Showing posts with label Gesture Recognition. Show all posts
Showing posts with label Gesture Recognition. Show all posts

Sunday, February 8, 2015

Bowing gestures - Bach Preludio





https://www.youtube.com/watch?v=W69LxKA0BdQ




PROBABILISTIC MODELING OF BOWING GESTURES FOR
GESTURE-BASED VIOLIN SOUND SYNTHESIS

We present a probabilistic approach to modeling violin bowing gestures, for the purpose of synthesizing violin sound from a musical score. The gesture models are based on Gaussian processes, a principled probabilistic framework. Models for bow velocity, bow-bridge distance and bow force during a stroke are learned from training data of recorded bowing motion. From the models of bow motion during a stroke, slightly novel bow motion can be synthesized, varying in a random manner along the main modes of variation learned from the data. Such synthesized bow strokes can be stitched together to form a continuous bowing motion, which can drive a physical violin model, producing naturalistic violin sound. Listening tests show that the sound produced from the synthetic bowing motion is perceived as very similar to sound produced from real bowing motion, recorded with motion capture. Even more importantly, the Gaussian process framework allows modeling short and long range temporal dependencies, as well as learning latent style parameters from the training data in an unsupervised manner.

http://www.csc.kth.se/~hedvig/publications/smac_13.pdf

Monday, July 28, 2014

Full-body joystick



The Virtualizer’s flat base plate has a low-friction surface that enables you to walk, run, and strafe freely in every direction. As it’s flat, movement feels realistic, dramatically enhancing immersion. The uniquely constructed ring allows for vertical movements such as jumping and crouching, as well as a 360° axial rotation. The adjustable harness ensures that movement through virtual worlds is effortless…you can even sit down!

SOURCES:




Saturday, June 7, 2014

AllSee: Bringing Gesture Recognition to All Devices


What is AllSee and how does it work?

Existing gesture-recognition systems consume significant power and computational resources that limit how they may be used in low-end devices. We introduce AllSee, the first gesture-recognition system that can operate on a range of computing devices including those with no batteries. AllSee consumes three to four orders of magnitude lower power than state-of-the-art systems and can enable always-on gesture recognition for smartphones and tablets. It extracts gesture information from existing wireless signals (e.g., TV transmissions), but does not incur the power and computational overheads of prior wireless approaches. We build AllSee prototypes that can recognize gestures on RFID tags and power-harvesting sensors. We also integrate our hardware with an off-the-shelf Samsung Galaxy Nexus phone. This enables gesture control such as volume changes while the phone is in a pocket.      


http://allsee.cs.washington.edu/files/allsee.pdf
http://allsee.cs.washington.edu/