Machine Learning
Playing Violin with Muscle Activity
Biosignals are often hard to deal with since the collected data are often hard to interpret, redundant, and noisy. Our approach illustrated in the video is to consider muscle activity as behaving as a spring-mass system. In other words, the muscle is... Read More
Using Motion Expressive Variations for Augmented Piano Performance
When performing a piece, a pianist’s interpretation is communicated both through the sound produced and through body gestures. We present PiaF (Piano Follower), a proto- type for augmenting piano performance by measuring gesture variations. We surv... Read More
Gesture expressivity through muscle sensing
Motivated by the understanding of gesture expressivity, complementary to our previous works working with shape gestures and free-air gestures, we aim to go further in the idea that expressivity is a visceral capacity of the human body. As such, to un... Read More
Gesture Variation Following (GVF): Algorithm and Application
The algorithm allows for early recognition of gestures (i.e. recognizing a gesture as soon as it starts) and allows for estimating gesture variation (such as speed, scale, orientation, ...) of a live gesture according to the learned (pre-recorded) te... Read More
Machine Learning of Musical Gestures: A Review
Machine learning (ML) techniques are increasingly used in a variety of fields, such as in interactive music and new digital instrument design. We want to provide the non-specialist reader an introduction to two ML tasks, classification and regression... Read More
Beyond recognition: Gesture Variation for Continuous Interaction
Gestural interaction has become commonplace in consumer electronics. Finger gestures captured on touch screens provide intuitive ways to interface with complex tasks, and some gestures such as pinch-zoom have become iconic. Most techniques for coding... Read More