Machine Learning

Playing Violin with Muscle Activity


Biosignals are often hard to deal with since the collected data are often hard to interpret, redundant, and noisy. Our approach illustrated in the video is to consider muscle activity as behaving as a spring-mass system. In other words, the muscle is... Read More

Using Motion Expressive Variations for Augmented Piano Performance


When performing a piece, a pianist’s interpretation is communicated both through the sound produced and through body gestures. We present PiaF (Piano Follower), a proto- type for augmenting piano performance by measuring gesture variations. We surv... Read More

Gesture expressivity through muscle sensing


Motivated by the understanding of gesture expressivity, complementary to our previous works working with shape gestures and free-air gestures, we aim to go further in the idea that expressivity is a visceral capacity of the human body. As such, to un... Read More

Gesture Variation Following (GVF): Algorithm and Application


The algorithm allows for early recognition of gestures (i.e. recognizing a gesture as soon as it starts) and allows for estimating gesture variation (such as speed, scale, orientation, ...) of a live gesture according to the learned (pre-recorded) te... Read More

Machine Learning of Musical Gestures: A Review


Machine learning (ML) techniques are increasingly used in a variety of fields, such as in interactive music and new digital instrument design. We want to provide the non-specialist reader an introduction to two ML tasks, classification and regression... Read More

Beyond recognition: Gesture Variation for Continuous Interaction


Gestural interaction has become commonplace in consumer electronics. Finger gestures captured on touch screens provide intuitive ways to interface with complex tasks, and some gestures such as pinch-zoom have become iconic. Most techniques for coding... Read More