A State-Based Approach to the Representation and Recognition of Gesture
IEEE Transactions on Pattern Analysis and Machine Intelligence
The Hierarchical Hidden Markov Model: Analysis and Applications
Machine Learning
MnM: a Max/MSP mapping toolbox
NIME '05 Proceedings of the 2005 conference on New interfaces for musical expression
Early Recognition and Prediction of Gestures
ICPR '06 Proceedings of the 18th International Conference on Pattern Recognition - Volume 03
Online Handwritten Shape Recognition Using Segmental Hidden Markov Models
IEEE Transactions on Pattern Analysis and Machine Intelligence
Wireless sensor interface and gesture-follower for music pedagogy
NIME '07 Proceedings of the 7th international conference on New interfaces for musical expression
A hybrid HMM/DPA adaptive gesture recognition method
ISVC'05 Proceedings of the First international conference on Advances in Visual Computing
IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews
Computers in Entertainment (CIE) - Theoretical and Practical Computer Applications in Entertainment
From dance to touch: movement qualities for interaction design
CHI '11 Extended Abstracts on Human Factors in Computing Systems
The urban musical game: using sport balls as musical interfaces
CHI '12 Extended Abstracts on Human Factors in Computing Systems
Proton++: a customizable declarative multitouch framework
Proceedings of the 25th annual ACM symposium on User interface software and technology
Proceedings of the Virtual Reality International Conference: Laval Virtual
Beyond recognition: using gesture variation for continuous interaction
CHI '13 Extended Abstracts on Human Factors in Computing Systems
The space between the notes: adding expressive pitch control to the piano keyboard
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Gesture--sound mapping by demonstration in interactive music systems
Proceedings of the 21st ACM international conference on Multimedia
Context-aware gesture recognition in classical music conducting
Proceedings of the 21st ACM international conference on Multimedia
Programming mixed music in ReactiveML
Proceedings of the first ACM SIGPLAN workshop on Functional art, music, modeling & design
ACM Transactions on Interactive Intelligent Systems (TiiS)
The conductor's philosophy: embodied generative visual music
Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction
| Hi-index | 0.00 |
We present a HMM based system for real-time gesture analysis. The system outputs continuously parameters relative to the gesture time progression and its likelihood. These parameters are computed by comparing the performed gesture with stored reference gestures. The method relies on a detailed modeling of multidimensional temporal curves. Compared to standard HMM systems, the learning procedure is simplified using prior knowledge allowing the system to use a single example for each class. Several applications have been developed using this system in the context of music education, music and dance performances and interactive installation. Typically, the estimation of the time progression allows for the synchronization of physical gestures to sound files by time stretching/compressing audio buffers or videos.