Wireless sensor interface and gesture-follower for music pedagogy

Authors:
Frederic Bevilacqua;Fabrice Guédy;Norbert Schnell;Emmanuel Fléty;Nicolas Leroy
Affiliations:
Real Time Musical Interactions Ircam -- CNRS STMS, Paris -- France;Real Time Musical Interactions Ircam -- CNRS STMS, Paris -- France;Real Time Musical Interactions Ircam -- CNRS STMS, Paris -- France;Ircam Centre Pompidou, Paris -- France;Ircam Centre Pompidou, Paris -- France
Venue:
NIME '07 Proceedings of the 7th international conference on New interfaces for musical expression
Year:
2007

Citing 11
Cited 5

An Inertial Measurement Framework for Gesture Recognition and Applications

GW '01 Revised Papers from the International Gesture Workshop on Gesture and Sign Languages in Human-Computer Interaction
TOASTER and KROONDE: high-resolution and high-speed real-time sensor interfaces

NIME '04 Proceedings of the 2004 conference on New interfaces for musical expression
MnM: a Max/MSP mapping toolbox

NIME '05 Proceedings of the 2005 conference on New interfaces for musical expression
The Wise Box: a multi-performer wireless sensor interface using WiFi and OSC

NIME '05 Proceedings of the 2005 conference on New interfaces for musical expression
Toward a Framework for Interactive Systems to Conduct Digital Audio and Video Streams

Computer Music Journal
Sensemble: a wireless, compact, multi-user sensor system for interactive dance

NIME '06 Proceedings of the 2006 conference on New interfaces for musical expression
MICON a music stand for interactive conducting

NIME '06 Proceedings of the 2006 conference on New interfaces for musical expression
conga: a framework for adaptive conducting gesture analysis

NIME '06 Proceedings of the 2006 conference on New interfaces for musical expression
GRASSP: gesturally-realized audio, speech and song performance

NIME '06 Proceedings of the 2006 conference on New interfaces for musical expression
Learning musical instrument skills through interactive sonification

NIME '06 Proceedings of the 2006 conference on New interfaces for musical expression
The augmented violin project: research, composition and performance report

NIME '06 Proceedings of the 2006 conference on New interfaces for musical expression

3d augmented mirror: a multimodal interface for string instrument learning and teaching with gesture support

Proceedings of the 9th international conference on Multimodal interfaces
Perspectives on gesture–sound relationships informed from acoustic instrument studies

Organised Sound
Continuous realtime gesture following and recognition

GW'09 Proceedings of the 8th international conference on Gesture in Embodied Communication and Human-Computer Interaction
Recognition of gesture sequences in real-time flow, context of virtual theater

GW'09 Proceedings of the 8th international conference on Gesture in Embodied Communication and Human-Computer Interaction
Fluid gesture interaction design: Applications of continuous recognition for the design of modern gestural interfaces

ACM Transactions on Interactive Intelligent Systems (TiiS)

Quantified Score

Hi-index	0.00

Visualization

Abstract

We present in this paper a complete gestural interface built to support music pedagogy. The development of this prototype concerned both hardware and software components: a small wireless sensor interface including accelerometers and gyroscopes, and an analysis system enabling gesture following and recognition. A first set of experiments was conducted with teenagers in a music theory class. The preliminary results were encouraging concerning the suitability of these developments in music education.