Gesture interaction for electronic music performance

Authors:
Reinhold Behringer
Affiliations:
Leeds Metropolitan University, Leeds, UK
Venue:
HCI'07 Proceedings of the 12th international conference on Human-computer interaction: intelligent multimodal interaction environments
Year:
2007

Citing 6
Cited 1

Automated accompaniment of musical ensembles

AAAI '94 Proceedings of the twelfth national conference on Artificial intelligence (vol. 1)
Conducting a Virtual Orchestra

IEEE MultiMedia
The importance of parameter mapping in electronic instrument design

NIME '02 Proceedings of the 2002 conference on New interfaces for musical expression
Immersion Music: a progress report

NIME '03 Proceedings of the 2003 conference on New interfaces for musical expression
Conducting Digitally Stored Music by Computer Vision Tracking

AXMEDIS '05 Proceedings of the First International Conference on Automated Production of Cross Media Content for Multi-Channel Distribution
Personal orchestra: conducting audio/video music recordings

WEDELMUSIC'02 Proceedings of the Second international conference on Web delivering of music

The visual keyboard: Real-time feet tracking for the control of musical meta-instruments

Image Communication

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper describes an approach for a system which analyses an orchestra conductor in real-time, with the purpose of using the extracted information of time pace and expression for an automatic play of a computer-controlled instrument (synthesizer). The system in its final stage will use non-intrusive computer vision methods to track the hands of the conductor. The main challenge is to interpret the motion of the hand/baton/mouse as beats for the timeline. The current implementation uses mouse motion to simulate the movement of the baton. It allows to "conduct" a pre-stored MIDI file of a classical orchestral music work on a PC.