Follow the beat? understanding conducting gestures from video

Authors:
Andrea Salgian;Micheal Pfirrmann;Teresa M. Nakra
Affiliations:
Department of Computer Science, The College of New Jersey, Ewing, NJ;Department of Computer Science, The College of New Jersey, Ewing, NJ;Department of Music, The College of New Jersey, Ewing, NJ
Venue:
ISVC'07 Proceedings of the 3rd international conference on Advances in visual computing - Volume Part I
Year:
2007

Citing 3
Cited 0

Action Recognition Using Probabilistic Parsing

CVPR '98 Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
Real-Time Online Adaptive Gesture Recognition

RATFG-RTS '99 Proceedings of the International Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems
Improving orchestral conducting systems in public spaces: examining the temporal characteristics and conceptual models of conducting gestures

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Quantified Score

Hi-index	0.01

Visualization

Abstract

In this paper we present a vision system that analyzes the gestures of a noted conductor conducting a real orchestra, a different approach from previous work that allowed users to conduct virtual orchestras with prerecorded scores. We use a low-resolution video sequence of a live performance of the Boston Symphony Orchestra, and we track the conductor's right hand. The tracker output is lined up with the output of an audio beat tracker run on the same sequence. The resulting analysis has numerous implications for the understanding of musical expression and gesture.