International Journal of Human-Computer Studies - Application of affective computing in human—Computer interaction
You're the conductor: a realistic interactive conducting system for children
NIME '04 Proceedings of the 2004 conference on New interfaces for musical expression
Pinocchio: conducting a virtual symphony orchestra
Proceedings of the international conference on Advances in computer entertainment technology
Continuous realtime gesture following and recognition
GW'09 Proceedings of the 8th international conference on Gesture in Embodied Communication and Human-Computer Interaction
Towards a gesture-sound cross-modal analysis
GW'09 Proceedings of the 8th international conference on Gesture in Embodied Communication and Human-Computer Interaction
| Hi-index | 0.00 |
Body movement has received increasing attention in music technology research during the last years. Some new musical interfaces make use of gestures to control music in a meaningful and intuitive way. A typical approach is to use the orchestra conducting paradigm, in which the computer that generates the music would be a \textit{virtual orchestra} conducted by the user. However, although conductors' gestures are complex and their meaning can vary depending on the musical context, this context-dependency is still to explore. We propose a method to study context-dependency of body and facial gestures of conductors in orchestral classical music based on temporal clustering of gestures into actions, followed by an analysis of the evolution of audio features after action occurrences. For this, multi-modal data (audio, video, motion capture) will be recorded in real live concerts and rehearsals situations using unobtrusive techniques.