The conductor program and mechanical baton
Current directions in computer music research
Inside the "conductor's jacket": analysis, interpretation and musical synthesis of expressive gesture
Possibilities for the digital baton as a general-purpose gestural interface
CHI EA '97 CHI '97 Extended Abstracts on Human Factors in Computing Systems
eWatch: A Wearable Sensor and Notification Platform
BSN '06 Proceedings of the International Workshop on Wearable and Implantable Body Sensor Networks
iSymphony: an adaptive interactive orchestral conducting system for digital audio and video streams
CHI '06 Extended Abstracts on Human Factors in Computing Systems
WiiArts: creating collaborative art experience with WiiRemote interaction
Proceedings of the 2nd international conference on Tangible and embedded interaction
Computers in Entertainment (CIE) - SPECIAL ISSUE: Media Arts and Games
UbiGesture: Customizing and Profiling Hand Gestures in Ubiquitous Environment
Proceedings of the 13th International Conference on Human-Computer Interaction. Part II: Novel Interaction Methods and Techniques
New Interaction Concepts by Using the Wii Remote
Proceedings of the 13th International Conference on Human-Computer Interaction. Part II: Novel Interaction Methods and Techniques
Pinocchio: a virtual symphony orchestra game
Proceedings of the ACM international conference companion on Object oriented programming systems languages and applications companion
A customizable recognizer for orchestral conducting gestures based on neural networks
EvoApplications'11 Proceedings of the 2011 international conference on Applications of evolutionary computation - Volume Part II
An evaluation of a low-cost 3-dimensional gestural interface: Wii3D
Proceedings of the South African Institute of Computer Scientists and Information Technologists Conference on Knowledge, Innovation and Leadership in a Diverse, Multidisciplinary Environment
Context-aware gesture recognition in classical music conducting
Proceedings of the 21st ACM international conference on Multimedia
| Hi-index | 0.00 |
We present a system that allows users of any skill to conduct a virtual orchestra. Tempo and volume of the orchestra's performance are influenced with a baton. Pinocchio works with several types of batons, differing in tracking method and in algorithms for gesture recognition. The virtual orchestra can be configured, allowing the muting, hiding and positioning of individual musicians or instrument groups in 3D space. The audio and video material is based on a professional recording session with the Bavarian symphony orchestra. Pinocchio's long-term goal is the creation of a multi-modal, device independent framework for gesture-based applications which require motor skills or the control and operation of a complex set of sensors in intelligent house or car driver assistance systems. In this paper, we describe the current development status of the project, detail its usage and finally give an overview over our future project goals.