Electronic music: new ways to play
IEEE Spectrum
Principles for designing computer music controllers
NIME '01 Proceedings of the 2001 conference on New interfaces for musical expression
The importance of parameter mapping in electronic instrument design
NIME '02 Proceedings of the 2002 conference on New interfaces for musical expression
Instruments, interactivity, and inevitability
NIME '02 Proceedings of the 2002 conference on New interfaces for musical expression
Digital instruments and players: part I --- efficiency and apprenticeship
NIME '04 Proceedings of the 2004 conference on New interfaces for musical expression
Evaluation of Input Devices for Musical Expression: Borrowing Tools from HCI
Computer Music Journal
Physical modeling of drums by transfer function methods
ICASSP '01 Proceedings of the Acoustics, Speech, and Signal Processing, 2001. on IEEE International Conference - Volume 05
User interface comparison for virtual drums
NIME '05 Proceedings of the 2005 conference on New interfaces for musical expression
A VR interface for collaborative 3D audio performance
NIME '06 Proceedings of the 2006 conference on New interfaces for musical expression
A framework for immersive spatial audio performance
NIME '06 Proceedings of the 2006 conference on New interfaces for musical expression
The augmented djembe drum: sculpting rhythms
NIME '06 Proceedings of the 2006 conference on New interfaces for musical expression
Grasp registration and learning in virtual reality environments
CIMMACS'09 Proceedings of the 8th WSEAS International Conference on Computational intelligence, man-machine systems and cybernetics
Model-based hand tracking by chamfer distance and adaptive color learning using particle filter
Journal on Image and Video Processing - Special issue on video-based modeling, analysis, and recognition of human motion
Vision-based guitarist fingering tracking using a Bayesian classifier and particle filters
PSIVT'07 Proceedings of the 2nd Pacific Rim conference on Advances in image and video technology
Leveraging behavioral models of sounding objects forgesture-controlled sound design
Proceedings of the fifth international conference on Tangible, embedded, and embodied interaction
Design of a touchless multipoint musical interface in a virtual studio environment
Proceedings of the 8th International Conference on Advances in Computer Entertainment Technology
Airstic drum: a drumstick for integration of real and virtual drums
ACE'12 Proceedings of the 9th international conference on Advances in Computer Entertainment
| Hi-index | 0.00 |
In this paper, we introduce and analyze four gesture-controlled musical instruments. We briefly discuss the test platform designed to allow for rapid experimentation of new interfaces and control mappings. We describe our design experiences and discuss the effects of system features such as latency, resolution and lack of tactile feedback. The instruments use virtual reality hardware and computer vision for user input, and three-dimensional stereo vision as well as simple desktop displays for providing visual feedback. The instrument sounds are synthesized in real-time using physical sound modeling.