Control Systems Engineering
Sensor systems for interactive surfaces
IBM Systems Journal
The AirStick: a free-gesture controller using infrared sensing
NIME '05 Proceedings of the 2005 conference on New interfaces for musical expression
Untethered robotic play for repetitive physical tasks
Proceedings of the 2005 ACM SIGCHI International Conference on Advances in computer entertainment technology
Musical-based interaction system for the Waseda Flutist Robot
Autonomous Robots
Hi-index | 0.00 |
We have created a new electronic musical instrument, referred to as the Termenova (Russian for "daughter of Theremin") that combines a free-gesture capacitive-sensing device with an optical sensing system that detects the reflection of a hand when it intersects a beam of an array of red lasers. The laser beams, which are made visible by a thin layer of theatrical mist, provide visual feedback and guidance to the performer to alleviate the difficulties of using a non-contact interface as well as adding an interesting component for the audience to observe. The system uses capacitive sensing to detect the proximity of the player's hands; this distance is mapped to pitch, volume, or other continuous effect. The laser guide positions are calibrated before play with position-controlled servo motors interfaced to a main controller board; the location of each beam corresponds to the position where the performer should move his or her hand to achieve a pre-specified pitch and/or effect. The optical system senses the distance of the player's hands from the source of each laser beam, providing an additional dimension of musical control.