The conductor program and mechanical baton
Current directions in computer music research
WorldBeat: designing a baton-based interface for an interactive music exhibit
Proceedings of the ACM SIGCHI Conference on Human factors in computing systems
Implementation of a 3D virtual drummer
Proceedings of the Eurographic workshop on Computer animation and simulation
Tele-kinesthetic interaction: using hand muscles to interact with a tangible 3D object
ACM SIGGRAPH 2006 Emerging technologies
| Hi-index | 0.00 |
We have been developing a new type of human-computer interface, myokinetic synthesizer (MyoKinSynthesizer), using electromyography (EMG) signals. It enables a user to select virtual instruments and to control its properties such as volume and tone without any position or force sensors. The virtual marimba system emulates the basic properties of the real instrument by producing a sound depending on in which of eight zones and how hard the user is hitting. The virtual drum set is composed of 4 different virtual drums controlled by arms and legs. We used a three-layer neural network to estimate position and force of the forearm from EMG signals. After training the neural network and obtaining appropriate weights, the subject was able to control the movement of virtual avatar and to play virtual instruments. The system was destined to be used as a demonstration of VR entertainment and music therapy rehabilitation.