The reacTable: exploring the synergy between live music performance and tabletop tangible interfaces
Proceedings of the 1st international conference on Tangible and embedded interaction
DAS'06 Proceedings of the 7th international conference on Document Analysis Systems
Hi-index | 0.00 |
Intuitive music playing using various digital musical instruments with specific tangible interfaces has become one of the ways to enjoy the music experience [Jorda et al. 2007]. When we start studying music, we need to learn how to read musical scores to understand the different instrumental parts and also understand the melody, rhythm, fingering and so on. However, reading scores is often a difficult task for beginners and could create a barrier for playing music. To solve this problem, we purpose a novel musical interface system named "onNote". In this system, physical markerless musical scores are used as instruments to play music intuitively (see Figure 1). The notes on the score are captured by a camera and are processed by the system which retrieves the music from a score database. In addition, the system can do a real-time recognition of the paper's position and the rotation. Thus, by physically moving and connecting the musical scores we can play music intuitively.