onNote: a musical interface using markerless physical scores

  • Authors:
  • Yusuke Yamamoto;Hideaki Uchiyama;Yasuaki Kakehi

  • Affiliations:
  • Keio University;INRIA Rennes;Keio University

  • Venue:
  • ACM SIGGRAPH 2011 Posters
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

Intuitive music playing using various digital musical instruments with specific tangible interfaces has become one of the ways to enjoy the music experience [Jorda et al. 2007]. When we start studying music, we need to learn how to read musical scores to understand the different instrumental parts and also understand the melody, rhythm, fingering and so on. However, reading scores is often a difficult task for beginners and could create a barrier for playing music. To solve this problem, we purpose a novel musical interface system named "onNote". In this system, physical markerless musical scores are used as instruments to play music intuitively (see Figure 1). The notes on the score are captured by a camera and are processed by the system which retrieves the music from a score database. In addition, the system can do a real-time recognition of the paper's position and the rotation. Thus, by physically moving and connecting the musical scores we can play music intuitively.