A multimodal music transcription prototype: first steps in an interactive prototype development

  • Authors:
  • Tomás Pérez-García;José M. Iñesta;Pedro J. Ponce de León;Antonio Pertusa

  • Affiliations:
  • Universidad de Alicante, San Vicente, Spain;Universidad de Alicante, San Vicente, Spain;Universidad de Alicante, San Vicente, Spain;Universidad de Alicante, San Vicente, Spain

  • Venue:
  • ICMI '11 Proceedings of the 13th international conference on multimodal interfaces
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

Music transcription consists of transforming an audio signal encoding a music performance in a symbolic representation such as a music score. In this paper, a multimodal and interactive prototype to perform music transcription is presented. The system is oriented to monotimbral transcription, its working domain is music played by a single instrument. This prototype uses three different sources of information to detect notes in a musical audio excerpt. It has been developed to allow a human expert to interact with the system to improve its results. In its current implementation, it offers a limited range of interaction and multimodality. Further development aimed at full interactivity and multimodal interactions is discussed.