Automatic synchronisation between audio and score musical description layers

  • Authors:
  • Antonello D'Aguanno;Giancarlo Vercellesi

  • Affiliations:
  • Laboratorio di Informatica Musicale, Dipartimento di Informatica e Comunicazione, Universitá degli Studi di Milano, Milano, Italy;Laboratorio di Informatica Musicale, Dipartimento di Informatica e Comunicazione, Universitá degli Studi di Milano, Milano, Italy

  • Venue:
  • SAMT'07 Proceedings of the semantic and digital media technologies 2nd international conference on Semantic Multimedia
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

This work describes algorithms dedicated to score and audio alignment using the MX / IEEE P1599 format. The format allows description of the score, and management of synchronisation points, linking them with different versions of the performed music. An algorithm is proposed here that allows alignment of an MX score and its execution, coded in PCM format, which produces an output for the MX Spine that contains synchronisation between notes and audio signal. The proposed architecture is based on two different steps: the first deals with the audio level and the extraction of features like pitch, onset and the like, while the second determines the alignment between the features extracted in the first step and the notes present in the MX score. For each step, different algorithms are proposed and discussed, and analysis and comparison of synchronisation capabilities are provided.