Towards reliable partial music alignments using multiple synchronization strategies

  • Authors:
  • Sebastian Ewert;Meinard Müller;Roger B. Dannenberg

  • Affiliations:
  • Multimedia Signal Processing Group, Bonn University, Bonn, Germany;Saarland University and MPI Informatik, Saarbrücken, Germany;School of Computer Science, Carnegie Mellon University, Pittsburgh

  • Venue:
  • AMR'09 Proceedings of the 7th international conference on Adaptive multimedia retrieval: understanding media and adapting to the user
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

The general goal of music synchronization is to align multiple information sources related to a given piece of music. This becomes a hard problem when the various representations to be aligned reveal significant differences not only in tempo, instrumentation, or dynamics but also in structure or polyphony. Because of the complexity and diversity of music data, one can not expect to find a universal synchronization algorithm that yields reasonable solutions in all situations. In this paper, we present a novel method that allows for automatically identifying the reliable parts of alignment results. Instead of relying on one single strategy, our idea is to combine several types of conceptually different synchronization strategies within an extensible framework, thus accounting for various musical aspects. Looking for consistencies and inconsistencies across the synchronization results, our method automatically classifies the alignments locally as reliable or critical. Considering only the reliable parts yields a high-precision partial alignment. Moreover, the identification of critical parts is also useful, as they often reveal musically interesting deviations between the versions to be aligned.