Score-informed audio decomposition and applications

  • Authors:
  • Jonathan Driedger;Harald Grohganz;Thomas Prätzlich;Sebastian Ewert;Meinard Müller

  • Affiliations:
  • International Audio Laboratories Erlangen, Erlangen, Germany;Bonn University, Bonn, Germany;International Audio Laboratories Erlangen, Erlangen, Germany;Queen Mary University of London, London, Gt Britain;International Audio Laboratories Erlangen, Erlangen, Germany

  • Venue:
  • Proceedings of the 21st ACM international conference on Multimedia
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

The separation of different sound sources from polyphonic music recordings constitutes a complex task since one has to account for different musical and acoustical aspects. In the last years, various score-informed procedures have been suggested where musical cues such as pitch, timing, and track information are used to support the source separation process. In this paper, we discuss a framework for decomposing a given music recording into notewise audio events which serve as elementary building blocks. In particular, we introduce an interface that employs the additional score information to provide a natural way for a user to interact with these audio events. By simply selecting arbitrary note groups within the score a user can access, modify, or analyze corresponding events in a given audio recording. In this way, our framework not only opens up new ways for audio editing applications, but also serves as a valuable tool for evaluating and better understanding the results of source separation algorithms.