A Framework for Managing Multimodal Digitized Music Collections

  • Authors:

  • Frank Kurth;David Damm;Christian Fremerey;Meinard Müller;Michael Clausen

  • Affiliations:

  • Research Establishment for Applied Science (FGAN), FKIE-KOM, Wachtberg, Germany 53343;Department of Computer Science III, University of Bonn, Bonn, Germany 53117;Department of Computer Science III, University of Bonn, Bonn, Germany 53117;Max-Planck-Institut für Informatik,Department D4 - Computer Graphics, Saarbrücken, Germany 66123;Department of Computer Science III, University of Bonn, Bonn, Germany 53117

  • Venue:
  • ECDL '08 Proceedings of the 12th European conference on Research and Advanced Technology for Digital Libraries
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we present a framework for managing heterogeneous, multimodal digitized music collections containing visual music representations (scanned sheet music) as well as acoustic music material (audio recordings). As a first contribution, we propose a preprocessing workflow comprising feature extraction, audio indexing, and music synchronization (linking the visual with the acoustic data). Then, as a second contribution, we introduce novel user interfaces for multimodal music presentation, navigation, and content-based retrieval. In particular, our system offers high quality audio playback with time-synchronous display of the digitized sheet music. Furthermore, our system allows a user to select regions within the scanned pages of a musical score in order to search for musically similar sections within the audio documents. Our novel user interfaces and search functionalities will be integrated into the library service system of the Bavarian State Library as part of the Probado project.