Multimodal presentation and browsing of music

  • Authors:

  • David Damm;Christian Fremerey;Frank Kurth;Meinard Müller;Michael Clausen

  • Affiliations:

  • University of Bonn, Bonn, Germany;University of Bonn, Bonn, Germany;Research Establishment for Applied Science, Wachtberg, Germany;Max-Planck-Institut für Informatik, Saarbrücken, Germany;University of Bonn, Bonn, Germany

  • Venue:
  • ICMI '08 Proceedings of the 10th international conference on Multimodal interfaces
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

Recent digitization efforts have led to large music collections, which contain music documents of various modes comprising textual, visual and acoustic data. In this paper, we present a multimodal music player for presenting and browsing digitized music collections consisting of heterogeneous document types. In particular, we concentrate on music documents of two widely used types for representing a musical work, namely visual music representation (scanned images of sheet music) and associated interpretations (audio recordings). We introduce novel user interfaces for multimodal (audio-visual) music presentation as well as intuitive navigation and browsing. Our system offers high quality audio playback with time-synchronous display of the digitized sheet music associated to a musical work. Furthermore, our system enables a user to seamlessly crossfade between various interpretations belonging to the currently selected musical work.