Lyrics-based audio retrieval and multimodal navigation in music collections

  • Authors:

  • Meinard Müller;Frank Kurth;David Damm;Christian Fremerey;Michael Clausen

  • Affiliations:

  • Department of Computer Science III, University of Bonn, Bonn, Germany;Department of Computer Science III, University of Bonn, Bonn, Germany;Department of Computer Science III, University of Bonn, Bonn, Germany;Department of Computer Science III, University of Bonn, Bonn, Germany;Department of Computer Science III, University of Bonn, Bonn, Germany

  • Venue:
  • ECDL'07 Proceedings of the 11th European conference on Research and Advanced Technology for Digital Libraries
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

Modern digital music libraries contain textual, visual, and audio data describing music on various semantic levels. Exploiting the availability of different semantically interrelated representations for a piece of music, this paper presents a query-by-lyrics retrieval system that facilitates multimodal navigation in CD audio collections. In particular, we introduce an automated method to time align given lyrics to an audio recording of the underlying song using a combination of synchronization algorithms. Furthermore, we describe a lyrics search engine and show how the lyrics-audio alignments can be used to directly navigate from the list of query results to the corresponding matching positions within the audio recordings. Finally, we present a user interface for lyrics-based queries and playback of the query results that extends the functionality of our SyncPlayer framework for content-based music and audio navigation.