A concept for using combined multimodal queries in digital music libraries

Authors:
David Damm;Frank Kurth;Christian Fremerey;Michael Clausen
Affiliations:
University of Bonn, Department of Computer Science III, Bonn, Germany;Research Establishment for Applied Science, FKIE-KOM, Wachtberg, Germany;University of Bonn, Department of Computer Science III, Bonn, Germany;University of Bonn, Department of Computer Science III, Bonn, Germany
Venue:
ECDL'09 Proceedings of the 13th European conference on Research and advanced technology for digital libraries
Year:
2009

Citing 5
Cited 1

Methodologies for Distributed Information Retrieval

ICDCS '98 Proceedings of the The 18th International Conference on Distributed Computing Systems
PROBADO --- A Generic Repository Integration Framework

ECDL '07 Proceedings of the 11th European conference on Research and Advanced Technology for Digital Libraries
Efficient Index-Based Audio Matching

IEEE Transactions on Audio, Speech, and Language Processing
Audio thumbnailing of popular music using chroma-based representations

IEEE Transactions on Multimedia
Lyrics-based audio retrieval and multimodal navigation in music collections

ECDL'07 Proceedings of the 11th European conference on Research and Advanced Technology for Digital Libraries

The PROBADO project: approach and lessons learned in building a digital library system for heterogeneous non-textual documents

ECDL'10 Proceedings of the 14th European conference on Research and advanced technology for digital libraries

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we propose a concept for using combined multimodal queries in the context of digital music libraries. Whereas usual mechanisms for content-based music retrieval only consider a single query mode, such as query-by-humming, full-text lyrics-search or query-by-example using short audio snippets, our proposed concept allows to combine those different modalities into one integrated query. Our particular contributions consist of concepts for query formulation, combined content-based retrieval and presentation of a suitably ranked result list. The proposed concepts have been realized within the context of the PROBADO Music Repository and allow for music retrieval based on combining full-text lyrics search and score-based query-by-example search.