Searching for Music Using Natural Language Queries and Relevance Feedback

  • Authors:
  • Peter Knees;Gerhard Widmer

  • Affiliations:
  • Dept. of Computational Perception, Johannes Kepler University, Linz, Austria;Dept. of Computational Perception, Johannes Kepler University, Linz, Austria and Austrian Research Institute for Artificial Intelligence (OFAI),

  • Venue:
  • Adaptive Multimedial Retrieval: Retrieval, User, and Semantics
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

We extend an approach to search inside large-scale music collections by enabling the user to give feedback on the retrieved music pieces. In the original approach, a search engine that can be queried through free-form natural language text is automatically built upon audio-based and Web-based similarity measures. Features for music pieces in the collection are derived automatically by retrieving relevant Web pages via Google queries and using the contents of these pages to construct term vectors. The additional use of information about acoustic similarity allows for reduction of the dimensionality of the vector space and characterization of audio pieces with no associated Web information. With the incorporation of relevance feedback, the retrieval of pieces can be adapted according to the preferences of the user and thus compensate for inadequately represented initial queries. The approach is evaluated on a collection comprising about 12,000 pieces by using semantic tags provided by Audioscrobblerand a user study which also gives further insights into users search behaviors.