Combining audio content and social context for semantic music discovery

  • Authors:
  • Douglas R. Turnbull;Luke Barrington;Gert Lanckriet;Mehrdad Yazdani

  • Affiliations:
  • Swarthmore College, Swarthmore, PA, USA;UC Sand Diego, La Jolla, CA, USA;UC San Diego, La Jolla, CA, USA;UC San Diego, La Jolla, CA, USA

  • Venue:
  • Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

When attempting to annotate music, it is important to consider both acoustic content and social context. This paper explores techniques for collecting and combining multiple sources of such information for the purpose of building a query-by-text music retrieval system. We consider two representations of the acoustic content (related to timbre and harmony) and two social sources (social tags and web documents). We then compare three algorithms that combine these information sources: calibrated score averaging (CSA), RankBoost, and kernel combination support vector machines (KC-SVM). We demonstrate empirically that each of these algorithms is superior to algorithms that use individual information sources.