Contextual tag inference

  • Authors:
  • Michael I. Mandel;Razvan Pascanu;Douglas Eck;Yoshua Bengio;Luca M. Aiello;Rossano Schifanella;Filippo Menczer

  • Affiliations:
  • Université de Montréal, Québec, Canada;Université de Montréal, Québec, Canada;Université de Montréal, Québec, Canada;Université de Montréal, Québec, Canada;Università di Torino;Università di Torino;Indiana University

  • Venue:
  • ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP) - Special section on ACM multimedia 2010 best paper candidates, and issue on social media
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

This article examines the use of two kinds of context to improve the results of content-based music taggers: the relationships between tags and between the clips of songs that are tagged. We show that users agree more on tags applied to clips temporally “closer” to one another; that conditional restricted Boltzmann machine models of tags can more accurately predict related tags when they take context into account; and that when training data is “smoothed” using context, support vector machines can better rank these clips according to the original, unsmoothed tags and do this more accurately than three standard multi-label classifiers.