Can social tagged images aid concept-based video search?

  • Authors:
  • Arjan T. Setz;Cees G. M. Snoek

  • Affiliations:
  • Intelligent Systems Lab Amsterdam, University of Amsterdam, Amsterdam, The Netherlands;Intelligent Systems Lab Amsterdam, University of Amsterdam, Amsterdam, The Netherlands

  • Venue:
  • ICME'09 Proceedings of the 2009 IEEE international conference on Multimedia and Expo
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper seeks to unravel whether commonly available social tagged images can be exploited as a training resource for concept-based video search. Since social tags are known to be ambiguous, overly personalized, and often error prone, we place special emphasis on the role of disambiguation. We present a systematic experimental study that evaluates concept detectors based on social tagged images, and their disambiguated versions, in three application scenarios: within-domain, cross-domain, and together with an interacting user. The results indicate that social tagged images can aid concept-based video search indeed, especially after disambiguation and when used in an interactive video retrieval setting. These results open-up interesting avenues for future research.