Not all tags are created equal: learning Flickr tag semantics for global annotation

  • Authors:

  • Emily Moxley;Jim Kleban;Jiejun Xu;B. S. Manjunath

  • Affiliations:

  • ECE/CS Departments, University of California Santa Barbara, Santa Barbara, CA;ECE/CS Departments, University of California Santa Barbara, Santa Barbara, CA;ECE/CS Departments, University of California Santa Barbara, Santa Barbara, CA;ECE/CS Departments, University of California Santa Barbara, Santa Barbara, CA

  • Venue:
  • ICME'09 Proceedings of the 2009 IEEE international conference on Multimedia and Expo
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

Large collaborative datasets offer the challenging opportunity of creating systems capable of extracting knowledge in the presence of noisy data. In this work we explore the ability to automatically learn tag semantics by mining a global geo-referenced image collection crawled from Flickr with the aim of improving an automatic annotation system. We are able to categorize sets of tags as places, landmarks, and visual descriptors. By organizing our dataset of more than 1.69 million images using a quadtree we can efficiently find geographic areas with sufficient density to provide useful results for place and landmark extraction. Precision-recall curves for our techniques compared with previous existing work used to identify place tags and manual groundtruth landmark annotation show the merit of our methods applied on a world scale.