Automatic image annotation using visual content and folksonomies

  • Authors:
  • Stefanie Lindstaedt;Roland Mörzinger;Robert Sorschag;Viktoria Pammer;Georg Thallinger

  • Affiliations:
  • Know-Center / KMI TU Graz, Graz, Austria;Joanneum Research, Institute of Information Systems and Information Management, Graz, Austria 8010;Joanneum Research, Institute of Information Systems and Information Management, Graz, Austria 8010;Know-Center / KMI TU Graz, Graz, Austria;Joanneum Research, Institute of Information Systems and Information Management, Graz, Austria 8010

  • Venue:
  • Multimedia Tools and Applications
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

Automatic image annotation is an important and challenging task, and becomes increasingly necessary when managing large image collections. This paper describes techniques for automatic image annotation that take advantage of collaboratively annotated image databases, so called visual folksonomies. Our approach applies two techniques based on image analysis: First, classification annotates images with a controlled vocabulary and second tag propagation along visually similar images. The latter propagates user generated, folksonomic annotations and is therefore capable of dealing with an unlimited vocabulary. Experiments with a pool of Flickr images demonstrate the high accuracy and efficiency of the proposed methods in the task of automatic image annotation. Both techniques were applied in the prototypical tag recommender "tagr".