Annotating images with suggestions: user study of a tagging system

  • Authors:
  • Michal Hradi$#353;Martin Kol$#225;$#345;Ale$#353; L$#225;ník;Ji$#345;í Kr$#225;l;Pavel Zemčík;Pavel Smrž

  • Affiliations:
  • Faculty of Information Technology, VUT -- Brno University of Technology, Brno, Czech Republic;Faculty of Information Technology, VUT -- Brno University of Technology, Brno, Czech Republic;Faculty of Information Technology, VUT -- Brno University of Technology, Brno, Czech Republic;Faculty of Information Technology, VUT -- Brno University of Technology, Brno, Czech Republic;Faculty of Information Technology, VUT -- Brno University of Technology, Brno, Czech Republic;Faculty of Information Technology, VUT -- Brno University of Technology, Brno, Czech Republic

  • Venue:
  • ACIVS'12 Proceedings of the 14th international conference on Advanced Concepts for Intelligent Vision Systems
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper explores the concept of image-wise tagging. It introduces a web-based user interface for image annotation, and a novel method for modeling dependencies of tags using Restricted Boltzmann Machines which is able to suggest probable tags for an image based on previously assigned tags. According to our user study, our tag suggestion methods improve both user experience and annotation speed. Our results demonstrate that large datasets with semantic labels (such as in TRECVID Semantic Indexing) can be annotated much more efficiently with the proposed approach than with current class-domain-wise methods, and produce higher quality data.