Image annotation with weak labels

  • Authors:
  • Feng Tian;Xukun Shen

  • Affiliations:
  • State Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing, China,School of Computer and Information Technology, Northeast Petroleum University, Daqing, China;State Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing, China

  • Venue:
  • WAIM'13 Proceedings of the 14th international conference on Web-Age Information Management
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we address the problem of image annotation when the given labels of training image are incomplete, inaccurate, and unevenly distributed, in the form of weak labels, which is frequently encountered when dealing with large scale web image training set. We introduce a progressive semantic neighborhood learning approach that explicitly addresses the challenge of learning from weakly labeled image by searching image's semantic consistent neighborhood. Neighbors in image's semantic consistent neighborhood have global similarity, partial correlation, conceptual similarity along with semantic balance. We also present an efficient label inference algorithm to handle noise by minimizing the neighborhood reconstruction error. Experiments with different data sets show that the proposed framework is more effective than the state-of-the-art algorithms in dealing with weakly labeled datasets.