Graph-based semi-supervised learning with multi-modality propagation for large-scale image datasets

  • Authors:

  • Wen-Yu Lee;Liang-Chi Hsieh;Guan-Long Wu;Winston Hsu

  • Affiliations:

  • The Graduate Institute of Networking and Multimedia, National Taiwan University, Taipei 10617, Taiwan;The Graduate Institute of Networking and Multimedia, National Taiwan University, Taipei 10617, Taiwan;The Graduate Institute of Networking and Multimedia, National Taiwan University, Taipei 10617, Taiwan;The Graduate Institute of Networking and Multimedia, National Taiwan University, Taipei 10617, Taiwan and Department of Computer Science and Information Engineering, National Taiwan University, Ta ...

  • Venue:
  • Journal of Visual Communication and Image Representation
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

Semi-supervised learning (SSL) is widely-used to explore the vast amount of unlabeled data in the world. Over the decade, graph-based SSL becomes popular in automatic image annotation due to its power of learning globally based on local similarity. However, recent studies have shown that the emergence of large-scale datasets challenges traditional methods. On the other hand, most previous works have concentrated on single-label annotation, which may not describe image contents well. To remedy the deficiencies, this paper proposes a new graph-based SSL technique with multi-label propagation, leveraging the distributed computing power of the MapReduce programming model. For high learning performance, the paper further presents both a multi-layer learning structure and a tag refinement approach, where the former unifies both visual and textual information of image data during learning, while the latter simultaneously suppresses noisy tags and emphasizes the other tags after learning. Experimental results based on a medium-scale and a large-scale image datasets show the effectiveness of the proposed methods.