Multiple instance learning with missing object tags

  • Authors:
  • Yi Shen;Jinye Peng;Xiaoyi Feng;Jianping Fan

  • Affiliations:
  • Northwestern Polytechnical University, Xian, P. R. China, and UNC-Charlotte, Charlotte, NC;Northwestern Polytechnical University Xian, P. R. China;Northwestern Polytechnical University Xian, P. R. China;Northwestern Polytechnical University, Xian, P. R. China, and UNC-Charlotte, Charlotte, NC

  • Venue:
  • Proceedings of the Third International Conference on Internet Multimedia Computing and Service
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we have addressed two key issues for leveraging large-scale loosely-tagged images for object classifier training: (a) loose object tags, e.g., multiple object tags are loosely given at the image level without identifying object locations in the images; (b) missing object tags, e.g., some object tags are missed and thus negative bags may contain positive instances. To address both the issues of loose object tags and missing object tags jointly, a novel multiple instance learning (MIL) algorithm is developed and it consists of the following key components: (1) An agreement value is defined for characterizing instance-tag relatedness; (2) Automatic instance clustering is performed and inter-cluster correlations are leveraged for agreement value refinement; (3) An automatic instance-tag alignment algorithm is developed for assigning multiple object tags into the most relevant image instances with maximum agreement values and determining uncertain image instances whose object tags are not available on the tag list (missing object tags); (4) Object co-occurrence contexts are leveraged to predict missing object tags for the uncertain image instances. Our experiments on large-scale loosely-tagged images have provided very positive results.