Summarizing tagged image collections by cross-media representativeness voting

  • Authors:
  • Hao Xu;Jingdong Wang;Xian-Sheng Hua;Shipeng Li

  • Affiliations:
  • MS KeyLab of MCC, University of Science and Technology of China, MOE;Microsoft Research Asia;Microsoft Research Asia;Microsoft Research Asia

  • Venue:
  • ICME'09 Proceedings of the 2009 IEEE international conference on Multimedia and Expo
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we address the problem of generating both visual and textual summaries for tagged image collections simultaneously. The visual and textual summaries consist of representative images and tags of the collection, which are selected through a proposed cross-media voting scheme. In the voting scheme, the likelihood of an image to be a representative is voted by not only other images but also the tags, according to the intra-media and cross-media affinities. The likelihood of a tag to be a representative is obtained in similar manner at the same time. We demonstrate that the proposed scheme produces more informative textual and visual summaries than summarizing images and tags separately.