SalientShape: group saliency in image collections

  • Authors:

  • Ming-Ming Cheng;Niloy J. Mitra;Xiaolei Huang;Shi-Min Hu

  • Affiliations:

  • TNList, Tsinghua University, Beijing, China;University College London, London, UK;Lehigh University, Bethlehem, USA;TNList, Tsinghua University, Beijing, China

  • Venue:
  • The Visual Computer: International Journal of Computer Graphics
  • Year:
  • 2014

Quantified Score

Hi-index 0.00

Visualization

Abstract

Efficiently identifying salient objects in large image collections is essential for many applications including image retrieval, surveillance, image annotation, and object recognition. We propose a simple, fast, and effective algorithm for locating and segmenting salient objects by analysing image collections. As a key novelty, we introduce group saliency to achieve superior unsupervised salient object segmentation by extracting salient objects (in collections of pre-filtered images) that maximize between-image similarities and within-image distinctness. To evaluate our method, we construct a large benchmark dataset consisting of 15聽K images across multiple categories with 6000+ pixel-accurate ground truth annotations for salient object regions where applicable. In all our tests, group saliency consistently outperforms state-of-the-art single-image saliency algorithms, resulting in both higher precision and better recall. Our algorithm successfully handles image collections, of an order larger than any existing benchmark datasets, consisting of diverse and heterogeneous images from various internet sources.