Using Multiple Segmentations to Discover Objects and their Extent in Image Collections

Authors:
Bryan C. Russell;William T. Freeman;Alexei A. Efros;Josef Sivic;Andrew Zisserman
Affiliations:
MIT;MIT;Carnegie Mellon University;University of Oxford, UK;University of Oxford, UK
Venue:
CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2
Year:
2006

Citing 0
Cited 92

Review: Which is the best way to organize/classify images by content?

Image and Vision Computing
Photo clip art

ACM SIGGRAPH 2007 papers
Using multiple segmentations for image auto-annotation

Proceedings of the 6th ACM international conference on Image and video retrieval
Recovering Surface Layout from an Image

International Journal of Computer Vision
LabelMe: A Database and Web-Based Tool for Image Annotation

International Journal of Computer Vision
Non-negative matrix factorisation for object class discovery and image auto-annotation

CIVR '08 Proceedings of the 2008 international conference on Content-based image and video retrieval
Object detection by global contour shape

Pattern Recognition
Unsupervised modeling and recognition of object categories with combination of visual contents and geometric similarity links

MIR '08 Proceedings of the 1st ACM international conference on Multimedia information retrieval
Weakly Supervised Object Localization with Stable Segmentations

ECCV '08 Proceedings of the 10th European Conference on Computer Vision: Part I
Some Objects Are More Equal Than Others: Measuring and Predicting Importance

ECCV '08 Proceedings of the 10th European Conference on Computer Vision: Part I
Shape Matching by Segmentation Averaging

ECCV '08 Proceedings of the 10th European Conference on Computer Vision: Part I
3D Object Modeling and Segmentation Based on Edge-Point Matching with Local Descriptors

ISVC '08 Proceedings of the 4th International Symposium on Advances in Visual Computing
Robust Higher Order Potentials for Enforcing Label Consistency

International Journal of Computer Vision
Shape Based Detection and Top-Down Delineation Using Image Segments

International Journal of Computer Vision
Learning Functional Object-Categories from a Relational Spatio-Temporal Representation

Proceedings of the 2008 conference on ECAI 2008: 18th European Conference on Artificial Intelligence
Unsupervised modeling of objects and their hierarchical contextual interactions

Journal on Image and Video Processing - Special issue on patches in vision
Contextual classification of image patches with latent aspect models

Journal on Image and Video Processing - Special issue on patches in vision
Foreground Focus: Unsupervised Learning from Partially Matching Images

International Journal of Computer Vision
Object Matching in Distributed Video Surveillance Systems by LDA-Based Appearance Descriptors

ICIAP '09 Proceedings of the 15th International Conference on Image Analysis and Processing
Scale-invariant visual language modeling for object categorization

IEEE Transactions on Multimedia - Special issue on integration of context and content
Patch Growing: Object segmentation using spatial coherence of local patches

Proceedings of the 2009 conference on Artificial Intelligence Research and Development: Proceedings of the 12th International Conference of the Catalan Association for Artificial Intelligence
Patch Growing: Object segmentation using spatial coherence of local patches

Proceedings of the 2009 conference on Artificial Intelligence Research and Development: Proceedings of the 12th International Conference of the Catalan Association for Artificial Intelligence
3D Object Mapping by Integrating Stereo SLAM and Object Segmentation Using Edge Points

ISVC '09 Proceedings of the 5th International Symposium on Advances in Visual Computing: Part I
Leveraging social media for training object detectors

DSP'09 Proceedings of the 16th international conference on Digital Signal Processing
Grounding of word meanings in multimodal concepts using LDA

IROS'09 Proceedings of the 2009 IEEE/RSJ international conference on Intelligent robots and systems
Interactive image segmentation using probabilistic hypergraphs

Pattern Recognition
Unsupervised Object Discovery: A Comparison

International Journal of Computer Vision
Learning natural scene categories by selective multi-scale feature extraction

Image and Vision Computing
Multi-view Superpixel Stereo in Urban Environments

International Journal of Computer Vision
Unsupervised identification of multiple objects of interest from multiple images: dISCOVER

ACCV'07 Proceedings of the 8th Asian conference on Computer vision - Volume Part II
Semi-latent Dirichlet allocation: a hierarchical model for human action recognition

Proceedings of the 2nd conference on Human motion: understanding, modeling, capture and animation
Recognizing activities with multiple cues

Proceedings of the 2nd conference on Human motion: understanding, modeling, capture and animation
Scene image segmentation based on perceptual organization

ICIP'09 Proceedings of the 16th IEEE international conference on Image processing
Leveraging loosely-tagged images and inter-object correlations for tag recommendation

Proceedings of the international conference on Multimedia
Unified tag analysis with multi-edge graph

Proceedings of the international conference on Multimedia
Mining and cropping common objects from images

Proceedings of the international conference on Multimedia
Avoiding confusing features in place recognition

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part I
From region based image representation to object discovery and recognition

SSPR&SPR'10 Proceedings of the 2010 joint IAPR international conference on Structural, syntactic, and statistical pattern recognition
Localizing objects while learning their appearance

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part IV
From a set of shapes to object discovery

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part V
Attribute-based transfer learning for object categorization with zero/one training example

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part V
Graph cut based inference with co-occurrence statistics

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part V
ClassCut for unsupervised class segmentation

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part V
Category independent object proposals

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part V
Image segmentation with topic random field

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part V
Object recognition with hierarchical stel models

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part VI
Figure-ground image segmentation helps weakly-supervised learning of objects

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part VI
Using the knowledge of object colors to segment images and improve web image search

Large Scale Semantic Access to Content (Text, Image, Video, and Sound)
Recovering Occlusion Boundaries from an Image

International Journal of Computer Vision
Geographical topic discovery and comparison

Proceedings of the 20th international conference on World wide web
Object class segmentation using reliable regions

ACCV'10 Proceedings of the 10th Asian conference on Computer vision - Volume Part II
Inference and Learning with Hierarchical Shape Models

International Journal of Computer Vision
Event detection with spatial latent Dirichlet allocation

Proceedings of the 11th annual international ACM/IEEE joint conference on Digital libraries
Semantics extraction from images

Knowledge-driven multimedia information extraction and ontology evolution
Geometric Latent Dirichlet Allocation on a Matching Graph for Large-scale Image Datasets

International Journal of Computer Vision
Spectral clustering of ROIs for object discovery

DAGM'11 Proceedings of the 33rd international conference on Pattern recognition
Exploiting context aware category discovery for image labeling

Proceedings of the Third International Conference on Internet Multimedia Computing and Service
Hybrid generative-discriminative nucleus classification of renal cell carcinoma

SIMBAD'11 Proceedings of the First international conference on Similarity-based pattern recognition
A hierarchical latent topic model based on sparse coding

Neurocomputing
KDE Paring and a Faster Mean Shift Algorithm

SIAM Journal on Imaging Sciences
Incrementally discovering object classes using similarity propagation and graph clustering

ACCV'09 Proceedings of the 9th Asian conference on Computer Vision - Volume Part III
Accurate Object Recognition with Shape Masks

International Journal of Computer Vision
Video fingerprinting using Latent Dirichlet Allocation and facial images

Pattern Recognition
Leveraging social media for scalable object detection

Pattern Recognition
What makes Paris look like Paris?

ACM Transactions on Graphics (TOG) - SIGGRAPH 2012 Conference Proceedings
Shape-Based Object Detection via Boundary Structure Segmentation

International Journal of Computer Vision
3D Material Style Transfer

Computer Graphics Forum
Label-to-region with continuity-biased bi-layer sparsity priors

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
Weakly Supervised Localization and Learning with Generic Knowledge

International Journal of Computer Vision
Human motion retrieval using topic model

Computer Animation and Virtual Worlds
A survey of graph theoretical approaches to image segmentation

Pattern Recognition
Object-Centric spatial pooling for image classification

ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part II
Unsupervised discovery of mid-level discriminative patches

ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part II
Constrained semi-supervised learning using attributes and comparative attributes

ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part III
Connecting missing links: object discovery from sparse observations using 5 million product images

ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part VI
"Clustering by composition": unsupervised discovery of image categories

ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part VII
Climbing: a unified approach for global constraints on hierarchical segmentation

ECCV'12 Proceedings of the 12th international conference on Computer Vision - Volume Part III
Are buildings only instances?: exploration in architectural style categories

Proceedings of the Eighth Indian Conference on Computer Vision, Graphics and Image Processing
Latent Dirichlet allocation for image segmentation and source finding in radio astronomy images

Proceedings of the 27th Conference on Image and Vision Computing New Zealand
Detecting regions from single scale edges

ECCV'10 Proceedings of the 11th European conference on Trends and Topics in Computer Vision - Volume Part I
Visual tracking by proto-objects

Pattern Recognition
A region-centered topic model for object discovery and category-based image segmentation

Pattern Recognition
One-Class multiple instance learning via robust PCA for common object discovery

ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part I
Sparse online topic models

Proceedings of the 22nd international conference on World Wide Web
Variational learning of a Dirichlet process of generalized Dirichlet distributions for simultaneous clustering and feature selection

Pattern Recognition
Inference Methods for CRFs with Co-occurrence Statistics

International Journal of Computer Vision
A boosting approach for the simultaneous detection and segmentation of generic objects

Pattern Recognition Letters
Integrating low-level and semantic features for object consistent segmentation

Neurocomputing
Visualizing brand associations from web community photos

Proceedings of the 7th ACM international conference on Web search and data mining
Learning discriminative localization from weakly labeled data

Pattern Recognition
Robust subspace discovery via relaxed rank minimization

Neural Computation
Learning what is where from unlabeled images: joint localization and clustering of foreground objects

Machine Learning

Quantified Score

Hi-index	0.00

Visualization

Abstract

Given a large dataset of images, we seek to automatically determine the visually similar object and scene classes together with their image segmentation. To achieve this we combine two ideas: (i) that a set of segmented objects can be partitioned into visual object classes using topic discovery models from statistical text analysis; and (ii) that visual object classes can be used to assess the accuracy of a segmentation. To tie these ideas together we compute multiple segmentations of each image and then: (i) learn the object classes; and (ii) choose the correct segmentations. We demonstrate that such an algorithm succeeds in automatically discovering many familiar objects in a variety of image datasets, including those from Caltech, MSRC and LabelMe.