Multi-modal constraint propagation for heterogeneous image clustering

Authors:
Zhenyong Fu;Horace H.S. Ip;Hongtao Lu;Zhiwu Lu
Affiliations:
Shanghai Jiao Tong University, Shanghai, China;City University of Hong Kong, Hong Kong, Hong Kong;Shanghai Jiao Tong University, Shanghai, China;Peking University, Beijing, China
Venue:
MM '11 Proceedings of the 19th ACM international conference on Multimedia
Year:
2011

Citing 18
Cited 3

Matrix multiplication via arithmetic progressions

Journal of Symbolic Computation - Special issue on computational algebraic complexity
Texture Features for Browsing and Retrieval of Image Data

IEEE Transactions on Pattern Analysis and Machine Intelligence
Normalized Cuts and Image Segmentation

IEEE Transactions on Pattern Analysis and Machine Intelligence
Computer Vision

Computer Vision
Clustering with Instance-level Constraints

ICML '00 Proceedings of the Seventeenth International Conference on Machine Learning
Cluster ensembles --- a knowledge reuse framework for combining multiple partitions

The Journal of Machine Learning Research
A probabilistic framework for semi-supervised clustering

Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining
Multi-model similarity propagation and its application for web image retrieval

Proceedings of the 12th annual ACM international conference on Multimedia
Group-theoretic Algorithms for Matrix Multiplication

FOCS '05 Proceedings of the 46th Annual IEEE Symposium on Foundations of Computer Science
Web image clustering by consistent utilization of visual features and surrounding texts

Proceedings of the 13th annual ACM international conference on Multimedia
Semi-supervised graph clustering: a kernel approach

ICML '05 Proceedings of the 22nd international conference on Machine learning
Spectral clustering and transductive learning with multiple views

Proceedings of the 24th international conference on Machine learning
A tutorial on spectral clustering

Statistics and Computing
Pairwise constraint propagation by semidefinite programming for semi-supervised classification

Proceedings of the 25th international conference on Machine learning
Spectral learning

IJCAI'03 Proceedings of the 18th international joint conference on Artificial intelligence
Flexible constrained spectral clustering

Proceedings of the 16th ACM SIGKDD international conference on Knowledge discovery and data mining
Constrained spectral clustering via exhaustive and efficient constraint propagation

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part VI
Active Spectral Clustering

ICDM '10 Proceedings of the 2010 IEEE International Conference on Data Mining

Modalities consensus for multi-modal constraint propagation

Proceedings of the 20th ACM international conference on Multimedia
CISC: clustered image search by conceptualization

Proceedings of the 16th International Conference on Extending Database Technology
Multi-view embedding learning for incompletely labeled data

IJCAI'13 Proceedings of the Twenty-Third international joint conference on Artificial Intelligence

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents a multi-modal constraint propagation approach to exploiting pairwise constraints for constrained clustering tasks on multi-modal datasets. Pairwise constraint propagation methods have previously been designed primarily for single modality data and cannot be directly applied to multi-modal data or a dataset with multiple representations. In this paper, we provide an effective solution to the multi-modal constraint propagation problem by decomposing it into a set of independent multi-graph based two-class label propagation subproblems which are then merged into a unified problem and solved by quadratic optimization. We also show that such a formulation yields a closed-form solution. Our approach allows the initial pairwise constraints to be propagated throughout the entire multi-modal dataset. The propagated constraints are further used to refine the similarities between the objects for subsequent clustering tasks. The proposed method has been tested in constrained clustering tasks on two real-life multi-modal image datasets and shown to achieve significant improvements with respect to the single modality methods.