Measuring multi-modality similarities via subspace learning for cross-media retrieval

Authors:
Hong Zhang;Jianguang Weng
Affiliations:
The Institute of Artificial Intelligence, Zhejiang University, HangZhou, P.R. China;The Institute of Artificial Intelligence, Zhejiang University, HangZhou, P.R. China
Venue:
PCM'06 Proceedings of the 7th Pacific Rim conference on Advances in Multimedia Information Processing
Year:
2006

Citing 8
Cited 9

Multiple-Instance Learning for Natural Scene Classification

ICML '98 Proceedings of the Fifteenth International Conference on Machine Learning
Audio Retrieval with Fast Relevance Feedback Based on Constrained Fuzzy Clustering and Stored Index Table

PCM '02 Proceedings of the Third IEEE Pacific Rim Conference on Multimedia: Advances in Multimedia Information Processing
Learning an image manifold for retrieval

Proceedings of the 12th annual ACM international conference on Multimedia
Efficient content-based retrieval of motion capture data

ACM SIGGRAPH 2005 Papers
Understanding multimedia document semantics for cross-media retrieval

PCM'05 Proceedings of the 6th Pacific-Rim conference on Advances in Multimedia Information Processing - Volume Part I
ClassView: hierarchical video shot classification, indexing, and accessing

IEEE Transactions on Multimedia
CBSA: content-based soft annotation for multimodal image retrieval using Bayes point machines

IEEE Transactions on Circuits and Systems for Video Technology
Content-based audio classification and retrieval by support vector machines

IEEE Transactions on Neural Networks

Multi-modal Correlation Modeling and Ranking for Retrieval

PCM '09 Proceedings of the 10th Pacific Rim Conference on Multimedia: Advances in Multimedia Information Processing
Boosting multimodal semantic understanding by local similarity adaptation and global correlation propagation

PCM'10 Proceedings of the 11th Pacific Rim conference on Advances in multimedia information processing: Part I
Multimodal search and retrieval using manifold learning and query formulation

Proceedings of the 16th International Conference on 3D Web Technology
Bridging the gap between visual and auditory feature spaces for cross-media retrieval

MMM'07 Proceedings of the 13th international conference on Multimedia Modeling - Volume Part I
Optimizing multimedia retrieval using multimodal fusion and relevance feedback techniques

MMM'12 Proceedings of the 18th international conference on Advances in Multimedia Modeling
I-SEARCH: a unified framework for multimodal search and retrieval

The Future Internet
Cross-Media semantics mining based on sparse canonical correlation analysis and relevance feedback

PCM'12 Proceedings of the 13th Pacific-Rim conference on Advances in Multimedia Information Processing
Multimedia search and retrieval using multimodal annotation propagation and indexing techniques

Image Communication
A unified framework for multimodal retrieval

Pattern Recognition

Quantified Score

Hi-index	0.00

Visualization

Abstract

Cross-media retrieval is an interesting research problem, which seeks to breakthrough the limitation of modality so that users can query multimedia objects by examples of different modalities. In order to cross-media retrieve, the problem of similarity measure between media objects with heterogeneous low-level features needs to be solved. This paper proposes a novel approach to learn both intra- and inter-media correlations among multi-modality feature spaces, and construct MLE semantic subspace containing multimedia objects of different modalities. Meanwhile, relevance feedback strategies are developed to enhance the efficiency of cross-media retrieval from both short- and long-term perspectives. Experiments show that the result of our approach is encouraging and the performance is effective.