Discriminating image senses by clustering with multimodal features

Authors:
Nicolas Loeff;Cecilia Ovesdotter Alm;David A. Forsyth
Affiliations:
University of Illinois, UC;University of Illinois, UC;University of Illinois, UC
Venue:
COLING-ACL '06 Proceedings of the COLING/ACL on Main conference poster sessions
Year:
2006

Citing 18
Cited 11

A new competitive learning approach based on an equidistortion principle for designing optimal vector quantizers

Neural Networks
Normalized Cuts and Image Segmentation

IEEE Transactions on Pattern Analysis and Machine Intelligence
Saliency, Scale and Image Description

International Journal of Computer Vision
Discovering word senses from text

Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining
WebSeer: An Image Search Engine for the World Wide Web

WebSeer: An Image Search Engine for the World Wide Web
Spectral Grouping Using the Nyström Method

IEEE Transactions on Pattern Analysis and Machine Intelligence
Automatic word sense discrimination

Computational Linguistics - Special issue on word sense disambiguation
Unsupervised word sense disambiguation rivaling supervised methods

ACL '95 Proceedings of the 33rd annual meeting on Association for Computational Linguistics
Distinctive Image Features from Scale-Invariant Keypoints

International Journal of Computer Vision
Multi-model similarity propagation and its application for web image retrieval

Proceedings of the 12th annual ACM international conference on Multimedia
Hierarchical clustering of WWW image search results using visual, textual and link information

Proceedings of the 12th annual ACM international conference on Multimedia
Toward the Automatic Compilation of Multimedia Encyclopedias: Associating Images with Term Descriptions on the Web

WI '05 Proceedings of the 2005 IEEE/WIC/ACM International Conference on Web Intelligence
Probabilistic web image gathering

Proceedings of the 7th ACM SIGMM international workshop on Multimedia information retrieval
Evaluation strategies for image understanding and retrieval

Proceedings of the 7th ACM SIGMM international workshop on Multimedia information retrieval
Word sense disambiguation with pictures

Artificial Intelligence - Special volume on connecting language to the world
Speech and Language Processing (2nd Edition)

Speech and Language Processing (2nd Edition)
Challenges for annotating images for sense disambiguation

LAC '06 Proceedings of the Workshop on Frontiers in Linguistically Annotated Corpora 2006
Support vector machines for histogram-based image classification

IEEE Transactions on Neural Networks

Semi-supervised Laplacian Regularization of Kernel Canonical Correlation Analysis

ECML PKDD '08 Proceedings of the 2008 European Conference on Machine Learning and Knowledge Discovery in Databases - Part I
Challenges for annotating images for sense disambiguation

LAC '06 Proceedings of the Workshop on Frontiers in Linguistically Annotated Corpora 2006
Heterogeneous transfer learning for image clustering via the social web

ACL '09 Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 1 - Volume 1
Image Sense Classification in Text-Based Image Retrieval

AIRS '09 Proceedings of the 5th Asia Information Retrieval Symposium on Information Retrieval Technology
Bilingual query translation and expansion for supporting more effective cross-language image retrieval

Proceedings of the international conference on Multimedia
Subjective natural language problems: motivations, applications, characterizations, and implications

HLT '11 Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies: short papers - Volume 2
A non-parametric visual-sense model of images--extending the cluster hypothesis beyond text

Multimedia Tools and Applications
Unsupervised disambiguation of image captions

SemEval '12 Proceedings of the First Joint Conference on Lexical and Computational Semantics - Volume 1: Proceedings of the main conference and the shared task, and Volume 2: Proceedings of the Sixth International Workshop on Semantic Evaluation
Computing similarity between cultural heritage items using multimodal features

LaTeCH '12 Proceedings of the 6th Workshop on Language Technology for Cultural Heritage, Social Sciences, and Humanities
Joint image and word sense discrimination for image retrieval

ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part I
Cross-modal social image clustering and tag cleansing

Journal of Visual Communication and Image Representation

Quantified Score

Hi-index	0.00

Visualization

Abstract

We discuss Image Sense Discrimination (ISD), and apply a method based on spectral clustering, using multimodal features from the image and text of the embedding web page. We evaluate our method on a new data set of annotated web images, retrieved with ambiguous query terms. Experiments investigate different levels of sense granularity, as well as the impact of text and image features, and global versus local text features.