A statistical approach to machine translation
Computational Linguistics
Using multiple knowledge sources for word sense discrimination
Computational Linguistics
Normalized Cuts and Image Segmentation
IEEE Transactions on Pattern Analysis and Machine Intelligence
Object Recognition as Machine Translation: Learning a Lexicon for a Fixed Image Vocabulary
ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part IV
An Iterative Approach to Word Sense Disambiguation
Proceedings of the Thirteenth International Florida Artificial Intelligence Research Society Conference
Automatic image annotation and retrieval using cross-media relevance models
Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval
Statistical Models for Co-occurrence Data
Statistical Models for Co-occurrence Data
The Journal of Machine Learning Research
The mathematics of statistical machine translation: parameter estimation
Computational Linguistics - Special issue on using large corpora: II
Word-sense disambiguation using statistical methods
ACL '91 Proceedings of the 29th annual meeting on Association for Computational Linguistics
Unsupervised word sense disambiguation rivaling supervised methods
ACL '95 Proceedings of the 33rd annual meeting on Association for Computational Linguistics
Integrating multiple knowledge sources to disambiguate word sense: an exemplar-based approach
ACL '96 Proceedings of the 34th annual meeting on Association for Computational Linguistics
ACL '92 Proceedings of the 30th annual meeting on Association for Computational Linguistics
Word-sense disambiguation using statistical models of Roget's categories trained on large corpora
COLING '92 Proceedings of the 14th conference on Computational linguistics - Volume 2
Word sense disambiguation using Conceptual Density
COLING '96 Proceedings of the 16th conference on Computational linguistics - Volume 1
HLT '91 Proceedings of the workshop on Speech and Natural Language
HLT '93 Proceedings of the workshop on Human Language Technology
Word sense disambiguation with pictures
HLT-NAACL-LWM '04 Proceedings of the HLT-NAACL 2003 workshop on Learning word meaning from non-linguistic data - Volume 6
Finding predominant word senses in untagged text
ACL '04 Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics
Hierarchical semantic classification: word sense disambiguation with world knowledge
IJCAI'03 Proceedings of the 18th international joint conference on Artificial intelligence
A WordNet-based algorithm for word sense disambiguation
IJCAI'95 Proceedings of the 14th international joint conference on Artificial intelligence - Volume 2
Multiple Bernoulli relevance models for image and video annotation
CVPR'04 Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition
Information Fusion in Multimedia Information Retrieval
Adaptive Multimedial Retrieval: Retrieval, User, and Semantics
Beyond Nouns: Exploiting Prepositions and Comparative Adjectives for Learning Visual Classifiers
ECCV '08 Proceedings of the 10th European Conference on Computer Vision: Part I
Integrating visual and semantic contexts for topic network generation and word sense disambiguation
Proceedings of the ACM International Conference on Image and Video Retrieval
Multiple-instance image database retrieval by spatial similarity based on Interval Neighbor Group
Proceedings of the ACM International Conference on Image and Video Retrieval
Baselines for Image Annotation
International Journal of Computer Vision
Proceedings of the international conference on Multimedia
Unsupervised disambiguation of image captions
SemEval '12 Proceedings of the First Joint Conference on Lexical and Computational Semantics - Volume 1: Proceedings of the main conference and the shared task, and Volume 2: Proceedings of the Sixth International Workshop on Semantic Evaluation
Proceedings of the 20th ACM international conference on Multimedia
Joint image and word sense discrimination for image retrieval
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part I
Cross-modal social image clustering and tag cleansing
Journal of Visual Communication and Image Representation
Hi-index | 0.00 |
We introduce using images for word sense disambiguation, either alone, or in conjunction with traditional text based methods. The approach is based on a recently developed method for automatically annotating images by using a statistical model for the joint probability for image regions and words. The model itself is learned from a data base of images with associated text. To use the model for word sense disambiguation, we constrain the predicted words to be possible senses for the word under consideration. When word prediction is constrained to a narrow set of choices (such as possible senses), it can be quite reliable. We report on experiments using the resulting sense probabilities as is, as well as augmenting a state of the art text based word sense disambiguation algorithm. In order to evaluate our approach, we developed a new corpus, ImCor, which consists of a substantive portion of the Corel image data set associated with disambiguated text drawn from the SemCor corpus. Our experiments using this corpus suggest that visual information can be very useful in disambiguating word senses. It also illustrates that associated non-textual information such as image data can help ground language meaning.