Learning the Semantics in Image Retrieval - A Natural Language Processing Approach

Authors:
Changbo Yang;Ming Dong;Farshad Fotouhi
Affiliations:
Wayne State University, Detroit, MI;Wayne State University, Detroit, MI;Wayne State University, Detroit, MI
Venue:
CVPRW '04 Proceedings of the 2004 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'04) Volume 9 - Volume 09
Year:
2004

Citing 0
Cited 3

Semantic feedback for interactive image retrieval

Proceedings of the 13th annual ACM international conference on Multimedia
Semantic hierarchies for image annotation: A survey

Pattern Recognition
Using linguistic models for image retrieval

ISVC'05 Proceedings of the First international conference on Advances in Visual Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

Learning the semantics of image retrieval using both text and visual information is a challenging research issue in content-based image retrieval systems. In this paper, we present a statistical natural language processing model for image retrieval, which integrates semantic information provided by WordNet, an online lexical reference system, and low-level visual features. In our system, the semantic hierarchy of word senses from WordNet is used to strengthen the association between images and the textual description of a concept. A statistical keyword selection algorithm is followed to choose the most representative keywords to annotate those images of the concept. We test our model on a landscape image database with 10 different concepts. Our experimental results show that our approach could greatly improve the retrieval accuracy. The results also demonstrate the high potential of our approach in building ontologies of image databases.