Approaches of using a word-image ontology and an annotated image corpus as intermedia for cross-language image retrieval

Authors:
Yih-Chen Chang;Hsin-Hsi Chen
Affiliations:
Department of Computer Science and Information Engineering, National Taiwan University, Taipei, Taiwan;Department of Computer Science and Information Engineering, National Taiwan University, Taipei, Taiwan
Venue:
CLEF'06 Proceedings of the 7th international conference on Cross-Language Evaluation Forum: evaluation of multilingual and multi-modal information retrieval
Year:
2006

Citing 5
Cited 7

Integrating textual and visual information for cross-language image retrieval: a trans-media dictionary approach

Information Processing and Management: an International Journal - Special issue: AIRS2005: Information retrieval research in Asia
The CLEF 2005 cross–language image retrieval track

CLEF'05 Proceedings of the 6th international conference on Cross-Language Evalution Forum: accessing Multilingual Information Repositories
The CLEF 2004 cross-language image retrieval track

CLEF'04 Proceedings of the 5th conference on Cross-Language Evaluation Forum: multilingual Information Access for Text, Speech and Images
Dublin city university at CLEF 2004: experiments with the ImageCLEF st. andrew's collection

CLEF'04 Proceedings of the 5th conference on Cross-Language Evaluation Forum: multilingual Information Access for Text, Speech and Images
Cross-media feedback strategies: merging text and image information to improve image retrieval

CLEF'04 Proceedings of the 5th conference on Cross-Language Evaluation Forum: multilingual Information Access for Text, Speech and Images

Late fusion of heterogeneous methods for multimedia image retrieval

MIR '08 Proceedings of the 1st ACM international conference on Multimedia information retrieval
Multimedia knowledge management using ontologies

MS '08 Proceedings of the 2nd ACM workshop on Multimedia semantics
Crossing textual and visual content in different application scenarios

Multimedia Tools and Applications
Image Sense Classification in Text-Based Image Retrieval

AIRS '09 Proceedings of the 5th Asia Information Retrieval Symposium on Information Retrieval Technology
Increasing precision and diversity in photo retrieval by result fusion

CLEF'08 Proceedings of the 9th Cross-language evaluation forum conference on Evaluating systems for multilingual and multimodal information access
Combining CBIR and NLP for multilingual terminology alignment and cross-language image indexing

YIWCALA '10 Proceedings of the NAACL HLT 2010 Young Investigators Workshop on Computational Approaches to Languages of the Americas
Multimodal indexing based on semantic cohesion for image retrieval

Information Retrieval

Quantified Score

Hi-index	0.00

Visualization

Abstract

Two kinds of intermedia are explored in ImageCLEFphoto2006. The approach of using a word-image ontology maps images to fundamental concepts in an ontology and measure the similarity between two images by using the kind-of relationship of the ontology. The approach of using an annotated image corpus maps images to texts describing concepts in the images, and the similarity of two images is measured by text counterparts using BM25. The official runs show that visual query and intermedia are useful. Comparing the runs using textual query only with the runs merging textual query and visual query, the latter improved 71%-119% of the performance of the former. Even in the situation which example images were removed from the image collection beforehand, the performance was still improved about 21%-43%.