Concept propagation based on visual similarity

  • Authors:
  • Jean-Pierre Chevallet;Nicolas Maillot;Joo-Hwee Lim

  • Affiliations:
  • IPAL French/Singapore Join Lab, CNRS/A-STAR, Universite Joseph Fourier/Institute for Infocomm Research, Singapore;IPAL French/Singapore Join Lab, CNRS/A-STAR, Universite Joseph Fourier/Institute for Infocomm Research, Singapore;IPAL French/Singapore Join Lab, CNRS/A-STAR, Universite Joseph Fourier/Institute for Infocomm Research, Singapore

  • Venue:
  • AIRS'06 Proceedings of the Third Asia conference on Information Retrieval Technology
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper presents an approach for image annotation propagation to images which have no annotations. In some specific domains, the assumption that visual similarity implies (partial) semantic similarity can be made. For instance, in medical imaging, two images of the same anatomic part in a given modality have a very similar appearance. In the proposed approach, a conceptual indexing phase extracts concepts from texts; a visual similarity between images is computed and then combined with conceptual text indexing. Annotation propagation driven by prior knowledge on the domain is finally performed. Domain knowledge used is a meta-thesaurus for both indexing and annotations propagation. The proposed approach has been applied on the imageCLEF medical image collection.