Enhancing semantic image retrieval by query expansion using user-specific annotation profiles

  • Authors:
  • Johanna Vompras;Stefan Conrad

  • Affiliations:
  • Heinrich Heine University, Düsseldorf, Germany;Heinrich Heine University, Düsseldorf, Germany

  • Venue:
  • EuroIMSA '08 Proceedings of the IASTED International Conference on Internet and Multimedia Systems and Applications
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

The assignment of annotations still forms the basis for conceptual queries in large image/text repositories by facilitating data classification at semantic level. However, the varying users' perception of image contents and the usage of different retrieval aspects make it necessary to develop methods for the unification and integration of different annotation schemes. In this paper we present the IKONA Retrieval and Annotation System with its main focus on the transformation of the subjective annotations assigned by different users into a unified knowledge base. For that purpose, the conducted queries are adjusted to user-dependent preferences by finding correspondences between the used vocabulary and the system's 'core' annotation ontology. The introduced method is evaluated on a large collection of news data including both images and the corresponding textual data. The experiments show that our approach significantly increases the retrieval quality, particularly when users are faced with a data repository whose content is unknown and has not been made completely semantically accessible.