Using visual concepts and fast visual diversity to improve image retrieval

  • Authors:
  • Sabrina Tollari;Marcin Detyniecki;Ali Fakeri-Tabrizi;Christophe Marsala;Massih-Reza Amini;Patrick Gallinari

  • Affiliations:
  • Université Pierre et Marie Curie-Paris 6, Laboratoire d'Informatique de Paris 6, UMR, CNRS, Paris, France;Université Pierre et Marie Curie-Paris 6, Laboratoire d'Informatique de Paris 6, UMR, CNRS, Paris, France;Université Pierre et Marie Curie-Paris 6, Laboratoire d'Informatique de Paris 6, UMR, CNRS, Paris, France;Université Pierre et Marie Curie-Paris 6, Laboratoire d'Informatique de Paris 6, UMR, CNRS, Paris, France;Université Pierre et Marie Curie-Paris 6, Laboratoire d'Informatique de Paris 6, UMR, CNRS, Paris, France;Université Pierre et Marie Curie-Paris 6, Laboratoire d'Informatique de Paris 6, UMR, CNRS, Paris, France

  • Venue:
  • CLEF'08 Proceedings of the 9th Cross-language evaluation forum conference on Evaluating systems for multilingual and multimodal information access
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this article, we focus our efforts (i) on the study of how to automatically extract and exploit visual concepts and (ii) on fast visual diversity. First, in the Visual Concept Detection Task (VCDT), we look at the mutual exclusion and implication relations between VCDT concepts in order to improve the automatic image annotation by Forest of Fuzzy Decision Trees (FFDTs). Second, in the ImageCLEFphoto task, we use the FFDTs learnt in VCDT task and WordNet to improve image retrieval. Third, we apply a fast visual diversity method based on space clustering to improve the cluster recall score. This study shows that there is a clear improvement, in terms of precision or cluster recall at 20, when using the visual concepts explicitly appearing in the query and that space clustering can be effciently used to improve cluster recall.