THESEUS meets ImageCLEF: combining evaluation strategies for a new visual concept detection task 2009

  • Authors:
  • Stefanie Nowak;Peter Dunker;Ronny Paduschek

  • Affiliations:
  • Fraunhofer Institute for Digital Media Technology, Ilmenau, Germany;Fraunhofer Institute for Digital Media Technology, Ilmenau, Germany;Fraunhofer Institute for Digital Media Technology, Ilmenau, Germany

  • Venue:
  • CLEF'08 Proceedings of the 9th Cross-language evaluation forum conference on Evaluating systems for multilingual and multimodal information access
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

Automatic methods for archiving, indexing and retrieving multimedia content becomemore andmore important through the steadily increasing amount of digital data in the web and at home. THESEUS, a German research program, focuses on developing sophisticated algorithms and evaluation strategies for the automated processing of digital data. In this paper we present how evaluation is performed in THESEUS and introduce a generic framework for the evaluation of various video and image analysis algorithms. Besides, evaluation campaigns like the Cross Evaluation Language Forum (CLEF) and subprojects like ImageCLEF deal with the evaluation of such algorithms and provide an objective comparison of their performance. We relate the THESEUS tasks to the work done in ImageCLEF and propose a new task for ImageCLEF 2009.