CLEF 2008: ad hoc track overview

  • Authors:
  • Eneko Agirre;Giorgio Maria Di Nunzio;Nicola Ferro;Thomas Mandl;Carol Peters

  • Affiliations:
  • Computer Science Department, University of the Basque Country, Spain;Department of Information Engineering, University of Padua, Italy;Department of Information Engineering, University of Padua, Italy;Information Science, University of Hildesheim, Germany;ISTI, CNR, Pisa, Italy

  • Venue:
  • CLEF'08 Proceedings of the 9th Cross-language evaluation forum conference on Evaluating systems for multilingual and multimodal information access
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

We describe the objectives and organization of the CLEF 2008 Ad Hoc track and discuss the main characteristics of the tasks offered to test monolingual and cross-language textual document retrieval systems. The track was changed considerably this year with the introduction of tasks with new document collections consisting of (i) library catalog records derived from The European Library, and (ii) and non-European language data, plus a task offering the chance to test retrieval with word sense disambiguated data. The track was thus structured in three distinct streams denominated: TEL@CLEF, Persian@CLEF and Robust WSD. The results obtained for each task are presented and statistical analyses are given.