Overview of the INEX 2008 Entity Ranking Track

  • Authors:
  • Gianluca Demartini;Arjen P. Vries;Tereza Iofciu;Jianhan Zhu

  • Affiliations:
  • L3S Research Center, Leibniz Universität Hannover, Hannover, Germany D-30167;CWI & Delft University of Technology, The Netherlands;L3S Research Center, Leibniz Universität Hannover, Hannover, Germany D-30167;University College London, Ipswich, UK IP5 3RE

  • Venue:
  • Advances in Focused Retrieval
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

In many contexts a search engine user would prefer to retrieve entities instead of just documents. Example queries include "Italian nobel prize winners", "Formula 1 drivers that won the Monaco Grand Prix", or "German spoken Swiss cantons". The XML Entity Ranking (XER) track at INEX creates a discussion forum aimed at standardizing evaluation procedures for entity retrieval. This paper describes the XER tasks and the evaluation procedure used at the XER track in 2008, focusing specifically on the sampled pooling strategy applied first this year. We conclude with a brief discussion of the predominant participant approaches and their effectiveness.