Overview of the 2009 QA track: towards a common task for QA, focused IR and automatic summarization systems

  • Authors:
  • Veronique Moriceau;Eric SanJuan;Xavier Tannier;Patrice Bellot

  • Affiliations:
  • LIMSI, CNRS, University Paris-Sud 11, France;LIA, Université d'Avignon et des Pays de Vaucluse, France;LIMSI, CNRS, University Paris-Sud 11, France;LIA, Université d'Avignon et des Pays de Vaucluse, France

  • Venue:
  • INEX'09 Proceedings of the Focused retrieval and evaluation, and 8th international conference on Initiative for the evaluation of XML retrieval
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

QA@INEX aims to evaluate a complex question-answering task. In such a task, the set of questions is composed of factoid, precise questions that expect short answers, as well as more complex questions that can be answered by several sentences or by an aggregation of texts from different documents. Question-answering, XML/passage retrieval and automatic summarization are combined in order to get closer to real information needs. This paper presents the groundwork carried out in 2009 to determine the tasks and a novel evaluation methodology that will be used in 2010.