Are passages enough? the MIRACLE team participation in QA@CLEF2009

  • Authors:
  • María Teresa Vicente-Díez;César De Pablo-Sánchez;Paloma Martínez;Julián Moreno Schneider;Marta Garrote Salazar

  • Affiliations:
  • Universidad Carlos III de Madrid, Leganés, Madrid, Spain;Universidad Carlos III de Madrid, Leganés, Madrid, Spain;Universidad Carlos III de Madrid, Leganés, Madrid, Spain;Universidad Carlos III de Madrid, Leganés, Madrid, Spain;Universidad Carlos III de Madrid, Leganés, Madrid, Spain

  • Venue:
  • CLEF'09 Proceedings of the 10th cross-language evaluation forum conference on Multilingual information access evaluation: text retrieval experiments
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper summarizes the participation of the MIRACLE team in the Multilingual Question Answering Track at CLEF 2009. In this campaign, we took part in the monolingual Spanish task at ResPubliQA and submitted two runs. We have adapted our QA system to the new JRC-Acquis collection and the legal domain. We tested the use of answer filtering and ranking techniques against a baseline system using passage retrieval with no success. The run using question analysis and passage retrieval obtained a global accuracy of 0.33, while the addition of an answer filtering resulted in 0.29. We provide an analysis of the results for different questions types to investigate why it is difficult to leverage previous QA techniques. Another task of our work has been the application of temporal management to QA. Finally we include some discussion of the problems found with the new collection and the complexities of the domain.