MIRACLE experiments in QA@CLEF 2006 in Spanish: main task, real-time QA and exploratory QA using wikipedia (WiQA)

  • Authors:
  • César De Pablo-Sánchez;Ana González-Ledesma;Antonio Moreno-Sandoval;Maria Teresa Vicente-Díez

  • Affiliations:
  • Departamento de Informática, Universidad Carlos III de Madrid;Laboratorio de Linguística Informática, Universidad Autónoma de Madrid;Laboratorio de Linguística Informática, Universidad Autónoma de Madrid;Departamento de Informática, Universidad Carlos III de Madrid

  • Venue:
  • CLEF'06 Proceedings of the 7th international conference on Cross-Language Evaluation Forum: evaluation of multilingual and multi-modal information retrieval
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

We describe the participation of MIRACLE group in the QA track at CLEF. We participated in three subtasks and presented two systems that works in Spanish. The first system is a traditional QA system and was evaluated in the main task and the Real-Time QA pilot. The system features improved Named Entity recognition and shallow linguistic analysis and achieves moderate performance. In contrast, results obtained in RT-QA shows that this approach is promising to provide answers in constrained time. The second system focus in the WiQA pilot task, that aims at retrieving important snippets to complete a Wikipedia. The system uses collection link structure, cosine similarity and Named Entities to retrieve new and important snippets. Although the experiments have not been exhaustive it seems that the performance depends on the type of concept.