Splitting complex temporal questions for question answering systems
ACL '04 Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics
Overview of the CLEF 2004 multilingual question answering track
CLEF'04 Proceedings of the 5th conference on Cross-Language Evaluation Forum: multilingual Information Access for Text, Speech and Images
Adapting a semantic question answering system to the web
MLQA '06 Proceedings of the Workshop on Multilingual Question Answering
Overview of the Clef 2008 multilingual question answering track
CLEF'08 Proceedings of the 9th Cross-language evaluation forum conference on Evaluating systems for multilingual and multimodal information access
A subspace decision cluster classifier for text classification
Expert Systems with Applications: An International Journal
A simple measure to assess non-response
HLT '11 Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies - Volume 1
Overview of the CLEF 2005 multilingual question answering track
CLEF'05 Proceedings of the 6th international conference on Cross-Language Evalution Forum: accessing Multilingual Information Repositories
Extending knowledge and deepening linguistic processing for the question answering system insicht
CLEF'05 Proceedings of the 6th international conference on Cross-Language Evalution Forum: accessing Multilingual Information Repositories
AliQAn, spanish QA system at CLEF-2005
CLEF'05 Proceedings of the 6th international conference on Cross-Language Evalution Forum: accessing Multilingual Information Repositories
SPARTE, a test suite for recognising textual entailment in spanish
CICLing'06 Proceedings of the 7th international conference on Computational Linguistics and Intelligent Text Processing
Question answering at the cross-language evaluation forum 2003---2010
Language Resources and Evaluation
Overview of the CLEF 2006 multilingual question answering track
CLEF'06 Proceedings of the 7th international conference on Cross-Language Evaluation Forum: evaluation of multilingual and multi-modal information retrieval
Overview of the answer validation exercise 2006
CLEF'06 Proceedings of the 7th international conference on Cross-Language Evaluation Forum: evaluation of multilingual and multi-modal information retrieval
| Hi-index | 0.00 |
A Pilot Question Answering Task has been activated in the Cross-Language Evaluation Forum 2004 with a twofold objective. In the first place, the evaluation of Question Answering systems when they have to answer conjunctive lists, disjunctive lists and questions with temporal restrictions. In the second place, the evaluation of systems' capability to give an accurate self-scoring about the confidence on their answers. In this way, two measures have been designed to be applied on all these different types of questions and to reward systems that give a confidence score with a high correlation with the human assessments. The forty eight runs submitted to the Question Answering Main Track have been taken as a case of study, confirming that some systems are able to give a very accurate score and showing how the measures proposed reward this fact.