How reliable are the results of large-scale information retrieval experiments?
Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval
The effect of topic set size on retrieval experiment error
SIGIR '02 Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval
ACM SIGIR Forum
Direct: applying the DIKW hierarchy to large-scale evaluation campaigns
Proceedings of the 8th ACM/IEEE-CS joint conference on Digital libraries
GikiP: evaluating geographical answers from wikipedia
Proceedings of the 2nd international workshop on Geographic information retrieval
GikiP at GeoCLEF 2008: joining GIR and QA forces for querying Wikipedia
CLEF'08 Proceedings of the 9th Cross-language evaluation forum conference on Evaluating systems for multilingual and multimodal information access
Where in the Wikipedia is that answer? the XLDB at the GikiCLEF 2009 task
CLEF'09 Proceedings of the 10th cross-language evaluation forum conference on Multilingual information access evaluation: text retrieval experiments
GikiCLEF topics and Wikipedia articles: did they blend?
CLEF'09 Proceedings of the 10th cross-language evaluation forum conference on Multilingual information access evaluation: text retrieval experiments
Interactive probabilistic search for GikiCLEF
CLEF'09 Proceedings of the 10th cross-language evaluation forum conference on Multilingual information access evaluation: text retrieval experiments
CLEF 2009: Grid@CLEF pilot track overview
CLEF'09 Proceedings of the 10th cross-language evaluation forum conference on Multilingual information access evaluation: text retrieval experiments
CLEF'05 Proceedings of the 6th international conference on Cross-Language Evalution Forum: accessing Multilingual Information Repositories
The key to the first CLEF with portuguese: topics, questions and answers in CHAVE
CLEF'04 Proceedings of the 5th conference on Cross-Language Evaluation Forum: multilingual Information Access for Text, Speech and Images
QolA: fostering collaboration within QA
CLEF'06 Proceedings of the 7th international conference on Cross-Language Evaluation Forum: evaluation of multilingual and multi-modal information retrieval
How geographic was GikiCLEF?: a GIR-critical review
Proceedings of the 6th Workshop on Geographic Information Retrieval
Recursive question decomposition for answering complex geographic questions
CLEF'09 Proceedings of the 10th cross-language evaluation forum conference on Multilingual information access evaluation: text retrieval experiments
GikiCLEF topics and Wikipedia articles: did they blend?
CLEF'09 Proceedings of the 10th cross-language evaluation forum conference on Multilingual information access evaluation: text retrieval experiments
Interactive probabilistic search for GikiCLEF
CLEF'09 Proceedings of the 10th cross-language evaluation forum conference on Multilingual information access evaluation: text retrieval experiments
SIGA, a system to manage information retrieval evaluations
PROPOR'12 Proceedings of the 10th international conference on Computational Processing of the Portuguese Language
Locational relativity and domain constraints in spatial questions
Proceedings of the 20th International Conference on Advances in Geographic Information Systems
| Hi-index | 0.00 |
This overview paper is devoted to a critical assessment of GikiCLEF 2009, an evaluation contest specifically designed to expose and investigate cultural and linguistic issues inWikipedia search, with eight participant systems and 17 runs. After providing a maximally short but self contained overview of the GikiCLEF task and participation, we present the open source SIGA system, and discuss, for each of the main guiding ideas, the resulting successes or shortcomings, concluding with further work and still unanswered questions.