On the evaluation of snippet selection for WebCLEF

Authors:
Arnold Overwijk;Dong Nguyen;Claudia Hauff;Dolf Trieschnigg;Djoerd Hiemstra;Franciska De Jong
Affiliations:
University of Twente, The Netherlands;University of Twente, The Netherlands;University of Twente, The Netherlands;University of Twente, The Netherlands;University of Twente, The Netherlands;University of Twente, The Netherlands
Venue:
CLEF'08 Proceedings of the 9th Cross-language evaluation forum conference on Evaluating systems for multilingual and multimodal information access
Year:
2008

Citing 3
Cited 1

Understanding user goals in web search

Proceedings of the 13th international conference on World Wide Web
Overview of WebCLEF 2007

Advances in Multilingual and Multimodal Information Retrieval
HiXEval: highlighting XML retrieval evaluation

INEX'05 Proceedings of the 4th international conference on Initiative for the Evaluation of XML Retrieval

Search snippet evaluation at yandex: lessons learned and future directions

CLEF'11 Proceedings of the Second international conference on Multilingual and multimodal information access evaluation

Quantified Score

Hi-index	0.00

Visualization

Abstract

WebCLEF is about supporting a user who is an expert in writing a survey article on a specific topic with a clear goal and audience by generating a ranked list with relevant snippets. This paper focuses on the evaluation methodology of WebCLEF. We show that the evaluation method and test set used for WebCLEF 2007 cannot be used to evaluate new systems and give recommendations how to improve the evaluation.