Visualizing the problems with the INEX topics

Authors:
Andrew Trotman;Maria del Rocio Gomez Crisostomo;Mounia Lalmas
Affiliations:
University of Otago, Dunedin, New Zealand;Universidad de Extremadura, Badajoz,, Spain;University of Glasgow, Glasgow, Scotland Uk
Venue:
Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval
Year:
2009

Citing 5
Cited 0

Evaluating evaluation measure stability

SIGIR '00 Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval
Measuring Search Engine Quality

Information Retrieval
Evaluating evaluation metrics based on the bootstrap

SIGIR '06 Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval
Why structural hints in queries do not help XML-retrieval

SIGIR '06 Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval
Comparative analysis of clicks and judgments for IR evaluation

Proceedings of the 2009 workshop on Web Search Click Data

Quantified Score

Hi-index	0.00

Visualization

Abstract

Topics form a crucial component of a test collection. We show, through visualization, that the INEX 2008 topics have shortcomings, which questions their validity for evaluating XML retrieval effectiveness.