Ad hoc IR: not much room for improvement

Authors:
Andrew Trotman;David Keeler
Affiliations:
University of Otago, Dunedin, New Zealand;University of Otago, Dunedin, New Zealand
Venue:
Proceedings of the 34th international ACM SIGIR conference on Research and development in Information Retrieval
Year:
2011

Citing 6
Cited 0

Probabilistic models of information retrieval based on measuring the divergence from randomness

ACM Transactions on Information Systems (TOIS)
Has adhoc retrieval improved since 1994?

Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval
Why current IR engines fail

Information Retrieval
Improvements that don't add up: ad-hoc retrieval results since 1998

Proceedings of the 18th ACM conference on Information and knowledge management
Against recall: is it persistence, cardinality, density, coverage, or totality?

ACM SIGIR Forum
Fast and effective focused retrieval

INEX'09 Proceedings of the Focused retrieval and evaluation, and 8th international conference on Initiative for the evaluation of XML retrieval

Quantified Score

Hi-index	0.00

Visualization

Abstract

Ranking function performance reached a plateau in 1994. The reason for this is investigated. First the performance of BM25 is measured as the proportion of queries satisfied on the first page of 10 results -- it performs well. The performance is then compared to human performance. They perform comparably. The conclusion is there isn't much room for ranking function improvement.