Rpref: a generalization of Bpref towards graded relevance judgments

Authors:
Jan De Beer;Marie-Francine Moens
Affiliations:
Katholieke Universiteit Leuven, Belgium;Katholieke Universiteit Leuven, Belgium
Venue:
SIGIR '06 Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval
Year:
2006

Citing 5
Cited 4

Measuring relevance judgements

Information Processing and Management: an International Journal
Finding information on the World Wide Web: the retrieval effectiveness of search engines

Information Processing and Management: an International Journal
Variations in relevance judgments and the measurement of retrieval effectiveness

Information Processing and Management: an International Journal
Using graded relevance assessments in IR evaluation

Journal of the American Society for Information Science and Technology
Retrieval evaluation with incomplete information

Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval

Alternatives to Bpref

SIGIR '07 Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval
On information retrieval metrics designed for evaluation with incomplete relevance assessments

Information Retrieval
Building a framework for the probability ranking principle by a family of expected weighted rank

ACM Transactions on Information Systems (TOIS)
Using domain ontologies for finding experts in corporate wikis

Proceedings of the 7th International Conference on Semantic Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

We present rpref ; our generalization of the bpref evaluation metric for assessing the quality of search engine results, given graded rather than binary user relevance judgments.