Two axioms for evaluation measures in information retrieval

Authors:
P. Bollmann
Affiliations:
Technische Universität Berlin, Franklinstr. 28--29, D--1OOO Berlin 10
Venue:
SIGIR '84 Proceedings of the 7th annual international ACM SIGIR conference on Research and development in information retrieval
Year:
1984

Citing 5
Cited 2

Inefficiency of the use of Boolean functions for information retrieval systems

Communications of the ACM
Restricted evaluation in information retrieval

SIGIR '81 Proceedings of the 4th annual international ACM SIGIR conference on Information storage and retrieval: theoretical issues in information retrieval
The normalized recall and related measures

SIGIR '83 Proceedings of the 6th annual international ACM SIGIR conference on Research and development in information retrieval
Information Retrieval

Information Retrieval
Measurement-theoretical investigation of the MZ-metric

SIGIR '80 Proceedings of the 3rd annual ACM conference on Research and development in information retrieval

Extended structural relevance framework: a framework for evaluating structured document retrieval

Information Retrieval
Axiometrics: An Axiomatic Approach to Information Retrieval Effectiveness Metrics

Proceedings of the 2013 Conference on the Theory of Information Retrieval

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper evaluation measures for information retrieval system outputs are investigated from a measurement theoretic point of view. Two axioms are introduced: the axiom of monoto-nicity and the Archimedian axiom. It is shown that the measures fullfilling these axioms are exactly the measures equivalent to some measure of the form αa + δd where a is the number of relevant retrieved documents and d is the number of nonrelevant not retrieved documents. Some consequences for retrieval tests are discussed.