A classification of IR effectiveness metrics

Authors:
Gianluca Demartini;Stefano Mizzaro
Affiliations:
Dept. of Mathematics and Computer Science, University of Udine, Udine, Italy;Dept. of Mathematics and Computer Science, University of Udine, Udine, Italy
Venue:
ECIR'06 Proceedings of the 28th European conference on Advances in Information Retrieval
Year:
2006

Citing 11
Cited 6

Determining the effectiveness of retrieval algorithms

Information Processing and Management: an International Journal
Upper bounds for retrieval performance and their use measuring performance and generating optimal Boolean queries: can it get any better than this?

Information Processing and Management: an International Journal
Measuring retrieval effectiveness based on user preference of documents

Journal of the American Society for Information Science
Information storage and retrieval

Information storage and retrieval
Relevance: the whole history

Journal of the American Society for Information Science - Special topic issue on the history of documentation and information science: part II
Measures of relative relevance and ranked half-life: performance indicators for interactive IR

Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval
Information Retrieval

Information Retrieval
Introduction to Modern Information Retrieval

Introduction to Modern Information Retrieval
Cumulated gain-based evaluation of IR techniques

ACM Transactions on Information Systems (TOIS)
Measuring retrieval effectiveness: a new proposal and a first experimental validation

Journal of the American Society for Information Science and Technology
Retrieval evaluation with incomplete information

Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval

Percent perfect performance (PPP)

Information Processing and Management: an International Journal
Leveraging semantic technologies for enterprise search

Proceedings of the ACM first Ph.D. workshop in CIKM
Measures for benchmarking semantic web service matchmaking correctness

ESWC'10 Proceedings of the 7th international conference on The Semantic Web: research and Applications - Volume Part II
Progress in information retrieval

ECIR'06 Proceedings of the 28th European conference on Advances in Information Retrieval
Axiometrics: An Axiomatic Approach to Information Retrieval Effectiveness Metrics

Proceedings of the 2013 Conference on the Theory of Information Retrieval
Choices in batch information retrieval evaluation

Proceedings of the 18th Australasian Document Computing Symposium

Quantified Score

Hi-index	0.00

Visualization

Abstract

Effectiveness is a primary concern in the information retrieval (IR) field. Various metrics for IR effectiveness have been proposed in the past; we take into account all the 44 metrics we are aware of, classifying them into a two-dimensional grid. The classification is based on the notions of relevance, i.e., if (or how much) a document is relevant, and retrieval, i.e., if (how much) a document is retrieved. To our knowledge, no similar classification has been proposed so far.