Measuring relevance judgements

User perspectives on relevance criteria: a comparison among relevant, partially relevant , and not-relevant judgements

Journal of the American Society for Information Science and Technology

Using graded relevance assessments in IR evaluation

Journal of the American Society for Information Science and Technology

Relevance thresholds: a multi-stage predictive model of how users evaluate information

Information Processing and Management: an International Journal

The concept of relevance in IR

Journal of the American Society for Information Science and Technology

A practical SVM-based algorithm for ordinal regression in image retrieval

MULTIMEDIA '03 Proceedings of the eleventh ACM international conference on Multimedia

Measuring retrieval effectiveness: a new proposal and a first experimental validation

Journal of the American Society for Information Science and Technology

Retrieval evaluation with incomplete information

Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval

Rpref: a generalization of Bpref towards graded relevance judgments

SIGIR '06 Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval

Relationships between perceived features and similarity of images: A test of Tversky's contrast model

Journal of the American Society for Information Science and Technology

Methods for Evaluating Interactive Information Retrieval Systems with Users

Foundations and Trends in Information Retrieval

Building a framework for the probability ranking principle by a family of expected weighted rank

ACM Transactions on Information Systems (TOIS)

Evaluating information retrieval system performance based on user preference

Journal of Intelligent Information Systems

Evaluating information retrieval system performance based on multi-grade relevance

ISMIS'08 Proceedings of the 17th international conference on Foundations of intelligent systems

Select-the-Best-Ones: A new way to judge relative relevance

Information Processing and Management: an International Journal

Calibrating information users' views on relevance: A social representations approach

Journal of Information Science

“THAT’s what i was looking for”: comparing user-rated relevance with search engine rankings

INTERACT'05 Proceedings of the 2005 IFIP TC13 international conference on Human-Computer Interaction

An eye-tracking approach to the analysis of relevance judgments on the Web: The case of Google search engine

Journal of the American Society for Information Science and Technology

Axiometrics: An Axiomatic Approach to Information Retrieval Effectiveness Metrics

Proceedings of the 2013 Conference on the Theory of Information Retrieval