An evaluation of retrieval effectiveness for a full-text document-retrieval system
Communications of the ACM
Coding and information theory (2nd ed.)
Coding and information theory (2nd ed.)
Natural language understanding
Natural language understanding
A document retrieval system based on nearest neighbour searching
Journal of Information Science
Automatic text processing: the transformation, analysis, and retrieval of information by computer
Automatic text processing: the transformation, analysis, and retrieval of information by computer
The state of retrieval system evaluation
Information Processing and Management: an International Journal - Special issue on evaluation issues in information retrieval
An information measure of retrieval performance
Information Systems
An application of least squares fit mapping to text information retrieval
SIGIR '93 Proceedings of the 16th annual international ACM SIGIR conference on Research and development in information retrieval
The effectiveness of document neighboring in search enhancement
Information Processing and Management: an International Journal
Non-parametric significance tests of retrieval performance comparisons
Journal of Information Science
Overview of the second text retrieval conference (TREC-2)
TREC-2 Proceedings of the second conference on Text retrieval conference
Representing documents using an explicit model of their similarities
Journal of the American Society for Information Science
Combining automatic and manual index representations in probabilistic retrieval
Journal of the American Society for Information Science
Optimal document-indexing vocabulary for MEDLINE
Information Processing and Management: an International Journal - Special issue: history of information science
Human subjectivity and performance limits in document retrieval
Information Processing and Management: an International Journal - Special issue: history of information science
On Relevance, Probabilistic Indexing and Information Retrieval
Journal of the ACM (JACM)
Information Retrieval
Evaluation of Text Retrieval Systems
Programming and Computing Software
Multiple viewpoints as an approach to digital library interfaces
Journal of the American Society for Information Science and Technology
Building a framework for the probability ranking principle by a family of expected weighted rank
ACM Transactions on Information Systems (TOIS)
Hi-index | 0.00 |
We show first that the pooling of multiple human judgments of relevance provides predictor of relevance that is superior to that obtained from a single human's relevance judgemts. A learning algorithm applied to a set of relevance judgments obtained from a single human would be expected to perform on new material at a level somewhat below that human. However, we examine two learning methods which when trained on the superior source of pooled human relevance judgments are able to perform at the level of a single human on new material. All performance comparisons are based on an independent human judge. Both algorithms function by producing term weights—one by a log odds calculation and the other by producing a least-squares fit to human relevance ratings. Some characteristics of the algorithms are examined.