Simulation of user judgments in bibliographic retrieval systems

Authors:
Jean M. Tague;Michael J. Nelson
Affiliations:
University of Western Ontario, London, Ontario, Canada;University of Western Ontario, London, Ontario, Canada
Venue:
SIGIR '81 Proceedings of the 4th annual international ACM SIGIR conference on Information storage and retrieval: theoretical issues in information retrieval
Year:
1981

Citing 2
Cited 8

Theory of Modelling and Simulation

Theory of Modelling and Simulation
Problems in the simulation of bibliographic retrieval systems

SIGIR '80 Proceedings of the 3rd annual ACM conference on Research and development in information retrieval

A clustering scheme

SIGIR '83 Proceedings of the 6th annual international ACM SIGIR conference on Research and development in information retrieval
Current practice in the evaluation of multikey search algorithms

SIGIR '83 Proceedings of the 6th annual international ACM SIGIR conference on Research and development in information retrieval
Simulation of bibliographic retrieval databases using hyperterms

SIGIR '82 Proceedings of the 5th annual ACM conference on Research and development in information retrieval
Building simulated queries for known-item topics: an analysis using six european languages

SIGIR '07 Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval
PRES: a score metric for evaluating recall-oriented information retrieval applications

Proceedings of the 33rd international ACM SIGIR conference on Research and development in information retrieval
Validating query simulators: an experiment using commercial searches and purchases

CLEF'10 Proceedings of the 2010 international conference on Multilingual and multimodal information access evaluation: cross-language evaluation forum
Generating pseudo test collections for learning to rank scientific articles

CLEF'12 Proceedings of the Third international conference on Information Access Evaluation: multilinguality, multimodality, and visual analytics
Pseudo test collections for training and tuning microblog rankers

Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval

Quantified Score

Hi-index	0.01

Visualization

Abstract

The general model and simulation algorithms for bibliographic retrieval systems presented in an earlier paper are expanded. The new model integrates the physical as well as the logical and semantic elements of these systems. A modified algorithm is developed for the simulation of user relevance judgments, and is validated, by means of recall-precision curves and a Kolmogorov-Smirnov test of recall, for two test collections. Other approaches to goodness-of-fit testing are suggested.