The influence of document presentation order and number of documents judged on users' judgments of relevance

Authors:
Mu-hsuan Huang;Hui-yu Wang
Affiliations:
Department of Library and Information Science, National Taiwan University, Taipei 106, Taiwan, R.O.C.;Department of Library and Information Science, National Taiwan University, Taipei 106, Taiwan, R.O.C.
Venue:
Journal of the American Society for Information Science and Technology
Year:
2004

Citing 0
Cited 4

A Bayesian model that predicts the impact of Web searching on decision making

Journal of the American Society for Information Science and Technology - Research Articles
When more is less: the paradox of choice in search engine use

Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval
Methods for Evaluating Interactive Information Retrieval Systems with Users

Foundations and Trends in Information Retrieval
The effect of threshold priming and need for cognition on relevance calibration and assessment

Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval

Quantified Score

Hi-index	0.00

Visualization

Abstract

This article attempts to verify the hypothesis of the document presentation order by an empirical, two-stage experiment. It aims to identify the relationship between number of documents judged and order effect. The results indicate that significant order effect takes place when 15 and 30 documents are presented. Sets with 45 and 60 documents still reveal the order effect. However, subjects are not influenced by order of presentation when the set of documents has 5 and 75 members, respectively.