User-Oriented Relevance Judgment: A Conceptual Model

Authors:
Zhiwei Chen;Yunjie Xu
Affiliations:
National University of Singapore;National University of Singapore
Venue:
HICSS '05 Proceedings of the Proceedings of the 38th Annual Hawaii International Conference on System Sciences (HICSS'05) - Track 4 - Volume 04
Year:
2005

Citing 0
Cited 6

When will information retrieval be "good enough"?

Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval
Combining bibliometrics, information retrieval, and relevance theory, Part 2: Some implications for information science: Research Articles

Journal of the American Society for Information Science and Technology
Combining bibliometrics, information retrieval, and relevance theory, Part 1: First examples of a synthesis: Research Articles

Journal of the American Society for Information Science and Technology
Content Quality Assessment Related Frameworks for Social Media

ICCSA '09 Proceedings of the International Conference on Computational Science and Its Applications: Part II
Attentive documents: Eye tracking as implicit feedback for information retrieval and beyond

ACM Transactions on Interactive Intelligent Systems (TiiS)
Quality assessment of user comments on mobile platforms considering channel of activation and platform design

SocInfo'12 Proceedings of the 4th international conference on Social Informatics

Quantified Score

Hi-index	0.00

Visualization

Abstract

The concept of relevance has been heatedly debated in last decade. Not satisfied with the narrow and technical definition of system relevance, researchers turn to the subjective and situational aspect of this concept. How does a user perceive a document as relevant? The literature on relevance has identified numerous factors affecting such judgment. Taking a cognitive approach, this study focuses on the criteria users employ in making relevance judgment. Based on Grice's theory of communication, this paper proposes a five-factor model of relevance: topicality, novelty, reliability, understandability, and scope. Data are collected from a semi-controlled survey study and analyzed following a psychometric procedure. The result supports topicality and novelty as the key relevance criteria. Theoretical and practical implications of this study are discussed.