Measuring relevance judgements
Information Processing and Management: an International Journal
Language and representation in information retrieval
Language and representation in information retrieval
Unified theories of cognition
User-defined relevance criteria: an exploratory study
Journal of the American Society for Information Science - Special issue: relevance research
Journal of the American Society for Information Science - Special issue: relevance research
Pertinence as reflected in personal constructs
Journal of the American Society for Information Science - Special issue: relevance research
The relevance of recall and precision in user evaluation
Journal of the American Society for Information Science - Special issue: relevance research
People, words, and perceptions: a phenomenological investigation of textuality
Journal of the American Society for Information Science
Relevance judgments for assessing recall
Information Processing and Management: an International Journal
Exploring the relationship between user satisfaction and relevance in information systems
Information Processing and Management: an International Journal - Special issue: history of information science
STAIRS redux: thoughts on the STAIRS evaluation, ten years after
Journal of the American Society for Information Science - Special issue: evaluation of information retrieval systems
The relevance aura of bibliographic records
Information Processing and Management: an International Journal
Information Processing and Management: an International Journal
Users' criteria for relevance evaluation: a cross-situational comparison
Information Processing and Management: an International Journal
Towards the identification of the optimal number of relevance categories
Journal of the American Society for Information Science
From highly relevant to not relevant: examining different regions of relevance
Information Processing and Management: an International Journal
Journal of the American Society for Information Science - Special issue on the 50th anniversary of the Journal of The American Society for Information Science: part 2: paradigms, models and methods of information science
Regions and levels: measuring and mapping users' relevance judgments
Journal of the American Society for Information Science and Technology
Journal of the American Society for Information Science and Technology
Information Retrieval: Uncertainty and Logics: Advanced Models for the Representation and Retrieval of Information
Median measure: an approach to IR systems evaluation
Information Processing and Management: an International Journal
Nodes of topicality: modeling user notions of on topic documents
Journal of the American Society for Information Science and Technology
Relevance judgment: What do information users consider beyond topicality?
Journal of the American Society for Information Science and Technology - Research Articles
The effectiveness of web search engines for retrieving relevant ecommerce links
Information Processing and Management: an International Journal
"What is a good digital library?" - A quality model for digital libraries
Information Processing and Management: an International Journal
The dynamics of interactive information retrieval behavior, Part I: An activity theory perspective
Journal of the American Society for Information Science and Technology
Novelty and topicality in interactive information retrieval
Journal of the American Society for Information Science and Technology
User-centred versus system-centred evaluation of a personalization system
Information Processing and Management: an International Journal
Learning to rank relevant and novel documents through user feedback
CIKM '10 Proceedings of the 19th ACM international conference on Information and knowledge management
A method of user modeling and relevance simulation in document retrieval systems
KES-AMSTA'11 Proceedings of the 5th KES international conference on Agent and multi-agent systems: technologies and applications
User relevance criteria choices and the information search process
Information Processing and Management: an International Journal
Searching for relevance in the relevance of search
CoLIS'05 Proceedings of the 5th international conference on Context: conceptions of Library and Information Sciences
Hi-index | 0.00 |
This investigation examines end-user judgment and evaluation behavior during information retrieval (IR) system interactions and extends previous research surrounding relevance as a key construct for representing the value end-users ascribe to items retrieved from IR systems. A self-reporting instrument collected evaluative responses from 32 end-users related to 1432 retrieved items in relation to five characteristics of each item: (1) whether it was on topic, (2) whether it was meaningful to the user, (3) whether it was useful in relation to the problem at hand, (4) whether the IR system returned the information in the right form or format, and (5) whether the information retrieved allowed the user to take further action on it. The manner in which these characteristics of the retrieved items were considered, differentiated and aggregated were examined in relation to the region of relevance attributed to those items by the users.The nominal nature of the data collected led to non-parametric statistical analyses that indicated that end-user evaluation of retrieved items to resolve an information problem at hand is most likely a multi-stage process. While end-users may differ in their judgments and evaluations of retrieved items, they appear to make those decisions by using somewhat consistent heuristic approaches that point to a predictive multi-stage model of relevance thresholds that exist on a continuum from topic to meaning (pertinence) to functionality (use).