User-defined relevance criteria: an exploratory study
Journal of the American Society for Information Science - Special issue: relevance research
Task complexity affects information seeking and use
Information Processing and Management: an International Journal
Variations in relevance assessments and the measurement of retrieval effectiveness
Journal of the American Society for Information Science - Special issue: evaluation of information retrieval systems
Information Processing and Management: an International Journal
Information and information sources in tasks of varying complexity
Journal of the American Society for Information Science and Technology
Features of documents relevant to task- and fact- oriented questions
Proceedings of the eleventh international conference on Information and knowledge management
The Concepts of an Active Life-Event Public Portal
EGOV '02 Proceedings of the First International Conference on Electronic Government
The concept of relevance in IR
Journal of the American Society for Information Science and Technology
How users assess web pages for information seeking
Journal of the American Society for Information Science and Technology
Conceptual framework for tasks in information studies: Book Reviews
Journal of the American Society for Information Science and Technology
Relevance judgment: What do information users consider beyond topicality?
Journal of the American Society for Information Science and Technology - Research Articles
Measuring online information seeking context, Part 1: Background and method
Journal of the American Society for Information Science and Technology
Identifying and improving retrieval for procedural questions
Information Processing and Management: an International Journal
A Comparison of Interactive and Ad-Hoc Relevance Assessments
Focused Access to XML Documents
Information Foraging Theory: Adaptive Interaction with Information
Information Foraging Theory: Adaptive Interaction with Information
Searching for relevance in the relevance of search
CoLIS'05 Proceedings of the 5th international conference on Context: conceptions of Library and Information Sciences
A cross-domain analysis of task and genre effects on perceptions of usefulness
Information Processing and Management: an International Journal
Hi-index | 0.00 |
This paper examines a key question in Information Seeking and Retrieval: how do people assess the usefulness of documents? In an experimental study, we presented 25 participants with five task-based search scenarios and asked them to assess and comment on the usefulness of Web documents from the Canadian government domain. Data was analyzed to test for the effect of five information task types: fact-finding, deciding, doing, learning and problem-solving. Participant assessments show a low level of agreement on usefulness scores overall, but consistency varied by task type. The criteria used to assess usefulness varied by level of usefulness, by task type and by participant. Findings contribute to our understanding of consistency in relevance assessments and the impact of tasks on information behaviour.