Analysis of user attitude and behaviour in evaluating a personalized search engine
Proceedings of the 13th Eurpoean conference on Cognitive ergonomics: trust and control in complex socio-technical systems
An evaluation framework of user interaction with metadata surrogates
Journal of Information Science
Journal of the American Society for Information Science and Technology
HealthFinland-A national semantic publishing network and portal for health information
Web Semantics: Science, Services and Agents on the World Wide Web
Journal of the American Society for Information Science and Technology
What eyes can tell about the use of relevance criteria during predictive relevance judgment?
Proceedings of the third symposium on Information interaction in context
Metrics for characterizing the form of security policies
The Journal of Strategic Information Systems
Design factors affecting relevance judgment behaviour in the context of metadata surrogates
Journal of Information Science
The use of relevance criteria during predictive judgment: an eye tracking approach
Proceedings of the 73rd ASIS&T Annual Meeting on Navigating Streams in an Information Ecosystem - Volume 47
Mental models: have users' mental models of web search engines improved in the last ten years?
EPCE'11 Proceedings of the 9th international conference on Engineering psychology and cognitive ergonomics
User relevance criteria choices and the information search process
Information Processing and Management: an International Journal
User effect in evaluating personalized information retrieval systems
EC-TEL'06 Proceedings of the First European conference on Technology Enhanced Learning: innovative Approaches for Learning and Knowledge Sharing
Journal of the American Society for Information Science and Technology
Learners' perceptions on the importance of learning object metadata for relevance judgement
International Journal of Metadata, Semantics and Ontologies
| Hi-index | 0.00 |
This article focuses on the relevance judgments made by health information users who use the Web. Health information users were conceptualized as motivated information users concerned about how an environmental issue affects their health. Users identified their own environmental health interests and conducted a Web search of a particular environmental health Web site. Users were asked to identify (by highlighting with a mouse) the criteria they use to assess relevance in both Web search engine surrogates and full-text Web documents. Content analysis of document criteria highlighted by users identified the criteria these users relied on most often. Key criteria identified included (in order of frequency of appearance) research, topic, scope, data, influence, affiliation, Web characteristics, and authority/person. A power-law distribution of criteria was observed (a few criteria represented most of the highlighted regions, with a long tail of occasionally used criteria). Implications of this work are that information retrieval (IR) systems should be tailored in terms of users' tendencies to rely on certain document criteria, and that relevance research should combine methods to gather richer, contextualized data. Metadata for IR systems, such as that used in search engine surrogates, could be improved by taking into account actual usage of relevance criteria. Such metadata should be user-centered (based on data from users, as in this study) and context-appropriate (fit to users' situations and tasks) © 2006 Wiley Periodicals, Inc.