Analysis of user attitude and behaviour in evaluating a personalized search engine

Authors:
Effie Lai-Chong Law;Tomaž Klobučar;Matic Pipan
Affiliations:
ETH Zürich, Zürich, Switzerland;Institut Jožef Stefan, Ljubljana, Slovenia;Institut Jožef Stefan, Ljubljana, Slovenia
Venue:
Proceedings of the 13th Eurpoean conference on Cognitive ergonomics: trust and control in complex socio-technical systems
Year:
2006

Citing 16
Cited 0

Refining the test phase of usability evaluation: how many subjects is enough?

Human Factors - Special issue: measurement in human factors
Claude Elwood Shannon: collected papers

Claude Elwood Shannon: collected papers
Toward a theory of user-based relevance: a call for a new paradigm of inquiry

Journal of the American Society for Information Science - Special issue: relevance research
Document familiarity, relevance, and Bradford's law: the Getty online searching project report no. 5

Information Processing and Management: an International Journal
Relevance: the whole history

Journal of the American Society for Information Science - Special topic issue on the history of documentation and information science: part II
Users' criteria for relevance evaluation: a cross-situational comparison

Information Processing and Management: an International Journal
Dimensions of relevance

Information Processing and Management: an International Journal
User perspectives on relevance criteria: a comparison among relevant, partially relevant , and not-relevant judgements

Journal of the American Society for Information Science and Technology
Building Trustworthy Software Agents

IEEE Internet Computing
Evaluating the quality of information models: empirical testing of a conceptual model quality framework

Proceedings of the 25th International Conference on Software Engineering
The effects of errors on system trust, self-confidence, and the allocation of control in route planning

International Journal of Human-Computer Studies - Special issue: Trust and technology
The concept of relevance in IR

Journal of the American Society for Information Science and Technology
Trust and mistrust of online health sites

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Seeking and implementing automated assistance during the search process

Information Processing and Management: an International Journal
Relevance criteria identified by health information users during Web searches: Research Articles

Journal of the American Society for Information Science and Technology
User acceptance of information technology: toward a unified view

MIS Quarterly

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper reports an empirical work on user-based relevance evaluation of a personalized search engine (PSE). The aim of the work is threefold: To develop metrics for evaluating PSE; to study how users' trust in personalized information retrieval systems influences their relevance judgments; to identify patterns of relevance criteria applications. Our findings corroborate some of those of the previous work and reveal some new phenomena: the optimality of sample size, consistency of relevance criteria application and role of pre-formed trust in automation.