Are Ten Participants Enough for Evaluating Information Scent of Web Page Hyperlinks?

Authors:
Christos Katsanos;Nikolaos Tselios;Nikolaos Avouris
Affiliations:
Human-Computer Interaction Group, Electrical and Computer Engineering Dept., University of Patras, Rio Patras, Greece GR-265 00;Human-Computer Interaction Group, Electrical and Computer Engineering Dept., University of Patras, Rio Patras, Greece GR-265 00;Human-Computer Interaction Group, Electrical and Computer Engineering Dept., University of Patras, Rio Patras, Greece GR-265 00
Venue:
INTERACT '09 Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part I
Year:
2009

Citing 6
Cited 0

Tool for accurately predicting website navigation problems, non-problems, problem severity, and effectiveness of repairs

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A comparison of LSA, wordNet and PMI-IR for predicting user click behavior

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
InfoScent evaluator: a semi-automated tool to evaluate semantic appropriateness of hyperlinks in a web site

OZCHI '06 Proceedings of the 18th Australia conference on Computer-Human Interaction: Design: Activities, Artefacts and Environments
Modeling information navigation: implications for information architecture

Human-Computer Interaction
SNIF-ACT: a cognitive model of user navigation on the world wide web

Human-Computer Interaction
Measuring the User Experience: Collecting, Analyzing, and Presenting Usability Metrics

Measuring the User Experience: Collecting, Analyzing, and Presenting Usability Metrics

Quantified Score

Hi-index	0.00

Visualization

Abstract

Information scent of hyperlinks, that is the user's assessment of semantic relevance of navigation options in a webpage, has been identified as a critical factor in Web navigation. An important question in this context is to identify the minimum number of participants required to measure reliably information scent. A two phase study was conducted in an attempt to provide an answer to this question. In the first phase, involving 101 participants, ratings produced by different size subsets of participants were compared to those of the whole set. In the second phase, the ratings of these different size subsets of participants where compared with measures of behavior of 54 participants, who performed the same information navigation tasks using a typical web browser. Results indicate that representative estimates of information scent can be obtained from 10 participants in both cases. This finding has important implications for future scent-related studies.