Eye-tracking reveals the personal styles for search result evaluation

  • Authors:
  • Anne Aula;Päivi Majaranta;Kari-Jouko Räihä

  • Affiliations:
  • Tampere Unit for Computer-Human Interaction (TAUCHI), Department of Computer Sciences, University of Tampere, Finland;Tampere Unit for Computer-Human Interaction (TAUCHI), Department of Computer Sciences, University of Tampere, Finland;Tampere Unit for Computer-Human Interaction (TAUCHI), Department of Computer Sciences, University of Tampere, Finland

  • Venue:
  • INTERACT'05 Proceedings of the 2005 IFIP TC13 international conference on Human-Computer Interaction
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

We used eye-tracking to study 28 users when they evaluated result lists produced by web search engines. Based on their different evaluation styles, the users were divided into economic and exhaustive evaluators. Economic evaluators made their decision about the next action (e.g., query re-formulation, following a link) faster and based on less information than exhaustive evaluators. The economic evaluation style was especially beneficial when most of the results in the result page were relevant. In these tasks, the task times were significantly shorter for economic than for exhaustive evaluators. The results suggested that economic evaluators were more experienced with computers than exhaustive evaluators. Thus, the result evaluation style seems to evolve towards a more economic style as the users gain more experience.