RealTourist: a study of augmenting human-human and human-computer dialogue with eye-gaze overlay

  • Authors:
  • Pernilla Qvarfordt;David Beymer;Shumin Zhai

  • Affiliations:
  • Department of Computer and Information Science, Linköping University, Linköping, Sweden;IBM Almaden Research Center, San Jose, CA;IBM Almaden Research Center, San Jose, CA

  • Venue:
  • INTERACT'05 Proceedings of the 2005 IFIP TC13 international conference on Human-Computer Interaction
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

We developed and studied an experimental system, RealTourist, which lets a user to plan a conference trip with the help of a remote tourist consultant who could view the tourist’s eye-gaze superimposed onto a shared map. Data collected from the experiment were analyzed in conjunction with literature review on speech and eye-gaze patterns. This inspective, exploratory research identified various functions of gaze-overlay on shared spatial material including: accurate and direct display of partner’s eye-gaze, implicit deictic referencing, interest detection, common focus and topic switching, increased redundancy and ambiguity reduction, and an increase of assurance, confidence, and understanding. This study serves two purposes. The first is to identify patterns that can serve as a basis for designing multimodal human-computer dialogue systems with eye-gaze locus as a contributing channel. The second is to investigate how computer-mediated communication can be supported by the display of the partner’s eye-gaze.