See what i'm saying?: using Dyadic Mobile Eye tracking to study collaborative reference

  • Authors:
  • Darren Gergle;Alan T. Clark

  • Affiliations:
  • Northwestern University, Evanston, IL, USA;Northwestern University, Evanston, IL, USA

  • Venue:
  • Proceedings of the ACM 2011 conference on Computer supported cooperative work
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

To create intelligent collaborative systems able to anticipate and react appropriately to users' needs and actions, it is crucial to develop a detailed understanding of the process of collaborative reference. We developed a dyadic eye tracking methodology and metrics for studying the multimodal process of reference, and applied these techniques in an experiment using a naturalistic conversation elicitation task. We found systematic differences in linguistic and visual coordination between pairs of mobile and seated participants. Our results detail measurable interactions between referential form, gaze, and spatial context and can be used to enable the development of more natural collaborative user interfaces.