Evaluating look-to-talk: a gaze-aware interface in a collaborative environment

Authors:
Alice Oh;Harold Fox;Max Van Kleek;Aaron Adler;Krzysztof Gajos;Louis-Philippe Morency;Trevor Darrell
Affiliations:
MIT Artificial Intelligence Lab, Cambridge, MA;MIT Artificial Intelligence Lab, Cambridge, MA;MIT Artificial Intelligence Lab, Cambridge, MA;MIT Artificial Intelligence Lab, Cambridge, MA;MIT Artificial Intelligence Lab, Cambridge, MA;MIT Artificial Intelligence Lab, Cambridge, MA;MIT Artificial Intelligence Lab, Cambridge, MA
Venue:
CHI '02 Extended Abstracts on Human Factors in Computing Systems
Year:
2002

Citing 4
Cited 13

Design principles for intelligent environments

AAAI '98/IAAI '98 Proceedings of the fifteenth national/tenth conference on Artificial intelligence/Innovative applications of artificial intelligence
Eye gaze patterns in conversations: there is more to conversational agents than meets the eyes

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Nudge nudge wink wink: elements of face-to-face conversation for embodied conversational agents

Embodied conversational agents
Estimating focus of attention based on gaze and sound

Proceedings of the 2001 workshop on Perceptive user interfaces

EyePliances: attention-seeking devices that respond to visual attention

CHI '03 Extended Abstracts on Human Factors in Computing Systems
Flexi-Modal and Multi-Machine User Interfaces

ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces
GWindows: robust stereo vision for gesture-based control of windows

Proceedings of the 5th international conference on Multimodal interfaces
ECSGlasses and EyePliances: using attention to open sociable windows of interaction

Proceedings of the 2004 symposium on Eye tracking research & applications
Media eyepliances: using eye tracking for remote control focus selection of appliances

CHI '05 Extended Abstracts on Human Factors in Computing Systems
Analyzing and predicting focus of attention in remote collaborative tasks

ICMI '05 Proceedings of the 7th international conference on Multimodal interfaces
ViewPointer: lightweight calibration-free eye tracking for ubiquitous handsfree deixis

Proceedings of the 18th annual ACM symposium on User interface software and technology
'User as assessor' approach to embodied conversational agents

From brows to trust
Use of eye movements for video game control

Proceedings of the 2006 ACM SIGCHI international conference on Advances in computer entertainment technology
A Fitts Law comparison of eye tracking and manual input in the selection of visual targets

ICMI '08 Proceedings of the 10th international conference on Multimodal interfaces
Attention and interaction control in a human-human-computer dialogue setting

SIGDIAL '09 Proceedings of the SIGDIAL 2009 Conference: The 10th Annual Meeting of the Special Interest Group on Discourse and Dialogue
Augmenting looking, pointing and reaching gestures to enhance the searching and browsing of physical objects

PERVASIVE'07 Proceedings of the 5th international conference on Pervasive computing
Automated awareness and visualization of online presence

Proceedings of the 2012 Joint International Conference on Human-Centered Computer Environments

Quantified Score

Hi-index	0.00

Visualization

Abstract

We present "look-to-talk", a gaze-aware interface for directing a spoken utterance to a software agent in a multi-user collaborative environment. Through a prototype and a Wizard-of-Oz (Woz) experiment, we show that "look-to-talk" is indeed a natural alternative to speech and other paradigms.