Multimodal integration of natural gaze behavior for intention recognition during object manipulation

Authors:
Thomas Bader;Matthias Vogelgesang;Edmund Klaus
Affiliations:
Universität Karlsruhe, Karlsruhe, Germany;Fraunhofer IITB, Karlsruhe, Germany;Fraunhofer IITB, Karlsruhe, Germany
Venue:
Proceedings of the 2009 international conference on Multimodal interfaces
Year:
2009

Citing 8
Cited 2

What you look at is what you get: eye movement-based interaction techniques

CHI '90 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
The design space of input devices

CHI '90 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Effective eye-gaze input into Windows

ETRA '00 Proceedings of the 2000 symposium on Eye tracking research & applications
Identifying fixations and saccades in eye-tracking protocols

ETRA '00 Proceedings of the 2000 symposium on Eye tracking research & applications
Hand eye coordination patterns in target selection

ETRA '00 Proceedings of the 2000 symposium on Eye tracking research & applications
Eye Tracking Methodology: Theory and Practice

Eye Tracking Methodology: Theory and Practice
Eye gaze patterns differentiate novice and experts in a virtual laparoscopic surgery training environment

Proceedings of the 2004 symposium on Eye tracking research & applications
Fast Invariant Contour-Based Classification of Hand Symbols for HCI

CAIP '09 Proceedings of the 13th International Conference on Computer Analysis of Images and Patterns

Putting gaze into context: a framework for analyzing gaze behavior in interactive and dynamic environments

Proceedings of the 2010 workshop on Eye gaze in intelligent human machine interaction
Eye gaze assisted human-computer interaction in a hand gesture controlled multi-display environment

Proceedings of the 4th Workshop on Eye Gaze in Intelligent Human Machine Interaction

Quantified Score

Hi-index	0.00

Visualization

Abstract

Naturally gaze is used for visual perception of our environment and gaze movements are mainly controlled subconsciously. Forcing the user to consciously diverge from that natural gaze behavior for interaction purposes causes high cognitive workload and destroys information contained in natural gaze movements. Instead of proposing a new gaze-based interaction technique, we analyze natural gaze behavior during an object manipulation task and show ways how it can be used for intention recognition, which provides a universal basis for integrating gaze into multimodal interfaces for different applications. We propose a model for multimodal integration of natural gaze behavior and evaluate it for two different use cases, namely for improvement of robustness of other potentially noisy input cues and for the design of proactive interaction techniques.