An empirical study of eye-gaze behaviors: towards the estimation of conversational engagement in human-agent communication

Authors:
Ryo Ishii;Yukiko I. Nakano
Affiliations:
NTT Corporation, Kanagawa, Japan;Seikei University, Tokyo, Japan
Venue:
Proceedings of the 2010 workshop on Eye gaze in intelligent human machine interaction
Year:
2010

Citing 5
Cited 2

Conversing with the user based on eye-gaze patterns

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Towards a model of face-to-face grounding

ACL '03 Proceedings of the 41st Annual Meeting on Association for Computational Linguistics - Volume 1
Attentive Presentation Agents

IVA '07 Proceedings of the 7th international conference on Intelligent Virtual Agents
Estimating User's Conversational Engagement Based on Gaze Behaviors

IVA '08 Proceedings of the 8th international conference on Intelligent Virtual Agents
Explorations in engagement for humans and robots

Artificial Intelligence

Gaze and conversational engagement in multiparty video conversation: an annotation scheme and classification of high and low levels of engagement

Proceedings of the 4th Workshop on Eye Gaze in Intelligent Human Machine Interaction
A gaze-based method for relating group involvement to individual engagement in multimodal multiparty dialogue

Proceedings of the 15th ACM on International conference on multimodal interaction

Quantified Score

Hi-index	0.00

Visualization

Abstract

In face-to-face conversations, speakers are continuously checking whether the listener is engaged in the conversation by monitoring the partner's eye-gaze behaviors. In this study, focusing on eye-gaze as information of estimating user's conversational engagement, first, we conduct a Wizard-of-Oz experiment to collect the user's gaze behaviors as well as the user's subjective reports and an observer's judgment concerning the user's engagement in the conversation. Then, by analyzing the user's gaze behaviors, variables and factors for estimating the user's engagement are identified. Based on the analysis, we propose four types of engagement estimation methods based on gaze duration information and gaze transition 3-gram patterns. As the results of comparing the performance of these methods, it is revealed that a method which takes account of the individual differences in gaze transition patterns performs the best and can predict the user's conversational engagement quite well.