Gaze-communicative behavior of stuffed-toy robot with joint attention and eye contact based on ambient gaze-tracking

Authors:
Tomoko Yonezawa;Hirotake Yamazoe;Akira Utsumi;Shinji Abe
Affiliations:
ATR Intelligent Robotics and Communication Laboratories, Kyoto, Japan;ATR Intelligent Robotics and Communication Laboratories, Kyoto, Japan;ATR Intelligent Robotics and Communication Laboratories, Kyoto, Japan;ATR Intelligent Robotics and Communication Laboratories, Kyoto, Japan
Venue:
Proceedings of the 9th international conference on Multimodal interfaces
Year:
2007

Citing 11
Cited 9

Messages embedded in gaze of interface agents --- impression management with agent's gaze

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Theory of Mind for a Humanoid Robot

Autonomous Robots
RobotPHONE: RUI for interpersonal communication

CHI '01 Extended Abstracts on Human Factors in Computing Systems
Just blink your eyes: a head-free gaze tracking system

CHI '03 Extended Abstracts on Human Factors in Computing Systems
An Algorithm for Real-Time Stereo Vision Implementation of Head Pose and Gaze Direction Measurement

FG '00 Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000
Estimating the eye gaze from one eye

Computer Vision and Image Understanding - Special issue on eye detection and tracking
Explorations in engagement for humans and robots

Artificial Intelligence
Learning From and About Others: Towards Using Imitation to Bootstrap the Social Understanding of Others by Robots

Artificial Life
Cross-modal coordination of expressive strength between voice and gesture for personified media

Proceedings of the 8th international conference on Multimodal interfaces
Gaze Tracking by Using Factorized Likelihoods Particle Filtering and Stereo Vision

3DPVT '06 Proceedings of the Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06)
Gazecoppet: hierarchical gaze-communication in ambient space

ACM SIGGRAPH 2007 posters

Remote gaze estimation with a single camera based on facial-feature tracking without special calibration actions

Proceedings of the 2008 symposium on Eye tracking research & applications
Evaluating crossmodal awareness of daily-partner robot to user's behaviors with gaze and utterance detection

Proceedings of the 3rd ACM International Workshop on Context-Awareness for Self-Managing Systems
AttractiveEye: augmented gaze representation for "what is the robot looking at?"

ICRA'09 Proceedings of the 2009 IEEE international conference on Robotics and Automation
Psychological effects on interpersonal communication by bystander android using motions based on human-like needs

IROS'09 Proceedings of the 2009 IEEE/RSJ international conference on Intelligent robots and systems
Joint attention, joint probability

Proceedings of the 7th International Conference on Advances in Mobile Computing and Multimedia
Learning spontaneous nonverbal behavior using a three layers hierarchy

ACS'10 Proceedings of the 10th WSEAS international conference on Applied computer science
Autonomous development of gaze control for natural human-robot interaction

Proceedings of the 2010 workshop on Eye gaze in intelligent human machine interaction
Gaze tracking in wide area using multiple camera observations

Proceedings of the Symposium on Eye Tracking Research and Applications
2nd International Workshop on Pervasive Eye Tracking and Mobile Eye-Based Interaction (PETMEI 2012): proposal for a workshop (mini-track) at UbiComp 2012

Proceedings of the 2012 ACM Conference on Ubiquitous Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper proposes a gaze-communicative stuffed-toy robot system with joint attention and eye-contact reactions based on ambient gaze-tracking. For free and natural interaction, we adopted our remote gaze-tracking method. Corresponding to the user's gaze, the gaze-reactive stuffed-toy robot is designed to gradually establish 1) joint attention using the direction of the robot's head and 2) eye-contact reactions from several sets of motion. From both subjective evaluations and observations of the user's gaze in the demonstration experiments, we found that i) joint attention draws the user's interest along with the user-guessed interest of the robot, ii) "eye contact" brings the user a favorable feeling for the robot, and iii) this feeling is enhanced when "eye contact" is used in combination with "joint attention." These results support the approach of our embodied gaze-communication model.