A fast and robust 3D head pose and gaze estimation system

Authors:
Koichi Kinoshita;Yong Ma;Shihong Lao;Masato Kawaade
Affiliations:
OMRON Corporation, Soraku-Gun, Kyoto, Japan;OMRON Corporation, Soraku-Gun, Kyoto, Japan;OMRON Corporation, Soraku-Gun, Kyoto, Japan;OMRON Corporation, Soraku-Gun, Kyoto, Japan
Venue:
Proceedings of the 8th international conference on Multimodal interfaces
Year:
2006

Citing 5
Cited 4

Active Appearance Models

IEEE Transactions on Pattern Analysis and Machine Intelligence
Model-Based Head Pose Tracking With Stereovision

FGR '02 Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition
Real-time combined 2D+3D active appearance models

CVPR'04 Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition
Head pose estimation using stereo vision for human-robot interaction

FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition
Bayesian tangent shape model: Estimating shape and pose parameters via bayesian inference

CVPR'03 Proceedings of the 2003 IEEE computer society conference on Computer vision and pattern recognition

Facial pose estimation using a symmetrical feature model

ICME'09 Proceedings of the 2009 IEEE international conference on Multimedia and Expo
An implementation of SVM-based gaze recognition system using advanced eye region detection

ICCSA'11 Proceedings of the 2011 international conference on Computational science and Its applications - Volume Part V
Tracking eye gaze under coordinated head rotations with an ordinary camera

ACCV'09 Proceedings of the 9th Asian conference on Computer Vision - Volume Part II
Loose-limbed People: Estimating 3D Human Pose and Motion Using Non-parametric Belief Propagation

International Journal of Computer Vision

Quantified Score

Hi-index	0.00

Visualization

Abstract

We developed a fast and robust head pose and gaze estimation system. This system can detect facial points and estimate 3D pose angles and gaze direction under various conditions including facial expression changes and partial occlusion. We need only one face image as input and do not need special devices such as blinking LEDs or stereo cameras. Moreover, no calibration is needed. The system shows a 95% head pose estimation accuracy and 81% gaze estimation accuracy (when the error margin is 15 degrees). The processing time is about 15 ms/frame (Pentium4 3.2 GHz). Acceptable range of facial pose is within a yaw (left-right) of ±60 degrees and within a pitch (up-down) of ±30 degrees.