Visual tracking for multimodal human computer interaction
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Modeling focus of attention for meeting indexing
MULTIMEDIA '99 Proceedings of the seventh ACM international conference on Multimedia (Part 1)
Model-based varying pose face detection and facial feature registration in video images
MULTIMEDIA '00 Proceedings of the eighth ACM international conference on Multimedia
Model-based varying pose face detection and facial feature registration in colour images
Pattern Recognition Letters
From Gaze to Focus of Attention
VISUAL '99 Proceedings of the Third International Conference on Visual Information and Information Systems
Estimating focus of attention based on gaze and sound
Proceedings of the 2001 workshop on Perceptive user interfaces
An embedded system for an eye-detection sensor
Computer Vision and Image Understanding - Special issue on eye detection and tracking
Head Pose Estimation in Single- and Multi-view Environments - Results on the CLEAR'07 Benchmarks
Multimodal Technologies for Perception of Humans
Monocular Head Pose Estimation
ICIAR '08 Proceedings of the 5th international conference on Image Analysis and Recognition
An embedded system for an eye-detection sensor
Computer Vision and Image Understanding - Special issue on eye detection and tracking
Facial pose estimation using a symmetrical feature model
ICME'09 Proceedings of the 2009 IEEE international conference on Multimedia and Expo
Neural network-based head pose estimation and multi-view fusion
CLEAR'06 Proceedings of the 1st international evaluation conference on Classification of events, activities and relationships
Refining face tracking with integral projections
AVBPA'03 Proceedings of the 4th international conference on Audio- and video-based biometric person authentication
Estimating the lecturer's head pose in seminar scenarios – a multi-view approach
MLMI'05 Proceedings of the Second international conference on Machine Learning for Multimodal Interaction
Gaze locking: passive eye contact detection for human-object interaction
Proceedings of the 26th annual ACM symposium on User interface software and technology
| Hi-index | 0.00 |
In this paper we present a non-intrusive model-based gaze tracking system. The system estimates the 3D pose of a user's head by tracking as few as six facial feature points. The system locates a human face using a statistical color model without any mark on the face and then traces the facial features, such as eyes, nostrils and lip corners. A full perspective model is employed to map these feature points onto the 3D pose. Several techniques have been developed to track the features points and recover from failure. We currently achieve a frame rate of 15+ frames per second using an HP 9000 workstation with a frame grabber and a Canon VC-C1 camera. The application of the system has been demonstrated by a gaze-driven panorama image viewer. The potential applications of the system include multimodal interfaces, virtual reality and video-teleconferencing.