Model-based real-time head tracking

Authors:
Jacob Ström
Affiliations:
Multimedia Technologies Department, Ericsson Research, Torshamnsgatan, Stockholm, Sweden
Venue:
EURASIP Journal on Applied Signal Processing
Year:
2002

Citing 15
Cited 2

Recognizing Facial Expressions in Image Sequences Using Local Parameterized Models of Image Motion

International Journal of Computer Vision
On Degeneracy of Linear Reconstruction From Three Views: Linear Line Complex and Applications

IEEE Transactions on Pattern Analysis and Machine Intelligence
Fast, Reliable Head Tracking under Varying Illumination: An Approach Based on Registration of Texture-Mapped 3D Models

IEEE Transactions on Pattern Analysis and Machine Intelligence
3-D Motion Estimation in Model-Based Facial Image Coding

IEEE Transactions on Pattern Analysis and Machine Intelligence
Recursive Estimation of Motion, Structure, and Focal Length

IEEE Transactions on Pattern Analysis and Machine Intelligence
Active Appearance Models

ECCV '98 Proceedings of the 5th European Conference on Computer Vision-Volume II - Volume II
Autocalibration from Planar Scenes

ECCV '98 Proceedings of the 5th European Conference on Computer Vision-Volume I - Volume I
Multi-Modal Tracking of Faces for Video Communications

CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
LAFTER: Lips and Face Real-Time Tracker

CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
Parametrized structure from motion for 3D adaptive feedback tracking of faces

CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
The Integration of Optical Flow and Deformable Models with Applications to Human Face Shape and Motion Estimation

CVPR '96 Proceedings of the 1996 Conference on Computer Vision and Pattern Recognition (CVPR '96)
Robust 3D Head Tracking Under Partial Occlusion

FG '00 Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000
Real Time Tracking and Modeling of Faces: An EKF-Based Analysis by Synthesis Approach

MPEOPLE '99 Proceedings of the IEEE International Workshop on Modelling People
Motion Regularization for Model-Based Head Tracking

ICPR '96 Proceedings of the International Conference on Pattern Recognition (ICPR '96) Volume III-Volume 7276 - Volume 7276
Maintaining Multiple Motion Model Hypotheses Over Many Views to Recover Matching and Structure

ICCV '98 Proceedings of the Sixth International Conference on Computer Vision

Efficient Active Appearance Model for Real-Time Head and Facial Feature Tracking

AMFG '03 Proceedings of the IEEE International Workshop on Analysis and Modeling of Faces and Gestures
High-performance face tracking

Proceedings of the 3rd Symposium on Facial Analysis and Animation

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper treats real-time tracking of a human head using an analysis by synthesis approach. The work is based on the Structure from Motion (SfM) algorithm from Azarbayejani and Pentland (1995). We will analyze the convergence properties of the SfM algorithm for planar objects, and extend it to handle new points. The extended algorithm is then used for head tracking. The system tracks feature points in the image using a texture mapped three-dimensional model of the head. The texture is updated adaptively so that points in the ear region can be tracked when the user's head is rotated far, allowing out-of-plane rotation of up to 90° without losing track. The covariance of the x- and the y-coordinates are estimated and forwarded to the Kalman filter, making the tracker robust to occlusion. The system automatically detects tracking failure and reinitializes the algorithm using information gathered in the original initialization process.