3D facial pose tracking in uncalibrated videos

Authors:
Gaurav Aggarwal;Ashok Veeraraghavan;Rama Chellappa
Affiliations:
University of Maryland, College Park, MD;University of Maryland, College Park, MD;University of Maryland, College Park, MD
Venue:
PReMI'05 Proceedings of the First international conference on Pattern Recognition and Machine Intelligence
Year:
2005

Citing 9
Cited 8

Automatic Interpretation and Coding of Face Images Using Flexible Models

IEEE Transactions on Pattern Analysis and Machine Intelligence
Efficient Region Tracking With Parametric Models of Geometry and Illumination

IEEE Transactions on Pattern Analysis and Machine Intelligence
Fast, Reliable Head Tracking under Varying Illumination: An Approach Based on Registration of Texture-Mapped 3D Models

IEEE Transactions on Pattern Analysis and Machine Intelligence
Color-Based Tracking of Heads and Other Mobile Objects at Video Frame Rates

CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
Parametrized structure from motion for 3D adaptive feedback tracking of faces

CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
A Particle Filter without Dynamics for Robust 3D Face Tracking

CVPRW '04 Proceedings of the 2004 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'04) Volume 5 - Volume 05
Video-based face recognition using probabilistic appearance manifolds

CVPR'03 Proceedings of the 2003 IEEE computer society conference on Computer vision and pattern recognition
Robust online appearance models for visual tracking

IEEE Transactions on Pattern Analysis and Machine Intelligence
Visual tracking and recognition using appearance-adaptive models in particle filters

IEEE Transactions on Image Processing

Robust head tracking using 3D ellipsoidal head model in particle filter

Pattern Recognition
Pose Robust Face Tracking by Combining Active Appearance Models and Cylinder Head Models

International Journal of Computer Vision
Statistical Methods and Models for Video-Based Tracking, Modeling, and Recognition

Foundations and Trends in Signal Processing
Design and implementation of embedded computer vision systems based on particle filters

Computer Vision and Image Understanding
A robust head pose estimation system for uncalibrated monocular videos

Proceedings of the Seventh Indian Conference on Computer Vision, Graphics and Image Processing
Pattern recognition in video

PReMI'05 Proceedings of the First international conference on Pattern Recognition and Machine Intelligence
Dictionary-based face recognition from video

ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part VI
Visual Focus of Attention in Non-calibrated Environments using Gaze Estimation

International Journal of Computer Vision

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents a method to recover the 3D configuration of a face in each frame of a video. The 3D configuration consists of the 3 translational parameters and the 3 orientation parameters which correspond to the yaw, pitch and roll of the face, which is important for applications like face modeling, recognition, expression analysis, etc. The approach combines the structural advantages of geometric modeling with the statistical advantages of a particle-filter based inference. The face is modeled as the curved surface of a cylinder which is free to translate and rotate arbitrarily. The geometric modeling takes care of pose and self-occlusion while the statistical modeling handles moderate occlusion and illumination variations. Experimental results on multiple datasets are provided to show the efficacy of the approach. The insensitivity of our approach to calibration parameters (focal length) is also shown.