Hierarchical On-line Appearance-Based Tracking for 3D head pose, eyebrows, lips, eyelids and irises

Authors:
Javier Orozco;Ognjen Rudovic;Jordi GonzíLez;Maja Pantic
Affiliations:
Imperial College, Department of Computing, London, UK;Imperial College, Department of Computing, London, UK;Computer Vision Center, Campus UAB, Barcelona, Spain;Imperial College, Department of Computing, London, UK and University of Twente, EEMCS, Twente, Netherlands
Venue:
Image and Vision Computing
Year:
2013

Citing 21
Cited 2

Perspective approximations

Image and Vision Computing - Special issue: frequency increase for 1991
Active shape models—their training and application

Computer Vision and Image Understanding
Fast, Reliable Head Tracking under Varying Illumination: An Approach Based on Registration of Texture-Mapped 3D Models

IEEE Transactions on Pattern Analysis and Machine Intelligence
Active Appearance Models

IEEE Transactions on Pattern Analysis and Machine Intelligence
Automatic Recognition of Eye Blinking in Spontaneously Occurring Behavior

ICPR '02 Proceedings of the 16 th International Conference on Pattern Recognition (ICPR'02) Volume 4 - Volume 4
The Template Update Problem

IEEE Transactions on Pattern Analysis and Machine Intelligence
Active Appearance Models Revisited

International Journal of Computer Vision
Meticulously Detailed Eye Region Model and Its Application to Analysis of Facial Images

IEEE Transactions on Pattern Analysis and Machine Intelligence
An active model for facial feature tracking

EURASIP Journal on Applied Signal Processing
A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions

IEEE Transactions on Pattern Analysis and Machine Intelligence
Locating Facial Features with an Extended Active Shape Model

ECCV '08 Proceedings of the 10th European Conference on Computer Vision: Part IV
Adaptive active appearance model with incremental learning

Pattern Recognition Letters
Real-time gaze tracking with appearance-based models

Machine Vision and Applications
Generic vs. person specific active appearance models

Image and Vision Computing
Video-based face model fitting using Adaptive Active Appearance Model

Image and Vision Computing
Face tracking with automatic model construction

Image and Vision Computing
Robust Facial Feature Tracking Using Shape-Constrained Multiresolution-Selected Linear Predictors

IEEE Transactions on Pattern Analysis and Machine Intelligence
Robust online appearance models for visual tracking

IEEE Transactions on Pattern Analysis and Machine Intelligence
What Are You Looking at?

International Journal of Computer Vision
Face detection, pose estimation, and landmark localization in the wild

CVPR '12 Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
Local Evidence Aggregation for Regression-Based Facial Point Detection

IEEE Transactions on Pattern Analysis and Machine Intelligence

Human behavior sensing for tag relevance assessment

Proceedings of the 21st ACM international conference on Multimedia
Correlated-spaces regression for learning continuous emotion dimensions

Proceedings of the 21st ACM international conference on Multimedia

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we propose an On-line Appearance-Based Tracker (OABT) for simultaneous tracking of 3D head pose, lips, eyebrows, eyelids and irises in monocular video sequences. In contrast to previously proposed tracking approaches, which deal with face and gaze tracking separately, our OABT can also be used for eyelid and iris tracking, as well as 3D head pose, lips and eyebrows facial actions tracking. Furthermore, our approach applies an on-line learning of changes in the appearance of the tracked target. Hence, the prior training of appearance models, which usually requires a large amount of labeled facial images, is avoided. Moreover, the proposed method is built upon a hierarchical combination of three OABTs, which are optimized using a Levenberg-Marquardt Algorithm (LMA) enhanced with line-search procedures. This, in turn, makes the proposed method robust to changes in lighting conditions, occlusions and translucent textures, as evidenced by our experiments. Finally, the proposed method achieves head and facial actions tracking in real-time.