Facial Feature Tracking using a Multi-State Hierarchical Shape Model under Varying Face Pose and Facial Expression

Authors:
Yan Tong;Yang Wang;Zhiwei Zhu;Qiang Ji
Affiliations:
Rensselaer Polytechnic Institute, Troy, NY 12180-3590, USA;Rensselaer Polytechnic Institute, Troy, NY 12180-3590, USA;Rensselaer Polytechnic Institute, Troy, NY 12180-3590, USA;Rensselaer Polytechnic Institute, Troy, NY 12180-3590, USA
Venue:
ICPR '06 Proceedings of the 18th International Conference on Pattern Recognition - Volume 01
Year:
2006

Citing 0
Cited 2

Adapted active appearance models

Journal on Image and Video Processing
A graphical model based solution to the facial feature point tracking problem

Image and Vision Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents a multi-state hierarchical approach for facial feature tracking. A hierarchical formulation of statistical shape models is proposed to characterize both global shape constraints of human faces and local structural details of facial components. Gabor wavelets and gray level profiles are integrated for effective and efficient representation of feature points. Furthermore, multi-state local shape models are presented to deal with shape variations of facial components. Meanwhile, face pose estimation helps improve shape constraints for the feature search. Both facial component states and feature point positions are dynamically estimated using a multi-modal tracking approach. Experimental results demonstrate that the proposed method accurately and robustly tracks facial features under different facial expressions and pose variations.