Real-time 3D face tracking with mutual information and active contours

Authors:
Giorgio Panin;Alois Knoll
Affiliations:
Technical University of Munich, Informatics Faculty, Munich, Germany;Technical University of Munich, Informatics Faculty, Munich, Germany
Venue:
ISVC'07 Proceedings of the 3rd international conference on Advances in visual computing - Volume Part I
Year:
2007

Citing 10
Cited 1

Alignment by Maximization of Mutual Information

International Journal of Computer Vision
CONDENSATION—Conditional Density Propagation forVisual Tracking

International Journal of Computer Vision
Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography

Communications of the ACM
Robust Real-Time Face Detection

International Journal of Computer Vision
The Contracting Curve Density Algorithm: Fitting Parametric Curve Models to Images Using Local Self-Adapting Separation Criteria

International Journal of Computer Vision
Stable Real-Time 3D Tracking Using Online and Offline Information

IEEE Transactions on Pattern Analysis and Machine Intelligence
A Particle Filter without Dynamics for Robust 3D Face Tracking

CVPRW '04 Proceedings of the 2004 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'04) Volume 5 - Volume 05
An Efficient and Robust Real-Time Contour Tracking System

ICVS '06 Proceedings of the Fourth IEEE International Conference on Computer Vision Systems
Real-time combined 2D+3D active appearance models

CVPR'04 Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition
Image-based photorealistic 3-D face modeling

FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition

Constraint task-based control in industrial settings

IROS'09 Proceedings of the 2009 IEEE/RSJ international conference on Intelligent robots and systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

We present a markerless real-time, model-based 3D face tracking methodology. The system combines two robust and complimentary op-timization-based strategies, namely active contours and mutual information template matching, in order to obtain real-time performances for full 6dof tracking. First, robust head contour estimation is realized by means of the Contracting Curve Density algorithm, effectively employing local color statistics separation for contour shape optimization. Afterwards, the 3D face template is robustly matched to the underlying image, through fastmutual information optimization. Off-line model building is done using a fast modeling procedure, providing a unique appearance model for each user. Re-initialization criteria are employed in order to obtain a complete and autonomous tracking system.