3D head pose estimation and tracking using particle filtering and ICP algorithm

Authors:
Mahdi Ben Ghorbel;Malek Baklouti;Serge Couvet
Affiliations:
Electrical Engineering Program, King Abdullah University of Sciences and Technology, Thuwal, Makkah Province, Saudi Arabia;Thales Research Departement, Division of Security and Services Solutions, Val-d'Oise Department, France;Thales Research Departement, Division of Security and Services Solutions, Val-d'Oise Department, France
Venue:
AMDO'10 Proceedings of the 6th international conference on Articulated motion and deformable objects
Year:
2010

Citing 16
Cited 1

Least-Squares Fitting of Two 3-D Point Sets

IEEE Transactions on Pattern Analysis and Machine Intelligence
Least-Squares Estimation of Transformation Parameters Between Two Point Patterns

IEEE Transactions on Pattern Analysis and Machine Intelligence
Estimating 3-D location parameters using dual number quaternions

CVGIP: Image Understanding
A comparison of four algorithms for estimating 3-D rigid transformations

BMVC '95 Proceedings of the 1995 British conference on Machine vision (Vol. 1)
Example-based head tracking

FG '96 Proceedings of the 2nd International Conference on Automatic Face and Gesture Recognition (FG '96)
Pose Estimation using 3D View-Based Eigenspaces

AMFG '03 Proceedings of the IEEE International Workshop on Analysis and Modeling of Faces and Gestures
Head Pose Estimation by Nonlinear Manifold Learning

ICPR '04 Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 4 - Volume 04
Graph Embedded Analysis for Head Pose Estimation

FGR '06 Proceedings of the 7th International Conference on Automatic Face and Gesture Recognition
Synergistic Face Detection and Pose Estimation with Energy-Based Models

The Journal of Machine Learning Research
EM enhancement of 3D head pose estimated by point at infinity

Image and Vision Computing
A two-stage head pose estimation framework and evaluation

Pattern Recognition
Real-time KD-tree construction on graphics hardware

ACM SIGGRAPH Asia 2008 papers
Head Pose Estimation in Computer Vision: A Survey

IEEE Transactions on Pattern Analysis and Machine Intelligence
Robust real-time 3D head pose estimation from range data

Pattern Recognition
Adaptive view-based appearance models

CVPR'03 Proceedings of the 2003 IEEE computer society conference on Computer vision and pattern recognition
Modeling focus of attention for meeting indexing based on multiple cues

IEEE Transactions on Neural Networks

Head-pose recognition for a game system based on nose's relative position

HCII'11 Proceedings of the 14th international conference on Human-computer interaction: users and applications - Volume Part IV

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper addresses the issue of 3D head pose estimation and tracking. Existing approaches generally need huge database, training procedure, manual initialization or use face feature extraction manually extracted. We propose a framework for estimating the 3D head pose in its fine level and tracking it continuously across multiple Degrees of Freedom (DOF) based on ICP and particle filtering. We propose to approach the problem, using 3D computational techniques, by aligning a face model to the 3D dense estimation computed by a stereo vision method, and propose a particle filter algorithm to refine and track the posteriori estimate of the position of the face. This work comes with two contributions: the first concerns the alignment part where we propose an extended ICP algorithm using an anisotropic scale transformation. The second contribution concerns the tracking part. We propose the use of the particle filtering algorithm and propose to constrain the search space using ICP algorithm in the propagation step. The results show that the system is able to fit and track the head properly, and keeps accurate the results on new individuals without a manual adaptation or training.