Efficient particle filtering using RANSAC with application to 3D face tracking

Authors:
Le Lu;Xiangtian Dai;Gregory Hager
Affiliations:
Computational Interaction and Robotics Lab, Computer Science Department, the Johns Hopkins University Baltimore, MD 21218, USA;Computational Interaction and Robotics Lab, Computer Science Department, the Johns Hopkins University Baltimore, MD 21218, USA;Computational Interaction and Robotics Lab, Computer Science Department, the Johns Hopkins University Baltimore, MD 21218, USA
Venue:
Image and Vision Computing
Year:
2006

Citing 17
Cited 7

A robust technique for matching two uncalibrated images through the recovery of the unknown epipolar geometry

Artificial Intelligence - Special volume on computer vision
Efficient Region Tracking With Parametric Models of Geometry and Illumination

IEEE Transactions on Pattern Analysis and Machine Intelligence
CONDENSATION—Conditional Density Propagation forVisual Tracking

International Journal of Computer Vision
Incremental Focus of Attention for Robust Vision-Based Tracking

International Journal of Computer Vision
Fast, Reliable Head Tracking under Varying Illumination: An Approach Based on Registration of Texture-Mapped 3D Models

IEEE Transactions on Pattern Analysis and Machine Intelligence
MLESAC: a new robust estimator with application to estimating image geometry

Computer Vision and Image Understanding - Special issue on robusst statistical techniques in image understanding
Learning and Classification of Complex Dynamics

IEEE Transactions on Pattern Analysis and Machine Intelligence
Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography

Communications of the ACM
Image Segmentation by Data-Driven Markov Chain Monte Carlo

IEEE Transactions on Pattern Analysis and Machine Intelligence
Probabilistic Tracking with Exemplars in a Metric Space

International Journal of Computer Vision - Marr Prize Special Issue
IMPSAC: Synthesis of Importance Sampling and Random Sample Consensus

IEEE Transactions on Pattern Analysis and Machine Intelligence
ICONDENSATION: Unifying Low-Level and High-Level Tracking in a Stochastic Framework

ECCV '98 Proceedings of the 5th European Conference on Computer Vision-Volume I - Volume I
Robust Full-Motion Recovery of Head by Dynamic Templates and Re-Registration Techniques

FGR '02 Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition
Robust and Rapid Generation of Animated Faces from Video Images: A Model-Based Modeling Approach

International Journal of Computer Vision - Special Issue on Research at Microsoft Corporation
Pose-Robust Face Recognition Using Geometry Assisted Probabilistic Modeling

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 1 - Volume 01
Real-time combined 2D+3D active appearance models

CVPR'04 Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition
A survey of convergence results on particle filtering methods forpractitioners

IEEE Transactions on Signal Processing

Visual Servoing in the Large

International Journal of Robotics Research
State estimation using particle filters in wildfire spread simulation

SpringSim '09 Proceedings of the 2009 Spring Simulation Multiconference
Real-time face tracking and pose estimation with partitioned sampling and relevance vector machine

ICRA'09 Proceedings of the 2009 IEEE international conference on Robotics and Automation
Editorial: Seeing faces in video by computers. Editorial for Special Issue on Face Processing in Video Sequences

Image and Vision Computing
Integrating multiple visual cues for robust real-time 3D face tracking

AMFG'07 Proceedings of the 3rd international conference on Analysis and modeling of faces and gestures
University of Glasgow at ImageCLEF 2009 robot vision task: a rule based approach

CLEF'09 Proceedings of the 10th international conference on Cross-language evaluation forum: multimedia experiments
Robust: real-time 3D face tracking from a monocular view

Journal on Image and Video Processing

Quantified Score

Hi-index	0.00

Visualization

Abstract

Particle filtering is a very popular technique for sequential state estimation. However, in high-dimensional cases where the state dynamics are complex or poorly modeled, thousands of particles are usually required for real applications. This paper presents a hybrid sampling solution that combines RANSAC and particle filtering. In this approach, RANSAC provides proposal particles that, with high probability, represent the observation likelihood. Both conditionally independent RANSAC sampling and boosting-like conditionally dependent RANSAC sampling are explored. We show that the use of RANSAC-guided sampling reduces the necessary number of particles to dozens for a full 3D tracking problem. This method is particularly advantageous when state dynamics are poorly modeled. We show empirically that the sampling efficiency (in terms of likelihood) is much higher with the use of RANSAC. The algorithm has been applied to the problem of 3D face pose tracking with changing expression. We demonstrate the validity of our approach with several video sequences acquired in an unstructured environment.