3D face and motion estimation from sparse points using adaptive bracketed minimization

Authors:
Varin Chouvatut;Suthep Madarasmi;Mihran Tuceryan
Affiliations:
Computer Engineering Department, King Mongkut's University of Technology Thonburi, Bangkok, Thailand;Computer Engineering Department, King Mongkut's University of Technology Thonburi, Bangkok, Thailand;Computer and Information Science Department, Indiana University-Purdue University Indianapolis, Indianapolis, USA 46202-5132
Venue:
Multimedia Tools and Applications
Year:
2013

Citing 13
Cited 0

Projective Reconstruction and Invariants from Multiple Images

IEEE Transactions on Pattern Analysis and Machine Intelligence
Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography

Communications of the ACM
Novel View Synthesis by Cascading Trilinear Tensors

IEEE Transactions on Visualization and Computer Graphics
Interpreting Face Images Using Active Appearance Models

FG '98 Proceedings of the 3rd. International Conference on Face & Gesture Recognition
Marker Tracking and HMD Calibration for a Video-Based Augmented Reality Conferencing System

IWAR '99 Proceedings of the 2nd IEEE and ACM International Workshop on Augmented Reality
Multiple View Geometry in Computer Vision

Multiple View Geometry in Computer Vision
Real-Time Camera Parameter Estimation from Images for a Mixed Reality System

ICPR '00 Proceedings of the International Conference on Pattern Recognition - Volume 4
A Factorization Method for Structure from Planar Motion

WACV-MOTION '05 Proceedings of the IEEE Workshop on Motion and Video Computing (WACV/MOTION'05) - Volume 2 - Volume 02
3D Models from Extended Uncalibrated Video Sequences: Addressing Key-Frame Selection and Projective Drift

3DIM '05 Proceedings of the Fifth International Conference on 3-D Digital Imaging and Modeling
Sliding adjustment for 3D video representation

EURASIP Journal on Applied Signal Processing
Novel directional gradient descent searches for fast block motion estimation

IEEE Transactions on Circuits and Systems for Video Technology
Motion estimation using a one-dimensional gradient descent search

IEEE Transactions on Circuits and Systems for Video Technology
Reformulated radial basis neural networks trained by gradient descent

IEEE Transactions on Neural Networks

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents a novel method for estimating camera motion and reconstructing human face from a video sequence. The coarse-to-fine method is applied via combining the concepts of Powell's minimization with gradient descent. Sparse points defining the human face in every frame are tracked using the active appearance model. The case of occluded points, even for self-occlusion, does not pose a problem in the proposed method. Robustness in the presence of noise and 3D accuracy using this method is also demonstrated. Examples of face reconstruction using other methods including trifocal tensor, Powell's minimization, and gradient descent are also compared to the proposed method. Experiments on both synthetic and real faces are presented and analyzed. Also, different camera movement paths are illustrated. All real-world experiments used an off-the-shelf digital camera carried by a human walking without using any dolly to demonstrate the robustness and practicality of the proposed method.