Visual reconstruction
Adaptive algorithms and stochastic approximations
Adaptive algorithms and stochastic approximations
Elements of information theory
Elements of information theory
Statistical Analysis of Inherent Ambiguities in Recovering 3-D Motion from a Noisy Flow Field
IEEE Transactions on Pattern Analysis and Machine Intelligence
An introduction to signal detection and estimation (2nd ed.)
An introduction to signal detection and estimation (2nd ed.)
A guided tour of computer vision
A guided tour of computer vision
Extracting Structure from Optical Flow Using the Fast Error Search Technique
International Journal of Computer Vision
Regularized Bundle-Adjustment to Model Heads from Image Sequences without Calibration Data
International Journal of Computer Vision
A critique of structure-from-motion algorithms
Computer Vision and Image Understanding
Multiple view geometry in computer visiond
Multiple view geometry in computer visiond
Error characterization of the factorization method
Computer Vision and Image Understanding
Three D-Dynamic Scene Analysis: A Stereo Based Approach
Three D-Dynamic Scene Analysis: A Stereo Based Approach
Data Fusion for Sensory Information Processing Systems
Data Fusion for Sensory Information Processing Systems
On sequential Monte Carlo sampling methods for Bayesian filtering
Statistics and Computing
Face Identification by Fitting a 3D Morphable Model Using Linear Shape and Texture Error Functions
ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part IV
Introduction to Stochastic Search and Optimization
Introduction to Stochastic Search and Optimization
Parametrized structure from motion for 3D adaptive feedback tracking of faces
CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
Stochastic Approximation and Rate-Distortion Analysis for Robust Structure and Motion Estimation
International Journal of Computer Vision
Pattern Classification (2nd Edition)
Pattern Classification (2nd Edition)
Wide baseline image registration with application to 3-D face modeling
IEEE Transactions on Multimedia
An information theoretic criterion for evaluating the quality of 3-D reconstructions from video
IEEE Transactions on Image Processing
Stochastic Approximation and Rate-Distortion Analysis for Robust Structure and Motion Estimation
International Journal of Computer Vision
Special issue on face recognition
Computer Vision and Image Understanding - Special issue on Face recognition
Face recognition: A literature survey
ACM Computing Surveys (CSUR)
A multimodal approach for 3D face modeling and recognition using 3D deformable facial mask
Machine Vision and Applications
Person recognition using facial video information: A state of the art
Journal of Visual Languages and Computing
Reconstruction of Facial Shape from Freehand Multi-viewpoint Snapshots
ISVC '09 Proceedings of the 5th International Symposium on Advances in Visual Computing: Part II
Statistical Methods and Models for Video-Based Tracking, Modeling, and Recognition
Foundations and Trends in Signal Processing
Tracking vertex flow and model adaptation for three-dimensional spatiotemporal face analysis
IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans - Special issue on recent advances in biometrics
An evaluation of video-to-video face verification
IEEE Transactions on Information Forensics and Security
Face recognition using more than one still image: what is more?
SINOBIOMETRICS'04 Proceedings of the 5th Chinese conference on Advances in Biometric Person Authentication
Hi-index | 0.00 |
Reconstructing a 3D model of a human face from a monocular video sequence is an important problem in computer vision, with applications to recognition, surveillance, multimedia, etc. However, the quality of 3D reconstructions using structure from motion (SfM) algorithms is often not satisfactory. One of the reasons is the poor quality of the input video data. Hence, it is important that 3D face reconstruction algorithms take into account the statistics representing the quality of the video. Also, because of the structural similarities of most faces, it is natural that the performance of these algorithms can be improved by using a generic model of a face. Most of the existing work using this approach initializes the reconstruction algorithm with this generic model. The problem with this approach is that the algorithm can converge to a solution very close to this initial value, resulting in a reconstruction which resembles the generic model rather than the particular face in the video which needs to be modeled. In this paper, we propose a method of 3D reconstruction of a human face from video in which the 3D reconstruction algorithm and the generic model are handled separately. We show that it is possible to obtain a reasonably good 3D SfM estimate purely from the video sequence, provided the quality of the input video is statistically assessed and incorporated into the algorithm. The final 3D model is obtained after combining the SfM estimate and the generic model using an energy function that corrects for the errors in the estimate by comparing the local regions in the two models. The main advantage of our algorithm over others is that it is able to retain the specific features of the face in the video sequence even when these features are different from those of the generic model and it does so even as the quality of the input video varies. The evolution of the 3D model through the various stages of the algorithm and an analysis of its accuracy are presented.