Face reconstruction across different poses and arbitrary illumination conditions

Authors:
Sen Wang;Lei Zhang;Dimitris Samaras
Affiliations:
Department of Computer Science, SUNY at Stony Brook, NY;Department of Computer Science, SUNY at Stony Brook, NY;Department of Computer Science, SUNY at Stony Brook, NY
Venue:
AVBPA'05 Proceedings of the 5th international conference on Audio- and Video-Based Biometric Person Authentication
Year:
2005

Citing 16
Cited 1

Scattered Data Modeling

IEEE Computer Graphics and Applications - Special issue on computer-aided geometric design
A robust technique for matching two uncalibrated images through the recovery of the unknown epipolar geometry

Artificial Intelligence - Special volume on computer vision
Synthesizing realistic facial expressions from photographs

Proceedings of the 25th annual conference on Computer graphics and interactive techniques
A morphable model for the synthesis of 3D faces

Proceedings of the 26th annual conference on Computer graphics and interactive techniques
Image-based visual hulls

Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Regularized Bundle-Adjustment to Model Heads from Image Sequences without Calibration Data

International Journal of Computer Vision
An efficient representation for irradiance environment maps

Proceedings of the 28th annual conference on Computer graphics and interactive techniques
The Visual Hull Concept for Silhouette-Based Image Understanding

IEEE Transactions on Pattern Analysis and Machine Intelligence
Lambertian Reflectance and Linear Subspaces

IEEE Transactions on Pattern Analysis and Machine Intelligence
Face Identification by Fitting a 3D Morphable Model Using Linear Shape and Texture Error Functions

ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part IV
Incorporating Illumination Constraints in Deformable Models

CVPR '98 Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
Face Recognition Based on Fitting a 3D Morphable Model

IEEE Transactions on Pattern Analysis and Machine Intelligence
The CMU Pose, Illumination, and Expression Database

IEEE Transactions on Pattern Analysis and Machine Intelligence
Face Synthesis and Recognition from a Single Image under Arbitrary Unknown Lighting Using a Spherical Harmonic Basis Morphable Model

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 2 - Volume 02
Accurate face models from uncalibrated and Ill-Lit video sequences

CVPR'04 Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition
Face recognition under variable lighting using harmonic image exemplars

CVPR'03 Proceedings of the 2003 IEEE computer society conference on Computer vision and pattern recognition

Surface measures for accuracy evaluation in 3d face reconstruction

Pattern Recognition

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we present a novel method for face reconstruction from multi-posed face images taken under arbitrary unknown illumination conditions. Previous work shows that any face image can be represented by a set of low dimensional parameters: shape parameters, spherical harmonic basis (SHB) parameters, pose parameters and illumination coefficients. Thus, face reconstruction can be performed by recovering the set of parameters from the input images. In this paper, we demonstrate that the shape and SHB parameters can be estimated by minimizing the silhouettes errors and image intensity errors in a fast and robust manner. We propose a new algorithm to detect the corresponding points between the 3D face model and the input images by using silhouettes. We also apply a model-based bundle adjustment technique to perform this minimization. We provide a series of experiments on both synthetic and real data and experimental results show that our method can have an accurate face shape and texture reconstruction.