Pose invariant face recognition under arbitrary illumination based on 3d face reconstruction

Authors:
Xiujuan Chai;Laiyun Qing;Shiguang Shan;Xilin Chen;Wen Gao
Affiliations:
School of Computer Science and Technology, Harbin Institute of Technology, Harbin, China;ICT-ISVISION Joint R&D Lab for Face Recognition, ICT, CAS, Beijing, China;ICT-ISVISION Joint R&D Lab for Face Recognition, ICT, CAS, Beijing, China;School of Computer Science and Technology, Harbin Institute of Technology, Harbin, China;School of Computer Science and Technology, Harbin Institute of Technology, Harbin, China
Venue:
AVBPA'05 Proceedings of the 5th international conference on Audio- and Video-Based Biometric Person Authentication
Year:
2005

Citing 11
Cited 0

Motion and Structure from Orthographic Projections

IEEE Transactions on Pattern Analysis and Machine Intelligence
Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection

IEEE Transactions on Pattern Analysis and Machine Intelligence
From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose

IEEE Transactions on Pattern Analysis and Machine Intelligence
SFS Based View Synthesis for Robust Face Recognition

FG '00 Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000
Eigen Light-Fields and Face Recognition Across Pose

FGR '02 Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition
The CMU Pose, Illumination, and Expression (PIE) Database

FGR '02 Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition
Face Recognition Based on Fitting a 3D Morphable Model

IEEE Transactions on Pattern Analysis and Machine Intelligence
Eigenfaces for recognition

Journal of Cognitive Neuroscience
Illuminating light field: image-based face recognition across illuminations and poses

FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition
Face recognition under variable lighting using harmonic image exemplars

CVPR'03 Proceedings of the 2003 IEEE computer society conference on Computer vision and pattern recognition
Gabor feature based classification using the enhanced fisher linear discriminant model for face recognition

IEEE Transactions on Image Processing

Quantified Score

Hi-index	0.00

Visualization

Abstract

Pose and illumination changes from picture to picture are two main barriers toward full automatic face recognition. In this paper, a novel method to handle both pose and lighting condition simultaneously is proposed, which calibrates the pose and lighting condition to a pre-set reference condition through an illumination invariant 3D face reconstruction. First, some located facial landmarks and a priori statistical deformable 3D model are used to recover an elaborate 3D shape. Based on the recovered 3D shape, the “texture image” calibrated to a standard illumination is generated by spherical harmonics ratio image and finally the illumination independent 3D face is reconstructed completely. The proposed method combines the strength of statistical deformable model to describe the shape information and the compact representations of the illumination in spherical frequency space, and handle both the pose and illumination variation simultaneously. This algorithm can be used to synthesize virtual views of a given face image and enhance the performance of face recognition. The experimental results on CMU PIE database show that this method can significantly improve the accuracy of the existed face recognition method when pose and illumination are inconsistent between gallery and probe sets.