IEEE Transactions on Pattern Analysis and Machine Intelligence
Facial Shape-from-shading and Recognition Using Principal Geodesic Analysis and Robust Statistics
International Journal of Computer Vision
A pose-wise linear illumination manifold model for face recognition using video
Computer Vision and Image Understanding
VIIP '07 The Seventh IASTED International Conference on Visualization, Imaging and Image Processing
Face synthesis using facial trait code and its application to creating suspect's physical profiles
ICME'09 Proceedings of the 2009 IEEE international conference on Multimedia and Expo
Active lighting for video conferencing
IEEE Transactions on Circuits and Systems for Video Technology
A new statistical model combining shape and spherical harmonics illumination for face reconstruction
ISVC'07 Proceedings of the 3rd international conference on Advances in visual computing - Volume Part I
Face image relighting using locally constrained global optimization
ECCV'10 Proceedings of the 11th European conference on Computer vision: Part IV
ISVC'11 Proceedings of the 7th international conference on Advances in visual computing - Volume Part I
Pose-encoded spherical harmonics for robust face recognition using a single image
AMFG'05 Proceedings of the Second international conference on Analysis and Modelling of Faces and Gestures
Face reconstruction across different poses and arbitrary illumination conditions
AVBPA'05 Proceedings of the 5th international conference on Audio- and Video-Based Biometric Person Authentication
Perception-Based lighting adjustment of image sequences
ACCV'09 Proceedings of the 9th Asian conference on Computer Vision - Volume Part III
A study on the effective approach to illumination-invariant face recognition based on a single image
CCBR'12 Proceedings of the 7th Chinese conference on Biometric Recognition
3D aided face recognition across pose variations
CCBR'12 Proceedings of the 7th Chinese conference on Biometric Recognition
| Hi-index | 0.00 |
Understanding and modifying the effects of arbitrary illumination on human faces in a realistic manner is a challenging problem both for face synthesis and recognition. Recent research demonstrates that the set of images of a convex Lambertian object obtained under a wide variety of lighting conditions can be approximated accurately by a low-dimensional linear subspace using spherical harmonics representation. Morphable models are statistical ensembles of facial properties such as shape and texture. In this paper, we integrate spherical harmonics into the morphable model framework, by proposing a 3D Spherical Harmonic Basis Morphable Model(SHBMM) and demonstrate that any face under arbitrary unknown lighting can be simply represented by three low-dimensional vectors: shape parameters, spherical harmonic basis parameters and illumination coefficients. We show that, with our SHBMM, given one single image under arbitrary unknown lighting, we can remove the illumination effects from the image (face "delighting") and synthesize new images under different illumination conditions (face "re-lighting"). Furthermore, we demonstrate that cast shadows can be detected and subsequently removed by using the image error between the input image and the corresponding rendered image. We also propose two illumination invariant face recognition methods based on the recovered SHBMM parameters and the de-lit images respectively. Experimental results show that using only a single image of a face under unknown lighting, we can achieve high recognition rates and generate photo-realistic images of the face under a wide range of illumination conditions, including multiple sources of illumination.