A new statistical model combining shape and spherical harmonics illumination for face reconstruction

  • Authors:
  • Abdelrehim Ahmed;Aly Farag

  • Affiliations:
  • Computer Vision and Image Processing Laboratory, University of Louisville, Louisville, KY;Computer Vision and Image Processing Laboratory, University of Louisville, Louisville, KY

  • Venue:
  • ISVC'07 Proceedings of the 3rd international conference on Advances in visual computing - Volume Part I
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper develops a new statistical model that can be used to recover the 3D face shape from a single image taken under arbitrary lighting conditions. The proposed statistical model combines shape and image intensity information. The latter is represented by a spherical harmonics (SH) space. Given a training data set of aligned height maps of faces and their corresponding albedos, The input image is projected into the space spanned by the SH basis images of each member in the data set. The combined statistical model is obtained by performing the PCA on both the SH projections and the height maps. Finally, the face is reconstructed by fitting the model to the input intensity image. In addition to the shape recovery, the proposed model can be used to recover the face albedo and to estimate the light direction. Experiments have been conducted to evaluate the performance of the proposed approach.