Multiview face capture using polarized spherical gradient illumination

  • Authors:
  • Abhijeet Ghosh;Graham Fyffe;Borom Tunwattanapong;Jay Busch;Xueming Yu;Paul Debevec

  • Affiliations:
  • USC Institute for Creative Technologies;USC Institute for Creative Technologies;USC Institute for Creative Technologies;USC Institute for Creative Technologies;USC Institute for Creative Technologies;USC Institute for Creative Technologies

  • Venue:
  • Proceedings of the 2011 SIGGRAPH Asia Conference
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present a novel process for acquiring detailed facial geometry with high resolution diffuse and specular photometric information from multiple viewpoints using polarized spherical gradient illumination. Key to our method is a new pair of linearly polarized lighting patterns which enables multiview diffuse-specular separation under a given spherical illumination condition from just two photographs. The patterns -- one following lines of latitude and one following lines of longitude -- allow the use of fixed linear polarizers in front of the cameras, enabling more efficient acquisition of diffuse and specular albedo and normal maps from multiple viewpoints. In a second step, we employ these albedo and normal maps as input to a novel multi-resolution adaptive domain message passing stereo reconstruction algorithm to create high resolution facial geometry. To do this, we formulate the stereo reconstruction from multiple cameras in a commonly parameterized domain for multiview reconstruction. We show competitive results consisting of high-resolution facial geometry with relightable reflectance maps using five DSLR cameras. Our technique scales well for multiview acquisition without requiring specialized camera systems for sensing multiple polarization states.