Robust 3D human face reconstruction by consumer binocular-stereo cameras

  • Authors:
  • Chen Huang;Wei Hu;Yiming Zhang

  • Affiliations:
  • Tsinghua University;Intel Labs China;Intel Labs China

  • Venue:
  • Proceedings of the 11th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper describes a robust 3D human face reconstruction approach by consumer binocular-stereo cameras. It aims to handle the ambiguity due to the captured noisy or distorted stereo images and the textureless nature of human face. First, seven facial feature points are extracted to deform a generic 3D face for initialization. A novel two-pass seed searching algorithm is then employed to deliver a set of sparse seeds. Also proposed is the seed outlier detection algorithm by using polynomial curves to introduce the smoothness prior. The resulting seeds significantly reduce the ambiguity, and propagate to remaining pixels using a modified seed growing strategy. The discussion also addresses polynomial curve fitting based disparity map denoising, stereo refinement and multibase-line matching for epipolar misalignment. They allow us to produce dense and detail preserving face models despite the low quality of image capture with consumer cameras. Both qualitative and quantitative evaluations demonstrate the state-of-the-art performance of our approach, and the accuracy is comparable to some active systems. Our approach can also deal with large facial expressions.