Model-Based 3D Face Capture with Shape-from-Silhouettes

  • Authors:
  • Baback Moghaddam;Jinho Lee;Hanspeter Pfister;Raghu Machiraju

  • Affiliations:
  • -;-;-;-

  • Venue:
  • AMFG '03 Proceedings of the IEEE International Workshop on Analysis and Modeling of Faces and Gestures
  • Year:
  • 2003

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present a method for 3D face acquisition using a set orsequence of 2D binary silhouettes. Since silhouette imagesdepend only on the shape and pose of an object, they areimmune to lighting and/or texture variations (unlike featureor texture-based shape-from-correspondence). Our prior3D face model is a linear combination of "eigenheads" obtainedby applying PCA to a training set of laser-scanned3D faces. These shape coefficients are the parameters for anear-automatic system for capturing the 3D shape as wellas the 2D texture-map of a novel input face. Specifically, weuse back-projection and a boundary-weighted XOR-basedcost function for binary silhouette matching, coupled with aprobabilistic "downhill-simplex" optimization for shape estimationand refinement. Experiments with a multi-camerarig as well as monocular video sequences demonstrate theadvantages of our 3D modeling framework and ultimately,its utility for robust face recognition with built-in invarianceto pose and illumination.