Dynamic shape capture using multi-view photometric stereo

  • Authors:
  • Daniel Vlasic;Pieter Peers;Ilya Baran;Paul Debevec;Jovan Popović;Szymon Rusinkiewicz;Wojciech Matusik

  • Affiliations:
  • Massachusetts Institute of Technology;UCS, Institute for Creative Technologies;Massachusetts Institute of Technology;UCS, Institute for Creative Technologies;Massachusetts Institute of Technology and Adobe Systems, Inc. and University of Washington;Adobe Systems, Inc. and Princeton University;Adobe Systems, Inc.

  • Venue:
  • ACM SIGGRAPH Asia 2009 papers
  • Year:
  • 2009

Quantified Score

Hi-index 0.02

Visualization

Abstract

We describe a system for high-resolution capture of moving 3D geometry, beginning with dynamic normal maps from multiple views. The normal maps are captured using active shape-from-shading (photometric stereo), with a large lighting dome providing a series of novel spherical lighting configurations. To compensate for low-frequency deformation, we perform multi-view matching and thin-plate spline deformation on the initial surfaces obtained by integrating the normal maps. Next, the corrected meshes are merged into a single mesh using a volumetric method. The final output is a set of meshes, which were impossible to produce with previous methods. The meshes exhibit details on the order of a few millimeters, and represent the performance over human-size working volumes at a temporal resolution of 60Hz.