High resolution passive facial performance capture

  • Authors:
  • Derek Bradley;Wolfgang Heidrich;Tiberiu Popa;Alla Sheffer

  • Affiliations:
  • University of British Columbia;University of British Columbia;University of British Columbia and ETH Zürich;University of British Columbia

  • Venue:
  • ACM SIGGRAPH 2010 papers
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

We introduce a purely passive facial capture approach that uses only an array of video cameras, but requires no template facial geometry, no special makeup or markers, and no active lighting. We obtain initial geometry using multi-view stereo, and then use a novel approach for automatically tracking texture detail across the frames. As a result, we obtain a high-resolution sequence of compatibly triangulated and parameterized meshes. The resulting sequence can be rendered with dynamically captured textures, while also consistently applying texture changes such as virtual makeup.