Facial cartography: interactive scan correspondence

  • Authors:
  • Cyrus A. Wilson;Oleg Alexander;Borom Tunwattanapong;Pieter Peers;Abhijeet Ghosh;Jay Busch;Arno Hartholt;Paul Debevec

  • Affiliations:
  • USC Institute for Creative Technologies;USC Institute for Creative Technologies;USC Institute for Creative Technologies;USC Institute for Creative Technologies and The College of William & Mary;USC Institute for Creative Technologies;USC Institute for Creative Technologies;USC Institute for Creative Technologies;USC Institute for Creative Technologies

  • Venue:
  • SCA '11 Proceedings of the 2011 ACM SIGGRAPH/Eurographics Symposium on Computer Animation
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present a semi-automatic technique for computing surface correspondences between 3D facial scans in different expressions, such that scan data can be mapped into a common domain for facial animation. The technique can accurately correspond high-resolution scans of widely differing expressions -- without requiring intermediate pose sequences -- such that they can be used, together with reflectance maps, to create high-quality blendshape-based facial animation. We optimize correspondences through a combination of Image, Shape, and Internal forces, as well as Directable forces to allow a user to interactively guide and refine the solution. Key to our method is a novel representation, called an Active Visage, that balances the advantages of both deformable templates and correspondence computation in a 2D canonical domain. We show that our semi-automatic technique achieves more robust results than automated correspondence alone, and is more precise than is practical with unaided manual input.