Performance-driven facial animation
SIGGRAPH '90 Proceedings of the 17th annual conference on Computer graphics and interactive techniques
Proceedings of the 25th annual conference on Computer graphics and interactive techniques
Optical Flow Constraints on Deformable Models with Applications to Face Tracking
International Journal of Computer Vision
Modeling, Tracking and Interactive Animation of Faces and Heads Using Input from Video
CA '96 Proceedings of the Computer Animation
Vision-based control of 3D facial animation
Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation
Estimating differential quantities using polynomial fitting of osculating jets
Proceedings of the 2003 Eurographics/ACM SIGGRAPH symposium on Geometry processing
Universal capture: image-based facial animation for "The Matrix Reloaded"
ACM SIGGRAPH 2003 Sketches & Applications
Spacetime faces: high resolution capture for modeling and animation
ACM SIGGRAPH 2004 Papers
Proceedings of the 2004 Eurographics/ACM SIGGRAPH symposium on Geometry processing
ACM SIGGRAPH 2005 Papers
Face transfer with multilinear models
ACM SIGGRAPH 2005 Papers
Highly Accurate Optic Flow Computation with Theoretically Justified Warping
International Journal of Computer Vision
ACM SIGGRAPH 2006 Courses
Constraint-based motion optimization using a statistical dynamic model
ACM SIGGRAPH 2007 papers
Multi-scale capture of facial geometry and motion
ACM SIGGRAPH 2007 papers
Embedded deformation for shape manipulation
ACM SIGGRAPH 2007 papers
Facial performance synthesis using deformation-driven polynomial displacement maps
ACM SIGGRAPH Asia 2008 papers
Robust single-view geometry and motion reconstruction
ACM SIGGRAPH Asia 2009 papers
Face poser: Interactive modeling of 3D facial expressions using facial priors
ACM Transactions on Graphics (TOG)
The Digital Emily project: photoreal facial modeling and animation
ACM SIGGRAPH 2009 Courses
ACM SIGGRAPH 2010 papers
High-quality single-shot capture of facial geometry
ACM SIGGRAPH 2010 papers
High resolution passive facial performance capture
ACM SIGGRAPH 2010 papers
Facial cartography: interactive scan correspondence
SCA '11 Proceedings of the 2011 ACM SIGGRAPH/Eurographics Symposium on Computer Animation
Artist friendly facial animation retargeting
Proceedings of the 2011 SIGGRAPH Asia Conference
Lightweight binocular facial performance capture under uncontrolled lighting
ACM Transactions on Graphics (TOG) - Proceedings of ACM SIGGRAPH Asia 2012
Online modeling for realtime facial animation
ACM Transactions on Graphics (TOG) - SIGGRAPH 2013 Conference Proceedings
3D shape regression for real-time facial animation
ACM Transactions on Graphics (TOG) - SIGGRAPH 2013 Conference Proceedings
High fidelity facial animation capture and retargeting with contours
Proceedings of the 12th ACM SIGGRAPH/Eurographics Symposium on Computer Animation
Reconstructing detailed dynamic face geometry from monocular video
ACM Transactions on Graphics (TOG)
| Hi-index | 0.00 |
This paper introduces a new approach for acquiring high-fidelity 3D facial performances with realistic dynamic wrinkles and fine-scale facial details. Our approach leverages state-of-the-art motion capture technology and advanced 3D scanning technology for facial performance acquisition. We start the process by recording 3D facial performances of an actor using a marker-based motion capture system and perform facial analysis on the captured data, thereby determining a minimal set of face scans required for accurate facial reconstruction. We introduce a two-step registration process to efficiently build dense consistent surface correspondences across all the face scans. We reconstruct high-fidelity 3D facial performances by combining motion capture data with the minimal set of face scans in the blendshape interpolation framework. We have evaluated the performance of our system on both real and synthetic data. Our results show that the system can capture facial performances that match both the spatial resolution of static face scans and the acquisition speed of motion capture systems.