Performance-driven facial animation
SIGGRAPH '90 Proceedings of the 17th annual conference on Computer graphics and interactive techniques
Proceedings of the 25th annual conference on Computer graphics and interactive techniques
3-D Motion Estimation in Model-Based Facial Image Coding
IEEE Transactions on Pattern Analysis and Machine Intelligence
Modeling, Tracking and Interactive Animation of Faces and Heads Using Input from Video
CA '96 Proceedings of the Computer Animation
CVPR '96 Proceedings of the 1996 Conference on Computer Vision and Pattern Recognition (CVPR '96)
Distinctive Image Features from Scale-Invariant Keypoints
International Journal of Computer Vision
Deformation transfer for triangle meshes
ACM SIGGRAPH 2004 Papers
Spacetime faces: high resolution capture for modeling and animation
ACM SIGGRAPH 2004 Papers
Cross-parameterization and compatible remeshing of 3D models
ACM SIGGRAPH 2004 Papers
Multi-scale capture of facial geometry and motion
ACM SIGGRAPH 2007 papers
Unwrap mosaics: a new representation for video editing
ACM SIGGRAPH 2008 papers
ACM SIGGRAPH 2008 papers
Mesh massage: A versatile mesh optimization framework
The Visual Computer: International Journal of Computer Graphics
Space-time surface reconstruction using incompressible flow
ACM SIGGRAPH Asia 2008 papers
Facial performance synthesis using deformation-driven polynomial displacement maps
ACM SIGGRAPH Asia 2008 papers
Efficient reconstruction of nonrigid shape and motion from real-time 3D scanner data
ACM Transactions on Graphics (TOG)
The Digital Emily project: photoreal facial modeling and animation
ACM SIGGRAPH 2009 Courses
Temporal upsampling of performance geometry using photometric alignment
ACM Transactions on Graphics (TOG)
High-quality single-shot capture of facial geometry
ACM SIGGRAPH 2010 papers
High resolution passive facial performance capture
ACM SIGGRAPH 2010 papers
Rapid acquisition of specular and diffuse normal maps from polarized spherical gradient illumination
EGSR'07 Proceedings of the 18th Eurographics conference on Rendering Techniques
Proceedings of the 2011 SIGGRAPH Asia Conference
Spacetime expression cloning for blendshapes
ACM Transactions on Graphics (TOG)
Coupled 3D reconstruction of sparse facial hair and skin
ACM Transactions on Graphics (TOG) - SIGGRAPH 2012 Conference Proceedings
ACM Transactions on Graphics (TOG) - SIGGRAPH 2012 Conference Proceedings
Data-driven simulation methods in computer graphics: cloth, tissue and faces
ACM SIGGRAPH 2012 Courses
Lightweight binocular facial performance capture under uncontrolled lighting
ACM Transactions on Graphics (TOG) - Proceedings of ACM SIGGRAPH Asia 2012
Improved reconstruction of deforming surfaces by cancelling ambient occlusion
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part I
Towards optimal non-rigid surface tracking
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part IV
Global Non-rigid Alignment of Surface Sequences
International Journal of Computer Vision
Online modeling for realtime facial animation
ACM Transactions on Graphics (TOG) - SIGGRAPH 2013 Conference Proceedings
ACM Transactions on Graphics (TOG) - SIGGRAPH 2013 Conference Proceedings
3D shape regression for real-time facial animation
ACM Transactions on Graphics (TOG) - SIGGRAPH 2013 Conference Proceedings
Realtime facial animation with on-the-fly correctives
ACM Transactions on Graphics (TOG) - SIGGRAPH 2013 Conference Proceedings
An anchor patch based optimization framework for reducing optical flow drift in long image sequences
ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part III
High fidelity facial animation capture and retargeting with contours
Proceedings of the 12th ACM SIGGRAPH/Eurographics Symposium on Computer Animation
High-fidelity facial performance capture with non-sequential temporal alignment
Proceedings of the 3rd Symposium on Facial Analysis and Animation
Analyzing growing plants from 4D point cloud data
ACM Transactions on Graphics (TOG)
Reconstructing detailed dynamic face geometry from monocular video
ACM Transactions on Graphics (TOG)
Augmenting physical avatars using projector-based illumination
ACM Transactions on Graphics (TOG)
Sparse localized deformation components
ACM Transactions on Graphics (TOG)
Animation-aware quadrangulation
SGP '13 Proceedings of the Eleventh Eurographics/ACMSIGGRAPH Symposium on Geometry Processing
| Hi-index | 0.00 |
We present a new technique for passive and markerless facial performance capture based on anchor frames. Our method starts with high resolution per-frame geometry acquisition using state-of-the-art stereo reconstruction, and proceeds to establish a single triangle mesh that is propagated through the entire performance. Leveraging the fact that facial performances often contain repetitive subsequences, we identify anchor frames as those which contain similar facial expressions to a manually chosen reference expression. Anchor frames are automatically computed over one or even multiple performances. We introduce a robust image-space tracking method that computes pixel matches directly from the reference frame to all anchor frames, and thereby to the remaining frames in the sequence via sequential matching. This allows us to propagate one reconstructed frame to an entire sequence in parallel, in contrast to previous sequential methods. Our anchored reconstruction approach also limits tracker drift and robustly handles occlusions and motion blur. The parallel tracking and mesh propagation offer low computation times. Our technique will even automatically match anchor frames across different sequences captured on different occasions, propagating a single mesh to all performances.