Performance-driven facial animation
SIGGRAPH '90 Proceedings of the 17th annual conference on Computer graphics and interactive techniques
Realistic modeling for facial animation
SIGGRAPH '95 Proceedings of the 22nd annual conference on Computer graphics and interactive techniques
Proceedings of the 25th annual conference on Computer graphics and interactive techniques
Synthesizing realistic facial expressions from photographs
Proceedings of the 25th annual conference on Computer graphics and interactive techniques
Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Real-time 3D model acquisition
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Computer generated animation of faces
ACM '72 Proceedings of the ACM annual conference - Volume 1
Real-time Photo-Realistic Physically Based Rendering of Fine Scale Human Skin Structure
Proceedings of the 12th Eurographics Workshop on Rendering Techniques
Learning controls for blend shape based realistic facial animation
Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation
Spacetime faces: high resolution capture for modeling and animation
ACM SIGGRAPH 2004 Papers
Spacetime Stereo: A Unifying Framework for Depth from Triangulation
IEEE Transactions on Pattern Analysis and Machine Intelligence
Automatic determination of facial muscle activations from sparse motion capture marker data
ACM SIGGRAPH 2005 Papers
Face transfer with multilinear models
ACM SIGGRAPH 2005 Papers
Efficiently combining positions and normals for precise 3D geometry
ACM SIGGRAPH 2005 Papers
Performance relighting and reflectance transformation with time-multiplexed illumination
ACM SIGGRAPH 2005 Papers
A statistical model for synthesis of detailed facial geometry
ACM SIGGRAPH 2006 Papers
Multi-scale capture of facial geometry and motion
ACM SIGGRAPH 2007 papers
ACM SIGGRAPH 2007 courses
Pose-space animation and transfer of facial details
Proceedings of the 2008 ACM SIGGRAPH/Eurographics Symposium on Computer Animation
Animatable facial reflectance fields
EGSR'04 Proceedings of the Fifteenth Eurographics conference on Rendering Techniques
Rapid acquisition of specular and diffuse normal maps from polarized spherical gradient illumination
EGSR'07 Proceedings of the 18th Eurographics conference on Rendering Techniques
Surface enhancement using real-time photometric stereo and reflectance transformation
EGSR'06 Proceedings of the 17th Eurographics conference on Rendering Techniques
Capture and modeling of non-linear heterogeneous soft tissue
ACM SIGGRAPH 2009 papers
Face/Off: live facial puppetry
Proceedings of the 2009 ACM SIGGRAPH/Eurographics Symposium on Computer Animation
The Digital Emily project: photoreal facial modeling and animation
ACM SIGGRAPH 2009 Courses
Temporal upsampling of performance geometry using photometric alignment
ACM Transactions on Graphics (TOG)
High resolution passive facial performance capture
ACM SIGGRAPH 2010 papers
A deformation transformer for real-time cloth animation
ACM SIGGRAPH 2010 papers
Perception of linear and nonlinear motion properties using a FACS validated 3D facial model
Proceedings of the 7th Symposium on Applied Perception in Graphics and Visualization
Beauty or realism: The dimensions of skin from cognitive sciences to computer graphics
Computers in Human Behavior
Markerless reconstruction and synthesis of dynamic facial expressions
Computer Vision and Image Understanding
Leveraging motion capture and 3D scanning for high-fidelity facial performance acquisition
ACM SIGGRAPH 2011 papers
High-quality passive facial performance capture using anchor frames
ACM SIGGRAPH 2011 papers
Controllable hand deformation from sparse examples with rich details
SCA '11 Proceedings of the 2011 ACM SIGGRAPH/Eurographics Symposium on Computer Animation
Content retargeting using parameter-parallel facial layers
SCA '11 Proceedings of the 2011 ACM SIGGRAPH/Eurographics Symposium on Computer Animation
Real-time facial animation from live video tracking
SCA '11 Proceedings of the 2011 ACM SIGGRAPH/Eurographics Symposium on Computer Animation
Multiview face capture using polarized spherical gradient illumination
Proceedings of the 2011 SIGGRAPH Asia Conference
Proceedings of the 2011 SIGGRAPH Asia Conference
Artist friendly facial animation retargeting
Proceedings of the 2011 SIGGRAPH Asia Conference
Self-calibrated, Multi-spectral Photometric Stereo for 3D Face Capture
International Journal of Computer Vision
Spacetime expression cloning for blendshapes
ACM Transactions on Graphics (TOG)
Data-driven facial expression synthesis via Laplacian deformation
Multimedia Tools and Applications
De-aging high-resolution 3D facial models by example-driven mesh deformation
ACM SIGGRAPH 2012 Posters
Data-driven simulation methods in computer graphics: cloth, tissue and faces
ACM SIGGRAPH 2012 Courses
Lip-synced character speech animation with dominated animeme models
SIGGRAPH Asia 2012 Technical Briefs
Online modeling for realtime facial animation
ACM Transactions on Graphics (TOG) - SIGGRAPH 2013 Conference Proceedings
High fidelity facial animation capture and retargeting with contours
Proceedings of the 12th ACM SIGGRAPH/Eurographics Symposium on Computer Animation
On-the-fly multi-scale infinite texturing from example
ACM Transactions on Graphics (TOG)
Real-time recovery of moving 3D faces for emerging applications
Computers in Industry
Reconstructing 3D tree models using motion capture and particle flow
International Journal of Computer Games Technology
Hi-index | 0.00 |
We present a novel method for acquisition, modeling, compression, and synthesis of realistic facial deformations using polynomial displacement maps. Our method consists of an analysis phase where the relationship between motion capture markers and detailed facial geometry is inferred, and a synthesis phase where novel detailed animated facial geometry is driven solely by a sparse set of motion capture markers. For analysis, we record the actor wearing facial markers while performing a set of training expression clips. We capture real-time high-resolution facial deformations, including dynamic wrinkle and pore detail, using interleaved structured light 3D scanning and photometric stereo. Next, we compute displacements between a neutral mesh driven by the motion capture markers and the high-resolution captured expressions. These geometric displacements are stored in a polynomial displacement map which is parameterized according to the local deformations of the motion capture dots. For synthesis, we drive the polynomial displacement map with new motion capture data. This allows the recreation of large-scale muscle deformation, medium and fine wrinkles, and dynamic skin pore detail. Applications include the compression of existing performance data and the synthesis of new performances. Our technique is independent of the underlying geometry capture system and can be used to automatically generate high-frequency wrinkle and pore details on top of many existing facial animation systems.