Performance-driven facial animation
SIGGRAPH '90 Proceedings of the 17th annual conference on Computer graphics and interactive techniques
Feature-based image metamorphosis
SIGGRAPH '92 Proceedings of the 19th annual conference on Computer graphics and interactive techniques
Reflection from layered surfaces due to subsurface scattering
SIGGRAPH '93 Proceedings of the 20th annual conference on Computer graphics and interactive techniques
Realistic modeling for facial animation
SIGGRAPH '95 Proceedings of the 22nd annual conference on Computer graphics and interactive techniques
Video Rewrite: driving visual speech with audio
Proceedings of the 24th annual conference on Computer graphics and interactive techniques
Proceedings of the 25th annual conference on Computer graphics and interactive techniques
Synthesizing realistic facial expressions from photographs
Proceedings of the 25th annual conference on Computer graphics and interactive techniques
A morphable model for the synthesis of 3D faces
Proceedings of the 26th annual conference on Computer graphics and interactive techniques
Performance-driven hand-drawn animation
NPAR '00 Proceedings of the 1st international symposium on Non-photorealistic animation and rendering
Acquiring the reflectance field of a human face
Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Surface light fields for 3D photography
Proceedings of the 27th annual conference on Computer graphics and interactive techniques
A Flexible New Technique for Camera Calibration
IEEE Transactions on Pattern Analysis and Machine Intelligence
A practical model for subsurface light transport
Proceedings of the 28th annual conference on Computer graphics and interactive techniques
A practical model for subsurface light transport
Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Trainable videorealistic speech animation
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Image-based 3D photography using opacity hulls
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Frequency space environment map rendering
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
A photometric approach to digitizing cultural artifacts
Proceedings of the 2001 conference on Virtual reality, archeology, and cultural heritage
Modeling and Rendering for Realistic Facial Animation
Proceedings of the Eurographics Workshop on Rendering Techniques 2000
Real-time Photo-Realistic Physically Based Rendering of Fine Scale Human Skin Structure
Proceedings of the 12th Eurographics Workshop on Rendering Techniques
All-frequency shadows using non-linear wavelet lighting approximation
ACM SIGGRAPH 2003 Papers
A parametric model for human faces.
A parametric model for human faces.
Image-based BRDF measurement including human skin
EGWR'99 Proceedings of the 10th Eurographics conference on Rendering
Performance relighting and reflectance transformation with time-multiplexed illumination
ACM SIGGRAPH 2005 Papers
Analysis of human faces using a measurement-based skin reflectance model
ACM SIGGRAPH 2006 Papers
ACM SIGGRAPH 2006 Courses
ACM SIGGRAPH 2006 Courses
Polarization Multiplexing and Demultiplexing for Appearance-Based Modeling
IEEE Transactions on Pattern Analysis and Machine Intelligence
SIGGRAPH '05 ACM SIGGRAPH 2005 Courses
Modeling and digitizing human facial reflectance
SIGGRAPH '05 ACM SIGGRAPH 2005 Courses
SIGGRAPH '05 ACM SIGGRAPH 2005 Courses
Realistic materials in computer graphics
SIGGRAPH '05 ACM SIGGRAPH 2005 Courses
International Journal of Computer Vision
Seeing People in Different Light-Joint Shape, Motion, and Reflectance Capture
IEEE Transactions on Visualization and Computer Graphics
Post-production facial performance relighting using reflectance transfer
ACM SIGGRAPH 2007 papers
A framework for precomputed and captured light transport
ACM Transactions on Graphics (TOG)
Real-time expression cloning using appearance models
Proceedings of the 9th international conference on Multimodal interfaces
Principles of appearance acquisition and representation
ACM SIGGRAPH 2008 classes
Facial performance synthesis using deformation-driven polynomial displacement maps
ACM SIGGRAPH Asia 2008 papers
A layered, heterogeneous reflectance model for acquiring and rendering human skin
ACM SIGGRAPH Asia 2008 papers
Interactive lighting manipulation application on GPU
SIGGRAPH '09: Posters
Principles of Appearance Acquisition and Representation
Foundations and Trends® in Computer Graphics and Vision
The Digital Emily project: photoreal facial modeling and animation
ACM SIGGRAPH 2009 Courses
Spatio-temporal reflectance sharing for relightable 3D video
MIRAGE'07 Proceedings of the 3rd international conference on Computer vision/computer graphics collaboration techniques
EGSR'05 Proceedings of the Sixteenth Eurographics conference on Rendering Techniques
Inferring reflectance functions from wavelet noise
EGSR'05 Proceedings of the Sixteenth Eurographics conference on Rendering Techniques
Relighting human locomotion with flowed reflectance fields
EGSR'06 Proceedings of the 17th Eurographics conference on Rendering Techniques
| Hi-index | 0.00 |
We present a technique for creating an animatable image-based appearance model of a human face, able to capture appearance variation over changing facial expression, head pose, view direction, and lighting condition. Our capture process makes use of a specialized lighting apparatus designed to rapidly illuminate the subject sequentially from many different directions in just a few seconds. For each pose, the subject remains still while six video cameras capture their appearance under each of the directions of lighting. We repeat this process for approximately 60 different poses, capturing different expressions, visemes, head poses, and eye positions. The images for each of the poses and camera views are registered to each other semi-automatically with the help of fiducial markers. The result is a model which can be rendered realistically under any linear blend of the captured poses and under any desired lighting condition by warping, scaling, and blending data from the original images. Finally, we show how to drive the model with performance capture data, where the pose is not necessarily a linear combination of the original captured poses.