A muscle model for animation three-dimensional facial expression
SIGGRAPH '87 Proceedings of the 14th annual conference on Computer graphics and interactive techniques
Performance-driven facial animation
SIGGRAPH '90 Proceedings of the 17th annual conference on Computer graphics and interactive techniques
Closed-Form Solutions for Physically Based Shape Modeling and Recognition
IEEE Transactions on Pattern Analysis and Machine Intelligence
Realistic modeling for facial animation
SIGGRAPH '95 Proceedings of the 22nd annual conference on Computer graphics and interactive techniques
Simulating facial surgery using finite element models
SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Video Rewrite: driving visual speech with audio
Proceedings of the 24th annual conference on Computer graphics and interactive techniques
Synthesizing realistic facial expressions from photographs
Proceedings of the 25th annual conference on Computer graphics and interactive techniques
EM algorithms for PCA and SPCA
NIPS '97 Proceedings of the 1997 conference on Advances in neural information processing systems 10
Mixtures of probabilistic principal component analyzers
Neural Computation
A morphable model for the synthesis of 3D faces
Proceedings of the 26th annual conference on Computer graphics and interactive techniques
Visual Speech Synthesis by Morphing Visemes
International Journal of Computer Vision - special issue on learning and vision at the center for biological and computational learning, Massachusetts Institute of Technology
Optical Flow Constraints on Deformable Models with Applications to Face Tracking
International Journal of Computer Vision
From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose
IEEE Transactions on Pattern Analysis and Machine Intelligence
Proceedings of the 28th annual conference on Computer graphics and interactive techniques
3-D Motion Estimation in Model-Based Facial Image Coding
IEEE Transactions on Pattern Analysis and Machine Intelligence
Incremental Singular Value Decomposition of Uncertain Data with Missing Values
ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part I
Multilinear Analysis of Image Ensembles: TensorFaces
ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part I
Modeling, Tracking and Interactive Animation of Faces and Heads Using Input from Video
CA '96 Proceedings of the Computer Animation
Learning bilinear models for two-factor problems in vision.
CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
CVPR '96 Proceedings of the 1996 Conference on Computer Vision and Pattern Recognition (CVPR '96)
Facial Expression Space Learning
PG '02 Proceedings of the 10th Pacific Conference on Computer Graphics and Applications
Vision-based control of 3D facial animation
Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation
Unsupervised learning for speech motion editing
Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation
ACM SIGGRAPH 2003 Papers
Spherical parametrization and remeshing
ACM SIGGRAPH 2003 Papers
Fundamentals of spherical parameterization for 3D meshes
ACM SIGGRAPH 2003 Papers
The space of human body shapes: reconstruction and parameterization from range scans
ACM SIGGRAPH 2003 Papers
Non-iterative, feature-preserving mesh smoothing
ACM SIGGRAPH 2003 Papers
A parametric model for human faces.
A parametric model for human faces.
Separability of Pose and Expression in Facial Tracking and Animation
ICCV '98 Proceedings of the Sixth International Conference on Computer Vision
TensorTextures: multilinear image-based rendering
ACM SIGGRAPH 2004 Papers
Deformation transfer for triangle meshes
ACM SIGGRAPH 2004 Papers
Spacetime faces: high resolution capture for modeling and animation
ACM SIGGRAPH 2004 Papers
Cross-parameterization and compatible remeshing of 3D models
ACM SIGGRAPH 2004 Papers
Face to face: anthropometry-based interactive face shape modeling using model priors
International Journal of Computer Games Technology - Special issue on cyber games and interactive entertainment
Person-independent monocular tracking of face and facial actions with multilinear models
AMFG'07 Proceedings of the 3rd international conference on Analysis and modeling of faces and gestures
Psychology-Aware video-enabled workplace
UIC'06 Proceedings of the Third international conference on Ubiquitous Intelligence and Computing
Face morphing using 3D-aware appearance optimization
Proceedings of Graphics Interface 2012
Hi-index | 0.00 |
Face Transfer is a method for mapping videorecorded performances of one individual to facial animations of another. It extracts visemes (speech-related mouth articulations), expressions, and three-dimensional (3D) pose from monocular video or film footage. These parameters are then used to generate and drive a detailed 3D textured face mesh for a target identity, which can be seamlessly rendered back into target footage. The underlying face model automatically adjusts for how the target performs facial expressions and visemes. The performance data can be easily edited to change the visemes, expressions, pose, or even the identity of the target---the attributes are separably controllable. This supports a wide variety of video rewrite and puppetry applications.Face Transfer is based on a multilinear model of 3D face meshes that separably parameterizes the space of geometric variations due to different attributes (e.g., identity, expression, and viseme). Separability means that each of these attributes can be independently varied. A multilinear model can be estimated from a Cartesian product of examples (identities x expressions x visemes) with techniques from statistical analysis, but only after careful preprocessing of the geometric data set to secure one-to-one correspondence, to minimize cross-coupling artifacts, and to fill in any missing examples. Face Transfer offers new solutions to these problems and links the estimated model with a face-tracking algorithm to extract pose, expression, and viseme parameters.