A muscle model for animation three-dimensional facial expression
SIGGRAPH '87 Proceedings of the 14th annual conference on Computer graphics and interactive techniques
Performance-driven facial animation
SIGGRAPH '90 Proceedings of the 17th annual conference on Computer graphics and interactive techniques
Closed-Form Solutions for Physically Based Shape Modeling and Recognition
IEEE Transactions on Pattern Analysis and Machine Intelligence
Realistic modeling for facial animation
SIGGRAPH '95 Proceedings of the 22nd annual conference on Computer graphics and interactive techniques
Simulating facial surgery using finite element models
SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Video Rewrite: driving visual speech with audio
Proceedings of the 24th annual conference on Computer graphics and interactive techniques
Synthesizing realistic facial expressions from photographs
Proceedings of the 25th annual conference on Computer graphics and interactive techniques
EM algorithms for PCA and SPCA
NIPS '97 Proceedings of the 1997 conference on Advances in neural information processing systems 10
A morphable model for the synthesis of 3D faces
Proceedings of the 26th annual conference on Computer graphics and interactive techniques
Visual Speech Synthesis by Morphing Visemes
International Journal of Computer Vision - special issue on learning and vision at the center for biological and computational learning, Massachusetts Institute of Technology
Optical Flow Constraints on Deformable Models with Applications to Face Tracking
International Journal of Computer Vision
From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose
IEEE Transactions on Pattern Analysis and Machine Intelligence
Proceedings of the 28th annual conference on Computer graphics and interactive techniques
3-D Motion Estimation in Model-Based Facial Image Coding
IEEE Transactions on Pattern Analysis and Machine Intelligence
Incremental Singular Value Decomposition of Uncertain Data with Missing Values
ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part I
Multilinear Analysis of Image Ensembles: TensorFaces
ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part I
Modeling, Tracking and Interactive Animation of Faces and Heads Using Input from Video
CA '96 Proceedings of the Computer Animation
Learning bilinear models for two-factor problems in vision.
CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
CVPR '96 Proceedings of the 1996 Conference on Computer Vision and Pattern Recognition (CVPR '96)
Facial Expression Space Learning
PG '02 Proceedings of the 10th Pacific Conference on Computer Graphics and Applications
Vision-based control of 3D facial animation
Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation
Unsupervised learning for speech motion editing
Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation
ACM SIGGRAPH 2003 Papers
Spherical parametrization and remeshing
ACM SIGGRAPH 2003 Papers
Fundamentals of spherical parameterization for 3D meshes
ACM SIGGRAPH 2003 Papers
The space of human body shapes: reconstruction and parameterization from range scans
ACM SIGGRAPH 2003 Papers
Non-iterative, feature-preserving mesh smoothing
ACM SIGGRAPH 2003 Papers
A parametric model for human faces.
A parametric model for human faces.
Separability of Pose and Expression in Facial Tracking and Animation
ICCV '98 Proceedings of the Sixth International Conference on Computer Vision
TensorTextures: multilinear image-based rendering
ACM SIGGRAPH 2004 Papers
Deformation transfer for triangle meshes
ACM SIGGRAPH 2004 Papers
Spacetime faces: high resolution capture for modeling and animation
ACM SIGGRAPH 2004 Papers
Cross-parameterization and compatible remeshing of 3D models
ACM SIGGRAPH 2004 Papers
Animating blendshape faces by cross-mapping motion capture data
I3D '06 Proceedings of the 2006 symposium on Interactive 3D graphics and games
Semantic 3D motion retargeting for facial animation
APGV '06 Proceedings of the 3rd symposium on Applied perception in graphics and visualization
Capturing and animating skin deformation in human motion
ACM SIGGRAPH 2006 Papers
A statistical model for synthesis of detailed facial geometry
ACM SIGGRAPH 2006 Papers
Computing human faces for human viewers: automated animation in photographs and paintings
Proceedings of the 8th international conference on Multimodal interfaces
ACM SIGGRAPH 2006 Courses
Playable universal capture: compression and real-time sequencing of image-based facial animation
ACM SIGGRAPH 2006 Courses
Transferring of Speech Movements from Video to 3D Face Space
IEEE Transactions on Visualization and Computer Graphics
SIGGRAPH '05 ACM SIGGRAPH 2005 Courses
Proceedings of the 2006 ACM SIGGRAPH/Eurographics symposium on Computer animation
eFASE: expressive facial animation synthesis and editing with phoneme-isomap controls
Proceedings of the 2006 ACM SIGGRAPH/Eurographics symposium on Computer animation
Simulating speech with a physics-based facial muscle model
Proceedings of the 2006 ACM SIGGRAPH/Eurographics symposium on Computer animation
Dynamic, expressive speech animation from a single mesh
SCA '07 Proceedings of the 2007 ACM SIGGRAPH/Eurographics symposium on Computer animation
Multifactor Gaussian process models for style-content separation
Proceedings of the 24th international conference on Machine learning
Multi-scale capture of facial geometry and motion
ACM SIGGRAPH 2007 papers
Post-production facial performance relighting using reflectance transfer
ACM SIGGRAPH 2007 papers
Hierarchical Tensor Approximation of Multi-Dimensional Visual Data
IEEE Transactions on Visualization and Computer Graphics
Proceedings of the 5th international conference on Computer graphics and interactive techniques in Australia and Southeast Asia
Real-time expression cloning using appearance models
Proceedings of the 9th international conference on Multimodal interfaces
Interactive 3D facial expression posing through 2D portrait manipulation
GI '08 Proceedings of graphics interface 2008
Probing dynamic human facial action recognition from the other side of the mean
Proceedings of the 5th symposium on Applied perception in graphics and visualization
Facial performance synthesis using deformation-driven polynomial displacement maps
ACM SIGGRAPH Asia 2008 papers
Feature points based facial animation retargeting
Proceedings of the 2008 ACM symposium on Virtual reality software and technology
View-Invariant Pose Recognition Using Multilinear Analysis and the Universum
ISVC '08 Proceedings of the 4th International Symposium on Advances in Visual Computing, Part II
EDFCES: a new example-driven 3D face construction and editing system
Machine Graphics & Vision International Journal
“Dive into the Movie” Audience-Driven Immersive Experience in the Story
IEICE - Transactions on Information and Systems
Visio-lization: generating novel facial images
ACM SIGGRAPH 2009 papers
Recognizing body poses using multilinear analysis and semi-supervised learning
Pattern Recognition Letters
Face/Off: live facial puppetry
Proceedings of the 2009 ACM SIGGRAPH/Eurographics Symposium on Computer Animation
Style learning and transferring for facial animation editing
Proceedings of the 2009 ACM SIGGRAPH/Eurographics Symposium on Computer Animation
Bayesian tensor inference for sketch-based facial photo hallucination
IJCAI'07 Proceedings of the 20th international joint conference on Artifical intelligence
Pose-space animation and transfer of facial details
Proceedings of the 2008 ACM SIGGRAPH/Eurographics Symposium on Computer Animation
Perceptually guided expressive facial animation
Proceedings of the 2008 ACM SIGGRAPH/Eurographics Symposium on Computer Animation
Adaptive Physics---Inspired Facial Animation
MIG '09 Proceedings of the 2nd International Workshop on Motion in Games
Weight, Sex, and Facial Expressions: On the Manipulation of Attributes in Generative 3D Face Models
ISVC '09 Proceedings of the 5th International Symposium on Advances in Visual Computing: Part I
Synthesis and editing of personalized stylistic human motion
Proceedings of the 2010 ACM SIGGRAPH symposium on Interactive 3D Graphics and Games
Generation of expression space for realtime facial expression control of 3D avatar
MIRAGE'07 Proceedings of the 3rd international conference on Computer vision/computer graphics collaboration techniques
Re-mapping animation parameters between multiple types of facial model
MIRAGE'07 Proceedings of the 3rd international conference on Computer vision/computer graphics collaboration techniques
ACM SIGGRAPH 2010 papers
Parametric reshaping of human bodies in images
ACM SIGGRAPH 2010 papers
Data-driven feature control models for creating virtual faces
ICCSA'07 Proceedings of the 2007 international conference on Computational science and Its applications - Volume Part II
Visyllable-specific facial transition motion embedding and extraction
ICIP'09 Proceedings of the 16th IEEE international conference on Image processing
Crafting 3D faces using free form portrait sketching and plausible texture inference
Proceedings of Graphics Interface 2010
MovieReshape: tracking and reshaping of humans in videos
ACM SIGGRAPH Asia 2010 papers
Automatic 3D facial model and texture reconstruction from range scans
AMDO'10 Proceedings of the 6th international conference on Articulated motion and deformable objects
ECCV'10 Proceedings of the 11th European conference on Computer vision: Part I
Bilinear kernel reduced rank regression for facial expression synthesis
ECCV'10 Proceedings of the 11th European conference on Computer vision: Part II
Automatic generation of head models and facial animations considering personal characteristics
Proceedings of the 17th ACM Symposium on Virtual Reality Software and Technology
A learning-based high-level human computer interface for face modeling and animation
ICMI'06/IJCAI'07 Proceedings of the ICMI 2006 and IJCAI 2007 international conference on Artifical intelligence for human computing
A new implementation of common matrix approach using third-order tensors for face recognition
Expert Systems with Applications: An International Journal
Behaviour transfer between expressive talking heads
Proceedings of the SSPNET 2nd International Symposium on Facial Analysis and Animation
Multifactor feature extraction for human movement recognition
Computer Vision and Image Understanding
Markerless reconstruction and synthesis of dynamic facial expressions
Computer Vision and Image Understanding
Expression flow for 3D-aware face component transfer
ACM SIGGRAPH 2011 papers
Leveraging motion capture and 3D scanning for high-fidelity facial performance acquisition
ACM SIGGRAPH 2011 papers
Interactive region-based linear 3D face models
ACM SIGGRAPH 2011 papers
Content retargeting using parameter-parallel facial layers
SCA '11 Proceedings of the 2011 ACM SIGGRAPH/Eurographics Symposium on Computer Animation
Proceedings of the 2011 SIGGRAPH Asia Conference
Compression and direct manipulation of complex blendshape models
Proceedings of the 2011 SIGGRAPH Asia Conference
Instant movie casting with personality: Dive into the movie system
Proceedings of the 2011 international conference on Virtual and mixed reality: systems and applications - Volume Part II
Realistic facial animation by automatic individual head modeling and facial muscle adjustment
Proceedings of the 2011 international conference on Virtual and mixed reality: systems and applications - Volume Part II
Uni-orthogonal nonnegative tucker decomposition for supervised image classification
ICIAP'11 Proceedings of the 16th international conference on Image analysis and processing: Part I
3D facial modeling for animation: a nonlinear approach
MMM'07 Proceedings of the 13th international conference on Multimedia Modeling - Volume Part I
Driving 3D morphable models using shading cues
Pattern Recognition
Real-Time expression mapping with ratio image
ICESS'05 Proceedings of the Second international conference on Embedded Software and Systems
Vision based speech animation transferring with underlying anatomical structure
ACCV'06 Proceedings of the 7th Asian conference on Computer Vision - Volume Part I
Spacetime expression cloning for blendshapes
ACM Transactions on Graphics (TOG)
Bilinear spatiotemporal basis models
ACM Transactions on Graphics (TOG)
K-clustered tensor approximation: A sparse multilinear model for real-time rendering
ACM Transactions on Graphics (TOG)
Data-driven facial expression synthesis via Laplacian deformation
Multimedia Tools and Applications
Real-time face tracking and recognition by sparse eigentracker with associative mapping to 3D shape
Image and Vision Computing
Video-driven state-aware facial animation
Computer Animation and Virtual Worlds
On generating realistic avatars: dress in your own style
Multimedia Tools and Applications
Robust tensor classifiers for color object recognition
ICIAR'07 Proceedings of the 4th international conference on Image Analysis and Recognition
Control of speech-related facial movements of an avatar from video
Speech Communication
Facial action transfer with personalized bilinear regression
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part II
Dynamic units of visual speech
EUROSCA'12 Proceedings of the 11th ACM SIGGRAPH / Eurographics conference on Computer Animation
Multi-linear data-driven dynamic hair model with efficient hair-body collision handling
EUROSCA'12 Proceedings of the 11th ACM SIGGRAPH / Eurographics conference on Computer Animation
Dynamic units of visual speech
Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation
Multi-linear data-driven dynamic hair model with efficient hair-body collision handling
Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation
Dynamic hair manipulation in images and videos
ACM Transactions on Graphics (TOG) - SIGGRAPH 2013 Conference Proceedings
3D shape regression for real-time facial animation
ACM Transactions on Graphics (TOG) - SIGGRAPH 2013 Conference Proceedings
Realtime facial animation with on-the-fly correctives
ACM Transactions on Graphics (TOG) - SIGGRAPH 2013 Conference Proceedings
Smooth contact-aware facial blendshapes transfer
Proceedings of the Symposium on Digital Production
Reconstructing detailed dynamic face geometry from monocular video
ACM Transactions on Graphics (TOG)
Sparse localized deformation components
ACM Transactions on Graphics (TOG)
Computer Vision and Image Understanding
Hi-index | 0.00 |
Face Transfer is a method for mapping videorecorded performances of one individual to facial animations of another. It extracts visemes (speech-related mouth articulations), expressions, and three-dimensional (3D) pose from monocular video or film footage. These parameters are then used to generate and drive a detailed 3D textured face mesh for a target identity, which can be seamlessly rendered back into target footage. The underlying face model automatically adjusts for how the target performs facial expressions and visemes. The performance data can be easily edited to change the visemes, expressions, pose, or even the identity of the target---the attributes are separably controllable. This supports a wide variety of video rewrite and puppetry applications.Face Transfer is based on a multilinear model of 3D face meshes that separably parameterizes the space of geometric variations due to different attributes (e.g., identity, expression, and viseme). Separability means that each of these attributes can be independently varied. A multilinear model can be estimated from a Cartesian product of examples (identities × expressions × visemes) with techniques from statistical analysis, but only after careful preprocessing of the geometric data set to secure one-to-one correspondence, to minimize cross-coupling artifacts, and to fill in any missing examples. Face Transfer offers new solutions to these problems and links the estimated model with a face-tracking algorithm to extract pose, expression, and viseme parameters.