Performance-driven facial animation
SIGGRAPH '90 Proceedings of the 17th annual conference on Computer graphics and interactive techniques
Mixtures of probabilistic principal component analyzers
Neural Computation
A morphable model for the synthesis of 3D faces
Proceedings of the 26th annual conference on Computer graphics and interactive techniques
Optical Flow Constraints on Deformable Models with Applications to Face Tracking
International Journal of Computer Vision
IEEE Transactions on Pattern Analysis and Machine Intelligence
3-D Motion Estimation in Model-Based Facial Image Coding
IEEE Transactions on Pattern Analysis and Machine Intelligence
Modeling, Tracking and Interactive Animation of Faces and Heads Using Input from Video
CA '96 Proceedings of the Computer Animation
CVPR '96 Proceedings of the 1996 Conference on Computer Vision and Pattern Recognition (CVPR '96)
Eigen-points: Control-point Location using Principle Component Analyses
FG '96 Proceedings of the 2nd International Conference on Automatic Face and Gesture Recognition (FG '96)
ICCV '95 Proceedings of the Fifth International Conference on Computer Vision
Vision-based control of 3D facial animation
Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation
ACM SIGGRAPH 2003 Papers
Style-based inverse kinematics
ACM SIGGRAPH 2004 Papers
Spacetime faces: high resolution capture for modeling and animation
ACM SIGGRAPH 2004 Papers
High-Resolution, Real-time 3D Shape Acquisition
CVPRW '04 Proceedings of the 2004 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'04) Volume 3 - Volume 03
Performance-driven facial animation
ACM SIGGRAPH 2006 Courses
Universal capture - image-based facial animation for "The Matrix Reloaded"
SIGGRAPH '05 ACM SIGGRAPH 2005 Courses
Face poser: interactive modeling of 3D facial expressions using model priors
SCA '07 Proceedings of the 2007 ACM SIGGRAPH/Eurographics symposium on Computer animation
Generalizing motion edits with Gaussian processes
ACM Transactions on Graphics (TOG)
Face/Off: live facial puppetry
Proceedings of the 2009 ACM SIGGRAPH/Eurographics Symposium on Computer Animation
Robust single-view geometry and motion reconstruction
ACM SIGGRAPH Asia 2009 papers
The Digital Emily project: photoreal facial modeling and animation
ACM SIGGRAPH 2009 Courses
Temporal upsampling of performance geometry using photometric alignment
ACM Transactions on Graphics (TOG)
ACM SIGGRAPH 2010 papers
High-quality single-shot capture of facial geometry
ACM SIGGRAPH 2010 papers
High resolution passive facial performance capture
ACM SIGGRAPH 2010 papers
Example-Based Human Motion Denoising
IEEE Transactions on Visualization and Computer Graphics
Rapid acquisition of specular and diffuse normal maps from polarized spherical gradient illumination
EGSR'07 Proceedings of the 18th Eurographics conference on Rendering Techniques
ACII'11 Proceedings of the 4th international conference on Affective computing and intelligent interaction - Volume Part II
SIGGRAPH Asia 2011 Emerging Technologies
Video-driven state-aware facial animation
Computer Animation and Virtual Worlds
Structure recovery by part assembly
ACM Transactions on Graphics (TOG) - Proceedings of ACM SIGGRAPH Asia 2012
Lightweight binocular facial performance capture under uncontrolled lighting
ACM Transactions on Graphics (TOG) - Proceedings of ACM SIGGRAPH Asia 2012
An interactive 3D video system for human facial reconstruction and expression modeling
Journal of Visual Communication and Image Representation
Improving accuracy in face tracking user interfaces using consumer devices
Proceedings of the 1st Annual conference on Research in information technology
Face tracking user interfaces using vision-based consumer devices
Proceedings of the 14th international ACM SIGACCESS conference on Computers and accessibility
Depth-based real time head pose tracking using 3D template matching
SIGGRAPH Asia 2012 Technical Briefs
Unconventional approaches for facial animation and tracking
SIGGRAPH Asia 2012 Technical Briefs
The pipeline of facial animation fast forward: the NMA example
SIGGRAPH Asia 2012 Technical Briefs
Lip-synced character speech animation with dominated animeme models
SIGGRAPH Asia 2012 Technical Briefs
Interactive steering of mesh animations
EUROSCA'12 Proceedings of the 11th ACM SIGGRAPH / Eurographics conference on Computer Animation
Interactive steering of mesh animations
Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation
Random Forests for Real Time 3D Face Analysis
International Journal of Computer Vision
Generation of facial expression for communication using elfoid with projector
MPRSS'12 Proceedings of the First international conference on Multimodal Pattern Recognition of Social Signals in Human-Computer-Interaction
Octree-based fusion for realtime 3D reconstruction
Graphical Models
Online modeling for realtime facial animation
ACM Transactions on Graphics (TOG) - SIGGRAPH 2013 Conference Proceedings
3D shape regression for real-time facial animation
ACM Transactions on Graphics (TOG) - SIGGRAPH 2013 Conference Proceedings
Realtime facial animation with on-the-fly correctives
ACM Transactions on Graphics (TOG) - SIGGRAPH 2013 Conference Proceedings
Creature features: online motion puppetry for non-human characters
Proceedings of the 12th ACM SIGGRAPH/Eurographics Symposium on Computer Animation
High fidelity facial animation capture and retargeting with contours
Proceedings of the 12th ACM SIGGRAPH/Eurographics Symposium on Computer Animation
ElastiFace: matching and blending textured faces
Proceedings of the Symposium on Non-Photorealistic Animation and Rendering
A review of motion analysis methods for human Nonverbal Communication Computing
Image and Vision Computing
Use of facial motion capture for hands free control of computer applications
Proceedings of the ACM Symposium on Applied Perception
AMITIES: avatar-mediated interactive training and individualized experience system
Proceedings of the 19th ACM Symposium on Virtual Reality Software and Technology
Dynamic 2D/3D registration for the Kinect
ACM SIGGRAPH 2013 Courses
Reconstructing detailed dynamic face geometry from monocular video
ACM Transactions on Graphics (TOG)
Design and evaluation of face tracking user interfaces for accessibility
Proceedings of the 2nd annual conference on Research in information technology
A head pose tracking system using RGB-D camera
ICVS'13 Proceedings of the 9th international conference on Computer Vision Systems
3D head pose and gaze tracking and their application to diverse multimodal tasks
Proceedings of the 15th ACM on International conference on multimodal interaction
Robust Bayesian fitting of 3D morphable model
Proceedings of the 10th European Conference on Visual Media Production
Capture of arm-muscle deformations using a depth-camera
Proceedings of the 10th European Conference on Visual Media Production
Realtime Performance-Based Facial Avatars for Immersive Gameplay
Proceedings of Motion on Games
Dynamic random regression forests for real-time head pose estimation
Machine Vision and Applications
Special Section on CAD/Graphics 2013: SCAPE-based human performance reconstruction
Computers and Graphics
Sparse iterative closest point
SGP '13 Proceedings of the Eleventh Eurographics/ACMSIGGRAPH Symposium on Geometry Processing
Hi-index | 0.00 |
This paper presents a system for performance-based character animation that enables any user to control the facial expressions of a digital avatar in realtime. The user is recorded in a natural environment using a non-intrusive, commercially available 3D sensor. The simplicity of this acquisition device comes at the cost of high noise levels in the acquired data. To effectively map low-quality 2D images and 3D depth maps to realistic facial expressions, we introduce a novel face tracking algorithm that combines geometry and texture registration with pre-recorded animation priors in a single optimization. Formulated as a maximum a posteriori estimation in a reduced parameter space, our method implicitly exploits temporal coherence to stabilize the tracking. We demonstrate that compelling 3D facial dynamics can be reconstructed in realtime without the use of face markers, intrusive lighting, or complex scanning hardware. This makes our system easy to deploy and facilitates a range of new applications, e.g. in digital gameplay or social interactions.