A muscle model for animation three-dimensional facial expression
SIGGRAPH '87 Proceedings of the 14th annual conference on Computer graphics and interactive techniques
Performance-driven facial animation
SIGGRAPH '90 Proceedings of the 17th annual conference on Computer graphics and interactive techniques
Recovery of Nonrigid Motion and Structure
IEEE Transactions on Pattern Analysis and Machine Intelligence
Techniques for facial animation
New trends in animation and visualization
Interactive graphics for plastic surgery: a task-level analysis and implementation
I3D '92 Proceedings of the 1992 symposium on Interactive 3D graphics
Active vision
Distributed representation and analysis of visual motion
Distributed representation and analysis of visual motion
Animating images with drawings
SIGGRAPH '94 Proceedings of the 21st annual conference on Computer graphics and interactive techniques
Realistic modeling for facial animation
SIGGRAPH '95 Proceedings of the 22nd annual conference on Computer graphics and interactive techniques
Analysis, interpretation and synthesis of facial expressions
Analysis, interpretation and synthesis of facial expressions
Analysis and Synthesis of Facial Image Sequences Using Physical and Anatomical Models
IEEE Transactions on Pattern Analysis and Machine Intelligence
SIGGRAPH '81 Proceedings of the 8th annual conference on Computer graphics and interactive techniques
Probabilistic visual learning for object detection
ICCV '95 Proceedings of the Fifth International Conference on Computer Vision
ICCV '95 Proceedings of the Fifth International Conference on Computer Vision
A Theory of Networks for Approximation and Learning
A Theory of Networks for Approximation and Learning
Parameterized Models for Facial Animation
IEEE Computer Graphics and Applications
Synthesizing realistic facial expressions from photographs
Proceedings of the 25th annual conference on Computer graphics and interactive techniques
NPAR '00 Proceedings of the 1st international symposium on Non-photorealistic animation and rendering
Performance-driven hand-drawn animation
NPAR '00 Proceedings of the 1st international symposium on Non-photorealistic animation and rendering
Animated deformations with radial basis functions
VRST '00 Proceedings of the ACM symposium on Virtual reality software and technology
Alternative representations and abstractions for moving sensors databases
Proceedings of the tenth international conference on Information and knowledge management
Controlled animation of video sprites
Proceedings of the 2002 ACM SIGGRAPH/Eurographics symposium on Computer animation
Constraint-Based Facial Animation
Constraints
Analysis and Reproduction of Facial Expressions for Realistic Communicating Clones
Journal of VLSI Signal Processing Systems
IEEE Computer Graphics and Applications
Facial Animation by Synthesis of Captured and Artificial Data
CAPTECH '98 Proceedings of the International Workshop on Modelling and Motion Capture Techniques for Virtual Environments
CT '01 Proceedings of the 4th International Conference on Cognitive Technology: Instruments of Mind
Smart Environments: Middleware Building Blocks for Pervasive Network Computing (A Position Paper)
IMWS '01 Revised Papers from the NSF Workshop on Developing an Infrastructure for Mobile and Wireless Systems
Machine Vision and Applications - Special issue: IEEE WACV
Vision-based control of 3D facial animation
Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation
Unsupervised learning for speech motion editing
Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation
IEEE Transactions on Visualization and Computer Graphics
Statistical synthesis of facial expressions for the portrayal of emotion
Proceedings of the 2nd international conference on Computer graphics and interactive techniques in Australasia and South East Asia
Spacetime faces: high resolution capture for modeling and animation
ACM SIGGRAPH 2004 Papers
Mood swings: expressive speech animation
ACM Transactions on Graphics (TOG)
Automatic determination of facial muscle activations from sparse motion capture marker data
ACM SIGGRAPH 2005 Papers
Face transfer with multilinear models
ACM SIGGRAPH 2005 Papers
Multimodal expressive embodied conversational agents
Proceedings of the 13th annual ACM international conference on Multimedia
Animating blendshape faces by cross-mapping motion capture data
I3D '06 Proceedings of the 2006 symposium on Interactive 3D graphics and games
Non-Rigid Stereo Factorization
International Journal of Computer Vision
Playable universal capture: compression and real-time sequencing of image-based facial animation
ACM SIGGRAPH 2006 Courses
Synthesizing realistic facial expressions from photographs
ACM SIGGRAPH 2006 Courses
Analysis and synthesis of facial expressions with hand-generated muscle actuation basis
ACM SIGGRAPH 2006 Courses
Face transfer with multilinear models
ACM SIGGRAPH 2006 Courses
Performance-driven hand-drawn animation
ACM SIGGRAPH 2006 Courses
Synthesizing realistic facial expressions from photographs
SIGGRAPH '05 ACM SIGGRAPH 2005 Courses
Analysis and synthesis of facial expressions with hand-generated muscle actuation basis
SIGGRAPH '05 ACM SIGGRAPH 2005 Courses
Simulating speech with a physics-based facial muscle model
Proceedings of the 2006 ACM SIGGRAPH/Eurographics symposium on Computer animation
Multi-scale capture of facial geometry and motion
ACM SIGGRAPH 2007 papers
Spatio-temporal graphical-model-based multiple facial feature tracking
EURASIP Journal on Applied Signal Processing
Pose-space animation and transfer of facial details
Proceedings of the 2008 ACM SIGGRAPH/Eurographics Symposium on Computer Animation
High resolution passive facial performance capture
ACM SIGGRAPH 2010 papers
Leveraging motion capture and 3D scanning for high-fidelity facial performance acquisition
ACM SIGGRAPH 2011 papers
High-quality passive facial performance capture using anchor frames
ACM SIGGRAPH 2011 papers
Realtime performance-based facial animation
ACM SIGGRAPH 2011 papers
Proceedings of the 2011 SIGGRAPH Asia Conference
Facial analysis and synthesis scheme
ACIVS'06 Proceedings of the 8th international conference on Advanced Concepts For Intelligent Vision Systems
3D shape regression for real-time facial animation
ACM Transactions on Graphics (TOG) - SIGGRAPH 2013 Conference Proceedings
Realtime facial animation with on-the-fly correctives
ACM Transactions on Graphics (TOG) - SIGGRAPH 2013 Conference Proceedings
Reconstructing detailed dynamic face geometry from monocular video
ACM Transactions on Graphics (TOG)
Hi-index | 0.00 |
We describe tools that use measurements from video for the extraction of facial modeling and animation parameters, head tracking, and real-time interactive facial animation. These tools share common goals but rely on varying details of physical and geometric modeling and in their input measurement system. Accurate facial modeling involves fine details of geometry and muscle coarticulation. By coupling pixel-by-pixel measurements of surface motion to a physically-based face model and a muscle control model, we have been able to obtain detailed spatio-temporal records of both the displacement of each point on the facial surface and the muscle control required to produce the observed facial motion. We will discuss the importance of this visually extracted representation in terms or realistic facial motion synthesis. A similar method that uses an ellipsoidal model of the head coupled with detailed estimates of visual motion allows accurate tracking of head motion in 3-D. Additionally, by coupling sparse, fast visual measurements with our physically-based model via an interpolation process, we have produced a real-time interactive facial animation/mimicking system.