Performance-driven facial animation
SIGGRAPH '90 Proceedings of the 17th annual conference on Computer graphics and interactive techniques
Digital image processing (2nd ed.)
Digital image processing (2nd ed.)
Realistic modeling for facial animation
SIGGRAPH '95 Proceedings of the 22nd annual conference on Computer graphics and interactive techniques
Proceedings of the 25th annual conference on Computer graphics and interactive techniques
Wires: a geometric deformation technique
Proceedings of the 25th annual conference on Computer graphics and interactive techniques
A morphable model for the synthesis of 3D faces
Proceedings of the 26th annual conference on Computer graphics and interactive techniques
Optical Flow Constraints on Deformable Models with Applications to Face Tracking
International Journal of Computer Vision
I3D '01 Proceedings of the 2001 symposium on Interactive 3D graphics
Analysis and Synthesis of Facial Image Sequences Using Physical and Anatomical Models
IEEE Transactions on Pattern Analysis and Machine Intelligence
Modeling and Rendering for Realistic Facial Animation
Proceedings of the Eurographics Workshop on Rendering Techniques 2000
LAFTER: Lips and Face Real-Time Tracker
CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
Facial expression recognition using a dynamic model and motion energy
ICCV '95 Proceedings of the Fifth International Conference on Computer Vision
ICCV '95 Proceedings of the Fifth International Conference on Computer Vision
An example-based approach for facial expression cloning
Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation
Geometry-driven photorealistic facial expression synthesis
Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation
Learning controls for blend shape based realistic facial animation
Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation
Reanimating the dead: reconstruction of expressive faces from skull data
ACM SIGGRAPH 2003 Papers
3D Modeling and Tracking of Human Lip Motions
ICCV '98 Proceedings of the Sixth International Conference on Computer Vision
Spacetime faces: high resolution capture for modeling and animation
ACM SIGGRAPH 2004 Papers
Mood swings: expressive speech animation
ACM Transactions on Graphics (TOG)
| Hi-index | 0.00 |
Recently, performance-driven facial animation has been popular in various entertainment area, such as game, animation movie, and advertisement. With the easy use of motion capture data from a performer's face, the resulting animated faces are far more natural and lifelike. However, when the characteristic features between live performer and animated character are quite different, expression mapping becomes a difficult problem. Many previous researches focus on facial motion capture only or facial animation only. Little attention has been paid to mapping motion capture data onto 3D face model. Therefore, we present a new expression mapping approach for performance-driven facial animation. Especially, we consider online factor of expression mapping for real-time application. Our basic idea is capturing the facial motion from a real performer and adapting it to a virtual character in real-time. For this purpose, we address three issues: facial expression capture, expression mapping and facial animation. We first propose a comprehensive solution for real-time facial expression capture without any devices such as head-mounted cameras and face-attached markers. With the analysis of the facial expression, the facial motion can be effectively mapped onto another 3D face model. We present a novel example-based approach for creating facial expressions of model to mimic those of face performer. Finally, real-time facial animation is provided with multiple face models, called "facial examples". Each of these examples reflects both a facial expression of different type and designer's insight to be a good guideline for animation. The resulting animation preserves the facial expressions of performer as well as the characteristic features of the target examples.