Free-form deformation of solid geometric models
SIGGRAPH '86 Proceedings of the 13th annual conference on Computer graphics and interactive techniques
Fundamentals of digital image processing
Fundamentals of digital image processing
Performance-driven facial animation
SIGGRAPH '90 Proceedings of the 17th annual conference on Computer graphics and interactive techniques
Realistic modeling for facial animation
SIGGRAPH '95 Proceedings of the 22nd annual conference on Computer graphics and interactive techniques
Coding, Analysis, Interpretation, and Recognition of Facial Expressions
IEEE Transactions on Pattern Analysis and Machine Intelligence
3-D Motion Estimation in Model-Based Facial Image Coding
IEEE Transactions on Pattern Analysis and Machine Intelligence
CVPR '96 Proceedings of the 1996 Conference on Computer Vision and Pattern Recognition (CVPR '96)
Compression of MPEG-4 facial animation parameters for transmission of talking heads
IEEE Transactions on Circuits and Systems for Video Technology
Active and Dynamic Information Fusion for Facial Expression Understanding from Image Sequences
IEEE Transactions on Pattern Analysis and Machine Intelligence
Nonrigid motion recovery for 3D surfaces
Image and Vision Computing
Outlier rejection in high-dimensional deformable models
Image and Vision Computing
Robust facial feature tracking under varying face pose and facial expression
Pattern Recognition
Supporting Ubiquitous Collaboration with Real-Time Facial Animation
Computer Supported Cooperative Work in Design IV
Dynamically adaptive tracking of gestures and facial expressions
ICCS'06 Proceedings of the 6th international conference on Computational Science - Volume Part III
| Hi-index | 0.00 |
The MPEG4 standard supports the transmission and composition of facial animation with natural video by including a facial animation parameter (FAP) set that is defined based on the study of minimal facial actions and is closely related to muscle actions. The FAP set enables model-based representation of natural or synthetic talking head sequences and allows intelligible visual reproduction of facial expressions, emotions, and speech pronunciations at the receiver. This paper describes two key components we have developed for building a model-based video coding system: (1) a method for estimating FAP parameters based on our previously proposed piecewise Bézier volume deformation model (PBVD), and (2) various methods for encoding FAP parameters. PBVD is a linear deformation model suitable for both the synthesis and the analysis of facial images. Each FAP parameter is a basis function in this model. Experimental results on PBVD-based animation, model-based tracking, and spatial-temporal compression of FAP parameters are demonstrated in this paper.