Numerical recipes in C (2nd ed.): the art of scientific computing
Numerical recipes in C (2nd ed.): the art of scientific computing
Proceedings of the 25th annual conference on Computer graphics and interactive techniques
3D lip shapes from video: a combined physical-statistical model
Speech Communication - Special issue on auditory-visual speech processing
Feature Detection with Automatic Scale Selection
International Journal of Computer Vision
IEEE Transactions on Pattern Analysis and Machine Intelligence
Optical Flow Constraints on Deformable Models with Applications to Face Tracking
International Journal of Computer Vision
Hyperpatches for 3D Model Acquisition and Tracking
IEEE Transactions on Pattern Analysis and Machine Intelligence
Modeling and Animating Realistic Faces from Images
International Journal of Computer Vision
Analyzing Facial Expressions for Virtual Conferencing
IEEE Computer Graphics and Applications
3-D Motion Estimation in Model-Based Facial Image Coding
IEEE Transactions on Pattern Analysis and Machine Intelligence
Analysis and Synthesis of Facial Image Sequences Using Physical and Anatomical Models
IEEE Transactions on Pattern Analysis and Machine Intelligence
Face Identification by Fitting a 3D Morphable Model Using Linear Shape and Texture Error Functions
ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part IV
Qualitative Multi-scale Feature Hierarchies for Object Tracking
SCALE-SPACE '99 Proceedings of the Second International Conference on Scale-Space Theories in Computer Vision
Parameterized Models for Facial Animation
IEEE Computer Graphics and Applications
| Hi-index | 0.00 |
This paper presents a system that can recover and track the 3Dspeech movements of a speaker's face for each image of a monocularsequence. A speaker-specific face model is used for tracking: modelparameters are extracted from each image by ananalysis-by-synthesis loop. To handle both the individualspecificities of the speaker's articulation and the complexity ofthe facial deformations during speech, speaker-specific models ofthe face 3D geometry and appearance are built from real data. Thegeometric model is linearly controlled by only six articulatoryparameters. Appearance is seen either as a classical texture map orthrough local appearance of a relevant subset of 3D points. Wecompare several appearance models: they are either constant ordepend linearly on the articulatory parameters. We evaluate thesedifferent appearance models with ground truth data.