Facial analysis and synthesis scheme

Authors:
Ilse Ravyse;Hichem Sahli
Affiliations:
Department ETRO, Audio Visual Signal Processing (AVSP), Vrije Universiteit Brussel, Brussel;Department ETRO, Audio Visual Signal Processing (AVSP), Vrije Universiteit Brussel, Brussel
Venue:
ACIVS'06 Proceedings of the 8th international conference on Advanced Concepts For Intelligent Vision Systems
Year:
2006

Citing 10
Cited 1

A muscle model for animation three-dimensional facial expression

SIGGRAPH '87 Proceedings of the 14th annual conference on Computer graphics and interactive techniques
Computer facial animation

Computer facial animation
Synthesizing realistic facial expressions from photographs

Proceedings of the 25th annual conference on Computer graphics and interactive techniques
A Comparison of Active Shape Model and Scale Decomposition Based Features for Visual Speech Recognition

ECCV '98 Proceedings of the 5th European Conference on Computer Vision-Volume II - Volume II
Modeling, Tracking and Interactive Animation of Faces and Heads Using Input from Video

CA '96 Proceedings of the Computer Animation
Estimation of Rigid and Non-Rigid Facial Motion Using Anatomical Face Model

ICPR '02 Proceedings of the 16 th International Conference on Pattern Recognition (ICPR'02) Volume 1 - Volume 1
Eye Activity Detection and Recognition Using Morphological Scale-Space Decomposition

ICPR '00 Proceedings of the International Conference on Pattern Recognition - Volume 1
Talking Faces - Technologies and Applications

ICPR '04 Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 3 - Volume 03
Three-Dimensional Scene Flow

IEEE Transactions on Pattern Analysis and Machine Intelligence
Segmentation of faces in video footage using controlled weights on HSV color

SCIA'03 Proceedings of the 13th Scandinavian conference on Image analysis

Compression and Key Feature Extraction for Video Transmission

CIARP '09 Proceedings of the 14th Iberoamerican Conference on Pattern Recognition: Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications

Quantified Score

Hi-index	0.00

Visualization

Abstract

We developed an algorithmic scheme to extract the semantical description of the face and the face motion from an image sequence, and to re-play this action in a 3-dimensional (3D) virtual world. The presented Facial Analysis and Synthesis Scheme combines new methods for detection and tracking of the face and facial features, for estimating the 3D face movements and the nonrigid facial expressions, and for extracting the MPEG4 facial animation parameters. In the scheme, the face is treated either as a 2D object that has specific color, shape and motion characteristics, either as a 3D model that is calibrated and moved using a natural displacement-based deformation model. A dynamic MPEG4 displacement table takes care of the semantical controls of the animations of the face model. As a result, this virtual face model mimics well the gestures of the person in the video.