System and analysis used for a dynamic facial speech deformation model

Authors:
Jürgen Rurainsky
Affiliations:
Fraunhofer Heinrich-Hertz-Institute, Berlin, Germany
Venue:
ICIAR'10 Proceedings of the 7th international conference on Image Analysis and Recognition - Volume Part I
Year:
2010

Citing 5
Cited 0

Fundamentals of speech recognition

Fundamentals of speech recognition
Dynamic Time Warping for Off-Line Recognition of a Small Gesture Vocabulary

RATFG-RTS '01 Proceedings of the IEEE ICCV Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems (RATFG-RTS'01)
Facial Expression Understanding in Image Sequences Using Dynamic and Active Visual Information Fusion

ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
Facial expression recognition from video sequences: temporal and static modeling

Computer Vision and Image Understanding - Special issue on Face recognition
Manifold Based Analysis of Facial Expression

CVPRW '04 Proceedings of the 2004 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'04) Volume 5 - Volume 05

Quantified Score

Hi-index	0.00

Visualization

Abstract

While facial expressions and phoneme states are analyzed and published very well, the dynamic deformation of a face is rarely described or modeled. Recently dynamic facial expressions are analyzed. We describe a capture system, processing steps and analysis results useful for modeling facial deformations while speaking. The capture system consists of a double mirror construction and a high speed camera, in order to get fluid motion. Not only major face features as well as a high accuracy of the tracked facial points, are required for such analysis. The dynamic analysis results demonstrate the potential of a reduced phoneme alphabet, because of similar 3D shape deformations. The separation of asymmetric facial motion allows to setup a personalized deformation model, besides the common symmetric deformation.