Lip Tracking for MPEG-4 Facial Animation

Authors:
Zhilin Wu;Petar S. Aleksic;Aggelos K. Katsaggelos
Affiliations:
Northwestern University;Northwestern University;Northwestern University
Venue:
ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces
Year:
2002

Citing 8
Cited 2

Feature extraction from faces using deformable templates

International Journal of Computer Vision
Speechreading using probabilistic models

Computer Vision and Image Understanding - Special issue on physics-based modeling and reasoning in computer vision
Gradient Vector Flow: A New External Force for Snakes

CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
Extraction and tracking of the eyelids

ICASSP '00 Proceedings of the Acoustics, Speech, and Signal Processing, 2000. on IEEE International Conference - Volume 04
Audio-visual speech recognition using MPEG-4 compliant visual features

EURASIP Journal on Applied Signal Processing
Compression of MPEG-4 facial animation parameters for transmission of talking heads

IEEE Transactions on Circuits and Systems for Video Technology
The facial animation engine: toward a high-level interface for the design of MPEG-4 compliant animated faces

IEEE Transactions on Circuits and Systems for Video Technology
An efficient use of MPEG-4 FAP interpolation for facial animation at 70 bits/frame

IEEE Transactions on Circuits and Systems for Video Technology

An object class-uncertainty induced adaptive force and its application to a new hybrid snake

Pattern Recognition
Robot Command Interface Using an Audio-Visual Speech Recognition System

CIARP '09 Proceedings of the 14th Iberoamerican Conference on Pattern Recognition: Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications

Quantified Score

Hi-index	0.00

Visualization

Abstract

It is very important to accurately track the mouth of a talking person for many applications, such as face recognition and human computer interaction. This is in general a difficult problem due to the complexity of shapes, colors, textures, and changing lighting conditions. In this paper we develop techniques for outer and inner lip tracking. From the tracking results FAPsare extracted which are used to drive an MPEG-4 decoder. A novel method consisting of a Gradient Vector Flow (GVF) snake with a parabolic template as an additional external force is proposed. Based on the results of the outer lip tracking, the inner lip is tracked using a similarity function and a temporal smoothness constraint. Numerical results are presented using the Bernstein database.