Performance driven face animation via non-rigid 3d tracking

Authors:
Wei Zhang;Qiang Wang;Xiaoou Tang
Affiliations:
The Chinese University of Hong Kong, Hong Kong;Microsoft Research Asia, Beijing, China;The Chinese University of Hong Kong, Hong Kong
Venue:
MM '09 Proceedings of the 17th ACM international conference on Multimedia
Year:
2009

Citing 4
Cited 1

Computer generated animation of faces

ACM '72 Proceedings of the ACM annual conference - Volume 1
Vision-based control of 3D facial animation

Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation
Learning controls for blend shape based realistic facial animation

SIGGRAPH '05 ACM SIGGRAPH 2005 Courses
Real Time Feature Based 3-D Deformable Face Tracking

ECCV '08 Proceedings of the 10th European Conference on Computer Vision: Part II

Content retargeting using parameter-parallel facial layers

SCA '11 Proceedings of the 2011 ACM SIGGRAPH/Eurographics Symposium on Computer Animation

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this demo, a performance driven 3D face animation system is proposed. The proposed system consists of two key components: a robust non-rigid 3D tracking module and a MPEG4 compliant facial animation module. Firstly, the facial motion is tracked from source videos which contain both the rigid 3D head motion (6 DOF) and the non-rigid expression variations. Afterward, the tracked facial motion is parameterized via estimating a set of MPEG4 facial animation parameters(FAP). As the final step, these FAP values are transferred to the MPEG4-compliant face model for the animation purpose. The proposed tracking and animation system has a strong generalization ability and can be used in the indoor environment with no additional assumptions.