Realistic facial modeling and animation based on high resolution capture

Authors:
Hae Won Byun
Affiliations:
School of Media & Information, Sung Shin Woman University, Seoul, Republic of Korea
Venue:
ACIVS'07 Proceedings of the 9th international conference on Advanced concepts for intelligent vision systems
Year:
2007

Citing 9
Cited 0

Performance-driven facial animation

SIGGRAPH '90 Proceedings of the 17th annual conference on Computer graphics and interactive techniques
Fast, Reliable Head Tracking under Varying Illumination: An Approach Based on Registration of Texture-Mapped 3D Models

IEEE Transactions on Pattern Analysis and Machine Intelligence
Optical Flow Constraints on Deformable Models with Applications to Face Tracking

International Journal of Computer Vision
Analysis and Synthesis of Facial Image Sequences Using Physical and Anatomical Models

IEEE Transactions on Pattern Analysis and Machine Intelligence
LAFTER: Lips and Face Real-Time Tracker

CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
Real Time Tracking and Modeling of Faces: An EKF-Based Analysis by Synthesis Approach

MPEOPLE '99 Proceedings of the IEEE International Workshop on Modelling People
3D Modeling and Tracking of Human Lip Motions

ICCV '98 Proceedings of the Sixth International Conference on Computer Vision
A Hierarchical Framework For High Resolution Facial Expression Tracking

CVPRW '04 Proceedings of the 2004 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'04) Volume 1 - Volume 01
3D model based expression tracking in intrinsic expression space

FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition

Quantified Score

Hi-index	0.00

Visualization

Abstract

Real-time facial expression capture is an essential part for on-line performance animation. For efficiency and robustness, special devices such as head-mounted cameras and face-attached markers have been used. However, these devices can possibly cause some discomfort that may hinder a face puppeteer from performing natural facial expressions. In this paper, we propose a comprehensive solution for real-time facial expression capture without any of such devices. Our basic idea is first to capture the 2D facial features and 3D head motion exploiting anthropometric knowledge and then to capture their time-varying 3D positions only due to facial expression. We adopt a Kalman filter to track the 3D features guided by their captured 2D positions while correcting their drift due to 3D head motion as well as removing noises.