Extracting Realistic 3D Facial Animation Parameters from Multiview Video Clips

Authors:
I-Chen Lin;Jeng-Sheng Yeh;Ming Ouhyoung
Affiliations:
-;-;-
Venue:
IEEE Computer Graphics and Applications
Year:
2002

Citing 8
Cited 3

Least-Squares Fitting of Two 3-D Point Sets

IEEE Transactions on Pattern Analysis and Machine Intelligence
Scattered Data Modeling

IEEE Computer Graphics and Applications - Special issue on computer-aided geometric design
Matrix computations (3rd ed.)

Matrix computations (3rd ed.)
Making faces

Proceedings of the 25th annual conference on Computer graphics and interactive techniques
Synthesizing realistic facial expressions from photographs

Proceedings of the 25th annual conference on Computer graphics and interactive techniques
Rectified Catadioptric Stereo Sensors

IEEE Transactions on Pattern Analysis and Machine Intelligence
Motion and Structure from Image Sequences

Motion and Structure from Image Sequences
A Three-Dimensional Model of Human Lip Motions Trained from Video

NAM '97 Proceedings of the 1997 IEEE Workshop on Motion of Non-Rigid and Articulated Objects (NAM '97)

Surface detail capturing for realistic facial animation

Journal of Computer Science and Technology - Special issue on computer graphics and computer-aided design
Capturing and animating skin deformation in human motion

ACM SIGGRAPH 2006 Papers
Surround structured lighting: 3-D scanning with orthographic illumination

Computer Vision and Image Understanding

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this article, an accurate and inexpensive procedure to estimate 3D facial and lip motion trajectories from mirror-reflected multi-view video clips is proposed. Two planar mirrors are located near a subject's cheeks, and a single camera is utilized to simultaneously capture markers' front and side view images of a face without any special synchronization mechanism. A novel closed-form linear algorithm reconstructs 3D positions from real vs. mirrored point correspondences.