Using the orthographic projection model to approximate the perspective projection model for 3D facial reconstruction

Authors:
Jin-Yi Wu;Jenn-Jier James Lien
Affiliations:
Department of Computer Science and Information Engineering, National Cheng Kung University, Tainan, Taiwan, ROC;Department of Computer Science and Information Engineering, National Cheng Kung University, Tainan, Taiwan, ROC
Venue:
PSIVT'07 Proceedings of the 2nd Pacific Rim conference on Advances in image and video technology
Year:
2007

Citing 14
Cited 0

Shape and motion from image streams under orthography: a factorization method

International Journal of Computer Vision
A Paraperspective Factorization Method for Shape and Motion Recovery

IEEE Transactions on Pattern Analysis and Machine Intelligence
A morphable model for the synthesis of 3D faces

Proceedings of the 26th annual conference on Computer graphics and interactive techniques
Shape from Shading: A Survey

IEEE Transactions on Pattern Analysis and Machine Intelligence
Regularized Bundle-Adjustment to Model Heads from Image Sequences without Calibration Data

International Journal of Computer Vision
Factorization Methods for Projective Structure and Motion

CVPR '96 Proceedings of the 1996 Conference on Computer Vision and Pattern Recognition (CVPR '96)
Computing 3-D head orientation from a monocular image sequence

FG '96 Proceedings of the 2nd International Conference on Automatic Face and Gesture Recognition (FG '96)
A New Perspective [on] Shape-from-Shading

ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
Tales of Shape and Radiance in Multi-view Stereo

ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
Delaunay Triangulation based 3D Human Face Modeling from Uncalibrated Images

CVPRW '04 Proceedings of the 2004 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'04) Volume 5 - Volume 05
A Direct Method for 3D Factorization of Nonrigid Motion Observed in 2D

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 2 - Volume 02
Uncalibrated Perspective Reconstruction of Deformable Structures

ICCV '05 Proceedings of the Tenth IEEE International Conference on Computer Vision - Volume 2
Real Time Localization and 3D Reconstruction

CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1
Multi-view stereo beyond lambert

CVPR'03 Proceedings of the 2003 IEEE computer society conference on Computer vision and pattern recognition

Quantified Score

Hi-index	0.00

Visualization

Abstract

This study develops a 3D facial reconstruction system, which consists of five modules, using the orthographic projection model to approximate the perspective projection model. The first module identifies a number of feature points on the face and tracks these feature points over a sequence of facial images by the optical flow technique. The second module applies the factorization method to the orthographic model to reconstruct a 3D human face. The facial images are acquired using a pinhole camera, which are based on a perspective projection model. However, the face is reconstructed using an orthographic projection model. To compensate for the difference between these two models, the third module implements a simple and efficient method for approximating the perspective projection model. The fourth module overcomes the missing point problem, commonly arising in 3D reconstruction applications. Finally, the fifth module implements a smoothing process for the 3D surface by interpolating additional vertices.