New algorithm for 3D facial model reconstruction and its application in virtual reality

Authors:
Rong-Hua Liang;Zhi-Geng Pan;Chun Chen
Affiliations:
College of Computer Science, Zhejiang University, Hangzhou 310027, P.R. China and College of Information and Engineering, Zhejiang University of Technology, Hangzhou, 310014. P.R. China;State Key Laboratory of CAD and CG, Zhejiang University, Hangzhou 310027, P.R. China;College of Computer Science, Zhejiang University, Hangzhou 310027, P.R. China
Venue:
Journal of Computer Science and Technology
Year:
2004

Citing 11
Cited 1

A muscle model for animation three-dimensional facial expression

SIGGRAPH '87 Proceedings of the 14th annual conference on Computer graphics and interactive techniques
Object-centered surface reconstruction: combining multi-image stereo and shading

International Journal of Computer Vision
Realistic modeling for facial animation

SIGGRAPH '95 Proceedings of the 22nd annual conference on Computer graphics and interactive techniques
A robust technique for matching two uncalibrated images through the recovery of the unknown epipolar geometry

Artificial Intelligence - Special volume on computer vision
Computer facial animation

Computer facial animation
An anthropometric face model using variational techniques

Proceedings of the 25th annual conference on Computer graphics and interactive techniques
Synthesizing realistic facial expressions from photographs

Proceedings of the 25th annual conference on Computer graphics and interactive techniques
A morphable model for the synthesis of 3D faces

Proceedings of the 26th annual conference on Computer graphics and interactive techniques
Incorporating Illumination Constraints in Deformable Models

CVPR '98 Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
An integrated framework for face modeling, facial motion analysis and synthesis

An integrated framework for face modeling, facial motion analysis and synthesis
The facial animation engine: toward a high-level interface for the design of MPEG-4 compliant animated faces

IEEE Transactions on Circuits and Systems for Video Technology

Visual perception modeling for intelligent avatars

ICAT'06 Proceedings of the 16th international conference on Advances in Artificial Reality and Tele-Existence

Quantified Score

Hi-index	0.00

Visualization

Abstract

3D human face model reconstruction is essential to the generation of facial animations that is widely used in the field of virtual reality (VR). The main issues of 3D facial model reconstruction based on images by vision technologies are in twofold: one is to select and match the corresponding features of face from two images with minimal interaction and the other is to generate the realistic-looking human face model. In this paper, a new algorithm for realistic-looking face reconstruction is presented based on stereo vision. Firstly, a pattern is printed and attached to a planar surface for camera calibration, and corners generation and corners matching between two images are performed by integrating modified image pyramid Lucas-Kanade (PLK) algorithm and local adjustment algorithm, and then 3D coordinates of corners are obtained by 3D reconstruction. Individual face model is generated by the deformation of general 3D model and interpolation of the features. Finally, realistic-looking human face model is obtained after texture mapping and eyes modeling. In addition, some application examples in the field of VR are given. Experimental result shows that the proposed algorithm is robust and the 3D model is photo-realistic.