Automatic, effective, and efficient 3d face reconstruction from arbitrary view image

Authors:
Changhu Wang;Shuicheng Yan;Hua Li;Hongjiang Zhang;Mingjing Li
Affiliations:
Department of EEIS, University of Science and Technology of China, China;LMAM, School of Mathematical Sciences, Peking University, P.R. China;LMAM, School of Mathematical Sciences, Peking University, P.R. China;Microsoft Research Asia, Beijing, P.R. China;Microsoft Research Asia, Beijing, P.R. China
Venue:
PCM'04 Proceedings of the 5th Pacific Rim Conference on Advances in Multimedia Information Processing - Volume Part II
Year:
2004

Citing 8
Cited 0

Algorithms for solid noise synthesis

SIGGRAPH '89 Proceedings of the 16th annual conference on Computer graphics and interactive techniques
An Analytic-to-Holistic Approach for Face Recognition Based on a Single Frontal View

IEEE Transactions on Pattern Analysis and Machine Intelligence
Shape from Shading: A Survey

IEEE Transactions on Pattern Analysis and Machine Intelligence
Computer generated animation of faces

ACM '72 Proceedings of the ACM annual conference - Volume 1
Face Identification by Fitting a 3D Morphable Model Using Linear Shape and Texture Error Functions

ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part IV
A parametric model for human faces.

A parametric model for human faces.
Robust non-frontal face alignment with edge based texture

Journal of Computer Science and Technology
Automatic 3D reconstruction for face recognition

FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we propose a fully automatic, effective and efficient framework for 3D face reconstruction based on a single face image in arbitrary view. First, a multi-view face alignment algorithm localizes the face feature points, and then EM algorithm is applied to derive the optimal 3D shape and position parameters. Moreover, the unit quaternion based pose representation is proposed for efficient 3D pose parameter optimization. Compared with other related works, this framework has the following advantages: 1) it is fully automatic, and only one single face image in arbitrary view is required; 2) EM algorithm and unit quaternion based pose representation are integrated for efficient shape and position parameters estimation; 3) the correspondence between 2D contour points and 3D model vertexes are dynamically determined by normal direction constraints, which facilitates the 3D reconstruction from arbitrary view image; 4) a weighted optimization strategy is applied for more robust parameter estimation. The experimental results show the effectiveness of our framework for 3D face reconstruction.