Image-based 3D face modeling system

Authors:
In Kyu Park;Hui Zhang;Vladimir Vezhnevets
Affiliations:
School of Information and Communication Engineering, Inha University, Incheon, Korea;Computing Lab, Samsung Advanced Institute of Technology, Yongin, Korea;Graphics and Media Lab, Department of Computational Mathematics and Cybernetics, Moscow State University, Moscow, Russia
Venue:
EURASIP Journal on Applied Signal Processing
Year:
2005

Citing 19
Cited 4

A multiresolution spline with application to image mosaics

ACM Transactions on Graphics (TOG)
Feature extraction from faces using deformable templates

International Journal of Computer Vision
Synthesizing realistic facial expressions from photographs

Proceedings of the 25th annual conference on Computer graphics and interactive techniques
A morphable model for the synthesis of 3D faces

Proceedings of the 26th annual conference on Computer graphics and interactive techniques
Regularized Bundle-Adjustment to Model Heads from Image Sequences without Calibration Data

International Journal of Computer Vision
3D face modeling from perspective-views and contour-based generic-model

Real-Time Imaging
Reconstruction and representation of 3D objects with radial basis functions

Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Expressive expression mapping with ratio images

Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Expression cloning

Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Detecting Faces in Images: A Survey

IEEE Transactions on Pattern Analysis and Machine Intelligence
Color Transfer between Images

IEEE Computer Graphics and Applications
Projection based method for segmentation of human face and its evaluation

Pattern Recognition Letters
Spatiotemporal Analysis of Face Profiles: Detection, Segmentation, and Registration

FG '98 Proceedings of the 3rd. International Conference on Face & Gesture Recognition
Comparison of Five Color Models in Skin Pixel Classification

RATFG-RTS '99 Proceedings of the International Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems
Active Face and Feature Tracking

ICIAP '99 Proceedings of the 10th International Conference on Image Analysis and Processing
Estimation of the chin and cheek contours for precise face model adaptation

ICIP '97 Proceedings of the 1997 International Conference on Image Processing (ICIP '97) 3-Volume Set-Volume 3 - Volume 3
Efficient, Robust and Accurate Fitting of a 3D Morphable Model

ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
Nose shape estimation and tracking for model-based coding

ICASSP '01 Proceedings of the Acoustics, Speech, and Signal Processing, 2001. on IEEE International Conference - Volume 03
3-D facial model estimation from single front-view facial image

IEEE Transactions on Circuits and Systems for Video Technology

Multimodal Human Machine Interactions in Virtual and Augmented Reality

Multimodal Signals: Cognitive and Algorithmic Issues
3D face model reconstruction from single 2D frontal image

Proceedings of the 8th International Conference on Virtual Reality Continuum and its Applications in Industry
Crafting 3D faces using free form portrait sketching and plausible texture inference

Proceedings of Graphics Interface 2010
Identities, forgeries and disguises

International Journal of Information Technology and Management

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper describes an automatic system for 3D face modeling using frontal and profile images taken by an ordinary digital camera. The system consists of four subsystems including frontal feature detection, profile feature detection, shape deformation, and texture generation modules. The frontal and profile feature detection modules automatically extract the facial parts such as the eye, nose, mouth, and ear. The shape deformation module utilizes the detected features to deform the generic head mesh model such that the deformed model coincides with the detected features. A texture is created by combining the facial textures augmented from the input images and the synthesized texture and mapped onto the deformed generic head model. This paper provides a practical system for 3D face modeling, which is highly automated by aggregating, customizing, and optimizing a bunch of individual computer vision algorithms. The experimental results show a highly automated process of modeling, which is sufficiently robust to various imaging conditions. The whole model creation including all the optional manual corrections takes only 2-3 minutes.