Image-based photorealistic 3-D face modeling

  • Authors:
  • In Kyu Park;Hui Zhang;Vladimir Vezhnevets;Heui-Keun Choh

  • Affiliations:
  • School of Information and Communication Engineering, INHA University, Incheon, Korea;Multimedia LAB., Samsung Advanced Institute of Technology, Yongin, Korea;Dept. of Computational Mathematics and Cybernetics, Moscow State University, Moscow, Russia;Multimedia LAB., Samsung Advanced Institute of Technology, Yongin, Korea

  • Venue:
  • FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we describe an automatic system for 3-D photorealistic face modeling from frontal and profile images taken by an uncalibrated handheld digital camera. The system employs a generic model adaptation framework. That is, after the fiducial features are detected from both images, a generic head model is deformed to match with the detected features. Realistic texture is created by combining the augmented facial textures from input images and synthesized texture, and mapped onto the deformed generic head model. Our shape deformation and texture generation algorithms have several advantages: (1) They generate photorealistic models even when the orthogonal assumption of input image pairs is not satisfied. (2) The generated ear has very accurate smooth shape and improves the quality of the whole face model dramatically. (3) A few supportive techniques on texture processing are employed to improve the visual quality.