Face image enhancement using 3D and spectral information

Authors:
Charles Dubout;Masato Tsukada;Rui Ishiyama;Chisato Funayama;Sabine Süsstrunk
Affiliations:
Common Platform Software Research Laboratories, NEC Corporation, Japan and School of Computer and Communication Sciences, EPFL, Switzerland;Common Platform Software Research Laboratories, NEC Corporation, Japan;Common Platform Software Research Laboratories, NEC Corporation, Japan;Common Platform Software Research Laboratories, NEC Corporation, Japan;School of Computer and Communication Sciences, EPFL, Switzerland
Venue:
ICIP'09 Proceedings of the 16th IEEE international conference on Image processing
Year:
2009

Citing 7
Cited 1

A morphable model for the synthesis of 3D faces

Proceedings of the 26th annual conference on Computer graphics and interactive techniques
A signal-processing framework for inverse rendering

Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Image-based skin color and texture analysis/synthesis by extracting hemoglobin and melanin information in the skin

ACM SIGGRAPH 2003 Papers
Fast and Accurate Facial Pose Estimation by Aligning a 3D Appearance Model

ICPR '04 Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 4 - Volume 04
Analysis of human faces using a measurement-based skin reflectance model

ACM SIGGRAPH 2006 Papers
Focal Encyclopedia of Photography, Fourth Edition: Digital Imaging, Theory and Applications, History, and Science

Focal Encyclopedia of Photography, Fourth Edition: Digital Imaging, Theory and Applications, History, and Science
Preferred skin color reproduction based on adaptive affine transform

IEEE Transactions on Consumer Electronics

Face image enhancement taking into account lighting behavior on a face

CAIP'11 Proceedings of the 14th international conference on Computer analysis of images and patterns - Volume Part II

Quantified Score

Hi-index	0.01

Visualization

Abstract

This paper presents a novel method of enhancing image quality of face pictures using 3D and spectral information. Most conventional techniques directly work on the image data, shifting the skin color to a predefined skin tone, and thus do not take into account the effects of shape and lighting. The proposed method first recovers the 3D shape of a face in an input image using a 3D morphable model. Then, using color constancy and inverse rendering techniques, specularities and the true skin color, i.e., its spectral reflectance, are recovered. The quality of the input image is improved by matching the skin reflectance to a predefined reference and reducing the amount of specularities. The method realizes the enhancement in a more physically accurate manner compared to previous ones. Subjective experiments on image quality demonstrate the validity of the proposed method.