Combining probabilistic shape-from-shading and statistical facial shape models

Authors:
Touqeer Ahmad;Richard C. Wilson;William A. P. Smith;Tom S. F. Haines
Affiliations:
Department of Computer Science, The University of York, UK and School of Science and Engineering, LUMS, Pakistan;Department of Computer Science, The University of York, UK;Department of Computer Science, The University of York, UK;Queen Mary University of London, UK
Venue:
ICIAP'11 Proceedings of the 16th international conference on Image analysis and processing: Part I
Year:
2011

Citing 10
Cited 0

Shape from shading with perspective projection

CVGIP: Image Understanding
New Constraints on Data-Closeness and Needle Map Consistency for Shape-from-Shading

IEEE Transactions on Pattern Analysis and Machine Intelligence
Symmetric Shape-from-Shading Using Self-ratio Image

International Journal of Computer Vision
Incorporating Illumination Constraints in Deformable Models for Shape from Shading and Light Direction Estimation

IEEE Transactions on Pattern Analysis and Machine Intelligence
Face Recognition Based on Fitting a 3D Morphable Model

IEEE Transactions on Pattern Analysis and Machine Intelligence
Outlier Robust ICP for Minimizing Fractional RMSD

3DIM '07 Proceedings of the Sixth International Conference on 3-D Digital Imaging and Modeling
Facial Shape-from-shading and Recognition Using Principal Geodesic Analysis and Robust Statistics

International Journal of Computer Vision
Belief Propagation with Directional Statistics for Solving the Shape-from-Shading Problem

ECCV '08 Proceedings of the 10th European Conference on Computer Vision: Part III
On the Fisher---Bingham distribution

Statistics and Computing
Rapid and brief communication: Improving feature extraction by replacing the Fisher criterion by an upper error bound

Pattern Recognition

Quantified Score

Hi-index	0.00

Visualization

Abstract

Shape-from-shading is an interesting approach to the problem of finding the shape of a face because it only requires one image and no subject participation. However, SfS is not accurate enough to produce good shape models. Previously, SfS has been combined with shape models to produce realistic face reconstructions. In this work, we aim to improve the quality of such models by exploiting a probabilistic SfS model based on Fisher-Bingham 8-parameter distributions (FB8). The benefits are two-fold; firstly we can correctly weight the contributions of the data and model where the surface normals are uncertain, and secondly we can locate areas of shadow and facial hair using inconsistencies between the data and model. We sample the FB8 distributions using a Gibbs sampling algorithm. These are then modelled as Gaussian distributions on the surface tangent plane defined by the model. The shape model provides a second Gaussian distribution describing the likely configurations of the model; these distributions are combined on the tangent plane of the directional sphere to give the most probable surface normal directions for all pixels. The Fisher criterion is used to locate inconsistencies between the two distributions and smoothing is used to deal with outliers originating in the shadowed and specular regions. A surface height model is then used to recover surface heights from surface normals. The combined approach shows improved results over the case when only surface normals from shape-from-shading are used.