Finding optimal views for 3D face shape modeling

Authors:
Jinho Lee;Baback Moghaddam;Hanspeter Pfister;Raghu Machiraju
Affiliations:
Mitsubishi Electric Research Laboratories, Cambridge, MA and The Ohio State University, Columbus, OH;Mitsubishi Electric Research Laboratories, Cambridge, MA;Mitsubishi Electric Research Laboratories, Cambridge, MA;The Ohio State University, Columbus, OH
Venue:
FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition
Year:
2004

Citing 6
Cited 8

Rapid octree construction from image sequences

CVGIP: Image Understanding
Synthesizing realistic facial expressions from photographs

Proceedings of the 25th annual conference on Computer graphics and interactive techniques
Regularized Bundle-Adjustment to Model Heads from Image Sequences without Calibration Data

International Journal of Computer Vision
Face Recognition Based on Fitting a 3D Morphable Model

IEEE Transactions on Pattern Analysis and Machine Intelligence
Model-Based 3D Face Capture with Shape-from-Silhouettes

AMFG '03 Proceedings of the IEEE International Workshop on Analysis and Modeling of Faces and Gestures
Statistical approach to shape from shading: Reconstruction of three-dimensional face surfaces from single two-dimensional images

Neural Computation

Reflectance from Images: A Model-Based Approach for Human Faces

IEEE Transactions on Visualization and Computer Graphics
Sit straight (and tell me what I did today): a human posture alarm and activity summarization system

CARPE '05 Proceedings of the 2nd ACM workshop on Continuous archival and retrieval of personal experiences
Posture and activity silhouettes for self-reporting, interruption management, and attentive interfaces

Proceedings of the 11th international conference on Intelligent user interfaces
A planar-reflective symmetry transform for 3D shapes

ACM SIGGRAPH 2006 Papers
Fast and automatic object pose estimation for range images on the GPU

Machine Vision and Applications - Integrated Imaging and Vision Techniques for Industrial Inspection
Face recognition via direct search optimized Gabor filters

ICOSSE'06 Proceedings of the 5th WSEAS international conference on System science and simulation in engineering
Combined pattern search optimization of feature extraction and classification parameters in facial recognition

Pattern Recognition Letters
SMI 2011: Full Paper: On visual complexity of 3D shapes

Computers and Graphics

Quantified Score

Hi-index	0.00

Visualization

Abstract

A fundamental problem in multi-view 3D face modeling is the determination of the set of optimal views (poses) required for accurate 3D shape estimation of a generic face. There is no analytical solution to this problem, instead (partial) solutions require (near) exhaustive combinatorial search, hence the inherent computational difficulty of this task. We build on our previous modeling framework [6, 8] which uses an efficient contour-based silhouette method and extend it by aggressive pruning of the view-sphere with view clustering and various imaging constraints. A multiview optimization search is performed using both model-based (eigenheads) and data-driven (visual hull) methods, yielding comparable best views. These constitute the first reported set of optimal views for 3D face shape capture and provide useful empirical guidelines for the design of 3D face recognition systems.