Structure from motion and photometric stereo for dense 3D shape recovery

Authors:
Reza Sabzevari;Alessio Del Bue;Vittorio Murino
Affiliations:
Istituto Italiano di Tecnologia, Genova, Italy;Istituto Italiano di Tecnologia, Genova, Italy;Istituto Italiano di Tecnologia, Genova, Italy
Venue:
ICIAP'11 Proceedings of the 16th international conference on Image analysis and processing: Part I
Year:
2011

Citing 14
Cited 0

Shape From Texture: Integrating Texture-Element Extraction and Surface Estimation

IEEE Transactions on Pattern Analysis and Machine Intelligence
Shape and motion from image streams under orthography: a factorization method

International Journal of Computer Vision
The Bas-Relief Ambiguity

International Journal of Computer Vision
Multiple view geometry in computer visiond

Multiple view geometry in computer visiond
Factorization Methods for Projective Structure and Motion

CVPR '96 Proceedings of the 1996 Conference on Computer Vision and Pattern Recognition (CVPR '96)
Shape and Motion under Varying Illumination: Unifying Structure from Motion, Photometric Stereo, and Multi-view Stereo

ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
A Geometric Approach to Shape from Defocus

IEEE Transactions on Pattern Analysis and Machine Intelligence
Passive Photometric Stereo from Motion

ICCV '05 Proceedings of the Tenth IEEE International Conference on Computer Vision - Volume 2
Photometric Stereo with General, Unknown Lighting

International Journal of Computer Vision
Estimating 3D shape from degenerate sequences with missing data

Computer Vision and Image Understanding
Uncalibrated Factorization Using a Variable Symmetric Affine Camera

IEICE - Transactions on Information and Systems
A Self-Calibrating Method for Photogeometric Acquisition of 3D Objects

IEEE Transactions on Pattern Analysis and Machine Intelligence
Multi-PIE

Image and Vision Computing
Bilinear factorization via augmented lagrange multipliers

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part IV

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper we present a dense 3D reconstruction pipeline from monocular video sequences using jointly Photometric Stereo (PS) and Structure from Motion (SfM) approaches. The input videos are completely uncalibrated both from the multi-view geometry and photometric stereo aspects. In particular we make use of the 3D metric information computed with SfM from a set of 2D landmarks in order to solve for the bas-relief ambiguity which is intrinsic from dense PS surface estimation. The algorithm is evaluated over the CMU Multi-Pie database which contains the images of 337 subjects viewed under different lighting conditions and showing various facial expressions.