Multi-View Stereo Reconstruction of Dense Shape and Complex Appearance

  • Authors:

  • Hailin Jin;Stefano Soatto;Anthony J. Yezzi

  • Affiliations:

  • Office of Technology, Adobe Systems Incorporated, San Jose 95110;Computer Science Department, University of California, Los Angeles 90095;School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta 30332

  • Venue:
  • International Journal of Computer Vision
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

We address the problem of estimating the three-dimensional shape and complex appearance of a scene from a calibrated set of views under fixed illumination. Our approach relies on a rank condition that must be satisfied when the scene exhibits "specular + diffuse" reflectance characteristics. This constraint is used to define a cost functional for the discrepancy between the measured images and those generated by the estimate of the scene, rather than attempting to match image-to-image directly. Minimizing such a functional yields the optimal estimate of the shape of the scene, represented by a dense surface, as well as its radiance, represented by four functions defined on such a surface. These can be used to generate novel views that capture the non-Lambertian appearance of the scene.