Robust estimation of surface properties and interpolation of shadow/specularity components

  • Authors:
  • Mark S. Drew;Yacov Hel-Or;Tom Malzbender;Nasim Hajari

  • Affiliations:
  • School of Computing Science, Simon Fraser University, Vancouver, Canada V5A 1S6;Department of Computer Science, The Interdisciplinary Center, Herzliya, Israel;Mobile and Immersive Experience Lab, Hewlett-Packard Laboratories, Palo Alto, CA, United States;School of Computing Science, Simon Fraser University, Vancouver, Canada V5A 1S6

  • Venue:
  • Image and Vision Computing
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

The Polynomial Texture Map framework (PTM) extends the simple model of image formation from the Lambertian variant of Photometric Stereo (PST) to more general reflectances and to more complex-shaped surfaces. It forms an alternative method for apprehending object color, albedo, and surface normals. Here we consider solving such a model in a robust version, not to date attempted for PTM, with the upshot that both shadows and specularities are identified automatically without the need for any thresholds. Instead of the linear model used in few-source PST for Lambertian surfaces, PTM adopts a higher degree polynomial model. PTM has two aims: interpolation of images for new lighting directions, and recovery of surface properties. Here we show that a robust approach is a good deal more accurate in recovering surface properties. For new-lighting interpolation, we demonstrate that a simple radial basis function interpolation can accurately interpolate specularities as well as attached and cast shadows even with a medium-sized image set, with no need for reflectance sharing across pixels or extremely large numbers of interpolation coefficients.