Illumination direction estimation for augmented reality using a surface input real valued output regression network

  • Authors:
  • Chi Kin Chow;Shiu Yin Yuen

  • Affiliations:
  • Department of Electronic Engineering, City University of Hong Kong, Hong Kong, PR China;Department of Electronic Engineering, City University of Hong Kong, Hong Kong, PR China

  • Venue:
  • Pattern Recognition
  • Year:
  • 2010

Quantified Score

Hi-index 0.01

Visualization

Abstract

Due to low cost for capturing depth information, it is worthwhile to reduce the illumination ambiguity by employing scenario depth information. In this article, a neural computation approach is reported that estimates illuminant direction from scenario reflectance map. Since the reflectance map recovered from depth map and image is a variable sized point cloud, we propose to parameterize it as a two dimensional polynomial function. Afterwards, a novel network model is presented for mapping from continuous function (reflectance map) to vectorial output (illuminant direction). Experimental results show that the proposed model works well on both synthetic and real scenes.