A 3D Imaging Framework Based on High-Resolution Photometric-Stereo and Low-Resolution Depth

  • Authors:
  • Zheng Lu;Yu-Wing Tai;Fanbo Deng;Moshe Ben-Ezra;Michael S. Brown

  • Affiliations:
  • National University of Singapore, Singapore, Singapore 127110 and Microsoft Research Asia, Haidian District, Beijing, People's Republic of China 10080;Department of Computer Science, Korea Advanced Institute of Science and Technology, Daejeon, South Korea 305-701;National University of Singapore, Singapore, Singapore 127110;Microsoft Research Asia, Haidian District, Beijing, People's Republic of China 10080;National University of Singapore, Singapore, Singapore 127110

  • Venue:
  • International Journal of Computer Vision
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper introduces a 3D imaging framework that combines high-resolution photometric stereo and low-resolution depth. Our approach targets imaging scenarios based on either macro-lens photography combined with focal stacking or a large-format camera that are able to image objects with more than 600 samples per mm $$^2$$ . These imaging techniques allow photometric stereo algorithms to obtain surface normals at resolutions that far surpass corresponding depth values obtained with traditional approaches such as structured-light, passive stereo, or depth-from-focus. Our work offers two contributions for 3D imaging based on these scenarios. The first is a multi-resolution, patched-based surface reconstruction scheme that can robustly handle the significant resolution difference between our surface normals and depth samples. The second is a method to improve the initial normal estimation by using all the available focal information for images obtained using a focal stacking technique.