High quality depth map upsampling for 3D-TOF cameras

  • Authors:
  • Jaesik Park;Hyeongwoo Kim; Yu-Wing Tai;Michael S. Brown;Inso Kweon

  • Affiliations:
  • Korea Advanced Institute of Science and Technology (KAIST), Korea;Korea Advanced Institute of Science and Technology (KAIST), Korea;Korea Advanced Institute of Science and Technology (KAIST), Korea;National University of Singapore (NUS), Singapore;Korea Advanced Institute of Science and Technology (KAIST), Korea

  • Venue:
  • ICCV '11 Proceedings of the 2011 International Conference on Computer Vision
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper describes an application framework to perform high quality upsampling on depth maps captured from a low-resolution and noisy 3D time-of-flight (3D-ToF) camera that has been coupled with a high-resolution RGB camera. Our framework is inspired by recent work that uses nonlocal means filtering to regularize depth maps in order to maintain fine detail and structure. Our framework extends this regularization with an additional edge weighting scheme based on several image features based on the additional high-resolution RGB input. Quantitative and qualitative results show that our method outperforms existing approaches for 3D-ToF upsampling. We describe the complete process for this system, including device calibration, scene warping for input alignment, and even how the results can be further processed using simple user markup.