Guided depth enhancement via a fast marching method

  • Authors:

  • Xiaojin Gong;Junyi Liu;Wenhui Zhou;Jilin Liu

  • Affiliations:

  • Dept. of Information Science and Electronic Engineering, Zhejiang University, Hangzhou, Zhejiang 310027, PR China;Dept. of Information Science and Electronic Engineering, Zhejiang University, Hangzhou, Zhejiang 310027, PR China;School of Computer Science and Technology, Hangzhou Dianzi University, Hangzhou, Zhejiang 310018, PR China;Dept. of Information Science and Electronic Engineering, Zhejiang University, Hangzhou, Zhejiang 310027, PR China

  • Venue:
  • Image and Vision Computing
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

Range imaging sensors such as Kinect and time-of-flight cameras can produce aligned depth and color images in real time. However, the depth maps captured by such sensors contain numerous invalid regions and suffer from heavy noise. These defects more or less influence the use of depth information in practical applications. In order to enhance the depth maps, this paper proposes a new inpainting approach based on the fast marching method (FMM). We extend the inpainting model and the propagation strategy of FMM to incorporate color information for depth inpainting. An edge-preserving guided filter is further applied for noise reduction. To validate our algorithm, we perform experiments on both Kinect data and Middlebury dataset which, respectively, provide qualitative and quantitative results. Meanwhile, we also compare it to the original FMM and other two state-of-the-art depth enhancement methods. Experimental results show that our method performs better than the local methods in terms of both visual and metric qualities, and it achieves visually comparable results to the time-consuming global method.