A Bayesian framework for dense depth estimation based on spatial-temporal correlation

  • Authors:

  • Qiong Liu;You Yang;Yue Gao;Rongrong Ji;Li Yu

  • Affiliations:

  • Department of Electronics & Information Engineering, Huazhong University of Science & Technology, Wuhan 430074, China;Department of Automation, Tsinghua University, Beijing, China;School of Computing, National University of Singapore, Singapore;Department of Electronic Engineering, Columbia University, New York, NY, USA;Department of Electronics & Information Engineering, Huazhong University of Science & Technology, Wuhan 430074, China

  • Venue:
  • Neurocomputing
  • Year:
  • 2013

Quantified Score

Hi-index 0.01

Visualization

Abstract

Depth video is vital to the representation of the dynamic 3-D video, which is the fundamental for the rapidly growing 3-D video applications. The issues of accuracy and temporal consistency are the main concerns of the researches on depth videos. In previous works, the stereo matching methods with global optimization can generate accurate and dense depth videos. However, the global optimization is computationally intensive, and the temporal consistency is obtained with difficulty in the optimization procedure. In this paper, a Bayesian framework is proposed to generate accurate and temporal consistent dense depth videos in an efficient way. Firstly, the spatial and temporal correlations in 3-D videos from different viewpoints are used to generate the candidates for depth, and these correlations are further measured by extracted features. These features are adopted to estimate the risk of initial depth in our Bayesian framework. Then, a two-stage decision method is designed to select candidates of depth value in the initial depth map with the minimum risk probability. Finally, depth videos are refined by improved graph cuts algorithm with global optimization. An improved graph construction method is designed and applied on graph cuts algorithm to reduce the number of nodes in graph and thus the complexity of global optimization. The experimental results demonstrate that the proposed algorithm can achieve accurate depth videos with higher efficiency up to 68.14% than traditional methods.