Robust stereo matching with improved graph and surface models and occlusion handling

  • Authors:
  • Jong Dae Oh;C. -C. Jay Kuo

  • Affiliations:
  • University of Southern California, Electrical Engineering, Los Angles, United States;University of Southern California, Electrical Engineering, Los Angles, United States

  • Venue:
  • Journal of Visual Communication and Image Representation
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

We decompose the stereo matching problem into three sub-problems in this work: (1) disparity estimation for non-occlusion regions and occlusion detection, (2) disparity estimation for occlusion regions, and (3) surface model for the disparity map. A three-step procedure is proposed to solve them sequentially. At the first step, we perform an initial matching and develop a new graph model using the ordering and segmentation constraints to improve disparity values in non-occlusion regions and detect occlusion regions. At the second step, we determine disparity values in occlusion regions based on global optimization. Since the conventional segmentation-based stereo matching is not efficient in highly slanted or curved objects, we propose a post-processing technique for disparity map enhancement using a three-dimensional (3D) geometric structure. The proposed three-step stereo matching procedure yields excellent quantitative and qualitative results with Middlebury data sets.