Multispectral piecewise planar stereo using Manhattan-world assumption

  • Authors:
  • Fernando Barrera;Felipe Lumbreras;Angel D. Sappa

  • Affiliations:
  • Computer Vision Center, Autonomous University of Barcelona, 08193 Bellaterra, Barcelona, Spain;Computer Vision Center, Autonomous University of Barcelona, 08193 Bellaterra, Barcelona, Spain and Dept. Computer Science, Autonomous University of Barcelona, 08193 Bellaterra, Barcelona, Spain;Computer Vision Center, Autonomous University of Barcelona, 08193 Bellaterra, Barcelona, Spain

  • Venue:
  • Pattern Recognition Letters
  • Year:
  • 2013

Quantified Score

Hi-index 0.10

Visualization

Abstract

This paper proposes a new framework for extracting dense disparity maps from a multispectral stereo rig. The system is constructed with an infrared and a color camera. It is intended to explore novel multispectral stereo matching approaches that will allow further extraction of semantic information. The proposed framework consists of three stages. Firstly, an initial sparse disparity map is generated by using a cost function based on feature matching in a multiresolution scheme. Then, by looking at the color image, a set of planar hypotheses is defined to describe the surfaces on the scene. Finally, the previous stages are combined by reformulating the disparity computation as a global minimization problem. The paper has two main contributions. The first contribution combines mutual information with a shape descriptor based on gradient in a multiresolution scheme. The second contribution, which is based on the Manhattan-world assumption, extracts a dense disparity representation using the graph cut algorithm. Experimental results in outdoor scenarios are provided showing the validity of the proposed framework.