Evaluation of similarity functions in multimodal stereo

  • Authors:
  • Fernando Barrera;Felipe Lumbreras;Angel D. Sappa

  • Affiliations:
  • Computer Vision Center, Campus UAB, Bellaterra, Spain;Computer Vision Center, Campus UAB, Bellaterra, Spain, Computer Science Department, Universitat Autonóma de Barcelona, Spain;Computer Vision Center, Campus UAB, Bellaterra, Spain

  • Venue:
  • ICIAR'12 Proceedings of the 9th international conference on Image Analysis and Recognition - Volume Part I
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper presents an evaluation framework for multimodal stereo matching, which allows to compare the performance of four similarity functions. Additionally, it presents details of a multimodal stereo head that supply thermal infrared and color images, as well as, aspects of its calibration and rectification. The pipeline includes a novel method for the disparity selection, which is suitable for evaluating the similarity functions. Finally, a benchmark for comparing different initializations of the proposed framework is presented. Similarity functions are based on mutual information, gradient orientation and scale space representations. Their evaluation is performed using two metrics: i) disparity error, and ii) number of correct matches on planar regions. In addition to the proposed evaluation, the current paper also shows that 3D sparse representations can be recovered from such a multimodal stereo head.