Visible and infrared sensors fusion by matching feature points of foreground blobs

  • Authors:
  • Pier-Luc St-Onge;Guillaume-Alexandre Bilodeau

  • Affiliations:
  • LITIV, Department of Computer Engineering, École Polytechnique de Montréal, Montréal, Québec, Canada;LITIV, Department of Computer Engineering, École Polytechnique de Montréal, Montréal, Québec, Canada

  • Venue:
  • ISVC'07 Proceedings of the 3rd international conference on Advances in visual computing - Volume Part II
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

Foreground blobs in a mixed stereo pair of videos (visible and infrared sensors) allow a coarse evaluation of the distances between each blob and the uncalibrated cameras. The main goals of this work are to find common feature points in each type of image and to create pairs of corresponding points in order to obtain coarse positionning of blobs in space. Feature points are found by two methods: the skeleton and the Discrete Curve Evolution (DCE) algorithm. For each method, a feature-based algorithm creates the pairs of points. Blob pairing can help to create those pairs of points. Finally, a RANSAC algorithm filters all pairs of points in order to respect the epipolar geometrical constraints. The median horizontal disparities for each pair of blobs are evaluated with two different ground truths. In most cases, the nearest blob is detected and disparities are as accurate as the background subtraction allows.