Semantic image segmentation using visible and near-infrared channels

  • Authors:
  • Neda Salamati;Diane Larlus;Gabriela Csurka;Sabine Süsstrunk

  • Affiliations:
  • IVRG, IC, École Polytechnique Fédérale de Lausanne, Switzerland, Xerox Research Centre Europe, Meylan, France;Xerox Research Centre Europe, Meylan, France;Xerox Research Centre Europe, Meylan, France;IVRG, IC, École Polytechnique Fédérale de Lausanne, Switzerland

  • Venue:
  • ECCV'12 Proceedings of the 12th international conference on Computer Vision - Volume 2
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

Recent progress in computational photography has shown that we can acquire physical information beyond visible (RGB) image representations. In particular, we can acquire near-infrared (NIR) cues with only slight modification to any standard digital camera. In this paper, we study whether this extra channel can improve semantic image segmentation. Based on a state-of-the-art segmentation framework and a novel manually segmented image database that contains 4-channel images (RGB+NIR), we study how to best incorporate the specific characteristics of the NIR response. We show that it leads to improved performances for 7 classes out of 10 in the proposed dataset and discuss the results with respect to the physical properties of the NIR response.