Structured class-labels in random forests for semantic image labelling

  • Authors:
  • Peter Kontschieder;Samuel Rota Bulo;Horst Bischof;Marcello Pelillo

  • Affiliations:
  • Institute for Computer Graphics and Vision, Graz University of Technology - Austria;Dipartimento di Scienze Ambientali, Informatica e Statistica, Università Ca' Foscari Venezia - Italy;Institute for Computer Graphics and Vision, Graz University of Technology - Austria;Dipartimento di Scienze Ambientali, Informatica e Statistica, Università Ca' Foscari Venezia - Italy

  • Venue:
  • ICCV '11 Proceedings of the 2011 International Conference on Computer Vision
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper we propose a simple and effective way to integrate structural information in random forests for semantic image labelling. By structural information we refer to the inherently available, topological distribution of object classes in a given image. Different object class labels will not be randomly distributed over an image but usually form coherently labelled regions. In this work we provide a way to incorporate this topological information in the popular random forest framework for performing low-level, unary classification. Our paper has several contributions: First, we show how random forests can be augmented with structured label information. In the second part, we introduce a novel data splitting function that exploits the joint distributions observed in the structured label space for learning typical label transitions between object classes. Finally, we provide two possibilities for integrating the structured output predictions into concise, semantic labellings. In our experiments on the challenging MSRC and CamVid databases, we compare our method to standard random forest and conditional random field classification results.