Multi-modal Semantic Place Classification

  • Authors:
  • A. Pronobis;O. Martínez Mozos;B. Caputo;P. Jensfelt

  • Affiliations:
  • Centre for Autonomous Systems, Royal Institute of Technology,SE-100 44 Stockholm, Sweden;Department of Computer Science, University of Freiburg,D-79110, Freiburg, Germany;Idiap Research Institute, CH-1920 Martigny, Switzerland,;Centre for Autonomous Systems, Royal Institute of Technology,SE-100 44 Stockholm, Sweden

  • Venue:
  • International Journal of Robotics Research
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

The ability to represent knowledge about space and its position therein is crucial for a mobile robot. To this end, topological and semantic descriptions are gaining popularity for augmenting purely metric space representations. In this paper we present a multi-modal place classification system that allows a mobile robot to identify places and recognize semantic categories in an indoor environment. The system effectively utilizes information from different robotic sensors by fusing multiple visual cues and laser range data. This is achieved using a high-level cue integration scheme based on a Support Vector Machine (SVM) that learns how to optimally combine and weight each cue. Our multi-modal place classification approach can be used to obtain a real-time semantic space labeling system which integrates information over time and space. We perform an extensive experimental evaluation of the method for two different platforms and environments, on a realistic off-line database and in a live experiment on an autonomous robot. The results clearly demonstrate the effectiveness of our cue integration scheme and its value for robust place classification under varying conditions.