ART-based fusion of multi-modal perception for robots

  • Authors:
  • Elmar BerghöFer;Denis Schulze;Christian Rauch;Marko Tscherepanow;Tim KöHler;Sven Wachsmuth

  • Affiliations:
  • DFKI GmbH, Robotics Innovation Center, Robert-Hooke-Straíe 5, 28359 Bremen, Germany;Applied Informatics, Faculty of Technology, Bielefeld University, Universitätsstraíe 25, 33615 Bielefeld, Germany and CITEC, Cognitive Interaction Technology, Center of Excellence, Unive ...;University of Bremen, Robotics Research Group, Robert-Hooke-Straíe 5, 28359 Bremen, Germany;Applied Informatics, Faculty of Technology, Bielefeld University, Universitätsstraíe 25, 33615 Bielefeld, Germany;DFKI GmbH, Robotics Innovation Center, Robert-Hooke-Straíe 5, 28359 Bremen, Germany;Applied Informatics, Faculty of Technology, Bielefeld University, Universitätsstraíe 25, 33615 Bielefeld, Germany and CITEC, Cognitive Interaction Technology, Center of Excellence, Unive ...

  • Venue:
  • Neurocomputing
  • Year:
  • 2013

Quantified Score

Hi-index 0.01

Visualization

Abstract

Robotic application scenarios in uncontrolled environments pose high demands on mobile robots. This is especially true if human-robot interaction or robot-robot interaction is involved. Here, potential interaction partners need to be identified. To tackle challenges like this, robots make use of different sensory systems. In many cases, these robots have to deal with erroneous data from different sensory systems which often are processed separately. A possible strategy to improve identification results is to combine different processing results of complementary sensors. Their relation is often hard coded and difficult to learn incrementally if new kinds of objects or events occur. In this paper, we present a new fusion strategy which we call the Simplified Fusion ARTMAP (SiFuAM) which is very flexible and therefore can be easily adapted to new domains or sensor configurations. As our approach is based on the Adaptive Resonance Theory (ART) it is inherently capable of incremental on-line learning. We show its applicability in different robotic scenarios and platforms and give an overview of its performance.