Self-Organizing Sensorimotor Maps Plus Internal Motivations Yield Animal-Like Behavior

  • Authors:
  • Martin V. Butz;Elshad Shirinov;Kevin L. Reif

  • Affiliations:
  • Department of Psychology, University of Würzburg,Germany;Department of Psychology, University of Würzburg,Germany;Department of Psychology, University of Würzburg,Germany

  • Venue:
  • Adaptive Behavior - Animals, Animats, Software Agents, Robots, Adaptive Systems
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

This article investigates how a motivational module can drive an animat to learn a sensorimotor cognitive map and use it to generate flexible goal-directed behavior. Inspired by the ratâ聙聶s hippocampus and neighboring areas, the time growing neural gas (TGNG) algorithm is used, which iteratively builds such a map by means of temporal Hebbian learning. The algorithm is combined with a motivation module, which activates goals, priorities, and consequent activity gradients in the developing cognitive map for the self-motivated control of behavior. The resulting motivated TGNG thus combines a neural cognitive map learning process with top-down, self-motivated, anticipatory behavior control mechanisms. While the algorithms involved are kept rather simple, motivated TGNG displays several emergent behavioral patterns, self-sustainment, and reliable latent learning. We conclude that motivated TGNG constitutes a solid basis for future studies on self-motivated cognitive map learning, on the design of further enhanced systems with additional cognitive modules, and on the realization of highly adaptive, interactive, goal-directed, cognitive systems.