Exploring the T-Maze: evolving learning-like robot behaviors using CTRNNs

  • Authors:
  • Jesper Blynel;Dario Floreano

  • Affiliations:
  • Autonomous Systems Lab, Institute of Systems Engineering, Swiss Federal Institute of Technology, Lausanne, Switzerland;Autonomous Systems Lab, Institute of Systems Engineering, Swiss Federal Institute of Technology, Lausanne, Switzerland

  • Venue:
  • EvoWorkshops'03 Proceedings of the 2003 international conference on Applications of evolutionary computing
  • Year:
  • 2003

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper explores the capabilities of continuous time recurrent neural networks (CTRNNs) to display reinforcement learning-like abilities on a set of T-Maze and double T-Maze navigation tasks, where the robot has to locate and "remember" the position of a reward-zone. The "learning" comes about without modifications of synapse strengths, but simply from internal network dynamics, as proposed by [12]. Neural controllers are evolved in simulation and in the simple case evaluated on a real robot. The evolved controllers are analyzed and the results obtained are discussed.