Reinforcement learning in mirrorbot

  • Authors:
  • Cornelius Weber;David Muse;Mark Elshaw;Stefan Wermter

  • Affiliations:
  • Hybrid Intelligent Systems, SCAT, University of Sunderland, UK;Hybrid Intelligent Systems, SCAT, University of Sunderland, UK;Hybrid Intelligent Systems, SCAT, University of Sunderland, UK;Hybrid Intelligent Systems, SCAT, University of Sunderland, UK

  • Venue:
  • ICANN'05 Proceedings of the 15th international conference on Artificial Neural Networks: biological Inspirations - Volume Part I
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

For this special session of EU projects in the area of NeuroIT, we will review the progress of the MirrorBot project with special emphasis on its relation to reinforcement learning and future perspectives. Models inspired by mirror neurons in the cortex, while enabling a system to understand its actions, also help in the solving of the curse of dimensionality problem of reinforcement learning. Reinforcement learning, which is primarily linked to the basal ganglia, is a powerful method to teach an agent such as a robot a goal-directed action strategy. Its limitation is mainly that the perceived situation has to be mapped to a state space, which grows exponentially with input dimensionality. Cortex-inspired computation can alleviate this problem by pre-processing sensory information and supplying motor primitives that can act as modules for a superordinate reinforcement learning scheme.