Self-Organizing reinforcement learning model

  • Authors:
  • Chang-Hsian Uang;Jiun-Wei Liou;Cheng-Yuan Liou

  • Affiliations:
  • Department of Computer Science and Information Engineering, National Taiwan University, Taiwan;Department of Computer Science and Information Engineering, National Taiwan University, Taiwan;Department of Computer Science and Information Engineering, National Taiwan University, Taiwan

  • Venue:
  • ACIIDS'12 Proceedings of the 4th Asian conference on Intelligent Information and Database Systems - Volume Part I
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

A motor control model based on reinforcement learning (RL) is proposed here. The model is inspired by organizational principles of the cerebral cortex, specifically on cortical maps and functional hierarchy in sensory and motor areas of the brain. Self-Organizing Maps (SOM) have proven to be useful in modeling cortical topological maps. The SOM maps the input space in response to the real-valued state information, and a second SOM is used to represent the action space. We use the Q-learning algorithm with a neighborhood update function, and an SOM for Q-function to avoid representing very large number of states or continuous action space in a large tabular form. The final model can map a continuous input space to a continuous action space.