Postural Control of Two-Stage Inverted Pendulum Using Reinforcement Learning and Self-organizing Map

  • Authors:
  • Jae-Kang Lee;Tae-Seok Oh;Yun-Su Shin;Tae-Jun Yoon;Il-Hwan Kim

  • Affiliations:
  • Department of Electrical and Electronic Engineering, College of Information Technology, Kangwon National Univ., Chuncheon, Korea;Department of Electrical and Electronic Engineering, College of Information Technology, Kangwon National Univ., Chuncheon, Korea;Program of Electronic & Communications Engineering, Department of Electric & Electronic Engineering, College of Information Technology, Kangwon National Univ., Chuncheon, Korea;Department of Mechatronics Engineering, Kangwon National Univ., Chuncheon, Korea;Department of Electrical and Electronic Engineering, College of Information Technology, Kangwon National Univ., Chuncheon, Korea

  • Venue:
  • ICANNGA '07 Proceedings of the 8th international conference on Adaptive and Natural Computing Algorithms, Part II
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper considers reinforcement learning control with the self-organizing map. Reinforcement learning uses the observable states of objective system and signals from interaction of the system and environment as input data. For fast learning in neural network training, it is necessary to reduce learning data. In this paper, we use the self-organizing map to partition the observable states. Partitioning states reduces the number of learning data which is used for training neural networks. And neural dynamic programming design method is used for the controller. For evaluating the designed reinforcement learning controller, a double linked inverted pendulum on the cart system is simulated. The designed controller is composed of serial connection of self-organizing map and two Multi-layer Feed-Forward Neural Networks.