A Neuro-fuzzy Learning System for Adaptive Swarm Behaviors Dealing with Continuous State Space

  • Authors:
  • Takashi Kuremoto;Masanao Obayashi;Kunikazu Kobayashi;Hirotaka Adachi;Kentaro Yoneda

  • Affiliations:
  • Graduate School of Science and Engineering, Yamaguchi University, Ube, Japan 755-8611;Graduate School of Science and Engineering, Yamaguchi University, Ube, Japan 755-8611;Graduate School of Science and Engineering, Yamaguchi University, Ube, Japan 755-8611;Graduate School of Science and Engineering, Yamaguchi University, Ube, Japan 755-8611;Faculty of Science and Engineering, Yamaguchi University, Ube, Japan 755-8611

  • Venue:
  • ICIC '08 Proceedings of the 4th international conference on Intelligent Computing: Advanced Intelligent Computing Theories and Applications - with Aspects of Artificial Intelligence
  • Year:
  • 2008

Quantified Score

Hi-index 0.01

Visualization

Abstract

Swarm intelligence has brought a new paradise for function optimization, structural optimization, multi-agent systems and other study fields. In our previous work, we proposed a neuro-fuzzy system using reinforcement learning algorithm (actor-critic method with TD error learning algorithm) to acquire optimized swarm behaviors. This paper improves the conventional learning system, which only deals with discrete state space and action space, to solve how a swarm to learn and obtain its adaptive behaviors in the continuous state space. The improved system adopts a new policy function of action which is possible to yield continuous actions corresponding to continuous states. The effectiveness of proposed system is investigated by computer simulations with more kinds of environments for the goal-exploration problem.