Reinforcement learning scheme for grouping and characterization of multi-agent network

Authors:
Koichiro Morihiro;Nobuyuki Matsui;Teijiro Isokawa;Haruhiko Nishimura
Affiliations:
Hyogo University of Teacher Education, Hyogo, Japan;Graduate School of Engineering, University of Hyogo, Hyogo, Japan;Graduate School of Engineering, University of Hyogo, Hyogo, Japan;Graduate School of Applied Informatics, University of Hyogo, Hyogo, Japan
Venue:
KES'10 Proceedings of the 14th international conference on Knowledge-based and intelligent information and engineering systems: Part III
Year:
2010

Citing 5
Cited 0

Flocks, herds and schools: A distributed behavioral model

SIGGRAPH '87 Proceedings of the 14th annual conference on Computer graphics and interactive techniques
Technical Note: \cal Q-Learning

Machine Learning
Learning Grouping and Anti-predator Behaviors for Multi-agent Systems

KES '08 Proceedings of the 12th international conference on Knowledge-Based Intelligent Information and Engineering Systems, Part II
Reinforcement learning: a survey

Journal of Artificial Intelligence Research
Reinforcement learning scheme for grouping and anti-predator behavior

KES'07/WIRN'07 Proceedings of the 11th international conference, KES 2007 and XVII Italian workshop on neural networks conference on Knowledge-based intelligent information and engineering systems: Part III

Quantified Score

Hi-index	0.00

Visualization

Abstract

Several models have been proposed for describing grouping behavior such as bird flocking, terrestrial animal herding, and fish schooling. In these models, a fixed rule has been imposed on each individual a priori for its interactions in a reductive and rigid manner. We have proposed a new framework for self-organized grouping of agents by reinforcement learning. It is important to introduce a learning scheme for developing collective behavior in artificial autonomous distributed systems. This scheme can be expanded to cases in which predators are present. We integrated grouping and anti-predator behaviors into our proposed scheme. The behavior of agents is demonstrated and evaluated in detail through computer simulations, and their grouping and antipredator behaviors developed as a result of learning are shown to be diverse and robust by changing some parameters of the scheme. In this study, we investigate the network structure of agents in the process of learning these behaviors. From the view point of the complex network, the average shortest path length and clustering coefficient are evaluated through computer simulations.