Coordinated learning for loosely coupled agents with sparse interactions

  • Authors:
  • Chao Yu;Minjie Zhang;Fenghui Ren

  • Affiliations:
  • School of Computer Science and Software Engineering, University of Wollongong, Wollongong, NSW, Australia;School of Computer Science and Software Engineering, University of Wollongong, Wollongong, NSW, Australia;School of Computer Science and Software Engineering, University of Wollongong, Wollongong, NSW, Australia

  • Venue:
  • AI'11 Proceedings of the 24th international conference on Advances in Artificial Intelligence
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

Multiagent learning is a challenging problem in the area of multiagent systems because of the non-stationary environment caused by the interdependencies between agents. Learning for coordination becomes more difficult when agents do not know the structure of the environment and have only local observability. In this paper, an approach is proposed to enable autonomous agents to learn where and how to coordinate their behaviours in an environment where the interactions between agents are sparse. Our approach firstly adopts a statistical method to detect those states where coordination is most necessary. A Q-learning based coordination mechanism is then applied to coordinate agents' behaviours based on their local observability of the environment. We test our approach in grid world domains to show its good performance.