Online planning for multi-agent systems with bounded communication
Artificial Intelligence
Reinforcement Learning of Communication in a Multi-agent Context
WI-IAT '11 Proceedings of the 2011 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology - Volume 02
| Hi-index | 0.00 |
In the following paper we present a new algorithm for cooperative reinforcement learning in multi-agent systems. We consider autonomous and independently learning agents, and we seek to obtain an optimal solution for the team as a whole while keeping the learning as much decentralized as possible. Coordination between agents occurs through communication, namely the mutual notification algorithm. We define the learning problem as a decentralized process using the MDP formalism. We then give an optimality criterion and prove the convergence of the algorithm for deterministic environments.We introduce variable and hierarchical communication strategies which considerably reduce the number of communications. Finally we study the convergence properties and communication over-head on a small example.