Adaptive load balancing: a study in multi-agent learning

  • Authors:
  • Andrea Schaerf;Yoav Shoham;Moshe Tennenholtz

  • Affiliations:
  • Dipartimento di Informatica e Sistemistica, Universitá di Roma "La Sapienza", Roma, Italy;Robotics Laboratory, Computer Science Department, Stanford University, Stanford, CA;Faculty of Industrial Engineering and Management, Technion, Haifa, Israel

  • Venue:
  • Journal of Artificial Intelligence Research
  • Year:
  • 1995

Quantified Score

Hi-index 0.00

Visualization

Abstract

We study the process of multi-agent reinforcement learning in the context of load balancing in a distributed system, without use of either central coordination or explicit communication. We first define a precise framework in which to study adaptive load balancing, important features of which are its stochastic nature and the purely local information available to individual agents. Given this framework, we show illuminating results on the interplay between basic adaptive behavior parameters and their effect on system efficiency. We then investigate the properties of adaptive load balancing in heterogeneous populations, and address the issue of exploration vs. exploitation in that context. Finally, we show that naive use of communication may not improve, and might even harm system efficiency.