Solving multi-stage games with hierarchical learning automata that bootstrap

  • Authors:
  • Maarten Peeters;Katja Verbeeck;Ann Nowé

  • Affiliations:
  • Vrije Universiteit Brussel, Computational Modeling Lab, Brussel, Belgium;Maastricht University, MICC-IKAT, Maastricht, The Netherlands;Vrije Universiteit Brussel, Computational Modeling Lab, Brussel, Belgium

  • Venue:
  • ALAMAS'05/ALAMAS'06/ALAMAS'07 Proceedings of the 5th , 6th and 7th European conference on Adaptive and learning agents and multi-agent systems: adaptation and multi-agent learning
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

Hierarchical learning automata are shown to be an excellent tool for solving multi-stage games. However, most updating schemes used by hierarchical automata expect the multi-stage game to reach an absorbing state at which point the automata are updated in a Monte Carlo way. As such, the approach is infeasible for large multi-stage games (and even for problems with an infinite horizon) and the convergence process is slow. In this paper we propose an algorithm where the rewards don't have to travel all the way up to the top of the hierarchy and in which there is no need for explicit end-stages.