Improving reinforcement learning with context detection

  • Authors:
  • Bruno C. da Silva;Eduardo W. Basso;Filipo S. Perotto;Ana L. C. Bazzan;Paulo M. Engel

  • Affiliations:
  • Instituto de Informática, UFRGS, Porto Alegre, Brazil;Instituto de Informática, UFRGS, Porto Alegre, Brazil;Instituto de Informática, UFRGS, Porto Alegre, Brazil;Instituto de Informática, UFRGS, Porto Alegre, Brazil;Instituto de Informática, UFRGS, Porto Alegre, Brazil

  • Venue:
  • AAMAS '06 Proceedings of the fifth international joint conference on Autonomous agents and multiagent systems
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper we propose a method for solving reinforcement learning problems in non-stationary environments. The basic idea is to create and simultaneously update multiple partial models of the environment dynamics. The learning mechanism is based on the detection of context changes, that is, on the detection of significant changes in the dynamics of the environment. Based on this motivation, we propose, formalize and show the efficiency of a method for detecting the current context and the associated model of prediction, as well as a method for updating each of the incrementally built models.