Heuristic Reinforcement Learning Applied to RoboCup Simulation Agents

  • Authors:
  • Luiz A. Celiberto, Jr.;Carlos H. Ribeiro;Anna H. Costa;Reinaldo A. Bianchi

  • Affiliations:
  • Centro Universitário da FEI, São Bernardo do Campo, Brazil 09850-901 and Instituto Tecnológico de Aeronáutica, São José dos Campos, Brazil 12228-900;Instituto Tecnológico de Aeronáutica, São José dos Campos, Brazil 12228-900;Laboratório de Técnicas Inteligentes, Escola Politécnica da Universidade de São Paulo, São Paulo, Brazil 05508-900;Centro Universitário da FEI, São Bernardo do Campo, Brazil 09850-901

  • Venue:
  • RoboCup 2007: Robot Soccer World Cup XI
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper describes the design and implementation of robotic agents for the RoboCup Simulation 2D category that learns using a recently proposed Heuristic Reinforcement Learning algorithm, the Heuristically Accelerated Q---Learning (HAQL). This algorithm allows the use of heuristics to speed up the well-known Reinforcement Learning algorithm Q---Learning. A heuristic function that influences the choice of the actions characterizes the HAQL algorithm. A set of empirical evaluations was conducted in the RoboCup 2D Simulator, and experimental results show that even very simple heuristics enhances significantly the performance of the agents.