A Case Study on Improving Defense Behavior in Soccer Simulation 2D: The NeuroHassle Approach

  • Authors:
  • Thomas Gabel;Martin Riedmiller;Florian Trost

  • Affiliations:
  • Neuroinformatics Group Institute of Mathematics and Computer Science Institute of Cognitive Science, University of Osnabrück, Osnabrück, Germany 49069;Neuroinformatics Group Institute of Mathematics and Computer Science Institute of Cognitive Science, University of Osnabrück, Osnabrück, Germany 49069;Neuroinformatics Group Institute of Mathematics and Computer Science Institute of Cognitive Science, University of Osnabrück, Osnabrück, Germany 49069

  • Venue:
  • RoboCup 2008: Robot Soccer World Cup XII
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

While a lot of papers on RoboCup's robotic 2D soccer simulation have focused on the players' offensive behavior, there are only a few papers that specifically address a team's defense strategy. In this paper, we consider a defense scenario of crucial importance: We focus on situations where one of our players must interfere and disturb an opponent ball leading player in order to scotch the opponent team's attack at an early stage and, even better, to eventually conquer the ball initiating a counter attack. We employ a reinforcement learning methodology that enables our players to autonomously acquire such an aggressive duel behavior, and we have embedded it into our soccer simulation team's defensive strategy. Employing the learned NeuroHassle policy in our competition team, we were able to clearly improve the capabilities of our defense and, thus, to increase the performance of our team as a whole.