Evolving Soccer Keepaway Players Through Task Decomposition

Authors:
Shimon Whiteson;Nate Kohl;Risto Miikkulainen;Peter Stone
Affiliations:
Department of Computer Sciences, The University of Texas at Austin, Austin 78712-1188;Department of Computer Sciences, The University of Texas at Austin, Austin 78712-1188;Department of Computer Sciences, The University of Texas at Austin, Austin 78712-1188;Department of Computer Sciences, The University of Texas at Austin, Austin 78712-1188
Venue:
Machine Learning
Year:
2005

Citing 27
Cited 21

Reinforcement learning for robots using neural networks

Reinforcement learning for robots using neural networks
Efficient reinforcement learning through symbiotic evolution

Machine Learning - Special issue on reinforcement learning
Incremental evolution of complex general behavior

Adaptive Behavior - Special issue on environment structure and behavior
Challenges in coevolutionary learning: arms-race dynamics, open-endedness, and medicocre stable states

ALIFE Proceedings of the sixth international conference on Artificial life
Three-layer architectures

Artificial intelligence and mobile robots
An architecture for action selection in robotic soccer

Proceedings of the fifth international conference on Autonomous agents
Layered Learning in Multiagent Systems: A Winning Approach to Robotic Soccer

Layered Learning in Multiagent Systems: A Winning Approach to Robotic Soccer
Many-layered learning

Neural Computation
Scaling Reinforcement Learning toward RoboCup Soccer

ICML '01 Proceedings of the Eighteenth International Conference on Machine Learning
The MAXQ Method for Hierarchical Reinforcement Learning

ICML '98 Proceedings of the Fifteenth International Conference on Machine Learning
Methods for Competitive Co-Evolution: Finding Opponents Worth Beating

Proceedings of the 6th International Conference on Genetic Algorithms
Feudal Reinforcement Learning

Advances in Neural Information Processing Systems 5, [NIPS Conference]
Learning In RoboCup Keepaway Using Evolutionary Algorithms

GECCO '02 Proceedings of the Genetic and Evolutionary Computation Conference
Genetic Programming And Multi-agent Layered Learning By Reinforcements

GECCO '02 Proceedings of the Genetic and Evolutionary Computation Conference
Solving Non-Markovian Control Tasks with Neuro-Evolution

IJCAI '99 Proceedings of the Sixteenth International Joint Conference on Artificial Intelligence
Evolving Beharioral Strategies in Predators and Prey

IJCAI '95 Proceedings of the Workshop on Adaption and Learning in Multi-Agent Systems
Keepaway Soccer: A Machine Learning Testbed

RoboCup 2001: Robot Soccer World Cup V
Learning to Race: Experiments with a Simulated Race Car

Proceedings of the Eleventh International Florida Artificial Intelligence Research Society Conference
Bootstrap learning for place recognition

Eighteenth national conference on Artificial intelligence
Concurrent layered learning

AAMAS '03 Proceedings of the second international joint conference on Autonomous agents and multiagent systems
COOPERATIVE COEVOLUTION OF MULTI-AGENT SYSTEMS

COOPERATIVE COEVOLUTION OF MULTI-AGENT SYSTEMS
Robust non-linear control through neuroevolution

Robust non-linear control through neuroevolution
Cooperative Coevolution: An Architecture for Evolving Coadapted Subcomponents

Evolutionary Computation
A comparison between cellular encoding and direct encoding for genetic neural networks

GECCO '96 Proceedings of the 1st annual conference on Genetic and evolutionary computation
Competitive coevolution through evolutionary complexification

Journal of Artificial Intelligence Research
Reinforcement learning: a survey

Journal of Artificial Intelligence Research
Active guidance for a finless rocket using neuroevolution

GECCO'03 Proceedings of the 2003 international conference on Genetic and evolutionary computation: PartII

Learning basic navigation for personal satellite assistant using neuroevolution

GECCO '05 Proceedings of the 7th annual conference on Genetic and evolutionary computation
Comparing evolutionary and temporal difference methods in a reinforcement learning domain

Proceedings of the 8th annual conference on Genetic and evolutionary computation
Evolving neural networks

Proceedings of the 9th annual conference companion on Genetic and evolutionary computation
Empirical Studies in Action Selection with Reinforcement Learning

Adaptive Behavior - Animals, Animats, Software Agents, Robots, Adaptive Systems
Evolving a Neural Model of Insect Path Integration

Adaptive Behavior - Animals, Animats, Software Agents, Robots, Adaptive Systems
Evolving neural networks

Proceedings of the 10th annual conference companion on Genetic and evolutionary computation
A new perspective to the keepaway soccer: the takers

Proceedings of the 7th international joint conference on Autonomous agents and multiagent systems - Volume 3
The Chin Pinch: A Case Study in Skill Learning on a Legged Robot

RoboCup 2006: Robot Soccer World Cup X
2009 Special Issue: Evolving neural networks for strategic decision-making problems

Neural Networks
Neuroevolutionary reinforcement learning for generalized helicopter control

Proceedings of the 11th Annual conference on Genetic and evolutionary computation
Evolving neural networks

Proceedings of the 11th Annual Conference Companion on Genetic and Evolutionary Computation Conference: Late Breaking Papers
Temporal difference and policy search methods for reinforcement learning: an empirical comparison

AAAI'07 Proceedings of the 22nd national conference on Artificial intelligence - Volume 2
Critical factors in the empirical performance of temporal difference and evolutionary methods for reinforcement learning

Autonomous Agents and Multi-Agent Systems
Evolving neural networks

Proceedings of the 12th annual conference companion on Genetic and evolutionary computation
Evolving Static Representations for Task Transfer

The Journal of Machine Learning Research
Evolving neural networks

Proceedings of the 13th annual conference companion on Genetic and evolutionary computation
Reinforcement learning through global stochastic search in N-MDPs

ECML PKDD'11 Proceedings of the 2011 European conference on Machine learning and knowledge discovery in databases - Volume Part II
Perceptually grounded self-diagnosis and self-repair of domain knowledge

Knowledge-Based Systems
Keepaway soccer: from machine learning testbed to benchmark

RoboCup 2005
Open-ended behavioral complexity for evolved virtual creatures

Proceedings of the 15th annual conference on Genetic and evolutionary computation
Evolving neural networks

Proceedings of the 15th annual conference companion on Genetic and evolutionary computation

Quantified Score

Hi-index	0.00

Visualization

Abstract

We formulate an automatic strategy acquisition problem for the multi-agent card game "Hearts" as a reinforcement learning problem. The problem can approximately be dealt with in the framework of a partially observable Markov decision process (POMDP) ...