Layered Learning in Multiagent Systems: A Winning Approach to Robotic Soccer
Layered Learning in Multiagent Systems: A Winning Approach to Robotic Soccer
Neural Networks: A Comprehensive Foundation
Neural Networks: A Comprehensive Foundation
Strongly Typed Genetic Programming in Evolving Cooperation Strategies
Proceedings of the 6th International Conference on Genetic Algorithms
Methods for Competitive Co-Evolution: Finding Opponents Worth Beating
Proceedings of the 6th International Conference on Genetic Algorithms
Coordinated Reinforcement Learning
ICML '02 Proceedings of the Nineteenth International Conference on Machine Learning
Hierarchical multi-agent reinforcement learning
Autonomous Agents and Multi-Agent Systems
Analysis of an evolutionary reinforcement learning method in a multiagent domain
Proceedings of the 7th international joint conference on Autonomous agents and multiagent systems - Volume 1
A new perspective to the keepaway soccer: the takers
Proceedings of the 7th international joint conference on Autonomous agents and multiagent systems - Volume 3
LearnPNP: a tool for learning agent behaviors
RoboCup 2010
On optimizing interdependent skills: a case study in simulated 3D humanoid robot soccer
The 10th International Conference on Autonomous Agents and Multiagent Systems - Volume 2
Reinforcement learning through global stochastic search in N-MDPs
ECML PKDD'11 Proceedings of the 2011 European conference on Machine learning and knowledge discovery in databases - Volume Part II
On the use of human instruction for improving the behavior of RoboCup soccer agents
Artificial Life and Robotics
UT Austin Villa 2011: a champion agent in the RoboCup 3D soccer simulation competition
Proceedings of the 11th International Conference on Autonomous Agents and Multiagent Systems - Volume 1
Hi-index | 0.00 |
As machine learning is applied to increasingly complex tasks, it is likely that the diverse challenges encountered can only be addressed by combining the strengths of different learning algorithms. We examine this aspect of learning through a case study grounded in the robot soccer context. The task we consider is Keepaway, a popular benchmark for multiagent reinforcement learning from the simulation soccer domain. Whereas previous successful results in Keepaway have limited learning to an isolated, infrequent decision that amounts to a turn-taking behavior (passing), we expand the agents’ learning capability to include a much more ubiquitous action (moving without the ball, or getting open), such that at any given time, multiple agents are executing learned behaviors simultaneously. We introduce a policy search method for learning “GetOpen” to complement the temporal difference learning approach employed for learning “Pass”. Empirical results indicate that the learned GetOpen policy matches the best hand-coded policy for this task, and outperforms the best policy found when Pass is learned. We demonstrate that Pass and GetOpen can be learned simultaneously to realize tightly-coupled soccer team behavior.