Teaching and leading an ad hoc teammate: Collaboration without pre-coordination

Authors:
Peter Stone;Gal A. Kaminka;Sarit Kraus;Jeffrey S. Rosenschein;Noa Agmon
Affiliations:
The University of Texas at Austin, Department of Computer Science, Austin, TX 78712, United States;Bar Ilan University, Israel;Bar Ilan University, Israel and The University of Maryland, United States;Hebrew University, Israel;The University of Texas at Austin, Department of Computer Science, Austin, TX 78712, United States and Bar Ilan University, Israel
Venue:
Artificial Intelligence
Year:
2013

Citing 38
Cited 1

ALVINN: an autonomous land vehicle in a neural network

Advances in neural information processing systems 1
Self-improving reactive agents: case studies of reinforcement learning frameworks

Proceedings of the first international conference on simulation of adaptive behavior on From animals to animats
Self-Improving Reactive Agents Based on Reinforcement Learning, Planning and Teaching

Machine Learning
Collaborative plans for complex group action

Artificial Intelligence
Locally Weighted Learning for Control

Artificial Intelligence Review - Special issue on lazy learning
The dynamics of reinforcement learning in cooperative multiagent systems

AAAI '98/IAAI '98 Proceedings of the fifteenth national/tenth conference on Artificial intelligence/Innovative applications of artificial intelligence
Task decomposition, dynamic role assignment, and low-bandwidth communication for real-time strategic teamwork

Artificial Intelligence - Special issue on Robocop: the first step
Introduction to Reinforcement Learning

Introduction to Reinforcement Learning
Multiagent Systems: A Survey from a Machine Learning Perspective

Autonomous Robots
Techniques for Plan Recognition

User Modeling and User-Adapted Interaction
Rational Coordination in Multi-Agent Environments

Autonomous Agents and Multi-Agent Systems
Distributed Intelligent Agents

IEEE Expert: Intelligent Systems and Their Applications
Sparse on-line Gaussian processes

Neural Computation
Electric Elves: Applying Agent Technology to Support Human Organizations

Proceedings of the Thirteenth Conference on Innovative Applications of Artificial Intelligence Conference
Friend-or-Foe Q-learning in General-Sum Games

ICML '01 Proceedings of the Eighteenth International Conference on Machine Learning
Distributed Value Functions

ICML '99 Proceedings of the Sixteenth International Conference on Machine Learning
A collaborative planning model of intentional structure

Computational Linguistics
An algorithm for plan recognition in collaborative discourse

ACL '91 Proceedings of the 29th annual meeting on Association for Computational Linguistics
Agents for Establishing Ad hoc Cross-Organizational Teams

IAT '04 Proceedings of the IEEE/WIC/ACM International Conference on Intelligent Agent Technology
Cooperative Multi-Agent Learning: The State of the Art

Autonomous Agents and Multi-Agent Systems
The possible and the impossible in multi-agent learning

Artificial Intelligence
Online Multiagent Learning against Memory Bounded Adversaries

ECML PKDD '08 Proceedings of the 2008 European Conference on Machine Learning and Knowledge Discovery in Databases - Part I
Essentials of Game Theory: A Concise, Multidisciplinary Introduction

Essentials of Game Theory: A Concise, Multidisciplinary Introduction
Toward identifying process models in ad hoc and distributed teams

HuCom '08 Proceedings of the 1st International Working Conference on Human Factors and Computational Models in Negotiation
Coordination and adaptation in impromptu teams

AAAI'05 Proceedings of the 20th national conference on Artificial intelligence - Volume 1
On partially controlled multi-agent systems

Journal of Artificial Intelligence Research
Towards flexible teamwork

Journal of Artificial Intelligence Research
Adaptive load balancing: a study in multi-agent learning

Journal of Artificial Intelligence Research
Learning against opponents with bounded memory

IJCAI'05 Proceedings of the 19th international joint conference on Artificial intelligence
A general approach to environment design with one agent

IJCAI'09 Proceedings of the 21st international jont conference on Artifical intelligence
Models of Cooperative Teaching and Learning

The Journal of Machine Learning Research
Empirical evaluation of ad hoc teamwork in the pursuit domain

The 10th International Conference on Autonomous Agents and Multiagent Systems - Volume 2
Learning to cooperate via policy search

UAI'00 Proceedings of the Sixteenth conference on Uncertainty in artificial intelligence
Computational Aspects of Cooperative Game Theory (Synthesis Lectures on Artificial Inetlligence and Machine Learning)

Computational Aspects of Cooperative Game Theory (Synthesis Lectures on Artificial Inetlligence and Machine Learning)
Online planning for ad hoc autonomous agent teams

IJCAI'11 Proceedings of the Twenty-Second international joint conference on Artificial Intelligence - Volume Volume One
Leading ad hoc agents in joint action settings with multiple teammates

Proceedings of the 11th International Conference on Autonomous Agents and Multiagent Systems - Volume 1
Modeling and learning synergy for team formation with heterogeneous agents

Proceedings of the 11th International Conference on Autonomous Agents and Multiagent Systems - Volume 1
Ad hoc teamwork for leading a flock

Proceedings of the 2013 international conference on Autonomous agents and multi-agent systems

Learning collaborative team behavior from observation

Expert Systems with Applications: An International Journal

Quantified Score

Hi-index	0.00

Visualization

Abstract

As autonomous agents proliferate in the real world, both in software and robotic settings, they will increasingly need to band together for cooperative activities with previously unfamiliar teammates. In such ad hoc team settings, team strategies cannot be developed a priori. Rather, an agent must be prepared to cooperate with many types of teammates: it must collaborate without pre-coordination. This article defines two aspects of collaboration in two-player teams, involving either simultaneous or sequential decision making. In both cases, the ad hoc agent is more knowledgeable of the environment, and attempts to influence the behavior of its teammate such that they will attain the optimal possible joint utility.