Online planning for ad hoc autonomous agent teams

  • Authors:
  • Feng Wu;Shlomo Zilberstein;Xiaoping Chen

  • Affiliations:
  • School of Computer Science, Univ. of Sci. & Tech. of China, Hefei, Anhui, China;Dept. of Computer Science, Univ. of Massachusetts, Amherst, MA;School of Computer Science, Univ. of Sci. & Tech. of China, Hefei, Anhui, China

  • Venue:
  • IJCAI'11 Proceedings of the Twenty-Second international joint conference on Artificial Intelligence - Volume Volume One
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

We propose a novel online planning algorithm for ad hoc team settings--challenging situations in which an agent must collaborate with unknown teammates without prior coordination. Our approach is based on constructing and solving a series of stage games, and then using biased adaptive play to choose actions. The utility function in each stage game is estimated via Monte-Carlo tree search using the UCT algorithm. We establish analytically the convergence of the algorithm and show that it performs well in a variety of ad hoc team domains.