Real-time heuristic search with a priority queue

  • Authors:

  • D. Chris Rayner;Katherine Davison;Vadim Bulitko;Kenneth Anderson;Jieshan Lu

  • Affiliations:

  • University of Alberta, Department of Computing Science, Edmonton, Alberta, Canada;University of Alberta, Department of Computing Science, Edmonton, Alberta, Canada;University of Alberta, Department of Computing Science, Edmonton, Alberta, Canada;University of Alberta, Department of Computing Science, Edmonton, Alberta, Canada;University of Alberta, Department of Computing Science, Edmonton, Alberta, Canada

  • Venue:
  • IJCAI'07 Proceedings of the 20th international joint conference on Artifical intelligence
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

Learning real-time search, which interleaves planning and acting, allows agents to learn from multiple trials and respond quickly. Such algorithms require no prior knowledge of the environment and can be deployed without pre-processing. We introduce Prioritized-LRTA* (P-LRTA*), a learning real-time search algorithm based on Prioritized Sweeping. P-LRTA* focuses learning on important areas of the search space, where the importance of a state is determined by the magnitude of the updates made to neighboring states. Empirical tests on path-planning in commercial game maps show a substantial learning speed-up over state-of-the-art real-time search algorithms.