The grand challenge of computer Go: Monte Carlo tree search and extensions

  • Authors:
  • Sylvain Gelly;Levente Kocsis;Marc Schoenauer;Michèle Sebag;David Silver;Csaba Szepesvári;Olivier Teytaud

  • Affiliations:
  • EPC TAO, INRIA Saclay & LRI, Orsay, France;MTA SZTAKI, Budapest, Hungary;EPC TAO, INRIA Saclay & LRI, Orsay, France;EPC TAO, INRIA Saclay & LRI, Orsay, France;University College London, London, U.K.;University of Alberta, Edmonton, Canada;EPC TAO, INRIA Saclay & LRI, Orsay, France

  • Venue:
  • Communications of the ACM
  • Year:
  • 2012

Quantified Score

Hi-index 48.22

Visualization

Abstract

The ancient oriental game of Go has long been considered a grand challenge for artificial intelligence. For decades, computer Go has defied the classical methods in game tree search that worked so successfully for chess and checkers. However, recent play in computer Go has been transformed by a new paradigm for tree search based on Monte-Carlo methods. Programs based on Monte-Carlo tree search now play at human-master levels and are beginning to challenge top professional players. In this paper, we describe the leading algorithms for Monte-Carlo tree search and explain how they have advanced the state of the art in computer Go.