Evaluating a reinforcement learning algorithm with a general intelligence test

  • Authors:
  • Javier Insa-Cabrera;David L. Dowe;José Hernández-Orallo

  • Affiliations:
  • DSIC, Universitat Politècnica de València, Spain;Clayton School of Information Technology, Monash University, Australia;DSIC, Universitat Politècnica de València, Spain

  • Venue:
  • CAEPIA'11 Proceedings of the 14th international conference on Advances in artificial intelligence: spanish association for artificial intelligence
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper we apply the recent notion of anytime universal intelligence tests to the evaluation of a popular reinforcement learning algorithm, Q-learning. We show that a general approach to intelligence evaluation of AI algorithms is feasible. This top-down (theory-derived) approach is based on a generation of environments under a Solomonoff universal distribution instead of using a pre-defined set of specific tasks, such as mazes, problem repositories, etc. This first application of a general intelligence test to a reinforcement learning algorithm brings us to the issue of task-specific vs. general AI agents. This, in turn, suggests new avenues for AI agent evaluation and AI competitions, and also conveys some further insights about the performance of specific algorithms.