Comparing humans and AI agents

  • Authors:
  • Javier Insa-Cabrera;David L. Dowe;Sergio España-Cubillo;M. Victoria Hernández-Lloreda;José Hernández-Orallo

  • Affiliations:
  • DSIC, Universitat Politècnica de València, Spain;Clayton School of Information Technology, Monash University, Australia;ProS Research Center, Universitat Politècnica de València, Spain;Departamento de Metodología de las Ciencias del Comportamiento, Universidad Complutense de Madrid, Spain;DSIC, Universitat Politècnica de València, Spain

  • Venue:
  • AGI'11 Proceedings of the 4th international conference on Artificial general intelligence
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

Comparing humans and machines is one important source of information about both machine and human strengths and limitations. Most of these comparisons and competitions are performed in rather specific tasks such as calculus, speech recognition, translation, games, etc. The information conveyed by these experiments is limited, since it portrays that machines are much better than humans at some domains and worse at others. In fact, CAPTCHAs exploit this fact. However, there have only been a few proposals of general intelligence tests in the last two decades, and, to our knowledge, just a couple of implementations and evaluations. In this paper, we implement one of the most recent test proposals, devise an interface for humans and use it to compare the intelligence of humans and Q-learning, a popular reinforcement learning algorithm. The results are highly informative in many ways, raising many questions on the use of a (universal) distribution of environments, on the role of measuring knowledge acquisition, and other issues, such as speed, duration of the test, scalability, etc.