Learning to Drive a Real Car in 20 Minutes

  • Authors:
  • Martin Riedmiller;Mike Montemerlo;Hendrik Dahlkamp

  • Affiliations:
  • -;-;-

  • Venue:
  • FBIT '07 Proceedings of the 2007 Frontiers in the Convergence of Bioscience and Information Technologies
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

The paper describes our first experiments on Reinforcement Learning to steer a real robot car. The applied method, Neural Fitted Q Iteration (NFQ) is purely data-driven based on data directly collected from real-life experiments, i.e. no transition model and no simulation is used. The RL approach is based on learning a neural Q value function, which means that no prior selection of the structure of the control law is required. We demonstrate, that the controller is able to learn a steering task in less than 20 minutes directly on the real car. We consider this as an important step towards the competitive application of neural Q function based RL methods in real-life environments.