Analyzing feature generation for value-function approximation

  • Authors:
  • Ronald Parr;Christopher Painter-Wakefield;Lihong Li;Michael Littman

  • Affiliations:
  • Duke University, Durham, NC;Duke University, Durham, NC;Rutgers University, Piscataway, NJ;Rutgers University, Piscataway, NJ

  • Venue:
  • Proceedings of the 24th international conference on Machine learning
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

We analyze a simple, Bellman-error-based approach to generating basis functions for value-function approximation. We show that it generates orthogonal basis functions that provably tighten approximation error bounds. We also illustrate the use of this approach in the presence of noise on some sample problems.