Reinforcement Learning with the Use of Costly Features

  • Authors:
  • Robby Goetschalckx;Scott Sanner;Kurt Driessens

  • Affiliations:
  • Declarative Languages and Artificial Intelligence, Katholieke Universiteit Leuven, Leuven, Belgium, email: robby@cs.kuleuven.be;National ICT Australia, email: Scott.Sanner@nicta.com.au;Declarative Languages and Artificial Intelligence, Katholieke Universiteit Leuven, Leuven, Belgium, email: kurtd@cs.kuleuven.be

  • Venue:
  • Proceedings of the 2008 conference on ECAI 2008: 18th European Conference on Artificial Intelligence
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

A common solution approach to reinforcement learning problems with large state spaces (where value functions cannot be represented exactly) is to compute an approximation of the value function in terms of state features. However, little attention has been paid to the cost of computing these state features (e.g., search-based features). To this end, we introduce a cost-sensitive sparse linear-value function approximation algorithm ---FOVEA ---and demonstrate its performance on an experimental domain with a range of feature costs.