Fast Function Approximation with Hierarchical Neural Networks and Their Application to a Reinforcement Learning Agent

  • Authors:
  • Joern Fischer;Ralph Breithaupt;Mathias Bode

  • Affiliations:
  • -;-;-

  • Venue:
  • IWANN '01 Proceedings of the 6th International Work-Conference on Artificial and Natural Neural Networks: Connectionist Models of Neurons, Learning Processes and Artificial Intelligence-Part I
  • Year:
  • 2001

Quantified Score

Hi-index 0.00

Visualization

Abstract

Current function approximators especially neural networks are often limited in several directions: most of the architectures can hardly be extended with more "informational" capcity, often neural networks with high capacity are too costly in calculation time (especially for an implementaion on a microcontroller of a real world robot) and funtions with high gradients can hardly be learned. The following approach hierarchical vector quantizing algorithm. With this algorithm the calculation time of a classification can decrease down to O(log(n)), where n is the number of implemented prototypes. If a given number of prototypes can not carry the "information" of the function which has to be approximated, the "informational" capacity can be increased by adding prototypes. Proposed in this article the algorithm is tested in a Reinforcement Learning task.