Formalizing the Ant Algorithms in Terms of Reinforcement Learning

  • Authors:
  • Ann Nowé;Katja Verbeeck

  • Affiliations:
  • -;-

  • Venue:
  • ECAL '99 Proceedings of the 5th European Conference on Advances in Artificial Life
  • Year:
  • 1999

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper we place ant algorithms in a reinforcement learning framework. We concentrate on the original Ant System and we briefly discuss Ant Colony system. We show that ant-quantity and ant-density can be considered as TD(0) algorithms which only take into account immediate reinforcement. Whereas ant cycle is basically an on-policy Monte Carlo method. We introduce the notion of decay traces, for modeling the decay of trail.