Dynamics of a Classical Conditioning Model

  • Authors:
  • Christian Balkenius

  • Affiliations:
  • Lund University Cognitive Science, Lund, Sweden. christian.balkenius@fil.lu.se

  • Venue:
  • Autonomous Robots
  • Year:
  • 1999

Quantified Score

Hi-index 0.00

Visualization

Abstract

Classical conditioning is a basic learning mechanism inanimals and can be found in almost all organisms. If we want toconstruct robots with abilities matching those of their biologicalcounterparts, this is one of the learning mechanisms that needs to beimplemented first. This article describes a computational model ofclassical conditioning where the goal of learning is assumed to be theprediction of a temporally discounted reward or punishment based onthe current stimulus situation.The model is well suited for robotic implementation as it models anumber of classical conditioning paradigms and learning in the modelis guaranteed to converge with arbitrarily complex stimulus sequences.This is an essential feature once the step is taken beyond the simplelaboratory experiment with two or three stimuli to the real worldwhere no such limitations exist. It is also demonstrated how the modelcan be included in a more complex system that includes various formsof sensory pre-processing and how it can handle reinforcementlearning, timing of responses and function as an adaptive world model.