Why and how hippocampal transition cells can be used in reinforcement learning

  • Authors:
  • Julien Hirel;Philippe Gaussier;Mathias Quoy;Jean-Paul Banquet

  • Affiliations:
  • ETIS, CNRS, ENSEA, University of Cergy-Pontoise, Cergy-Pontoise, France;ETIS, CNRS, ENSEA, University of Cergy-Pontoise, Cergy-Pontoise, France;ETIS, CNRS, ENSEA, University of Cergy-Pontoise, Cergy-Pontoise, France;ETIS, CNRS, ENSEA, University of Cergy-Pontoise, Cergy-Pontoise, France

  • Venue:
  • SAB'10 Proceedings of the 11th international conference on Simulation of adaptive behavior: from animals to animats
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper we present a model of reinforcement learning (RL) which can be used to solve goal-oriented navigation tasks. Our model supposes that transitions between places are learned in the hippocampus (CA pyramidal cells) and associated with information coming from path-integration. The RL neural network acts as a bias on these transitions to perform action selection. RL originates in the basal ganglia and matches observations of reward-based activity in dopaminergic neurons. Experiments were conducted in a simulated environment. We show that our model using transitions and inspired by Q-learning performs more efficiently than traditional actor-critic models of the basal ganglia based on temporal difference (TD) learning and using static states.