Interpreting dopamine activities in stochastic reward tasks

  • Authors:
  • Akiyo Asahina;Jun-Ichiro Hirayama;Shin Ishii

  • Affiliations:
  • Graduate School of Information Science, Nara Institute of Science and Technology, Ikoma, Nara, Japan and Graduate School of Informatics, Kyoto University, Uji, Kyoto, Japan;Graduate School of Informatics, Kyoto University, Uji, Kyoto, Japan;Graduate School of Information Science, Nara Institute of Science and Technology, Ikoma, Nara, Japan and Graduate School of Informatics, Kyoto University, Uji, Kyoto, Japan

  • Venue:
  • ICONIP'08 Proceedings of the 15th international conference on Advances in neuro-information processing - Volume Part I
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

Phasic activities of dopamine (DA) neurons in the primate midbrain have been considered as representing temporal difference (TD) errors from a computational perspective. Recently, several studies have reported that, in stochastic reward tasks, the DA activities gradually increase before receiving actual rewards, which is not well explained by the simple TD model. In this study, we propose an alternative model based on a probabilistic formulation of the stochastic reward task. In simulation experiments, expectation errors, defined by the probabilistic modeling, well described the gradually increasing DA activities during a wait period even in a single trial.