Neural systems implicated in delayed and probabilistic reinforcement

Authors:
Rudolf N. Cardinal
Affiliations:
Department of Experimental Psychology, University of Cambridge, Cambridge, United Kingdom and Cambridge University Hospitals NHS Foundation Trust, Addenbrooke's Hospital, Cambridge, United Kingdom
Venue:
Neural Networks - 2006 Special issue: Neurobiology of decision making
Year:
2006

Citing 3
Cited 3

Artificial intelligence: a modern approach

Artificial intelligence: a modern approach
Learning to Predict by the Methods of Temporal Differences

Machine Learning
Long-term reward prediction in TD models of the dopamine system

Neural Computation

White matter integrity predicts delay discounting behavior in 9-to 23-year-olds: A diffusion tensor imaging study

Journal of Cognitive Neuroscience
Internal-time temporal difference model for neural value-based decision making

Neural Computation
Cocaine-induced impulsive choices are accompanied by impaired delay-dependent anticipatory activity in basolateral amygdala

Journal of Cognitive Neuroscience

Quantified Score

Hi-index	0.00

Visualization

Abstract

This review considers the theoretical problems facing agents that must learn and choose on the basis of reward or reinforcement that is uncertain or delayed, in implicit or procedural (stimulus-response) representational systems and in explicit or declarative (action-outcome-value) representational systems. Individual differences in sensitivity to delays and uncertainty may contribute to impulsivity and risk taking. Learning and choice with delayed and uncertain reinforcement are related but in some cases dissociable processes. The contributions to delay and uncertainty discounting of neuromodulators including serotonin, dopamine, and noradrenaline, and of specific neural structures including the nucleus accumbens core, nucleus accumbens shell, orbitofrontal cortex, basolateral amygdala, anterior cingulate cortex, medial prefrontal (prelimbic/infralimbic) cortex, insula, subthalamic nucleus, and hippocampus are examined.