Using ε-greedy reinforcement learning methods to further understand ventromedial prefrontal patients' deficits on the Iowa Gambling Task

  • Authors:

  • Kiran Kalidindi;Howard Bowman

  • Affiliations:

  • Centre for Cognitive Neuroscience and Cognitive Systems, Computing Laboratory, University of Kent, Canterbury, Kent, CT2 7TR, England, United Kingdom;Centre for Cognitive Neuroscience and Cognitive Systems, Computing Laboratory, University of Kent, Canterbury, Kent, CT2 7TR, England, United Kingdom

  • Venue:
  • Neural Networks
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

An important component of decision making is evaluating the expected result of a choice, using past experience. The way past experience is used to predict future rewards and punishments can have profound effects on decision making. The aim of this study is to further understand the possible role played by the ventromedial prefrontal cortex in decision making, using results from the Iowa Gambling Task (IGT). A number of theories in the literature offer potential explanations for the underlying cause of the deficit(s) found in bilateral ventromedial prefrontal lesion (VMF) patients on the IGT. An error-driven-greedy reinforcement learning method was found to produce a good match to both human normative and VMF patient groups from a number of studies. The model supports the theory that the VMF patients are less strategic (more explorative), which could be due to a working memory deficit, and are more reactive than healthy controls. This last aspect seems consistent with a 'myopia' for future consequences.