Goal-based action selection and utility-based action bias

  • Authors:

  • Kenji Matsumoto;Madoka Matsumoto;Hiroshi Abe

  • Affiliations:

  • Cognitive Brain Mapping Laboratory, RIKEN Brain Science Institute, Wako, Saitama, Japan;Cognitive Brain Mapping Laboratory, RIKEN Brain Science Institute, Wako, Saitama, Japan and Department of Behavioral and Brain Sciences, Primate Research Institute, Kyoto University, Kanrin, Inuya ...;Cognitive Brain Mapping Laboratory, RIKEN Brain Science Institute, Wako, Saitama, Japan and Graduate School of Decision Science and Technology, Tokyo Institute of Technology, Tokyo, Japan

  • Venue:
  • Neural Networks - 2006 Special issue: Neurobiology of decision making
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

According to artificial intelligence studies, goal-based and utility-based agents can select an action to attain a desired outcome. The goal-based agent sets a specific goal regardless of its utility at first, and selects the action that leads to that goal (goal-based action selection). The utility-based agent compares the utilities of different possible outcomes, and selects the action that causes the outcome with the highest utility (utility-based action bias). The medial prefrontal cortex is involved in implementing the goal-based action selection and the striatum is involved in implementing the utility-based action bias. Goal-based action selection may be temporarily dominant over the utility-based action bias in a new environment, whereas the utility-based action bias becomes dominant after acquisition of action utilities in the environment. This transition of dominance between the two decision systems may be enhanced by a reference-point shift based on the goal-setting process during goal-based action selection.