Estimating Internal Variables of a Decision Maker's Brain: A Model-Based Approach for Neuroscience

  • Authors:
  • Kazuyuki Samejima;Kenji Doya

  • Affiliations:
  • Brain Science Institute, Tamagawa University, Tokyo, Japan 194-8610;Initial Research Project, Okinawa Institute of Science and Technology, Uruma, Japan 904-2234

  • Venue:
  • Neural Information Processing
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

A major problem in search of neural substrates of learning and decision making is that the process is highly stochastic and subject dependent, making simple stimulus- or output-triggered averaging inadequate. This paper presents a novel approach of characterizing neural recording or brain imaging data in reference to the internal variables of learning models (such as connection weights and parameters of learning) estimated from the history of external variables by Bayesian inference framework. We specifically focus on reinforcement leaning (RL) models of decision making and derive an estimation method for the variables by particle filtering, a recent method of dynamic Bayesian inference. We present the results of its application to decision making experiment in monkeys and humans. The framework is applicable to wide range of behavioral data analysis and diagnosis.