Neural Computation
A Theory of the Striatum
Introduction to Reinforcement Learning
Introduction to Reinforcement Learning
Computational Explorations in Cognitive Neuroscience: Understanding the Mind by Simulating the Brain
Computational Explorations in Cognitive Neuroscience: Understanding the Mind by Simulating the Brain
Actor-critic models of the basal ganglia: new anatomical and computational perspectives
Neural Networks - Computational models of neuromodulation
Learning to Predict by the Methods of Temporal Differences
Machine Learning
Learning to Forget: Continual Prediction with LSTM
Neural Computation
Journal of Cognitive Neuroscience
A Computational Model of Information Processing in the Frontal Cortex and Basal Ganglia
Journal of Cognitive Neuroscience
A Computational Model of How the Basal Ganglia Produce Sequences
Journal of Cognitive Neuroscience
A model of corticostriatal plasticity for learning oculomotor associations and sequences
Journal of Cognitive Neuroscience
Journal of Cognitive Neuroscience
Hold your horses: a dynamic computational role for the subthalamic nucleus in decision making
Neural Networks - 2006 Special issue: Neurobiology of decision making
Assessing Machine Volition: An Ordinal Scale for Rating Artificial and Natural Systems
Adaptive Behavior - Animals, Animats, Software Agents, Robots, Adaptive Systems
Endogenous control and task representation: An fmri study in algebraic problem-solving
Journal of Cognitive Neuroscience
Neural Correlates of Anticipation in Cerebellum, Basal Ganglia, and Hippocampus
Anticipatory Behavior in Adaptive Learning Systems
SAL: an explicitly pluralistic cognitive architecture
Journal of Experimental & Theoretical Artificial Intelligence - Pluralism and the Future of Cognitive Science
On the Role of Dopamine in Cognitive Vision
Attention in Cognitive Systems. Theories and Systems from an Interdisciplinary Viewpoint
An oscillatory hebbian network model of short-term memory
Neural Computation
Bringing Consciousness To Cognitive Neuroscience: A Computational Perspective
Journal of Integrated Design & Process Science
2009 Special Issue: Goal-directed control and its antipodes
Neural Networks
A Scientific Perspective on the Hard Problem of Consciousness
Proceedings of the 2008 conference on Artificial General Intelligence 2008: Proceedings of the First AGI Conference
Stable-yet-switchable (SyS) attractor networks
IJCNN'09 Proceedings of the 2009 international joint conference on Neural Networks
A dynamical connectionist model of idea generation
IJCNN'09 Proceedings of the 2009 international joint conference on Neural Networks
Sensor integration in KIV brain model for decision making
IJCNN'09 Proceedings of the 2009 international joint conference on Neural Networks
Cooperation between the hippocampus and the striatum during episodic encoding
Journal of Cognitive Neuroscience
Decision-making in drosophila with two conflicting cues
ISNN'11 Proceedings of the 8th international conference on Advances in neural networks - Volume Part I
Systematically grounding language through vision in a deep, recurrent neural network
AGI'11 Proceedings of the 4th international conference on Artificial general intelligence
From an executive network to executive control: A computational model of the n-back task
Journal of Cognitive Neuroscience
Fragile X syndrome: Neural network models of sequencing and memory
Cognitive Systems Research
Cognitive Systems Research
Pet evidence for a role for striatal dopamine in the attentional blink: Functional implications
Journal of Cognitive Neuroscience
The brain's sequential parallelism: perceptual decision-making and early sensory responses
ICONIP'12 Proceedings of the 19th international conference on Neural Information Processing - Volume Part II
Assembling old tricks for new tasks: A neural model of instructional learning and control
Journal of Cognitive Neuroscience
The parietal cortex in sensemaking: the dissociation of multiple types of spatial information
Computational Intelligence and Neuroscience - Special issue on Neurocognitive Models of Sense Making
Strategic cognitive sequencing: a computational cognitive neuroscience approach
Computational Intelligence and Neuroscience - Special issue on Neurocognitive Models of Sense Making
Hi-index | 0.00 |
The prefrontal cortex has long been thought to subserve both working memory (the holding of information online for processing) and executive functions (deciding how to manipulate working memory and perform processing). Although many computational models of working memory have been developed, the mechanistic basis of executive function remains elusive, often amounting to a homunculus. This article presents an attempt to deconstruct this homunculus through powerful learning mechanisms that allow a computational model of the prefrontal cortex to control both itself and other brain areas in a strategic, task-appropriate manner. These learning mechanisms are based on subcortical structures in the midbrain, basal ganglia, and amygdala, which together form an actor-critic architecture. The critic system learns which prefrontal representations are task relevant and trains the actor, which in turn provides a dynamic gating mechanism for controlling working memory updating. Computationally, the learning mechanism is designed to simultaneously solve the temporal and structural credit assignment problems. The model's performance compares favorably with standard backpropagation-based temporal learning mechanisms on the challenging 1-2-AX working memory task and other benchmark working memory tasks.