Neuromodulation and Plasticity in an autonomous robot

Authors:
Olaf Sporns;William H. Alexander
Affiliations:
Department of Psychology, Indiana University, Bloomington, IN;Department of Psychology, Indiana University, Bloomington, IN
Venue:
Neural Networks - Computational models of neuromodulation
Year:
2002

Citing 6
Cited 14

Operant conditioning in skinnerbots

Adaptive Behavior - Special issue on environment structure and behavior
Computational models of neuromodulation

Neural Computation
Understanding intelligence

Understanding intelligence
Learning and Evolution

Autonomous Robots
TD Models of reward predictive responses in dopamine neurons

Neural Networks - Computational models of neuromodulation
Temporal Difference Model Reproduces Anticipatory Neural Activity

Neural Computation

Timed delivery of reward signals in an autonomous robot

ICSAB Proceedings of the seventh international conference on simulation of adaptive behavior on From animals to animats
Actor-Critic Models of Reinforcement Learning in the Basal Ganglia: From Natural to Artificial Rats

Adaptive Behavior - Animals, Animats, Software Agents, Robots, Adaptive Systems
A Large-scale Neurocomputational Model of Task-oriented Behavior Selection and Working Memory in Prefrontal Cortex

Journal of Cognitive Neuroscience
A robot model of the basal ganglia: Behavior and intrinsic processing

Neural Networks
Assessing Machine Volition: An Ordinal Scale for Rating Artificial and Natural Systems

Adaptive Behavior - Animals, Animats, Software Agents, Robots, Adaptive Systems
Hierarchical Co-evolution of Cooperating Agents Acting in the Brain-Arena

Adaptive Behavior - Animals, Animats, Software Agents, Robots, Adaptive Systems
Design Principles and Constraints Underlying the Construction of Brain-Based Devices

Neural Information Processing
The Neuromodulatory System: A Framework for Survival and Adaptive Behavior in a Challenging World

Adaptive Behavior - Animals, Animats, Software Agents, Robots, Adaptive Systems
Agent-based brain modeling by means of hierarchical cooperative coevolution

Artificial Life
Communicating emotions and mental states to robots in a real time parallel framework using Laban movement analysis

Robotics and Autonomous Systems
A world survey of artificial brain projects, Part I: Large-scale brain simulations

Neurocomputing
From modulated Hebbian plasticity to simple behavior learning through noise and weight saturation

Neural Networks
Anubis: Artificial neuromodulation using a bayesian inference system

Neural Computation
Neuronal assembly dynamics in supervised and unsupervised learning scenarios

Neural Computation

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper we implement a computational model of a neuromodulatory system in an autonomous robot. The output of the neuromodulatory system acts as a value signal, modulating widely distributed synaptic changes. The model is based on anatomical and physiological properties of midbrain diffuse ascending systems, in particular parts of the dopamine and noradrenaline systems. During reward conditioning, the model learns to generate tonic and phasic signals that represent predictions and prediction errors, including precisely timed negative signals if expected rewards are omitted or delayed. We test the robot's learning and behavior in different environmental contexts and observe changes in the development of the neuromodulatory system that depend upon environmental factors. Simulation of a computational model incorporating both reward-related and aversive stimuli leads to the emergence of conditioned reward and aversive behaviors. These studies represent a step towards investigating computational aspects of neuromodulatory systems in autonomous robots.