Neural Networks - Special issue on organisation of computation in brain-like systems
Introduction to Reinforcement Learning
Introduction to Reinforcement Learning
Actor-critic models of the basal ganglia: new anatomical and computational perspectives
Neural Networks - Computational models of neuromodulation
Neuromodulation and Plasticity in an autonomous robot
Neural Networks - Computational models of neuromodulation
Multiple model-based reinforcement learning
Neural Computation
Emergent neural computational architectures based on neuroscience
Applications of the self-organising map to reinforcement learning
Neural Networks - New developments in self-organizing maps
Reinforcement learning models of the dopamine system and their behavioral implications
Reinforcement learning models of the dopamine system and their behavioral implications
Adaptive Behavior - Animals, Animats, Software Agents, Robots, Adaptive Systems
Temporal Difference Model Reproduces Anticipatory Neural Activity
Neural Computation
Reinforcement Learning in Continuous Time and Space
Neural Computation
Cognitive Systems Research
Adaptive Behavior - Animals, Animats, Software Agents, Robots, Adaptive Systems
Integration of an Omnidirectional Visual System with the Control Architecture of Psikharpax
SAB '08 Proceedings of the 10th international conference on Simulation of Adaptive Behavior: From Animals to Animats
Levels and Types of Action Selection: The Action Selection Soup
Adaptive Behavior - Animals, Animats, Software Agents, Robots, Adaptive Systems
Learning Affordances of Consummatory Behaviors: Motivation-Driven Adaptive Perception
Adaptive Behavior - Animals, Animats, Software Agents, Robots, Adaptive Systems
An integrated neuromimetic model of the saccadic eye movements for the psikharpax robot
SAB'10 Proceedings of the 11th international conference on Simulation of adaptive behavior: from animals to animats
Why and how hippocampal transition cells can be used in reinforcement learning
SAB'10 Proceedings of the 11th international conference on Simulation of adaptive behavior: from animals to animats
SAB'06 Proceedings of the 9th international conference on From Animals to Animats: simulation of Adaptive Behavior
Hedonic value: enhancing adaptation for motivated agents
Adaptive Behavior - Animals, Animats, Software Agents, Robots, Adaptive Systems
| Hi-index | 0.00 |
Since 1995, numerous Actor-Critic architectures for reinforcement learning have been proposed as models of dopamine-like reinforcement learning mechanisms in the rat's basal ganglia. However, these models were usually tested in different tasks, and it is then difficult to compare their efficiency for an autonomous animat. We present here the comparison of four architectures in an animat as it per forms the same reward-seeking task. This will illustrate the consequences of different hypotheses about the management of different Actor sub-modules and Critic units, and their more or less autono mously determined coordination. We show that the classical method of coordination of modules by mixture of experts, depending on each module's performance, did not allow solving our task. Then we address the question of which principle should be applied efficiently to combine these units. Improve ments for Critic modeling and accuracy of Actor-Critic models for a natural task are finally discussed in the perspective of our Psikharpax project--an artificial rat having to survive autonomously in unpre dictable environments.