Liquid computing in a simplified model of cortical layer IV: learning to balance a ball

Authors:
Dimitri Probst;Wolfgang Maass;Henry Markram;Marc-Oliver Gewaltig
Affiliations:
Blue Brain Project, École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland,Ruprecht-Karls Universität Heidelberg, Heidelberg, Germany;Institute for Theoretical Computer Science, Technische Universität Graz, Graz, Austria;Blue Brain Project, École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland;Blue Brain Project, École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland
Venue:
ICANN'12 Proceedings of the 22nd international conference on Artificial Neural Networks and Machine Learning - Volume Part I
Year:
2012

Citing 2
Cited 0

Real-time computing without stable states: a new framework for neural computation based on perturbations

Neural Computation
Movement Generation with Circuits of Spiking Neurons

Neural Computation

Quantified Score

Hi-index	0.00

Visualization

Abstract

We present a biologically inspired recurrent network of spiking neurons and a learning rule that enables the network to balance a ball on a flat circular arena and to steer it towards a target field, by controlling the inclination angles of the arena. The neural controller is a recurrent network of adaptive exponential integrate and fire neurons configured and connected to match properties of cortical layer IV. The network is used as a liquid state machine with four action cells as readout neurons. The solution of the task requires the controller to take its own reaction time into account by anticipating the future state of the controlled system. We demonstrate that the cortical network can robustly learn this task using a supervised learning rule that penalizes the error on the force applied to the arena.