Delay learning and polychronization for reservoir computing

  • Authors:
  • Hélène Paugam-Moisy;Régis Martinez;Samy Bengio

  • Affiliations:
  • LIRIS, UMR CNRS 5205, Bít. C, Université Lumière Lyon 2, 5 avenue Pierre Mendès France, F-69676 Bron cedex, France;LIRIS, UMR CNRS 5205, Bít. C, Université Lumière Lyon 2, 5 avenue Pierre Mendès France, F-69676 Bron cedex, France;Google, 1600 Amphitheatre Pkwy, B1350-138B, Mountain View, CA 94043, USA

  • Venue:
  • Neurocomputing
  • Year:
  • 2008

Quantified Score

Hi-index 0.02

Visualization

Abstract

We propose a multi-timescale learning rule for spiking neuron networks, in the line of the recently emerging field of reservoir computing. The reservoir is a network model of spiking neurons, with random topology and driven by STDP (spike-time-dependent plasticity), a temporal Hebbian unsupervised learning mode, biologically observed. The model is further driven by a supervised learning algorithm, based on a margin criterion, that affects the synaptic delays linking the network to the readout neurons, with classification as a goal task. The network processing and the resulting performance can be explained by the concept of polychronization, proposed by Izhikevich [Polychronization: computation with spikes, Neural Comput. 18(2) (2006) 245-282], on physiological grounds. The model emphasizes that polychronization can be used as a tool for exploiting the computational power of synaptic delays and for monitoring the topology and activity of a spiking neuron network.