A supervised multi-spike learning algorithm based on gradient descent for spiking neural networks

Authors:
Yan Xu;Xiaoqin Zeng;Lixin Han;Jing Yang
Affiliations:
Institute of Intelligence Science and Technology, Hohai University, Nanjing 210098, PR China;Institute of Intelligence Science and Technology, Hohai University, Nanjing 210098, PR China;Institute of Intelligence Science and Technology, Hohai University, Nanjing 210098, PR China;School of Management, Beijing Normal University, Zhuhai Campus, Zhuhai 519087, PR China
Venue:
Neural Networks
Year:
2013

Citing 12
Cited 0

Neural network fundamentals with graphs, algorithms, and applications

Neural network fundamentals with graphs, algorithms, and applications
Fast sigmoidal networks via spiking neurons

Neural Computation
Learning Beyond Finite Memory in Recurrent Networks of Spiking Neurons

Neural Computation
What Can a Neuron Learn with Spike-Timing-Dependent Plasticity?

Neural Computation
Rate Coding Versus Temporal Order Coding: What the Retinal Ganglion Cells Tell the Visual Cortex

Neural Computation
Optimal spike-timing-dependent plasticity for precise action potential firing in supervised learning

Neural Computation
Reinforcement Learning Through Modulation of Spike-Timing-Dependent Synaptic Plasticity

Neural Computation
Improved spiking neural networks for EEG classification and epilepsy and seizure detection

Integrated Computer-Aided Engineering
A new supervised learning algorithm for multiple spiking neural networks with application in epilepsy and seizure detection

Neural Networks
Supervised learning in spiking neural networks with resume: Sequence learning, classification, and spike shifting

Neural Computation
A gradient descent rule for spiking neurons emitting multiple spikes

Information Processing Letters - Special issue on applications of spiking neural networks
Analysis of the ReSuMe Learning Process For Spiking Neural Networks

International Journal of Applied Mathematics and Computer Science - Special Section: Selected Topics in Biological Cybernetics, Special Editors: Andrzej Kasiński and Filip Ponulak

Quantified Score

Hi-index	0.00

Visualization

Abstract

We use a supervised multi-spike learning algorithm for spiking neural networks (SNNs) with temporal encoding to simulate the learning mechanism of biological neurons in which the SNN output spike trains are encoded by firing times. We first analyze why existing gradient-descent-based learning methods for SNNs have difficulty in achieving multi-spike learning. We then propose a new multi-spike learning method for SNNs based on gradient descent that solves the problems of error function construction and interference among multiple output spikes during learning. The method could be widely applied to single spiking neurons to learn desired output spike trains and to multilayer SNNs to solve classification problems. By overcoming learning interference among multiple spikes, our method has high learning accuracy when there are a relatively large number of output spikes in need of learning. We also develop an output encoding strategy with respect to multiple spikes for classification problems. This effectively improves the classification accuracy of multi-spike learning compared to that of single-spike learning.