Dynamic stochastic synapses as computational units
Neural Computation
Introduction to Reinforcement Learning
Introduction to Reinforcement Learning
Neural Computation
Reinforcement Learning, Spike-Time-Dependent Plasticity, and the BCM Rule
Neural Computation
Finite Impulse Response (FIR) Filter Model of Synapses: Associated Neural Networks
ICNC '08 Proceedings of the 2008 Fourth International Conference on Natural Computation - Volume 02
On similarity measures for spike trains
ICONIP'08 Proceedings of the 15th international conference on Advances in neuro-information processing - Volume Part I
A Hebbian-based reinforcement learning framework for spike-timing-dependent synapses
ICANN'10 Proceedings of the 20th international conference on Artificial neural networks: Part II
Hi-index | 0.00 |
An integration of both the Hebbian-based and reinforcement learning (RL) rules is presented for dynamic synapses. The proposed framework permits the Hebbian rule to update the hidden synaptic model parameters regulating the synaptic response rather than the synaptic weights. This is performed using both the value and the sign of the temporal difference in the reward signal after each trial. Applying this framework, a spiking network with spike-timing-dependent synapses is tested to learn the exclusive-OR computation on a temporally coded basis. Reward values are calculated with the distance between the output spike train of the network and a reference target one. Results show that the network is able to capture the required dynamics and that the proposed framework can reveal indeed an integrated version of Hebbian and RL. The proposed framework is tractable and less computationally expensive. The framework is applicable to a wide class of synaptic models and is not restricted to the used neural representation. This generality, along with the reported results, supports adopting the introduced approach to benefit from the biologically plausible synaptic models in a wide range of intuitive signal processing.