Optimizing Generic Neural Microcircuits through Reward Modulated STDP

Authors:
Prashant Joshi;Jochen Triesch
Affiliations:
Frankfurt Institute for Advanced Studies, Frankfurt, Germany 60438;Frankfurt Institute for Advanced Studies, Frankfurt, Germany 60438
Venue:
ICANN '09 Proceedings of the 19th International Conference on Artificial Neural Networks: Part I
Year:
2009

Citing 7
Cited 0

Real-time computing without stable states: a new framework for neural computation based on perturbations

Neural Computation
On the computational power of circuits of spiking neurons

Journal of Computer and System Sciences
Movement Generation with Circuits of Spiking Neurons

Neural Computation
Editorial: Special issue on echo state networks and liquid state machines

Neural Networks
2007 Special Issue: From memory-based decisions to decision-based movements: A model of interval discrimination followed by action selection

Neural Networks
2007 Special Issue: Fading memory and time series prediction in recurrent networks with different forms of plasticity

Neural Networks
Improving reservoirs using intrinsic plasticity

Neurocomputing

Quantified Score

Hi-index	0.00

Visualization

Abstract

How can we characterize if a given neural circuit is optimal for the class of computational operations that it has to perform on a certain input distribution? We show that modifying the efficacies of recurrent synapses in a generic neural microcircuit via spike timing dependent plasticity (STDP) can optimize the circuit in an unsupervised fashion for a particular input distribution if STDP is modulated by a global reward signal. More precisely, optimizing microcircuits through reward modulated STDP leads to a lower eigen-value spread of the cross-correlation matrix, higher entropy, highly decorrelated neural activity, and tunes the circuit dynamics to a regime that requires a large number of principal components for representing the information contained in the liquid state as compared to randomly drawn microcircuits. Another set of results show that such optimization brings the mean firing rate into a realistic regime, while increasing the sparseness and the information content of the network. We also show that the performance of optimized circuits improves for several linear and non-linear tasks.