Mean Field and Capacity in Realistic Networks of Spiking Neurons Storing Sparsely Coded Random Memories

Authors:
Emanuele Curti;Gianluigi Mongillo;Giancarlo La Camera;Daniel J. Amit
Affiliations:
INFM, Dipartimento di Fisica, Universitá di Roma La Sapienza, 00185 Rome, Italy;Dipartimento di Fisiologia Umana, Universitá di Roma La Sapienza, 00185 Rome, Italy;Institute of Physiology, University of Bern, 3012 Bern, Switzerland;INFM, Dipartimento di Fisica, Universit´ di Roma La Sapienza, 00185 Rome, Italy, and Racah Institute of Physics, Hebrew University, Jerusalem, Israe
Venue:
Neural Computation
Year:
2004

Citing 3
Cited 4

Learning in neural networks with material synapses

Neural Computation
Hebbian learning of context in recurrent neural networks

Neural Computation
Spike-driven synaptic dynamics generating working memory states

Neural Computation

Fast and robust learning by reinforcement signals: Explorations in the insect brain

Neural Computation
Semantic priming in a cortical network model

Journal of Cognitive Neuroscience
Determinants of multiple semantic priming: A meta-analysis and spike frequency adaptive model of a cortical network

Journal of Cognitive Neuroscience
Capacity analysis in multi-state synaptic models: a retrieval probability perspective

Journal of Computational Neuroscience

Quantified Score

Hi-index	0.00

Visualization

Abstract

Mean-field (MF) theory is extended to realistic networks of spiking neurons storing in synaptic couplings of randomly chosen stimuli of a given low coding level. The underlying synaptic matrix is the result of a generic, slow, long-term synaptic plasticity of two-state synapses, upon repeated presentation of the fixed set of the stimuli to be stored. The neural populations subtending the MF description are classified by the number of stimuli to which their neurons are responsive (multiplicity). This involves 2p + 1 populations for a network storing p memories. The computational complexity of the MF description is then significantly reduced by observing that at low coding levels (f), only a few populations remain relevant: the population of mean multiplicity – pf and those of multiplicity of order √pf around the mean.The theory is used to produce (predict) bifurcation diagrams (the onset of selective delay activity and the rates in its various stationary states) and to compute the storage capacity of the network (the maximal number of single items used in training for each of which the network can sustain a persistent, selective activity state). This is done in various regions of the space of constitutive parameters for the neurons and for the learning process. The capacity is computed in MF versus potentiation amplitude, ratio of potentiation to depression probability and coding level f. The MF results compare well with recordings of delay activity rate distributions in simulations of the underlying microscopic network of 10,000 neurons.