Information capacity of the Hopfield model

Authors:
Y. Abu-Mostafa;J. St. Jacques
Affiliations:
-;-
Venue:
IEEE Transactions on Information Theory
Year:
2006

Citing 0
Cited 4

Original Contribution: Bounds on the number of hidden units of boltzmann machines

Neural Networks
Periodic solutions for a class of higher-order Cohen-Grossberg type neural networks with delays

Computers & Mathematics with Applications
Letters: Upper bound on pattern storage in feedforward networks

Neurocomputing
Impulsive effects on stability of high-order BAM neural networks with time delays

Neurocomputing

Quantified Score

Hi-index	754.84

Visualization

Abstract

The information capacity of general forms of memory is formalized. The number of bits of information that can be stored in the Hopfield model of associative memory is estimated. It is found that the asymptotic information capacity of a Hopfield network ofNneurons is of the orderN^{3}b. The number of arbitrary state vectors that can be made stable in a Hopfield network ofNneurons is proved to be bounded above byN.