Efficient architectures for sparsely-connected high capacity associative memory models

  • Authors:
  • Lee Calcraft;Rod Adams;Neil Davey

  • Affiliations:
  • School of Computer Science, University of Hertfordshire, United Kingdom;School of Computer Science, University of Hertfordshire, United Kingdom;School of Computer Science, University of Hertfordshire, United Kingdom

  • Venue:
  • Connection Science
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

In physical implementations of associative memory, wiring costs play a significant role in shaping patterns of connectivity. In this study of sparsely-connected associative memory, a range of architectures is explored in search of optimal connection strategies that maximize pattern-completion performance, while at the same time minimizing wiring costs. It is found that architectures in which the probability of connection between any two nodes is based on relatively tight Gaussian and exponential distributions perform well and that for optimum performance, the width of the Gaussian distribution should be made proportional to the number of connections per node. It is also established from a study of other connection strategies that distal connections are not necessary for good pattern-completion performance. Convergence times and network scalability are also addressed in this study.