Mixed states on neural network with structural learning

  • Authors:
  • Tomoyuki Kimoto;Masato Okada

  • Affiliations:
  • Oita National College of Technology, 1666 Maki, Oita-shi 870-0152, Japan;Brain Science Institute, RIKEN, Saitama and Intelligent Cooperation and Control, PRESTO, JST, c/o RIKEN BSI, Saitama and ERATO Kawato Dynamic Brain Project, 2-2 Hikaridai, Seika-cho, Kyoto, Japan

  • Venue:
  • Neural Networks
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

We investigated the properties of mixed states in a sparsely encoded associative memory model with a structural learning method. When mixed states are made of s memory patterns, s types of mixed states, which become equilibrium states of the model, can be generated. To investigate the properties of s types of the mixed states, we analyzed them using the statistical mechanical method. We also found that the storage capacity of the memory pattern and the storage capacity of only a particular mixed state diverge at the sparse limit. We also found that the threshold value needed to recall the memory pattern is nearly equal to the threshold value needed to recall the particular mixed state. This means that the memory pattern and the particular mixed state can be made to easily coexist at the sparse limit. The properties of the model obtained by the analysis are also useful for constructing a transform-invariant recognition model.