Be Busy and Unique ... or Be History - The Utility Criterion for Removing Units in Self-Organizing Networks

  • Authors:
  • Bernd Fritzke

  • Affiliations:
  • -

  • Venue:
  • KI '99 Proceedings of the 23rd Annual German Conference on Artificial Intelligence: Advances in Artificial Intelligence
  • Year:
  • 1999

Quantified Score

Hi-index 0.00

Visualization

Abstract

A novel on-line criterion for identifying "useless" neurons of a self-organizing network is proposed and analyzed. The criterion is based on a utility measure. When it is used in the context of the growing neural gas model to guide deletions of units, the resulting method is able to closely track non-stationary distributions. Slow changes of the distribution are handled by adaptation of existing units. Rapid changes are handled by removal of "useless" neurons and subsequent insertions of new units in other places. Additionally, the utility measure can be used to prune existing networks to a specified size with near-minimal increase of quantization error.