Phase transitions in vector quantization and neural gas

Authors:
Aree Witoelar;Michael Biehl
Affiliations:
Mathematics and Computing Science, University of Groningen, P.O. Box 407, NL-9700 AK Groningen, The Netherlands;Mathematics and Computing Science, University of Groningen, P.O. Box 407, NL-9700 AK Groningen, The Netherlands
Venue:
Neurocomputing
Year:
2009

Citing 6
Cited 0

Pattern Recognition with Fuzzy Objective Function Algorithms

Pattern Recognition with Fuzzy Objective Function Algorithms
Self-Organizing Maps

Self-Organizing Maps
Statistical Mechanics of Learning

Statistical Mechanics of Learning
Dynamics and Generalization Ability of LVQ Algorithms

The Journal of Machine Learning Research
Learning dynamics and robustness of vector quantization and neural gas

Neurocomputing
`Neural-gas' network for vector quantization and its application to time-series prediction

IEEE Transactions on Neural Networks

Quantified Score

Hi-index	0.01

Visualization

Abstract

The statistical physics of off-learning is applied to winner-takes-all (WTA) and rank-based vector quantization (VQ), including the neural gas (NG). The analysis is based on the limit of high training temperatures and the annealed approximation. The typical learning behavior is evaluated for systems of two and three prototypes with data drawn from a mixture of high dimensional Gaussian clusters. The learning curves exhibit phase transitions, i.e. a critical or discontinuous dependence of performances on the training set size and training temperature. We show how the nature and properties of the transition depend on the number of prototypes and the control parameter of rank-based cost functions. The NG-based systems are demonstrated to give an advantage over WTA in terms of robustness to initial conditions.