Hebbian iterative method for unsupervised clustering with automatic detection of the number of clusters with discrete recurrent networks

Authors:
Enrique Mérida-Casermeiro;Domingo López-Rodríguez
Affiliations:
Department of Applied Mathematics, University of Málaga, Málaga, Spain;Department of Applied Mathematics, University of Málaga, Málaga, Spain
Venue:
CAEPIA'05 Proceedings of the 11th Spanish association conference on Current Topics in Artificial Intelligence
Year:
2005

Citing 5
Cited 1

Introduction to the theory of neural computation

Introduction to the theory of neural computation
A new family of multivalued networks

Neural Networks
An Associative Multivalued Recurrent Network

IBERAMIA 2002 Proceedings of the 8th Ibero-American Conference on AI: Advances in Artificial Intelligence
A Recurrent Multivalued Neural Network for the N-Queens Problem

IWANN '01 Proceedings of the 6th International Work-Conference on Artificial and Natural Neural Networks: Connectionist Models of Neurons, Learning Processes and Artificial Intelligence-Part I
MREM: An associative autonomous recurrent network

Journal of Intelligent & Fuzzy Systems: Applications in Engineering and Technology - IBERAMIA '02

Robust stability of discrete-time stochastic neural networks with time-varying delays

Neurocomputing

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, two important issues concerning pattern recognition by neural networks are studied: a new model of hebbian learning, as well as the effect of the network capacity when retrieving patterns and performing clustering tasks. Particularly, an explanation of the energy function when the capacity is exceeded: the limitation in pattern storage implies that similar patterns are going to be identified by the network, therefore forming different clusters. This ability can be translated as an unsupervised learning of pattern clusters, with one major advantage over most clustering algorithms: the number of data classes is automatically learned, as confirmed by the experiments. Two methods to reinforce learning are proposed to improve the quality of the clustering, by enhancing the learning of patterns relationships. As a related issue, a study on the net capacity, depending on the number of neurons and possible outputs, is presented, and some interesting conclusions are commented.