Flexible architecture of self organizing maps for changing environments

  • Authors:
  • Rodrigo Salas;Héctor Allende;Sebastián Moreno;Carolina Saavedra

  • Affiliations:
  • Departamento de Computación, Universidad de Valparaíso, Valparaíso, Chile;Dept. de Informática, Universidad Técnica Federico Santa María, Valparaíso, Chile;Dept. de Informática, Universidad Técnica Federico Santa María, Valparaíso, Chile;Dept. de Informática, Universidad Técnica Federico Santa María, Valparaíso, Chile

  • Venue:
  • CIARP'05 Proceedings of the 10th Iberoamerican Congress conference on Progress in Pattern Recognition, Image Analysis and Applications
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

Catastrophic Interference is a well known problem of Artificial Neural Networks (ANN) learning algorithms where the ANN forget useful knowledge while learning from new data. Furthermore the structure of most neural models must be chosen in advance. In this paper we introduce a hybrid algorithm called Flexible Architecture of Self Organizing Maps (FASOM) that overcomes the Catastrophic Interference and preserves the topology of Clustered data in changing environments. The model consists in K receptive fields of self organizing maps. Each Receptive Field projects high-dimensional data of the input space onto a neuron position in a low-dimensional output space grid by dynamically adapting its structure to a specific region of the input space. Furthermore the FASOM model automatically finds the number of maps and prototypes needed to successfully adapt to the data. The model has the capability of both growing its structure when novel clusters appears and gradually forgets when the data volume is reduced in its receptive fields. Finally we show the capabilities of our model with experimental results using synthetic sequential data sets and real world data.