Temporal Hebbian Self-Organizing Map for Sequences

  • Authors:
  • Jan Koutník;Miroslav Šnorek

  • Affiliations:
  • Computational Intelligence Group, Department of Computer Science and Engineering, Faculty of Electrical Engineering, Czech Technical University in Prague,;Computational Intelligence Group, Department of Computer Science and Engineering, Faculty of Electrical Engineering, Czech Technical University in Prague,

  • Venue:
  • ICANN '08 Proceedings of the 18th international conference on Artificial Neural Networks, Part I
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper we present a new self-organizing neural network called Temporal Hebbian Self-organizing Map (THSOM) suitable for modelling of temporal sequences. The network is based on Kohonen's Self-organizing Map, which is extended with a layer of full recurrent connections among the neurons. The layer of recurrent connections is trained with Hebb's rule. The recurrent layer represents temporal order of the input vectors. The THSOM brings a straightforward way of embedding context information in recurrent SOM using neurons with Euclidean metric and scalar product. The recurrent layer can be easily converted into a stochastic automaton (Markov Chain) generating sequences used for previous THSOM training. Finally, two real world examples of THSOM usage are presented. THSOM was applied to extraction of road network from GPS data and to construction of spatio-temporal models of spike train sequences measured in human brain in vivo.