Optimally integrated adaptive learning

  • Authors:

  • R. D. Dony;S. Haykin

  • Affiliations:

  • Communications Research Laboratory, McMaster University, Hamilton, Ontario, Canada;Communications Research Laboratory, McMaster University, Hamilton, Ontario, Canada

  • Venue:
  • ICASSP'93 Proceedings of the 1993 IEEE international conference on Acoustics, speech, and signal processing: plenary, special, audio, underwater acoustics, VLSI, neural networks - Volume I
  • Year:
  • 1993

Quantified Score

Hi-index 0.00

Visualization

Abstract

A new self-organized learning algorithm is proposed that is well suited for the problem of image compression. The network consists of a number of modules corresponding to different classes of input data. Each module consists of an orthonormal linear transformation whose weights are calculated during an initial training period. As the network is trained, each input signal x is classified according to a competitive learning scheme based on the maximum norm of the signal's projection under the class transformation. The classification is optimal in the sense that it minimizes the square error. The class transformation weights are updated according to a Hebbian learning rule which converges to the optimal KLT for each class. The performance of the resulting adaptive network is shown to be superior to that of the optimal non-adaptive linear transformation.