Fast orthogonal neural networks

  • Authors:
  • Bartłomiej Stasiak;Mykhaylo Yatsymirskyy

  • Affiliations:
  • Institute of Computer Science, Technical University of Łódź, Łódź, Poland;Institute of Computer Science, Technical University of Łódź, Łódź, Poland

  • Venue:
  • ICAISC'06 Proceedings of the 8th international conference on Artificial Intelligence and Soft Computing
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

The paper presents a novel approach to the construction and learning of linear neural networks based on fast orthogonal transforms. The orthogonality of basic operations associated with the algorithm of a given transform is used in order to substantially reduce the number of adapted weights of the network. Two new types of neurons corresponding to orthogonal basic operations are introduced and formulas for architecture-independent error backpropagation and weights adaptation are presented.