Fast learning for multi-layer perceptrons using statistical techniques

  • Authors:
  • Eric R. Buhrke;Joseph L. LoCicero

  • Affiliations:
  • Illinois Institute of Technology, Department of Electrical and Computer Engineering, Chicago, Illinois;Illinois Institute of Technology, Department of Electrical and Computer Engineering, Chicago, Illinois

  • Venue:
  • ICASSP'92 Proceedings of the 1992 IEEE international conference on Acoustics, speech and signal processing - Volume 1
  • Year:
  • 1992

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper describes a new learning algorithm for the multi-layer perceptron. The learning problem is stated formally as an optimization problem that is solved through a series of systematic approximations. The solution uses the moments of the training data to design the network. This procedure has several advantages, most importantly is the reduction in training time. The algorithm is verified and compared to backpropagation. In a speech recognition experiment the total training time was reduced by more than 75% when compared to backpropagation.