Comparative Analysis of Backpropagation and the Extended Kalman Filter for Training Multilayer Perceptrons

  • Authors:
  • Dennis W. Ruck;Steven K. Rogers;Matthew Kabrisky;Peter S. Maybeck;Mark E. Oxley

  • Affiliations:
  • -;-;-;-;-

  • Venue:
  • IEEE Transactions on Pattern Analysis and Machine Intelligence
  • Year:
  • 1992

Quantified Score

Hi-index 0.14

Visualization

Abstract

The relationship between backpropagation and extended Kalman filtering for training multilayer perceptrons is examined. These two techniques are compared theoretically and empirically using sensor imagery. Backpropagation is a technique from neural networks for assigning weights in a multilayer perceptron. An extended Kalman filter can also be used for this purpose. A brief review of the multilayer perceptron and these two training methods is provided. Then, it is shown that backpropagation is a degenerate form of the extended Kalman filter. The training rules are compared in two examples: an image classification problem using laser radar Doppler imagery and a target detection problem using absolute range images. In both examples, the backpropagation training algorithm is shown to be three orders of magnitude less costly than the extended Kalman filter algorithm in terms of a number of floating-point operations.