Backpropagation with homotopy

  • Authors:
  • Liping Yang;Wanzhen Yu

  • Affiliations:
  • Department of Applied Mathematics, Tsinghua University, 100084, Beijing, China;Department of Applied Mathematics, Tsinghua University, 100084, Beijing, China

  • Venue:
  • Neural Computation
  • Year:
  • 1993

Quantified Score

Hi-index 0.00

Visualization

Abstract

When training a feedforward neural network with backpropagation (Rumelhart et al. 1986), local minima are always a problem because of the nonlinearity of the system. There have been several ways to attack this problem: for example, to restart the training by selecting a new initial point, to perform the preprocessing of the input data or the neural network. Here, we propose a method which is efficient in computation to avoid some local minima.