MLP in layer-wise form with applications to weight decay

  • Authors:
  • Tommi Kärkkäinen

  • Affiliations:
  • Department of Mathematical Information Technology, University of Jyväskylä, P.O.Box 35 (Agora), FIN-40351 Jyväskylä, Finland

  • Venue:
  • Neural Computation
  • Year:
  • 2002

Quantified Score

Hi-index 0.00

Visualization

Abstract

A simple and general calculus for the sensitivity analysis of a feedforward MLP network in a layer-wise form is presented. Based on the local optimality conditions, some consequences for the least-means-squares learning problem are stated and further discussed. Numerical experiments with formulation and comparison of different weight decay techniques are included.