Convergence analysis of the Levenberg-Marquardt method

  • Authors:
  • Xin-Long Luo;Li-Zhi Liao;Hon Wah Tam

  • Affiliations:
  • School of Information Engineering, Beijing University of Posts and Telecommunications, P.R. China;Department of Mathematics, Hong Kong Baptist University, Kowloon, Hong Kong;Department of Computer Science, Hong Kong Baptist University, Kowloon, Hong Kong

  • Venue:
  • Optimization Methods & Software
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

The Levenberg-Marquardt method is a popular method for both optimization problems and equilibrium problems in dynamical systems. In this article, we study the convergence properties of the Levenberg-Marquardt method with the standard matrix update scheme. In our global convergence proof, we relax the condition that update matrices be bounded, and only require that their norms increase at most linearly. Furthermore, we analyze its local convergence for the uniformly convex function. In this case, the Levenberg-Marquardt method has superlinear convergence, and the initial matrix can be chosen arbitrarily for the Broyden-Fletcher-Goldfarb-Shanno (BFGS) formula.