Original Halley method and its improvement with automatic differentiation
FSKD'09 Proceedings of the 6th international conference on Fuzzy systems and knowledge discovery - Volume 4
On diagonally structured problems in unconstrained optimization using an inexact super Halley method
Journal of Computational and Applied Mathematics
Rate of convergence of higher order methods
Applied Numerical Mathematics
| Hi-index | 0.00 |
Third-order methods will, in most cases, use fewer iterations than a second-order method to reach the same accuracy. However, the number of arithmetic operations per iteration is higher for third-order methods than for a second-order method. Newton's method is the most commonly used second order method and Halley's method is the most well-known third-order method. Newton's method is more used in practical applications than any third-order method. We will show that for a large class of problems, the ratio of the number of arithmetic operations of Halley's method and Newton's method is constant per iteration. It is shown that [image omitted] We show that the zero elements in the Hessian matrix induce zero elements in the tensor (third derivative). The sparsity structure in the Hessian matrix we consider is the skyline or envelope structure. This is a very convenient structure for solving linear systems of equations with a direct method. The class of matrices that have a skyline structure includes banded and dense matrices. Numerical testing confirms that the ratio of the number of arithmetic operations of a third-order method and Newton's method is constant per iteration, and is independent of the number of unknowns.