Efficient computation of spectral bounds for Hessian matrices on hyperrectangles for global optimization

  • Authors:
  • Moritz Schulze Darup;Martin Kastsian;Stefan Mross;Martin Mönnigmann

  • Affiliations:
  • Automatic Control and Systems Theory, Ruhr-Universität Bochum, Bochum, Germany 44801;Automatic Control and Systems Theory, Ruhr-Universität Bochum, Bochum, Germany 44801;Automatic Control and Systems Theory, Ruhr-Universität Bochum, Bochum, Germany 44801;Automatic Control and Systems Theory, Ruhr-Universität Bochum, Bochum, Germany 44801

  • Venue:
  • Journal of Global Optimization
  • Year:
  • 2014

Quantified Score

Hi-index 0.00

Visualization

Abstract

We compare two established and a new method for the calculation of spectral bounds for Hessian matrices on hyperrectangles by applying them to a large collection of 1,522 objective and constraint functions extracted from benchmark global optimization problems. Both the tightness of the spectral bounds and the computational effort of the three methods, which apply to $$C^2$$ C 2 functions $${\varphi }:\mathbb{R }^n\rightarrow \mathbb{R }$$ 驴 : R n 驴 R that can be written as codelists, are assessed. Specifically, we compare eigenvalue bounds obtained with the interval variant of Gershgorin's circle criterion (Adjiman et al. in Comput Chem Eng 22(9):1137---1158, 1998; Gershgorin in Izv. Akad. Nauk SSSR, Ser. fizmat. 6:749---754, 1931), Hertz (IEEE Trans Autom Control 37:532---535, 1992) and Rohn's (SIAM J Matrix Anal Appl 15(1):175---184, 1994) method for tight bounds of interval matrices, and a recently proposed Hessian matrix eigenvalue arithmetic (Mönnigmann in SIAM J. Matrix Anal. Appl. 32(4): 1351---1366, 2011), which deliberately avoids the computation of interval Hessians. The eigenvalue arithmetic provides tighter, as tight, and less tight bounds than the interval variant of Gershgorin's circle criterion in about 15, 61, and 24 % of the examples, respectively. Hertz and Rohn's method results in bounds that are always as tight as or tighter than those from Gershgorin's circle criterion, and as tight as or tighter than those from the eigenvalue arithmetic in 96 % of the cases. In 4 % of the examples, the eigenvalue arithmetic results in tighter bounds than Hertz and Rohn's method. This result is surprising, since Hertz and Rohn's method provides tight bounds for interval matrices. The eigenvalue arithmetic provides tighter bounds in these cases, since it is not based on interval matrices.