Three parallel algorithms for solving nonlinear systems and optimization problems

  • Authors:
  • Jesús Peinado;Antonio M. Vidal

  • Affiliations:
  • Departamento de Sistemas Informáticos y Computación, Universidad Politécnica de Valencia, Valencia, Spain;Departamento de Sistemas Informáticos y Computación, Universidad Politécnica de Valencia, Valencia, Spain

  • Venue:
  • VECPAR'04 Proceedings of the 6th international conference on High Performance Computing for Computational Science
  • Year:
  • 2004

Quantified Score

Hi-index 0.01

Visualization

Abstract

In this work we describe three sequential algorithms and their parallel counterparts for solving nonlinear systems, when the Jacobian matrix is symmetric and positive definite. This case appears frequently in unconstrained optimization problems. Two of the three algorithms are based on Newton's method. The first solves the inner iteration with Cholesky decomposition while the second is based on the inexact Newton methods family, where a preconditioned CG method has been used for solving the linear inner iteration. In this latter case and to control the inner iteration as far as possible and avoid the oversolving problem, we also parallelized several forcing term criteria and used parallel preconditioning techniques. The third algorithm is based on parallelizing the BFGS method. We implemented the parallel algorithms using the SCALAPACK library. Experimental results have been obtained using a cluster of Pentium II PC's connected through a Myrinet network. To test our algorithms we used four different problems. The algorithms show good scalability in most cases.