Greville's method for preconditioning least squares problems

  • Authors:
  • Xiaoke Cui;Ken Hayami;Jun-Feng Yin

  • Affiliations:
  • Department of Informatics, School of Multidisciplinary Sciences, The Graduate University for Advanced Studies (Sokendai), Tokyo, Japan 101-8430;Department of Informatics, School of Multidisciplinary Sciences, The Graduate University for Advanced Studies (Sokendai), Tokyo, Japan 101-8430 and National Institute of Informatics, Tokyo, Japan ...;Department of Mathematics, Tongji University, Shanghai, People's Republic of China 200092

  • Venue:
  • Advances in Computational Mathematics
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we propose a preconditioning algorithm for least squares problems $\displaystyle{\min_{x\in{{\mathbb{R}}}^n}}\|b-Ax\|_2$ , where A can be matrices with any shape or rank. The preconditioner is constructed to be a sparse approximation to the Moore---Penrose inverse of the coefficient matrix A. For this preconditioner, we provide theoretical analysis to show that under our assumption, the least squares problem preconditioned by this preconditioner is equivalent to the original problem, and the GMRES method can determine a solution to the preconditioned problem before breakdown happens. In the end of this paper, we also give some numerical examples showing the performance of the method.