Preconditioning techniques for large linear systems: a survey

Authors:
Michele Benzi
Affiliations:
Mathematics and Computer Science Department, Emory University, Atlanta, Georgia
Venue:
Journal of Computational Physics
Year:
2002

Citing 124
Cited 72

GMRES: a generalized minimal residual algorithm for solving nonsymmetric linear systems

SIAM Journal on Scientific and Statistical Computing
Direct methods for sparse matrices

Direct methods for sparse matrices
A stability analysis of incomplete LU factorizations

Mathematics of Computation
Multicolor ICCG methods for vector computers

SIAM Journal on Numerical Analysis
Sparsity structure and Gaussian elimination

ACM SIGNUM Newsletter
Preconditioning techniques for nonsymmetric and indefinite linear systems

Journal of Computational and Applied Mathematics - Special issue on iterative methods for the solution of linear systems
On the robustness of Ilu smoothing

SIAM Journal on Scientific and Statistical Computing
The evolution of the minimum degree ordering algorithm

SIAM Review
Some history of the conjugate gradient and lanczos methods

SIAM Review
Krylov subspace methods on supercomputers

SIAM Journal on Scientific and Statistical Computing
A block ordering method for sparse matrices

SIAM Journal on Scientific and Statistical Computing
Adaptive polynomial preconditioning for hermitian indefinite linear systems

BIT
The effect of ordering on preconditioned conjugate gradients

BIT
A history of scientific computing

A history of scientific computing
A new modified Cholesky factorization

SIAM Journal on Scientific and Statistical Computing
Algebraic multilevel preconditioning methods, II

SIAM Journal on Numerical Analysis
Limits on parallelism in the numerical solution of linear partial differential equations

SIAM Journal on Scientific and Statistical Computing
The convergence behaviour of preconditioned CG and CG-S in the presence of rounding errors

Proceedings of a conference on Preconditioned conjugate gradient methods
On parallelism and convergence of incomplete LU factorizations

Applied Numerical Mathematics - Selected papers CWI-IMACS Symposia on Parallel Scientific Computing, Amsterdam, Netherlands
Predicting the behavior of finite precision Lanczos and conjugate gradient computations

SIAM Journal on Matrix Analysis and Applications
BI-CGSTAB: a fast and smoothly converging variant of BI-CG for the solution of nonsymmetric linear systems

SIAM Journal on Scientific and Statistical Computing
A review on the inverse of symmetric tridiagonal and block tridiagonal matrices

SIAM Journal on Matrix Analysis and Applications
Ordering methods for preconditioned conjugate gradient methods applied to unstructured grid problems

SIAM Journal on Matrix Analysis and Applications
Parallel ocean general circulation modeling

Proceedings of the eleventh annual international conference of the Center for Nonlinear Studies on Experimental mathematics : computational issues in nonlinear science: computational issues in nonlinear science
Factorized sparse approximate inverse preconditionings I: theory

SIAM Journal on Matrix Analysis and Applications
On finding supernodes for sparse matrix computations

SIAM Journal on Matrix Analysis and Applications
A flexible inner-outer preconditioned GMRES algorithm

SIAM Journal on Scientific Computing
A transpose-free quasi-minimal residual algorithm for non-Hermitian linear systems

SIAM Journal on Scientific Computing
Ordering effects on relaxation methods applied to the discrete one-dimensional convection-diffusion equation

SIAM Journal on Numerical Analysis
Scalable iterative solution of sparse linear systems

Parallel Computing
Predicting Structure in Sparse Matrix Computations

SIAM Journal on Matrix Analysis and Applications
An improved incomplete Cholesky factorization

ACM Transactions on Mathematical Software (TOMS)
Algorithm 740: Fortran subroutines to compute improved incomplete Cholesky factorizations

ACM Transactions on Mathematical Software (TOMS)
Iterative solution methods

Iterative solution methods
A linear algebraic analysis of diffusion synthetic acceleration for the Boltzmann transport equation

SIAM Journal on Numerical Analysis
Modification of the minimum-degree algorithm by multiple elimination

ACM Transactions on Mathematical Software (TOMS)
Compressed graphs and the minimum degree algorithm

SIAM Journal on Scientific Computing
Nested grids ILU-decomposition (NGILU)

Proceedings of the 6th international congress on Computational and applied mathematics
Domain decomposition: parallel multilevel methods for elliptic partial differential equations

Domain decomposition: parallel multilevel methods for elliptic partial differential equations
ILUM: a multi-elimination ILU preconditioner for general sparse matrices

SIAM Journal on Scientific Computing
Any Nonincreasing Convergence Curve is Possible for GMRES

SIAM Journal on Matrix Analysis and Applications
A Sparse Approximate Inverse Preconditioner for the Conjugate Gradient Method

SIAM Journal on Scientific Computing
An Approximate Minimum Degree Ordering Algorithm

SIAM Journal on Matrix Analysis and Applications
Matrix computations (3rd ed.)

Matrix computations (3rd ed.)
Projection methods for linear systems

Journal of Computational and Applied Mathematics - Special issue: ROLLS symposium
Parallel Preconditioning with Sparse Approximate Inverses

SIAM Journal on Scientific Computing
Iterative methods for solving linear systems

Iterative methods for solving linear systems
Experimental study of ILU preconditioners for indefinite matrices

Journal of Computational and Applied Mathematics
Approximate Inverse Techniques for Block-Partitioned Matrices

SIAM Journal on Scientific Computing
An object-oriented framework for block preconditioning

ACM Transactions on Mathematical Software (TOMS)
Sparse Approximate-Inverse Preconditioners Using Norm-Minimization Techniques

SIAM Journal on Scientific Computing
A Sparse Approximate Inverse Preconditioner for Nonsymmetric Linear Systems

SIAM Journal on Scientific Computing
Approximate Inverse Preconditioners via Sparse-Sparse Iterations

SIAM Journal on Scientific Computing
Parallel incomplete Cholesky preconditioners based on the non-overlapping data distribution

Parallel Computing
A Fast and High Quality Multilevel Scheme for Partitioning Irregular Graphs

SIAM Journal on Scientific Computing
On a Class of Preconditioning Methods for Dense Linear Systems from Boundary Elements

SIAM Journal on Scientific Computing
Parallelism in ILU-preconditioned GMRES

Parallel Computing
The Incomplete Factorization Multigraph Algorithm

SIAM Journal on Scientific Computing
Approximate sparsity patterns for the inverse of a matrix and preconditioning

IMACS'97 Proceedings on the on Iterative methods and preconditioners
A comparative study of sparse approximate inverse preconditioners

IMACS'97 Proceedings on the on Iterative methods and preconditioners
Orderings for Incomplete Factorization Preconditioning of Nonsymmetric Problems

SIAM Journal on Scientific Computing
BILUM: Block Versions of Multielimination and Multilevel ILU Preconditioner for General Sparse Linear Systems

SIAM Journal on Scientific Computing
The Design and Use of Algorithms for Permuting Large Entries to the Diagonal of Sparse Matrices

SIAM Journal on Matrix Analysis and Applications
Matrix Renumbering ILU: An Effective Algebraic Multilevel ILU Preconditioner for Sparse Matrices

SIAM Journal on Matrix Analysis and Applications
Incomplete Cholesky Factorizations with Limited Memory

SIAM Journal on Scientific Computing
Ordering techniques for two- and three-dimensional convection-dominated elliptic boundary value problems

Computing
BILUTM: A Domain-Based Multilevel Block ILUT Preconditioner for General Sparse Matrices

SIAM Journal on Matrix Analysis and Applications
A multilevel block incomplete factorization preconditioning

Applied Numerical Mathematics
Ordering, Anisotropy, and Factored Sparse Approximate Inverses

SIAM Journal on Scientific Computing
Wavelet Methods for Second-Order Elliptic Problems, Preconditioning, and Adaptivity

SIAM Journal on Scientific Computing
Ordering strategies and related techniques to overcome the trade-off between parallelism and convergence in incomplete factorizations

Parallel Computing - Special Anniversary issue
Inexact Preconditioned Conjugate Gradient Method with Inner-Outer Iteration

SIAM Journal on Scientific Computing
The fast multipole method: numerical implementation

Journal of Computational Physics
Physics-based preconditioning and the Newton-Krylov method for non-equilibrium radiation diffusion

Journal of Computational Physics
A Priori Sparsity Patterns for Parallel Sparse Approximate Inverse Preconditioners

SIAM Journal on Scientific Computing
Orderings for Factorized Sparse Approximate Inverse Preconditioners

SIAM Journal on Scientific Computing
Robustness and Scalability of Algebraic Multigrid

SIAM Journal on Scientific Computing
Sparse Approximate Inverse Smoother for Multigrid

SIAM Journal on Matrix Analysis and Applications
A multigrid tutorial (2nd ed.)

A multigrid tutorial (2nd ed.)
A Note on Preconditioning for Indefinite Linear Systems

SIAM Journal on Scientific Computing
Optimal Order Preconditioning of Finite Difference Matrices

SIAM Journal on Scientific Computing
Sparse approximate inverse and multilevel block ILU preconditioning techniques for general sparse matrices

Applied Numerical Mathematics
Iterative solution of linear systems in the 20th century

Journal of Computational and Applied Mathematics - Special issue on numerical analysis 2000 Vol. III: linear algebra
Preconditioning eigenvalues and some comparison of solvers

Journal of Computational and Applied Mathematics - Special issue on numerical analysis 2000 Vol. III: linear algebra
Refining an approximate inverse

Journal of Computational and Applied Mathematics - Special issue on numerical analysis 2000 Vol. III: linear algebra
A review of algebraic multigrid

Journal of Computational and Applied Mathematics - Special issue on numerical analysis 2000 Vol. VII: partial differential equations
Multigrid

Multigrid
Parallel preconditioning of a sparse eigensolver

Parallel Computing - Linear systems and associated problems
Numerical Linear Algebra for High Performance Computers

Numerical Linear Algebra for High Performance Computers
Parallel approximate factorization method for solving discrete elliptic equations

Parallel Computing
Computer Solution of Large Sparse Positive Definite

Computer Solution of Large Sparse Positive Definite
FQMR: A Flexible Quasi-Minimal Residual Method with Inexact Preconditioning

SIAM Journal on Scientific Computing
Multiresolution Approximate Inverse Preconditioners

SIAM Journal on Scientific Computing
Robust Parallel Smoothing for Multigrid Via Sparse Approximate Inverses

SIAM Journal on Scientific Computing
Flexible Conjugate Gradients

SIAM Journal on Scientific Computing
Preconditioning Highly Indefinite and Nonsymmetric Matrices

SIAM Journal on Scientific Computing
Robust Approximate Inverse Preconditioning for the Conjugate Gradient Method

SIAM Journal on Scientific Computing
A Structural Diagnosis of Some IC Orderings

SIAM Journal on Scientific Computing
An Algebraic Multilevel Multigraph Algorithm

SIAM Journal on Scientific Computing
A Scalable Parallel Algorithm for Incomplete Factor Preconditioning

SIAM Journal on Scientific Computing
Algebraic Multilevel Methods and Sparse Approximate Inverses

SIAM Journal on Matrix Analysis and Applications
On the Relations between ILUs and Factored Approximate Inverses

SIAM Journal on Matrix Analysis and Applications
An Analysis of Sparse Approximate Inverse Preconditioners for Boundary Integral Equations

SIAM Journal on Matrix Analysis and Applications
On Algorithms For Permuting Large Entries to the Diagonal of a Sparse Matrix

SIAM Journal on Matrix Analysis and Applications
A Factored Approximate Inverse Preconditioner with Pivoting

SIAM Journal on Matrix Analysis and Applications
A Fully Asynchronous Multifrontal Solver Using Distributed Dynamic Scheduling

SIAM Journal on Matrix Analysis and Applications
A Multilevel Dual Reordering Strategy for Robust Incomplete LU Factorization of Indefinite Matrices

SIAM Journal on Matrix Analysis and Applications
Generalized Augmented Matrix Preconditioning Approach and its Application to Iterative Solution of Ill-Conditioned Algebraic Systems

SIAM Journal on Matrix Analysis and Applications
Incomplete Multilevel Cholesky Factorizations

SIAM Journal on Matrix Analysis and Applications
The Fast Multipole Method I: Error Analysis and Asymptotic Complexity

SIAM Journal on Numerical Analysis
Sparse approximate inverse smoothers for geometric and algebraic multigrid

Applied Numerical Mathematics - Developments and trends in iterative methods for large systems of equations—in memoriam Rüdiger Weiss
A parallel solver for large-scale Markov chains

Applied Numerical Mathematics - Developments and trends in iterative methods for large systems of equations—in memoriam Rüdiger Weiss
BoomerAMG: a parallel algebraic multigrid solver and preconditioner

Applied Numerical Mathematics - Developments and trends in iterative methods for large systems of equations—in memoriam Rüdiger Weiss
Factorized Sparse Approximate Inverses for Preconditioning

The Journal of Supercomputing
Iterative Methods for Sparse Linear Systems

Iterative Methods for Sparse Linear Systems
Application of Threshold Partitioning of Sparse Matrices to Markov Chains

IPDS '96 Proceedings of the 2nd International Computer Performance and Dependability Symposium (IPDS '96)
Krylov methods for the numerical solution of initial-value problems in differential-algebraic equations

Krylov methods for the numerical solution of initial-value problems in differential-algebraic equations
New sequential and scalable parallel algorithms for incomplete factor preconditioning

New sequential and scalable parallel algorithms for incomplete factor preconditioning
Solution of the Discontinuous P1 Equations in Two-Dimensional Cartesian Geometry with Two-Level Preconditioning

SIAM Journal on Scientific Computing
Exploiting Multilevel Preconditioning Techniques in Eigenvalue Computations

SIAM Journal on Scientific Computing
On a class of preconditioners for solving the Helmholtz equation

Applied Numerical Mathematics
An MPI Implementation of the SPAI Preconditioner on the T3E

International Journal of High Performance Computing Applications
Parallel Implementation and Practical Use of Sparse Approximate Inverse Preconditioners with a Priori Sparsity Patterns

International Journal of High Performance Computing Applications
The university of Florida sparse matrix collection

ACM Transactions on Mathematical Software (TOMS)

Jacobian-free Newton-Krylov methods: a survey of approaches and applications

Journal of Computational Physics
A finite element algorithm for reanalysis of structures with added degrees of freedom

Finite Elements in Analysis and Design
An implicit compact scheme solver with application to chemically reacting flows

Journal of Computational Physics
Performance of fully coupled domain decomposition preconditioners for finite element transport/reaction simulations

Journal of Computational Physics
On the discrete dynamic nature of the conjugate gradient method

Journal of Computational Physics
An ILU preconditioner for nonsymmetric positive definite matrices by using the conjugate Gram-Schmidt process

Journal of Computational and Applied Mathematics
Numerical performance of incomplete factorizations for 3D transient convection-diffusion problems

Advances in Engineering Software
Iteratively constructing preconditioners via the conjugate gradient method

Proceedings of the thirty-ninth annual ACM symposium on Theory of computing
A numerical experimental study of inverse preconditioning for the parallel iterative solution to 3D finite element flow equations

Journal of Computational and Applied Mathematics
A taxonomy and comparison of parallel block multi-level preconditioners for the incompressible Navier-Stokes equations

Journal of Computational Physics
Effect of discretization order on preconditioning and convergence of a high-order unstructured Newton-GMRES solver for the Euler equations

Journal of Computational Physics
Object-oriented programming of distributed iterative equation solvers

Computers and Structures
Additive preconditioning and aggregation in matrix computations

Computers & Mathematics with Applications
A short survey on preconditioning techniques for large-scale dense complex linear systems in electromagnetics

International Journal of Computer Mathematics - Fast Iterative and Preconditioning Methods for Linear and Non-Linear Systems
Preconditioners for the conjugate gradient algorithm using Gram-Schmidt and least squares methods

International Journal of Computer Mathematics
Acceleration of Preconditioned Krylov Solvers for Bubbly Flow Problems

ICCS '07 Proceedings of the 7th international conference on Computational Science, Part I: ICCS 2007
On Using Reinforcement Learning to Solve Sparse Linear Systems

ICCS '08 Proceedings of the 8th international conference on Computational Science, Part I
Schur aggregation for linear systems and determinants

Theoretical Computer Science
FGMRES preconditioning by symmetric/skew-symmetric decomposition of generalized stokes problems

Mathematics and Computers in Simulation
Some preconditioning techniques for linear systems

WSEAS Transactions on Mathematics
Optimization of the parameterized Uzawa preconditioners for saddle point matrices

Journal of Computational and Applied Mathematics
A sparse-sparse iteration for computing a sparse incomplete factorization of the inverse of an SPD matrix

Applied Numerical Mathematics
On Single Precision Preconditioners for Krylov Subspace Iterative Methods

Large-Scale Scientific Computing
Design and deployment of distributed numerical applications using .NET and component oriented programming

Advances in Engineering Software
Lanczos-type variants of the COCR method for complex nonsymmetric linear systems

Journal of Computational Physics
Efficient Parallelization of the Preconditioned Conjugate Gradient Method

PaCT '09 Proceedings of the 10th International Conference on Parallel Computing Technologies
A block inverse-free preconditioned Krylov subspace method for symmetric generalized eigenvalue problems

Journal of Computational and Applied Mathematics
A preconditioned Krylov technique for global hydrodynamic stability analysis of large-scale compressible flows

Journal of Computational Physics
New implementation of QMR-type algorithms

Computers and Structures
An ILU preconditioner for nonsymmetric positive definite matrices by using the conjugate Gram-Schmidt process

Journal of Computational and Applied Mathematics
On mutual impact of numerical linear algebra and large-scale optimization with focus on interior point methods

Computational Optimization and Applications
A directed Monte Carlo solution of linear stochastic algebraic system of equations

Finite Elements in Analysis and Design
Acceleration of preconditioned Krylov solvers for bubbly flow problems

PPAM'07 Proceedings of the 7th international conference on Parallel processing and applied mathematics
On the use of incomplete LU decomposition as a preconditioning technique for density fitting in electronic structure computations

ICCSA'07 Proceedings of the 2007 international conference on Computational science and its applications - Volume Part I
Additive preconditioning for matrix computations

CSR'08 Proceedings of the 3rd international conference on Computer science: theory and applications
A comparative study of iterative solutions to linear systems arising in quantum mechanics

Journal of Computational Physics
Algebraic and numerical algorithms

Algorithms and theory of computation handbook
On the performance of parallel normalized explicit preconditioned conjugate gradient type methods

IPDPS'06 Proceedings of the 20th international conference on Parallel and distributed processing
Wavelet based ILU preconditioners for the numerical solution by PUFEM of high frequency elastic wave scattering

Journal of Computational Physics
Adaptive Techniques for Improving the Performance of Incomplete Factorization Preconditioning

SIAM Journal on Scientific Computing
Iterative Near-Field Preconditioner for the Multilevel Fast Multipole Algorithm

SIAM Journal on Scientific Computing
A Block FSAI-ILU Parallel Preconditioner for Symmetric Positive Definite Linear Systems

SIAM Journal on Scientific Computing
Fast iterative solvers for thin structures

Finite Elements in Analysis and Design
Preconditioning the bidomain model with almost linear complexity

Journal of Computational Physics
Acquired Clustering Properties and Solution of Certain Saddle Point Systems

SIAM Journal on Matrix Analysis and Applications
MINRES-QLP: A Krylov Subspace Method for Indefinite or Singular Symmetric Systems

SIAM Journal on Scientific Computing
Improved Scaling for Quantum Monte Carlo on Insulators

SIAM Journal on Scientific Computing
Schur Complement Preconditioners for Surface Integral-Equation Formulations of Dielectric Problems Solved with the Multilevel Fast Multipole Algorithm

SIAM Journal on Scientific Computing
Performance analysis of block jacobi preconditioning technique based on block broyden method

ICCS'06 Proceedings of the 6th international conference on Computational Science - Volume Part I
Quasi-Newton acceleration of ILU preconditioners for nonlinear two-phase flow equations in porous media

Advances in Engineering Software
Advancing matrix computations with randomized preprocessing

CSR'10 Proceedings of the 5th international conference on Computer Science: theory and Applications
Using performance profiles to evaluate preconditioners for iterative methods

ICCSA'06 Proceedings of the 2006 international conference on Computational Science and Its Applications - Volume Part III
An approach for structural static reanalysis with unchanged number of degrees of freedom

Structural and Multidisciplinary Optimization
Short Note: On the performance of a simple parallel implementation of the ILU-PCG for the Poisson equation on irregular domains

Journal of Computational Physics
Solution of generalized shifted linear systems with complex symmetric matrices

Journal of Computational Physics
An Empirical Analysis of the Performance of Preconditioners for SPD Systems

ACM Transactions on Mathematical Software (TOMS)
On iterative techniques for computing flow in large two-dimensional discrete fracture networks

Journal of Computational and Applied Mathematics
Minimizing Condition Number via Convex Programming

SIAM Journal on Matrix Analysis and Applications
Implementation of a direct procedure for critical point computations using preconditioned iterative solvers

Computers and Structures
Staggered meshless solid-fluid coupling

ACM Transactions on Graphics (TOG) - Proceedings of ACM SIGGRAPH Asia 2012
A dispersion minimizing finite difference scheme and preconditioned solver for the 3D Helmholtz equation

Journal of Computational Physics
Forward and back substitution algorithms on GPU: a case study on modified incomplete Cholesky Preconditioner for three-dimensional finite difference method

The Journal of Supercomputing
Solving Hermitian positive definite systems using indefinite incomplete factorizations

Journal of Computational and Applied Mathematics
A preconditioned conjugate gradient algorithm for GeneRank with application to microarray data mining

Data Mining and Knowledge Discovery
Multigrid in energy preconditioner for Krylov solvers

Journal of Computational Physics
Review: A unified framework for regularized linear estimation in communication systems

Signal Processing
On optimizing Jacobi-Davidson method for calculating eigenvalues in low dimensional structures using eight band k·p model

Journal of Computational Physics
Towards a recursive iterative preconditioner

Proceedings of the 51st ACM Southeast Conference
VBARMS: A variable block algebraic recursive multilevel solver for sparse linear systems

Journal of Computational and Applied Mathematics
A generalization of the optimal diagonal approximate inverse preconditioner

Computers & Mathematics with Applications
A domain decomposition method of stochastic PDEs: An iterative solution techniques using a two-level scalable preconditioner

Journal of Computational Physics
A hybrid boundary element-finite element approach to modeling plane wave 3D electromagnetic induction responses in the Earth

Journal of Computational Physics

Quantified Score

Hi-index	31.54

Visualization

Abstract

This article surveys preconditioning techniques for the iterative solution of large linear systems, with a focus on algebraic methods suitable for general sparse matrices. Covered topics include progress in incomplete factorization methods, sparse approximate inverses, reorderings, parallelization issues, and block and multilevel extensions. Some of the challenges ahead are also discussed. An extensive bibliography completes the paper.