Hybrid scheduling for the parallel solution of linear systems

Authors:
Patrick R. Amestoy;Abdou Guermouche;Jean-Yves L'Excellent;Stéphane Pralet
Affiliations:
ENSEEIHT-IRIT, 2 rue Camichel, 31071 Toulouse Cedex 7, France;INRIA/ENSEEIHT-IRIT, 2 rue Camichel, 31071 Toulouse Cedex 7, France;INRIA/LIP, ENS Lyon, 46, allee d'Italie, 69364 Lyon Cedex 7, France;CNRS/ENSEEIHT-IRIT, 2 rue Camichel, 31071 Toulouse Cedex 7, France
Venue:
Parallel Computing - Parallel matrix algorithms and applications (PMAA'04)
Year:
2006

Citing 12
Cited 43

The role of elimination trees in sparse factorization

SIAM Journal on Matrix Analysis and Applications
Task scheduling for parallel sparse Cholesky factorization

International Journal of Parallel Programming
The multifrontal method for sparse matrix solution: theory and practice

SIAM Review
On finding supernodes for sparse matrix computations

SIAM Journal on Matrix Analysis and Applications
A mapping algorithm for parallel sparse Cholesky factorization

SIAM Journal on Scientific Computing
The Multifrontal Solution of Indefinite Sparse Symmetric Linear

ACM Transactions on Mathematical Software (TOMS)
Numerical Linear Algebra for High Performance Computers

Numerical Linear Algebra for High Performance Computers
A Fully Asynchronous Multifrontal Solver Using Distributed Dynamic Scheduling

SIAM Journal on Matrix Analysis and Applications
PASTIX: a high-performance parallel direct solver for sparse symmetric positive definite systems

Parallel Computing - Parallel matrix algorithms and applications
Adapting a parallel sparse direct solver to architectures with clusters of SMPs

Parallel Computing - Special issue: Parallel and distributed scientific and engineering computing
Task Scheduling in an Asynchronous Distributed Memory Multifrontal Solver

SIAM Journal on Matrix Analysis and Applications
A Study of Various Load Information Exchange Mechanisms for a Distributed Application using Dynamic Scheduling

IPDPS '05 Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS'05) - Papers - Volume 01

Parallel sparse LU factorization on different message passing platforms

Journal of Parallel and Distributed Computing
On finding approximate supernodes for an efficient block-ILU(k) factorization

Parallel Computing
Parallel scalability study of hybrid preconditioners in three dimensions

Parallel Computing
GREMLINS: a large sparse linear solver for grid environment

Parallel Computing
A parallel out-of-core multifrontal method: Storage of factors on disk and analysis of models for an out-of-core active memory

Parallel Computing
Using Mixed Precision for Sparse Matrix Computations to Enhance the Performance while Achieving 64-bit Accuracy

ACM Transactions on Mathematical Software (TOMS)
Multigrid based preconditioners for the numerical solution of two-dimensional heterogeneous problems in geophysics

International Journal of Computer Mathematics - Fast Iterative and Preconditioning Methods for Linear and Non-Linear Systems
On the I/O Volume in Out-of-Core Multifrontal Methods with a Flexible Allocation Scheme

High Performance Computing for Computational Science - VECPAR 2008
FWT2D: A massively parallel program for frequency-domain full-waveform tomography of wide-aperture seismic data-Part 1

Computers & Geosciences
On the Parallelization of Self-Adaptive hp-Finite Element Methods Part II. Partitioning Communication Agglomeration Mapping (PCAM) Analysis

Fundamenta Informaticae
PSPIKE: A Parallel Hybrid Sparse Linear System Solver

Euro-Par '09 Proceedings of the 15th International Euro-Par Conference on Parallel Processing
A parallel computer implementation of the Asymptotic Numerical Method to study thermal convection instabilities

Journal of Computational Physics
Parallelising a simulator for the analysis of electromagnetic radiation using MUMPS library

Proceedings of the Fourth International ICST Conference on Performance Evaluation Methodologies and Tools
A parallel direct solver for the self-adaptive hp Finite Element Method

Journal of Parallel and Distributed Computing
Analysis of the solution phase of a parallel multifrontal approach

Parallel Computing
Sparse approximate solution of partial differential equations

Applied Numerical Mathematics
Reducing the I/O volume in an out-of-core sparse multifrontal solver

HiPC'07 Proceedings of the 14th international conference on High performance computing
Towards a transparent data access model for the GridRPC paradigm

HiPC'07 Proceedings of the 14th international conference on High performance computing
Parallelizing a hybrid finite element-boundary integral method for the analysis of scattering and radiation of electromagnetic waves

Finite Elements in Analysis and Design
Adaptive Discontinuous Galerkin Methods for Eigenvalue Problems Arising in Incompressible Fluid Flows

SIAM Journal on Scientific Computing
Reducing the I/O Volume in Sparse Out-of-core Multifrontal Methods

SIAM Journal on Scientific Computing
Weighted Matrix Ordering and Parallel Banded Preconditioners for Iterative Linear System Solvers

SIAM Journal on Scientific Computing
Two-dimensional frequency-domain visco-elastic full waveform inversion: Parallel algorithms, optimization and performance

Computers & Geosciences
Adaptivity and a Posteriori Error Control for Bifurcation Problems II: Incompressible Fluid Flow in Open Systems with Z2 Symmetry

Journal of Scientific Computing
A domain-decomposing parallel sparse linear system solver

Journal of Computational and Applied Mathematics
Scalable stochastic optimization of complex energy systems

Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis
Full multi grid method for electric field computation in point-to-plane streamer discharge in air at atmospheric pressure

Journal of Computational Physics
Solving large sparse linear systems in a grid environment: the GREMLINS code versus the PETSc library

The Journal of Supercomputing
A preliminary out-of-core extension of a parallel multifrontal solver

Euro-Par'06 Proceedings of the 12th international conference on Parallel Processing
Object-oriented design to automate a high order non-linear solver based on asymptotic numerical method

Advances in Engineering Software
Reflections on simultaneous impact

ACM Transactions on Graphics (TOG) - SIGGRAPH 2012 Conference Proceedings
Adaptivity and a Posteriori Error Control for Bifurcation Problems III: Incompressible Fluid Flow in Open Systems with O(2) Symmetry

Journal of Scientific Computing
On the Parallelization of Self-Adaptive hp-Finite Element Methods Part II. Partitioning Communication Agglomeration Mapping (PCAM) Analysis

Fundamenta Informaticae
Algorithm 925: Parallel Solver for Semidefinite Programming Problem having Sparse Schur Complement Matrix

ACM Transactions on Mathematical Software (TOMS)
Task scheduling for parallel multifrontal methods

Euro-Par'07 Proceedings of the 13th international Euro-Par conference on Parallel Processing
A look inside the earth: geophysical imaging of the subsurface

XRDS: Crossroads, The ACM Magazine for Students - Scientific Computing
Power series analysis as a major breakthrough to improve the efficiency of Asymptotic Numerical Method in the vicinity of bifurcations

Journal of Computational Physics
A direct solver with reutilization of LU factorizations for h-adaptive finite element grids with point singularities

Computers & Mathematics with Applications
Project APhiD: A Lorenz-gauged A-Φ decomposition for parallelized computation of ultra-broadband electromagnetic induction in a fully heterogeneous Earth

Computers & Geosciences
Scalable domain decomposition preconditioners for heterogeneous elliptic problems

SC '13 Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis
A three-dimensional numerical model for dense granular flows based on the µ(I) rheology

Journal of Computational Physics
hp-adaptive discontinuous Galerkin methods for bifurcation phenomena in open flows

Computers & Mathematics with Applications
An a-posteriori error estimate for hp-adaptive DG methods for convection-diffusion problems on anisotropically refined meshes

Computers & Mathematics with Applications

Quantified Score

Hi-index	0.02

Visualization

Abstract

We consider the problem of designing a dynamic scheduling strategy that takes into account both workload and memory information in the context of the parallel multifrontal factorization. The originality of our approach is that we base our estimations (work and memory) on a static optimistic scenario during the analysis phase. This scenario is then used during the factorization phase to constrain the dynamic decisions that compute fully irregular partitions in order to better balance the workload. We show that our new scheduling algorithm significantly improves both the memory behaviour and the factorization time. We give experimental results for large challenging real-life 3D problems on 64 and 128 processors.