Dynamic Load Balancing on Dedicated Heterogeneous Systems

Authors:
Ismael Galindo;Francisco Almeida;José Manuel Badía-Contelles
Affiliations:
Department of Statistics and Computer Science, La Laguna University Spain,;Department of Statistics and Computer Science, La Laguna University Spain,;Department of Computer Science and Engineering, Jaume I University Spain,
Venue:
Proceedings of the 15th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface
Year:
2008

Citing 11
Cited 12

Adaptive parallel computing on heterogeneous networks with mpC

Parallel Computing
Modeling Parallel Applications Performance on Heterogeneous Systems

IPDPS '03 Proceedings of the 17th International Symposium on Parallel and Distributed Processing
Parallel Programming: Techniques and Applications Using Networked Workstations and Parallel Computers (2nd Edition)

Parallel Programming: Techniques and Applications Using Networked Workstations and Parallel Computers (2nd Edition)
Parallelization of the GNU Scientific Library on Heterogeneous Systems

ISPDC '04 Proceedings of the Third International Symposium on Parallel and Distributed Computing/Third International Workshop on Algorithms, Models and Tools for Parallel Computing on Heterogeneous Networks
Guest editorial: Heterogeneous computing

Parallel Computing - Heterogeneous computing
Heuristics for work distribution of a homogeneous parallel dynamic programming scheme on heterogeneous systems

Parallel Computing - Heterogeneous computing
Scalability of heterogeneous parallel systems

Programming and Computing Software
HeteroMPI: Towards a message-passing library for heterogeneous networks of computers

Journal of Parallel and Distributed Computing
The master-slave paradigm on heterogeneous systems: a dynamic programming approach for the optimal mapping

Journal of Systems Architecture: the EUROMICRO Journal - Special issue: Parallel, distributed and network-based processing
Self-adapting numerical software (SANS) effort

IBM Journal of Research and Development
Efficient parallel LAN/WAN algorithms for optimization. The mallba project

Parallel Computing

Applying process migration on a BSP-based LU decomposition application

VECPAR'10 Proceedings of the 9th international conference on High performance computing for computational science
Dynamic load balancing of parallel computational iterative routines on platforms with memory heterogeneity

Euro-Par 2010 Proceedings of the 2010 conference on Parallel processing
Using multidimensional solvers for optimal data partitioning on dedicated heterogeneous HPC platforms

PaCT'11 Proceedings of the 11th international conference on Parallel computing technologies
Automatic tuning of iterative computation on heterogeneous multiprocessors with ADITHE

The Journal of Supercomputing
Optimization strategies in different CUDA architectures using llCoMP

Microprocessors & Microsystems
Scheduling divisible loads on heterogeneous desktop systems with limited memory

Euro-Par'11 Proceedings of the 2011 international conference on Parallel Processing
Hierarchical partitioning algorithm for scientific computing on highly heterogeneous CPU + GPU clusters

Euro-Par'12 Proceedings of the 18th international conference on Parallel Processing
From latex specifications to parallel codes

The Journal of Supercomputing
A load index and load balancing algorithm for heterogeneous clusters

The Journal of Supercomputing
FLEX-MPI: an MPI extension for supporting dynamic load balancing on heterogeneous non-dedicated systems

Euro-Par'13 Proceedings of the 19th international conference on Parallel Processing
Dynamic load balancing on heterogeneous multi-GPU systems

Computers and Electrical Engineering
A compound OpenMP/MPI program development toolkit for hybrid CPU/GPU clusters

The Journal of Supercomputing

Quantified Score

Hi-index	0.00

Visualization

Abstract

Parallel computing in heterogeneous environments is drawing considerable attention due to the growing number of these kind of systems. Adapting existing code and libraries to such systems is a fundamental problem. The performance of this code is affected by the large interdependence between the code and these parallel architectures. We have developed a dynamic load balancing library that allows parallel code to be adapted to heterogeneous systems for a wide variety of problems. The overhead introduced by our system is minimal and the cost to the programmer negligible. The strategy was validated on several problems to confirm the soundness of our proposal.