Load balancing in SPMD applications: concepts and experiments

Authors:
A. Plastino;V. Thomé;D. Vianna;R. Costa;O. T. da Silveira Filho
Affiliations:
Universidade Federal Fluminense, Department of Computer Science, Niterói, 24210-240, Brazil;Universidade Federal Fluminense, Department of Computer Science, Niterói, 24210-240, Brazil;Universidade Federal Fluminense, Department of Computer Science, Niterói, 24210-240, Brazil;Universidade Federal Fluminense, Department of Computer Science, Niterói, 24210-240, Brazil;Universidade Federal Fluminense, Department of Computer Science, Niterói, 24210-240, Brazil
Venue:
High performance scientific and engineering computing
Year:
2004

Citing 13
Cited 1

A multi-level load balancing scheme for OR-parallel exhaustive search programs on the multi-PSI

PPOPP '90 Proceedings of the second ACM SIGPLAN symposium on Principles & practice of parallel programming
Object-oriented modeling and design

Object-oriented modeling and design
Parallel computing (2nd ed.): theory and practice

Parallel computing (2nd ed.): theory and practice
Design patterns: elements of reusable object-oriented software

Design patterns: elements of reusable object-oriented software
Design patterns for object-oriented software development

Design patterns for object-oriented software development
A general matrix iterative model for dynamic load balancing

Parallel Computing
Customized dynamic load balancing for a network of workstations

Journal of Parallel and Distributed Computing
Framework Patterns

Framework Patterns
Strategies for Dynamic Load Balancing on Highly Parallel Computers

IEEE Transactions on Parallel and Distributed Systems
A taxonomy of scheduling in general-purpose distributed computing systems

IEEE Transactions on Software Engineering
Exploring Load Balancing in Parallel Processing of Recursive Queries

Euro-Par '97 Proceedings of the Third International Euro-Par Conference on Parallel Processing
Exploring Load Balancing in a Scientific SPMD Parallel Application

ICPPW '02 Proceedings of the 2002 International Conference on Parallel Processing Workshops
Developing SPMD applications with load balancing

Parallel Computing

Evaluating a scientific SPMD application on a computational grid with different load balancing techniques

ISSADS'05 Proceedings of the 5th international conference on Advanced Distributed Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

The performance of SPMD parallel programs is strongly affected by dynamic load imbalancing factors. The use of a suitable load balancing strategy is essential in overcoming the effects of these imbalancing factors. This chapter deals with concepts and experiments related to load balancing in SPMD applications. Initially, we discuss a set of classification criteria for load balancing algorithms designed for SPMD applications. In addition, we define a load imbalancing index in order to measure the load imbalance of a parallel application execution. In the experimental part of this chapter, we describe the development of an SPMD parallel application which computes the macroscopic thermal dispersion in porous media. Nine versions of this scientific application were developed, each one adopting a different load balancing strategy. We evaluate and compare the performance of these nine versions and show the importance of using an appropriate load balancing strategy for the characteristics of a specific SPMD parallel application.