Dynamic Remapping of Parallel Computations with Varying Resource Demands
IEEE Transactions on Computers
Adaptive Optimal Load Balancing in a Nonhomogeneous Multiserver System with a Central Job Scheduler
IEEE Transactions on Computers
The Influence of Different Workload Descriptions on a Heuristic Load Balancing Scheme
IEEE Transactions on Software Engineering
Utopia: a load sharing facility for large, heterogeneous distributed computer systems
Software—Practice & Experience
PVM: Parallel virtual machine: a users' guide and tutorial for networked parallel computing
PVM: Parallel virtual machine: a users' guide and tutorial for networked parallel computing
Dynamic load balancing of data parallel applications on a distributed network
ICS '95 Proceedings of the 9th international conference on Supercomputing
Non-uniform and dynamic domain decompositions for hypercomputing
Parallel Computing
Adaptive load migration systems for PVM
Proceedings of the 1994 ACM/IEEE conference on Supercomputing
Adaptive Parallelism and Piranha
Computer
Strategies for Dynamic Load Balancing on Highly Parallel Computers
IEEE Transactions on Parallel and Distributed Systems
Runtime Support and Compilation Methods for User-Specified Irregular Data Distributions
IEEE Transactions on Parallel and Distributed Systems
Predicting parallel applications performance on non-dedicated cluster platforms
ICS '98 Proceedings of the 12th international conference on Supercomputing
IEEE Parallel & Distributed Technology: Systems & Technology
HPCN Europe 2001 Proceedings of the 9th International Conference on High-Performance Computing and Networking
Adaptive scheduling of parallel computations for SPMD tasks
ICCSA'07 Proceedings of the 2007 international conference on Computational science and Its applications - Volume Part II
Adaptive scheduling and resource assessment in GRID
PaCT'07 Proceedings of the 9th international conference on Parallel Computing Technologies
| Hi-index | 0.00 |
Distributed systems have the potentiality of becoming an alternative platform for parallel computations. However, there are still many obstacles to overcome, one of the most serious is that distributed systems typically consist of shared heterogeneous components with highly variable computational power. We present a load balancing support that checks the load status and, if necessary, adapts the workload to dynamic platform conditions through data migrations from overloaded to underloaded nodes. Unlike task migration supports for task parallelism and other data migration frameworks for master/slave-based parallel applications, our support works for the entire class of SPMD regular applications with explicit communications such as linear algebra problems, partial differential equation solvers, image processing algorithms. Although we considered several variants (three activation mechanisms, three load monitoring techniques and four decision policies), we implemented only the protocols that guarantee program consistency. The efficiency of the strategies is tested in the instance of two SPMD algorithms that are based on the PVM library enriched by special-purpose primitives for data management. As additional contribution, our research keeps the entire support for dynamic load balancing transparent to the programmer. The only visible interface of our support is the activation phase.