Scalable loop self-scheduling schemes for heterogeneous clusters

Authors:
Anthony T. Chronopoulos;Satish Penmatsa;Ning Yu;Du Yu
Affiliations:
Department of Computer Science, The University of Texas, 6900 N Loop, 1604 W, San Antonio, TX 78249, USA.;Department of Computer Science, The University of Texas, 6900 N Loop, 1604 W, San Antonio, TX 78249, USA.;Department of Computer Science, The University of Texas, 6900 N Loop, 1604 W, San Antonio, TX 78249, USA.;Department of Computer Science, The University of Texas, 6900 N Loop, 1604 W, San Antonio, TX 78249, USA
Venue:
International Journal of Computational Science and Engineering
Year:
2005

Citing 16
Cited 1

Load-sharing in heterogeneous systems via weighted factoring

Proceedings of the eighth annual ACM symposium on Parallel algorithms and architectures
Parallel programming with MPI

Parallel programming with MPI
Adaptively Scheduling Parallel Loops in Distributed Shared-Memory Systems

IEEE Transactions on Parallel and Distributed Systems
Trapezoid Self-Scheduling: A Practical Scheduling Scheme for Parallel Compilers

IEEE Transactions on Parallel and Distributed Systems
Using Processor Affinity in Loop Scheduling on Shared-Memory Multiprocessors

IEEE Transactions on Parallel and Distributed Systems
Feedback Guided Dynamic Loop Scheduling: Algorithms and Experiments

Euro-Par '98 Proceedings of the 4th International Euro-Par Conference on Parallel Processing
On the Scalability of Dynamic Scheduling Scientific Applications with Adaptive Weighted Factoring

Cluster Computing
A Class of Loop Self-Scheduling for Heterogeneous Clusters

CLUSTER '01 Proceedings of the 3rd IEEE International Conference on Cluster Computing
Compiling Tiled Iteration Spaces for Clusters

CLUSTER '02 Proceedings of the IEEE International Conference on Cluster Computing
Linear Algebra Algorithms in Heterogeneous Cluster of Personal Computers

HCW '00 Proceedings of the 9th Heterogeneous Computing Workshop
Loop scheduling for heterogeneity

HPDC '95 Proceedings of the 4th IEEE International Symposium on High Performance Distributed Computing
The Effect of Scheduling Discipline on Dynamic Load Sharing in Heterogeneous Distributed Systems

MASCOTS '97 Proceedings of the 5th International Workshop on Modeling, Analysis, and Simulation of Computer and Telecommunications Systems
An Investigation of Feedback Guided Dynamic Scheduling of Nested Loops

ICPP '00 Proceedings of the 2000 International Workshop on Parallel Processing
(R) Load Balancing for Parallel Loops in Workstation Clusters

ICPP '96 Proceedings of the Proceedings of the 1996 International Conference on Parallel Processing - Volume 3
A Hierarchical Processor Scheduling Policy for Distributed-Memory Multicomputer Systems

HIPC '97 Proceedings of the Fourth International Conference on High-Performance Computing
A parallel loop self-scheduling on extremely heterogeneous PC clusters

ICCS'03 Proceedings of the 2003 international conference on Computational science

Towards the optimal synchronization granularity for dynamic scheduling of pipelined computations on heterogeneous computing systems

Concurrency and Computation: Practice & Experience

Quantified Score

Hi-index	0.00

Visualization

Abstract

Heterogeneous cluster systems (e.g., a LAN of computers) can be used for concurrent processing for some applications. However, a serious difficulty in concurrent programming of a heterogeneous system is how to deal with scheduling and load balancing of such a system that may consist of heterogeneous computers. Distributed scheduling schemes suitable for parallel loops with independent iterations on heterogeneous computer clusters have been proposed and analysed in the past. Here, we implement the previous schemes in MPI. We present an extension of these schemes implemented in a hierarchical Master Slave architecture and include experimental results and comparisons.