(R) Load Balancing for Parallel Loops in Workstation Clusters

  • Authors:
  • Affiliations:
  • Venue:
  • ICPP '96 Proceedings of the Proceedings of the 1996 International Conference on Parallel Processing - Volume 3
  • Year:
  • 1996

Quantified Score

Hi-index 0.00

Visualization

Abstract

Abstract: Load imbalance is a serious impediment to achieving good performance in parallel processing. Global load balancing schemes cannot adequately man-age to balance parallel tasks generated from a single application. Dynamic loop scheduling methods are known to be useful in balancing parallel loops on shared-memory multiprocessor machines. However, their centralized nature causes a bottleneck even for the relatively small number of processors in workstation clusters because of order-of-magnitude differences in communications overheads. Moreover, improvements of basic loop scheduling methods have not dealt effectively with irregularly distributed workloads in parallel loops, which commonly occur in applications for work-station clusters. In this paper, we present a new decentralized balancing method for parallel loops on workstation clusters.