Executing Communication-Intensive Irregular Programs Efficiently

  • Authors:
  • Vara Ramakrishnan;Isaac D. Scherson

  • Affiliations:
  • -;-

  • Venue:
  • IPDPS '00 Proceedings of the 15 IPDPS 2000 Workshops on Parallel and Distributed Processing
  • Year:
  • 2000

Quantified Score

Hi-index 0.00

Visualization

Abstract

We consider the problem of efficiently executing completely irregular, communication-intensive parallel programs. Completely irregular programs are those whose number of parallel threads as well as the amount of computation performed in each thread vary during execution. Our programs run on MIMD computers with some form of space-slicing (partitioning) and time-slicing (scheduling) support. A hardware barrier sync hronization mechanism is required to efficiently implement the frequent communications of our programs, and this constrains the computer to a fixed size partitioning policy.We compare the possible scheduling policies for irregular programs on fixed size partitions: local scheduling and multi-gangscheduling, and prove that local scheduling does better. Then we introduce competitive analysis and formally analyze the online rebalancing algorithms required for efficient local sc heduling under two scenarios: with full information and with partial information.