Selecting Data Distributions for Unbounded Loops

  • Authors:
  • Thomas Rauber;Gudula Rünger

  • Affiliations:
  • -;-

  • Venue:
  • IPDPS '02 Proceedings of the 16th International Parallel and Distributed Processing Symposium
  • Year:
  • 2002

Quantified Score

Hi-index 0.00

Visualization

Abstract

We consider parallel programs that are composed of a set of data-parallel modules. For an execution on a distributed memory machine (DMM), each data parallel module has to use a data distribution for its variables. If cooperating modules are based on different data distributions for the same variable, data redistributions have to be performed between the activations of the modules and thus additional time for communication is needed. In this paper, we assume that each of the modules is available in several different parallel realizations using different data distributions. We address the question how to select the realizations of the data-parallel modules that result in the smallest overall execution time of the entire program. We describe a cost-based method to determine data distributions for the different modules such that redistributions are taken into consideration. In particular, we concentrate on unbounded loops. Computation and communication costs as well as the costs for redistributions between cooperating modules are modelled by cost functions.