Scalability Analysis of Multidimensional Wavefront Algorithms on Large-Scale SMP Clusters

  • Authors:
  • Adolfy Hoisie;Olaf Lubeck;Harvey Wasserman

  • Affiliations:
  • -;-;-

  • Venue:
  • FRONTIERS '99 Proceedings of the The 7th Symposium on the Frontiers of Massively Parallel Computation
  • Year:
  • 1999

Quantified Score

Hi-index 0.00

Visualization

Abstract

We develop a model for the parallel perform-ance of algorithms that consist of concurrent, two-dimensional wavefronts implemented in a message pass-ing environment. The model combines the separate con-tributions of computation and communication wavefronts. We validate the model on three supercomputer systems, with up to 500 processors, using data from an ASCI de-terministic particle transport application, although the model is general to any wavefront algorithm implemented on a 2-D processor domain. We also use the model to make estimates of performance and scalability of wave-front algorithms on 100-TFLOPS computer systems ex-pected to be in existence within the next decade. Our model shows that on a 1-billion-cell problem, single-node computation speed (not inter-processor communication performance, as is widely believed) is the bottleneck. Fi-nally, we present preliminary considerations that reveal the additional complexity associated with modeling wavefront algorithms on reduced-connectivity network topologies, such as clusters of SMPs.