A model for multi-grained parallelism (extended abstract)

  • Authors:
  • John E. Savage

  • Affiliations:
  • Brown University, Department of Computer Science, Box 1910, Providence, Rhode Island

  • Venue:
  • SPAA '94 Proceedings of the sixth annual ACM symposium on Parallel algorithms and architectures
  • Year:
  • 1994

Quantified Score

Hi-index 0.00

Visualization

Abstract

Multi-grained parallel computers can be very effective on computationally intensive problems that have important serial and parallel components. We introduce the Mesh SuperHet, a model of this type consisting of the close coupling of a d-dimensional toroidal mesh of coarse-grained processors to a serial machine consisting of memory modules connected via a low-diameter network to a serial processor. We exhibit problems for which the Mesh SuperHet is superior to its serial or parallel components alone and develop tight performance bounds for sorting, the fast Fourier transform, and matrix multiplication. As multi-grained machines become more common, studies such as this will both reveal the fundamental limitations on such architectures and set the context for algorithm development.