Pipelining and Overlapping for MPI Collective Operations

  • Authors:
  • Joachim Worringen

  • Affiliations:
  • -

  • Venue:
  • LCN '03 Proceedings of the 28th Annual IEEE International Conference on Local Computer Networks
  • Year:
  • 2003

Quantified Score

Hi-index 0.00

Visualization

Abstract

Collective operations are an important aspect of the currentlymost important message-passing programming modelMPI (Message Passing Interface). Many MPI applicationsmake heavy use of collective operations. Collective operationsinvolve the active participation of a known groupof processes and are usually implemented on top of MPIpoint-to-point message passing. Many optimizations of theused communication algorithms have been developed, butthe vast majority of those optimizations is still based onplain MPI point-to-point message passing. While this hasthe advantage of portability, it often does not allow for fullexploitation of the underlying interconnection network. Inthis paper, we present a low-level, pipeline-based optimizationof one-to-many and many-to-one collective operationsfor the SCI (Scalable Coherent Interface) interconnectionnetwork. The optimizations increase the performance ofsome operations by a factor of four if compared with thegeneric, tree-based algorithms.