Efficient implementation of reduce-scatter in MPI

  • Authors:
  • Massimo Bernaschi;Giulio Iannello;Mario Lauria

  • Affiliations:
  • IAC, CNR;Dipartimento di Informatica, e Sistemistica, Università di Napoli;Department of Computer and Information Science, The Ohio State University

  • Venue:
  • EUROMICRO-PDP'02 Proceedings of the 10th Euromicro conference on Parallel, distributed and network-based processing
  • Year:
  • 2002

Quantified Score

Hi-index 0.00

Visualization

Abstract

We discuss the efficient implementation of the MPI collective operation called reduce-scatter. We describe the implementation issues and the performance characterization of two algorithms for the reduce-scatter that have been proven to be highly efficient in theory under the assumption of fully connected parallel system. A performance comparison with existing mainstream implementations of the operation is presented which confirms the practical advantage of the new algorithms. Experiments show that the two algorithms have different characteristics which make them complementary in providing a performance gain over standard algorithms.