MPI on the I-WAY: A Wide-Area, Multimethod Implementation of the Message Passing Interface

  • Authors:
  • Ian T. Foster;David R. Kohr Jr;Rakesh Krishnaiyer;Alok Choudhary

  • Affiliations:
  • -;-;-;-

  • Venue:
  • MPIDC '96 Proceedings of the Second MPI Developers Conference
  • Year:
  • 1996

Quantified Score

Hi-index 0.00

Visualization

Abstract

Data-parallel languages such as High Performance Fortran (HPF) present a simple execution model in which a single thread of control performs high-level operations on distributed arrays. These languages can greatly ease the development of parallel programs. Yet there are large classes of applications for which a mixture of task and data parallelism is most appropriate. Such applications can be structured as collections of data-parallel tasks that communicate by using explicit message passing. Because the Message Passing Interface (MPI) defines standardized, familiar mechanisms for this communication model, we propose that HPF tasks communicate by making calls to a coordination library that provides an HPF binding for MPI. The semantics of a communication interface for sequential languages can be ambiguous when the interface is invoked from a parallel language; we show how these ambiguities can be resolved by describing one possible HPF binding for MPI. We then present the design of a library that implements this binding, discuss issues that influenced our design decisions, and evaluate the performance of a prototype HPF/MPI library using a communications microbenchmark and application kernel. Finally, we discuss how other MPI features might be incorporated into our design framework.