Pattern-independent detection of manual collectives in MPI programs

  • Authors:
  • Alexandru Calotoiu;Christian Siebert;Felix Wolf

  • Affiliations:
  • German Research School for Simulation Sciences, Aachen, Germany, Computer Science Department, RWTH Aachen University, Aachen, Germany;German Research School for Simulation Sciences, Aachen, Germany, Computer Science Department, RWTH Aachen University, Aachen, Germany;German Research School for Simulation Sciences, Aachen, Germany, Computer Science Department, RWTH Aachen University, Aachen, Germany, Forschungszentrum Jülich, Jülich Supercomputing Cen ...

  • Venue:
  • Euro-Par'12 Proceedings of the 18th international conference on Parallel Processing
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

In parallel applications, a significant amount of communication occurs in a collective fashion to perform, for example, broadcasts, reductions, or complete exchanges. Although the MPI standard defines many convenience functions for this purpose, which not only improve code readability and maintenance but are usually also highly efficient, many application programmers still create their own, manual implementations using point-to-point communication. We show how instances of such hand-crafted collectives can be automatically detected. Matching pre- and post-conditions of hashed message exchanges recorded in event traces, our method is independent of the specific communication pattern employed. We demonstrate that replacing detected broadcasts in the HPL benchmark can yield significant performance improvements.