Enabling low-overhead hybrid MPI/OpenMP parallelism with MPC

  • Authors:
  • Patrick Carribault;Marc Pérache;Hervé Jourdren

  • Affiliations:
  • CEA, DAM, DIF, Arpajon, France;CEA, DAM, DIF, Arpajon, France;CEA, DAM, DIF, Arpajon, France

  • Venue:
  • IWOMP'10 Proceedings of the 6th international conference on Beyond Loop Level Parallelism in OpenMP: accelerators, Tasking and more
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

With the advent of multicore- and manycore-based supercomputers, parallel programming models like MPI and OpenMP become more widely used to express various levels of parallelism in applications. But even though combining multiple models is possible, the resulting performance may not reach expected results. This is mainly due to collaboration issues between the runtime implementations. In this paper, we introduce an extended taxonomy of hybrid MPI/OpenMP programming and a new module to the MPC framework handling a fully 2.5-compliant OpenMP runtime completely integrated to an MPI 1.3 implementation. The design and implementation guidelines enable two features: (i) built-in oversubscribing capabilities with performance comparable to state-of-the-art implementations on pure OpenMP benchmarks and programs, and (ii) the possibility to run hybrid MPI/OpenMP applications with a limited overhead due to the mix of two different programming models.