Exploiting Efficient Transpacking for One-Sided Communication and MPI-IO

  • Authors:
  • Faisal Ghias Mir;Jesper Larsson Träff

  • Affiliations:
  • NEC Laboratories Europe, NEC Europe Ltd., Sankt Augustin, Germany D-53757;NEC Laboratories Europe, NEC Europe Ltd., Sankt Augustin, Germany D-53757

  • Venue:
  • Proceedings of the 16th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface
  • Year:
  • 2009

Quantified Score

Hi-index 0.01

Visualization

Abstract

Based on a construction of socalled input-output datatypes that define a mapping between non-consecutive input and output buffers, we outline an efficient method for copying of structured data. We term this operation transpacking , and show how transpacking can be applied for the MPI implementation of one-sided communication and MPI-IO. For one-sided communication via shared-memory, we demonstrate the expected performance improvements by up to a factor of two. For individual MPI-IO, the time to read or write from file dominates the overall time, but even here efficient transpacking can in some scenarios reduce file I/O time considerably. The reported results have been achieved on a single NEC SX-8 vector node.