Improvement of the bandwidth of cross-site MPI communication using optical fiber

  • Authors:
  • Kiril Dichev;Alexey Lastovetsky;Vladimir Rychkov

  • Affiliations:
  • UCD School of Computer Science and Informatics, University College Dublin, Belfield, Dublin, Ireland;UCD School of Computer Science and Informatics, University College Dublin, Belfield, Dublin, Ireland;UCD School of Computer Science and Informatics, University College Dublin, Belfield, Dublin, Ireland

  • Venue:
  • EuroMPI'11 Proceedings of the 18th European MPI Users' Group conference on Recent advances in the message passing interface
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

We perform a set of communication experiments spanning multiple sites on the heterogeneous Grid'5000 infrastructure in France. The backbone widely employs high-band width optical fiber. Experiments with point-to-point MPI communications across sites show much lower band width than expected for the optical fiber connections. This work proposes and tests an alternative implementation of cross-site point-to-point communication, exploiting the observation that a higher band width can be reached when transferring TCP messages in parallel. It spawns additional MPI processes for point-to-point communication and significantly improves the band width for large messages. The approach comes closer to the maximum band width measured without using MPI.