MPI-IO/L: efficient remote I/O for MPI-IO via logistical networking

  • Authors:
  • Jonghyun Lee;Robert Ross;Scott Atchley;Micah Beck;Rajeev Thakur

  • Affiliations:
  • Argonne National Laboratory, Math. and Comp. Sci. Div., Argonne, IL;Argonne National Laboratory, Math. and Comp. Sci. Div., Argonne, IL;Myricom, Inc., Oak Ridge, TN;University of Tennessee, Dept. of Comp. Sci., Knoxville, TN;Argonne National Laboratory, Math. and Comp. Sci. Div., Argonne, IL

  • Venue:
  • IPDPS'06 Proceedings of the 20th international conference on Parallel and distributed processing
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

Scientific applications often need to access remotely located files, but many remote I/O systems lack standard APIs that allow efficient and direct access from application codes. This work presents MPI-IO/L, a remote I/O facility for MPI-IO using Logistical Networking. This combination not only provides high-performance and direct remote I/O using the standard parallel I/O interface but also offers convenient management and sharing of remote files. We show the performance trade-offs with various remote I/O approaches implemented in the system, which can help scientists identify preferable I/O options for their own applications. We also discuss how Logistical Networking could be improved to work better with parallel I/O systems such as ROMIO.