Non-collective parallel I/O for global address space programming models

  • Authors:
  • Sriram Krishnamoorthy;Juan Piernas Canovas;Vinod Tipparaju;Jarek Nieplocha;P. Sadayappan

  • Affiliations:
  • Dept. of Computer Science and Engineering, The Ohio State University, 395 Dreese Labs, 2015 Neil Ave, Columbus, USA;Computational Sciences and Mathematics, Pacific Northwest National Laboratory Richland, WA USA;Computational Sciences and Mathematics, Pacific Northwest National Laboratory Richland, WA USA;Computational Sciences and Mathematics, Pacific Northwest National Laboratory Richland, WA USA;Dept. of Computer Science and Engineering, The Ohio State University, 395 Dreese Labs, 2015 Neil Ave, Columbus, USA

  • Venue:
  • CLUSTER '07 Proceedings of the 2007 IEEE International Conference on Cluster Computing
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

Achieving high performance for out-of-core applications typically involves explicit management of the movement of data between the disk and the physical memory. We are developing a programming environment in which the different levels of the memory hierarchy are handled efficiently in a unified transparent framework. In this paper, we present our experiences with implementing efficient non-collective I/O (GPCIO) as part of this framework. As a generalization of the Remote Procedure Call (RPC) that was used as a foundation for the Sun NFS system, we developed a global procedure call (GPC) to invoke procedures on a remote node to handle non-collective I/O. We consider alternative approaches that can be employed in implementing this functionality. The approaches are evaluated using a representative computation from quantum chemistry. The results demonstrate that GPC-IO achieves better absolute execution times, strong-scaling, and weak-scaling than the alternatives considered.