Compiler and runtime support for out-of-core HPF programs

  • Authors:

  • Rajeev Thakur;Rajesh Bordawekar;Alok Choudhary

  • Affiliations:

  • Dept. of Electrical and Computer Eng. and Northeast Parallel Architectures Center, Syracuse University, Syracuse, NY;Dept. of Electrical and Computer Eng. and Northeast Parallel Architectures Center, Syracuse University, Syracuse, NY;Dept. of Electrical and Computer Eng. and Northeast Parallel Architectures Center, Syracuse University, Syracuse, NY

  • Venue:
  • ICS '94 Proceedings of the 8th international conference on Supercomputing
  • Year:
  • 1994

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper describes the design of a compiler which can translate out-of-core programs written in a data parallel language like HPF. Such a compiler is required for compiling large scale scientific applications, such as the Grand Challenge applications, which deal with enormous quantities of data. We propose a framework by which a compiler together with appropriate runtime support can translate an out-of-core HPF program to a message passing node program with explicit parallel I/O. We describe the basic model of the compiler and the various transformations made by the compiler. We also discuss the runtime routines used by the compiler for I/O and communication. In order to minimize I/O, the runtime support system can reuse data already fetched into memory. The working of the compiler is illustrated using two out-of-core applications, namely a Laplace equation solver and LU Decomposition, together with performance results on the Intel Touchstone Delta.