Language and Compiler Support for Hybrid-Parallel Programming on SMP Clusters

Authors:
Siegfried Benkner;Viera Sipkova
Affiliations:
Institute for Software Science, University of Vienna, Vienna, Austria A-1090;Institute for Software Science, University of Vienna, Vienna, Austria A-1090
Venue:
ISHPC '02 Proceedings of the 4th International Symposium on High Performance Computing
Year:
2009

Citing 0
Cited 2

Algorithms for memory hierarchies: advanced lectures

Algorithms for memory hierarchies: advanced lectures
Hybrid parallel programming on SMP clusters using XPFortran and OpenMP

IWOMP'10 Proceedings of the 6th international conference on Beyond Loop Level Parallelism in OpenMP: accelerators, Tasking and more

Quantified Score

Hi-index	0.01

Visualization

Abstract

In this paper we present HPF extensions for clusters of SMPs and their implementation within the VFC compiler. The main goal of these extensions is to optimize HPF for clusters of SMPs by enhancing the functionality of the mapping mechanisms and by providing the user with high-level means for controlling key aspects of distributed-memory and shared-memory parallelization. Based on the proposed language extensions, the VFC compiler adopts a hybrid parallelization strategy which closely reflects the hierarchical structure of SMP clusters by exploiting shared-memory parallelism based on OpenMP within nodes and distributed-memory parallelism utilizing MPI across nodes. We describe the language extensions, outline the hybrid parallelization strategy of VFC and present experimental results which show the effectiveness of these techniques.