Improving the performance of OpenMP by array privatization

Authors:
Zhenying Liu;Barbara Chapman;Tien-Hsiung Weng;Oscar Hernandez
Affiliations:
Department of Computer Science, University of Houston;Department of Computer Science, University of Houston;Department of Computer Science, University of Houston;Department of Computer Science, University of Houston
Venue:
WOMPAT'03 Proceedings of the OpenMP applications and tools 2003 international conference on OpenMP shared memory parallel programming
Year:
2003

Citing 10
Cited 7

Interprocedural compilation of Fortran D for MIMD distributed-memory machines

Proceedings of the 1992 ACM/IEEE conference on Supercomputing
An optimizing Fortran D compiler for MIMD distributed-memory machines

An optimizing Fortran D compiler for MIMD distributed-memory machines
Is data distribution necessary in OpenMP?

Proceedings of the 2000 ACM/IEEE conference on Supercomputing
Scaling irregular parallel codes with minimal programming effort

Proceedings of the 2001 ACM/IEEE conference on Supercomputing
Global arrays: a portable "shared-memory" programming model for distributed memory computers

Proceedings of the 1994 ACM/IEEE conference on Supercomputing
Simultaneous Multithreading: A Platform for Next-Generation Processors

IEEE Micro
Automatic Array Privatization

Proceedings of the 6th International Workshop on Languages and Compilers for Parallel Computing
Extending OpenMP for NUMA machines

Scientific Programming
Cluster-enabled OpenMP: An OpenMP compiler for the SCASH software distributed shared memory system

Scientific Programming
Compiler optimization techniques for OpenMP programs

Scientific Programming

Towards a more efficient implementation of OpenMP for clusters via translation to global arrays

Parallel Computing - OpenMp
An extended OpenMP targeting on the hybrid architecture of SMP-cluster

ACST'06 Proceedings of the 2nd IASTED international conference on Advances in computer science and technology
Towards optimisation of openMP codes for synchronisation and data reuse

International Journal of High Performance Computing and Networking
Analyses for the translation of OpenMP codes into SPMD style with array privatization

WOMPAT'03 Proceedings of the OpenMP applications and tools 2003 international conference on OpenMP shared memory parallel programming
A tool to display array access patterns in OpenMP programs

PARA'04 Proceedings of the 7th international conference on Applied Parallel Computing: state of the Art in Scientific Computing
Dragon: a static and dynamic tool for OpenMP

WOMPAT'04 Proceedings of the 5th international conference on OpenMP Applications and Tools: shared Memory Parallel Programming with OpenMP
Efficient implementation of OpenMP for clusters with implicit data distribution

WOMPAT'04 Proceedings of the 5th international conference on OpenMP Applications and Tools: shared Memory Parallel Programming with OpenMP

Quantified Score

Hi-index	0.00

Visualization

Abstract

The scalability of an OpenMP program in a ccNUMA system with a large number of processors suffers from remote memory accesses, cache misses and false sharing. Good data locality is needed to overcome these problems whereas OpenMP offers limited capabilities to control it on ccNUMA architecture. A so-called SPMD style OpenMP program can achieve data locality by means of array privatization, and this approach has shown good performance in previous research. It is hard to write SPMD OpenMP code; therefore we are building a tool to relieve users from this task by automatically converting OpenMP programs into equivalent SPMD style OpenMP. We show the process of the translation by considering how to modify array declarations, parallel loops, and showing how to handle a variety of OpenMP constructs including REDUCTION, ORDERED clauses and synchronization. We are currently implementing these translations in an interactive tool based on the Open64 compiler.