Compiling Fortran D for MIMD distributed-memory machines
Communications of the ACM
GIVE-N-TAKE—a balanced code placement framework
PLDI '94 Proceedings of the ACM SIGPLAN 1994 conference on Programming language design and implementation
Global communication analysis and optimization
PLDI '96 Proceedings of the ACM SIGPLAN 1996 conference on Programming language design and implementation
A study of the EARTH-MANNA multithreaded system
International Journal of Parallel Programming - Special issue on parallel architectures and compilation techniques—part II
Compiling C for the EARTH multithreaded architecture
International Journal of Parallel Programming - Special issue: selected papers from PACT'96, fourth international conference on parallel architectures and compilation techniques—part 1
Using integer sets for data-parallel program analysis and optimization
PLDI '98 Proceedings of the ACM SIGPLAN 1998 conference on Programming language design and implementation
A General Interprocedural Framework for Placement of Split-Phase Large Latency Operations
IEEE Transactions on Parallel and Distributed Systems
Parallel Programming with Polaris
Computer
Compiler and Runtime Support for Irregular Reductions on a Multithreaded Architecture
IPDPS '02 Proceedings of the 16th International Parallel and Distributed Processing Symposium
MANNA: Prototype of a Distributed Memory Architecture with Maximized Sustained Performance
PDP '96 Proceedings of the 4th Euromicro Workshop on Parallel and Distributed Processing (PDP '96)
Proceedings of the 13th international conference on Architectural support for programming languages and operating systems
| Hi-index | 0.00 |
Communication optimizations play a crucial role in performance of parallel applications which are compiled and executed on distributed memory machines. Multithreaded architectures can support multiple threads of execution on each processor, with low-cost thread initiation, low-overhead communication, and efficient data transfer and synchronization between threads on different processors. These mechanisms can be used for achieving an effective overlap between communication and computation, and therefore, good performance on communication intensive parallel applications.We focus on generating correct and efficient multithreaded code for array based programs that involve different classes of communication patterns. We consider producer-consumer, scalar reductions, and near-neighbor communication patterns. We describe multithreaded programming methodologies suitable for handling loops with each of these patterns. We further show how a compiler can generate threaded code for loops with such patterns.We present experimental results from two benchmark programs, CG, and Tomcatv. Our results show that: 1) the compiler generated multithreaded code achieves high performance, not previously seen from distributed memory compilers, and 2) the performance of compiler generated code is comparable to the performance of hand-written multithreaded codes.