Portable explicit threading and concurrent programming for MPI applications

Authors:
Tobias Berka;Helge Hagenauer;Marian Vajteršic
Affiliations:
Department of Computer Sciences, University of Salzburg, Salzburg, Austria;Department of Computer Sciences, University of Salzburg, Salzburg, Austria;Department of Computer Sciences, University of Salzburg, Salzburg, Austria, Department of Informatics, Mathematical Institute, Slovak Academy of Sciences, Bratislava, Slovakia
Venue:
PPAM'11 Proceedings of the 9th international conference on Parallel Processing and Applied Mathematics - Volume Part II
Year:
2011

Citing 14
Cited 1

OpenMP: An Industry-Standard API for Shared-Memory Programming

IEEE Computational Science & Engineering
Threads cannot be implemented as a library

Proceedings of the 2005 ACM SIGPLAN conference on Programming language design and implementation
Concurrent urban legends: Research Articles

Concurrency and Computation: Practice & Experience
Automatic thread distribution for nested parallelism in OpenMP

Proceedings of the 19th annual international conference on Supercomputing
A UPC Runtime System Based on MPI and POSIX Threads

PDP '06 Proceedings of the 14th Euromicro International Conference on Parallel, Distributed, and Network-Based Processing
Development of mixed mode MPI / OpenMP applications

Scientific Programming
Cray XT4: an early evaluation for petascale scientific simulation

Proceedings of the 2007 ACM/IEEE conference on Supercomputing
Performance Evaluation of MPI, UPC and OpenMP on Multicore Architectures

Proceedings of the 16th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface
The International Exascale Software Project: a Call To Cooperative Action By the Global High-Performance Community

International Journal of High Performance Computing Applications
Test suite for evaluating performance of multithreaded MPI communication

Parallel Computing
Fine-Grained Multithreading Support for Hybrid Threaded MPI Programming

International Journal of High Performance Computing Applications
A new technique for data privatization in user-level threads and its use in parallel applications

Proceedings of the 2010 ACM Symposium on Applied Computing
Early experiments with the OpenMP/MPI hybrid programming model

IWOMP'08 Proceedings of the 4th international conference on OpenMP in a new era of parallelism
Can MPI be used for persistent parallel services?

EuroPVM/MPI'06 Proceedings of the 13th European PVM/MPI User's Group conference on Recent advances in parallel virtual machine and message passing interface

Concurrent programming constructs for parallel MPI applications

The Journal of Supercomputing

Quantified Score

Hi-index	0.00

Visualization

Abstract

New applications for parallel computing in today's data centers, such as online analytical processing, data mining or information retrieval, require support for concurrency. Due to online query processing and multi-user operation, we need to concurrently maintain and analyze the data. While the Portable Operating System Interface (POSIX) defines a thread interface that is widely available, and while modern implementations of the Message Passing Interface (MPI) support threading, this combination is lacking in safety, security and reliability. The development of such parallel applications is therefore complex, difficult and error-prone. In response to this, we propose an additional layer of middleware for threaded MPI applications designed to simplify the development of concurrent parallel programs. We formulate a list of requirements and sketch a design rationale for such a library. Based on a prototype implementation, we evaluate the run-time overhead to estimate the overhead caused by the additional layer of indirection.