Fortran M: a language for modular parallel programming
Journal of Parallel and Distributed Computing
Modeling the benefits of mixed data and task parallelism
Proceedings of the seventh annual ACM symposium on Parallel algorithms and architectures
Early prediction of MPP performance: the SP2, T3D, and Paragon experiences
Parallel Computing
A new model for integrated nested task and data parallel programming
PPOPP '97 Proceedings of the sixth ACM SIGPLAN symposium on Principles and practice of parallel programming
Models and languages for parallel computation
ACM Computing Surveys (CSUR)
A Programming Methodology for Dual-Tier Multicomputers
IEEE Transactions on Software Engineering - Special issue on architecture-independent languages and software tools for parallel processing
NestStep: Nested Parallelism and Virtual Shared Memory for the BSP Model
The Journal of Supercomputing
Double standards: bringing task parallelism to HPF via the message passing interface
Supercomputing '96 Proceedings of the 1996 ACM/IEEE conference on Supercomputing
Approaches for Integrating Task and Data Parallelism
IEEE Concurrency
PARADIGM (version 2.0): A New HPF Compilation System
IPPS '99/SPDP '99 Proceedings of the 13th International Symposium on Parallel Processing and the 10th Symposium on Parallel and Distributed Processing
Euro-Par '96 Proceedings of the Second International Euro-Par Conference on Parallel Processing - Volume I
Simultaneous exploitation of task and data parallelism in regular scientific applications
Simultaneous exploitation of task and data parallelism in regular scientific applications
A programming model for block-structured scientific calculations on smp clusters
A programming model for block-structured scientific calculations on smp clusters
Irregular Coarse-Grain Data Parallelism under LPARX
Scientific Programming
M-Task-Programming for Heterogeneous Systems and Grid Environments
IPDPS '05 Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS'05) - Workshop 4 - Volume 05
A Data-Re-Distribution Library for Multi-Processor Task Programming
IPDPS '05 Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS'05) - Workshop 8 - Volume 09
Combining building blocks for parallel multi-level matrix multiplication
Parallel Computing
Communicating Multiprocessor-Tasks
Languages and Compilers for Parallel Computing
NestStepModelica: mathematical modeling and bulk-synchronous parallel simulation
PARA'06 Proceedings of the 8th international conference on Applied parallel computing: state of the art in scientific computing
Anticipated distributed task scheduling for grid environments
IPDPS'06 Proceedings of the 20th international conference on Parallel and distributed processing
Modeling the energy consumption for concurrent executions of parallel tasks
Proceedings of the 14th Communications and Networking Symposium
Component-based programming techniques for coarse-grained parallelism
Proceedings of the 19th High Performance Computing Symposia
Design and evaluation of a parallel data redistribution component for TGrid
ISPA'06 Proceedings of the 4th international conference on Parallel and Distributed Processing and Applications
Programming support and scheduling for communicating parallel tasks
Journal of Parallel and Distributed Computing
Combined scheduling and mapping for scalable computing with parallel tasks
Scientific Programming - Biological Knowledge Discovery and Data Mining
| Hi-index | 0.00 |
The paper considers the modular programming with hierarchically structured multi-processor tasks on top of SPMD tasks for distributed memory machines. The parallel execution requires a corresponding decomposition of the set of processors into a hierarchical group structure onto which the tasks are mapped. The result is a multi-level group SPMD computation model with varying processor group structures. The advantage of this kind of mixed task and data parallelism is a potential to reduce the communication overhead and to increase scalability. We present a runtime library to support the coordination of hierarchically structured multi-processor tasks. The library exploits an extended parallel group SPMD programming model and manages the entire task execution including the dynamic hierarchy of processor groups. The library is built on top of MPI, has an easy-to-use interface, and leads to only a marginal overhead while allowing static planning and dynamic restructuring.