Using hybrid MPI and OpenMP programming to optimize communications in parallel loop self-scheduling schemes for multicore PC clusters

  • Authors:

  • Chao-Chin Wu;Lien-Fu Lai;Chao-Tung Yang;Po-Hsun Chiu

  • Affiliations:

  • Department of Computer Science and Information Engineering, National Changhua University of Education, Changhua City, Taiwan 500;Department of Computer Science and Information Engineering, National Changhua University of Education, Changhua City, Taiwan 500;High-Performance Computing Laboratory, Department of Computer Science and Information Engineering, Tunghai University, Taichung, Taiwan 40704;Department of Computer Science and Information Engineering, National Changhua University of Education, Changhua City, Taiwan 500

  • Venue:
  • The Journal of Supercomputing
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

Recently, a series of parallel loop self-scheduling schemes have been proposed, especially for heterogeneous cluster systems. However, they employed the MPI programming model to construct the applications without considering whether the computing node is multicore architecture or not. As a result, every processor core has to communicate directly with the master node for requesting new tasks no matter the fact that the processor cores on the same node can communicate with each other through the underlying shared memory. To address the problem of higher communication overhead, in this paper we propose to adopt hybrid MPI and OpenMP programming model to design two-level parallel loop self-scheduling schemes. In the first level, each computing node runs an MPI process for inter-node communications. In the second level, each processor core runs an OpenMP thread to execute the iterations assigned for its resident node. Experimental results show that our method outperforms the previous works.