Key Message Approach to Optimize Communication of Parallel Applications on Clusters

  • Authors:
  • Ming Zhu;Wentong Cai;Bu-Sung Lee

  • Affiliations:
  • Parallel and Distributed Computing Center, School of Computer Engineering, Nanyang Technological University, Singapore 639798;Parallel and Distributed Computing Center, School of Computer Engineering, Nanyang Technological University, Singapore 639798;Parallel and Distributed Computing Center, School of Computer Engineering, Nanyang Technological University, Singapore 639798

  • Venue:
  • Cluster Computing
  • Year:
  • 2003

Quantified Score

Hi-index 0.00

Visualization

Abstract

Over the past few years, cluster/distributed computing has been gaining popularity. The proliferation of the cluster/distributed computing is due to the improved performance and increased reliability of these systems. Many parallel programming languages and related parallel programming models have become widely accepted. However, one of the major shortcomings of running parallel applications on cluster/distributed computing environments is the high communication overhead incurred. To reduce the communication overhead, and thus the completion time of a parallel application, this paper describes a simple, efficient and portable Key Message (KM) approach to support parallel computing on cluster/distributed computing environments. To demonstrate the advantage of the KM approach, a prototype runtime system has been implemented and evaluated. Our preliminary experimental results show that the KM approach has better improvement on communication of a parallel application when network background load increases or the computation to communication ratio of the application decreases.