Optimizing communications of data parallel programs in scalable cluster systems

Authors:
Chun-Ching Wang;Shih-Chang Chen;Ching-Hsien Hsu;Chao-Tung Yang
Affiliations:
SoC Technology Center, Industrial Technology Research Institute, Hsinchu, Taiwan;Institute of Engineering and Science, Chung Hua University, Hsinchu, Taiwan;Department of Computer Science and Information Engineering, Chung Hua University, Hsinchu, Taiwan;High-Performance Computing Laboratory, Department of Computer Science and Information Engineering, Tunghai University, Taichung, Taiwan
Venue:
GPC'08 Proceedings of the 3rd international conference on Advances in grid and pervasive computing
Year:
2008

Citing 12
Cited 0

Processor Mapping Techniques Toward Efficient Data Redistribution

IEEE Transactions on Parallel and Distributed Systems
The grid: blueprint for a new computing infrastructure

The grid: blueprint for a new computing infrastructure
Processor reordering algorithms toward efficient GEN_BLOCK redistribution

Proceedings of the 2001 ACM symposium on Applied computing
A Framework for Efficient Data Redistribution on Distributed Memory Multicomputers

The Journal of Supercomputing
Distribution Assignment Placement: Effective Optimization of Redistribution Costs

IEEE Transactions on Parallel and Distributed Systems
Condor-G: A Computation Management Agent for Multi-Institutional Grids

Cluster Computing
Building an Open Grid

NCA '03 Proceedings of the Second IEEE International Symposium on Network Computing and Applications
Optimal Algorithms for Scheduling Divisible Workloads on Heterogeneous Systems

IPDPS '03 Proceedings of the 17th International Symposium on Parallel and Distributed Processing
Key Message Algorithm: A Communication Optimization Algorithm in Cluster-Based Parallel Computing

IWCC '99 Proceedings of the 1st IEEE Computer Society International Workshop on Cluster Computing
Optimizing User-Level Communication Patterns on the Fujitsu AP3000

IWCC '99 Proceedings of the 1st IEEE Computer Society International Workshop on Cluster Computing
Optimizing Parallel Applications for Wide-Area Clusters

IPPS '98 Proceedings of the 12th. International Parallel Processing Symposium on International Parallel Processing Symposium
Localization techniques for cluster-based data grid

ICA3PP'05 Proceedings of the 6th international conference on Algorithms and Architectures for Parallel Processing

Quantified Score

Hi-index	0.00

Visualization

Abstract

With the improvement of personal computers and high-speed network, clusters have become the trend in designing high performance computing environments. As the researches of relative hardware and software technology of Cluster and Grid are constantly improved, the application of Cluster is growing popular. Due to information progress and increasing calculation capacity required by all kind of applications; the calculation has also extended to cross-network calculation. Through the Internet, which connects several Clusters, the mass calculation platform is combined into Cluster Grid. As a result of data partition and exchange that may happen during the executing program, communication localization becomes important in programming efficiency. This paper, then, proposes a mathematical method which achieves excellent data partitioning and maintains data calculation in local environment. We also conduct some theoretical analysis on the amounts of computing nodes and data partition in the hope of being applied to practical parallel environment and further to reduce communication cost.