Optimizations of data distribution localities in cluster grid environments

Authors:
Ching-Hsien Hsu;Shih-Chang Chen;Chao-Tung Yang;Kuan-Ching Li
Affiliations:
Department of Computer Science and Information Engineering, Chung Hua University, Hsinchu, Taiwan;Department of Computer Science and Information Engineering, Chung Hua University, Hsinchu, Taiwan;Department of Computer Science and Information Management, Providence University, Taichung, Taiwan;Department of Computer Science and Information Engineering, Tunghai University, Taichung, Taiwan
Venue:
ICCSA'05 Proceedings of the 2005 international conference on Computational Science and Its Applications - Volume Part IV
Year:
2005

Citing 16
Cited 0

Processor Mapping Techniques Toward Efficient Data Redistribution

IEEE Transactions on Parallel and Distributed Systems
The grid: blueprint for a new computing infrastructure

The grid: blueprint for a new computing infrastructure
Processor reordering algorithms toward efficient GEN_BLOCK redistribution

Proceedings of the 2001 ACM symposium on Applied computing
A Framework for Efficient Data Redistribution on Distributed Memory Multicomputers

The Journal of Supercomputing
Distribution Assignment Placement: Effective Optimization of Redistribution Costs

IEEE Transactions on Parallel and Distributed Systems
Condor-G: A Computation Management Agent for Multi-Institutional Grids

Cluster Computing
Resource Allocation for Steerable Parallel Parameter Searches

GRID '02 Proceedings of the Third International Workshop on Grid Computing
Dynamic, Reliability-Driven Scheduling of Parallel Real-Time Jobs in Heterogeneous Systems

ICPP '02 Proceedings of the 2001 International Conference on Parallel Processing
Mapping Functions and Data Redistribution for Parallel Files

IPDPS '02 Proceedings of the 16th International Parallel and Distributed Processing Symposium
Scheduling of Periodic Time Critical Applications for Pipelined Execution on Heterogeneous Systems

ICPP '02 Proceedings of the 2001 International Conference on Parallel Processing
Sensitivity of Parallel Applications to Large Differences in Bandwidth and Latency in Two-Layer Interconnects

HPCA '99 Proceedings of the 5th International Symposium on High Performance Computer Architecture
Building an Open Grid

NCA '03 Proceedings of the Second IEEE International Symposium on Network Computing and Applications
Optimal Algorithms for Scheduling Divisible Workloads on Heterogeneous Systems

IPDPS '03 Proceedings of the 17th International Symposium on Parallel and Distributed Processing
Key Message Algorithm: A Communication Optimization Algorithm in Cluster-Based Parallel Computing

IWCC '99 Proceedings of the 1st IEEE Computer Society International Workshop on Cluster Computing
Optimizing User-Level Communication Patterns on the Fujitsu AP3000

IWCC '99 Proceedings of the 1st IEEE Computer Society International Workshop on Cluster Computing
Optimizing Parallel Applications for Wide-Area Clusters

IPPS '98 Proceedings of the 12th. International Parallel Processing Symposium on International Parallel Processing Symposium

Quantified Score

Hi-index	0.00

Visualization

Abstract

The advent of widely interconnected computing resources introduces the technologies of ubiquitous computing, peer to peer computing and grid computing. In this paper, we present an efficient data distribution scheme for optimizing data localities of SPMD data parallel programs on cluster grid, a typical computational grid environment consists of several clusters located in multiple campuses that distributed globally over the Internet. Because of the Internet infrastructure of cluster grid, the communication overhead becomes as key factor to the performance of parallel applications. Effectiveness of the proposed distribution mechanism is to reduce inter-cluster communication overheads and to speed the execution of data parallel programs in the underlying distributed cluster grid. The theoretical analysis and experimental results show improvement of communication costs and scalable of the proposed techniques on different hierarchical cluster grids.