Performance improvement by data management layer in a grid RPC system

Authors:
Yoshiaki Aida;Yoshihiro Nakajima;Mitsuhisa Sato;Tetsuya Sakurai;Daisuke Takahashi;Taisuke Boku
Affiliations:
Department of System and Information Engineering, University of Tsukuba, Ibaraki, Japan;Department of System and Information Engineering, University of Tsukuba, Ibaraki, Japan;Department of System and Information Engineering, University of Tsukuba, Ibaraki, Japan;Department of System and Information Engineering, University of Tsukuba, Ibaraki, Japan;Department of System and Information Engineering, University of Tsukuba, Ibaraki, Japan;Department of System and Information Engineering, University of Tsukuba, Ibaraki, Japan
Venue:
GPC'06 Proceedings of the First international conference on Advances in Grid and Pervasive Computing
Year:
2006

Citing 5
Cited 3

Ninf: A Network Based Information Library for Global World-Wide Computing Infrastructure

HPCN Europe '97 Proceedings of the International Conference and Exhibition on High-Performance Computing and Networking
The internet backplane protocol: a study in resource sharing

Future Generation Computer Systems - Selected papers from CCGRID 2002
Grid Datafarm Architecture for Petascale Data Intensive Computing

CCGRID '02 Proceedings of the 2nd IEEE/ACM International Symposium on Cluster Computing and the Grid
Performance Evaluation of OmniRPC in a Grid Environment

SAINT-W '04 Proceedings of the 2004 Symposium on Applications and the Internet-Workshops (SAINT 2004 Workshops)
Data Management in Grid Applications Providers

DFMA '05 Proceedings of the First International Conference on Distributed Frameworks for Multimedia Applications

A parallel method for large sparse generalized eigenvalue problems using a GridRPC system

Future Generation Computer Systems
Performance Evaluation of Data Management Layer by Data Sharing Patterns for Grid RPC Applications

Euro-Par '08 Proceedings of the 14th international Euro-Par conference on Parallel Processing
Resolution of large symmetric eigenproblems on a world-wide grid

International Journal of Grid and Utility Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

A grid RPC system provides a useful and intuitive programming interface for master-worker type applications in a grid environment. In many grid applications, such as parameter search programs, both master and workers are often required to have a large amount of common data. Since in the RPC model the data must be transferred from the master directly to each worker, the master is sometimes a bottleneck, resulting in poor performance. In order to improve the performance in such cases, we propose a model to decouple the data transfer by a data management layer from the RPC programming. We have designed and implemented a prototype data transfer layer called OmniStorage to OmniRPC, which is a grid RPC system for parallel programming in a grid environment. This allows efficient data transmission of a large amount of data by placing intermediate relay servers, taking the network topology into account, to route the communication and cache the common data in the server. We have evaluated the performance of the proposed system by using synthetic workloads and a real grid application. The results show that OmniStorage can improve the performance of OmniRPC applications compared to the case of using only OmniRPC.