Transparent on-demand co-allocation data access for grids

Authors:
Po-/Cheng Chen;Jyh-/Biau Chang;Yi-/Sheng Lin;Ce-/Kuen Shieh;Yi-/Chang Zhuang
Affiliations:
Department of Electrical Engineering, Institute of Computer and Communication Engineering, National Cheng Kung University, Tainan 70101, Taiwan.;Department of Computer Science and Applications, Leader University, Tainan 70970, Taiwan.;Department of Electrical Engineering, Institute of Computer and Communication Engineering, National Cheng Kung University, Tainan 70101, Taiwan.;Department of Electrical Engineering, Institute of Computer and Communication Engineering, National Cheng Kung University, Tainan 70101, Taiwan.;Home Network Technology Center, Industrial Technology Research Institute&#/#/47/South, Tainan 70955, Taiwan
Venue:
International Journal of Ad Hoc and Ubiquitous Computing
Year:
2010

Citing 14
Cited 0

The network weather service: a distributed resource performance forecasting service for metacomputing

Future Generation Computer Systems - Special issue on metacomputing
The SDSC storage resource broker

CASCON '98 Proceedings of the 1998 conference of the Centre for Advanced Studies on Collaborative research
A Simple Mass Storage System for the SRB Data Grid

MSS '03 Proceedings of the 20 th IEEE/11 th NASA Goddard Conference on Mass Storage Systems and Technologies (MSS'03)
Grid Datafarm Architecture for Petascale Data Intensive Computing

CCGRID '02 Proceedings of the 2nd IEEE/ACM International Symposium on Cluster Computing and the Grid
Enabling the Co-Allocation of Grid Data Transfers

GRID '03 Proceedings of the 4th International Workshop on Grid Computing
Downloading Replicated, Wide-Area Files - A Framework and Empirical Evaluation

NCA '04 Proceedings of the Network Computing and Applications, Third IEEE International Symposium
Parallel and Distributed Astronomical Data Analysis on Grid Datafarm

GRID '04 Proceedings of the 5th IEEE/ACM International Workshop on Grid Computing
The Livny and Plank-Beck Problems: Studies in Data Movement on the Computational Grid

Proceedings of the 2003 ACM/IEEE conference on Supercomputing
NFSv4 replication for grid storage middleware

Proceedings of the 4th international workshop on Middleware for grid computing
Production Storage Resource Broker Data Grids

E-SCIENCE '06 Proceedings of the Second IEEE International Conference on e-Science and Grid Computing
Complete and fragmented replica selection and retrieval in Data Grids

Future Generation Computer Systems
Efficient reuse of replicated parallel data segments in computational grids

Future Generation Computer Systems
A replicated file system for Grid computing

Concurrency and Computation: Practice & Experience - Middleware for Grid Computing: Future Trends (MGC2006)
Replica selection on co-allocation data grids

ISPA'04 Proceedings of the Second international conference on Parallel and Distributed Processing and Applications

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents a data sharing system called On-Demand data Co-Allocation (ODCA). ODCA integrates the advantages of the co-allocation concepts with the conventional on-demand data access scheme. It transfers the necessary file fragments from multiple data sources only when the application demands, thereby reducing data transmission time, wasted network bandwidth and required storage space. Moreover, it facilitates legacy applications to transparently access distributed grid data by using the native I/O system calls. The experimental results indicate that ODCA achieves superior performance in the turnaround time of data-intensive applications than the pre-staging and the on-demand access schemes.