A dynamic adjustment strategy for file transformation in data grids

Authors:
Chao-Tung Yang;Shih-Yu Wang;Chun-Pin Fu
Affiliations:
High-Performance Computing Laboratory, Department of Computer Science and Information Engineering, Tunghai University, Taichung, Taiwan;High-Performance Computing Laboratory, Department of Computer Science and Information Engineering, Tunghai University, Taichung, Taiwan;High-Performance Computing Laboratory, Department of Computer Science and Information Engineering, Tunghai University, Taichung, Taiwan
Venue:
NPC'07 Proceedings of the 2007 IFIP international conference on Network and parallel computing
Year:
2007

Citing 21
Cited 4

The network weather service: a distributed resource performance forecasting service for metacomputing

Future Generation Computer Systems - Special issue on metacomputing
File and Object Replication in Data Grids

Cluster Computing
Data management and transfer in high-performance computational grid environments

Parallel Computing - Parallel data-intensive algorithms and applications
Predicting the Performance of Wide Area Data Transfers

IPDPS '02 Proceedings of the 16th International Parallel and Distributed Processing Symposium
Giggle: a framework for constructing scalable replica location services

Proceedings of the 2002 ACM/IEEE conference on Supercomputing
Replica Selection in the Globus Data Grid

CCGRID '01 Proceedings of the 1st International Symposium on Cluster Computing and the Grid
Resource Co-Allocation in Computational Grids

HPDC '99 Proceedings of the 8th IEEE International Symposium on High Performance Distributed Computing
Predicting Sporadic Grid Data Transfers

HPDC '02 Proceedings of the 11th IEEE International Symposium on High Performance Distributed Computing
A Performance Study of Monitoring and Information Services for Distributed Systems

HPDC '03 Proceedings of the 12th IEEE International Symposium on High Performance Distributed Computing
Secure, Efficient Data Transport and Replica Management for High-Performance Data-Intensive Computing

MSS '01 Proceedings of the Eighteenth IEEE Symposium on Mass Storage Systems and Technologies
Grid Information Services for Distributed Resource Sharing

HPDC '01 Proceedings of the 10th IEEE International Symposium on High Performance Distributed Computing
Enabling the Co-Allocation of Grid Data Transfers

GRID '03 Proceedings of the 4th International Workshop on Grid Computing
The Anatomy of the Grid: Enabling Scalable Virtual Organizations

International Journal of High Performance Computing Applications
Using Regression Techniques to Predict Large Data Transfers

International Journal of High Performance Computing Applications
A taxonomy of Data Grids for distributed data sharing, management, and processing

ACM Computing Surveys (CSUR)
Implementation of a dynamic adjustment mechanism with efficient replica selection in data grid environments

Proceedings of the 2006 ACM symposium on Applied computing
A Domain-Based Model for Efficient Measurement of Network Information on Grid Computing Environments

IEICE - Transactions on Information and Systems
Improvements on dynamic adjustment mechanism in co-allocation data grid environments

The Journal of Supercomputing
Introduction to grid computing with globus

Introduction to grid computing with globus
A recursive-adjustment co-allocation scheme in data grid environments

ICA3PP'05 Proceedings of the 6th international conference on Algorithms and Architectures for Parallel Processing
Performance analysis of applying replica selection technology for data grid environments

PaCT'05 Proceedings of the 8th international conference on Parallel Computing Technologies

Enhancement of anticipative recursively adjusting mechanism for redundant parallel file transfer in data grids

Journal of Network and Computer Applications
File replication, maintenance, and consistency management services in data grids

The Journal of Supercomputing
Implementation of a dynamic adjustment strategy for parallel file transfer in co-allocation data grids

The Journal of Supercomputing
A medical image file accessing system with virtualization fault tolerance on cloud

GPC'12 Proceedings of the 7th international conference on Advances in Grid and Pervasive Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we propose a dynamic file transfer scheme with coallocation architecture, called Dynamic Adjustment Strategy, a dynamic file transfer scheme with co-allocation architecture that reduce the file transfer times and improves the performance in Data Grid environments. Our approach reduces the idle time faster servers spend waiting for the slowest server, and decreases file transfer completion time. We also present a new toolkit, called Cyber-Transformer, with a friendly graphical user interface interface running on the client side that makes it easy for inexperienced users to manage replicas and download the files in Data Grid environments. We also provide an effective scheme for reducing the cost of reassembling data blocks.