Analytic Queueing Network Models for Parallel Processing of Task Systems
IEEE Transactions on Computers
Algorithmic skeletons: structured management of parallel computation
Algorithmic skeletons: structured management of parallel computation
Analytical performance prediction on multicomputers
Proceedings of the 1993 ACM/IEEE conference on Supercomputing
Analyzing the behavior and performance of parallel programs
Analyzing the behavior and performance of parallel programs
Performance prediction and tuning of parallel programs
Performance prediction and tuning of parallel programs
Adaptive performance prediction for distributed data-intensive applications
SC '99 Proceedings of the 1999 ACM/IEEE conference on Supercomputing
Proceedings of the 2001 ACM/IEEE conference on Supercomputing
Predicting Performance of Parallel Computations
IEEE Transactions on Parallel and Distributed Systems
Data Management in an International Data Grid Project
GRID '00 Proceedings of the First IEEE/ACM International Workshop on Grid Computing
Predicting the Performance of Wide Area Data Transfers
IPDPS '02 Proceedings of the 16th International Parallel and Distributed Processing Symposium
Predicting Queue Times on Space-Sharing Parallel Computers
IPPS '97 Proceedings of the 11th International Symposium on Parallel Processing
Predicting Application Run Times Using Historical Information
IPPS/SPDP '98 Proceedings of the Workshop on Job Scheduling Strategies for Parallel Processing
The SDSC storage resource broker
CASCON '98 Proceedings of the 1998 conference of the Centre for Advanced Studies on Collaborative research
The Globus Project: A Status Report
HCW '98 Proceedings of the Seventh Heterogeneous Computing Workshop
Customized dynamic load balancing for a network of workstations
HPDC '96 Proceedings of the 5th IEEE International Symposium on High Performance Distributed Computing
HPDC '00 Proceedings of the 9th IEEE International Symposium on High Performance Distributed Computing
Distributed Data Access and Resource Management in the D0 SAM System
HPDC '01 Proceedings of the 10th IEEE International Symposium on High Performance Distributed Computing
Performance Prediction in Production Environments
IPPS '98 Proceedings of the 12th. International Parallel Processing Symposium on International Parallel Processing Symposium
Using Disk Throughput Data in Predictions of End-to-End Grid Data Transfers
GRID '02 Proceedings of the Third International Workshop on Grid Computing
Multivariate resource performance forecasting in the network weather service
Proceedings of the 2002 ACM/IEEE conference on Supercomputing
Grid resource management
Proceedings of the 2006 ACM symposium on Applied computing
Complete and fragmented replica selection and retrieval in Data Grids
Future Generation Computer Systems
Improvements on dynamic adjustment mechanism in co-allocation data grid environments
The Journal of Supercomputing
Performance of a GridFTP overlay network
Future Generation Computer Systems
Optimizing center performance through coordinated data staging, scheduling and recovery
Proceedings of the 2007 ACM/IEEE conference on Supercomputing
Timely offloading of result-data in HPC centers
Proceedings of the 22nd annual international conference on Supercomputing
Data transfers in the grid: workload analysis of globus GridFTP
DADC '08 Proceedings of the 2008 international workshop on Data-aware distributed computing
A GridFTP Overlay Network Service
GRID '06 Proceedings of the 7th IEEE/ACM International Conference on Grid Computing
Methods of linear transfer speed estimation in the data grid
Proceedings of the 1st ACM workshop on Data grids for eScience
Journal of Network and Computer Applications
A Recursively-Adjusting Co-allocation scheme with a Cyber-Transformer in Data Grids
Future Generation Computer Systems
Which network measurement tool is right for you? a multidimensional comparison study
GRID '08 Proceedings of the 2008 9th IEEE/ACM International Conference on Grid Computing
Short-term prediction models for server management in Internet-based contexts
Decision Support Systems
Redundant parallel file transfer with anticipative recursively-adjusting scheme in data grids
ICA3PP'07 Proceedings of the 7th international conference on Algorithms and architectures for parallel processing
A fair replica placement for parallel download on cluster grid
NBiS'07 Proceedings of the 1st international conference on Network-based information systems
A dynamic adjustment strategy for file transformation in data grids
NPC'07 Proceedings of the 2007 IFIP international conference on Network and parallel computing
Mixture of ANFIS systems for CPU load prediction in metacomputing environment
Future Generation Computer Systems
The Journal of Supercomputing
A recursive-adjustment co-allocation scheme in data grid environments
ICA3PP'05 Proceedings of the 6th international conference on Algorithms and Architectures for Parallel Processing
Predicting network throughput for grid applications on network virtualization areas
Proceedings of the first international workshop on Network-aware data management
Replica selection on co-allocation data grids
ISPA'04 Proceedings of the Second international conference on Parallel and Distributed Processing and Applications
Modeling throughput sampling size for a cloud-hosted data scheduling and optimization service
Future Generation Computer Systems
| Hi-index | 0.00 |
The increasingly common practice of replicating datasets and using resources as distributed data stores in Grid environments has led to the problem of determining which replica can be accessed most efficiently. Because of diverse performance characteristics and load variations of several components in the end-to-end path linking these various locations, selecting a replica from among many requires accurate prediction information of the data transfer times between the sources and sinks.In this paper we present a prediction system that is based on combining end-to-end application throughput observations and network load variations, capturing whole-systemperformance and variations in load patterns, respectively. We develop a set of regression models to derive predictions that characterize the effect of network load variations on file transfer times. We apply these techniques to the GridFTP data movement tool, part of the Globus Toolkit驴, and observe performance gains of up to 10% in prediction accuracy when compared with approaches based on past system behavior in isolation.