Fat-trees: universal networks for hardware-efficient supercomputing
IEEE Transactions on Computers
Future Generation Computer Systems - Special issue on metacomputing
Condor: a distributed job scheduler
Beowulf cluster computing with Linux
Simulation of Dynamic Grid Replication Strategies in OptorSim
GRID '02 Proceedings of the Third International Workshop on Grid Computing
Identifying Dynamic Replication Strategies for a High-Performance Data Grid
GRID '01 Proceedings of the Second International Workshop on Grid Computing
Matchmaking: Distributed Resource Management for High Throughput Computing
HPDC '98 Proceedings of the 7th IEEE International Symposium on High Performance Distributed Computing
Decoupling Computation and Data Scheduling in Distributed Data-Intensive Applications
HPDC '02 Proceedings of the 11th IEEE International Symposium on High Performance Distributed Computing
Towards an Economy-Based Optimisation of File Access and Replication on a Data Grid
CCGRID '02 Proceedings of the 2nd IEEE/ACM International Symposium on Cluster Computing and the Grid
Data Replication Strategies in Grid Environments
ICA3PP '02 Proceedings of the Fifth International Conference on Algorithms and Architectures for Parallel Processing
Evaluating Scheduling and Replica Optimisation Strategies in OptorSim
GRID '03 Proceedings of the 4th International Workshop on Grid Computing
Stork: Making Data Placement a First Class Citizen in the Grid
ICDCS '04 Proceedings of the 24th International Conference on Distributed Computing Systems (ICDCS'04)
Dynamic replication algorithms for the multi-tier Data Grid
Future Generation Computer Systems - Special issue: Parallel computing technologies
A Scalable P2P Platform for the Knowledge Grid
IEEE Transactions on Knowledge and Data Engineering
An evaluation of the close-to-files processor and data co-allocation policy in multiclusters
CLUSTER '04 Proceedings of the 2004 IEEE International Conference on Cluster Computing
The impact of data replication on job scheduling performance in the Data Grid
Future Generation Computer Systems
Integration of scheduling and replication in data grids
HiPC'04 Proceedings of the 11th international conference on High Performance Computing
A dynamic data replication strategy using access-weights in data grids
The Journal of Supercomputing
An ant algorithm for balanced job scheduling in grids
Future Generation Computer Systems
Adaptive hierarchical scheduling policy for enterprise grid computing systems
Journal of Network and Computer Applications
Future Generation Computer Systems
Future Generation Computer Systems
Multi-cost job routing and scheduling in Grid networks
Future Generation Computer Systems
Branch replication scheme: A new model for data replication in large scale data grids
Future Generation Computer Systems
An integrated security-aware job scheduling strategy for large-scale computational grids
Future Generation Computer Systems
Message scheduling for array re-decomposition on distributed memory systems
Future Generation Computer Systems
Computer Science: Where Is the Next Frontier?
FGIT '09 Proceedings of the 1st International Conference on Future Generation Information Technology
FIRE: A File Reunion Based Data Replication Strategy for Data Grids
CCGRID '10 Proceedings of the 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing
A Two-Level Scheduling Strategy for optimising communications of data parallel programs in clusters
International Journal of Ad Hoc and Ubiquitous Computing
Selecting the most fitting resource for task execution
Future Generation Computer Systems
Improving job scheduling algorithms in a grid environment
Future Generation Computer Systems
Reactive power management for distributed systems
Proceedings of the 49th Annual Southeast Regional Conference
Message clustering technique towards efficient irregular data redistribution in clusters and grids
ICA3PP'10 Proceedings of the 10th international conference on Algorithms and Architectures for Parallel Processing - Volume Part I
PFRF: An adaptive data replication algorithm based on star-topology data grids
Future Generation Computer Systems
Investigation of data locality and fairness in MapReduce
Proceedings of third international workshop on MapReduce and its Applications Date
Document replication strategies for geographically distributed web search engines
Information Processing and Management: an International Journal
Efficient Management of Fragmented Replica in Data Grids
International Journal of Grid and High Performance Computing
Enhanced Dynamic Hierarchical Replication and Weighted Scheduling Strategy in Data Grid
Journal of Parallel and Distributed Computing
Job scheduling and dynamic data replication in data grid environment
The Journal of Supercomputing
Computers and Operations Research
A classification of file placement and replication methods on grids
Future Generation Computer Systems
Hopfield neural network for simultaneous job scheduling and data replication in grids
Future Generation Computer Systems
Dynamic replica placement and selection strategies in data grids- A comprehensive survey
Journal of Parallel and Distributed Computing
Hi-index | 0.00 |
In data grids, many distributed scientific and engineering applications often require access to a large amount of data (terabytes or petabytes). Data access time depends on bandwidth, especially in a cluster grid. Network bandwidth within the same cluster is larger than across clusters. In a communication environment, the major bottleneck to supporting fast data access in Grids is the high latencies of Wide Area Networks (WANs) and Internet. Effective scheduling in such network architecture can reduce the amount of data transferred across the Internet by dispatching a job to where the needed data are present. Another solution is to use a data replication mechanism to generate multiple copies of the existing data to reduce access opportunities from a remote site. To utilize the above two concepts, in this paper we develop a job scheduling policy, called HCS (Hierarchical Cluster Scheduling), and a dynamic data replication strategy, called HRS (Hierarchical Replication Strategy), to improve the data access efficiencies in a cluster grid. We simulate our algorithm to evaluate various combinations of data access patterns. We also implement HCS and HRS in the Taiwan Unigrid environment. The simulation and experiment results show that HCS and HRS successfully reduces data access time and the amount of inter-cluster-communications in comparison with other strategies in a cluster grid.