Dynamic mapping of a class of independent tasks onto heterogeneous computing systems
Journal of Parallel and Distributed Computing - Special issue on software support for distributed computing
Performance-Effective and Low-Complexity Task Scheduling for Heterogeneous Computing
IEEE Transactions on Parallel and Distributed Systems
M-Task-Programming for Heterogeneous Systems and Grid Environments
IPDPS '05 Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS'05) - Workshop 4 - Volume 05
Proceedings of the 2006 ACM/IEEE conference on Supercomputing
QBETS: queue bounds estimation from time series
Proceedings of the 2007 ACM SIGMETRICS international conference on Measurement and modeling of computer systems
A Comparison of Scheduling Approaches for Mixed-Parallel Applications on Heterogeneous Platforms
ISPDC '07 Proceedings of the Sixth International Symposium on Parallel and Distributed Computing
Automatic resource specification generation for resource selection
Proceedings of the 2007 ACM/IEEE conference on Supercomputing
Scheduling Dynamic Workflows onto Clusters of Clusters using Postponing
CCGRID '08 Proceedings of the 2008 Eighth IEEE International Symposium on Cluster Computing and the Grid
Scheduling mixed-parallel applications with advance reservations
HPDC '08 Proceedings of the 17th international symposium on High performance distributed computing
A toolkit for modelling and simulating data Grids: an extension to GridSim
Concurrency and Computation: Practice & Experience
A Planner-Guided Scheduling Strategy for Multiple Workflow Applications
ICPPW '08 Proceedings of the 2008 International Conference on Parallel Processing - Workshops
Amdahl's Law in the Multicore Era
Computer
Dynamic scheduling of multi-processor tasks on clusters of clusters
CLUSTER '07 Proceedings of the 2007 IEEE International Conference on Cluster Computing
Toward practical multi-workflow scheduling in cluster and grid environments
Toward practical multi-workflow scheduling in cluster and grid environments
IPDPS'06 Proceedings of the 20th international conference on Parallel and distributed processing
Workload characteristics of a multi-cluster supercomputer
JSSPP'04 Proceedings of the 10th international conference on Job Scheduling Strategies for Parallel Processing
Scheduling of scientific workflow in non-dedicated heterogeneous multicluster platform
Journal of Systems and Software
| Hi-index | 0.00 |
Workflows are prevailing in scientific computation. Multicluster environments emerge and provide more resources, benefiting workflows but also challenging the traditional workflow scheduling heuristics. In a multicluster environment, each cluster has its own independent workload management system. Jobs are queued up before getting executed, they experience different resource availability and wait time if dispatched to different clusters. However, existing scheduling heuristics neither consider the queue wait time nor balance the performance gain with data movement cost. The proposed algorithm leverages the advancement of queue wait time prediction techniques and empirically studies if the tunability of resource requirements helps scheduling. The extensive experiment with both real workload traces and test bench shows that the queue wait time aware algorithm improves workflow performance by 3 to 10 times in terms of average makespan with relatively very low cost of data movement.