An opportunistic algorithm for scheduling workflows on grids

Authors:
Luiz Meyer;Doug Scheftner;Jens Vöckler;Marta Mattoso;Mike Wilde;Ian Foster
Affiliations:
Federal University of Rio de Janeiro - COPPE, Department of Computer Science;University of Chicago - Department of Computer Science;University of Chicago - Department of Computer Science;Federal University of Rio de Janeiro - COPPE, Department of Computer Science;Argonne National Laboratory - Mathematics and Computer Science Division;University of Chicago - Department of Computer Science and Argonne National Laboratory - Mathematics and Computer Science Division
Venue:
VECPAR'06 Proceedings of the 7th international conference on High performance computing for computational science
Year:
2006

Citing 15
Cited 7

The AppLeS parameter sweep template: user-level middleware for the grid

Proceedings of the 2000 ACM/IEEE conference on Supercomputing
Chimera: AVirtual Data System for Representing, Querying, and Automating Data Derivation

SSDBM '02 Proceedings of the 14th International Conference on Scientific and Statistical Database Management
Evaluation of an Economy-Based File Replication Strategy for a Data Grid

CCGRID '03 Proceedings of the 3st International Symposium on Cluster Computing and the Grid
A Unified Resource Scheduling Framework for Heterogeneous Computing Environments

HCW '99 Proceedings of the Eighth Heterogeneous Computing Workshop
Pipeline and Batch Sharing in Grid Workloads

HPDC '03 Proceedings of the 12th IEEE International Symposium on High Performance Distributed Computing
Evaluating Scheduling and Replica Optimisation Strategies in OptorSim

GRID '03 Proceedings of the 4th International Workshop on Grid Computing
Computation scheduling and data replication algorithms for data Grids

Grid resource management
The Grid 2: Blueprint for a New Computing Infrastructure

The Grid 2: Blueprint for a New Computing Infrastructure
The Grid2003 Production Grid: Principles and Practice

HPDC '04 Proceedings of the 13th IEEE International Symposium on High Performance Distributed Computing
A taxonomy of scientific workflow systems for grid computing

ACM SIGMOD Record
Scheduling of scientific workflows in the ASKALON grid environment

ACM SIGMOD Record
Taverna: a tool for the composition and enactment of bioinformatics workflows

Bioinformatics
An evaluation of the close-to-files processor and data co-allocation policy in multiclusters

CLUSTER '04 Proceedings of the 2004 IEEE International Conference on Cluster Computing
Scheduling strategies for mapping application workflows onto the grid

HPDC '05 Proceedings of the High Performance Distributed Computing, 2005. HPDC-14. Proceedings. 14th IEEE International Symposium
Experiences in running workloads over grid3

GCC'05 Proceedings of the 4th international conference on Grid and Cooperative Computing

XCraft: boosting the performance of active XML materialization

EDBT '08 Proceedings of the 11th international conference on Extending database technology: Advances in database technology
Exploring many task computing in scientific workflows

Proceedings of the 2nd Workshop on Many-Task Computing on Grids and Supercomputers
Low-Cost Tuning of Two-Step Algorithms for Scheduling Mixed-Parallel Applications onto Homogeneous Clusters

CCGRID '10 Proceedings of the 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing
Performance analysis of dynamic workflow scheduling in multicluster grids

Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing
Data parallelism in bioinformatics workflows using Hydra

Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing
A scheduling model for workflows on grids and clouds

Proceedings of the 8th International Workshop on Middleware for Grids, Clouds and e-Science
A framework for readapting and running bioinformatics applications in the cloud

Proceedings of the 2012 ACM Research in Applied Computation Symposium

Quantified Score

Hi-index	0.00

Visualization

Abstract

The execution of scientific workflows in Grid environments imposes many challenges due to the dynamic nature of such environments and the characteristics of scientific applications. This work presents an algorithm that dynamically schedules tasks of workflows to Grid sites based on the performance of these sites when running previous jobs from the same workflow. The algorithm captures the dynamic characteristics of Grid environments without the need to probe the remote sites. We evaluated the algorithm running a workflow in the Open Science Grid using twelve sites. The results showed improvements up to 150% relative to other four usual scheduling strategies.