Scheduling of scientific workflows in the ASKALON grid environment

Authors:
Marek Wieczorek;Radu Prodan;Thomas Fahringer
Affiliations:
University of Innsbruck, Innsbruck, Austria;University of Innsbruck, Innsbruck, Austria;University of Innsbruck, Innsbruck, Austria
Venue:
ACM SIGMOD Record
Year:
2005

Citing 5
Cited 53

Genetic Algorithms in Search, Optimization and Machine Learning

Genetic Algorithms in Search, Optimization and Machine Learning
Grid resource management: state of the art and future trends

Grid resource management: state of the art and future trends
Dynamic scheduling of scientific workflow applications on the grid: a case study

Proceedings of the 2005 ACM symposium on Applied computing
Specification of grid workflow applications with AGWL: an Abstract Grid Workflow Language

CCGRID '05 Proceedings of the Fifth IEEE International Symposium on Cluster Computing and the Grid (CCGrid'05) - Volume 2 - Volume 02
Real world workflow applications in the askalon grid environment

EGC'05 Proceedings of the 2005 European conference on Advances in Grid Computing

A provisioning model and its comparison with best-effort for performance-cost optimization in grids

Proceedings of the 16th international symposium on High performance distributed computing
Data driven workflow planning in cluster management systems

Proceedings of the 16th international symposium on High performance distributed computing
A Pipeline Virtual Service Pre-Scheduling Pattern and its Application in Astronomy Data Processing

Simulation
XCraft: boosting the performance of active XML materialization

EDBT '08 Proceedings of the 11th international conference on Extending database technology: Advances in database technology
A data placement service for petascale applications

PDSW '07 Proceedings of the 2nd international workshop on Petascale data storage: held in conjunction with Supercomputing '07
Scheduling scientific workflow applications with deadline and budget constraints using genetic algorithms

Scientific Programming - Scientific Workflows
Optimizing workflow data footprint

Scientific Programming - Dynamic Computational Workflows: Discovery, Optimization and Scheduling
Resource Allocation vs. Business Process Improvement: How They Impact on Each Other

BPM '08 Proceedings of the 6th International Conference on Business Process Management
Composing geoinformatics workflows with user preferences

Proceedings of the 16th ACM SIGSPATIAL international conference on Advances in geographic information systems
Data placement for scientific applications in distributed environments

GRID '07 Proceedings of the 8th IEEE/ACM International Conference on Grid Computing
Multi-objective planning for workflow execution on Grids

GRID '07 Proceedings of the 8th IEEE/ACM International Conference on Grid Computing
Scientific workflow scheduling in computational grids Planning, reservation, and data/network-awareness

GRID '07 Proceedings of the 8th IEEE/ACM International Conference on Grid Computing
Workflow Global Computing with YML

GRID '06 Proceedings of the 7th IEEE/ACM International Conference on Grid Computing
Enabling Ad Hoc Queries over Low-Level Scientific Data Sets

SSDBM 2009 Proceedings of the 21st International Conference on Scientific and Statistical Database Management
Utility Driven Adaptive Work?ow Execution

CCGRID '09 Proceedings of the 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid
Cost and accuracy sensitive dynamic workflow composition over grid environments

GRID '08 Proceedings of the 2008 9th IEEE/ACM International Conference on Grid Computing
DAGMap: Efficient scheduling for DAG grid workflow job

GRID '08 Proceedings of the 2008 9th IEEE/ACM International Conference on Grid Computing
From data to knowledge to discoveries: Artificial intelligence and scientific workflows

Scientific Programming
Wings for Pegasus: creating large-scale scientific applications using semantic representations of computational workflows

IAAI'07 Proceedings of the 19th national conference on Innovative applications of artificial intelligence - Volume 2
A data-driven workflow language for grids based on array programming principles

Proceedings of the 4th Workshop on Workflows in Support of Large-Scale Science
A mobile agent based workflow rescheduling approach for grids

PDCS '07 Proceedings of the 19th IASTED International Conference on Parallel and Distributed Computing and Systems
Resource Planning for Massive Number of Process Instances

OTM '09 Proceedings of the Confederated International Conferences, CoopIS, DOA, IS, and ODBASE 2009 on On the Move to Meaningful Internet Systems: Part I
Advance reservation policies for workflows

JSSPP'06 Proceedings of the 12th international conference on Job scheduling strategies for parallel processing
An opportunistic algorithm for scheduling workflows on grids

VECPAR'06 Proceedings of the 7th international conference on High performance computing for computational science
Grid computing: experiment management, tool integration, and scientific workflows

Grid computing: experiment management, tool integration, and scientific workflows
A collaborative scheduling approach for service-driven scientific workflow execution

Journal of Computer and System Sciences
Scaling up workflow-based applications

Journal of Computer and System Sciences
Adaptive service scheduling for workflow applications in Service-Oriented Grid

The Journal of Supercomputing
A data placement strategy in scientific cloud workflows

Future Generation Computer Systems
Grids and Clouds: Making Workflow Applications Work in Heterogeneous Distributed Environments

International Journal of High Performance Computing Applications
Performance analysis of dynamic workflow scheduling in multicluster grids

Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing
Data parallelism in bioinformatics workflows using Hydra

Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing
A Min-Min average algorithm for scheduling transaction-intensive grid workflows

AusGrid '09 Proceedings of the Seventh Australasian Symposium on Grid Computing and e-Research - Volume 99
Negotiation-Based Scheduling of Scientific Grid Workflows Through Advance Reservations

Journal of Grid Computing
Power-Aware Consolidation of Scientific Workflows in Virtualized Environments

Proceedings of the 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis
Scheduling multiple DAGs onto heterogeneous systems

IPDPS'06 Proceedings of the 20th international conference on Parallel and distributed processing
Robust scheduler for grid networks under uncertainties of both application demands and resource availability

Computer Networks: The International Journal of Computer and Telecommunications Networking
A robust multi-objective optimization to workflow scheduling for dynamic grid

ACAI '11 Proceedings of the International Conference on Advances in Computing and Artificial Intelligence
CG3DR: Coordination of icosahedral virus reconstruction using Condensed Graphs

Parallel Computing
Latency modeling and minimization for large-scale scientific workflows in distributed network environments

Proceedings of the 44th Annual Simulation Symposium
Modeling and simulation of distributed computing workflows in heterogeneous network environments

Simulation
Object reuse and exchange for publishing and sharing workflows

Proceedings of the 6th workshop on Workflows in support of large-scale science
Multi-objective workflow grid scheduling based on discrete particle swarm optimization

SEMCCO'11 Proceedings of the Second international conference on Swarm, Evolutionary, and Memetic Computing - Volume Part I
Integration of Workflow Partitioning and Resource Provisioning

CCGRID '12 Proceedings of the 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012)
A New Grid Scheduler with Failure Recovery and Rescheduling Mechanisms: Discussion and Analysis

Journal of Grid Computing
Multiple Workflow Scheduling Strategies with User Run Time Estimates on a Grid

Journal of Grid Computing
Partitioning and scheduling workflows across multiple sites with storage constraints

PPAM'11 Proceedings of the 9th international conference on Parallel Processing and Applied Mathematics - Volume Part II
MTCProv: a practical provenance query framework for many-task scientific computing

Distributed and Parallel Databases
Deadline-constrained workflow scheduling algorithms for Infrastructure as a Service Clouds

Future Generation Computer Systems
Reference Point Based Multi-Objective Optimization to Workflow Grid Scheduling

International Journal of Applied Evolutionary Computation
A Scheduling Algorithm for the Distributed Student Registration System in Transaction-Intensive Environment

International Journal of Distance Education Technologies
Bi-level fuzzy based advanced reservation of Cloud workflow applications on distributed Grid resources

The Journal of Supercomputing
Bundle and Pool Architecture for Multi-Language, Robust, Scalable Workflow Executions

Journal of Grid Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

Scheduling is a key concern for the execution of performance-driven Grid applications. In this paper we comparatively examine different existing approaches for scheduling of scientific workflow applications in a Grid environment. We evaluate three algorithms namely genetic, HEFT, and simple "myopic" and compare incremental workflow partitioning against the full-graph scheduling strategy. We demonstrate experiments using real-world scientific applications covering both balanced (symmetric) and unbalanced (asymmetric) workflows. Our results demonstrate that full-graph scheduling with the HEFT algorithm performs best compared to the other strategies examined in this paper.