Workflow management in GriPhyN

Authors:
Ewa Deelman;James Blythe;Yolanda Gil;Carl Kesselman
Affiliations:
Information Sciences Institute, University of Southern California;Information Sciences Institute, University of Southern California;Information Sciences Institute, University of Southern California;Information Sciences Institute, University of Southern California
Venue:
Grid resource management
Year:
2004

Citing 0
Cited 24

Organizing Dynamic Multi-Level Workflows on Multi-Layer Grids for Developing e-Business Portals

WI '04 Proceedings of the 2004 IEEE/WIC/ACM International Conference on Web Intelligence
Grid-Based Galaxy Morphology Analysis for the National Virtual Observatory

Proceedings of the 2003 ACM/IEEE conference on Supercomputing
Organizing Multiple Data Sources for Developing Intelligent e-Business Portals

Data Mining and Knowledge Discovery
Pegasus: A framework for mapping complex scientific workflows onto distributed systems

Scientific Programming
Workflow task clustering for best effort systems with Pegasus

Proceedings of the 15th ACM Mardi Gras conference: From lightweight mash-ups to lambda grids: Understanding the spectrum of distributed computing requirements, applications, tools, infrastructures, interoperability, and the incremental adoption of key capabilities
An innovative workflow mapping mechanism for Grids in the frame of Quality of Service

Future Generation Computer Systems
CNP-based Implementation of Service-oriented Workflow Mapping in SHGWMS

World Wide Web
Optimizing workflow data footprint

Scientific Programming - Dynamic Computational Workflows: Discovery, Optimization and Scheduling
WE-AMBLE: a Workflow Engine To Manage Awareness in Collaborative Grid Environments

International Journal of High Performance Computing Applications
Experience in using a process language to define scientific workflow and generate dataset provenance

Proceedings of the 16th ACM SIGSOFT International Symposium on Foundations of software engineering
Towards a general model of the multi-criteria workflow scheduling on the grid

Future Generation Computer Systems
Developing Grid-based E-finance Portals for Intelligent Risk Management and Decision Making

Proceedings of the 2006 conference on Advances in Intelligent IT: Active Media Technology 2006
A QoS-Based Selection Mechanism Exploiting Business Relationships in Workflows

GECON '09 Proceedings of the 6th International Workshop on Grid Economics and Business Models
On agents and grids: Creating the fabric for a new generation of distributed intelligent systems

Web Semantics: Science, Services and Agents on the World Wide Web
Developing mining-grid centric e-finance portals for risk management

JSAI'06 Proceedings of the 20th annual conference on New frontiers in artificial intelligence
A multi-dimensional classification model for scientific workflow characteristics

Proceedings of the 1st International Workshop on Workflow Approaches to New Data-centric Science
Failure-aware workflow scheduling in cluster environments

Cluster Computing
Modeling and survivability analysis of service composition using Stochastic Petri Nets

The Journal of Supercomputing
GridSpace – semantic programming environment for the grid

PPAM'05 Proceedings of the 6th international conference on Parallel Processing and Applied Mathematics
Semantic-Based grid workflow composition

PPAM'05 Proceedings of the 6th international conference on Parallel Processing and Applied Mathematics
Workflows for wind tunnel grid applications

ICCS'06 Proceedings of the 6th international conference on Computational Science - Volume Part III
Workflow overhead analysis and optimizations

Proceedings of the 6th workshop on Workflows in support of large-scale science
Effective job management in the virtual laboratory

EGC'05 Proceedings of the 2005 European conference on Advances in Grid Computing
Integration of Workflow Partitioning and Resource Provisioning

CCGRID '12 Proceedings of the 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012)

Quantified Score

Hi-index	0.00

Visualization

Abstract

This chapter describes the work done within the NSF-funded GriPhyN project in the area of workflow management. The targeted workflows are large both in terms of the number of tasks in a given workflow and in terms of the total execution time of the workflow, which can sometimes be on the order of days. The workflows represent the computation that needs to be performed to analyze large scientific datasets produced in high-energy physics, gravitational physics, and astronomy. This chapter discusses issues associated with workflow management in the Grid in general and also provides a description of the Pegasus system, which can generate executable workflows.