Grids and Clouds: Making Workflow Applications Work in Heterogeneous Distributed Environments

Authors:
Ewa Deelman
Affiliations:
USC INFORMATION SCIENCES INSTITUTE, MARINA DEL REY,CA 90292, USA
Venue:
International Journal of High Performance Computing Applications
Year:
2010

Citing 25
Cited 8

Distributed P2P Computing within Triana: A Galaxy Visualization Test Case

IPDPS '03 Proceedings of the 17th International Symposium on Parallel and Distributed Processing
Scheduling of scientific workflows in the ASKALON grid environment

ACM SIGMOD Record
VisTrails: visualization meets data management

Proceedings of the 2006 ACM SIGMOD international conference on Management of data
Scientific workflow management and the Kepler system: Research Articles

Concurrency and Computation: Practice & Experience - Workflow in Grid Systems
Programming scientific and distributed workflow with Triana services: Research Articles

Concurrency and Computation: Practice & Experience - Workflow in Grid Systems
CASA and LEAD: Adaptive Cyberinfrastructure for Real-Time Multiscale Weather Forecasting

Computer
Application-Level Resource Provisioning on the Grid

E-SCIENCE '06 Proceedings of the Second IEEE International Conference on e-Science and Grid Computing
Managing Large-Scale Workflow Execution from Resource Provisioning to Provenance Tracking: The CyberShake Example

E-SCIENCE '06 Proceedings of the Second IEEE International Conference on e-Science and Grid Computing
Pegasus: A framework for mapping complex scientific workflows onto distributed systems

Scientific Programming
Scheduling Data-IntensiveWorkflows onto Storage-Constrained Distributed Resources

CCGRID '07 Proceedings of the Seventh IEEE International Symposium on Cluster Computing and the Grid
Wide Area Data Replication for Scientific Collaborations

GRID '05 Proceedings of the 6th IEEE/ACM International Workshop on Grid Computing
Challenges in executing large parameter sweep studies across widely distributed computing environments

Proceedings of the 5th IEEE workshop on Challenges of large applications in distributed environments
Scheduling strategies for mapping application workflows onto the grid

HPDC '05 Proceedings of the High Performance Distributed Computing, 2005. HPDC-14. Proceedings. 14th IEEE International Symposium
Workflow task clustering for best effort systems with Pegasus

Proceedings of the 15th ACM Mardi Gras conference: From lightweight mash-ups to lambda grids: Understanding the spectrum of distributed computing requirements, applications, tools, infrastructures, interoperability, and the incremental adoption of key capabilities
Optimizing workflow data footprint

Scientific Programming - Dynamic Computational Workflows: Discovery, Optimization and Scheduling
The cost of doing science on the cloud: the Montage example

Proceedings of the 2008 ACM/IEEE conference on Supercomputing
Reducing Time-to-Solution Using Distributed High-Throughput Mega-Workflows - Experiences from SCEC CyberShake

ESCIENCE '08 Proceedings of the 2008 Fourth IEEE International Conference on eScience
Resource Provisioning Options for Large-Scale Scientific Workflows

ESCIENCE '08 Proceedings of the 2008 Fourth IEEE International Conference on eScience
Lattice QCD Workflows: A Case Study

ESCIENCE '08 Proceedings of the 2008 Fourth IEEE International Conference on eScience
On the Use of Cloud Computing for Scientific Workflows

ESCIENCE '08 Proceedings of the 2008 Fourth IEEE International Conference on eScience
Workflows and e-Science: An overview of workflow system features and capabilities

Future Generation Computer Systems
Elastic management of cluster-based services in the cloud

ACDC '09 Proceedings of the 1st workshop on Automated control for datacenters and clouds
The Eucalyptus Open-Source Cloud-Computing System

CCGRID '09 Proceedings of the 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid
Brokering multi-grid workflows in the P-GRADE portal

Euro-Par'06 Proceedings of the CoreGRID 2006, UNICORE Summit 2006, Petascale Computational Biology and Bioinformatics conference on Parallel processing
Data integration and workflow solutions for ecology

DILS'05 Proceedings of the Second international conference on Data Integration in the Life Sciences

Experiences with resource provisioning for scientific workflows using Corral

Scientific Programming
An agent-oriented approach to process partition and planning in migrating workflow systems

Engineering Applications of Artificial Intelligence
Workflow management for soft real-time interactive applications in virtualized environments

Future Generation Computer Systems
Formal QoS Policy Based Grid Resource Provisioning Framework

Journal of Grid Computing
Component-based approach for programming and running scientific applications on grids and clouds

International Journal of High Performance Computing Applications
Deadline-constrained workflow scheduling algorithms for Infrastructure as a Service Clouds

Future Generation Computer Systems
Factors that Determine the Adoption of Cloud Computing: A Global Perspective

International Journal of Enterprise Information Systems
Cost minimization for computational applications on hybrid cloud infrastructures

Future Generation Computer Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

Scientific workflows are frequently being used to model complex phenomena, to analyze instrumental data, to tie together information from distributed sources, and to pursue other scientific endeavors. Out of necessity, these complex applications need to execute in distributed environments and make use of a number of heterogeneous resources. In this paper we describe some of these applications and illustrate techniques that improve their performance and reliably in distributed environments, such as grids and clouds. Although clouds were first introduced in the business arena, they have a potential to be provide on-demand resources for scientific computations.