Gridflow Description, Query, and Execution at SCEC using the SDSC Matrix

Authors:
Jonathan Weinberg;Arun Jagatheesan;Allen Ding;Marcio Faerman;Yuanfang Hu
Affiliations:
University of California, San Diego;University of California, San Diego;University of California, San Diego;University of California, San Diego;University of California, San Diego
Venue:
HPDC '04 Proceedings of the 13th IEEE International Symposium on High Performance Distributed Computing
Year:
2004

Citing 0
Cited 5

Scientific workflow management: between generality and applicability

QSIC '05 Proceedings of the Fifth International Conference on Quality Software
Grids with multiple batch systems for performance enhancement of multi-component and parameter sweep parallel applications

Future Generation Computer Systems
Exploiting Latent I/O Asynchrony in Petascale Science Applications

International Journal of High Performance Computing Applications
A meta-scheduling service for co-allocating arbitrary types of resources

PPAM'05 Proceedings of the 6th international conference on Parallel Processing and Applied Mathematics
Datagridflows: managing long-run processes on datagrids

DMG 2005 Proceedings of the First VLDB conference on Data Management in Grids

Quantified Score

Hi-index	0.01

Visualization

Abstract

While conventional workflow systems have been around for many years, the deployment of analogous systems onto a grid infrastructure introduces a number of unique questions and challenges. Innovative approaches to grid workflow (gridflow) are needed to leverage the heterogeneity, autonomy, dynamic behavior, and wide-area distribution that characterize grid resources. The Matrix Project carries out research and development to deliver the language descriptions and protocols necessary to build collaborative gridflow management systems for the emerging grid infrastructures. We describe here our activities to date including development of the Data Grid Language (DGL) and the usage of the Matrix gridflow management system by the Southern California Earthquake Center (SCEC) to manage its gridflows.