Parallel Scripting for Applications at the Petascale and Beyond

Authors:
Michael Wilde;Ian Foster;Kamil Iskra;Pete Beckman;Zhao Zhang;Allan Espinosa;Mihael Hategan;Ben Clifford;Ioan Raicu
Affiliations:
University of Chicago and Argonne National Laboratory;University of Chicago and Argonne National Laboratory;University of Chicago and Argonne National Laboratory;University of Chicago and Argonne National Laboratory;University of Chicago;University of Chicago;University of Chicago;University of Chicago;Northwestern University
Venue:
Computer
Year:
2009

Citing 0
Cited 26

Accelerating science gateway development with Web 2.0 and Swift

Proceedings of the 2010 TeraGrid Conference
Harnessing parallelism in multicore clusters with the All-Pairs, Wavefront, and Makeflow abstractions

Cluster Computing
Provenance management in Swift

Future Generation Computer Systems
A MapReduce workflow system for architecting scientific data intensive applications

Proceedings of the 2nd International Workshop on Software Engineering for Cloud Computing
Engineering high performance service-oriented pipeline applications with MeDICi

ICSOC'10 Proceedings of the 2010 international conference on Service-oriented computing
Making a case for distributed file systems at Exascale

Proceedings of the third international workshop on Large-scale system and application performance
A solution looking for lots of problems: generic portals for science infrastructure

Proceedings of the 2011 TeraGrid Conference: Extreme Digital Discovery
ComputErl - erlang-based framework for many task computing

TFP'10 Proceedings of the 11th international conference on Trends in functional programming
AME: an anyscale many-task computing engine

Proceedings of the 6th workshop on Workflows in support of large-scale science
Exploring provenance in high performance scientific computing

Proceedings of the first annual workshop on High performance computing meets databases
Parallel high-resolution climate data analysis using swift

Proceedings of the 2011 ACM international workshop on Many task computing on grids and supercomputers
Design and implementation of "many parallel task" hybrid subsurface model

Proceedings of the 2011 ACM international workshop on Many task computing on grids and supercomputers
Propagation of Data Error and Parametric Sensitivity in Computable General Equilibrium Models

Computational Economics
Swift: A language for distributed parallel scripting

Parallel Computing
Component-based approach for programming and running scientific applications on grids and clouds

International Journal of High Performance Computing Applications
A cost-effective cloud computing framework for accelerating multimedia communication simulations

Journal of Parallel and Distributed Computing
Design and analysis of data management in scalable parallel scripting

SC '12 Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis
A high-productivity task-based programming model for clusters

Concurrency and Computation: Practice & Experience
Designing and Deploying a Scientific Computing Cloud Platform

GRID '12 Proceedings of the 2012 ACM/IEEE 13th International Conference on Grid Computing
Turbine: a distributed-memory dataflow engine for extreme-scale many-task applications

Proceedings of the 1st ACM SIGMOD Workshop on Scalable Workflow Execution Engines and Technologies
Provenance traces of the swift parallel scripting system

Proceedings of the Joint EDBT/ICDT 2013 Workshops
MTC envelope: defining the capability of large scale computers in the context of parallel scripting applications

Proceedings of the 22nd international symposium on High-performance parallel and distributed computing
The parallel system for integrating impact models and sectors (pSIMS)

Proceedings of the Conference on Extreme Science and Engineering Discovery Environment: Gateway to Discovery
Using Kestrel and XMPP to Support the STAR Experiment in the Cloud

Journal of Grid Computing
JETS: Language and System Support for Many-Parallel-Task Workflows

Journal of Grid Computing
Turbine: A Distributed-memory Dataflow Engine for High Performance Many-task Applications

Fundamenta Informaticae - Scalable Workflow Enactment Engines and Technology

Quantified Score

Hi-index	4.10

Visualization

Abstract

Scripting accelerates and simplifies the composition of existing codes to form more powerful applications. Parallel scripting extends this technique to allow for the rapid development of highly parallel applications that can run efficiently on platforms ranging from multicore workstations to petascale supercomputers.