Executing a Program on the MIT Tagged-Token Dataflow Architecture
IEEE Transactions on Computers
The RMIT data flow computer: a hybrid architecture
The Computer Journal - Special issue on parallel computing
General atomic and molecular electronic structure system
Journal of Computational Chemistry
The grid: blueprint for a new computing infrastructure
The grid: blueprint for a new computing infrastructure
Condor: a distributed job scheduler
Beowulf cluster computing with Linux
An automatic design optimization tool and its application to computational fluid dynamics
Proceedings of the 2001 ACM/IEEE conference on Supercomputing
High Performance Parametric Modeling with Nimrod/G: Killer Application for the Global Grid?
IPDPS '00 Proceedings of the 14th International Symposium on Parallel and Distributed Processing
GridAnt: A Client-Controllable Grid Work.ow System
HICSS '04 Proceedings of the Proceedings of the 37th Annual Hawaii International Conference on System Sciences (HICSS'04) - Track 7 - Volume 7
Parameter scan of an effective group difference pseudopotential using grid computing
New Generation Computing - Grid systems for life sciences
ASKALON: a tool set for cluster and Grid computing: Research Articles
Concurrency and Computation: Practice & Experience - Grid Performance
Application of grid computing to parameter sweeps and optimizations in molecular modeling
Future Generation Computer Systems
GridRod: a dynamic runtime scheduler for grid workflows
Proceedings of the 21st annual international conference on Supercomputing
Fractional factorial design for parameter sweep experiments using Nimrod/E
Scientific Programming - Large-Scale Programming Tools and Environments
Composing Different Models of Computation in Kepler and Ptolemy II
ICCS '07 Proceedings of the 7th international conference on Computational Science, Part III: ICCS 2007
A framework for the design and reuse of grid workflows
SAG'04 Proceedings of the First international conference on Scientific Applications of Grid Computing
Parameter Space Exploration Using Scientific Workflows
ICCS '09 Proceedings of the 9th International Conference on Computational Science: Part I
Scientific Workflows: Business as Usual?
BPM '09 Proceedings of the 7th International Conference on Business Process Management
Robust workflows for science and engineering
Proceedings of the 2nd Workshop on Many-Task Computing on Grids and Supercomputers
GridBot: execution of bags of tasks in multiple grids
Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis
Data parallelism in bioinformatics workflows using Hydra
Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing
P-GRADE Portal: A generic workflow system to support user communities
Future Generation Computer Systems
Virtual workflow system for distributed collaborative scientific applications on Grids
Computers and Electrical Engineering
Dynamic workflow adaptation over adaptive infrastructures
KES-AMSTA'11 Proceedings of the 5th KES international conference on Agent and multi-agent systems: technologies and applications
An adaptive parallel execution strategy for cloud-based scientific workflows
Concurrency and Computation: Practice & Experience
A Provenance-based Adaptive Scheduling Heuristic for Parallel Scientific Workflows in Clouds
Journal of Grid Computing
Building an ecoinformatics platform to support climate change adaptation in Victoria
Future Generation Computer Systems
Evaluating parameter sweep workflows in high performance computing
Proceedings of the 1st ACM SIGMOD Workshop on Scalable Workflow Execution Engines and Technologies
Scheduling parameter sweep workflow in the Grid based on resource competition
Future Generation Computer Systems
An Adaptive Grid Workflow Scheduling Based on Bottleneck Detection and Execution Context
Proceedings of International Conference on Information Integration and Web-based Applications & Services
Approaches to Distributed Execution of Scientific Workflows in Kepler
Fundamenta Informaticae - Scalable Workflow Enactment Engines and Technology
| Hi-index | 0.00 |
A challenge for Grid computing is the difficulty in developing software that is parallel, distributed and highly dynamic. Whilst there have been many general purpose mechanisms developed over the years, Grid programming still remains a low level, error prone task. Scientific workflow engines can double as programming environments, and allow a user to compose 'virtual' Grid applications from pre-existing components. Whilst existing workflow engines can specify arbitrary parallel programs, (where components use message passing) they are typically not effective with large and variable parallelism. Here we discuss dynamic dataflow, originally developed for parallel tagged dataflow architectures (TDAs), and show that these can be used for implementing Grid workflows. TDAs spawn parallel threads dynamically without additional programming. We have added TDAs to Kepler, and show that the system can orchestrate workflows that have large amounts of variable parallelism. We demonstrate the system using case studies in chemistry and in cardiac modelling.