Job and data clustering for aggregate use of multiple production cyberinfrastructures
Proceedings of the fifth international workshop on Data-Intensive Distributed Computing Date
Swift/T: scalable data flow programming for many-task applications
Proceedings of the 18th ACM SIGPLAN symposium on Principles and practice of parallel programming
The parallel system for integrating impact models and sectors (pSIMS)
Proceedings of the Conference on Extreme Science and Engineering Discovery Environment: Gateway to Discovery
Dataflow coordination of data-parallel tasks via MPI 3.0
Proceedings of the 20th European MPI Users' Group Meeting
JETS: Language and System Support for Many-Parallel-Task Workflows
Journal of Grid Computing
Turbine: A Distributed-memory Dataflow Engine for High Performance Many-task Applications
Fundamenta Informaticae - Scalable Workflow Enactment Engines and Technology
| Hi-index | 0.00 |
In this paper we present the Coaster System. It is an automatically-deployed node provisioning (Pilot Job) system for grids, clouds, and ad-hoc desktop-computer networks supporting file staging, on-demand opportunistic multi-node allocation, remote logging, and remote monitoring. The Coaster System has been previously shown to work at scales of thousands of cores. It has been used since 2009 for applications in fields that include biochemistry, earth systems science, energy modeling, and neuroscience. The system has been used successfully on the Open Science Grid, the Tera Grid, supercomputers (IBM Blue Gene/P, Cray XT and XE systems, and Sun Constellation), a number of smaller clusters, and three cloud infrastructures (BioNimbus, Future Grid and Amazon EC2).