Scientific Computing
Kepler: An Extensible System for Design and Execution of Scientific Workflows
SSDBM '04 Proceedings of the 16th International Conference on Scientific and Statistical Database Management
A survey of data provenance in e-science
ACM SIGMOD Record
Recycling Subspace Information for Diffuse Optical Tomography
SIAM Journal on Scientific Computing
VisTrails: visualization meets data management
Proceedings of the 2006 ACM SIGMOD international conference on Management of data
Recycling Krylov Subspaces for Sequences of Linear Systems
SIAM Journal on Scientific Computing
MapReduce: simplified data processing on large clusters
Communications of the ACM - 50th anniversary issue: 1958 - 2008
Journal of Computational Physics
An integrated framework for performance-based optimization of scientific workflows
Proceedings of the 18th ACM international symposium on High performance distributed computing
Exploring many task computing in scientific workflows
Proceedings of the 2nd Workshop on Many-Task Computing on Grids and Supercomputers
Parameter Exploration in Science and Engineering Using Many-Task Computing
IEEE Transactions on Parallel and Distributed Systems
A Performance Evaluation of X-Ray Crystallography Scientific Workflow Using SciCumulus
CLOUD '11 Proceedings of the 2011 IEEE 4th International Conference on Cloud Computing
Using domain-specific data to enhance scientific workflow steering queries
IPAW'12 Proceedings of the 4th international conference on Provenance and Annotation of Data and Processes
Capturing and querying workflow runtime provenance with PROV: a practical approach
Proceedings of the Joint EDBT/ICDT 2013 Workshops
Provenance traces from Chiron parallel workflow engine
Proceedings of the Joint EDBT/ICDT 2013 Workshops
User-steering of HPC workflows: state-of-the-art and future directions
Proceedings of the 2nd ACM SIGMOD Workshop on Scalable Workflow Execution Engines and Technologies
Runtime Dynamic Structural Changes of Scientific Workflows in Clouds
UCC '13 Proceedings of the 2013 IEEE/ACM 6th International Conference on Utility and Cloud Computing
Hi-index | 0.00 |
Large-scale experiments in computational science are complex to manage. Due to its exploratory nature, several iterations evaluate a large space of parameter combinations. Scientists analyze partial results and dynamically interfere on the next steps of the simulation. Scientific workflow management systems can execute those experiments by providing process management, distributed execution and provenance data. However, supporting scientists in complex exploratory processes involving dynamic workflows is still a challenge. Features, such as user steering on workflows to track, evaluate and adapt the execution need to be designed to support iterative methods. We provide an approach to support dynamic parameter sweep, in which scientists can use the results obtained in a slice of the parameter space to improve the remainder of the execution. We propose new control structures to enable adaptive and user-steered workflows supporting iterative methods using dynamic mechanisms. We evaluate our approach using a proof of concept (Lanczos algorithm) workflow and the results show up to 78% of execution time saved.