An Extensible, Scalable Architecture for Managing Bioinformatics Data and Analyses
ESCIENCE '08 Proceedings of the 2008 Fourth IEEE International Conference on eScience
Kepler + MeDICi Service-Oriented Scientific Workflow Applications
SERVICES '09 Proceedings of the 2009 Congress on Services - I
A High-Performance Hybrid Computing Approach to Massive Contingency Analysis in the Power Grid
E-SCIENCE '09 Proceedings of the 2009 Fifth IEEE International Conference on e-Science
Scientific workflow: a survey and research directions
PPAM'07 Proceedings of the 7th international conference on Parallel processing and applied mathematics
Developing an End-to-End Scientific Workflow
IEEE Design & Test
Real-time visualization of network behaviors for situational awareness
Proceedings of the Seventh International Symposium on Visualization for Cyber Security
| Hi-index | 0.00 |
The pipeline software architecture pattern is commonly used in many application domains to structure a software system. A pipeline comprises a sequence of processing steps that progressively transform data to some desired outputs. As pipeline-based systems are required to handle increasingly large volumes of data and provide high throughput services, simple scripting-based technologies that have traditionally been used for constructing pipelines do not scale. In this paper we describe the MeDICI Integration Framework (MIF), which is specifically designed for building flexible, efficient and scalable pipelines that exploit distributed services as elements of the pipeline. We explain the core runtime and development infrastructures that MIF provides, and demonstrate how MIF has been used in two complex applications to improve performance and modifiability.