Portable run-time support for dynamic object-oriented parallel processing
ACM Transactions on Computer Systems (TOCS)
Analysis of integration models for service composition
WOSP '02 Proceedings of the 3rd international workshop on Software and performance
Distributed P2P Computing within Triana: A Galaxy Visualization Test Case
IPDPS '03 Proceedings of the 17th International Symposium on Parallel and Distributed Processing
Differential Serialization for Optimized SOAP Performance
HPDC '04 Proceedings of the 13th IEEE International Symposium on High Performance Distributed Computing
Scientific workflow management and the Kepler system: Research Articles
Concurrency and Computation: Practice & Experience - Workflow in Grid Systems
Decentralized Orchestration of CompositeWeb Services
ICWS '06 Proceedings of the IEEE International Conference on Web Services
Pegasus: A framework for mapping complex scientific workflows onto distributed systems
Scientific Programming
Orchestrating Data-Centric Workflows
CCGRID '08 Proceedings of the 2008 Eighth IEEE International Symposium on Cluster Computing and the Grid
Introduction to OGSA-DAI services
SAG'04 Proceedings of the First international conference on Scientific Applications of Grid Computing
The benefits of service choreography for data-intensive computing
Proceedings of the 7th international workshop on Challenges of large applications in distributed environments
Services + Components = Data Intensive Scientific Workflow Applications with MeDICi
CBSE '09 Proceedings of the 12th International Symposium on Component-Based Software Engineering
An E-infrastructure to Support Collaborative Embryo Research
CCGRID '09 Proceedings of the 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid
Using proxies to accelerate cloud applications
HotCloud'09 Proceedings of the 2009 conference on Hot topics in cloud computing
Efficient resource-aware hybrid configuration of distributed pervasive applications
Pervasive'10 Proceedings of the 8th international conference on Pervasive Computing
Managing data dependencies in service compositions
Journal of Systems and Software
Hi-index | 0.00 |
Efficiently executing large-scale, data-intensive workflows such as Montage must take into account the volume and pattern of communication. When orchestrating data-centric workflows, centralised servers common to standard workflow systems can become a bottleneck to performance. However, standards-based workflow systems that rely on centralisation, e.g., Web service based frameworks, have many other benefits such as a wide user base and sustained support. This paper presents and evaluates a light-weight hybrid architecture which maintains the robustness and simplicity of centralised orchestration, but facilitates choreography by allowing services to exchange data directly with one another. Furthermore our architecture is standards compliment, flexible and is a non-disruptive solution; service definitions do not have to be altered prior to enactment. Our architecture could be realised within any existing workflow framework, in this paper, we focus on a Web service based framework. Taking inspiration from Montage, a number of common workflow patterns (sequence, fan-in and fan-out), input-output data size relationships and network configurations are identified and evaluated. The performance analysis concludes that a substantial reduction in communication overhead results in a 2-4 fold performance benefit across all patterns. An end-to-end pattern through the Montage workflow results in an 8 fold performance benefit and demonstrates how the advantage of using our hybrid architecture increases as the complexity of a workflow grows.