GridFlow: Workflow Management for Grid Computing
CCGRID '03 Proceedings of the 3st International Symposium on Cluster Computing and the Grid
Distributed data management in workflow environments
RIDE '97 Proceedings of the 7th International Workshop on Research Issues in Data Engineering (RIDE '97) High Performance Database Management for Large-Scale Applications
Dryad: distributed data-parallel programs from sequential building blocks
Proceedings of the 2nd ACM SIGOPS/EuroSys European Conference on Computer Systems 2007
Peer-to-Peer Based Grid Workflow Runtime Environment of SwinDeW-G
E-SCIENCE '07 Proceedings of the Third IEEE International Conference on e-Science and Grid Computing
Restful web services
Composing RESTful Services and Collaborative Workflows: A Lightweight Approach
IEEE Internet Computing
Development of Web services-based Multidisciplinary Design Optimization framework
Advances in Engineering Software
Resource-Oriented Architecture for Business Processes
APSEC '08 Proceedings of the 2008 15th Asia-Pacific Software Engineering Conference
Why is the web loosely coupled?: a multi-faceted metric for service design
Proceedings of the 18th international conference on World wide web
RESTful Web service composition with BPEL for REST
Data & Knowledge Engineering
Composing RESTful Services with JOpera
SC '09 Proceedings of the 8th International Conference on Software Composition
Automatically composing data workflows with relational descriptions and shim services
ISWC'07/ASWC'07 Proceedings of the 6th international The semantic web and 2nd Asian conference on Asian semantic web conference
CIEL: a universal execution engine for distributed data-flow computing
Proceedings of the 8th USENIX conference on Networked systems design and implementation
Hypermedia-driven RESTful service composition
ICSOC'10 Proceedings of the 2010 international conference on Service-oriented computing
Hi-index | 0.00 |
The problem of staging data in workflows has received much attention over the last decade, with a variety of user-directed and automatic solutions. The latter are the focus of the first contribution in this paper, where we propose a simple peer-to-peer solution adapted to the needs of RESTful services. The second contribution, is the combination of the data staging mechanism with a simple service deployment mechanism, that is designed to allow applications developed for the command-line to function as (RESTful) services without modification or (in some cases) recompilation. Thus, the aim of this paper is to describe the design and implementation of: (i) a peer-to-peer data-staging mechanism, that is itself RESTful, and (ii) a service deployment mechanism, also following REST design principles, which together form the Universal Distributed Data-flows framework, for the support of data-intensive (RESTful) workflows. We evaluate the framework by means of an engineering workflow developed for multi-disciplinary design optimization. The workflow itself is specified in Taverna, which is a conventional centralized data-staging enactment system. However, by virtue of the underlying services and staging mechanisms described here, the resulting enactment is peer-to-peer (for data), which furthermore permits asynchronous staging, with potential benefits for network utilization and end-to-end execution time.