The grid: blueprint for a new computing infrastructure
The grid: blueprint for a new computing infrastructure
IEEE Internet Computing
Managing Scientific Metadata Using XML
IEEE Internet Computing
Distributed P2P Computing within Triana: A Galaxy Visualization Test Case
IPDPS '03 Proceedings of the 17th International Symposium on Parallel and Distributed Processing
A survey of data provenance in e-science
ACM SIGMOD Record
Incorporating semantics in scientific workflow authoring
SSDBM'2005 Proceedings of the 17th international conference on Scientific and statistical database management
Special Issue: Workflow in Grid Systems: Editorials
Concurrency and Computation: Practice & Experience - Workflow in Grid Systems
Scientific workflow management and the Kepler system: Research Articles
Concurrency and Computation: Practice & Experience - Workflow in Grid Systems
Pegasus: A framework for mapping complex scientific workflows onto distributed systems
Scientific Programming
Workflow management for high volume supernova search
Proceedings of the 2009 ACM symposium on Applied Computing
C-SWF: A Lightweight Scientific Workflow System for Astronomical Data Processing
IWCSE '09 Proceedings of the 2009 Second International Workshop on Computer Science and Engineering - Volume 02
Scientific workflow: a survey and research directions
PPAM'07 Proceedings of the 7th international conference on Parallel processing and applied mathematics
A model for user-oriented data provenance in pipelined scientific workflows
IPAW'06 Proceedings of the 2006 international conference on Provenance and Annotation of Data
Hi-index | 0.00 |
Network-grid computing is widely adopted in complex data computing and distributed data processing. In order to construct loosely-coupled application, the scientific workflow technique was used to invoke distributed services and data. However, there are many drawbacks in current scientific workflow system such as the complexity of manipulation and the difficulty of system deploy. In this paper, aims to the urgent requirement of astronomic data processing, we have a study on a lightweight scientific workflow system and discuss the critical techniques of the system implementation. Finally, we present a lightweight scientific workflow system, which named C-SWF, to support the complicated data processing in the field of astronomy. C-SWF fully implemented the critical features such as task customization, job scheduling, data movement, data's provenance and task re-run mechanism. Comparing with the existing scientific workflow system, C-SWF has many useful features that simplify the manipulation and deployment of the system.