A taxonomy of scientific workflow systems for grid computing
ACM SIGMOD Record
Introduction to scientific workflow management and the Kepler system
Proceedings of the 2006 ACM/IEEE conference on Supercomputing
Reaching for the Stars with Python
Computing in Science and Engineering
Querying and Creating Visualizations by Analogy
IEEE Transactions on Visualization and Computer Graphics
The Sloan Digital Sky Survey and beyond
ACM SIGMOD Record - Tribute to honor Jim Gray
Provenance for Computational Tasks: A Survey
Computing in Science and Engineering
Provenance and Annotation of Data and Processes: Second International Provenance and Annotation Workshop, IPAW 2008, Salt Lake City, UT, USA, June 17-18, 2008. Revised Selected Papers
Astro-WISE: Tracing and Using Lineage for Scientific Data Processing
NBIS '09 Proceedings of the 2009 International Conference on Network-Based Information Systems
| Hi-index | 0.00 |
While there has been advances in observational equipment that generate huge high quality images, the processing of these images remains a major bottleneck. We show that provenance data collected during the processing of data can be reused to perform selective processing of data and support network collaboration without clogging distribution networks. We introduce the idea of sub-image processing (SIMP) in the context of processing a subset of pixels of an image and the use of provenance data to assemble pipelines and to select processing metadata for SIMP. We describe an implementation of SIMP in Astro-WISE