Scalable directory services using proactivity
Proceedings of the 2002 ACM/IEEE conference on Supercomputing
Enterprise Integration Patterns: Designing, Building, and Deploying Messaging Solutions
Enterprise Integration Patterns: Designing, Building, and Deploying Messaging Solutions
PPerfGrid: A Grid Services-based Tool for the Exchange of Heterogeneous Parallel Performance Data
IPDPS '05 Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS'05) - Workshop 4 - Volume 05
Workflow-based grid applications
Future Generation Computer Systems
Towards User-Defined Performance Monitoring of Distributed Java Applications
E-SCIENCE '06 Proceedings of the Second IEEE International Conference on e-Science and Grid Computing
Semantic Composition of Scientific Workflows Based on the Petri Nets Formalism
E-SCIENCE '06 Proceedings of the Second IEEE International Conference on e-Science and Grid Computing
K-WfGrid Distributed Monitoring and Performance Analysis Services for Workflows in the Grid
E-SCIENCE '06 Proceedings of the Second IEEE International Conference on e-Science and Grid Computing
SCALEA-G: A unified monitoring and performance analysis system for the grid
Scientific Programming - AxGrids 2004
From Monitoring Data to Experiment Information - Monitoring of Grid Scientific Workflows
E-SCIENCE '07 Proceedings of the Third IEEE International Conference on e-Science and Grid Computing
Towards distributed monitoring and performance analysis services in the k-wfgrid project
PPAM'05 Proceedings of the 6th international conference on Parallel Processing and Applied Mathematics
An instrumentation infrastructure for grid workflow applications
ODBASE'06/OTM'06 Proceedings of the 2006 Confederated international conference on On the Move to Meaningful Internet Systems: CoopIS, DOA, GADA, and ODBASE - Volume Part II
Fine-Grained instrumentation and monitoring of legacy applications in a service-oriented environment
ICCS'06 Proceedings of the 6th international conference on Computational Science - Volume Part II
A computational framework for flood risk assessment in The Netherlands
Scientific Programming
| Hi-index | 0.00 |
Scientific workflows are a means of conducting in silico experiments in modern computing infrastructures for e-Science, often built on top of Grids. Monitoring of Grid scientific workflows is essential not only for performance analysis but also to collect provenance data and gather feedback useful in future decisions, e.g., related to optimization of resource usage. In this paper, basic problems related to monitoring of Grid scientific workflows are discussed. Being highly distributed, loosely coupled in space and time, heterogeneous, and heavily using legacy codes, workflows are exceptionally challenging from the monitoring point of view. We propose a Grid monitoring architecture for scientific workflows. Monitoring data correlation problem is described and an algorithm for on-line distributed collection of monitoring data is proposed. We demonstrate a prototype implementation of the proposed workflow monitoring architecture, the GEMINI monitoring system, and its use for monitoring of a real-life scientific workflow.