K-WfGrid Distributed Monitoring and Performance Analysis Services for Workflows in the Grid

Authors:
Hong-Linh Truong;Peter Brunner;Thomas Fahringer;Francesco Nerieri;Robert Samborski;Bartosz Balis;Marian Bubak;Kuba Rozkwitalski
Affiliations:
University of Innsbruck, Austria;University of Innsbruck, Austria;University of Innsbruck, Austria;University of Innsbruck, Austria;University of Innsbruck, Austria;Institute of Computer Science, AGH, Poland;Institute of Computer Science, AGH, Poland;Institute of Computer Science, AGH, Poland
Venue:
E-SCIENCE '06 Proceedings of the Second IEEE International Conference on e-Science and Grid Computing
Year:
2006

Citing 0
Cited 8

Performance metrics and ontologies for Grid workflows

Future Generation Computer Systems
Workflow adaptation as an autonomic computing problem

Proceedings of the 2nd workshop on Workflows in support of large-scale science
Monitoring of Grid scientific workflows

Scientific Programming - Large-Scale Programming Tools and Environments
Analysis of application heartbeats: learning structural and temporal features in time series data for identification of performance problems

Proceedings of the 2008 ACM/IEEE conference on Supercomputing
DIPAS: A distributed performance analysis service for grid service-based workflows

Future Generation Computer Systems
Scientific workflow design for mere mortals

Future Generation Computer Systems
Workflow overhead analysis and optimizations

Proceedings of the 6th workshop on Workflows in support of large-scale science
User-steering of HPC workflows: state-of-the-art and future directions

Proceedings of the 2nd ACM SIGMOD Workshop on Scalable Workflow Execution Engines and Technologies

Quantified Score

Hi-index	0.00

Visualization

Abstract

Grid workflows for e-science are complex and prone to failures. However, there is a lack of performance monitoring and analysis tools for supporting the user as well as workflow middleware to monitor and understand the performance of complex interactions among Grid applications, middleware and resources involved in workflow executions. In this paper, we present a novel integrated environment which supports online performance monitoring and analysis of service-oriented workflows. Performance monitoring and analysis of Grid workflows and infrastructure is conducted through a Web portal. Performance overheads of Grid workflows are analyzed in a systematic way, and performance problems can be detected during runtime. Moreover, we present several languages that alleviate the interaction among performance monitoring and analysis services and their clients. Our system has been integrated into the K-WfGrid knowledge-based workflow system. It plays a key role in supporting the user and developer to analyze their workflows and in providing performance knowledge for constructing and executing workflows.