Leveraging complex event processing for grid monitoring

  • Authors:
  • Bartosz Balis;Bartosz Kowalewski;Marian Bubak

  • Affiliations:
  • Institute of Computer Science, AGH, Poland and Academic Computer Centre CYFRONET, Poland;Academic Computer Centre CYFRONET, Poland;Institute of Computer Science, AGH, Poland and Academic Computer Centre CYFRONET, Poland

  • Venue:
  • PPAM'09 Proceedings of the 8th international conference on Parallel processing and applied mathematics: Part II
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

Currently existing monitoring services for Grid infrastructures typically collect information from local agents and store it as data sets in global repositories. However, for some scenarios querying realtime streams of monitoring information would be extremely useful. In this paper, we evaluate Complex Event Processing technologies applied to real-time Grid monitoring. We present a monitoring system which uses CEP technologies to expose monitoring information as queryable data streams. We study an example use case - monitoring for job rescheduling. We also employ CEP technologies for data reduction, measure the overhead of monitoring, and conclude that real-time Grid monitoring is possible without excessive intrusiveness for resources and network.