Towards 'integrated' monitoring and management of DataCenters using complex event processing techniques

  • Authors:
  • Krishnaprasad Narayanan;Sumit Kumar Bose;Shrisha Rao

  • Affiliations:
  • Global Technology Center, Bangalore, India;Global Technology Center, Bangalore, India;IIIT Bangalore, Electronics, Bangalore, India

  • Venue:
  • COMPUTE '11 Proceedings of the Fourth Annual ACM Bangalore Conference
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

Diagnosing cause of system failure in data centers that house large interconnected complex computer systems is a herculean task. This is because different monitoring tools for network, storage, server, facilities and application provide useful information regarding the health of the communication systems, the storage arrays, the physical machines, the environmental factors and the applications within a data center respectively in only a piece-meal manner. The existing tools fail to provide a comprehensive view of the complete set of operations within a data-center. In the absence of integrated monitoring and management tools, a data center administrator has to manually shuffle through and analyze data from various logs generated by the disparate monitoring tools on occurrence of a fault for identifying the root cause. In this paper we propose an approach for integrated data center health monitoring and management framework on top of the existing monitoring tools. The integrated framework leverages complex event processing techniques to process massive streams of events from these tools in (near) real time and enables automatic reuse of the existing monitoring tools in a non-intrusive manner.