Benchmarking event processing systems: current state and future directions

  • Authors:
  • Marcelo R.N. Mendes;Pedro Bizarro;Paulo Marques

  • Affiliations:
  • Univesidade de Coimbra, Coimbra, Portugal;Univesidade de Coimbra, Coimbra, Portugal;Univesidade de Coimbra, Coimbra, Portugal

  • Venue:
  • Proceedings of the first joint WOSP/SIPEW international conference on Performance engineering
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

Complex Event Processing (CEP) has attracted a lot of interest from academia and industry in recent years. It has been employed in a variety of domains (e.g. financial, health-care, military) as a way of promptly detecting and reacting to the occurrence of certain events/situations of interest. However, as a relatively new area, many people are still unaware or unfamiliar with CEP. The goal of this tutorial is therefore twofold: first to give a broad view of CEP to researchers and practitioners of the performance engineering community; second to share our experiences over the last months in the ambit of BiCEP, a research project at University of Coimbra that aims at devising standard benchmarks for CEP. We present the general principles behind the definition of benchmarks, the specific challenges and novelties found when benchmarking CEP systems, as well as the current state of the BiCEP project and its future directions. We also provide hands-on instruction on the FINCoS framework, a set of tools we have developed for carrying out experimental performance evaluation of CEP engines.