Benchmarking publish/subscribe-based messaging systems

  • Authors:
  • Kai Sachs;Stefan Appel;Samuel Kounev;Alejandro Buchmann

  • Affiliations:
  • Databases and Distributed System Group, TU Darmstadt, Germany;Databases and Distributed System Group, TU Darmstadt, Germany;Descartes Research Group, Karlsruhe Institute of Technology;Databases and Distributed System Group, TU Darmstadt, Germany

  • Venue:
  • DASFAA'10 Proceedings of the 15th international conference on Database systems for advanced applications
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

Publish/subscribe-based messaging systems are used increasingly often as a communication mechanism in data-oriented web applications. Such applications often pose serious performance and scalability challenges. To address these challenges, it is important that systems are tested using benchmarks to evaluate their performance and scalability before they are put into production. In this paper, we present jms2009-PS, a new benchmark for publish/subscribe-based messaging systems built on top of the SPECjms2007 standard workload.We introduce the benchmark and discuss its configuration parameters showing how the workload can be customized to evaluate various aspects of publish/subscribe communication. Finally, we present a case study illustrating how the benchmark can be used for performance analysis of messaging servers.