Workload characterization of the SPECjms2007 benchmark

Authors:
Kai Sachs;Samuel Kounev;Jean Bacon;Alejandro Buchmann
Affiliations:
Databases and Distributed Systems Group, TU Darmstadt, Germany;Databases and Distributed Systems Group, TU Darmstadt, Germany and Computer Laboratory, University of Cambridge, UK;Computer Laboratory, University of Cambridge, UK;Databases and Distributed Systems Group, TU Darmstadt, Germany
Venue:
EPEW'07 Proceedings of the 4th European performance engineering conference on Formal methods and stochastic models for performance evaluation
Year:
2007

Citing 3
Cited 3

RFID Handbook: Fundamentals and Applications in Contactless Smart Cards and Identification

RFID Handbook: Fundamentals and Applications in Contactless Smart Cards and Identification
Improving data access of J2EE applications by exploiting asynchronous messaging and caching services

VLDB '02 Proceedings of the 28th international conference on Very Large Data Bases
Integrating automatic data acquisition with business processes experiences with SAP's auto-ID infrastructure

VLDB '04 Proceedings of the Thirtieth international conference on Very large data bases - Volume 30

A pattern-based performance completion for Message-oriented Middleware

WOSP '08 Proceedings of the 7th international workshop on Software and performance
Parametric performance completions for model-driven performance prediction

Performance Evaluation
Performance evaluation and benchmarking of event-based systems: SPEC distinguished dissertation award 2011 (invited abstract)

ICPE '12 Proceedings of the 3rd ACM/SPEC International Conference on Performance Engineering

Quantified Score

Hi-index	0.00

Visualization

Abstract

Message-oriented middleware (MOM) is at the core of a vast number of financial services and telco applications, and is gaining increasing traction in other industries, such as manufacturing, transportation, health-care and supply chain management. There is a strong interest in the end user and analyst communities for a standardized benchmark suite for evaluating the performance and scalability of MOM. In this paper, we present a workload characterization of the SPECjms2007 benchmark which is the world's first industry-standard benchmark specialized for MOM. In addition to providing standard workload and metrics for MOM performance, the benchmark provides a flexible performance analysis framework that allows users to customize the workload according to their requirements. The workload characterization presented in this paper serves two purposes i) to help users understand the internal components of the SPECjms2007 workload and the way they are scaled, ii) to show how the workload can be customized to exercise and evaluate selected aspects of MOM performance. We discuss how the various features supported by the benchmark can be exploited for in-depth performance analysis of MOM infrastructures.