A little language for rapidly constructing automated performance tests

  • Authors:
  • Shaun Dunning;Darren Sawyer

  • Affiliations:
  • NetApp, Inc.;NetApp, Inc.

  • Venue:
  • Proceedings of the 2nd ACM/SPEC International Conference on Performance engineering
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

In order to effectively measure the performance of large scale data management solutions at NetApp, we use a fully automated infrastructure to execute end-to-end system performance tests. Both the software and user requirements of this infrastructure are complex: the system under test runs a multi-protocol, highly specialized operating system and the infrastructure serves a diverse audience of developers, analysts, and field engineers (including both sales and support). In this paper we describe our approach to rapidly constructing automated performance system tests by using a lightweight, little, or domain-specific language called SLSL in order to more effectively express test specifications. Using a real world example, we illustrate the efficacy of SLSL in terms of its expressiveness, flexibility, and ease of use by showing a complex test configuration expressed with just a few language constructs. We also demonstrate how SLSL can be used in conjunction with our performance measurement lab to quickly deploy performance tests that yield highly repeatable measurements.