Performance variation across benchmark suites

  • Authors:
  • Carl Ponder

  • Affiliations:
  • -

  • Venue:
  • ACM SIGMETRICS Performance Evaluation Review
  • Year:
  • 1990

Quantified Score

Hi-index 0.00

Visualization

Abstract

The performance ratio between two systems tends to vary across different benchmarks. Here we study this variation as a "signature" or "fingerprint" of the systems under consideration. This "fingerprint" can be used to guess the performance of programs not represented in a benchmark suite, assess the breadth and credibility of the benchmark suite, and infer details of the system design.