Paper: The SPEC benchmarks

  • Authors:
  • Kaivalya M. Dixit

  • Affiliations:
  • -

  • Venue:
  • Parallel Computing
  • Year:
  • 1991

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper characterizes problems with popular benchmarks used to measure system performance and describes the history, structure, mission, future, and workings of an evolving standard in characterizing systems performance. Systems Performance Evaluation Cooperative (SPEC) represents an effort of major computer companies to create a yardstick to measure the performance of computer systems. This paper compares results of three architectures with traditional performance metrics and metrics developed by SPEC. It discusses strengths and weaknesses of SPEC and warns users about the dangers of single number performance characterization.