The evolution of benchmarking as a computer performance evaluation technique

Authors:
Bryon C. Lewis;Albert E. Crews
Affiliations:
Department of Decision Sciences, Georgia State University, Atlanta, Georgia;Data General Corp., Birmingham, Alabama
Venue:
MIS Quarterly
Year:
1985

Citing 3
Cited 1

Evaluation and performance of computers: application benchmarks: the key to meaningful computer evaluations

ACM '65 Proceedings of the 1965 20th national conference
Throughput measurement using a synthetic job stream

AFIPS '71 (Fall) Proceedings of the November 16-18, 1971, fall joint computer conference
A synthetic job for measuring system performance

IBM Systems Journal

On evaluating commercial Cloud services: A systematic review

Journal of Systems and Software

Quantified Score

Hi-index	0.00

Visualization

Abstract

The practice of benchmarking as an assessment tool in computer performance evaluation is traced in this article from the early 1960s to the present. Included here are discussions of standard benchmark problems (used in Standard EDP Reports), application benchmarks, workload mapping, synthetic jobs, and the standard benchmark library concept. Advantages and disadvantages of the various techniques are given, along with a discussion of critical issues raised during the past two decades.