How not to lie with statistics: the correct way to summarize benchmark results
Communications of the ACM - The MIT Press scientific computation series
Considerations on the insularity of performance evaluation
IEEE Transactions on Software Engineering
MIPS, Dhrystones, and other tales
Datamation
Dhrystone: a synthetic systems programming benchmark
Communications of the ACM
ACM '65 Proceedings of the 1965 20th national conference
ParcBench: a benchmark for shared-memory architectures
ACM SIGARCH Computer Architecture News
| Hi-index | 0.00 |
The author offers a simple mathematical model of the interrelation of hardware and software to illustrate the necessity of knowledge of, and control over, the system under evaluation. He presents a list of hardware and software variables in Unix systems that should be considered when running benchmarks and a set of guidelines to benchmarking technique. While Unix is used as the case study, most (if not all) of the unwritten rules generally apply to other operating system environments. The author applies these guidelines to various benchmarks to illustrate the need for proper technique.