The GENESIS distributed-memory benchmarks
Computer benchmarks
On the Automatic Parallelization of the Perfect Benchmarks®
IEEE Transactions on Parallel and Distributed Systems
The grid: blueprint for a new computing infrastructure
The grid: blueprint for a new computing infrastructure
Benchmarking with Real Industrial Applications: The SPEC High-Performance Group
IEEE Computational Science & Engineering
Performance of Various Computers Using Standard Linear Equations Software
Performance of Various Computers Using Standard Linear Equations Software
A Framework for Measuring Supercomputer Productivity
International Journal of High Performance Computing Applications
Benchmarking XML processors for applications in grid web services
Proceedings of the 2006 ACM/IEEE conference on Supercomputing
Measuring the Performance and Reliability of Production Computational Grids
GRID '06 Proceedings of the 7th IEEE/ACM International Conference on Grid Computing
| Hi-index | 0.01 |
The authors present a brief overview of the development of benchmarks for parallel performance analysis and show how a set of widely accepted parallel benchmarks has emerged from the Parkbench initiative. At the lowest level, basic node parameters are captured by the LINPACK benchmark and the Genesis communications benchmarks, which give information on message-passing latency and bandwidth. At kernel and application levels, results are widely available for the NAS parallel benchmarks. A new release of the Genesis communications benchmarks is described, which addresses the important issue of the effect of memory hierarchy on message transfers. The rest of the paper is concerned with the way in which benchmark results can be used to predict performance of full applications. Three studies are considered: the PERFORM estimation tool and WHITEBOX benchmarking are research projects, indicating some possible directions for progress, while INTREPID is the basis of a commercial system for scheduling meta-applications based on performance models for the components.