A measure of transaction processing power
Datamation
Scale and performance in a distributed file system
ACM Transactions on Computer Systems (TOCS)
The Sprite Network Operating System
Computer
A case for redundant arrays of inexpensive disks (RAID)
SIGMOD '88 Proceedings of the 1988 ACM SIGMOD international conference on Management of data
Beating the I/O bottleneck: a case for log-structured file systems
ACM SIGOPS Operating Systems Review
Machine Characterization Based on an Abstract High-Level Language Machine
IEEE Transactions on Computers
IOStone: a synthetic file system benchmark
ACM SIGARCH Computer Architecture News
The design and implementation of a log-structured file system
SOSP '91 Proceedings of the thirteenth ACM symposium on Operating systems principles
Input-output performance evaluation: self-scaling benchmarks, predicted performance
Input-output performance evaluation: self-scaling benchmarks, predicted performance
Maximizing performance in a striped disk array
ISCA '90 Proceedings of the 17th annual international symposium on Computer Architecture
On the foundations of artificial workload design
SIGMETRICS '84 Proceedings of the 1984 ACM SIGMETRICS conference on Measurement and modeling of computer systems
ACM Transactions on Software Engineering and Methodology (TOSEM)
Fault-Tolerant File-I/O for Portable Checkpointing Systems
The Journal of Supercomputing - Special issue on embedded fault-tolerance systems
Using Information from Prior Runs to Improve Automated Tuning Systems
Proceedings of the 2004 ACM/IEEE conference on Supercomputing
Physical Database Design: the database professional's guide to exploiting indexes, views, storage, and more
lmbench: portable tools for performance analysis
ATEC '96 Proceedings of the 1996 annual conference on USENIX Annual Technical Conference
Uncovering performance differences among backbone ISPs with Netdiff
NSDI'08 Proceedings of the 5th USENIX Symposium on Networked Systems Design and Implementation
Benchmarking and testing OSD for correctness and compliance
HVC'05 Proceedings of the First Haifa international conference on Hardware and Software Verification and Testing
Towards realistic benchmarks for virtual infrastructure resource allocators
Proceedings of the Asia-Pacific Workshop on Systems
Towards realistic benchmarks for virtual infrastructure resource allocators
APSys'12 Proceedings of the Third ACM SIGOPS Asia-Pacific conference on Systems
| Hi-index | 0.00 |
Current I/O benchmarks suffer from several chronic problems: they quickly become obsolete; they do not stress the I/O system; and they do not help much in understanding I/O system performance. We propose a new approach to I/O performance analysis. First, we propose a self-scaling benchmark that dynamically adjusts aspects of its workload according to the performance characteristic of the system being measured. By doing so, the benchmark automatically scales across current and future systems. The evaluation aids in understanding system performance by reporting how performance varies according to each of five workload parameters. Second, we propose predicted performance, a technique for using the results from the self-scaling evaluation to estimate quickly the performance for workloads that have not been measured. We show that this technique yields reasonably accurate performance estimates and argue that this method gives a far more accurate comparative performance evaluation than traditional single-point benchmarks. We apply our new evaluation technique by measuring a SPARCstation 1+ with one SCSI disk, an HP 730 with one SCSI-II disk, a DECstation 5000/200 running the Sprite LFS operating system with a three-disk disk array, a Convex C240 minisupercomputer with a four-disk disk array, and a Solbourne 5E/905 fileserver with a two-disk disk array.