On-line extraction of SCSI disk drive parameters
Proceedings of the 1995 ACM SIGMETRICS joint international conference on Measurement and modeling of computer systems
Windows NT file system internals: a developer's guide
Windows NT file system internals: a developer's guide
Advanced Windows: The Developer's Guide to the WIN32 API for Windows NT 3.5 and Windows 95
Advanced Windows: The Developer's Guide to the WIN32 API for Windows NT 3.5 and Windows 95
Locality preserving dictionaries: theory & application to clustering in databases
PODS '99 Proceedings of the eighteenth ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems
Conquest: Better Performance Through a Disk/Persistent-RAM Hybrid File System
ATEC '02 Proceedings of the General Track of the annual conference on USENIX Annual Technical Conference
A High-Performance Cluster Storage Server
HPDC '02 Proceedings of the 11th IEEE International Symposium on High Performance Distributed Computing
On windows file access modes: a performance study
WISICT '05 Proceedings of the 4th international symposium on Information and communication technologies
The Conquest file system: Better performance through a disk/persistent-RAM hybrid design
ACM Transactions on Storage (TOS)
The record-breaking terabyte sort on a compaq cluster
WINSYM'99 Proceedings of the 3rd conference on USENIX Windows NT Symposium - Volume 3
WINSYM'99 Proceedings of the 3rd conference on USENIX Windows NT Symposium - Volume 3
Optimization and bottleneck analysis of network block I/O in commodity storage systems
Proceedings of the 21st annual international conference on Supercomputing
A clean-slate look at disk scrubbing
FAST'10 Proceedings of the 8th USENIX conference on File and storage technologies
Hi-index | 0.00 |
Large-scale database, data mining, and multimedia applications require large, sequential transfers and have bandwidth as a key requirement. This paper investigates the performance of reading and writing large sequential files using the Windows NTtm 4.0 File System. The study explores the performance of Intel Pentium ProTM based memory and IO subsystems, including the processor bus, the PCI bus, the SCSI bus, the disk controllers, and the disk media in a typical server or high-end desktop system. We provide details of the overhead costs at each level of the system and examine a variety of the available tuning knobs. We show that NTFS out-of-the-box performance is quite good, but overheads for small requests can be quite high. The best performance is achieved by using large requests, bypassing the file system cache, spreading the data across many disks and controllers, and using deep-asynchronous requests. This combination allows us to reach or exceed the half-power point of all the individual hardware components.