Storage Devices, Local File System and Crossbar Network File System Characteristics, and 1 Terabyte File IO Benchmark on the "Numerical Simulator III"

Authors:
Naoyuki Fujita;Hirofumi Ookawa
Affiliations:
-;-
Venue:
MSS '03 Proceedings of the 20 th IEEE/11 th NASA Goddard Conference on Mass Storage Systems and Technologies (MSS'03)
Year:
2003

Citing 6
Cited 0

The SDSC storage resource broker

CASCON '98 Proceedings of the 1998 conference of the Centre for Advanced Studies on Collaborative research
Knowledge-based Grids

MSS '01 Proceedings of the Eighteenth IEEE Symposium on Mass Storage Systems and Technologies
SFIO a striped file I/O library for MPI

MSS '01 Proceedings of the Eighteenth IEEE Symposium on Mass Storage Systems and Technologies
Two Case Studies of the Application of Dynamic Modeling Techniques in Performance Assessment and Prediction of Complex Shared Storage Architectures

MSS '01 Proceedings of the Eighteenth IEEE Symposium on Mass Storage Systems and Technologies
High-Speed Data Transfer via HPSS using Striped Gigabit Ethernet Communications Phil Andrews, Tom Sherwin, and Victor Hazlewood

MSS '01 Proceedings of the Eighteenth IEEE Symposium on Mass Storage Systems and Technologies
File System Benchmarks, Then, Now, and Tomorrow

MSS '01 Proceedings of the Eighteenth IEEE Symposium on Mass Storage Systems and Technologies

Quantified Score

Hi-index	0.00

Visualization

Abstract

We benchmarked a mass storage system named "CeMSS" on the "Numerical Simulator III" System. It has eighty (80) RAID-5 disk arrays and forty (40) LTO tape drives, as a storage devices, and has an HSM based local file system and crossbar network file system. We also described CeMSS design outline. In order to clear our benchmark perspective we defined "Standard IO Characteristic" and "User IO Pattern". We recognized that the disk and tape devices of CeMSS are optimized at 2 [MB] and 128+[KB] IO size. Using 16-way disks, userapplication programs can use over 1 [GB/s] IO throughput on the NS-III. And under 80-way disk condition, CeMSS could operate a 1 [TB] file within 10 minutes.