Distributed parallel data storage systems: a scalable approach to high speed image servers
MULTIMEDIA '94 Proceedings of the second ACM international conference on Multimedia
RIO: a real-time multimedia object server
ACM SIGMETRICS Performance Evaluation Review - Special issue on multimedia storage systems
The grid: blueprint for a new computing infrastructure
The grid: blueprint for a new computing infrastructure
CNS '97 Proceedings of the sixth annual conference on Computational neuroscience : trends in research, 1998: trends in research, 1998
GASS: a data movement and access service for wide area computing systems
Proceedings of the sixth workshop on I/O in parallel and distributed systems
ICS '01 Proceedings of the 15th international conference on Supercomputing
A performance study of sequential I/O on windows NTTM4
WINSYM'98 Proceedings of the 2nd conference on USENIX Windows NT Symposium - Volume 2
DataStager: scalable data staging services for petascale applications
Proceedings of the 18th ACM international symposium on High performance distributed computing
DataStager: scalable data staging services for petascale applications
Cluster Computing
CaPaS: an optimal security-aware cache replacement algorithm for cluster storage systems
International Journal of High Performance Systems Architecture
| Hi-index | 0.00 |
An essential building block for any Data Grid infrastructure is the storage server. In this paper we describe a high-performance cluster storage server built around the SDSC Storage Resource Broker (SRB) and commodity workstations. A number of performance critical design issues and our solutions to them are described. We incorporate pipeline optimizations into SRB to enable the full overlapping of communication and disk I/O. With these optimizations we were able to deliver to the application more than 95% of the disk throughput achievable through a remote connection. Then we show how our approach to network-striped transport is effective in achieving aggregate cluster-to-cluster throughput which scales with the number ofconnections. Finally, we present a federated SRB service over MPI that allows fast TCP connections to stripe data across multiple server disks reaching 97% of the combined write capacity of multiple nodes.