System issues in implementing high speed distributed parallel storage systems

Authors:
Brian Tierney;Bill Johnston;Hanan Herzog;Gary Hoo;Guojun Jin;Jason Lee
Affiliations:
Imaging Technologies Group, Lawrence Berkeley Laboratory, Berkeley, CA;Imaging Technologies Group, Lawrence Berkeley Laboratory, Berkeley, CA;Imaging Technologies Group, Lawrence Berkeley Laboratory, Berkeley, CA;Imaging Technologies Group, Lawrence Berkeley Laboratory, Berkeley, CA;Imaging Technologies Group, Lawrence Berkeley Laboratory, Berkeley, CA;Imaging Technologies Group, Lawrence Berkeley Laboratory, Berkeley, CA
Venue:
HSNS'94 Proceedings of the High-Speed Networking Symposium on USENIX 1994 High-Speed Networking Symposium
Year:
1994

Citing 5
Cited 0

A case for redundant arrays of inexpensive disks (RAID)

SIGMOD '88 Proceedings of the 1988 ACM SIGMOD international conference on Management of data
The synchronization of periodic routing messages

SIGCOMM '93 Conference proceedings on Communications architectures, protocols and applications
Continuous Retrieval of Multimedia Data Using Parallelism

IEEE Transactions on Knowledge and Data Engineering
Declustering Objects for Visualization

VLDB '93 Proceedings of the 19th International Conference on Very Large Data Bases
A Continuous Media Player

Proceedings of the Third International Workshop on Network and Operating System Support for Digital Audio and Video

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper we describe several aspects of implementing a high speed network-based distributed application. We describe the design and implementation of a distributed parallel storage system that uses high speed ATM networks as a key element of the architecture. The architecture provides what amounts to a collection of network-based disk block servers, and an associated name server that provides some file system functionality. The implementation approach is that of user level software that runs on UNIX workstations. Both the architecture and the implementation are intended to provide for easy and economical scalability in both performance and capacity. We describe the software architecture, the implementation and operating system overhead issues, and our experiences with this approach in an IP-over-ATM WAN. Although most of the paper is specific to a distributed parallel data server, we believe many of the issues we encountered are generally applicable to any high speed network-based application.