Distributed parallel data storage systems: a scalable approach to high speed image servers

Authors:
Brian Tierney;Jason Lee;Ling Tony Chen;Hanan Herzog;Gary Hoo;Guojun Jin;William E. Johnston
Affiliations:
Imaging and Distributed Computing Group, Lawrence Berkeley Laboratory, Berkeley, CA;Imaging and Distributed Computing Group, Lawrence Berkeley Laboratory, Berkeley, CA;Data Management Research Group, Lawrence Berkeley Laboratory, Berkeley, CA;Imaging and Distributed Computing Group, Lawrence Berkeley Laboratory, Berkeley, CA;Imaging and Distributed Computing Group, Lawrence Berkeley Laboratory, Berkeley, CA;Imaging and Distributed Computing Group, Lawrence Berkeley Laboratory, Berkeley, CA;Imaging and Distributed Computing Group, Lawrence Berkeley Laboratory, Berkeley, CA and Lawrence Berkeley Laboratory
Venue:
MULTIMEDIA '94 Proceedings of the second ACM international conference on Multimedia
Year:
1994

Citing 5
Cited 17

A case for redundant arrays of inexpensive disks (RAID)

SIGMOD '88 Proceedings of the 1988 ACM SIGMOD international conference on Management of data
Using high speed networks to enable distributed parallel image server systems

Proceedings of the 1994 ACM/IEEE conference on Supercomputing
Continuous Retrieval of Multimedia Data Using Parallelism

IEEE Transactions on Knowledge and Data Engineering
Declustering Objects for Visualization

VLDB '93 Proceedings of the 19th International Conference on Very Large Data Bases
A Continuous Media Player

Proceedings of the Third International Workshop on Network and Operating System Support for Digital Audio and Video

Remote I/O: fast access to distant storage

Proceedings of the fifth workshop on I/O in parallel and distributed systems
Continuous display using heterogeneous disk-subsystems

MULTIMEDIA '97 Proceedings of the fifth ACM international conference on Multimedia
Coding for High Availability of a Distributed-Parallel Storage System

IEEE Transactions on Parallel and Distributed Systems
GASS: a data movement and access service for wide area computing systems

Proceedings of the sixth workshop on I/O in parallel and distributed systems
MPICH-GQ: quality-of-service for message passing programs

Proceedings of the 2000 ACM/IEEE conference on Supercomputing
File and Object Replication in Data Grids

Cluster Computing
Using high speed networks to enable distributed parallel image server systems

Proceedings of the 1994 ACM/IEEE conference on Supercomputing
A TCP tuning daemon

Proceedings of the 2002 ACM/IEEE conference on Supercomputing
Scheduling of Storage and Cache Servers for Replicated Multimedia Data

HPC-ASIA '97 Proceedings of the High-Performance Computing on the Information Superhighway, HPC-Asia '97
Approaches for a reliable high-performance distributed-parallel storage system

HPDC '96 Proceedings of the 5th IEEE International Symposium on High Performance Distributed Computing
A High-Performance Cluster Storage Server

HPDC '02 Proceedings of the 11th IEEE International Symposium on High Performance Distributed Computing
Video IBPster

Future Generation Computer Systems - iGrid 2002
Using overlays for efficient data transfer over shared wide-area networks

Proceedings of the 2008 ACM/IEEE conference on Supercomputing
Elastic Cloud Caches for Accelerating Service-Oriented Computations

Proceedings of the 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis
CaPaS: an optimal security-aware cache replacement algorithm for cluster storage systems

International Journal of High Performance Systems Architecture
End-to-end quality of service for high-end applications

Computer Communications
On causes of GridFTP transfer throughput variance

NDM '13 Proceedings of the Third International Workshop on Network-Aware Data Management

Quantified Score

Hi-index	0.00

Visualization

Abstract

We have designed, built, and analyzed a distributed parallel storage system that will supply image streams fast enough to permit multi-user, “real-time”, video-like applications in a wide-area ATM network-based Internet environment. We have based the implementation on user-level code in order to secure portability; we have characterized the performance bottlenecks arising from operating system and hardware issues, and based on this have optimized our design to make the best use of the available performance. Although at this time we have only operated with a few classes of data, the approach appears to be capable of providing a scalable, high-performance, and economical mechanism to provide a data storage system for several classes of data (including mixed multimedia streams), and for applications (clients) that operate in a high-speed network environment.