Limits to low-latency communication on high-speed networks
ACM Transactions on Computer Systems (TOCS)
High-speed switch scheduling for local-area networks
ACM Transactions on Computer Systems (TOCS)
The logical disk: a new approach to improving file systems
SOSP '93 Proceedings of the fourteenth ACM symposium on Operating systems principles
A coherent distributed file cache with directory write-behind
ACM Transactions on Computer Systems (TOCS)
Performance and design evaluation of the RAID-II storage server
Distributed and Parallel Databases - Special issue on disk arrays
ACM Transactions on Computer Systems (TOCS)
The TickerTAIP parallel RAID architecture
ACM Transactions on Computer Systems (TOCS)
Experiences with a high-speed network adaptor: a software perspective
SIGCOMM '94 Proceedings of the conference on Communications architectures, protocols and applications
The Zebra striped network file system
ACM Transactions on Computer Systems (TOCS)
The HP AutoRAID hierarchical storage system
SOSP '95 Proceedings of the fifteenth ACM symposium on Operating systems principles
Serverless network file systems
ACM Transactions on Computer Systems (TOCS) - Special issue on operating system principles
Implementing remote procedure calls
ACM Transactions on Computer Systems (TOCS)
Strategic directions in storage I/O issues in large-scale computing
ACM Computing Surveys (CSUR) - Special ACM 50th-anniversary issue: strategic directions in computing research
Eraser: a dynamic data race detector for multithreaded programs
ACM Transactions on Computer Systems (TOCS)
Eraser: a dynamic data race detector for multi-threaded programs
Proceedings of the sixteenth ACM symposium on Operating systems principles
Frangipani: a scalable distributed file system
Proceedings of the sixteenth ACM symposium on Operating systems principles
Archival storage for digital libraries
Proceedings of the third ACM conference on Digital libraries
Implementing cooperative prefetching and caching in a globally-managed memory system
SIGMETRICS '98/PERFORMANCE '98 Proceedings of the 1998 ACM SIGMETRICS joint international conference on Measurement and modeling of computer systems
VISA: Netstation's virtual Internet SCSI adapter
Proceedings of the eighth international conference on Architectural support for programming languages and operating systems
A cost-effective, high-bandwidth storage architecture
Proceedings of the eighth international conference on Architectural support for programming languages and operating systems
The design of a multicast-based distributed file system
OSDI '99 Proceedings of the third symposium on Operating systems design and implementation
Analysis of timing-based mutual exclusion with random times
Proceedings of the eighteenth annual ACM symposium on Principles of distributed computing
Proceedings of the seventeenth ACM symposium on Operating systems principles
SPINE: a safe programmable and integrated network environment
Proceedings of the 8th ACM SIGOPS European workshop on Support for composing distributed applications
Phoenix: a low-power fault-tolerant real-time network-attached storage device
MULTIMEDIA '99 Proceedings of the seventh ACM international conference on Multimedia (Part 1)
Feasibility of a serverless distributed file system deployed on an existing set of desktop PCs
Proceedings of the 2000 ACM SIGMETRICS international conference on Measurement and modeling of computer systems
Network attached storage architecture
Communications of the ACM
ACM Transactions on Computer Systems (TOCS)
Creating trading networks of digital archives
Proceedings of the 1st ACM/IEEE-CS joint conference on Digital libraries
Interposed request routing for scalable network storage
ACM Transactions on Computer Systems (TOCS)
Orthogonal Striping and Mirroring in Distributed RAID for I/O-Centric Cluster Computing
IEEE Transactions on Parallel and Distributed Systems
Peer-to-peer data trading to preserve information
ACM Transactions on Information Systems (TOIS)
Active disk paxos with infinitely many processes
Proceedings of the twenty-first annual symposium on Principles of distributed computing
ACM Transactions on Computer Systems (TOCS)
The Network RamDisk: Using remote memory on heterogeneous NOWs
Cluster Computing
Adaptive Sector Grouping to Reduce False Sharing in Distributed RAID
Cluster Computing
Studies on striping and buffer caching issues for the software RAID file system
Journal of Systems Architecture: the EUROMICRO Journal
Evolving RPC for active storage
Proceedings of the 10th international conference on Architectural support for programming languages and operating systems
Active Storage for Large-Scale Data Mining and Multimedia
VLDB '98 Proceedings of the 24rd International Conference on Very Large Data Bases
DISC '00 Proceedings of the 14th International Conference on Distributed Computing
Peer-to-Peer Resource Trading in a Reliable Distributed System
IPTPS '01 Revised Papers from the First International Workshop on Peer-to-Peer Systems
Instant Image: Transitive and Cyclical Snapshots in Distributed Storage Volumes
Euro-Par '00 Proceedings from the 6th International Euro-Par Conference on Parallel Processing
Bridging the Information Gap in Storage Protocol Stacks
ATEC '02 Proceedings of the General Track of the annual conference on USENIX Annual Technical Conference
Structure and Performance of the Direct Access File System
ATEC '02 Proceedings of the General Track of the annual conference on USENIX Annual Technical Conference
Data Reservoir: utilization of multi-gigabit backbone network for data-intensive research
Proceedings of the 2002 ACM/IEEE conference on Supercomputing
Peabody: The Time Travelling Disk
MSS '03 Proceedings of the 20 th IEEE/11 th NASA Goddard Conference on Mass Storage Systems and Technologies (MSS'03)
IP SAN " From iSCSI to IP-Addressable Ethernet Disks
MSS '03 Proceedings of the 20 th IEEE/11 th NASA Goddard Conference on Mass Storage Systems and Technologies (MSS'03)
A Scalable Architecture for Clustered Network Attached Storage
MSS '03 Proceedings of the 20 th IEEE/11 th NASA Goddard Conference on Mass Storage Systems and Technologies (MSS'03)
Fault-Tolerant Replication Management in Large-Scale Distributed Storage Systems
SRDS '99 Proceedings of the 18th IEEE Symposium on Reliable Distributed Systems
Farsite: federated, available, and reliable storage for an incompletely trusted environment
ACM SIGOPS Operating Systems Review - OSDI '02: Proceedings of the 5th symposium on Operating systems design and implementation
Design of a Media Service Provider Architecture for the Internet
ISCC '00 Proceedings of the Fifth IEEE Symposium on Computers and Communications (ISCC 2000)
On Network CoProcessors for Scalable, Predictable Media Services
IEEE Transactions on Parallel and Distributed Systems
Byzantine disk paxos: optimal resilience with byzantine shared memory
Proceedings of the twenty-third annual ACM symposium on Principles of distributed computing
The software architecture of a SAN storage control system
IBM Systems Journal
D-SPTF: decentralized request distribution in brick-based storage systems
ASPLOS XI Proceedings of the 11th international conference on Architectural support for programming languages and operating systems
FAB: building distributed enterprise disk arrays from commodity components
ASPLOS XI Proceedings of the 11th international conference on Architectural support for programming languages and operating systems
STICS: SCSI-to-IP cache for storage area networks
Journal of Parallel and Distributed Computing
Peer-to-Peer Data Preservation through Storage Auctions
IEEE Transactions on Parallel and Distributed Systems
A Self-Organizing Storage Cluster for Parallel Data-Intensive Applications
Proceedings of the 2004 ACM/IEEE conference on Supercomputing
An Efficient Data Location Protocol for Self.organizing Storage Clusters
Proceedings of the 2003 ACM/IEEE conference on Supercomputing
Farsite: federated, available, and reliable storage for an incompletely trusted environment
OSDI '02 Proceedings of the 5th symposium on Operating systems design and implementationCopyright restrictions prevent ACM from being able to make the PDFs for this conference available for downloading
Distributed Computing
Mining block correlations to improve storage performance
ACM Transactions on Storage (TOS)
Deconstructing Commodity Storage Clusters
Proceedings of the 32nd annual international symposium on Computer Architecture
OS support for a commodity database on PC clusters: distributed devices vs. distributed file systems
ADC '05 Proceedings of the 16th Australasian database conference - Volume 39
Strong Security for Network-Attached Storage
FAST '02 Proceedings of the 1st USENIX Conference on File and Storage Technologies
Myriad: Cost-effective Disaster Tolerance
FAST '02 Proceedings of the 1st USENIX Conference on File and Storage Technologies
GPFS: A Shared-Disk File System for Large Computing Clusters
FAST '02 Proceedings of the 1st USENIX Conference on File and Storage Technologies
Metadata Efficiency in Versioning File Systems
FAST '03 Proceedings of the 2nd USENIX Conference on File and Storage Technologies
FAST '03 Proceedings of the 2nd USENIX Conference on File and Storage Technologies
FAST '04 Proceedings of the 3rd USENIX Conference on File and Storage Technologies
A Versatile and User-Oriented Versioning File System
FAST '04 Proceedings of the 3rd USENIX Conference on File and Storage Technologies
C-Miner: Mining Block Correlations in Storage Systems
FAST '04 Proceedings of the 3rd USENIX Conference on File and Storage Technologies
Segank: A Distributed Mobile Storage System
FAST '04 Proceedings of the 3rd USENIX Conference on File and Storage Technologies
Hydra: a platform for survivable and secure data storage systems
Proceedings of the 2005 ACM workshop on Storage security and survivability
Separating Abstractions from Resources in a Tactical Storage System
SC '05 Proceedings of the 2005 ACM/IEEE conference on Supercomputing
FreeLoader: Scavenging Desktop Storage Resources for Scientific Data
SC '05 Proceedings of the 2005 ACM/IEEE conference on Supercomputing
Discretionary Caching for I/O on Clusters
Cluster Computing
TRAP-Array: A Disk Array Architecture Providing Timely Recovery to Any Point-in-time
Proceedings of the 33rd annual international symposium on Computer Architecture
Exploiting redundancy to conserve energy in storage systems
SIGMETRICS '06/Performance '06 Proceedings of the joint international conference on Measurement and modeling of computer systems
CEFT: A cost-effective, fault-tolerant parallel virtual file system
Journal of Parallel and Distributed Computing
Home-based cooperative cache for parallel I/O applications
Future Generation Computer Systems - Parallel input/output management techniques (PIOMT) in cluster and grid computing
IBM intelligent Bricks project: petabytes and beyond
IBM Journal of Research and Development
Reliability of modular mesh-connected intelligent storage brick systems
IBM Journal of Research and Development
Active disk Paxos with infinitely many processes
Distributed Computing - Special issue: PODC 02
Performance evaluation of distributed iSCSI RAID
SNAPI '03 Proceedings of the international workshop on Storage network architecture and parallel I/Os
SNAPI '03 Proceedings of the international workshop on Storage network architecture and parallel I/Os
Constructing collaborative desktop storage caches for large scientific datasets
ACM Transactions on Storage (TOS)
An approach to virtual allocation in storage systems
ACM Transactions on Storage (TOS)
The SMART way to migrate replicated stateful services
Proceedings of the 1st ACM SIGOPS/EuroSys European Conference on Computer Systems 2006
Exploring high performance distributed file storage using LDPC codes
Parallel Computing
BitVault: a highly reliable distributed data retention platform
ACM SIGOPS Operating Systems Review - Systems work at Microsoft Research
A Data-Mining-Based Prefetching Approach to Caching for Network Storage Systems
INFORMS Journal on Computing
Wayback: a user-level versioning file system for linux
ATEC '04 Proceedings of the annual conference on USENIX Annual Technical Conference
Ursa minor: versatile cluster-based storage
FAST'05 Proceedings of the 4th conference on USENIX Conference on File and Storage Technologies - Volume 4
FAB: enterprise storage systems on a shoestring
HOTOS'03 Proceedings of the 9th conference on Hot Topics in Operating Systems - Volume 9
The case for a session state storage layer
HOTOS'03 Proceedings of the 9th conference on Hot Topics in Operating Systems - Volume 9
Parallax: managing storage for a million machines
HOTOS'05 Proceedings of the 10th conference on Hot Topics in Operating Systems - Volume 10
Constructing services with interposable virtual hardware
NSDI'04 Proceedings of the 1st conference on Symposium on Networked Systems Design and Implementation - Volume 1
Session state: beyond soft state
NSDI'04 Proceedings of the 1st conference on Symposium on Networked Systems Design and Implementation - Volume 1
Timeline: a high performance archive for a distributed object store
NSDI'04 Proceedings of the 1st conference on Symposium on Networked Systems Design and Implementation - Volume 1
Latency management in storage systems
OSDI'00 Proceedings of the 4th conference on Symposium on Operating System Design & Implementation - Volume 4
Self-securing storage: protecting data in compromised system
OSDI'00 Proceedings of the 4th conference on Symposium on Operating System Design & Implementation - Volume 4
Interposed request routing for scalable network storage
OSDI'00 Proceedings of the 4th conference on Symposium on Operating System Design & Implementation - Volume 4
Boxwood: abstractions as the foundation for storage infrastructure
OSDI'04 Proceedings of the 6th conference on Symposium on Opearting Systems Design & Implementation - Volume 6
Using smart clients to build scalable services
ATEC '97 Proceedings of the annual conference on USENIX Annual Technical Conference
Secure file system versioning at the block level
Proceedings of the 2nd ACM SIGOPS/EuroSys European Conference on Computer Systems 2007
Antiquity: exploiting a secure log for wide-area distributed storage
Proceedings of the 2nd ACM SIGOPS/EuroSys European Conference on Computer Systems 2007
Paxos made live: an engineering perspective
Proceedings of the twenty-sixth annual ACM symposium on Principles of distributed computing
Distributed directory service in the Farsite file system
OSDI '06 Proceedings of the 7th symposium on Operating systems design and implementation
A Feasibility Study of a Virtual Storage System for Large Organizations
VTDC '06 Proceedings of the 2nd International Workshop on Virtualization Technology in Distributed Computing
Niobe: A practical replication protocol
ACM Transactions on Storage (TOS)
Workload-based generation of administrator hints for optimizing database storage utilization
ACM Transactions on Storage (TOS)
Parallax: virtual disks for virtual machines
Proceedings of the 3rd ACM SIGOPS/EuroSys European Conference on Computer Systems 2008
A high performance redundancy scheme for cluster file systems
International Journal of High Performance Computing and Networking
Kinesis: A new approach to replica placement in distributed storage systems
ACM Transactions on Storage (TOS)
Selective versioning in a secure disk system
SS'08 Proceedings of the 17th conference on Security symposium
Efficient access to many samall files in a filesystem for grid computing
GRID '07 Proceedings of the 8th IEEE/ACM International Conference on Grid Computing
Model and procedure for performance and availability-wise parallel warehouses
Distributed and Parallel Databases
HYDRAstor: a Scalable Secondary Storage
FAST '09 Proccedings of the 7th conference on File and storage technologies
Smoke and mirrors: reflecting files at a geographically remote location without loss of performance
FAST '09 Proccedings of the 7th conference on File and storage technologies
Dynamic atomic storage without consensus
Proceedings of the 28th ACM symposium on Principles of distributed computing
Symmetric active/active metadata service for high availability parallel file systems
Journal of Parallel and Distributed Computing
Symmetric active/active metadata service for highly available cluster storage systems
PDCS '07 Proceedings of the 19th IASTED International Conference on Parallel and Distributed Computing and Systems
NGI'09 Proceedings of the 5th Euro-NGI conference on Next Generation Internet networks
A novel secure distributed disk system
ICACT'09 Proceedings of the 11th international conference on Advanced Communication Technology - Volume 2
Home-based Cooperative Cache for parallel I/O applications
Future Generation Computer Systems - Parallel input/output management techniques (PIOMT) in cluster and grid computing
Metaserver locality and scalability in a distributed NFS
VECPAR'06 Proceedings of the 7th international conference on High performance computing for computational science
Automated control for elastic storage
Proceedings of the 7th international conference on Autonomic computing
Extensible block-level storage virtualization in cluster-based systems
Journal of Parallel and Distributed Computing
DARC: design and evaluation of an I/O controller for data protection
Proceedings of the 3rd Annual Haifa Experimental Systems Conference
Versioning for workflow evolution
Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing
HotOS'09 Proceedings of the 12th conference on Hot topics in operating systems
Everest: scaling down peak loads through I/O off-loading
OSDI'08 Proceedings of the 8th USENIX conference on Operating systems design and implementation
A transparently-scalable metadata service for the Ursa Minor storage system
USENIXATC'10 Proceedings of the 2010 USENIX conference on USENIX annual technical conference
WIOV'08 Proceedings of the First conference on I/O virtualization
Fast and cautious evolution of cloud storage
HotStorage'10 Proceedings of the 2nd USENIX conference on Hot topics in storage and file systems
Scalable virtual machine storage using local disks
ACM SIGOPS Operating Systems Review
Finding a needle in Haystack: facebook's photo storage
OSDI'10 Proceedings of the 9th USENIX conference on Operating systems design and implementation
StarTrack next generation: a scalable infrastructure for track-based applications
OSDI'10 Proceedings of the 9th USENIX conference on Operating systems design and implementation
Dynamic atomic storage without consensus
Journal of the ACM (JACM)
Scale and concurrency of GIGA+: file system directories with millions of files
FAST'11 Proceedings of the 9th USENIX conference on File and stroage technologies
Keypad: an auditing file system for theft-prone devices
Proceedings of the sixth conference on Computer systems
PRESIDIO: A Framework for Efficient Archival Data Storage
ACM Transactions on Storage (TOS)
Paxos replicated state machines as the basis of a high-performance data store
Proceedings of the 8th USENIX conference on Networked systems design and implementation
Strong security for network-attached storage
FAST'02 Proceedings of the 1st USENIX conference on File and storage technologies
Myriad: cost-effective disaster tolerance
FAST'02 Proceedings of the 1st USENIX conference on File and storage technologies
GPFS: a shared-disk file system for large computing clusters
FAST'02 Proceedings of the 1st USENIX conference on File and storage technologies
Metadata efficiency in versioning file systems
FAST'03 Proceedings of the 2nd USENIX conference on File and storage technologies
FAST'03 Proceedings of the 2nd USENIX conference on File and storage technologies
FAST'04 Proceedings of the 3rd USENIX conference on File and storage technologies
A versatile and user-oriented versioning file system
FAST'04 Proceedings of the 3rd USENIX conference on File and storage technologies
C-Miner: mining block correlations in storage systems
FAST'04 Proceedings of the 3rd USENIX conference on File and storage technologies
Segank: a distributed mobile storage system
FAST'04 Proceedings of the 3rd USENIX conference on File and storage technologies
An integrated high-performance distributed file system implementation on existing local network
Proceedings of the International Conference & Workshop on Emerging Trends in Technology
A file is not a file: understanding the I/O behavior of Apple desktop applications
SOSP '11 Proceedings of the Twenty-Third ACM Symposium on Operating Systems Principles
Detecting failures in distributed systems with the Falcon spy network
SOSP '11 Proceedings of the Twenty-Third ACM Symposium on Operating Systems Principles
Transactional storage for geo-replicated systems
SOSP '11 Proceedings of the Twenty-Third ACM Symposium on Operating Systems Principles
Chimera: data sharing flexibility, shared nothing simplicity
Proceedings of the 15th Symposium on International Database Engineering & Applications
A cluster LVM for SAN environments
ISPA'05 Proceedings of the 2005 international conference on Parallel and Distributed Processing and Applications
A locking protocol for a distributed computing environment
EGC'05 Proceedings of the 2005 European conference on Advances in Grid Computing
Ω meets paxos: leader election and stability without eventual timely links
DISC'05 Proceedings of the 19th international conference on Distributed Computing
Modularized redundant parallel virtual file system
ACSAC'05 Proceedings of the 10th Asia-Pacific conference on Advances in Computer Systems Architecture
Issues in automatic provenance collection
IPAW'06 Proceedings of the 2006 international conference on Provenance and Annotation of Data
An on-line reorganization framework for SAN file systems
ADBIS'06 Proceedings of the 10th East European conference on Advances in Databases and Information Systems
Design and development of file system for storage area networks
ICCSA'05 Proceedings of the 2005 international conference on Computational Science and Its Applications - Volume Part IV
CORFU: a shared log design for flash clusters
NSDI'12 Proceedings of the 9th USENIX conference on Networked Systems Design and Implementation
A File Is Not a File: Understanding the I/O Behavior of Apple Desktop Applications
ACM Transactions on Computer Systems (TOCS)
Surviving congestion in geo-distributed storage systems
USENIX ATC'12 Proceedings of the 2012 USENIX conference on Annual Technical Conference
Scalability of replicated metadata services in distributed file systems
DAIS'12 Proceedings of the 12th IFIP WG 6.1 international conference on Distributed Applications and Interoperable Systems
OSDI'12 Proceedings of the 10th USENIX conference on Operating Systems Design and Implementation
Robustness in the Salus scalable block store
nsdi'13 Proceedings of the 10th USENIX conference on Networked Systems Design and Implementation
CORFU: A distributed shared log
ACM Transactions on Computer Systems (TOCS)
Shroud: ensuring private access to large-scale data in the data center
FAST'13 Proceedings of the 11th USENIX conference on File and Storage Technologies
Gecko: contention-oblivious disk arrays for cloud storage
FAST'13 Proceedings of the 11th USENIX conference on File and Storage Technologies
Strata: scalable high-performance storage on virtualized non-volatile memory
FAST'14 Proceedings of the 12th USENIX conference on File and Storage Technologies
Analysis of HDFS under HBase: a facebook messages case study
FAST'14 Proceedings of the 12th USENIX conference on File and Storage Technologies
A novel approach to data deduplication over the engineering-oriented cloud systems
Integrated Computer-Aided Engineering
Blizzard: fast, cloud-scale block storage for cloud-oblivious applications
NSDI'14 Proceedings of the 11th USENIX Conference on Networked Systems Design and Implementation
Hi-index | 0.02 |
The ideal storage system is globally accessible, always available, provides unlimited performance and capacity for a large number of clients, and requires no management. This paper describes the design, implementation, and performance of Petal, a system that attempts to approximate this ideal in practice through a novel combination of features. Petal consists of a collection of network-connected servers that cooperatively manage a pool of physical disks. To a Petal client, this collection appears as a highly available block-level storage system that provides large abstract containers called virtual disks. A virtual disk is globally accessible to all Petal clients on the network. A client can create a virtual disk on demand to tap the entire capacity and performance of the underlying physical resources. Furthermore, additional resources, such as servers and disks, can be automatically incorporated into Petal.We have an initial Petal prototype consisting of four 225 MHz DEC 3000/700 workstations running Digital Unix and connected by a 155 Mbit/s ATM network. The prototype provides clients with virtual disks that tolerate and recover from disk, server, and network failures. Latency is comparable to a locally attached disk, and throughput scales with the number of servers. The prototype can achieve I/O rates of up to 3150 requests/sec and bandwidth up to 43.1 Mbytes/sec.