Feasibility of a serverless distributed file system deployed on an existing set of desktop PCs
Proceedings of the 2000 ACM SIGMETRICS international conference on Measurement and modeling of computer systems
Freenet: a distributed anonymous information storage and retrieval system
International workshop on Designing privacy enhancing technologies: design issues in anonymity and unobservability
The free haven project: distributed anonymous storage service
International workshop on Designing privacy enhancing technologies: design issues in anonymity and unobservability
OceanStore: an architecture for global-scale persistent storage
ASPLOS IX Proceedings of the ninth international conference on Architectural support for programming languages and operating systems
Chord: A scalable peer-to-peer lookup service for internet applications
Proceedings of the 2001 conference on Applications, technologies, architectures, and protocols for computer communications
A scalable content-addressable network
Proceedings of the 2001 conference on Applications, technologies, architectures, and protocols for computer communications
Storage management and caching in PAST, a large-scale, persistent peer-to-peer storage utility
SOSP '01 Proceedings of the eighteenth ACM symposium on Operating systems principles
Wide-area cooperative storage with CFS
SOSP '01 Proceedings of the eighteenth ACM symposium on Operating systems principles
Tapestry: An Infrastructure for Fault-tolerant Wide-area Location and
Tapestry: An Infrastructure for Fault-tolerant Wide-area Location and
Extracting guarantees from chaos
Communications of the ACM
When FEC Speed up Data Access in P2P Networks
IDMS/PROMS 2002 Proceedings of the Joint International Workshops on Interactive Distributed Multimedia Systems and Protocols for Multimedia Systems: Protocols and Systems for Interactive Distributed Multimedia
Software-Based Erasure Codes for Scalable Distributed Storage
MSS '03 Proceedings of the 20 th IEEE/11 th NASA Goddard Conference on Mass Storage Systems and Technologies (MSS'03)
Reliability Mechanisms for Very Large Storage Systems
MSS '03 Proceedings of the 20 th IEEE/11 th NASA Goddard Conference on Mass Storage Systems and Technologies (MSS'03)
Future Generation Computer Systems - iGrid 2002
Erasure Code Replication Revisited
P2P '04 Proceedings of the Fourth International Conference on Peer-to-Peer Computing
DCFS: distributed cooperative fault-tolerance storage mechanism
ACM SIGOPS Operating Systems Review
DISP: Practical, efficient, secure and fault-tolerant distributed data storage
ACM Transactions on Storage (TOS)
To Unify Structured and Unstructured P2P Systems
IPDPS '05 Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS'05) - Papers - Volume 01
Using redundancy to cope with failures in a delay tolerant network
Proceedings of the 2005 conference on Applications, technologies, architectures, and protocols for computer communications
Erasure-coding based routing for opportunistic networks
Proceedings of the 2005 ACM SIGCOMM workshop on Delay-tolerant networking
Awarded Best Student Paper! - Pond: The OceanStore Prototype
FAST '03 Proceedings of the 2nd USENIX Conference on File and Storage Technologies
LH*RS---a highly-available scalable distributed data structure
ACM Transactions on Database Systems (TODS)
Efficient heartbeats and repair of softstate in decentralized object location and routing systems
EW 10 Proceedings of the 10th workshop on ACM SIGOPS European workshop
Separating durability and availability in self-managed storage
Proceedings of the 11th workshop on ACM SIGOPS European workshop
Exploiting redundancy to conserve energy in storage systems
SIGMETRICS '06/Performance '06 Proceedings of the joint international conference on Measurement and modeling of computer systems
A hybrid routing approach for opportunistic networks
Proceedings of the 2006 SIGCOMM workshop on Challenged networks
Strategies for Checkpoint Storage on Opportunistic Grids
IEEE Distributed Systems Online
Improving duplicate elimination in storage systems
ACM Transactions on Storage (TOS)
A fresh look at the reliability of long-term digital storage
Proceedings of the 1st ACM SIGOPS/EuroSys European Conference on Computer Systems 2006
Survey of research towards robust peer-to-peer networks: search methods
Computer Networks: The International Journal of Computer and Telecommunications Networking
Exploring high performance distributed file storage using LDPC codes
Parallel Computing
Ursa minor: versatile cluster-based storage
FAST'05 Proceedings of the 4th conference on USENIX Conference on File and Storage Technologies - Volume 4
High availability, scalable storage, dynamic peer networks: pick two
HOTOS'03 Proceedings of the 9th conference on Hot Topics in Operating Systems - Volume 9
POST: a secure, resilient, cooperative messaging system
HOTOS'03 Proceedings of the 9th conference on Hot Topics in Operating Systems - Volume 9
Designing a DHT for low latency and high throughput
NSDI'04 Proceedings of the 1st conference on Symposium on Networked Systems Design and Implementation - Volume 1
Glacier: highly durable, decentralized storage despite massive correlated failures
NSDI'05 Proceedings of the 2nd conference on Symposium on Networked Systems Design & Implementation - Volume 2
Novel architectures for P2P applications: The continuous-discrete approach
ACM Transactions on Algorithms (TALG)
Proceedings of the international workshop on Workshop on multimedia information retrieval
Low-overhead byzantine fault-tolerant storage
Proceedings of twenty-first ACM SIGOPS symposium on Operating systems principles
LH*RS: a highly available distributed data storage
VLDB '04 Proceedings of the Thirtieth international conference on Very large data bases - Volume 30
Insight into redundancy schemes in DHTs
The Journal of Supercomputing
Replication degree customization for high availability
Proceedings of the 3rd ACM SIGOPS/EuroSys European Conference on Computer Systems 2008
RobuSTore: a distributed storage architecture with robust and high performance
Proceedings of the 2007 ACM/IEEE conference on Supercomputing
SafeStore: a durable and practical storage system
ATC'07 2007 USENIX Annual Technical Conference on Proceedings of the USENIX Annual Technical Conference
StoreGPU: exploiting graphics processing units to accelerate distributed storage systems
HPDC '08 Proceedings of the 17th international symposium on High performance distributed computing
DADC '08 Proceedings of the 2008 international workshop on Data-aware distributed computing
Security in a peer-to-peer data grid storage system
Proceedings of the 4th annual workshop on Cyber security and information intelligence research: developing strategies to meet the cyber security and information intelligence challenges ahead
Availability in Peer to Peer Management Networks
APNOMS '08 Proceedings of the 11th Asia-Pacific Symposium on Network Operations and Management: Challenges for Next Generation Network Operations and Service Management
A three-tier information management architecture for mobile grid environments
Proceedings of the 6th International Conference on Advances in Mobile Computing and Multimedia
HYDRAstor: a Scalable Secondary Storage
FAST '09 Proccedings of the 7th conference on File and storage technologies
Efficient maintenance of distributed data in highly dynamic opportunistic grids
Proceedings of the 2009 ACM symposium on Applied Computing
R-ADMAD: high reliability provision for large-scale de-duplication archival storage systems
Proceedings of the 23rd international conference on Supercomputing
Preserving digital data in heterogeneous environments
Proceedings of the 9th ACM/IEEE-CS joint conference on Digital libraries
Deep-Space Transport Protocol: A novel transport scheme for Space DTNs
Computer Communications
On GPU's viability as a middleware accelerator
Cluster Computing
HDDBrs middleware for implementing highly available distributed databases
Proceedings of the 18th ACM conference on Information and knowledge management
Fault recovery mechanism in single-hop sensor networks
Computer Communications
Content-access QoS in peer-to-peer networks using a fast MDS erasure code
Computer Communications
Redundancy Maintenance and Garbage Collection Strategies in Peer-to-Peer Storage Systems
SSS '09 Proceedings of the 11th International Symposium on Stabilization, Safety, and Security of Distributed Systems
Self-organized Data Redundancy Management for Peer-to-Peer Storage Systems
IWSOS '09 Proceedings of the 4th IFIP TC 6 International Workshop on Self-Organizing Systems
DiskReduce: RAID for data-intensive scalable computing
Proceedings of the 4th Annual Workshop on Petascale Data Storage
Decentralized coding algorithms for distributed storage in wireless sensor networks
IEEE Journal on Selected Areas in Communications
Cooperative recovery of distributed storage systems from multiple losses with network coding
IEEE Journal on Selected Areas in Communications
Effective data replication in heterogeneous structured P2P networks
WiCOM'09 Proceedings of the 5th International Conference on Wireless communications, networking and mobile computing
eSciGrid: A P2P-based e-science Grid for scalable and efficient data sharing
Future Generation Computer Systems
Distributed hash table based peer-to-peer version control system for collaboration
CSCWD'06 Proceedings of the 10th international conference on Computer supported cooperative work in design III
Performance analysis of peer-to-peer storage systems
ITC20'07 Proceedings of the 20th international teletraffic conference on Managing traffic performance in converged networks
On using probabilistic forwarding to improve HEC-based data forwarding in opportunistic networks
EUC'07 Proceedings of the 2007 international conference on Embedded and ubiquitous computing
Towards secure data management system for grid environment based on the cell broadband engine
PPAM'07 Proceedings of the 7th international conference on Parallel processing and applied mathematics
RACS: a case for cloud storage diversity
Proceedings of the 1st ACM symposium on Cloud computing
Naming and integrity: self-verifying data in peer-to-peer systems
Future directions in distributed computing
Replication strategies for highly available peer-to-peer storage
Future directions in distributed computing
A round-based pricing scheme for maximizing service provider's revenue in P2PTV networks
IMSAA'09 Proceedings of the 3rd IEEE international conference on Internet multimedia services architecture and applications
Highly available component sharing in large-scale multi-tenant cloud systems
Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing
Network coding for distributed storage systems
IEEE Transactions on Information Theory
Cost-bandwidth tradeoff in distributed storage systems
Computer Communications
Remote data checking for network coding-based distributed storage systems
Proceedings of the 2010 ACM workshop on Cloud computing security workshop
Data life time for different placement policies in P2P storage systems
Globe'10 Proceedings of the Third international conference on Data management in grid and peer-to-peer systems
Availability in globally distributed storage systems
OSDI'10 Proceedings of the 9th USENIX conference on Operating systems design and implementation
A quantitative analysis of redundancy schemes for peer-to- peer storage systems
SSS'10 Proceedings of the 12th international conference on Stabilization, safety, and security of distributed systems
Computer Networks: The International Journal of Computer and Telecommunications Networking
Pond: the oceanstore prototype
FAST'03 Proceedings of the 2nd USENIX conference on File and storage technologies
Reducing Repair Traffic in P2P Backup Systems: Exact Regenerating Codes on Hierarchical Codes
ACM Transactions on Storage (TOS)
Hybrid approaches for distributed storage systems
Globe'11 Proceedings of the 4th international conference on Data management in grid and peer-to-peer systems
A security and high-availability layer for cloud storage
WISS'10 Proceedings of the 2010 international conference on Web information systems engineering
SEERDIS: a DHT-based resource indexing and discovery scheme for the data center
Proceedings of the 19th High Performance Computing Symposia
Repairing Flocks in Peer-to-Peer Networks
WI-IAT '11 Proceedings of the 2011 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology - Volume 02
Redundancy schemes for high availability in DHTs
ISPA'05 Proceedings of the Third international conference on Parallel and Distributed Processing and Applications
Requirements for secure logging of decentralized cross-organizational workflow executions
OTM'05 Proceedings of the 2005 OTM Confederated international conference on On the Move to Meaningful Internet Systems
Understanding the session durability in peer-to-peer storage system
ICCS'06 Proceedings of the 6th international conference on Computational Science - Volume Part IV
High availability in DHTs: erasure coding vs. replication
IPTPS'05 Proceedings of the 4th international conference on Peer-to-Peer Systems
Towards efficient execution of erasure codes on multicore architectures
PARA'10 Proceedings of the 10th international conference on Applied Parallel and Scientific Computing - Volume 2
Rethinking erasure codes for cloud file systems: minimizing I/O for recovery and degraded reads
FAST'12 Proceedings of the 10th USENIX conference on File and Storage Technologies
Planning for optimal multi-site data distribution for disaster recovery
GECON'11 Proceedings of the 8th international conference on Economics of Grids, Clouds, Systems, and Services
Multimedia Tools and Applications
Erasure coding in windows azure storage
USENIX ATC'12 Proceedings of the 2012 USENIX conference on Annual Technical Conference
Robust Redundancy Scheme for the Repair Process: Hierarchical Codes in the Bandwidth-Limited Systems
Journal of Grid Computing
Scalia: an adaptive scheme for efficient multi-cloud storage
SC '12 Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis
Availability modelling of a virtual black box for automotive systems
Proceedings of the 2nd International Workshop on Software Engineering for Resilient Systems
Scalable Reed-Solomon-based reliable local storage for HPC applications on iaas clouds
Euro-Par'12 Proceedings of the 18th international conference on Parallel Processing
Towards efficient replication of documents in chord: case (r,s) erasure codes
ICICA'12 Proceedings of the Third international conference on Information Computing and Applications
Analysis for REPERA: A Hybrid Data Protection Mechanism in Distributed Environment
International Journal of Cloud Applications and Computing
Reducing Correlated Failures Impact in Peer-to-Peer Storage Systems Using Mobile Agents Flocks
WI-IAT '12 Proceedings of the The 2012 IEEE/WIC/ACM International Joint Conferences on Web Intelligence and Intelligent Agent Technology - Volume 02
The cloud is not 'there', we are the cloud!
International Journal of Web and Grid Services
In-network redundancy generation for opportunistic speedup of data backup
Future Generation Computer Systems
Energy-efficient fault-tolerant data storage & processing in dynamic networks
Proceedings of the fourteenth ACM international symposium on Mobile ad hoc networking and computing
Exploiting Redundancies and Deferred Writes to Conserve Energy in Erasure-Coded Storage Clusters
ACM Transactions on Storage (TOS)
Regenerating codes: a system perspective
ACM SIGOPS Operating Systems Review
Effect of codeword placement on the reliability of erasure coded data storage systems
QEST'13 Proceedings of the 10th international conference on Quantitative Evaluation of Systems
HotStorage'13 Proceedings of the 5th USENIX conference on Hot Topics in Storage and File Systems
On the interplay between data redundancy and retrieval times in P2P storage systems
Computer Networks: The International Journal of Computer and Telecommunications Networking
FAST'14 Proceedings of the 12th USENIX conference on File and Storage Technologies
| Hi-index | 0.08 |
Peer-to-peer systems are positioned to take advantage of gains in network bandwidth, storage capacity, and computational resources to provide long-term durable storage infrastructures. In this paper, we quantitatively compare building a distributed storage infrastructure that is self-repairing and resilient to faults using either a replicated system or an erasure-resilient system. We show that systems employing erasure codes have mean time to failures many orders of magnitude higher than replicated systems with similar storage and bandwidth requirements. More importantly, erasure-resilient systems use an order of magnitude less bandwidth and storage to provide similar system durability as replicated systems.