WORLDS'06 Proceedings of the 3rd conference on USENIX Workshop on Real, Large Distributed Systems - Volume 3
Experience-driven experimental systems research
Communications of the ACM
Experiences building PlanetLab
OSDI '06 Proceedings of the 7th symposium on Operating systems design and implementation
High-bandwidth data dissemination for large-scale distributed systems
ACM Transactions on Computer Systems (TOCS)
Stork: package management for distributed VM environments
LISA'07 Proceedings of the 21st conference on Large Installation System Administration Conference
Supporting practical content-addressable caching with CZIP compression
ATC'07 2007 USENIX Annual Technical Conference on Proceedings of the USENIX Annual Technical Conference
A result-data offloading service for HPC centers
PDSW '07 Proceedings of the 2nd international workshop on Petascale data storage: held in conjunction with Supercomputing '07
Timely offloading of result-data in HPC centers
Proceedings of the 22nd annual international conference on Supercomputing
Adaptive file transfers for diverse environments
ATC'08 USENIX 2008 Annual Technical Conference on Annual Technical Conference
Computer Networks: The International Journal of Computer and Telecommunications Networking
Network load-aware content distribution in overlay networks
Computer Communications
Rethinking FTP: Aggressive block reordering for large file transfers
ACM Transactions on Storage (TOS)
Proceedings of the 10th International Conference on Information Integration and Web-based Applications & Services
Optimal node-selection algorithm for parallel download in overlay content-distribution networks
Computer Networks: The International Journal of Computer and Telecommunications Networking
A Partition-Based Broadcast Algorithm over DHT for Large-Scale Computing Infrastructures
GPC '09 Proceedings of the 4th International Conference on Advances in Grid and Pervasive Computing
Flexible, wide-area storage for distributed systems with WheelFS
NSDI'09 Proceedings of the 6th USENIX symposium on Networked systems design and implementation
Antfarm: efficient content distribution with managed swarms
NSDI'09 Proceedings of the 6th USENIX symposium on Networked systems design and implementation
HashCache: cache storage for the next billion
NSDI'09 Proceedings of the 6th USENIX symposium on Networked systems design and implementation
iPlane Nano: path prediction for peer-to-peer applications
NSDI'09 Proceedings of the 6th USENIX symposium on Networked systems design and implementation
A Novel Content Distribution Mechanism in DHT Networks
NETWORKING '09 Proceedings of the 8th International IFIP-TC 6 Networking Conference
DHT-based lightweight broadcast algorithms in large-scale computing infrastructures
Future Generation Computer Systems
Time-critical data dissemination in cooperative peer-to-peer systems
GLOBECOM'09 Proceedings of the 28th IEEE conference on Global telecommunications
First-class access for developing-world environments
Proceedings of the 5th International Conference on Future Internet Technologies
IPTPS'08 Proceedings of the 7th international conference on Peer-to-peer systems
Bringing P2P to the web: security and privacy in the firecoral network
IPTPS'09 Proceedings of the 8th international conference on Peer-to-peer systems
Experiences with CoralCDN: a five-year operational view
NSDI'10 Proceedings of the 7th USENIX conference on Networked systems design and implementation
Exploiting similarity for multi-source downloads using file handprints
NSDI'07 Proceedings of the 4th USENIX conference on Networked systems design & implementation
Budget-constrained bulk data transfer via internet and shipping networks
Proceedings of the 8th ACM international conference on Autonomic computing
A content propagation metric for efficient content distribution
Proceedings of the ACM SIGCOMM 2011 conference
Modeling data transfer in content-centric networking
Proceedings of the 23rd International Teletraffic Congress
Understanding and characterizing PlanetLab resource usage for federated network testbeds
Proceedings of the 2011 ACM SIGCOMM conference on Internet measurement conference
Dynamic service placement in shared service hosting infrastructures
NETWORKING'10 Proceedings of the 9th IFIP TC 6 international conference on Networking
Server-assisted latency management for wide-area distributed systems
USENIX ATC'12 Proceedings of the 2012 USENIX conference on Annual Technical Conference
Evaluating CCN multi-path interest forwarding strategies
Computer Communications
Maygh: building a CDN from client web browsers
Proceedings of the 8th ACM European Conference on Computer Systems
Performance analysis of in-network caching for content-centric networking
Computer Networks: The International Journal of Computer and Telecommunications Networking
From content delivery today to information centric networking
Computer Networks: The International Journal of Computer and Telecommunications Networking
Hi-index | 0.02 |
Scalable distribution of large files has been the area of much research and commercial interest in the past few years. In this paper, we describe the CoBlitz system, which efficiently distributes large files using a content distribution network (CDN) designed for HTTP. As a result, CoBlitz is able to serve large files without requiring any modifications to standard Web servers and clients, making it an interesting option both for end users as well as infrastructure services. Over the 18 months that CoBlitz and its partner service, CoDeploy, have been running on PlanetLab, we have had the opportunity to observe its algorithms in practice, and to evolve its design. These changes stem not only from observations on its use, but also from a better understanding of their behavior in real-world conditions. This utilitarian approach has led us to better understand the effects of scale, peering policies, replication behavior, and congestion, giving us new insights into how to better improve their performance. With these changes, CoBlitz is able to deliver in excess of 1 Gbps on PlanetLab, and to outperform a range of systems, including research systems as well as the widely-used BitTorrent.