Practical Byzantine fault tolerance
OSDI '99 Proceedings of the third symposium on Operating systems design and implementation
Not all hits are created equal: cooperative proxy caching over a wide-area network
Computer Networks and ISDN Systems - Selected papers of the 3rd international caching workshop
On the scale and performance of cooperative Web proxy caching
Proceedings of the seventeenth ACM symposium on Operating systems principles
Chord: A scalable peer-to-peer lookup service for internet applications
Proceedings of the 2001 conference on Applications, technologies, architectures, and protocols for computer communications
A scalable content-addressable network
Proceedings of the 2001 conference on Applications, technologies, architectures, and protocols for computer communications
Squirrel: a decentralized peer-to-peer web cache
Proceedings of the twenty-first annual symposium on Principles of distributed computing
Pastry: Scalable, Decentralized Object Location, and Routing for Large-Scale Peer-to-Peer Systems
Middleware '01 Proceedings of the IFIP/ACM International Conference on Distributed Systems Platforms Heidelberg
Design Considerations for Distributed Caching on the Internet
ICDCS '99 Proceedings of the 19th IEEE International Conference on Distributed Computing Systems
Farsite: federated, available, and reliable storage for an incompletely trusted environment
OSDI '02 Proceedings of the 5th symposium on Operating systems design and implementationCopyright restrictions prevent ACM from being able to make the PDFs for this conference available for downloading
The effectiveness of request redirection on CDN robustness
OSDI '02 Proceedings of the 5th symposium on Operating systems design and implementationCopyright restrictions prevent ACM from being able to make the PDFs for this conference available for downloading
The design of a robust peer-to-peer system
EW 10 Proceedings of the 10th workshop on ACM SIGOPS European workshop
One hop lookups for peer-to-peer overlays
HOTOS'03 Proceedings of the 9th conference on Hot Topics in Operating Systems - Volume 9
Democratizing content publication with coral
NSDI'04 Proceedings of the 1st conference on Symposium on Networked Systems Design and Implementation - Volume 1
A hierarchical internet object cache
ATEC '96 Proceedings of the 1996 annual conference on USENIX Annual Technical Conference
LISA '04 Proceedings of the 18th USENIX conference on System administration
IPDPS '05 Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS'05) - Papers - Volume 01
Using PlanetLab for network research: myths, realities, and best practices
ACM SIGOPS Operating Systems Review
CoMon: a mostly-scalable monitoring system for PlanetLab
ACM SIGOPS Operating Systems Review
CobWeb: a proactive analysis-driven approach to content distribution
Proceedings of the twentieth ACM symposium on Operating systems principles
FeedEx: collaborative exchange of news feeds
Proceedings of the 15th international conference on World Wide Web
WAP5: black-box performance debugging for wide-area systems
Proceedings of the 15th international conference on World Wide Web
Fractal: a mobile code-based framework for dynamic application protocol adaptation
Journal of Parallel and Distributed Computing - 19th International parallel and distributed processing symposium
Diagnosis of TCP overlay connection failures using bayesian networks
Proceedings of the 2006 SIGCOMM workshop on Mining network data
Touring the internet in a TCP sidecar
Proceedings of the 6th ACM SIGCOMM conference on Internet measurement
On the impact of research network based testbeds on wide-area experiments
Proceedings of the 6th ACM SIGCOMM conference on Internet measurement
Experiences in building and operating ePOST, a reliable peer-to-peer application
Proceedings of the 1st ACM SIGOPS/EuroSys European Conference on Computer Systems 2006
CoDNS: improving DNS performance and reliability via cooperative lookups
OSDI'04 Proceedings of the 6th conference on Symposium on Opearting Systems Design & Implementation - Volume 6
(Re)design considerations for scalable large-file content distribution
WORLDS'05 Proceedings of the 2nd conference on Real, Large Distributed Systems - Volume 2
Why it is hard to build a long-running service on PlanetLab
WORLDS'05 Proceedings of the 2nd conference on Real, Large Distributed Systems - Volume 2
Live wide-area migration of virtual machines including local persistent state
Proceedings of the 3rd international conference on Virtual execution environments
A platform for unobtrusive measurements on PlanetLab
WORLDS'06 Proceedings of the 3rd conference on USENIX Workshop on Real, Large Distributed Systems - Volume 3
ConfiDNS: leveraging scale and history to improve DNS security
WORLDS'06 Proceedings of the 3rd conference on USENIX Workshop on Real, Large Distributed Systems - Volume 3
A grid-based infrastructure to support multimedia content distribution
Proceedings of the second workshop on Use of P2P, GRID and agents for the development of content networks
An architecture for virtual organization (VO)-based effective peering of content delivery networks
Proceedings of the second workshop on Use of P2P, GRID and agents for the development of content networks
Cloud control with distributed rate limiting
Proceedings of the 2007 conference on Applications, technologies, architectures, and protocols for computer communications
Experience-driven experimental systems research
Communications of the ACM
Experiences building PlanetLab
OSDI '06 Proceedings of the 7th symposium on Operating systems design and implementation
iPlane: an information plane for distributed services
OSDI '06 Proceedings of the 7th symposium on Operating systems design and implementation
Using P2P, GRID and Agent technologies for the development of content distribution networks
Future Generation Computer Systems
An economic model for resource management in a Grid-based content distribution network
Future Generation Computer Systems
High-bandwidth data dissemination for large-scale distributed systems
ACM Transactions on Computer Systems (TOCS)
Stork: package management for distributed VM environments
LISA'07 Proceedings of the 21st conference on Large Installation System Administration Conference
Power to the people: securing the internet one edge at a time
Proceedings of the 2007 workshop on Large scale attack defense
Supporting practical content-addressable caching with CZIP compression
ATC'07 2007 USENIX Annual Technical Conference on Proceedings of the USENIX Annual Technical Conference
Timely offloading of result-data in HPC centers
Proceedings of the 22nd annual international conference on Supercomputing
Securing peer-to-peer media streaming systems from selfish and malicious behavior
Proceedings of the 4th on Middleware doctoral symposium
GONE: an infrastructure overlay for resilient, DoS-limiting networking
Proceedings of the 2006 international workshop on Network and operating systems support for digital audio and video
Satellitelab: adding heterogeneity to planetary-scale network testbeds
Proceedings of the ACM SIGCOMM 2008 conference on Data communication
ConfiDNS: leveraging scale and history to detect compromise
ATC'08 USENIX 2008 Annual Technical Conference on Annual Technical Conference
Understanding hybrid CDN-P2P: why limelight needs its own Red Swoosh
Proceedings of the 18th International Workshop on Network and Operating Systems Support for Digital Audio and Video
EGOIST: overlay routing using selfish neighbor selection
CoNEXT '08 Proceedings of the 2008 ACM CoNEXT Conference
Distributed content delivery using load-aware network coordinates
CoNEXT '08 Proceedings of the 2008 ACM CoNEXT Conference
Antfarm: efficient content distribution with managed swarms
NSDI'09 Proceedings of the 6th USENIX symposium on Networked systems design and implementation
HashCache: cache storage for the next billion
NSDI'09 Proceedings of the 6th USENIX symposium on Networked systems design and implementation
Architecture and performance models for QoS-driven effective peering of content delivery networks
Multiagent and Grid Systems - Content management and delivery through P2P-based content networks
CDNsim: A simulation tool for content distribution networks
ACM Transactions on Modeling and Computer Simulation (TOMACS)
Leveraging bittorrent for end host measurements
PAM'07 Proceedings of the 8th international conference on Passive and active network measurement
Content delivery networks: protection or threat?
ESORICS'09 Proceedings of the 14th European conference on Research in computer security
ICC'09 Proceedings of the 2009 IEEE international conference on Communications
Communications of the ACM
Towards understanding developing world traffic
Proceedings of the 4th ACM Workshop on Networked Systems for Developing Regions
Building a collaborative peer-to-peer wiki system on a structured overlay
Computer Networks: The International Journal of Computer and Telecommunications Networking
Suppressing bot traffic with accurate human attestation
Proceedings of the first ACM asia-pacific workshop on Workshop on systems
Highly available component sharing in large-scale multi-tenant cloud systems
Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing
First-class access for developing-world environments
Proceedings of the 5th International Conference on Future Internet Technologies
Towards understanding modern web traffic
Proceedings of the ACM SIGMETRICS joint international conference on Measurement and modeling of computer systems
Towards understanding modern web traffic
ACM SIGMETRICS Performance Evaluation Review - Performance evaluation review
A content propagation metric for efficient content distribution
Proceedings of the ACM SIGCOMM 2011 conference
Modeling resource usage in planetary-scale shared infrastructures: PlanetLab's case study
Computer Networks: The International Journal of Computer and Telecommunications Networking
Towards understanding modern web traffic
Proceedings of the 2011 ACM SIGCOMM conference on Internet measurement conference
Understanding and characterizing PlanetLab resource usage for federated network testbeds
Proceedings of the 2011 ACM SIGCOMM conference on Internet measurement conference
Review: A survey on content-centric technologies for the current Internet: CDN and P2P solutions
Computer Communications
Software as a service for data scientists
Communications of the ACM
Content-oriented transport protocol
AINTEC '11 Proceedings of the 7th Asian Internet Engineering Conference
Dynamic service placement in shared service hosting infrastructures
NETWORKING'10 Proceedings of the 9th IFIP TC 6 international conference on Networking
Selfish overlay network creation and maintenance
IEEE/ACM Transactions on Networking (TON)
Proceedings of the 2012 workshop on Cloud services, federation, and the 8th open cirrus summit
Populated IP addresses: classification and applications
Proceedings of the 2012 ACM conference on Computer and communications security
A case for virtualization of content delivery networks
Proceedings of the Winter Simulation Conference
Maygh: building a CDN from client web browsers
Proceedings of the 8th ACM European Conference on Computer Systems
On learning how to plan content delivery networks
Proceedings of the 46th Annual Simulation Symposium
Peer-assisted video on-demand streaming system in practical WiFi-based mobile opportunistic networks
Journal of Network and Computer Applications
| Hi-index | 0.05 |
With the advent of large-scale, wide-area networking testbeds, researchers can deploy long-running distributed services that interact with other resources on the Web. The CoDeeN Content Distribution Network, deployed on PlanetLab, uses a network of caching Web proxy servers to intelligently distribute and cache requests from a potentially large client population. We have been running this system nearly continuously since June 2003, allowing open access from any client in the world. In that time, it has become the most heavily-used long-running service on PlanetLab, handling over four million accesses per day. In this paper, we discuss the design of our system, focusing on the reliability and security mechanisms that have kept the service in operation. Our reliability mechanisms assess node health, preventing failing nodes from disrupting the operation of the overall system. Our security mechanisms protect nodes from being exploited and from being implicated in malicious activities, problems that commonly plague other open proxies. We believe that future services, especially peer-to-peer systems, will require similar mechanisms as more services are deployed on non-dedicated distributed systems, and as their interaction with existing protocols and systems increases. Our experiences with CoDeeN and our data on its availability should serve as an important starting point for designers of future systems.