Willow: DHT, aggregation, and publish/subscribe in one protocol

Authors:
Robbert van Renesse;Adrian Bozdog
Affiliations:
Dept. of Computer Science, Cornell University, Ithaca, NY;Dept. of Computer Science, Cornell University, Ithaca, NY
Venue:
IPTPS'04 Proceedings of the Third international conference on Peer-to-Peer Systems
Year:
2004

Citing 9
Cited 22

Accessing nearby copies of replicated objects in a distributed environment

Proceedings of the ninth annual ACM symposium on Parallel algorithms and architectures
Bayeux: an architecture for scalable and fault-tolerant wide-area data dissemination

NOSSDAV '01 Proceedings of the 11th international workshop on Network and operating systems support for digital audio and video
Kademlia: A Peer-to-Peer Information System Based on the XOR Metric

IPTPS '01 Revised Papers from the First International Workshop on Peer-to-Peer Systems
Astrolabe: A robust and scalable technology for distributed system monitoring, management, and data mining

ACM Transactions on Computer Systems (TOCS)
Scalable and Secure Resource Location

HICSS '00 Proceedings of the 33rd Hawaii International Conference on System Sciences-Volume 4 - Volume 4
SplitStream: high-bandwidth multicast in cooperative environments

SOSP '03 Proceedings of the nineteenth ACM symposium on Operating systems principles
A scalable distributed information management system

Proceedings of the 2004 conference on Applications, technologies, architectures, and protocols for computer communications
SelectCast: a scalable and self-repairing multicast overlay routing facility

Proceedings of the 2003 ACM workshop on Survivable and self-regenerative systems: in association with 10th ACM Conference on Computer and Communications Security
Querying the internet with PIER

VLDB '03 Proceedings of the 29th international conference on Very large data bases - Volume 29

Aggregating Information in Peer-to-Peer Systems for Improved Join and Leave

P2P '04 Proceedings of the Fourth International Conference on Peer-to-Peer Computing
Location based placement of whole distributed systems

CoNEXT '05 Proceedings of the 2005 ACM conference on Emerging network experiment and technology
Content-based communication: a research agenda

Proceedings of the 6th international workshop on Software engineering and middleware
A framework for evaluating the performance of cluster algorithms for hierarchical networks

IEEE/ACM Transactions on Networking (TON)
San Fermín: aggregating large data sets using a binomial swap forest

NSDI'08 Proceedings of the 5th USENIX Symposium on Networked Systems Design and Implementation
From cells to organisms: long-term guarantees on service provisioning in peer-to-peer networks

NOTERE '08 Proceedings of the 8th international conference on New technologies in distributed systems
A Partition-Based Broadcast Algorithm over DHT for Large-Scale Computing Infrastructures

GPC '09 Proceedings of the 4th International Conference on Advances in Grid and Pervasive Computing
Towards an architecture for service deployment in contributory communities

International Journal of Grid and Utility Computing
DHT-based lightweight broadcast algorithms in large-scale computing infrastructures

Future Generation Computer Systems
Elaborating a decentralized market information system

OTM'07 Proceedings of the 2007 OTM confederated international conference on On the move to meaningful internet systems - Volume Part I
A hybrid approach for estimating document frequencies in unstructured P2P networks

Information Systems
Ripple: A publish/subscribe service for multidata item updates propagation in the cloud

Journal of Network and Computer Applications
Self-organizing and self-reconfigurable event routing in ad hoc networks with causal dependency awareness

ACM Transactions on Autonomous and Adaptive Systems (TAAS)
DECA: a hierarchical framework for DECentralized aggregation in DHTs

DSOM'06 Proceedings of the 17th IFIP/IEEE international conference on Distributed Systems: operations and management
Scalable distributed aggregate computations through collaboration

DEXA'05 Proceedings of the 16th international conference on Database and Expert Systems Applications
A self-repairing peer-to-peer system resilient to dynamic adversarial churn

IPTPS'05 Proceedings of the 4th international conference on Peer-to-Peer Systems
Dependable peer-to-peer systems withstanding dynamic adversarial churn

Dependable Systems
Camdoop: exploiting in-network aggregation for big data applications

NSDI'12 Proceedings of the 9th USENIX conference on Networked Systems Design and Implementation
Content-based publish/subscribe using distributed R-trees

Euro-Par'07 Proceedings of the 13th international Euro-Par conference on Parallel Processing
Decentralized resource discovery mechanisms for distributed computing in peer-to-peer environments

ACM Computing Surveys (CSUR)
Towards a semantic-driven and scalable publish/subscribe framework

International Journal of Internet Protocol Technology
Decentralized monitoring in peer-to-peer systems

Benchmarking Peer-to-Peer Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper describes a new peer-to-peer protocol that integrates DHT routing, aggregation, all-to-all multicast, as well as both topic- and content-based publish/subscribe. In spite of this extensive set of features, the Willow protocol is simple, scalable, balances the load well across the members, is proximity-aware, adapts to network conditions, and recovers quickly and gracefully from network partitions and subsequent repairs.