Improving the WWW: caching or multicast
Computer Networks and ISDN Systems - Selected papers of the 3rd international caching workshop
NiagaraCQ: a scalable continuous query system for Internet databases
SIGMOD '00 Proceedings of the 2000 ACM SIGMOD international conference on Management of data
Implications of proxy caching for provisioning networks and servers
Proceedings of the 2000 ACM SIGMETRICS international conference on Measurement and modeling of computer systems
Engineering server-driven consistency for large scale dynamic Web services
Proceedings of the 10th international conference on World Wide Web
Adaptive precision setting for cached approximate values
SIGMOD '01 Proceedings of the 2001 ACM SIGMOD international conference on Management of data
Cooperative leases: scalable consistency maintenance in content distribution networks
Proceedings of the 11th international conference on World Wide Web
Best-effort cache synchronization with source cooperation
Proceedings of the 2002 ACM SIGMOD international conference on Management of data
Adaptive Push-Pull: Disseminating Dynamic Web Data
IEEE Transactions on Computers
Continual Queries for Internet Scale Event-Driven Information Delivery
IEEE Transactions on Knowledge and Data Engineering
Analysis of link failures in an IP backbone
Proceedings of the 2nd ACM SIGCOMM Workshop on Internet measurment
ICDE '96 Proceedings of the Twelfth International Conference on Data Engineering
The case for geographical push-caching
HOTOS '95 Proceedings of the Fifth Workshop on Hot Topics in Operating Systems (HotOS-V)
Maintaining Strong Cache Consistency in the World-Wide Web
ICDCS '97 Proceedings of the 17th International Conference on Distributed Computing Systems (ICDCS '97)
Design Considerations for Distributed Caching on the Internet
ICDCS '99 Proceedings of the 19th IEEE International Conference on Distributed Computing Systems
An Efficient Multicast Protocol for Content-Based Publish-Subscribe Systems
ICDCS '99 Proceedings of the 19th IEEE International Conference on Distributed Computing Systems
Design and evaluation of a continuous consistency model for replicated services
OSDI'00 Proceedings of the 4th conference on Symposium on Operating System Design & Implementation - Volume 4
Scalable web caching of frequently updated objects using reliable multicast
USITS'99 Proceedings of the 2nd conference on USENIX Symposium on Internet Technologies and Systems - Volume 2
Hierarchical cache consistency in a WAN
USITS'99 Proceedings of the 2nd conference on USENIX Symposium on Internet Technologies and Systems - Volume 2
Improving web server performance by caching dynamic data
USITS'97 Proceedings of the USENIX Symposium on Internet Technologies and Systems on USENIX Symposium on Internet Technologies and Systems
Salamander: a push-based distribution substrate for internet applications
USITS'97 Proceedings of the USENIX Symposium on Internet Technologies and Systems on USENIX Symposium on Internet Technologies and Systems
Cost-aware WWW proxy caching algorithms
USITS'97 Proceedings of the USENIX Symposium on Internet Technologies and Systems on USENIX Symposium on Internet Technologies and Systems
A hierarchical internet object cache
ATEC '96 Proceedings of the 1996 annual conference on USENIX Annual Technical Conference
Maintaining coherency of dynamic data in cooperating repositories
VLDB '02 Proceedings of the 28th international conference on Very Large Data Bases
An efficient and resilient approach to filtering and disseminating streaming data
VLDB '03 Proceedings of the 29th international conference on Very large data bases - Volume 29
An Engineering Approach to Cooperating Agents for Distributed Information Systems
Journal of Intelligent Information Systems
Client assignment in content dissemination networks for dynamic data
VLDB '05 Proceedings of the 31st international conference on Very large data bases
Objective-Optimal Algorithms for Long-Term Web Prefetching
IEEE Transactions on Computers
Scalable Delivery of Dynamic Content Using a Cooperative Edge Cache Grid
IEEE Transactions on Knowledge and Data Engineering
Disseminating streaming data in a dynamic environment: an adaptive and cost-based approach
The VLDB Journal — The International Journal on Very Large Data Bases
An autonomous agent approach to query optimization in stream grids
Proceedings of the International Conference on Management of Emergent Digital EcoSystems
Cooperative caching by clients constructing a peer-to-peer network for push-based broadcast
Data & Knowledge Engineering
Consistency rationing in the cloud: pay only when it matters
Proceedings of the VLDB Endowment
Trust overlay networks for global reputation aggregation in P2P grid computing
IPDPS'06 Proceedings of the 20th international conference on Parallel and distributed processing
Maintaining coherent views over dynamic distributed data
ICDCIT'10 Proceedings of the 6th international conference on Distributed Computing and Internet Technology
An Autonomous Agent Approach to Query Optimization in Stream Grids
International Journal of Organizational and Collective Intelligence
The MACE Approach for Caching Mashups
International Journal of Web Services Research
Multi-scale dissemination of time series data
Proceedings of the 25th International Conference on Scientific and Statistical Database Management
Hi-index | 0.00 |
The focus of our work is to design and build a dynamic data distribution system that is coherence-preserving, i.e., the delivered data must preserve associated coherence requirements (the user-specified bound on tolerable imprecision) and resilient to failures. To this end, we consider a system in which a set of repositories cooperate with each other and the sources, forming a peer-to-peer network. In this system, necessary changes are pushed to the users so that they are automatically informed about changes of interest. We present techniques 1) to determine when to push an update from one repository to another for coherence maintenance, 2) to construct an efficient dissemination tree for propagating changes from sources to cooperating repositories, and 3) to make the system resilient to failures. An experimental evaluation using real world traces of dynamically changing data demonstrates that 1) careful dissemination of updates through a network of cooperating repositories can substantially lower the cost of coherence maintenance, 2) unless designed carefully, even push-based systems experience considerable loss in fidelity due to message delays and processing costs, 3) the computational and communication cost of achieving resiliency can be made to be low, and 4) surprisingly, adding resiliency can actually improve fidelity even in the absence of failures.