Summary cache: a scalable wide-area Web cache sharing protocol
Proceedings of the ACM SIGCOMM '98 conference on Applications, technologies, architectures, and protocols for computer communication
On the scale and performance of cooperative Web proxy caching
Proceedings of the seventeenth ACM symposium on Operating systems principles
A protocol-independent technique for eliminating redundant network traffic
Proceedings of the conference on Applications, Technologies, Architectures, and Protocols for Computer Communication
A low-bandwidth network file system
SOSP '01 Proceedings of the eighteenth ACM symposium on Operating systems principles
Winnowing: local algorithms for document fingerprinting
Proceedings of the 2003 ACM SIGMOD international conference on Management of data
Optimizing cost and performance for multihoming
Proceedings of the 2004 conference on Applications, technologies, architectures, and protocols for computer communications
Organization-based analysis of web-object sharing and caching
USITS'99 Proceedings of the 2nd conference on USENIX Symposium on Internet Technologies and Systems - Volume 2
Finding similar files in a large file system
WTEC'94 Proceedings of the USENIX Winter 1994 Technical Conference on USENIX Winter 1994 Technical Conference
Packet caches on routers: the implications of universal redundant traffic elimination
Proceedings of the ACM SIGCOMM 2008 conference on Data communication
Ditto: a system for opportunistic caching in multi-hop wireless networks
Proceedings of the 14th ACM international conference on Mobile computing and networking
Exploiting similarity for multi-source downloads using file handprints
NSDI'07 Proceedings of the 4th USENIX conference on Networked systems design & implementation
Wavelet analysis of long-range-dependent traffic
IEEE Transactions on Information Theory
SmartRE: an architecture for coordinated network-wide redundancy elimination
Proceedings of the ACM SIGCOMM 2009 conference on Data communication
Experimental study of protocol-independent redundancy elimination algorithms
Proceedings of the first joint WOSP/SIPEW international conference on Performance engineering
Dr. multicast: Rx for data center communication scalability
Proceedings of the 5th European conference on Computer systems
Towards understanding developing world traffic
Proceedings of the 4th ACM Workshop on Networked Systems for Developing Regions
EndRE: an end-system redundancy elimination service for enterprises
NSDI'10 Proceedings of the 7th USENIX conference on Networked systems design and implementation
LiteGreen: saving energy in networked desktops using virtualization
USENIXATC'10 Proceedings of the 2010 USENIX conference on USENIX annual technical conference
The effect of packet loss on redundancy elimination in cellular wireless networks
IMC '10 Proceedings of the 10th ACM SIGCOMM conference on Internet measurement
On content-centric router design and implications
Proceedings of the Re-Architecting the Internet Workshop
The power of prediction: cloud bandwidth and cost reduction
Proceedings of the ACM SIGCOMM 2011 conference
REfactor-ing content overhearing to improve wireless performance
MobiCom '11 Proceedings of the 17th annual international conference on Mobile computing and networking
Towards understanding modern web traffic
Proceedings of the 2011 ACM SIGCOMM conference on Internet measurement conference
An approximation method of origin-destination flow traffic from link load counts
Computers and Electrical Engineering
Enhancing redundant network traffic elimination
Computer Networks: The International Journal of Computer and Telecommunications Networking
Suppressing redundancy in wireless sensor network traffic
DCOSS'10 Proceedings of the 6th IEEE international conference on Distributed Computing in Sensor Systems
DECOR: a distributed coordinated resource monitoring system
Proceedings of the 2012 IEEE 20th International Workshop on Quality of Service
Minimization of network power consumption with redundancy elimination
IFIP'12 Proceedings of the 11th international IFIP TC 6 conference on Networking - Volume Part I
Probabilistic in-network caching for information-centric networks
Proceedings of the second edition of the ICN workshop on Information-centric networking
ICN-RE: redundancy elimination for information-centric networking
Proceedings of the second edition of the ICN workshop on Information-centric networking
ICN-RE: redundancy elimination for information-centric networking
Proceedings of the second edition of the ICN workshop on Information-centric networking
Asymmetric caching: improved network deduplication for mobile devices
Proceedings of the 18th annual international conference on Mobile computing and networking
Architecting for edge diversity: supporting rich services over an unbundled transport
Proceedings of the 8th international conference on Emerging networking experiments and technologies
Evaluating CCN multi-path interest forwarding strategies
Computer Communications
Comparison of caching strategies in modern cellular backhaul networks
Proceeding of the 11th annual international conference on Mobile systems, applications, and services
Holistic run-time parallelism management for time and energy efficiency
Proceedings of the 27th international ACM conference on International conference on supercomputing
How to reduce smartphone traffic volume by 30%?
PAM'13 Proceedings of the 14th international conference on Passive and Active Measurement
Horizon extender: long-term preservation of data leakage evidence in web traffic
Proceedings of the 8th ACM SIGSAC symposium on Information, computer and communications security
Intra-AS cooperative caching for content-centric networks
Proceedings of the 3rd ACM SIGCOMM workshop on Information-centric networking
Scissors: dealing with header redundancies in data centers through SDN
Proceedings of the 8th International Conference on Network and Service Management
PACK: Prediction-Based Cloud Bandwidth and Cost Reduction System
IEEE/ACM Transactions on Networking (TON)
Hi-index | 0.00 |
A large amount of popular content is transferred repeatedly across network links in the Internet. In recent years, protocol-independent redundancy elimination, which can remove duplicate strings from within arbitrary network flows, has emerged as a powerful technique to improve the efficiency of network links in the face of repeated data. Many vendors offer such redundancy elimination middleboxes to improve the effective bandwidth of enterprise, data center and ISP links alike. In this paper, we conduct a large scale trace-driven study of protocol independent redundancy elimination mechanisms, driven by several terabytes of packet payload traces collected at 12 distinct network locations, including the access link of a large US-based university and of 11 enterprise networks of different sizes. Based on extensive analysis, we present a number of findings on the benefits and fundamental design issues in redundancy elimination systems. Two of our key findings are (1) A new redundancy elimination algorithm based on Winnowing that outperforms the widely-used Rabin fingerprint-based algorithm by 5-10% on most traces and by as much as 35% in some traces. (2) A surprising finding that 75-90% of middlebox's bandwidth savings in our enterprise traces is due to redundant byte-strings from within each client's traffic, implying that pushing redundancy elimination capability to the end hosts, i.e. an end-to-end redundancy elimination solution, could obtain most of the middlebox's bandwidth savings.