Potential benefits of delta encoding and data compression for HTTP
SIGCOMM '97 Proceedings of the ACM SIGCOMM '97 conference on Applications, technologies, architectures, and protocols for computer communication
A protocol-independent technique for eliminating redundant network traffic
Proceedings of the conference on Applications, Technologies, Architectures, and Protocols for Computer Communication
A low-bandwidth network file system
SOSP '01 Proceedings of the eighteenth ACM symposium on Operating systems principles
WWW '03 Proceedings of the 12th international conference on World Wide Web
An analysis of TCP reset behaviour on the internet
ACM SIGCOMM Computer Communication Review
Feasibility study of mesh networks for all-wireless offices
Proceedings of the 4th international conference on Mobile systems, applications and services
Energy-aware lossless data compression
ACM Transactions on Computer Systems (TOCS)
A first look at modern enterprise traffic
IMC '05 Proceedings of the 5th ACM SIGCOMM conference on Internet Measurement
Shark: scaling file servers via cooperative caching
NSDI'05 Proceedings of the 2nd conference on Symposium on Networked Systems Design & Implementation - Volume 2
An architecture for internet data transfer
NSDI'06 Proceedings of the 3rd conference on Networked Systems Design & Implementation - Volume 3
Packet caches on routers: the implications of universal redundant traffic elimination
Proceedings of the ACM SIGCOMM 2008 conference on Data communication
Redundancy in network traffic: findings and implications
Proceedings of the eleventh international joint conference on Measurement and modeling of computer systems
Exploiting similarity for multi-source downloads using file handprints
NSDI'07 Proceedings of the 4th USENIX conference on Networked systems design & implementation
Stratus: energy-efficient mobile communication using cloud support
Proceedings of the ACM SIGCOMM 2010 conference
LiteGreen: saving energy in networked desktops using virtualization
USENIXATC'10 Proceedings of the 2010 USENIX conference on USENIX annual technical conference
The effect of packet loss on redundancy elimination in cellular wireless networks
IMC '10 Proceedings of the 10th ACM SIGCOMM conference on Internet measurement
CloudNet: dynamic pooling of cloud resources by live WAN migration of virtual machines
Proceedings of the 7th ACM SIGPLAN/SIGOPS international conference on Virtual execution environments
A comparative study of handheld and non-handheld traffic in campus Wi-Fi networks
PAM'11 Proceedings of the 12th international conference on Passive and active measurement
The power of prediction: cloud bandwidth and cost reduction
Proceedings of the ACM SIGCOMM 2011 conference
REfactor-ing content overhearing to improve wireless performance
MobiCom '11 Proceedings of the 17th annual international conference on Mobile computing and networking
Enhancing redundant network traffic elimination
Computer Networks: The International Journal of Computer and Telecommunications Networking
Celleration: loss-resilient traffic redundancy elimination for cellular data
Proceedings of the Twelfth Workshop on Mobile Computing Systems & Applications
Shredder: GPU-accelerated incremental storage and computation
FAST'12 Proceedings of the 10th USENIX conference on File and Storage Technologies
DECOR: a distributed coordinated resource monitoring system
Proceedings of the 2012 IEEE 20th International Workshop on Quality of Service
ICN-RE: redundancy elimination for information-centric networking
Proceedings of the second edition of the ICN workshop on Information-centric networking
ICN-RE: redundancy elimination for information-centric networking
Proceedings of the second edition of the ICN workshop on Information-centric networking
Asymmetric caching: improved network deduplication for mobile devices
Proceedings of the 18th annual international conference on Mobile computing and networking
The power of batching in the Click modular router
Proceedings of the Asia-Pacific Workshop on Systems
The power of batching in the click modular router
APSys'12 Proceedings of the Third ACM SIGOPS Asia-Pacific conference on Systems
Reducing server and network load with shared buffering
Proceedings of the 2012 ACM workshop on Capacity sharing
Comparison of caching strategies in modern cellular backhaul networks
Proceeding of the 11th annual international conference on Mobile systems, applications, and services
How to reduce smartphone traffic volume by 30%?
PAM'13 Proceedings of the 14th international conference on Passive and Active Measurement
Smart in-network deduplication for storage-aware SDN
Proceedings of the ACM SIGCOMM 2013 conference on SIGCOMM
Next stop, the cloud: understanding modern web service deployment in EC2 and azure
Proceedings of the 2013 conference on Internet measurement conference
MiG: efficient migration of desktop VMs using semantic compression
USENIX ATC'13 Proceedings of the 2013 USENIX conference on Annual Technical Conference
VMShadow: optimizing the performance of latency-sensitive virtual desktops in distributed clouds
Proceedings of the 5th ACM Multimedia Systems Conference
Effective content-based video caching with cache-friendly encoding and media-aware chunking
Proceedings of the 5th ACM Multimedia Systems Conference
PACK: Prediction-Based Cloud Bandwidth and Cost Reduction System
IEEE/ACM Transactions on Networking (TON)
Hi-index | 0.00 |
In many enterprises today, WAN optimizers are being deployed in order to eliminate redundancy in network traffic and reduce WAN access costs. In this paper, we present the design and implementation of EndRE, an alternate approach where redundancy elimination (RE) is provided as an end system service. Unlike middleboxes, such an approach benefits both end-to-end encrypted traffic as well as traffic on last-hop wireless links to mobile devices. EndRE needs to be fast, adaptive and parsimonious in memory usage in order to opportunistically leverage resources on end hosts. Thus, we design a new fingerprinting scheme called SampleByte that is much faster than Rabin fingerprinting while delivering similar compression gains. Unlike Rabin fingerprinting, SampleByte can also adapt its CPU usage depending on server load. Further, we introduce optimizations to reduce server memory footprint by 33-75% compared to prior approaches. Using several terabytes of network traffic traces from 11 enterprise sites, testbed experiments and a pilot deployment, we show that EndRE delivers 26% bandwidth savings on average, processes payloads at speeds of 1.5- 4Gbps, reduces end-to-end latencies by up to 30%, and translates bandwidth savings into equivalent energy savings on mobile smartphones.