WebExpress: a system for optimizing Web browsing in a wireless environment
MobiCom '96 Proceedings of the 2nd annual international conference on Mobile computing and networking
On the scale and performance of cooperative Web proxy caching
Proceedings of the seventeenth ACM symposium on Operating systems principles
On the Resemblance and Containment of Documents
SEQUENCES '97 Proceedings of the Compression and Complexity of Sequences 1997
Organization-based analysis of web-object sharing and caching
USITS'99 Proceedings of the 2nd conference on USENIX Symposium on Internet Technologies and Systems - Volume 2
Increasing effective link bandwidth by suppressing replicated data
ATEC '98 Proceedings of the annual conference on USENIX Annual Technical Conference
Wide-area Internet traffic patterns and characteristics
IEEE Network: The Magazine of Global Internetworking
A low-bandwidth network file system
SOSP '01 Proceedings of the eighteenth ACM symposium on Operating systems principles
Aliasing on the world wide web: prevalence and performance implications
Proceedings of the 11th international conference on World Wide Web
WWW '03 Proceedings of the 12th international conference on World Wide Web
ICDE '04 Proceedings of the 20th International Conference on Data Engineering
Improving Bandwidth Efficiency of Peer-to-Peer Storage
P2P '04 Proceedings of the Fourth International Conference on Peer-to-Peer Computing
IPDPS '05 Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS'05) - Papers - Volume 01
ACM Computing Surveys (CSUR)
Hierarchical substring caching for efficient content distribution to low-bandwidth clients
WWW '05 Proceedings of the 14th international conference on World Wide Web
An adaptive, fast, and safe XML parser based on byte sequences memorization
WWW '05 Proceedings of the 14th international conference on World Wide Web
DeltaCast: efficient file reconciliation in wireless broadcast systems
Proceedings of the 3rd international conference on Mobile systems, applications, and services
Integrating Portable and Distributed Storage
FAST '04 Proceedings of the 3rd USENIX Conference on File and Storage Technologies
Fractal: a mobile code-based framework for dynamic application protocol adaptation
Journal of Parallel and Distributed Computing - 19th International parallel and distributed processing symposium
Approximate fingerprinting to accelerate pattern matching
Proceedings of the 6th ACM SIGCOMM conference on Internet measurement
The case for a dynamic proxy framework with voluntary/incentive-based client hosting scheme
Journal of Network and Computer Applications - Special issue: Network and information security: A computational intelligence approach
Consistency-preserving caching of dynamic database content
Proceedings of the 16th international conference on World Wide Web
Efficient search in large textual collections with redundancy
Proceedings of the 16th international conference on World Wide Web
Redundancy elimination within large collections of files
ATEC '04 Proceedings of the annual conference on USENIX Annual Technical Conference
Alternatives for detecting redundancy in storage systems data
ATEC '04 Proceedings of the annual conference on USENIX Annual Technical Conference
Improving mobile database access over wide-area networks without degrading consistency
Proceedings of the 5th international conference on Mobile systems, applications and services
A case for Passive Application Layer Multicast
Computer Networks: The International Journal of Computer and Telecommunications Networking
Design, implementation, and evaluation of duplicate transfer detection in HTTP
NSDI'04 Proceedings of the 1st conference on Symposium on Networked Systems Design and Implementation - Volume 1
OSDI'04 Proceedings of the 6th conference on Symposium on Opearting Systems Design & Implementation - Volume 6
Bottom-k sketches: better and more efficient estimation of aggregates
Proceedings of the 2007 ACM SIGMETRICS international conference on Measurement and modeling of computer systems
Summarizing data using bottom-k sketches
Proceedings of the twenty-sixth annual ACM symposium on Principles of distributed computing
Supporting practical content-addressable caching with CZIP compression
ATC'07 2007 USENIX Annual Technical Conference on Proceedings of the USENIX Annual Technical Conference
Avoiding the disk bottleneck in the data domain deduplication file system
FAST'08 Proceedings of the 6th USENIX Conference on File and Storage Technologies
Efficiency through eavesdropping: link-layer packet caching
NSDI'08 Proceedings of the 5th USENIX Symposium on Networked Systems Design and Implementation
Packet caches on routers: the implications of universal redundant traffic elimination
Proceedings of the ACM SIGCOMM 2008 conference on Data communication
Ditto: a system for opportunistic caching in multi-hop wireless networks
Proceedings of the 14th ACM international conference on Mobile computing and networking
Tighter estimation using bottom k sketches
Proceedings of the VLDB Endowment
Redundancy in network traffic: findings and implications
Proceedings of the eleventh international joint conference on Measurement and modeling of computer systems
Leveraging discarded samples for tighter estimation of multiple-set aggregates
Proceedings of the eleventh international joint conference on Measurement and modeling of computer systems
SmartRE: an architecture for coordinated network-wide redundancy elimination
Proceedings of the ACM SIGCOMM 2009 conference on Data communication
Analysis of network processing workloads
Journal of Systems Architecture: the EUROMICRO Journal
Efficient locally trackable deduplication in replicated systems
Proceedings of the 10th ACM/IFIP/USENIX International Conference on Middleware
Experimental study of protocol-independent redundancy elimination algorithms
Proceedings of the first joint WOSP/SIPEW international conference on Performance engineering
Experimental analysis of flow optimization and data compression for TCP enhancement
INFOCOM'09 Proceedings of the 28th IEEE international conference on Computer Communications Workshops
Systems support for remote visualization of genomics applications over wide area networks
GCCB'06 Proceedings of the 2006 international conference on Distributed, high-performance and grid computing in computational biology
Efficient locally trackable deduplication in replicated systems
Middleware'09 Proceedings of the ACM/IFIP/USENIX 10th international conference on Middleware
Efficient similarity estimation for systems exploiting data redundancy
INFOCOM'10 Proceedings of the 29th conference on Information communications
Towards understanding developing world traffic
Proceedings of the 4th ACM Workshop on Networked Systems for Developing Regions
Stratus: energy-efficient mobile communication using cloud support
Proceedings of the ACM SIGCOMM 2010 conference
First-class access for developing-world environments
Proceedings of the 5th International Conference on Future Internet Technologies
EndRE: an end-system redundancy elimination service for enterprises
NSDI'10 Proceedings of the 7th USENIX conference on Networked systems design and implementation
Wide-area network acceleration for the developing world
USENIXATC'10 Proceedings of the 2010 USENIX conference on USENIX annual technical conference
The effect of packet loss on redundancy elimination in cellular wireless networks
IMC '10 Proceedings of the 10th ACM SIGCOMM conference on Internet measurement
Globe'10 Proceedings of the Third international conference on Data management in grid and peer-to-peer systems
Integrating portable and distributed storage
FAST'04 Proceedings of the 3rd USENIX conference on File and storage technologies
Anchor-driven subchunk deduplication
Proceedings of the 4th Annual International Conference on Systems and Storage
Testbed evaluation of P2P shared cache architecture
Proceedings of the 6th International Conference on Future Internet Technologies
The power of prediction: cloud bandwidth and cost reduction
Proceedings of the ACM SIGCOMM 2011 conference
REfactor-ing content overhearing to improve wireless performance
MobiCom '11 Proceedings of the 17th annual international conference on Mobile computing and networking
Content delivery and caching from a network provider's perspective
Computer Networks: The International Journal of Computer and Telecommunications Networking
Fast Path Performance of Packet Cache Router Using Multi-core Network Processor
Proceedings of the 2011 ACM/IEEE Seventh Symposium on Architectures for Networking and Communications Systems
Towards understanding modern web traffic
Proceedings of the 2011 ACM SIGCOMM conference on Internet measurement conference
Enhancing redundant network traffic elimination
Computer Networks: The International Journal of Computer and Telecommunications Networking
String matching on the internet
CAAN'04 Proceedings of the First international conference on Combinatorial and Algorithmic Aspects of Networking
CFP taxonomy of the approaches for dynamic web content acceleration
ADBIS'05 Proceedings of the 9th East European conference on Advances in Databases and Information Systems
Celleration: loss-resilient traffic redundancy elimination for cellular data
Proceedings of the Twelfth Workshop on Mobile Computing Systems & Applications
Suppressing redundancy in wireless sensor network traffic
DCOSS'10 Proceedings of the 6th IEEE international conference on Distributed Computing in Sensor Systems
WAN optimized replication of backup datasets using stream-informed delta compression
FAST'12 Proceedings of the 10th USENIX conference on File and Storage Technologies
RPT: re-architecting loss protection for content-aware networks
NSDI'12 Proceedings of the 9th USENIX conference on Networked Systems Design and Implementation
Toward predictable performance in software packet-processing platforms
NSDI'12 Proceedings of the 9th USENIX conference on Networked Systems Design and Implementation
Minimization of network power consumption with redundancy elimination
IFIP'12 Proceedings of the 11th international IFIP TC 6 conference on Networking - Volume Part I
Optimizing positional index structures for versioned document collections
SIGIR '12 Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval
Asymmetric caching: improved network deduplication for mobile devices
Proceedings of the 18th annual international conference on Mobile computing and networking
WAN-optimized replication of backup datasets using stream-informed delta compression
ACM Transactions on Storage (TOS)
Comparison of caching strategies in modern cellular backhaul networks
Proceeding of the 11th annual international conference on Mobile systems, applications, and services
How to reduce smartphone traffic volume by 30%?
PAM'13 Proceedings of the 14th international conference on Passive and Active Measurement
Horizon extender: long-term preservation of data leakage evidence in web traffic
Proceedings of the 8th ACM SIGSAC symposium on Information, computer and communications security
Effective content-based video caching with cache-friendly encoding and media-aware chunking
Proceedings of the 5th ACM Multimedia Systems Conference
No more Déjà Vu: eliminating redundancy with cachecast: feasibility and performance gains
IEEE/ACM Transactions on Networking (TON)
PACK: Prediction-Based Cloud Bandwidth and Cost Reduction System
IEEE/ACM Transactions on Networking (TON)
Migratory compression: coarse-grained data reordering to improve compressibility
FAST'14 Proceedings of the 12th USENIX conference on File and Storage Technologies
Hi-index | 0.00 |
We present a technique for identifying repetitive information transfers and use it to analyze the redundancy of network traffic. Our insight is that dynamic content, streaming media and other traffic that is not caught by today's Web caches is nonetheless likely to derive from similar information. We have therefore adapted similarity detection techniques to the problem of designing a system to eliminate redundant transfers. We identify repeated byte ranges between packets to avoid retransmitting the redundant data.We find a high level of redundancy and are able to detect repetition that Web proxy caches are not. In our traces, after Web proxy caching has been applied, an additional 39% of the original volume of Web traffic is found to be redundant. Moreover, because our technique makes no assumptions about HTTP protocol syntax or caching semantics, it provides immediate benefits for other types of content, such as streaming media, FTP traffic, news and mail.