A protocol-independent technique for eliminating redundant network traffic
Proceedings of the conference on Applications, Technologies, Architectures, and Protocols for Computer Communication
A low-bandwidth network file system
SOSP '01 Proceedings of the eighteenth ACM symposium on Operating systems principles
WWW '03 Proceedings of the 12th international conference on World Wide Web
Understanding user behavior in large-scale video-on-demand systems
Proceedings of the 1st ACM SIGOPS/EuroSys European Conference on Computer Systems 2006
Practical elimination of near-duplicates from web video search
Proceedings of the 15th international conference on Multimedia
I tube, you tube, everybody tubes: analyzing the world's largest user generated content video system
Proceedings of the 7th ACM SIGCOMM conference on Internet measurement
ADMAD: Application-Driven Metadata Aware De-duplication Archival Storage System
SNAPI '08 Proceedings of the 2008 Fifth IEEE International Workshop on Storage Network Architecture and Parallel I/Os
SmartRE: an architecture for coordinated network-wide redundancy elimination
Proceedings of the ACM SIGCOMM 2009 conference on Data communication
EndRE: an end-system redundancy elimination service for enterprises
NSDI'10 Proceedings of the 7th USENIX conference on Networked systems design and implementation
Wide-area network acceleration for the developing world
USENIXATC'10 Proceedings of the 2010 USENIX conference on USENIX annual technical conference
A case for information-bound referencing
Hotnets-IX Proceedings of the 9th ACM SIGCOMM Workshop on Hot Topics in Networks
The power of prediction: cloud bandwidth and cost reduction
Proceedings of the ACM SIGCOMM 2011 conference
Over the top video: the gorilla in cellular networks
Proceedings of the 2011 ACM SIGCOMM conference on Internet measurement conference
Enhancing redundant network traffic elimination
Computer Networks: The International Journal of Computer and Telecommunications Networking
Comparison of caching strategies in modern cellular backhaul networks
Proceeding of the 11th annual international conference on Mobile systems, applications, and services
An information-aware QoE-centric mobile video cache
Proceedings of the 19th annual international conference on Mobile computing & networking
| Hi-index | 0.00 |
Caching similar videos transparently in a network is a cost-effective solution that potentially reduces redundant data transfers. Recent study shows that network redundancy elimination (NRE) on the content level could produce high bandwidth savings in ISPs. However, we find that blindly employing existing NRE techniques to video contents could lead to suboptimal redundancy suppression rates. This is because (a) randomness in the video encoding process could produce completely different binaries even when they deal with seemingly identical video clips and (b) existing NRE chunking schemes incur high overheads since they do not utilize the underlying video format. In this work, we present two novel schemes that help similar or aliased videos to be cached more effectively in the NRE system. First, we propose a deterministic video encoding scheme that preserves the unmodified original content even after editing or re-encoding. This would eliminate the sources of encoding randomness, allowing the NRE systems to detect the redundancy across similar videos. Second, we propose a lightweight video chunking scheme that exploits the underlying video structure. Our "sample-based" chunking scheme groups the logically-related frames into a chunk, and significantly reduces the size of NRE chunk indexes as well as chunking overheads. Our preliminary evaluation shows that the deterministic video encoding scheme helps greatly expose the redundancy across similar videos even after editing. Also, our sample-based chunking reduces the chunking overhead by a factor of 2.0 to 22.5 compared with popular NRE chunking schemes and reduces the index size by 27 times over various video contents.