WAN optimized replication of backup datasets using stream-informed delta compression
FAST'12 Proceedings of the 10th USENIX conference on File and Storage Technologies
WAN-optimized replication of backup datasets using stream-informed delta compression
ACM Transactions on Storage (TOS)
| Hi-index | 0.00 |
Traditionally backup has been performed on tapes.With the price of disk becoming cheaper and CPUsbecoming faster, the use of disk-based network backupsystem to replace or augment tape-based backup becomesrealistic. More interestingly, random access nature ofdisks allows redundancy of data to be taken intoconsideration for more efficient network transmissionsand data storage at the backup system.In this paper, we consider the type of redundancy thatcan be exploited and study different types of compressiontechniques suitable to achieve improved network efficiencyand storage efficiency during the backup. One form ofredundancy we exploit is the similarities between differentversions. Such efficiencies are never before achievableusing tape-based solutions. We also implemented aworking disk-based network backup system called "A-Backupsystem", which applies the technologies discussedin the paper. Such a system is capable of achieving over10x compression in both network utilization and datastorage during backup.