Insight into redundancy schemes in DHTs

  • Authors:
  • Guihai Chen;Tongqing Qiu;Fan Wu

  • Affiliations:
  • State Key Laboratory of Novel Software Technology, Nanjing University, Nanjing, China;State Key Laboratory of Novel Software Technology, Nanjing University, Nanjing, China;Department of Computer Science and Engineering, SUNY at Buffalo, Buffalo, USA

  • Venue:
  • The Journal of Supercomputing
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

In order to provide high data availability in peer-to-peer (P2P) DHTs, proper data redundancy schemes are required. This paper compares two popular schemes: replication and erasure coding. Unlike previous comparison, we take user download behavior into account. Furthermore, we propose a hybrid redundancy scheme, which shares user downloaded files for subsequent accesses and utilizes erasure coding to adjust file availability. Comparison experiments of three schemes show that replication saves more bandwidth than erasure coding, although it requires more storage space, when average node availability is higher than 47%; moreover, our hybrid scheme saves more maintenance bandwidth with acceptable redundancy factor.