Deleting Files in the Celeste Peer-to-Peer Storage System

  • Authors:
  • Gal Badishi;Germano Caronni;Idit Keidar;Raphael Rom;Glenn Scott

  • Affiliations:
  • Israel Institute of Technology;Sun Microsystems Laboratories;Israel Institute of Technology;Israel Institute of Technology;Sun Microsystems Laboratories

  • Venue:
  • SRDS '06 Proceedings of the 25th IEEE Symposium on Reliable Distributed Systems
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

Celeste is a robust peer-to-peer object store built on top of a distributed hash table (DHT). Celeste is a working system, developed by Sun Microsystems Laboratories. During the development of Celeste, we faced the challenge of complete object deletion, and moreover, of deleting "files" composed of several different objects. This important problem is not solved by merely deleting meta-data, as there are scenarios in which all file contents must be deleted, e.g., due to a court order. Complete file deletion in a realistic peer-topeer storage system has not been previously dealt with due to the intricacy of the problem - the system may experience high churn rates, nodes may crash or have intermittent connectivity, and the overlay network may become partitioned at times. We present an algorithm that eventually deletes all file content, data and meta-data, in the aforementioned complex scenarios. The algorithm is fully functional and has been successfully integrated into Celeste.