Online migration for geo-distributed storage systems

  • Authors:
  • Nguyen Tran;Marcos K. Aguilera;Mahesh Balakrishnan

  • Affiliations:
  • New York University and Microsoft Research Silicon Valley;Microsoft Research Silicon Valley;Microsoft Research Silicon Valley

  • Venue:
  • USENIXATC'11 Proceedings of the 2011 USENIX conference on USENIX annual technical conference
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

We consider the problem of migrating user data between data centers. We introduce distributed storage overlays, a simple abstraction that represents data as stacked layers in different places. Overlays can be readily used to cache data objects, migrate these caches, and migrate the home of data objects.We implement overlays as part of a key-value object store called Nomad, designed to span many data centers. Using Nomad, we compare overlays against commonmigration approaches and show that overlays are more flexible and impose less overhead. To drive migration decisions, we propose policies for predicting the location of future accesses, focusing on a web mail application.We evaluate themigration policies using real traces of user activity from Hotmail.