Zone-based data striping for cloud storage

  • Authors:
  • L. Lu;D. Hildebrand;R. Tewari

  • Affiliations:
  • University of Wisconsin-Madison, Department of Computer Sciences, Madison, SI;IBM Research Division, Almaden Research Center, San Jose, CA;IBM Research Division, Almaden Research Center, San Jose, CA

  • Venue:
  • IBM Journal of Research and Development
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

Data centers in the "cloud" will need to support a wide range of applications, each with their own input/output (I/O) requirements. Some applications perform small and random I/O operations, whereas others demand high streaming bandwidth. In addition, in order to reduce costs, cloud data centers will contain thousands of commodity servers and network switches. Delivering high performance with unreliable commodity hardware for this range of workloads is a grand challenge. ZoneFS uses zone-based data striping in data center infrastructures built from commodity network switches. By striping data in zones, ZoneFS reduces network congestion and avoids one or more storage servers from becoming I/O bottlenecks. In this paper, we present the overall design and implementation of ZoneFS and evaluate its key features with several cloud-computing workloads.