Distributed data storage for opportunistic grids

  • Authors:
  • Raphael Y. de Camargo;Fabio Kon

  • Affiliations:
  • Universidade de São Paulo, Brazil;Universidade de São Paulo, Brazil

  • Venue:
  • Proceedings of the 3rd international Middleware doctoral symposium
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

Grid applications typically need to deal with large amounts of data. The traditional approach for data storage is to employ high-performance dedicated servers with data replication. However, a class of computational grids, called opportunistic grids, focus on the usage of idle resources from shared machines. These machines normally have large quantities of unused storage space that could be used when the machines are idle, allowing opportunistic grids to share not only computational cycles, but also storage space.In this work, we present the initial design of OppStore, a middleware that provides reliable storage using the free storage space from shared grid machines. The storage can be transparently accessed from any grid machine, allowing easy data sharing among grid users and applications. The system uses a two-level peer-to-peer organization to connect grid machines in a scalable and fault-tolerant way. To deal with resource heterogeneity, we developed the concept of virtual ids, which allows the creation of virtual spaces located on top of the peer-to-peer routing substrate. These virtual spaces enables the middleware to perform heterogeneity-aware, load-balancing selection of storage sites using multiple simultaneous metrics.