Distributing and managing data on desktop grids with BitDew

  • Authors:
  • Gilles Fedak;Haiwu He;Franck Cappello

  • Affiliations:
  • INRIA Saclay, Orsay, France;INRIA Saclay, Orsay, France;INRIA Saclay, Orsay, France

  • Venue:
  • UPGRADE '08 Proceedings of the third international workshop on Use of P2P, grid and agents for the development of content networks
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

Desktop Grids use the computing, network and storage resources from idle desktop PC's distributed over multiple-LAN's or the Internet to compute a large variety of resource-demanding distributed applications. While these applications need to access, compute, store and circulate large volumes of data, little attention has been paid to data management in such large-scale, dynamic, heterogeneous, volatile and highly distributed Grids. To address this problem, we propose the BitDew framework, a programmable environment for automatic and trans-parent data management on computational Desktop Grids. BitDew relies on a specific set of meta-data to drive key data management operations, namely life cycle, distribution, placement, replication and fault-tolerance with a high level of abstraction. The Bitdew runtime environment is a flexible distributed service architecture that integrates modular P2P components such as DHT's for a distributed data catalog and collaborative transport protocols for data distribution.