Preference driven server selection in peer-2-peer data sharing systems

  • Authors:
  • Abdelhamid Elwaer;Ian Taylor;Omer Rana

  • Affiliations:
  • Cardiff University, Cardiff, United Kingdom;Cardiff University, Cardiff, United Kingdom;Cardiff University, Cardiff, United Kingdom

  • Venue:
  • Proceedings of the fourth international workshop on Data-intensive distributed computing
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

In scientific applications utilizing a distributed computing infrastructure, data may not be co-located with computation, and may need to be retrieved from one or more remote servers. Where such computation is being supported through volunteered resources, often the data storage server is centralized, but the processing nodes (peers) are distributed. For instance, the BOINC project has been widely used to develop "volunteer computing" projects, utilizing a centralized server to distribute data to users. This can be limiting in terms of performance, scalability and reliability. We describe a framework which utilizes an alternative data distribution and access approach, making use of a BitTorrent-like protocol and integrated with BOINC, for supported automated server selection. In this framework, a node within the system can be a client requesting data, a data hosting service (data center) or a lookup server responsible for providing data to its clients to calculate the "trust value" of data centers. These trust values are used to select data centers to download from based on preferences identified by clients. We demonstrate how such a framework could be used to improve data access time and reliability in Peer-2-Peer based volunteer computing projects.