Unstructured peer-to-peer networks for sharing processor cycles

  • Authors:

  • Asad Awan;Ronaldo A. Ferreira;Suresh Jagannathan;Ananth Grama

  • Affiliations:

  • Department of Computer Sciences, Purdue University, 250 N, University Street, West Lafayette, IN 47907, USA;Department of Computer Sciences, Purdue University, 250 N, University Street, West Lafayette, IN 47907, USA;Department of Computer Sciences, Purdue University, 250 N, University Street, West Lafayette, IN 47907, USA;Department of Computer Sciences, Purdue University, 250 N, University Street, West Lafayette, IN 47907, USA

  • Venue:
  • Parallel Computing - Parallel matrix algorithms and applications (PMAA'04)
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

Motivated by the needs and success of projects such as SETI@home and genome@home, we propose an architecture for a sustainable large-scale peer-to-peer environment for distributed cycle sharing among Internet hosts. Such networks are characterized by highly dynamic state due to high arrival and departure rates. This makes it difficult to build and maintain structured networks and to use state-based resource allocation techniques. We build our system to work in an environment similar to current file-sharing networks such as Gnutella and Freenet. In doing so, we are able to leverage vast network resources while providing resilience to random failures, low network overhead, and an open architecture for resource brokering. This paper describes the underlying analytical and algorithmic substrates based on randomization for job distribution, replication, monitoring, aggregation and oblivious resource sharing and communication between participating hosts. We support our claims of robustness and scalability analytically with high probabilistic guarantees. Our algorithms do not introduce any state dependencies, and hence are resilient to dynamic node arrivals, departures, and failures. We support all analytical claims with a detailed simulation-based evaluation of our distributed framework.