Randomized gossip algorithms

  • Authors:

  • Stephen Boyd;Arpita Ghosh;Balaji Prabhakar;Devavrat Shah

  • Affiliations:

  • Information Systems Laboratory, Department of Electrical Engineering, Stanford University, Stanford, CA;Information Systems Laboratory, Department of Electrical Engineering, Stanford University, Stanford, CA;Information Systems Laboratory, Department of Electrical Engineering, Stanford University, Stanford, CA;LIDS, Departments of Electrical Engineering and Computer Science, and ESD, the Massachusetts Institute of Technology, Cambridge, MA

  • Venue:
  • IEEE/ACM Transactions on Networking (TON) - Special issue on networking and information theory
  • Year:
  • 2006

Quantified Score

Hi-index 0.36

Visualization

Abstract

Motivated by applications to sensor, peer-to-peer, and ad hoc networks, we study distributed algorithms, also known as gossip algorithms, for exchanging information and for computing in an arbitrarily connected network of nodes. The topology of such networks changes continuously as new nodes join and old nodes leave the network. Algorithms for such networks need to be robust against changes in topology. Additionally, nodes in sensor networks operate under limited computational, communication, and energy resources. These constraints have motivated the design of "gossip" algorithms: schemes which distribute the computational burden and in which a node communicates with a randomly chosen neighbor.We analyze the averaging problem under the gossip constraint for an arbitrary network graph, and find that the averaging time of a gossip algorithm depends on the second largest eigenvalue of a doubly stochastic matrix characterizing the algorithm. Designing the fastest gossip algorithm corresponds to minimizing this eigenvalue, which is a semidefinite program (SDP). In general, SDPs cannot be solved in a distributed fashion; however, exploiting problem structure, we propose a distributed subgradient method that solves the optimization problem over the network.The relation of averaging time to the second largest eigenvalue naturally relates it to the mixing time of a random walk with transition probabilities derived from the gossip algorithm. We use this connection to study the performance and scaling of gossip algorithms on two popular networks: Wireless Sensor Networks, which are modeled as Geometric Random Graphs, and the Internet graph under the so-called Preferential Connectivity (PC) model.