Network information flow with correlated sources

• Authors: J. Barros;S. D. Servetto
• Venue: IEEE Transactions on Information Theory
• Year: 2006

Consider the following network communication setup, originating in a sensor networking application we refer to as the "sensor reachback" problem. We have a directed graph G=(V,E), where V={v0v1...vn} and E⊆V×V. If (vi,vj)∈E, then node i can send messages to node j over a discrete memoryless channel (DMC) (Xij,pij(y|x),Yij), of capacity Cij. The channels are independent. Each node vi gets to observe a source of information Ui(i=0...M), with joint distribution p(U0U1...UM). Our goal is to solve an incast problem in G: nodes exchange messages with their neighbors, and after a finite number of communication rounds, one of the M+1 nodes (v0 by convention) must have received enough information to reproduce the entire field of observations (U0U1...UM), with arbitrarily small probability of error. In this paper, we prove that such perfect reconstruction is possible if and only if H(Us | US(c)) i∈S,j∈S(c) for all S⊆{0...M},S≠O,0∈S(c). Our main finding is that in this setup, a general source/channel separation theorem holds, and that Shannon information behaves as a classical network flow, identical in nature to the flow of water in pipes. At first glance, it might seem surprising that separation holds in a fairly general network situation like the one we study. A closer look, however, reveals that the reason for this is that our model allows only for independent point-to-point channels between pairs of nodes, and not multiple-access and/or broadcast channels, for which separation is well known not to hold. This "information as flow" view provides an algorithmic interpretation for our results, among which perhaps the most important one is the optimality of implementing codes using a layered protocol stack.