BackStreamDB: a distributed system for backbone traffic monitoring providing arbitrary measurements in real-time

  • Authors:
  • Christian Lyra;Carmem S. Hara;Elias P. Duarte

  • Affiliations:
  • Brazilian Research Network (RNP) --- Point of Presence at Parana State, Curitiba-PR, Brazil;Department of Informatics, Federal University of Parana, Curitiba-PR, Brazil;Department of Informatics, Federal University of Parana, Curitiba-PR, Brazil

  • Venue:
  • PAM'12 Proceedings of the 13th international conference on Passive and Active Measurement
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

Monitoring the traffic of wide area networks consisting of several autonomous systems connected through a high-speed backbone is a challenge due to the huge amount of traffic. Keeping logs for obtaining measurements is unfeasible. This work describes a distributed real-time strategy for backbone traffic monitoring that does not employ logs and allows arbitrary metrics to be collected about the traffic of the backbone as a whole. Traffic is sampled by monitors that are distributed across the backbone and are accessed by a Stream Processing Engine (SPE). Besides the distributed monitoring architecture, we present an implementation (BackStreamDB) that was deployed on a national backbone. Case studies are described that show the system flexibility. Experiments are reported in which we evaluated the amount of traffic that can be handled.