Streaming Solutions for Fine-Grained Network Traffic Measurements and Analysis

  • Authors:
  • Faisal Khan;Nicholas Hosein;Chen-Nee Chuah;Soheil Ghiasi

  • Affiliations:
  • -;-;-;-

  • Venue:
  • Proceedings of the 2011 ACM/IEEE Seventh Symposium on Architectures for Networking and Communications Systems
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

Streaming network traffic measurements and analysis is critical for detecting and preventing any real-time anomalies in the network. The high speeds and complexity of today's network make the traditional slow open-loop measurement schemes infeasible. We propose an alternate closed-loop measurement paradigm and demonstrate its practical realization. To the heart of our solution are three streaming algorithms that provide a tight integration between the measurement platform and the measurements. The algorithms cater to varying degrees of computational budgets, detection latency, and accuracy. We empirically evaluate our streaming solutions on a highly parallel and programmable measurement platform. The algorithms demonstrate a marked 100% accuracy increase from a recently proposed MRT algorithm in detecting DoS attacks made up of synthetic hard-to-track elephant flows. Our proposed algorithms maintain the worst case complexities of the MRT, while empirically demonstrating a moderate increase in average resource utilization.