Real-time behaviour profiling for network monitoring

  • Authors:
  • Kuai Xu;Feng Wang;Supratik Bhattacharyya;Zhi-/Li Zhang

  • Affiliations:
  • Arizona State University, 4701 W. Thunderbird Road, Glendale, AZ 85306, USA.;Arizona State University, 4701 W. Thunderbird Road, Glendale, AZ 85306, USA.;SnapTell Inc., Palo Alto, CA 94306, USA.;Department of Computer Science and Engineering, University of Minnesota, 4-/192 EE&#/#/47/CS Building, 200 Union Street SE, Minneapolis, MN 55416, USA

  • Venue:
  • International Journal of Internet Protocol Technology
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper presents the design and implementation of a real-time behaviour profiling system for internet links. The system uses flow-level information, and applies data mining and information-theoretic techniques to automatically discover significant events based on communication patterns. We demonstrate the operational feasibility of the system by implementing it and performing benchmarking of CPU and memory costs using packet traces from backbone links. To improve the robustness of this system against sudden traffic surges, we propose a novel filtering algorithm. The proposed algorithm successfully reduces the CPU and memory cost while maintaining high profiling accuracy. Finally, we devise and evaluate simple yet effective blocking strategies to reduce prevalent exploit traffic, and build a simple event analysis engine to generate ACL rules for filtering unwanted traffic.