Anomaly detection by finding feature distribution outliers

  • Authors:
  • Marc Stoecklin

  • Affiliations:
  • IBM Zurich Research Laboratory

  • Venue:
  • CoNEXT '06 Proceedings of the 2006 ACM CoNEXT conference
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

In our project we are developing a technique to detect traffic anomalies based on network flow behavior. We estimate baseline distributions for meaningful traffic features and derive measures of legitimate deviations thereof. Observed network behavior is then compared to the baseline behavior by means of a symmetrized version of the Kullback-Leibler divergence. The achieved dimension reduction enables effective outlier detection to flag deviations from the legitimate behavior with high precision. Our technique supports online training and provides enough information to efficiently classify observed anomalies and allows in-depth analysis on demand. First measurements confirm its resilience to seasonal effects while detecting abnormal behavior reliably.