Unsupervised host behavior classification from connection patterns

  • Authors:
  • Guillaume Dewaele;Yosuke Himura;Pierre Borgnat;Kensuke Fukuda;Patrice Abry;Olivier Michel;Romain Fontugne;Kenjiro Cho;Hiroshi Esaki

  • Affiliations:
  • Laboratoire de Physique de l'ENS de Lyon, CNRS, UMR, ENSL, Lyon, France;Graduate School of Information Science and Technology, University of Tokyo, Tokyo, Japan;Laboratoire de Physique de l'ENS de Lyon, CNRS, UMR, ENSL, Lyon, France;National Institute of Informatics, PRESTO, JST, Tokyo, Japan;Laboratoire de Physique de l'ENS de Lyon, CNRS, UMR, ENSL, Lyon, France;Gipsa-lab, CNRS, UMR, Saint Martin d'Hères, France;National Institute of Informatics, Graduate University for Advanced Studies, Tokyo, Japan;Internet Initiative Japan, Tokyo, Japan;Graduate School of Information Science and Technology, University of Tokyo, Tokyo, Japan

  • Venue:
  • International Journal of Network Management
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

A novel host behavior classification approach is proposed as a preliminary step toward traffic classification and anomaly detection in network communication. Although many attempts described in the literature were devoted to flow or application classifications, these approaches are not always adaptable to the operational constraints of traffic monitoring (expected to work even without packet payload, without bidirectionality, on high-speed networks or from flow reports only, etc.). Instead, the classification proposed here relies on the leading idea that traffic is relevantly analyzed in terms of host typical behaviors: typical connection patterns of both legitimate applications (data sharing, downloading, etc.) and anomalous (eventually aggressive) behaviors are obtained by profiling traffic at the host level using unsupervised statistical classification. Classification at the host level is not reducible to flow or application classification, and neither is the contrary: they are different operations which might have complementary roles in network management. The proposed host classification is based on a nine-dimensional feature space evaluating host Internet connectivity, dispersion and exchanged traffic content. A minimum spanning tree (MST) clustering technique is developed that does not require any supervised learning step to produce a set of statistically established typical host behaviors. Not relying on a priori defined classes of known behaviors enables the procedure to discover new host behaviors, that potentially were never observed before. This procedure is applied to traffic collected over the entire year of 2008 on a transpacific (Japan/USA) link. A cross-validation of this unsupervised classification against a classical port-based inspection and a state-of-the-art method provides assessment of the meaningfulness and the relevance of the obtained classes for host behaviors. Copyright © 2010 John Wiley & Sons, Ltd.