Discernibility analysis and accuracy improvement of machine learning algorithms for network intrusion detection

  • Authors:
  • Sanping Li;Yan Luo

  • Affiliations:
  • Department of Electrical and Computer Engineering, University of Massachusetts Lowell, Lowell, MA;Department of Electrical and Computer Engineering, University of Massachusetts Lowell, Lowell, MA

  • Venue:
  • ICC'09 Proceedings of the 2009 IEEE international conference on Communications
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

Network intrusion detection based on machine learning algorithms has demonstrated high performance in execution time and overall classification accuracy. However, very poor identification skill is showed for certain specific attack types, especially for the unknown attack types appeared in the test data only. We use the Parallel Coordinates Plot (PCP), one kind of visualization technique for multi-dimension data analysis, to comparatively analyze the data distribution characteristic for both training and test datasets. On the other hand, we make use of rough sets theory to investigate the discernibility in respect of whole training dataset, randomly sampled dataset and reduct attributes set. Furthermore, based on the higher classification accuracy for data with unknown attack types by using rough sets method, the decision rules extracted from both C4.5 and rough sets method are combined to improve the detection capability of classification model.