Fast anomaly detection for streaming data

Authors:
Swee Chuan Tan;Kai Ming Ting;Tony Fei Liu
Affiliations:
SIM University, Singapore;Monash University, Australia;Monash University, Australia
Venue:
IJCAI'11 Proceedings of the Twenty-Second international joint conference on Artificial Intelligence - Volume Volume Two
Year:
2011

Citing 16
Cited 2

Mining high-speed data streams

Proceedings of the sixth ACM SIGKDD international conference on Knowledge discovery and data mining
Mining time-changing data streams

Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining
A Simple Generalisation of the Area Under the ROC Curve for Multiple Class Classification Problems

Machine Learning
Random Forests

Machine Learning
Discovering cluster-based local outliers

Pattern Recognition Letters
Mining distance-based outliers in near linear time with randomization and a simple pruning rule

Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining
Fast Distributed Outlier Detection in Mixed-Attribute Data Sets

Data Mining and Knowledge Discovery
Outlier detection by active learning

Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining
An online support vector machine for abnormal events detection

Signal Processing - Special section: Advances in signal processing-assisted cross-layer designs
Online outlier detection in sensor data using non-parametric models

VLDB '06 Proceedings of the 32nd international conference on Very large data bases
Advances in Neural Information Processing Systems 19: Proceedings of the 2006 Conference (Bradford Books)

Advances in Neural Information Processing Systems 19: Proceedings of the 2006 Conference (Bradford Books)
Isolation Forest

ICDM '08 Proceedings of the 2008 Eighth IEEE International Conference on Data Mining
Anomaly detection: A survey

ACM Computing Surveys (CSUR)
Novelty detection with application to data streams

Intelligent Data Analysis - Knowledge Discovery from Data Streams
New ensemble methods for evolving data streams

Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining
Mass estimation and its applications

Proceedings of the 16th ACM SIGKDD international conference on Knowledge discovery and data mining

Root cause detection in a service-oriented architecture

Proceedings of the ACM SIGMETRICS/international conference on Measurement and modeling of computer systems
A least-squares approach to anomaly detection in static and sequential data

Pattern Recognition Letters

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper introduces Streaming Half-Space-Trees (HS-Trees), a fast one-class anomaly detector for evolving data streams. It requires only normal data for training and works well when anomalous data are rare. The model features an ensemble of random HS-Trees, and the tree structure is constructed without any data. This makes the method highly efficient because it requires no model restructuring when adapting to evolving data streams. Our analysis shows that Streaming HS-Trees has constant amortised time complexity and constant memory requirement. When compared with a state-of-the-art method, our method performs favourably in terms of detection accuracy and runtime performance. Our experimental results also show that the detection performance of Streaming HS-Trees is not sensitive to its parameter settings.