Novelty detection: a review—part 1: statistical approaches

Authors:
Markos Markou;Sameer Singh
Affiliations:
Department of Computer Science, PANN Research, University of Exeter, Exeter EX4 4PT, UK;Department of Computer Science, PANN Research, University of Exeter, Exeter EX4 4PT, UK
Venue:
Signal Processing
Year:
2003

Citing 28
Cited 135

Pole-assignment robustness in a specified disk

Systems & Control Letters
A probabilistic resource allocating network for novelty detection

Neural Computation
A study of retrospective and on-line event detection

Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval
A re-examination of text categorization methods

Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval
On-line unsupervised outlier detection using finite mixtures with discounting learning algorithms

Proceedings of the sixth ACM SIGKDD international conference on Knowledge discovery and data mining
Two-phase clustering process for outliers detection

Pattern Recognition Letters
Artificial Intelligence in Design '00

Artificial Intelligence in Design '00
The Error-Reject Tradeoff

Open Systems & Information Dynamics
Using Artificial Anomalies to Detect Unknown and Known Network Intrusions

ICDM '01 Proceedings of the 2001 IEEE International Conference on Data Mining
Outlier Detection Using Classifier Instability

SSPR '98/SPR '98 Proceedings of the Joint IAPR International Workshops on Advances in Pattern Recognition
Distance-based outliers: algorithms and applications

The VLDB Journal — The International Journal on Very Large Data Bases
Topic-conditioned novelty detection

Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining
Parzen-Window Network Intrusion Detectors

ICPR '02 Proceedings of the 16 th International Conference on Pattern Recognition (ICPR'02) Volume 4 - Volume 4
Neural Networks for Novelty Detection in Airframe Strain Data

IJCNN '00 Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks (IJCNN'00)-Volume 6 - Volume 6
Detection, Synthesis and Compression in Mammographic Image Analysis with a Hierarchical Image Probability Model

MMBIA '01 Proceedings of the IEEE Workshop on Mathematical Methods in Biomedical Image Analysis (MMBIA'01)
Self-Nonself Discrimination in a Computer

SP '94 Proceedings of the 1994 IEEE Symposium on Security and Privacy
Pattern Classification (2nd Edition)

Pattern Classification (2nd Edition)
An Approach to Novelty Detection Applied to the Classification of Image Regions

IEEE Transactions on Knowledge and Data Engineering
Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600)

CEC '02 Proceedings of the Evolutionary Computation on 2002. CEC '02. Proceedings of the 2002 Congress - Volume 02
Anomaly detection in multidimensional data using negative selection algorithm

CEC '02 Proceedings of the Evolutionary Computation on 2002. CEC '02. Proceedings of the 2002 Congress - Volume 02
Modeling text with generalizable Gaussian mixtures

ICASSP '00 Proceedings of the Acoustics, Speech, and Signal Processing, 2000. on IEEE International Conference - Volume 06
A System for the Analysis of Jet Engine Vibration Data

Integrated Computer-Aided Engineering
Statistical independence and novelty detection with information preserving nonlinear maps

Neural Computation
A novelty detection approach to classification

IJCAI'95 Proceedings of the 14th international joint conference on Artificial intelligence - Volume 1
To reject or not to reject: that is the question-an answer in caseof neural classifiers

IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews
Network intrusion and fault detection: a statistical anomaly approach

IEEE Communications Magazine
EvIdentTM: a functional magnetic resonance image analysis system

Artificial Intelligence in Medicine
A method for improving classification reliability of multilayer perceptrons

IEEE Transactions on Neural Networks

Symbolic dynamic analysis of complex systems for anomaly detection

Signal Processing
Anomaly subspace detection based on a multi-scale Markov random field model

Signal Processing
Feature bagging for outlier detection

Proceedings of the eleventh ACM SIGKDD international conference on Knowledge discovery in data mining
Symbolic time series analysis for anomaly detection: a comparative evaluation

Signal Processing
A Neural Network-Based Novelty Detector for Image Sequence Analysis

IEEE Transactions on Pattern Analysis and Machine Intelligence
Application of LVQ to novelty detection using outlier training data

Pattern Recognition Letters
Kernel PCA for novelty detection

Pattern Recognition
Unknown word sense detection as outlier detection

HLT-NAACL '06 Proceedings of the main conference on Human Language Technology Conference of the North American Chapter of the Association of Computational Linguistics
Focusing on non-respondents: Response modeling with novelty detectors

Expert Systems with Applications: An International Journal
OLINDDA: a cluster-based approach for detecting novelty and concept drift in data streams

Proceedings of the 2007 ACM symposium on Applied computing
A self-organizing neural network for detecting novelties

Proceedings of the 2007 ACM symposium on Applied computing
Towards a synthetic analysis of user's information need for more effective personalized filtering services

Proceedings of the 2007 ACM symposium on Applied computing
Quantile Regression Forests

The Journal of Machine Learning Research
Conditional Anomaly Detection

IEEE Transactions on Knowledge and Data Engineering
Real-time Automated Visual Inspection using Mobile Robots

Journal of Intelligent and Robotic Systems
Adaptive model selection for time series prediction in wireless sensor networks

Signal Processing
Anomaly detection in a mobile communication network

Computational & Mathematical Organization Theory
Failure Detection in Large-Scale Internet Services by Principal Subspace Mapping

IEEE Transactions on Knowledge and Data Engineering
Probabilistic graphical models and their role in databases

VLDB '07 Proceedings of the 33rd international conference on Very large data bases
Monitoring High-Dimensional Data for Failure Detection and Localization in Large-Scale Computing Systems

IEEE Transactions on Knowledge and Data Engineering
Supporting diagnosis of attention-deficit hyperactive disorder with novelty detection

Artificial Intelligence in Medicine
Evolving a dynamic predictive coding mechanism for novelty detection

Knowledge-Based Systems
Cluster-based novel concept detection in data streams applied to intrusion detection in computer networks

Proceedings of the 2008 ACM symposium on Applied computing
CURIO: a fast outlier and outlier cluster detection algorithm for large datasets

AIDM '07 Proceedings of the 2nd international workshop on Integrating artificial intelligence and data mining - Volume 84
Known Unknowns: Novelty Detection in Condition Monitoring

IbPRIA '07 Proceedings of the 3rd Iberian conference on Pattern Recognition and Image Analysis, Part I
Case-Based Reasoning and the Statistical Challenges

ECCBR '08 Proceedings of the 9th European conference on Advances in Case-Based Reasoning
Open problems in the security of learning

Proceedings of the 1st ACM workshop on Workshop on AISec
Automatic target defect identification for TFT-LCD array process inspection using kernel FCM-based fuzzy SVDD ensemble

Expert Systems with Applications: An International Journal
Outlier identification and market segmentation using kernel-based clustering techniques

Expert Systems with Applications: An International Journal
Outlier detection and evaluation by network flow

International Journal of Computer Applications in Technology
An extended energy detector for non-Gaussian and non-independent noise

Signal Processing
An evaluation of dimension reduction techniques for one-class classification

Artificial Intelligence Review
Concepts for novelty detection and handling based on a case-based reasoning process scheme

Engineering Applications of Artificial Intelligence
Incremental data-driven learning of a novelty detection model for one-class classification with application to high-dimensional noisy data

Machine Learning
Fabric defect detection based on multiple fractal features and support vector data description

Engineering Applications of Artificial Intelligence
One-Class Genetic Programming

EuroGP '09 Proceedings of the 12th European Conference on Genetic Programming
Improving authentication accuracy using artificial rhythms and cues for keystroke dynamics-based authentication

Expert Systems with Applications: An International Journal
Anomaly detection: A survey

ACM Computing Surveys (CSUR)
Novelty detection with application to data streams

Intelligent Data Analysis - Knowledge Discovery from Data Streams
Relational Frequent Patterns Mining for Novelty Detection from Data Streams

MLDM '09 Proceedings of the 6th International Conference on Machine Learning and Data Mining in Pattern Recognition
HMM-Based Defect Localization in Wire Ropes --- A New Approach to Unusual Subsequence Recognition

Proceedings of the 31st DAGM Symposium on Pattern Recognition
Integrating Novel Class Detection with Classification for Concept-Drifting Data Streams

ECML PKDD '09 Proceedings of the European Conference on Machine Learning and Knowledge Discovery in Databases: Part II
Using labeled data to evaluate change detectors in a multivariate streaming environment

Signal Processing
Fast communication: Detection of signals of unknown duration by multiple energy detectors

Signal Processing
Unsupervised anomaly detection

IJCAI'07 Proceedings of the 20th international joint conference on Artifical intelligence
Robust speech recognition by integrating speech separation and hypothesis testing

Speech Communication
Elliptical anomalies in wireless sensor networks

ACM Transactions on Sensor Networks (TOSN)
SVDD regularized with area under the ROC

Proceedings of the 2nd International Conference on Interaction Sciences: Information Technology, Culture and Human
Information theoretic novelty detection

Pattern Recognition
Domain-guided novelty detection for autonomous exploration

IJCAI'09 Proceedings of the 21st international jont conference on Artifical intelligence
Hierarchical Architecture with Modular Network SOM and Modular Reinforcement Learning

ICANN '09 Proceedings of the 19th International Conference on Artificial Neural Networks: Part I
Detection of Unusual Objects and Temporal Patterns in EEG Video Recordings

ISVC '09 Proceedings of the 5th International Symposium on Advances in Visual Computing: Part I
Autonomous Mapping Using a Flexible Region Map for Novelty Detection

ICIRA '09 Proceedings of the 2nd International Conference on Intelligent Robotics and Applications
A higher order collective classifier for detecting andclassifying network events

ISI'09 Proceedings of the 2009 IEEE international conference on Intelligence and security informatics
Combining SOM and local minimum enclosing spheres for novelty detection

CCDC'09 Proceedings of the 21st annual international conference on Chinese control and decision conference
Soft computing applications to prognostics and health management (PHM): leveraging field data and domain knowledge

IWANN'07 Proceedings of the 9th international work conference on Artificial neural networks
Separating the wheat from the chaff: practical anomaly detection schemes in ecological applications of distributed sensor networks

DCOSS'07 Proceedings of the 3rd IEEE international conference on Distributed computing in sensor systems
Concepts for novelty detection and handling based on a case-based reasoning process scheme

ICDM'07 Proceedings of the 7th industrial conference on Advances in data mining: theoretical aspects and applications
Dealing with application requirements and energy consumption in wireless sensor networks: a novelty detection approach for quality of query services

Proceedings of the 2010 ACM Symposium on Applied Computing
A novel immune inspired approach to fault detection

ICARIS'07 Proceedings of the 6th international conference on Artificial immune systems
Towards a novel immune inspired approach to temporal anomaly detection

ICARIS'07 Proceedings of the 6th international conference on Artificial immune systems
Towards a computational model of creative societies using curious design agents

ESAW'06 Proceedings of the 7th international conference on Engineering societies in the agents world VII
A comparison of one-class classifiers for novelty detection in forensic case data

IDEAL'07 Proceedings of the 8th international conference on Intelligent data engineering and automated learning
Detecting concept drift using statistical testing

DS'07 Proceedings of the 10th international conference on Discovery science
Outlier detection via localized p-value estimation

Allerton'09 Proceedings of the 47th annual Allerton conference on Communication, control, and computing
On community outliers and their efficient detection in information networks

Proceedings of the 16th ACM SIGKDD international conference on Knowledge discovery and data mining
Apply robust segmentation to the service industry using kernel induced fuzzy clustering techniques

Expert Systems with Applications: An International Journal
Fast support vector data descriptions for novelty detection

IEEE Transactions on Neural Networks
A Computable Plug-In Estimator of Minimum Volume Sets for Novelty Detection

Operations Research
Fuzzy multivariable Gaussian evolving approach for fault detection and diagnosis

IPMU'10 Proceedings of the Computational intelligence for knowledge-based systems design, and 13th international conference on Information processing and management of uncertainty
Adaptive methods for classification in arbitrarily imbalanced and drifting data streams

PAKDD'09 Proceedings of the 13th Pacific-Asia international conference on Knowledge discovery and data mining: new frontiers in applied data mining
Visualization of changes in process dynamics using self-organizing maps

ICANN'10 Proceedings of the 20th international conference on Artificial neural networks: Part II
Mining Medical Administrative Data --The PKB Suite

Proceedings of the 2010 conference on Data Mining for Business Applications
Detection of different authorship of text sequences through self-organizing maps and mutual information function

MICAI'10 Proceedings of the 9th Mexican international conference on Artificial intelligence conference on Advances in soft computing: Part II
High-speed inline defect detection for TFT-LCD array process using a novel support vector data description

Expert Systems with Applications: An International Journal
Atypicity detection in data streams: A self-adjusting approach

Intelligent Data Analysis - Ubiquitous Knowledge Discovery
Feature extraction for novelty detection as applied to fault detection in machinery

Pattern Recognition Letters
Improving gaussian process classification with outlier detection: with applications in image classification

ACCV'10 Proceedings of the 10th Asian conference on Computer vision - Volume Part IV
lp-Norm Multiple Kernel Learning

The Journal of Machine Learning Research
Combining structure and appearance for anomaly detection in wire ropes

CAIP'11 Proceedings of the 14th international conference on Computer analysis of images and patterns - Volume Part II
New drift detection method for data streams

ICAIS'11 Proceedings of the Second international conference on Adaptive and intelligent systems
Novelty detection using graphical models for semantic room classification

EPIA'11 Proceedings of the 15th Portugese conference on Progress in artificial intelligence
Novelty detection for the inspection of light-emitting diodes

Expert Systems with Applications: An International Journal
Theoretical basis of novelty detection in time series using negative selection algorithms

ICARIS'06 Proceedings of the 5th international conference on Artificial Immune Systems
SOM-based novelty detection using novel data

IDEAL'05 Proceedings of the 6th international conference on Intelligent Data Engineering and Automated Learning
Monitoring industrial processes with SOM-based dissimilarity maps

Expert Systems with Applications: An International Journal
Anomaly internet network traffic detection by kernel principle component classifier

ISNN'05 Proceedings of the Second international conference on Advances in Neural Networks - Volume Part III
On-line multi-stage sorting algorithm for agriculture products

Pattern Recognition
Techniques for knowledge acquisition in dynamically changing environments

ACM Transactions on Autonomous and Adaptive Systems (TAAS) - Special section on formal methods in pervasive computing, pervasive adaptation, and self-adaptive systems: Models and algorithms
On-line adaptive clustering for process monitoring and fault detection

Expert Systems with Applications: An International Journal
Anomalistic sequence detection

International Journal of Intelligent Information and Database Systems
Learning from others: Exchange of classification rules in intelligent distributed systems

Artificial Intelligence
Combining multiple classifiers to quantitatively rank the impact of abnormalities in flight data

Applied Soft Computing
Novelty detection in wildlife scenes through semantic context modelling

Pattern Recognition
Sequential change-point detection based on direct density-ratio estimation

Statistical Analysis and Data Mining
Event-based classification of social media streams

Proceedings of the 2nd ACM International Conference on Multimedia Retrieval
An automated vision based on-line novel percept detection method for a mobile robot

Robotics and Autonomous Systems
A survey on unsupervised outlier detection in high-dimensional numerical data

Statistical Analysis and Data Mining
Adaptive fault detection and diagnosis using an evolving fuzzy classifier

Information Sciences: an International Journal
Drift detection and characterization for fault diagnosis and prognosis of dynamical systems

SUM'12 Proceedings of the 6th international conference on Scalable Uncertainty Management
A modified support vector data description based novelty detection approach for machinery components

Applied Soft Computing
A study of anomaly detection in data from urban sensor networks

MDAI'12 Proceedings of the 9th international conference on Modeling Decisions for Artificial Intelligence
Novelty detection using a new group outlier factor

ICONIP'12 Proceedings of the 19th international conference on Neural Information Processing - Volume Part III
Outlier detection for patient monitoring and alerting

Journal of Biomedical Informatics
Fractal analogies for general intelligence

AGI'12 Proceedings of the 5th international conference on Artificial General Intelligence
Managing information disparity in multilingual document collections

ACM Transactions on Speech and Language Processing (TSLP)
Enhanced anomaly detection in wire ropes by combining structure and appearance

Pattern Recognition Letters
Fast intelligent watermarking of heterogeneous image streams through mixture modeling of PSO populations

Applied Soft Computing
Novelty detection algorithm for data streams multi-class problems

Proceedings of the 28th Annual ACM Symposium on Applied Computing
Event identification for local areas using social media streaming data

Proceedings of the ACM SIGMOD Workshop on Databases and Social Networks
Robust novelty detection in the framework of a contamination neighbourhood

International Journal of Intelligent Information and Database Systems
Robust novelty detection in the framework of a contamination neighbourhood

International Journal of Intelligent Information and Database Systems
An online system with end-user services: mining novelty concepts from tv broadcast subtitles

Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining
An adaptive ensemble classifier for mining concept drifting data streams

Expert Systems with Applications: An International Journal
Systematic construction of anomaly detection benchmarks from real data

Proceedings of the ACM SIGKDD Workshop on Outlier Detection and Description
Security analysis of online centroid anomaly detection

The Journal of Machine Learning Research
Toward supervised anomaly detection

Journal of Artificial Intelligence Research
One class random forests

Pattern Recognition
Principal Component Analysis of the start-up transient and Hidden Markov Modeling for broken rotor bar fault diagnosis in asynchronous machines

Expert Systems with Applications: An International Journal
A survey on concept drift adaptation

ACM Computing Surveys (CSUR)
On query processing in wireless sensor networks using classes of quality of queries

Information Fusion
Novelty detection and segmentation based on Gaussian mixture models: A case study in 3D robotic laser mapping

Robotics and Autonomous Systems
A survey of multiple classifier systems as hybrid systems

Information Fusion
Exploring customer specific KPI selection strategies for an adaptive time critical user interface

Proceedings of the 19th international conference on Intelligent User Interfaces
Fast communication: Unknown signal detection by one-class detector based on Gaussian copula

Signal Processing
An adaptive threshold estimation scheme for abrupt changes detection algorithm in a cement rotary kiln

Journal of Computational and Applied Mathematics
Geometrical and computational aspects of Spectral Support Estimation for novelty detection

Pattern Recognition Letters
1-norm support vector novelty detection and its sparseness

Neural Networks
Hyperspherical cluster based distributed anomaly detection in wireless sensor networks

Journal of Parallel and Distributed Computing
A plug-in approach to neyman-pearson classification

The Journal of Machine Learning Research
Neighbors' distribution property and sample reduction for support vector machines

Applied Soft Computing
Hybrid model of clustering and kernel autoassociator for reliable vehicle type classification

Machine Vision and Applications
Review: A review of novelty detection

Signal Processing
Regularized correntropy criterion based feature extraction for novelty detection

Neurocomputing
Authorship attribution as a case of anomaly detection: A neural network model

International Journal of Hybrid Intelligent Systems

Quantified Score

Hi-index	0.10

Visualization

Abstract

Novelty detection is the identification of new or unknown data or signal that a machine learning system is not aware of during training. Novelty detection is one of the fundamental requirements of a good classification or identification system since sometimes the test data contains information about objects that were not known at the time of training the model. In this paper we provide state-of-the-art review in the area of novelty detection based on statistical approaches. The second part paper details novelty detection using neural networks. As discussed, there are a multitude of applications where novelty detection is extremely important including signal processing, computer vision, pattern recognition, data mining, and robotics.