Review: A review of novelty detection

Authors:
Marco A. F. Pimentel;David A. Clifton;Lei Clifton;Lionel Tarassenko
Affiliations:
-;-;-;-
Venue:
Signal Processing
Year:
2014

Citing 162
Cited 0

Detection of abrupt changes: theory and application

Detection of abrupt changes: theory and application
A probabilistic resource allocating network for novelty detection

Neural Computation
Growing cell structures—a self-organizing network for unsupervised and supervised learning

Neural Networks
Modelling extremal events: for insurance and finance

Modelling extremal events: for insurance and finance
Outliers in statistical pattern recognition and an application to automatic chromosome classification

Pattern Recognition Letters
Nonlinear component analysis as a kernel eigenvalue problem

Neural Computation
LOF: identifying density-based local outliers

SIGMOD '00 Proceedings of the 2000 ACM SIGMOD international conference on Management of data
Support vector domain description

Pattern Recognition Letters - Special issue on pattern recognition in practice VI
On-line unsupervised outlier detection using finite mixtures with discounting learning algorithms

Proceedings of the sixth ACM SIGKDD international conference on Knowledge discovery and data mining
Supervised versus unsupervised binary-learning by feedforward neural networks

Machine Learning
Pattern Recognition with Fuzzy Objective Function Algorithms

Pattern Recognition with Fuzzy Objective Function Algorithms
COOLCAT: an entropy-based algorithm for categorical clustering

Proceedings of the eleventh international conference on Information and knowledge management
Improving the performance of radial basis function classifiers in condition monitoring and fault diagnosis applications where ‘unknown’ faults may occur

Pattern Recognition Letters
Findout: finding outliers in very large datasets

Knowledge and Information Systems
Mean-field approaches to independent component analysis

Neural Computation
Using novelty detection to identify abnormalities caused by mean shifts in bivariate processes

Computers and Industrial Engineering
Efficient greedy learning of Gaussian mixture models

Neural Computation
Fast Outlier Detection in High Dimensional Spaces

PKDD '02 Proceedings of the 6th European Conference on Principles of Data Mining and Knowledge Discovery
Algorithms for Mining Distance-Based Outliers in Large Datasets

VLDB '98 Proceedings of the 24rd International Conference on Very Large Data Bases
Fast Algorithms for Mining Association Rules in Large Databases

VLDB '94 Proceedings of the 20th International Conference on Very Large Data Bases
Outlier Detection Using Replicator Neural Networks

DaWaK 2000 Proceedings of the 4th International Conference on Data Warehousing and Knowledge Discovery
Enhancing Effectiveness of Outlier Detections for Low Density Patterns

PAKDD '02 Proceedings of the 6th Pacific-Asia Conference on Advances in Knowledge Discovery and Data Mining
Discovering cluster-based local outliers

Pattern Recognition Letters
Learning nonstationary models of normal network traffic for detecting novel attacks

Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining
A self-organising network that grows when required

Neural Networks - New developments in self-organizing maps
Rule-based anomaly pattern detection for detecting disease outbreaks

Eighteenth national conference on Artificial intelligence
A Comparative Study of RNN for Outlier Detection in Data Mining

ICDM '02 Proceedings of the 2002 IEEE International Conference on Data Mining
Parzen-Window Network Intrusion Detectors

ICPR '02 Proceedings of the 16 th International Conference on Pattern Recognition (ICPR'02) Volume 4 - Volume 4
Self-Nonself Discrimination in a Computer

SP '94 Proceedings of the 1994 IEEE Symposium on Security and Privacy
Fuzzy C-Means Clustering Algorithm Based on Kernel Method

ICCIMA '03 Proceedings of the 5th International Conference on Computational Intelligence and Multimedia Applications
One-class svms for document classification

The Journal of Machine Learning Research
Anomaly Detection Using Real-Valued Negative Selection

Genetic Programming and Evolvable Machines
Anomaly detection of web-based attacks

Proceedings of the 10th ACM conference on Computer and communications security
Bootstrapping a data mining intrusion detection system

Proceedings of the 2003 ACM symposium on Applied computing
Pattern Classification (2nd Edition)

Pattern Classification (2nd Edition)
Bayesian Event Classification for Intrusion Detection

ACSAC '03 Proceedings of the 19th Annual Computer Security Applications Conference
Mining distance-based outliers in near linear time with randomization and a simple pruning rule

Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining
Online novelty detection on temporal sequences

Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining
Graph-based anomaly detection

Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining
Novelty detection: a review—part 1: statistical approaches

Signal Processing
Novelty detection: a review—part 2: neural network based approaches

Signal Processing
Towards multisensor data fusion for DoS detection

Proceedings of the 2004 ACM symposium on Applied computing
An Approach to Novelty Detection Applied to the Classification of Image Regions

IEEE Transactions on Knowledge and Data Engineering
On-Line Unsupervised Outlier Detection Using Finite Mixtures with Discounting Learning Algorithms

Data Mining and Knowledge Discovery
A probabilistic framework for semi-supervised clustering

Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining
Towards parameter-free data mining

Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining
Eigenspace-based anomaly detection in computer systems

Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining
Outlier Detection Using k-Nearest Neighbour Graph

ICPR '04 Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 3 - Volume 03
A Survey of Outlier Detection Methodologies

Artificial Intelligence Review
Detection of Significant Sets of Episodes in Event Sequences

ICDM '04 Proceedings of the Fourth IEEE International Conference on Data Mining
On Local Spatial Outliers

ICDM '04 Proceedings of the Fourth IEEE International Conference on Data Mining
LOADED: Link-Based Outlier and Anomaly Detection in Evolving Data Sets

ICDM '04 Proceedings of the Fourth IEEE International Conference on Data Mining
RDF: A Density-Based Outlier Detection Method using Vertical Data Representation

ICDM '04 Proceedings of the Fourth IEEE International Conference on Data Mining
Reliable detection of episodes in event sequences

Knowledge and Information Systems
Approximations to Magic: Finding Unusual Medical Time Series

CBMS '05 Proceedings of the 18th IEEE Symposium on Computer-Based Medical Systems
Mining anomalies using traffic feature distributions

Proceedings of the 2005 conference on Applications, technologies, architectures, and protocols for computer communications
An approach to spacecraft anomaly detection problem using kernel feature space

Proceedings of the eleventh ACM SIGKDD international conference on Knowledge discovery in data mining
Neighborhood Formation and Anomaly Detection in Bipartite Graphs

ICDM '05 Proceedings of the Fifth IEEE International Conference on Data Mining
An Empirical Bayes Approach to Detect Anomalies in Dynamic Multidimensional Arrays

ICDM '05 Proceedings of the Fifth IEEE International Conference on Data Mining
Estimation of High-Density Regions Using One-Class Neighbor Machines

IEEE Transactions on Pattern Analysis and Machine Intelligence
Kernel Fisher Discriminants for Outlier Detection

Neural Computation
Variational Learning for Switching State-Space Models

Neural Computation
Fast Distributed Outlier Detection in Mixed-Attribute Data Sets

Data Mining and Knowledge Discovery
Adaptive event detection with time-varying poisson processes

Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining
Mining distance-based outliers from large databases in any metric space

Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining
Outlier detection by sampling with accuracy guarantees

Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining
Hierarchical Anomaly Detection in Distributed Large-Scale Sensor Networks

ISCC '06 Proceedings of the 11th IEEE Symposium on Computers and Communications
A Neural Network-Based Novelty Detector for Image Sequence Analysis

IEEE Transactions on Pattern Analysis and Machine Intelligence
SLOM: a new measure for local spatial outliers

Knowledge and Information Systems
Finding centric local outliers in categorical/numerical spaces

Knowledge and Information Systems
Application of LVQ to novelty detection using outlier training data

Pattern Recognition Letters
Pattern Recognition and Machine Learning (Information Science and Statistics)

Pattern Recognition and Machine Learning (Information Science and Statistics)
Online outlier detection in sensor data using non-parametric models

VLDB '06 Proceedings of the 32nd international conference on Very large data bases
Detecting outlying subspaces for high-dimensional data: the new task, algorithms, and performance

Knowledge and Information Systems
Gaussian mixture pdf in one-class classification: computing and utilizing confidence values

ICPR '06 Proceedings of the 18th International Conference on Pattern Recognition - Volume 02
A Gamma mixture model better accounts for among site rate heterogeneity

Bioinformatics
Capabilities of outlier detection schemes in large datasets, framework and methodologies

Knowledge and Information Systems
Finding the most unusual time series subsequence: algorithms and applications

Knowledge and Information Systems
Detecting anomalies in cross-classified streams: a Bayesian approach

Knowledge and Information Systems
Kernel PCA for novelty detection

Pattern Recognition
Feature representation and discrimination based on Gaussian mixture model probability densities-Practices and algorithms

Pattern Recognition
One-class document classification via Neural Networks

Neurocomputing
Information sharing for distributed intrusion detection systems

Journal of Network and Computer Applications
Modelling nonlinear count time series with local mixtures of Poisson autoregressions

Computational Statistics & Data Analysis
A self-organizing neural network for detecting novelties

Proceedings of the 2007 ACM symposium on Applied computing
One-Class Novelty Detection for Seizure Analysis from Intracranial EEG

The Journal of Machine Learning Research
Anomaly detection in multidimensional data using negative selection algorithm

CEC '02 Proceedings of the Evolutionary Computation on 2002. CEC '02. Proceedings of the 2002 Congress - Volume 02
Conditional Anomaly Detection

IEEE Transactions on Knowledge and Data Engineering
Real-time Automated Visual Inspection using Mobile Robots

Journal of Intelligent and Robotic Systems
An overview of anomaly detection techniques: Existing solutions and latest technological trends

Computer Networks: The International Journal of Computer and Telecommunications Networking
Fast Iterative Kernel Principal Component Analysis

The Journal of Machine Learning Research
Evolving a dynamic predictive coding mechanism for novelty detection

Knowledge-Based Systems
Statistical independence and novelty detection with information preserving nonlinear maps

Neural Computation
Fast mining of distance-based outliers in high-dimensional datasets

Data Mining and Knowledge Discovery
A multi-agent simulation system for prediction and scheduling of aero engine overhaul

Proceedings of the 7th international joint conference on Autonomous agents and multiagent systems: industrial track
Known Unknowns: Novelty Detection in Condition Monitoring

IbPRIA '07 Proceedings of the 3rd Iberian conference on Pattern Recognition and Image Analysis, Part I
Unsupervised Outlier Detection in Sensor Networks Using Aggregation Tree

ADMA '07 Proceedings of the 3rd international conference on Advanced Data Mining and Applications
One-Class Classification by Combining Density and Class Probability Estimation

ECML PKDD '08 Proceedings of the 2008 European Conference on Machine Learning and Knowledge Discovery in Databases - Part I
Principal Component Analysis Based on L1-Norm Maximization

IEEE Transactions on Pattern Analysis and Machine Intelligence
Computing Correlation Anomaly Scores Using Stochastic Nearest Neighbors

ICDM '07 Proceedings of the 2007 Seventh IEEE International Conference on Data Mining
Clustering Needles in a Haystack: An Information Theoretic Analysis of Minority and Outlier Detection

ICDM '07 Proceedings of the 2007 Seventh IEEE International Conference on Data Mining
Outlier identification and market segmentation using kernel-based clustering techniques

Expert Systems with Applications: An International Journal
Concepts for novelty detection and handling based on a case-based reasoning process scheme

Engineering Applications of Artificial Intelligence
Incremental data-driven learning of a novelty detection model for one-class classification with application to high-dimensional noisy data

Machine Learning
Anomaly detection: A survey

ACM Computing Surveys (CSUR)
Novelty detection with application to data streams

Intelligent Data Analysis - Knowledge Discovery from Data Streams
TANGENT: a novel, 'Surprise me', recommendation algorithm

Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining
Time Series Clustering for Anomaly Detection Using Competitive Neural Networks

WSOM '09 Proceedings of the 7th International Workshop on Advances in Self-Organizing Maps
Analysis of Time Series Novelty Detection Strategies for Synthetic and Real Data

Neural Processing Letters
Learning from Imbalanced Data

IEEE Transactions on Knowledge and Data Engineering
Factorial Switching Linear Dynamical Systems Applied to Physiological Condition Monitoring

IEEE Transactions on Pattern Analysis and Machine Intelligence
A comprehensive survey of numeric and symbolic outlier mining techniques

Intelligent Data Analysis
A Small Sphere and Large Margin Approach for Novelty Detection Using Training Data with Outliers

IEEE Transactions on Pattern Analysis and Machine Intelligence
fMRI analysis via one-class machine learning techniques

IJCAI'05 Proceedings of the 19th international joint conference on Artificial intelligence
Graph-based text representation for novelty detection

TextGraphs-1 Proceedings of the First Workshop on Graph Based Methods for Natural Language Processing
Information theoretic novelty detection

Pattern Recognition
Multi-sphere Support Vector Data Description for Outliers Detection on Multi-distribution Data

ICDMW '09 Proceedings of the 2009 IEEE International Conference on Data Mining Workshops
Robust Bayesian mixture modelling

Neurocomputing
Gaussian Processes for Object Categorization

International Journal of Computer Vision
A Least-squares Approach to Direct Importance Estimation

The Journal of Machine Learning Research
HOT: hypergraph-based outlier test for categorical data

PAKDD'03 Proceedings of the 7th Pacific-Asia conference on Advances in knowledge discovery and data mining
Applying the possibilistic c-means algorithm in kernel-induced spaces

IEEE Transactions on Fuzzy Systems - Special section on computing with words
Fast support vector data descriptions for novelty detection

IEEE Transactions on Neural Networks
High-speed inline defect detection for TFT-LCD array process using a novel support vector data description

Expert Systems with Applications: An International Journal
Statistical outlier detection using direct density ratio estimation

Knowledge and Information Systems
A survey of recent trends in one class classification

AICS'09 Proceedings of the 20th Irish conference on Artificial intelligence and cognitive science
Detection of anomalous insiders in collaborative environments via relational analysis of access logs

Proceedings of the first ACM conference on Data and application security and privacy
Feature extraction for novelty detection as applied to fault detection in machinery

Pattern Recognition Letters
One-class classification with gaussian processes

ACCV'10 Proceedings of the 10th Asian conference on Computer vision - Volume Part II
Anytime online novelty and change detection for mobile robots

Journal of Field Robotics
Encyclopedia of Machine Learning

Encyclopedia of Machine Learning
Multiple distribution data description learning algorithm for novelty detection

PAKDD'11 Proceedings of the 15th Pacific-Asia conference on Advances in knowledge discovery and data mining - Volume Part II
Novelty detection using graphical models for semantic room classification

EPIA'11 Proceedings of the 15th Portugese conference on Progress in artificial intelligence
Novelty Detection with Multivariate Extreme Value Statistics

Journal of Signal Processing Systems
Machine learning-based novelty detection for faulty wafer detection in semiconductor manufacturing

Expert Systems with Applications: An International Journal
The novelty detection approach for different degrees of class imbalance

ICONIP'06 Proceedings of the 13th international conference on Neural Information Processing - Volume Part II
A fast greedy algorithm for outlier mining

PAKDD'06 Proceedings of the 10th Pacific-Asia conference on Advances in Knowledge Discovery and Data Mining
Learning shape for jet engine novelty detection

ISNN'06 Proceedings of the Third international conference on Advances in Neural Networks - Volume Part III
Support vector machine in novelty detection for multi-channel combustion data

ISNN'06 Proceedings of the Third international conference on Advances in Neural Networks - Volume Part III
An anomaly detection algorithm for detecting attacks in wireless sensor networks

ISI'06 Proceedings of the 4th IEEE international conference on Intelligence and Security Informatics
Pseudo-density estimation for clustering with gaussian processes

ISNN'06 Proceedings of the Third international conference on Advances in Neural Networks - Volume Part I
Finding time series discords based on haar transform

ADMA'06 Proceedings of the Second international conference on Advanced Data Mining and Applications
Outlier detection using rough set theory

RSFDGrC'05 Proceedings of the 10th international conference on Rough Sets, Fuzzy Sets, Data Mining, and Granular Computing - Volume Part II
An optimization model for outlier detection in categorical data

ICIC'05 Proceedings of the 2005 international conference on Advances in Intelligent Computing - Volume Part I
Novelty detection in projected spaces for structural health monitoring

IDA'10 Proceedings of the 9th international conference on Advances in Intelligent Data Analysis
Distance-Based outliers in sequences

ICDCIT'05 Proceedings of the Second international conference on Distributed Computing and Internet Technology
Detecting Anomalous Insiders in Collaborative Information Systems

IEEE Transactions on Dependable and Secure Computing
Anomaly detection in IP networks

IEEE Transactions on Signal Processing
A Perturbative Approach to Novelty Detection in Autoregressive Models

IEEE Transactions on Signal Processing
Bayesian Reasoning and Machine Learning

Bayesian Reasoning and Machine Learning
Robust support vector machine with bullet hole image classification

IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews
A formal framework for positive and negative detection schemes

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
An approach to online identification of Takagi-Sugeno fuzzy models

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
A possibilistic approach to clustering

IEEE Transactions on Fuzzy Systems
2012 Special Issue: Autonomous Growing Neural Gas for applications with time constraint: Optimal parameter estimation

Neural Networks
Novelty detection in wildlife scenes through semantic context modelling

Pattern Recognition
On optimum recognition error and reject tradeoff

IEEE Transactions on Information Theory
Markov monitoring with unknown states

IEEE Journal on Selected Areas in Communications
Dynamic self-organizing maps with controlled growth for knowledge discovery

IEEE Transactions on Neural Networks
Probabilistic Novelty Detection for Acoustic Surveillance Under Real-World Conditions

IEEE Transactions on Multimedia
L1 norm based KPCA for novelty detection

Pattern Recognition
Wildlife video key-frame extraction based on novelty detection in semantic context

Multimedia Tools and Applications

Quantified Score

Hi-index	0.08

Visualization

Abstract

Novelty detection is the task of classifying test data that differ in some respect from the data that are available during training. This may be seen as ''one-class classification'', in which a model is constructed to describe ''normal'' training data. The novelty detection approach is typically used when the quantity of available ''abnormal'' data is insufficient to construct explicit models for non-normal classes. Application includes inference in datasets from critical systems, where the quantity of available normal data is very large, such that ''normality'' may be accurately modelled. In this review we aim to provide an updated and structured investigation of novelty detection research papers that have appeared in the machine learning literature during the last decade.