Genetic algorithms for outlier detection and variable selection in linear regression models

Authors:
J. Tolvi
Affiliations:
University of Turku, Department of Economics, 20014, Turku, Finland
Venue:
Soft Computing - A Fusion of Foundations, Methodologies and Applications
Year:
2004

Citing 0
Cited 5

Predicting EU Energy Industry Excess Returns on EU Market Index via a Constrained Genetic Algorithm

Computational Economics
New method for instance or prototype selection using mutual information in time series prediction

Neurocomputing
Multiple-case outlier detection in least-squares regression model using Quantum-inspired Evolutionary Algorithm

International Journal of Artificial Intelligence and Soft Computing
Model selection in logistic regression using p-values and greedy search

SIIS'11 Proceedings of the 2011 international conference on Security and Intelligent Information Systems
Instance selection with neural networks for regression problems

ICANN'12 Proceedings of the 22nd international conference on Artificial Neural Networks and Machine Learning - Volume Part II

Quantified Score

Hi-index	0.00

Visualization

Abstract

This article addresses some problems in outlier detection and variable selection in linear regression models. First, in outlier detection there are problems known as smearing and masking. Smearing means that one outlier makes another, non-outlier observation appear as an outlier, and masking that one outlier prevents another one from being detected. Detecting outliers one by one may therefore give misleading results. In this article a genetic algorithm is presented which considers different possible groupings of the data into outlier and non-outlier observations. In this way all outliers are detected at the same time. Second, it is known that outlier detection and variable selection can influence each other, and that different results may be obtained, depending on the order in which these two tasks are performed. It may therefore be useful to consider these tasks simultaneously, and a genetic algorithm for a simultaneous outlier detection and variable selection is suggested. Two real data sets are used to illustrate the algorithms, which are shown to work well. In addition, the scalability of the algorithms is considered with an experiment using generated data.