Handling Missing Data from Heteroskedastic and Nonstationary Data

Authors:
Fulufhelo V. Nelwamondo;Tshilidzi Marwala
Affiliations:
School of Electrical and Information Engineering, University of the Witwatersrand, Private Bag 3, Wits, 2050, South Africa;School of Electrical and Information Engineering, University of the Witwatersrand, Private Bag 3, Wits, 2050, South Africa
Venue:
ISNN '07 Proceedings of the 4th international symposium on Neural Networks: Advances in Neural Networks
Year:
2007

Citing 7
Cited 0

Statistical analysis with missing data

Statistical analysis with missing data
Tracking drifting concepts using random examples

COLT '91 Proceedings of the fourth annual workshop on Computational learning theory
Learning in the presence of concept drift and hidden contexts

Machine Learning
Extracting Hidden Context

Machine Learning - Special issue on context sensitivity and concept drift
Using Correspondence Analysis to Combine Classifiers

Machine Learning
Incremental Learning from Noisy Data

Machine Learning
Online classification of nonstationary data streams

Intelligent Data Analysis

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents a computational intelligence approach for predicting missing data in the presence of concept drift using an ensemble of multi-layered feed forward neural networks. An algorithm that detects concept drift by measuring heteroskedasticity is proposed. Six instances prior to the occurrence of missing data are used to approximate the missing values. The algorithm is applied to simulated time series data sets resembling non-stationary data from a sensor. Results show that the prediction of missing data in non-stationary time series data is possible but is still a challenge. For one test, up to 78% of the data could be predicted within 10% tolerance range of accuracy.