FIMUS: A framework for imputing missing values using co-appearance, correlation and similarity analysis

Authors:
Md. Geaur Rahman;Md Zahidul Islam
Affiliations:
-;-
Venue:
Knowledge-Based Systems
Year:
2014

Citing 13
Cited 0

A tutorial on support vector regression

Statistics and Computing
Missing value estimation for DNA microarray gene expression data: local least squares imputation

Bioinformatics
Top 10 algorithms in data mining

Knowledge and Information Systems
Discretization for naive-Bayes learning: managing discretization bias and variance

Machine Learning
Improved use of continuous attributes in C4.5

Journal of Artificial Intelligence Research
The theoretic framework of local weighted approximation for microarray missing value estimation

Pattern Recognition
Missing value imputation on missing completely at random data using multilayer perceptrons

Neural Networks
LIBSVM: A library for support vector machines

ACM Transactions on Intelligent Systems and Technology (TIST)
Iterative bicluster-based least square framework for estimation of missing values in microarray gene expression data

Pattern Recognition
A hybrid method for imputation of missing values using optimized fuzzy c-means with support vector regression and a genetic algorithm

Information Sciences: an International Journal
A Survey of Discretization Techniques: Taxonomy and Empirical Analysis in Supervised Learning

IEEE Transactions on Knowledge and Data Engineering
A decision tree-based missing value imputation technique for data pre-processing

AusDM '11 Proceedings of the Ninth Australasian Data Mining Conference - Volume 121
VICUS: a noise addition technique for categorical data

AusDM '12 Proceedings of the Tenth Australasian Data Mining Conference - Volume 134

Quantified Score

Hi-index	0.00

Visualization

Abstract

Natural data sets often have missing values in them. An accurate missing value imputation is crucial to increase the usability of a data set for statistical analyses and data mining tasks. In this paper we present a novel missing value imputation technique using a data set's existing patterns including co-appearances of attribute values, correlations among the attributes and similarity of values belonging to an attribute. Our technique can impute both numerical and categorical missing values. We carry out extensive experiments on nine natural data sets, and compare our technique with four high quality existing techniques. We simulate 32 types of missing patterns (combinations), and thereby generate 320 missing data sets for each of the nine natural data sets. Two well known evaluation criteria namely index of agreement (d"2) and root mean squared error are used. Our experimental results, based on the statistical sign test, indicate that our technique achieves significantly better imputation accuracy than the existing techniques.