Intelligent feature and instance selection to improve nearest neighbor classifiers

Authors:
Yenny Villuendas-Rey;Yailé Caballero-Mota;María Matilde García-Lorenzo
Affiliations:
Computer Science Department, University of Ciego de Ávila, Cuba,Computer Science Department, University of Las Villas, Cuba;Computer Science Department, University of Camagüey, Cuba;Computer Science Department, University of Las Villas, Cuba
Venue:
MICAI'12 Proceedings of the 11th Mexican international conference on Advances in Artificial Intelligence - Volume Part I
Year:
2012

Citing 11
Cited 0

Nearest neighbor classifier: simultaneous editing and feature selection

Pattern Recognition Letters - Special issue on pattern recognition in practice VI
A case-based reasoning system with the two-dimensional reduction technique for customer classification

Expert Systems with Applications: An International Journal
Statistical Comparisons of Classifiers over Multiple Data Sets

The Journal of Machine Learning Research
Selecting Features and Objects for Mixed and Incomplete Data

CIARP '08 Proceedings of the 13th Iberoamerican congress on Pattern Recognition: Progress in Pattern Recognition, Image Analysis and Applications
Improved heterogeneous distance functions

Journal of Artificial Intelligence Research
Finding Small Consistent Subset for the Nearest Neighbor Classifier Based on Support Graphs

CIARP '09 Proceedings of the 14th Iberoamerican Conference on Pattern Recognition: Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications
Using Maximum Similarity Graphs to Edit Nearest Neighbor Classifiers

CIARP '09 Proceedings of the 14th Iberoamerican Conference on Pattern Recognition: Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications
IFS-CoCo in the landscape contest: description and results

ICPR'10 Proceedings of the 20th International conference on Recognizing patterns in signals, speech, images, and videos
Enhancing evolutionary instance selection algorithms by means of fuzzy rough set based feature selection

Information Sciences: an International Journal
Simultaneous features and objects selection for mixed and incomplete data

CIARP'06 Proceedings of the 11th Iberoamerican conference on Progress in Pattern Recognition, Image Analysis and Applications
Selecting prototypes in mixed incomplete data

CIARP'05 Proceedings of the 10th Iberoamerican Congress conference on Progress in Pattern Recognition, Image Analysis and Applications

Quantified Score

Hi-index	0.00

Visualization

Abstract

Feature and instance selection before classification is a very important task, which can lead to big improvements in both classifier accuracy and classifier speed. However, few papers consider the simultaneous or combined instance and feature selection for Nearest Neighbor classifiers in a deterministic way. This paper proposes a novel deterministic feature and instance selection algorithm, which uses the recently introduced Minimum Neighborhood Rough Sets as basis for the selection process. The algorithm relies on a metadata computation to guide instance selection. The proposed algorithm deals with mixed and incomplete data and arbitrarily dissimilarity functions. Numerical experiments over repository databases were carried out to compare the proposal with respect to previous methods and to the classifier using the original sample. These experiments show the proposal has a good performance according to classifier accuracy and instance and feature reduction.