Improving nearest neighbor classification using particle swarm optimization with novel fitness function

Authors:
Ali Adeli;Ahmad Ghorbani-Rad;M. Javad Zomorodian;Mehdi Neshat;Saeed Mozaffari
Affiliations:
Department of Computer Science and Engineering, Shiraz University, Shiraz, Iran, Institute of Computer Science, Bojnurd Darolfonoun Technical College, Bojnurd, Iran;Department of Computer Engineering and Information Technology, Qazvin Islamic Azad University, Qazvin, Iran;Department of Computer Science and Engineering, Shiraz University, Shiraz, Iran, Institute of Computer Science, Shiraz Bahonar Technical College, Shiraz, Iran;Department of Computer Science, Shirvan Branch, Islamic Azad University, Shirvan, Iran;Department of Electrical and Computer Engineering, Semnan University, Semnan, Iran
Venue:
ICCCI'12 Proceedings of the 4th international conference on Computational Collective Intelligence: technologies and applications - Volume Part II
Year:
2012

Citing 3
Cited 0

Text Categorization Using Weight Adjusted k-Nearest Neighbor Classification

PAKDD '01 Proceedings of the 5th Pacific-Asia Conference on Knowledge Discovery and Data Mining
Simultaneous feature selection and feature weighting using Hybrid Tabu Search/K-nearest neighbor classifier

Pattern Recognition Letters
Improving nearest neighbor classification by elimination of noisy irrelevant features

ACIIDS'12 Proceedings of the 4th Asian conference on Intelligent Information and Database Systems - Volume Part II

Quantified Score

Hi-index	0.00

Visualization

Abstract

A new method of feature selection is presented in this paper. The proposed idea uses Particle Swarm Optimization (PSO) with fitness function in order to assign higher weights to informative features while noisy irrelevant features are given low weights. The measure of Area Under the receiver operating characteristics Curve (AUC) is used as the fitness function of the particles. Experimental results claim that the PSO-based feature weighting can improve the classification performance of the k-NN algorithm in comparison with the other important method in realm of feature weighting such as Mutual Information, Genetic Algorithm, Tabu Search and chi-squared (χ2). Additionally, on synthetic data sets, this method is able to allocate very low weight to the noisy irrelevant features which may be considered as the eliminated features from the data set.