IKNN: Informative K-Nearest Neighbor Pattern Classification

Authors:
Yang Song;Jian Huang;Ding Zhou;Hongyuan Zha;C. Lee Giles
Affiliations:
Department of Computer Science and Engineering,;College of Information Sciences and Technology, The Pennsylvania State University, University Park, PA 16802, U.S.A.;Department of Computer Science and Engineering,;Department of Computer Science and Engineering, and College of Information Sciences and Technology, The Pennsylvania State University, University Park, PA 16802, U.S.A.;Department of Computer Science and Engineering, and College of Information Sciences and Technology, The Pennsylvania State University, University Park, PA 16802, U.S.A.
Venue:
PKDD 2007 Proceedings of the 11th European conference on Principles and Practice of Knowledge Discovery in Databases
Year:
2007

Citing 9
Cited 13

Discriminant Adaptive Nearest Neighbor Classification

IEEE Transactions on Pattern Analysis and Machine Intelligence
Improved boosting algorithms using confidence-rated predictions

COLT' 98 Proceedings of the eleventh annual conference on Computational learning theory
Locally Adaptive Metric Nearest-Neighbor Classification

IEEE Transactions on Pattern Analysis and Machine Intelligence
Toward an Ecplanatory Similarity Measure for Nearest-Neighbor Classification

ECML '00 Proceedings of the 11th European Conference on Machine Learning
Text Categorization Using Weight Adjusted k-Nearest Neighbor Classification

PAKDD '01 Proceedings of the 5th Pacific-Asia Conference on Knowledge Discovery and Data Mining
On the algorithmic implementation of multiclass kernel-based vector machines

The Journal of Machine Learning Research
Efficient Nearest Neighbor Classification Using a Cascade of Approximate Similarity Measures

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 1 - Volume 01
Boosting Nearest Neighbor Classi.ers for Multiclass Recognition

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops - Volume 03
SVM-KNN: Discriminative Nearest Neighbor Classification for Visual Category Recognition

CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2

Personal News RSS Feeds Generation Using Existing News Feeds

ICWE '9 Proceedings of the 9th International Conference on Web Engineering
A Pattern Classification Approach to DNA Microarray Image Segmentation

PRIB '09 Proceedings of the 4th IAPR International Conference on Pattern Recognition in Bioinformatics
Application of combined support vector machines in process fault diagnosis

ACC'09 Proceedings of the 2009 conference on American Control Conference
EEG: pattern classification during emotional picture processing

Proceedings of the 3rd International Conference on PErvasive Technologies Related to Assistive Environments
K nearest neighbor reinforced expectation maximization method

Expert Systems with Applications: An International Journal
Investigating a novel GA-based feature selection method using improved KNN classifiers

International Journal of Information and Communication Technology
Noisy data elimination using mutual k-nearest neighbor for classification mining

Journal of Systems and Software
Comparison of different EEG features in estimation of hypnosis susceptibility level

Computers in Biology and Medicine
Palmprint authentication using pattern classification techniques

SEMCCO'11 Proceedings of the Second international conference on Swarm, Evolutionary, and Memetic Computing - Volume Part I
The application of pattern recognition in the automatic classification of microscopic rock images

Computers & Geosciences
Class imbalance and the curse of minority hubs

Knowledge-Based Systems
Dynamic supervised classification method for online monitoring in non-stationary environments

Neurocomputing
A niching genetic programming-based multi-objective algorithm for hybrid data classification

Neurocomputing

Quantified Score

Hi-index	0.00

Visualization

Abstract

The K-nearest neighbor (KNN) decision rule has been a ubiquitous classification tool with good scalability. Past experience has shown that the optimal choice of Kdepends upon the data, making it laborious to tune the parameter for different applications. We introduce a new metric that measures the informativeness of objects to be classified. When applied as a query-based distance metric to measure the closeness between objects, two novel KNN procedures, Locally Informative-KNN (LI-KNN) and Globally Informative-KNN (GI-KNN), are proposed. By selecting a subset of most informative objects from neighborhoods, our methods exhibit stability to the change of input parameters, number of neighbors(K) and informative points (I). Experiments on UCI benchmark data and diverse real-world data sets indicate that our approaches are application-independent and can generally outperform several popular KNN extensions, as well as SVM and Boosting methods.