Bayes Error Estimation Using Parzen and k-NN Procedures

Authors:
K. Fukunaga;D. M. Hummels
Affiliations:
-;-
Venue:
IEEE Transactions on Pattern Analysis and Machine Intelligence
Year:
1987

Citing 0
Cited 16

Leave-One-Out Procedures for Nonparametric Error Estimates

IEEE Transactions on Pattern Analysis and Machine Intelligence
The Reduced Parzen Classifier

IEEE Transactions on Pattern Analysis and Machine Intelligence
Small Sample Error Rate Estimation for k-NN Classifiers

IEEE Transactions on Pattern Analysis and Machine Intelligence
On the Behavior of Artificial Neural Network Classifiers in High-Dimensional Spaces

IEEE Transactions on Pattern Analysis and Machine Intelligence
Orthogonal Moment Features for Use With Parametric and Non-Parametric Classifiers

IEEE Transactions on Pattern Analysis and Machine Intelligence
Toward Bayes-Optimal Linear Dimension Reduction

IEEE Transactions on Pattern Analysis and Machine Intelligence
A New Approximation Method of the Quadratic Discriminant Function

Proceedings of the Joint IAPR International Workshops on Advances in Pattern Recognition
Partition based pattern synthesis technique with efficient algorithms for nearest neighbor classification

Pattern Recognition Letters
A discriminant analysis using composite features for classification problems

Pattern Recognition
A vision-based method for weeds identification through the Bayesian decision theory

Pattern Recognition
On Classifying Disease-Induced Patterns in the Brain Using Diffusion Tensor Images

MICCAI '08 Proceedings of the 11th international conference on Medical Image Computing and Computer-Assisted Intervention - Part I
On combining classifiers through a fuzzy multicriteria decision making approach: Applied to natural textured images

Expert Systems with Applications: An International Journal
An Approximation Method of the Quadratic Discriminant Function and Its Application to Estimation of High-Dimensional Distribution

IEICE - Transactions on Information and Systems
A class discriminality measure based on feature space partitioning

Pattern Recognition
Overlap pattern synthesis with an efficient nearest neighbor classifier

Pattern Recognition
Pattern classification using composite features

ICANN'06 Proceedings of the 16th international conference on Artificial Neural Networks - Volume Part II

Quantified Score

Hi-index	0.15

Visualization

Abstract

The use of k nearest neighbor (k-NN) and Parzen density estimates to obtain estimates of the Bayes error is investigated under limited design set conditions. By drawing analogies between the k-NN and Parzen procedures, new procedures are suggested, and experimental results are given which indicate that these procedures yield a significant improvement over the conventional k-NN and Parzen procedures. We show that, by varying the decision threshold, many of the biases associated with the k-NN or Parzen density estimates may be compensated, and successful error estimation may be performed in spite of these biases. Experimental results are given which demonstrate the effect of kernel size and shape (Parzen), the size of k (k-NN), and the number of samples in the design set.