The study of leave-one-out error-based classification learning algorithm for generalization performance

Authors:
Bin Zou;Jie Xu;Luoqing Li
Affiliations:
Faculty of Mathematics and Computer Science, Hubei University, Wuhan, P.R. China;Faculty of Mathematics and Computer Science, Hubei University, Wuhan, P.R. China;Faculty of Mathematics and Computer Science, Hubei University, Wuhan, P.R. China
Venue:
ICNC'06 Proceedings of the Second international conference on Advances in Natural Computation - Volume Part I
Year:
2006

Citing 4
Cited 0

Scale-sensitive dimensions, uniform convergence, and learnability

Journal of the ACM (JACM)
Algorithmic stability and sanity-check bounds for leave-one-out cross-validation

Neural Computation
Stability and generalization

The Journal of Machine Learning Research
Almost-everywhere algorithmic stability and generalization error

UAI'02 Proceedings of the Eighteenth conference on Uncertainty in artificial intelligence

Quantified Score

Hi-index	0.00

Visualization

Abstract

This note mainly focuses on a theoretical analysis of the generalization ability of classification learning algorithm. The explicit bound is derived on the relative difference between the generalization error and leave-one-out error for classification learning algorithm under the condition of leave-one-out stability by using Markov's inequality, and then this bound is used to estimate the generalization error of classification learning algorithm. We compare the result in this paper with previous results in the end.