Fast and Scalable Local Kernel Machines
The Journal of Machine Learning Research
Adaptive weighted fusion of local kernel classifiers for effective pattern classification
ICIC'11 Proceedings of the 7th international conference on Advanced Intelligent Computing
Learning from mistakes: towards a correctable learning algorithm
Proceedings of the 21st ACM international conference on Information and knowledge management
Universal consistency of localized versions of regularized kernel methods
The Journal of Machine Learning Research
Hi-index | 0.00 |
We show that all consistent learning methods---that is, that asymptotically achieve the lowest possible expected loss for any distribution on (X,Y)---are necessarily localizable, by which we mean that they do not significantly change their response at a particular point when we show them only the part of the training set that is close to that point. This is true in particular for methods that appear to be defined in a non-local manner, such as support vector machines in classification and least-squares estimators in regression. Aside from showing that consistency implies a specific form of localizability, we also show that consistency is logically equivalent to the combination of two properties: (1) a form of localizability, and (2) that the method's global mean (over the entire X distribution) correctly estimates the true mean. Consistency can therefore be seen as comprised of two aspects, one local and one global.