Sided and symmetrized Bregman centroids
IEEE Transactions on Information Theory
The Journal of Machine Learning Research
Multi-class leveraged k-NN for image classification
ACCV'10 Proceedings of the 10th Asian conference on Computer vision - Volume Part III
Leveraging k-NN for generic classification boosting
Neurocomputing
Boosting k-NN for Categorization of Natural Scenes
International Journal of Computer Vision
Boosting nearest neighbors for the efficient estimation of posteriors
ECML PKDD'12 Proceedings of the 2012 European conference on Machine Learning and Knowledge Discovery in Databases - Volume Part I
Information-geometric lenses for multiple foci+contexts interfaces
SIGGRAPH Asia 2013 Technical Briefs
Hi-index | 0.20 |
Bartlett et al. (2006) recently proved that a ground condition for surrogates, classification calibration, ties up their consistent minimization to that of the classification risk, and left as an important problem the algorithmic questions about their minimization. In this paper, we address this problem for a wide set which lies at the intersection of classification calibrated surrogates and those of Murata et al. (2004). This set coincides with those satisfying three common assumptions about surrogates. Equivalent expressions for the members—sometimes well known—follow for convex and concave surrogates, frequently used in the induction of linear separators and decision trees. Most notably, they share remarkable algorithmic features: for each of these two types of classifiers, we give a minimization algorithm provably converging to the minimum of any such surrogate. While seemingly different, we show that these algorithms are offshoots of the same “master” algorithm. This provides a new and broad unified account of different popular algorithms, including additive regression with the squared loss, the logistic loss, and the top-down induction performed in CART, C4.5. Moreover, we show that the induction enjoys the most popular boosting features, regardless of the surrogate. Experiments are provided on 40 readily available domains.