A simple additive re-weighting strategy for improving margins

  • Authors:
  • Fabio Aiolli;Alessandro Sperduti

  • Affiliations:
  • Department of Computer Science, Pisa, Italy;Department of Computer Science, Pisa, Italy

  • Venue:
  • IJCAI'01 Proceedings of the 17th international joint conference on Artificial intelligence - Volume 2
  • Year:
  • 2001

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present a sample re-weighting scheme inspired by recent results in margin theory. The basic idea is to add to the training set replicas of samples which are not classified with a sufficient margin. We prove the convergence of the input distribution obtained in this way. As study case, we consider an instance of the scheme involving a 1-NN classifier implementing a Vector Quantization algorithm that accommodates tangent distance models. The tangent distance models created in this way have shown a significant improvement in generalization power with respect to the standard tangent models. More-over, the obtained models were able to outperform state of the art algorithms, such as SVM.