Linear Programming Boosting via Column Generation
Machine Learning
A robust minimax approach to classification
The Journal of Machine Learning Research
Support Vector Machines for Pattern Classification
Support Vector Machines for Pattern Classification
Scalable large-margin Mahalanobis distance metric learning
IEEE Transactions on Neural Networks
Training of support vector machines with Mahalanobis kernels
ICANN'05 Proceedings of the 15th international conference on Artificial neural networks: formal models and their applications - Volume Part II
Weighted Mahalanobis Distance Kernels for Support Vector Machines
IEEE Transactions on Neural Networks
Structural Regularized Support Vector Machine: A Framework for Structural Large Margin Classifier
IEEE Transactions on Neural Networks
| Hi-index | 0.00 |
The covariance matrix in the Mahalanobis distance can be trained by semi-definite programming, but training for a large size data set is inefficient. In this paper, we constrain the covariance matrix to be diagonal and train Mahalanobis kernels by linear programming (LP). Training can be formulated by ν-LP SVMs (support vector machines) or regular LP SVMs. We clarify the dependence of the solutions on the margin parameter. If a problem is not separable, a zero-margin solution, which does not appear in the LP SVM, appears in the ν-LP SVM. Therefore, we use the LP SVM for kernel training. Using the benchmark data sets we show that the proposed method gives better generalization ability than RBF (radial basis function) kernels and Mahalanobis kernels calculated using the training data and has a good capability of selecting input variables especially for a large number of input variables.