An adaptive error penalization method for training an efficient and generalized SVM

Authors:
Yiqiang Zhan;Dinggang Shen
Affiliations:
Section of Biomedical Image Analysis, Department of Radiology, University of Pennsylvania, Philadelphia, PA, USA and Department of Computer Science, The Johns Hopkins University, Baltimore, MD, US ...;Section of Biomedical Image Analysis, Department of Radiology, University of Pennsylvania, Philadelphia, PA, USA and Center for Computer-Integrated Surgical Systems and Technology, The Johns Hopki ...
Venue:
Pattern Recognition
Year:
2006

Citing 6
Cited 5

The nature of statistical learning theory

The nature of statistical learning theory
Texture Features for Browsing and Retrieval of Image Data

IEEE Transactions on Pattern Analysis and Machine Intelligence
A statistical learning learning model of text classification for support vector machines

Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval
A Tutorial on Support Vector Machines for Pattern Recognition

Data Mining and Knowledge Discovery
Training Support Vector Machines: an Application to Face Detection

CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
SVMTorch: support vector machines for large-scale regression problems

The Journal of Machine Learning Research

A rough margin based support vector machine

Information Sciences: an International Journal
Improving radial basis function kernel classification through incremental learning and automatic parameter selection

Neurocomputing
Wavelet kernel support vector machines forecasting techniques: Case study on water-level predictions during typhoons

Expert Systems with Applications: An International Journal
MR image segmentation using phase information and a novel multiscale scheme

MICCAI'06 Proceedings of the 9th international conference on Medical Image Computing and Computer-Assisted Intervention - Volume Part II
Self-advising support vector machine

Knowledge-Based Systems

Quantified Score

Hi-index	0.01

Visualization

Abstract

A novel training method has been proposed for increasing efficiency and generalization of support vector machine (SVM). The efficiency of SVM in classification is directly determined by the number of the support vectors used, which is often huge in the complicated classification problem in order to represent a highly convoluted separation hypersurface for better nonlinear classification. However, the separation hypersurface of SVM might be unnecessarily over-convoluted around extreme outliers, as these outliers can easily dominate the objective function of SVM. This situation eventually affects the efficiency and generalization of SVM in classifying unseen testing samples. To avoid this problem, we propose a novel objective function for SVM, i.e., an adaptive penalty term is designed to suppress the effects of extreme outliers, thus simplifying the separation hypersurface and increasing the classification efficiency. Since maximization of the margin distance of hypersurface is no longer dominated by those extreme outliers, our generated SVM tends to have a wider margin, i.e., better generalization ability. Importantly, as our designed objective function can be reformulated as a dual problem, similar to that of standard SVM, any existing SVM training algorithm can be borrowed for the training of our proposed SVM. The performances of our method have been extensively tested on the UCI machine learning repository, as well as a real clinical problem, i.e., tissue classification in prostate ultrasound images. Experimental results show that our method is able to simultaneously increase the classification efficiency and the generalization ability of the SVM.