An improved incremental training algorithm for support vector machines using active query

Authors:
Shouxian Cheng;Frank Y. Shih
Affiliations:
Computer Vision Laboratory, College of Computing Sciences, New Jersey Institute of Technology, Newark, NJ 07102, USA;Computer Vision Laboratory, College of Computing Sciences, New Jersey Institute of Technology, Newark, NJ 07102, USA
Venue:
Pattern Recognition
Year:
2007

Citing 9
Cited 9

The nature of statistical learning theory

The nature of statistical learning theory
Support-Vector Networks

Machine Learning
A Tutorial on Support Vector Machines for Pattern Recognition

Data Mining and Knowledge Discovery
Less is More: Active Learning with Support Vector Machines

ICML '00 Proceedings of the Seventeenth International Conference on Machine Learning
Query Learning with Large Margin Classifiers

ICML '00 Proceedings of the Seventeenth International Conference on Machine Learning
Pattern Classification (2nd Edition)

Pattern Classification (2nd Edition)
A Probabilistic Active Support Vector Learning Algorithm

IEEE Transactions on Pattern Analysis and Machine Intelligence
Active learning using pre-clustering

ICML '04 Proceedings of the twenty-first international conference on Machine learning
Improved feature reduction in input and feature spaces

Pattern Recognition

A distance-based separator representation for pattern classification

Image and Vision Computing
Incremental support vector machine learning in the primal and applications

Neurocomputing
An incremental learning algorithm for Lagrangian support vector machines

Pattern Recognition Letters
An online core vector machine with adaptive MEB adjustment

Pattern Recognition
An incremental support vector machine-trained TS-type fuzzy system for online classification problems

Fuzzy Sets and Systems
Inconsistency-based active learning for support vector machines

Pattern Recognition
Three-parameter sequential minimal optimization for support vector machines

Neurocomputing
Inverse matrix-free incremental proximal support vector machine

Decision Support Systems
Granular support vector machine based on mixed measure

Neurocomputing

Quantified Score

Hi-index	0.01

Visualization

Abstract

In this paper, we present an improved incremental training algorithm for support vector machines (SVMs). Instead of selecting training samples randomly, we divide them into groups and apply the k-means clustering algorithm to collect the initial set of training samples. In active query, we assign a weight to each sample according to its confidence factor and its distance to the separating hyperplane. The confidence factor is calculated from the error upper bound of the SVM to indicate the closeness of the current hyperplane to the optimal hyperplane. A criterion is developed to eliminate non-informative training samples incrementally. Experimental results show our algorithm works successfully on artificial and real data, and is superior to the existing methods.