Training ν-Support Vector Classifiers: Theory and Algorithms

Authors:
Chih-Chung Chang;Chih-Jen Lin
Affiliations:
Department of Computer Science and Information Engineering, National Taiwan University, Taipei 106, Taiwan;Department of Computer Science and Information Engineering, National Taiwan University, Taipei 106, Taiwan
Venue:
Neural Computation
Year:
2001

Citing 13
Cited 74

The nature of statistical learning theory

The nature of statistical learning theory
Machine learning, neural and statistical classification

Machine learning, neural and statistical classification
Making large-scale support vector machine learning practical

Advances in kernel methods
Fast training of support vector machines using sequential minimal optimization

Advances in kernel methods
Shrinking the tube: a new support vector regression algorithm

Proceedings of the 1998 conference on Advances in neural information processing systems II
A Simple Decomposition Method for Support Vector Machines

Machine Learning
The Kernel-Adatron Algorithm: A Fast and Simple Learning Procedure for Support Vector Machines

ICML '98 Proceedings of the Fifteenth International Conference on Machine Learning
Training Support Vector Machines: an Application to Face Detection

CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
Formulations of Support Vector Machines: A Note from an Optimization Point of View

Neural Computation
New Support Vector Algorithms

Neural Computation
Successive overrelaxation for support vector machines

IEEE Transactions on Neural Networks
A fast iterative nearest point algorithm for support vector machine classifier design

IEEE Transactions on Neural Networks
The analysis of decomposition methods for support vector machines

IEEE Transactions on Neural Networks

Training v-support vector regression: theory and algorithms

Neural Computation
Support vector machines for analog circuit performance representation

Proceedings of the 40th annual Design Automation Conference
Asymptotic behaviors of support vector machines with Gaussian kernel

Neural Computation
An effective Bayesian neural network classifier with a comparison study to support vector machine

Neural Computation
Discovering Compact and Highly Discriminative Features or Feature Combinations of Drug Activities Using Support Vector Machines

CSB '03 Proceedings of the IEEE Computer Society Conference on Bioinformatics
Classifying large data sets using SVMs with hierarchical clusters

Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining
Text classification from positive and unlabeled documents

CIKM '03 Proceedings of the twelfth international conference on Information and knowledge management
Classification of Gene Expression Profile Using Combinatory Method of Evolutionary Computation and Machine Learning

Genetic Programming and Evolvable Machines
A tutorial on support vector regression

Statistics and Computing
A generalized S-K algorithm for learning v-SVM classifiers

Pattern Recognition Letters
Feature Space Interpretation of SVMs with Indefinite Kernels

IEEE Transactions on Pattern Analysis and Machine Intelligence
Expressive speech-driven facial animation

ACM Transactions on Graphics (TOG)
Making SVMs Scalable to Large Data Sets using Hierarchical Cluster Indexing

Data Mining and Knowledge Discovery
An Efficient Support Vector Machine Learning Method with Second-Order Cone Programming for Large-Scale Problems

Applied Intelligence
Single-Class Classification with Mapping Convergence

Machine Learning
Identity verification through finger matching: A comparison of Support Vector Machines and Gaussian Basis Functions classifiers

Pattern Recognition Letters
Support vector classifiers via gradient systems with discontinuous righthand sides

Neural Networks
Enabling soft queries for data retrieval

Information Systems
Identity verification through finger matching: a comparison of support vector machines and Gaussian basis functions classifiers

Pattern Recognition Letters
Semi-automatic computer aided lesion detection in dental X-rays using variational level set

Pattern Recognition
Comments on the "Core Vector Machines: Fast SVM Training on Very Large Data Sets"

The Journal of Machine Learning Research
Semismooth Newton support vector machine

Pattern Recognition Letters
A general soft method for learning SVM classifiers with L1-norm penalty

Pattern Recognition
Cellular automata for simulating land use changes based on support vector machines

Computers & Geosciences
Prediction and dynamical reconstruction of non-stationary data with delay-coordinates embedding and support vector machine regression

NOLASC'05 Proceedings of the 4th WSEAS International Conference on Non-linear Analysis, Non-linear Systems and Chaos
General solution and learning method for binary classification with performance constraints

Pattern Recognition Letters
ν-support vector machine as conditional value-at-risk minimization

Proceedings of the 25th international conference on Machine learning
Support Vector Machinery for Infinite Ensemble Learning

The Journal of Machine Learning Research
On the Equivalence of the SMO and MDM Algorithms for SVM Training

ECML PKDD '08 Proceedings of the 2008 European Conference on Machine Learning and Knowledge Discovery in Databases - Part I
Augmenting learning function to Bayesian network inferences with maximum likelihood parameters

Expert Systems with Applications: An International Journal
Learning-Function-Augmented Inferences of Causalities Implied in Health Data

Advanced Web and NetworkTechnologies, and Applications
Data preparation for sample-based face detection

International Journal of Computer Applications in Technology
Rough ν-support vector regression

Expert Systems with Applications: An International Journal
Generalization performance of ν-support vector classifier based on conditional value-at-risk minimization

Neurocomputing
SVMC: single-class classification with support vector machines

IJCAI'03 Proceedings of the 18th international joint conference on Artificial intelligence
GNG-SVM framework: classifying large datasets with support vector machines using growing neural gas

IJCNN'09 Proceedings of the 2009 international joint conference on Neural Networks
Automatic clinical image segmentation using pathological modeling, PCA and SVM

Engineering Applications of Artificial Intelligence
A modified algorithm for nonconvex support vector classification

AIA '08 Proceedings of the 26th IASTED International Conference on Artificial Intelligence and Applications
On the simplification of an examples-based controller with support vector machines

Control and Intelligent Systems
Support vector machines of interval-based features for time series classification

Knowledge-Based Systems
Multi-Standard Quadratic Optimization: interior point methods and cone programming reformulation

Computational Optimization and Applications
Reducing samples for accelerating multikernel semiparametric support vector regression

Expert Systems with Applications: An International Journal
Learning in region-based image retrieval

CIVR'03 Proceedings of the 2nd international conference on Image and video retrieval
Generalized SMO-style decomposition algorithms

COLT'07 Proceedings of the 20th annual conference on Learning theory
A neural support vector machine

Neural Networks
Study on signal interpretation of GPR based on support vector machines

LSMS'07 Proceedings of the Life system modeling and simulation 2007 international conference on Bio-Inspired computational intelligence and applications
Hierarchical clustering support vector machines for classifying type-2 diabetes patients

ISBRA'08 Proceedings of the 4th international conference on Bioinformatics research and applications
An effective incremental algorithm for ν-support vector machine

IITA'09 Proceedings of the 3rd international conference on Intelligent information technology application
An effective regularization path for ν-support vector classification

IITA'09 Proceedings of the 3rd international conference on Intelligent information technology application
A combination of modified particle swarm optimization algorithm and support vector machine for pattern classification

IITA'09 Proceedings of the 3rd international conference on Intelligent information technology application
A modified support vector machine and its application to image segmentation

Image and Vision Computing
Large margin classifiers based on affine hulls

Neurocomputing
A vertical search engine based on visual and textual features

Edutainment'10 Proceedings of the Entertainment for education, and 5th international conference on E-learning and games
Decision making for contractor insurance deductible using the evolutionary support vector machines inference model

Expert Systems with Applications: An International Journal
LIBSVM: A library for support vector machines

ACM Transactions on Intelligent Systems and Technology (TIST)
L2-SVM: Dependence on the regularization parameter

Pattern Recognition and Image Analysis
An efficient intrusion detection system based on support vector machines and gradually feature removal method

Expert Systems with Applications: An International Journal
Learning "verb-object" concepts for semantic image annotation

MM '11 Proceedings of the 19th ACM international conference on Multimedia
Enabling Fast Brain-Computer Interaction by Single-Trial Extraction of Visual Evoked Potentials

Journal of Medical Systems
Evoked potentials estimation in brain-computer interface using support vector machine

RSKT'06 Proceedings of the First international conference on Rough Sets and Knowledge Technology
Training support vector machines with multiple equality constraints

ECML'05 Proceedings of the 16th European conference on Machine Learning
Infinite ensemble learning with support vector machines

ECML'05 Proceedings of the 16th European conference on Machine Learning
Accurate on-line ν-support vector learning

Neural Networks
Automatic clinical image segmentation using pathological modelling, PCA and SVM

MLDM'05 Proceedings of the 4th international conference on Machine Learning and Data Mining in Pattern Recognition
Clustering support vector machines and its application to local protein tertiary structure prediction

ICCS'06 Proceedings of the 6th international conference on Computational Science - Volume Part II
Rough margin based core vector machine

PAKDD'10 Proceedings of the 14th Pacific-Asia conference on Advances in Knowledge Discovery and Data Mining - Volume Part I
Modified matrix splitting method for the support vector machine and its application to the credit classification of companies in Korea

Expert Systems with Applications: An International Journal
Properties of the solution of L2-Support Vector Machine as a function of regularization parameter

Pattern Recognition and Image Analysis
On minimum distribution discrepancy support vector machine for domain adaptation

Pattern Recognition
Fast multi-label core vector machine

Pattern Recognition
A unified classification model based on robust optimization

Neural Computation
A view-invariant and anti-reflection algorithm for car body extraction and color classification

Multimedia Tools and Applications
Biologically relevant neural network architectures for support vector machines

Neural Networks
Image-based classification of protein subcellular location patterns in human reproductive tissue by ensemble learning global and local features

Neurocomputing

Quantified Score

Hi-index	0.01

Visualization

Abstract

The ν-support vector machine (ν-SVM) for classification proposed by Schölkopf, Smola, Williamson, and Bartlett (2000) has the advantage of using a parameter ν on controlling the number of support vectors. In this article, we investigate the relation between ν-SVM and C-SVM in detail. We show that in general they are two different problems with the same optimal solution set. Hence, we may expect that many numerical aspects of solving them are similar. However, compared to regular C-SVM, the formulation of ν-SVM is more complicated, so up to now there have been no effective methods for solving large-scale ν-SVM. We propose a decomposition method for ν-SVM that is competitive with existing methods for C-SVM. We also discuss the behavior of ν-SVM by some numerical experiments.