SSVM: A Smooth Support Vector Machine for Classification

Authors:
Yuh-Jye Lee;O. L. Mangasarian
Affiliations:
Computer Sciences Department, University of Wisconsin, 1210 West Dayton Street, Madison, Wisconsin 53706 USA. yuh-jye@cs.wisc.edu;Computer Sciences Department, University of Wisconsin, 1210 West Dayton Street, Madison, Wisconsin 53706 USA. olvi@cs.wisc.edu
Venue:
Computational Optimization and Applications
Year:
2001

Citing 15
Cited 68

The nature of statistical learning theory

The nature of statistical learning theory
Parallel Gradient Distribution in Unconstrained Optimization

SIAM Journal on Control and Optimization
Smoothing methods for convex inequalities and linear complementarity problems

Mathematical Programming: Series A and B
A class of smoothing functions for nonlinear and mixed complementarity problems

Computational Optimization and Applications
Global and superlinear convergence of the smoothing Newton method and its application to general box constrained variational inequalities

Mathematics of Computation
Solving the quadratic programming problem arising in support vector classification

Advances in kernel methods
Making large-scale support vector machine learning practical

Advances in kernel methods
Fast training of support vector machines using sequential minimal optimization

Advances in kernel methods
On Homotopy-Smoothing Methods for Box-Constrained Variational Inequalities

SIAM Journal on Control and Optimization
Learning from Data: Concepts, Theory, and Methods

Learning from Data: Concepts, Theory, and Methods
Smooth Approximations to Nonlinear Complementarity Problems

SIAM Journal on Optimization
A Tutorial on Support Vector Machines for Pattern Recognition

Data Mining and Knowledge Discovery
Feature Selection via Concave Minimization and Support Vector Machines

ICML '98 Proceedings of the Fifteenth International Conference on Machine Learning
Numerical Methods for Unconstrained Optimization and Nonlinear Equations (Classics in Applied Mathematics, 16)

Numerical Methods for Unconstrained Optimization and Nonlinear Equations (Classics in Applied Mathematics, 16)
Successive overrelaxation for support vector machines

IEEE Transactions on Neural Networks

Proximal support vector machine classifiers

Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining
Data mining with sparse grids using simplicial basis functions

Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining
Data mining with sparse grids

Computing
Survival-Time Classification of Breast Cancer Patients

Computational Optimization and Applications
Shrinkage estimator generalizations of Proximal Support Vector Machines

Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining
A tutorial on support vector regression

Statistics and Computing
Multicategory Proximal Support Vector Machine Classifiers

Machine Learning
Supervised versus multiple instance learning: an empirical comparison

ICML '05 Proceedings of the 22nd international conference on Machine learning
Convex Kernel Underestimation of Functions with Multiple Local Minima

Computational Optimization and Applications
Classification using a sparse combination of basis functions

Acta Cybernetica
Training a Support Vector Machine in the Primal

Neural Computation
Smoothed penalty algorithms for optimization of nonlinear models

Computational Optimization and Applications
The optimal design of weighted order statistics filters by using support vector machines

EURASIP Journal on Applied Signal Processing
Semismooth Newton support vector machine

Pattern Recognition Letters
A two-level approach to choose the cost parameter in support vector machines

Expert Systems with Applications: An International Journal
Application of smoothing technique on twin support vector machines

Pattern Recognition Letters
Oblique Support Vector Machines

Informatica
Simulation of Time Series Prediction Based on Smooth Support Vector Regression

ISNN '07 Proceedings of the 4th international symposium on Neural Networks: Advances in Neural Networks, Part III
Fast Optimization Methods for L1 Regularization: A Comparative Study and Two New Approaches

ECML '07 Proceedings of the 18th European conference on Machine Learning
Letters: On the stability and bias-variance analysis of sparse SVMs

Neurocomputing
An algebraic characterization of the optimum of regularized kernel methods

Machine Learning
An application of a new meta-heuristic for optimizing the classification accuracy when analyzing some medical datasets

Expert Systems with Applications: An International Journal
Game bot identification based on manifold learning

Proceedings of the 7th ACM SIGCOMM Workshop on Network and System Support for Games
Variant of Gaussian kernel and parameter setting method for nonlinear SVM

Neurocomputing
Newton's method for nonparallel plane proximal classifier with unity norm hyperplanes

Signal Processing
Multiclass support vector classification via coding and regression

Neurocomputing
A Quasi-Newton Approach to Nonsmooth Convex Optimization Problems in Machine Learning

The Journal of Machine Learning Research
The minimum redundancy-maximum relevance approach to building sparse support vector machines

IDEAL'09 Proceedings of the 10th international conference on Intelligent data engineering and automated learning
Privacy-preserving outsourcing support vector machines with random transformation

Proceedings of the 16th ACM SIGKDD international conference on Knowledge discovery and data mining
On Lagrangian support vector regression

Expert Systems with Applications: An International Journal
A meta-heuristic approach for improving the accuracy in some classification algorithms

Computers and Operations Research
Noise reduction for instance-based learning with a local maximal margin approach

Journal of Intelligent Information Systems
A hybrid model combining case-based reasoning and fuzzy decision tree for medical data classification

Applied Soft Computing
Primal twin support vector regression and its sparse approximation

Neurocomputing
Robust 1-norm soft margin smooth support vector machine

IDEAL'10 Proceedings of the 11th international conference on Intelligent data engineering and automated learning
Trajectory based behavior analysis for user verification

IDEAL'10 Proceedings of the 11th international conference on Intelligent data engineering and automated learning
A new smooth support vector machine

AICI'10 Proceedings of the 2010 international conference on Artificial intelligence and computational intelligence: Part I
A novel framework for multi-class classification via ternary smooth support vector machine

Pattern Recognition
Smooth Bayesian kernel machines

ICANN'05 Proceedings of the 15th international conference on Artificial neural networks: formal models and their applications - Volume Part II
SBAD: sequence based attack detection via sequence comparison

PSDML'10 Proceedings of the international ECML/PKDD conference on Privacy and security issues in data mining and machine learning
TPMSVM: A novel twin parametric-margin support vector machine for pattern recognition

Pattern Recognition
Kernel machines for epilepsy diagnosis via EEG signal classification: A comparative study

Artificial Intelligence in Medicine
An RSVM based two-teachers-one-student semi-supervised learning algorithm

Neural Networks
Exact semismooth newton SVM

ICNC'06 Proceedings of the Second international conference on Advances in Natural Computation - Volume Part I
Addressing image variability while learning classifiers for detecting clusters of micro-calcifications

IWDM'06 Proceedings of the 8th international conference on Digital Mammography
A smoothing support vector machine based on exact penalty function

CIS'05 Proceedings of the 2005 international conference on Computational Intelligence and Security - Volume Part I
A new smooth support vector machine

CIS'05 Proceedings of the 2005 international conference on Computational Intelligence and Security - Volume Part I
Model trees for classification of hybrid data types

IDEAL'05 Proceedings of the 6th international conference on Intelligent Data Engineering and Automated Learning
Semi-supervised image classification for automatic construction of a health image library

Proceedings of the 2nd ACM SIGHIT International Health Informatics Symposium
A smoothing multiple support vector machine model

ISNN'06 Proceedings of the Third international conference on Advances in Neural Networks - Volume Part I
A new expert system for diabetes disease diagnosis using modified spline smooth support vector machine

ICCSA'10 Proceedings of the 2010 international conference on Computational Science and Its Applications - Volume Part IV
A new smooth support vector regression based on ε-insensitive logistic loss function

ICNC'05 Proceedings of the First international conference on Advances in Natural Computation - Volume Part I
A polynomial smooth support vector machine for classification

ADMA'05 Proceedings of the First international conference on Advanced Data Mining and Applications
Simplify decision function of reduced support vector machines

MICAI'05 Proceedings of the 4th Mexican international conference on Advances in Artificial Intelligence
A review of optimization methodologies in support vector machines

Neurocomputing
Inverse matrix-free incremental proximal support vector machine

Decision Support Systems
An attribute weight assignment and particle swarm optimization algorithm for medical database classifications

Computer Methods and Programs in Biomedicine
Trajectory analysis for user verification and recognition

Knowledge-Based Systems
Fast opposite maps: an iterative SOM-Based method for building reduced-set SVMs

IDEAL'12 Proceedings of the 13th international conference on Intelligent Data Engineering and Automated Learning
Review: Supervised classification and mathematical optimization

Computers and Operations Research
A sequential algorithm for sparse support vector classifiers

Pattern Recognition
A GA-based model selection for smooth twin parametric-margin support vector machine

Pattern Recognition
Lagrangian support vector regression via unconstrained convex minimization

Neural Networks
An inexact smoothing-type algorithm for support vector machines

Neurocomputing
Finite Newton method for implicit Lagrangian support vector regression

International Journal of Knowledge-based and Intelligent Engineering Systems
Smooth Newton method for implicit Lagrangian twin support vector regression

International Journal of Knowledge-based and Intelligent Engineering Systems
Smooth support vector learning for fuzzy rule-based classification systems

Intelligent Data Analysis
TS-fuzzy modeling based on ε-insensitive smooth support vector regression

Journal of Intelligent & Fuzzy Systems: Applications in Engineering and Technology

Quantified Score

Hi-index	0.00

Visualization

Abstract

Smoothing methods, extensively used for solving important mathematical programming problems and applications, are applied here to generate and solve an unconstrained smooth reformulation of the support vector machine for pattern classification using a completely arbitrary kernel. We term such reformulation a smooth support vector machine (SSVM). A fast Newton–Armijo algorithm for solving the SSVM converges globally and quadratically. Numerical results and comparisons are given to demonstrate the effectiveness and speed of the algorithm. On six publicly available datasets, tenfold cross validation correctness of SSVM was the highest compared with four other methods as well as the fastest. On larger problems, SSVM was comparable or faster than SVMlight (T. Joachims, in Advances in Kernel Methods—Support Vector Learning, MIT Press: Cambridge, MA, 1999), SOR (O.L. Mangasarian and David R. Musicant, IEEE Transactions on Neural Networks, vol. 10, pp. 1032–1037, 1999) and SMO (J. Platt, in Advances in Kernel Methods—Support Vector Learning, MIT Press: Cambridge, MA, 1999). SSVM can also generate a highly nonlinear separating surface such as a checkerboard.