Probabilistic support vector machines for classification of noise affected data

Authors:
Han-Xiong Li;Jing-Lin Yang;Geng Zhang;Bi Fan
Affiliations:
Department of Systems Eng. & Eng. Management, City University of Hong Kong, Hong Kong Special Administrative Region and School of Mechanical and Electrical Engineering, Central South University, C ...;Department of Systems Eng. & Eng. Management, City University of Hong Kong, Hong Kong Special Administrative Region and Guangzhou Branch of Extra High Voltage Power Transmission Company of China, ...;School of Mechanical and Electrical Engineering, Central South University, Changsha, China;Department of Systems Eng. & Eng. Management, City University of Hong Kong, Hong Kong Special Administrative Region
Venue:
Information Sciences: an International Journal
Year:
2013

Citing 25
Cited 3

Optimal control by least squares support vector machines

Neural Networks
A Tutorial on Support Vector Machines for Pattern Recognition

Data Mining and Knowledge Discovery
Bayesian Methods for Support Vector Machines: Evidence and Predictive Class Probabilities

Machine Learning
A Probabilistic Framework for SVM Regression and Error Bar Estimation

Machine Learning
Pattern Classification (2nd Edition)

Pattern Classification (2nd Edition)
Probability Product Kernels

The Journal of Machine Learning Research
Systematic benchmarking of microarray data classification: assessing the role of non-linearity and dimensionality reduction

Bioinformatics
Hybridizing mixtures of experts with support vector machines: Investigation into nonlinear dynamic systems identification

Information Sciences: an International Journal
Gini Support Vector Machine: Quadratic Entropy Based Robust Multi-Class Probability Regression

The Journal of Machine Learning Research
Induction of multiple fuzzy decision trees based on rough set technique

Information Sciences: an International Journal
Support vector regression from simulation data and few experimental samples

Information Sciences: an International Journal
Improving generalization of fuzzy IF-THEN rules by maximizing fuzzy entropy

IEEE Transactions on Fuzzy Systems
Exploiting uncertain data in support vector classification

KES'07/WIRN'07 Proceedings of the 11th international conference, KES 2007 and XVII Italian workshop on neural networks conference on Knowledge-based intelligent information and engineering systems: Part III
Knowledge based Least Squares Twin support vector machines

Information Sciences: an International Journal
Simultaneous feature selection and classification using kernel-penalized support vector machines

Information Sciences: an International Journal
A probabilistic SVM based decision system for pain diagnosis

Expert Systems with Applications: An International Journal
Evolution strategies based adaptive Lp LS-SVM

Information Sciences: an International Journal
A Probabilistic Wavelet System for Stochastic and Incomplete Data-Based Modeling

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
A new fuzzy support vector machine to evaluate credit risk

IEEE Transactions on Fuzzy Systems
A probabilistic fuzzy logic system for modeling and control

IEEE Transactions on Fuzzy Systems
A Probabilistic Neural-Fuzzy Learning System for Stochastic Modeling

IEEE Transactions on Fuzzy Systems
The evidence framework applied to support vector machines

IEEE Transactions on Neural Networks
Fuzzy support vector machines

IEEE Transactions on Neural Networks
Survey of clustering algorithms

IEEE Transactions on Neural Networks
Reduced Support Vector Machines: A Statistical Theory

IEEE Transactions on Neural Networks

A probabilistic SVM based decision system for pain diagnosis

Expert Systems with Applications: An International Journal
A proximal classifier with consistency

Knowledge-Based Systems
Traffic sign recognition using group sparse coding

Information Sciences: an International Journal

Quantified Score

Hi-index	0.07

Visualization

Abstract

The support vector machines (SVMs) have gained visibility and been thoroughly studied in the machine learning community. However, the performance of these machines is sensitive to noisy data and the machine may not be effective when the level of noise is high. Since the noise makes the separating margin of SVM to be a stochastic variable, a probabilistic support vector machine (PSVM) is proposed to capture the probabilistic information of the separating margin and formulate the decision function within such a noisy environment. First, all data are clustered, upon which different subsets are formed by PCA-based sampling; then, a distributed SVM system is constructed to estimate the separating margin for each subset. Next, a quadratic optimization problem is being solved with the use of probabilistic information extracted from separating margins to determine the decision function. Using the weighted average of probability of cluster centers, the confidence of the decision can be estimated. An artificial dataset and four real-life datasets from a UCI machine learning database are used to demonstrate the effectiveness of the proposed probabilistic SVM.