Particle swarm optimization for parameter determination and feature selection of support vector machines

Authors:
Shih-Wei Lin;Kuo-Ching Ying;Shih-Chieh Chen;Zne-Jung Lee
Affiliations:
Information Management, Huafan University, Taiwan;Industrial Engineering and Management Information, Huafan University, Taiwan;Industrial Management, National Taiwan University of Science and Technology, Taiwan;Information Management, Huafan University, Taiwan
Venue:
Expert Systems with Applications: An International Journal
Year:
2008

Citing 15
Cited 51

The nature of statistical learning theory

The nature of statistical learning theory
Wrappers for feature subset selection

Artificial Intelligence - Special issue on relevance
Feature Selection for Knowledge Discovery and Data Mining

Feature Selection for Knowledge Discovery and Data Mining
On Comparing Classifiers: Pitfalls toAvoid and a Recommended Approach

Data Mining and Knowledge Discovery
A Tutorial on Support Vector Machines for Pattern Recognition

Data Mining and Knowledge Discovery
Asymptotic behaviors of support vector machines with Gaussian kernel

Neural Computation
A neural network model with bounded-weights for pattern classification

Computers and Operations Research
Data Mining: Concepts and Techniques

Data Mining: Concepts and Techniques
2005 Special Issue: Bayesian approach to feature selection and parameter tuning for support vector machine classifiers

Neural Networks - 2005 Special issue: IJCNN 2005
Support vector machines based on K-means clustering for real-time business intelligence systems

International Journal of Business Intelligence and Data Mining
Application of support vector machines to bandwidth reservation in sectored cellular communications

Engineering Applications of Artificial Intelligence
Automatic classification of auditory brainstem responses using SVM-based feature selection algorithm for threshold detection

Engineering Applications of Artificial Intelligence
Gene expression data analysis of human lymphoma using support vector machines and output coding ensembles

Artificial Intelligence in Medicine
An introduction to kernel-based learning algorithms

IEEE Transactions on Neural Networks
Support vector machine with adaptive parameters in financial time series forecasting

IEEE Transactions on Neural Networks

Use of particle swarm optimization for machinery fault detection

Engineering Applications of Artificial Intelligence
Using new attribute construction to incorporate the expertise of human experts into a smuggling vessels classification system

Expert Systems with Applications: An International Journal
The forecasting model based on wavelet ν-support vector machine

Expert Systems with Applications: An International Journal
Power load forecasts based on hybrid PSO with Gaussian and adaptive mutation and Wv-SVM

Expert Systems with Applications: An International Journal
Development of a hybrid methodology for dimensionality reduction in Mahalanobis-Taguchi system using Mahalanobis distance and binary particle swarm optimization

Expert Systems with Applications: An International Journal
Gaussian quantum-behaved particle swarm optimization approaches for constrained engineering design problems

Expert Systems with Applications: An International Journal
A hybrid-forecasting model based on Gaussian support vector machine and chaotic particle swarm optimization

Expert Systems with Applications: An International Journal
Parameter determination and feature selection for back-propagation network by particle swarm optimization

Knowledge and Information Systems
Model optimization of SVM for a fermentation soft sensor

Expert Systems with Applications: An International Journal
Regression application based on fuzzy ν-support vector machine in symmetric triangular fuzzy space

Expert Systems with Applications: An International Journal
Car assembly line fault diagnosis based on robust wavelet SVC and PSO

Expert Systems with Applications: An International Journal
Feature selection for SVM via optimization of kernel polarization with Gaussian ARD kernels

Expert Systems with Applications: An International Journal
Enhancing the classification accuracy by scatter-search-based ensemble approach

Applied Soft Computing
Tax forecasting theory and model based on SVM optimized by PSO

Expert Systems with Applications: An International Journal
GA-based method for feature selection and parameters optimization for machine learning regression applied to software effort estimation

Information and Software Technology
The forecasting model based on modified SVRM and PSO penalizing Gaussian noise

Expert Systems with Applications: An International Journal
Oil holdup prediction of oil-water two phase flow using thermal method based on multiwavelet transform and least squares support vector machine

Expert Systems with Applications: An International Journal
The model of rainfall forecasting by support vector regression based on particle swarm optimization algorithms

LSMS/ICSEE'10 Proceedings of the 2010 international conference on Life system modeling and simulation and intelligent computing, and 2010 international conference on Intelligent computing for sustainable energy and environment: Part II
Short term wind speed prediction based on evolutionary support vector regression algorithms

Expert Systems with Applications: An International Journal
Cauchy mutation for decision-making variable of Gaussian particle swarm optimization applied to parameters selection of SVM

Expert Systems with Applications: An International Journal
Feature selection and parameter optimization for support vector machines: A new approach based on genetic algorithm with feature chromosomes

Expert Systems with Applications: An International Journal
Cauchy mutation based on objective variable of Gaussian particle swarm optimization for parameters selection of SVM

Expert Systems with Applications: An International Journal
Hybrid forecasting model based on support vector machine and particle swarm optimization with adaptive and Cauchy mutation

Expert Systems with Applications: An International Journal
A probabilistic SVM based decision system for pain diagnosis

Expert Systems with Applications: An International Journal
Monthly streamflow forecasting based on improved support vector machine model

Expert Systems with Applications: An International Journal
A genetic algorithm-based approach to cost-sensitive bankruptcy prediction

Expert Systems with Applications: An International Journal
Chaos particle swarm optimization and T-S fuzzy modeling approaches to constrained predictive control

Expert Systems with Applications: An International Journal
A genetic algorithm for optimized feature selection with resource constraints in software product lines

Journal of Systems and Software
Leak detection of pipeline: An integrated approach of rough set theory and artificial bee colony trained SVM

Expert Systems with Applications: An International Journal
Vibrant fault diagnosis for hydroelectric generator units with a new combination of rough sets and support vector machine

Expert Systems with Applications: An International Journal
A hybrid stock selection model using genetic algorithms and support vector regression

Applied Soft Computing
A Biomedical Decision Support System Using LS-SVM Classifier with an Efficient and New Parameter Regularization Procedure for Diagnosis of Heart Valve Diseases

Journal of Medical Systems
Attribute selection method based on a hybrid BPNN and PSO algorithms

Applied Soft Computing
A novel algorithm applied to classify unbalanced data

Applied Soft Computing
Hybrid wavelet υ-support vector machine and chaotic particle swarm optimization for regression estimation

Expert Systems with Applications: An International Journal
Evolutionary feature selection via structure retention

Expert Systems with Applications: An International Journal
An intelligent algorithm with feature selection and decision rules applied to anomaly intrusion detection

Applied Soft Computing
Automatic detection of erythemato-squamous diseases using PSO-SVM based on association rules

Engineering Applications of Artificial Intelligence
Nonlinear regression in environmental sciences by support vector machines combined with evolutionary strategy

Computers & Geosciences
Hybrid of artificial immune system and particle swarm optimization-based support vector machine for Radio Frequency Identification-based positioning system

Computers and Industrial Engineering
Discrete Artificial Bee Colony Optimization Algorithm for Financial Classification Problems

International Journal of Applied Metaheuristic Computing
Adaptive SVM-Based classification systems based on the improved endocrine-based PSO algorithm

AMT'12 Proceedings of the 8th international conference on Active Media Technology
ECG arrhythmia classification based on optimum-path forest

Expert Systems with Applications: An International Journal
A hybrid PSO-FSVM model and its application to imbalanced classification of mammograms

ACIIDS'13 Proceedings of the 5th Asian conference on Intelligent Information and Database Systems - Volume Part I
Classification of EMG signals using PSO optimized SVM for diagnosis of neuromuscular disorders

Computers in Biology and Medicine
A hybrid-forecasting model reducing Gaussian noise based on the Gaussian support vector regression machine and chaotic particle swarm optimization

Information Sciences: an International Journal
Resampling methods for quality assessment of classifier performance and optimal number of features

Signal Processing
A loan default discrimination model using cost-sensitive support vector machine improved by PSO

Information Technology and Management
Least squares twin parametric-margin support vector machine for classification

Applied Intelligence
An improved quantum-behaved particle swarm optimization algorithm

Applied Intelligence
Feature subset selection using improved binary gravitational search algorithm

Journal of Intelligent & Fuzzy Systems: Applications in Engineering and Technology

Quantified Score

Hi-index	12.09

Visualization

Abstract

Support vector machine (SVM) is a popular pattern classification method with many diverse applications. Kernel parameter setting in the SVM training procedure, along with the feature selection, significantly influences the classification accuracy. This study simultaneously determines the parameter values while discovering a subset of features, without reducing SVM classification accuracy. A particle swarm optimization (PSO) based approach for parameter determination and feature selection of the SVM, termed PSO+SVM, is developed. Several public datasets are employed to calculate the classification accuracy rate in order to evaluate the developed PSO+SVM approach. The developed approach was compared with grid search, which is a conventional method of searching parameter values, and other approaches. Experimental results demonstrate that the classification accuracy rates of the developed approach surpass those of grid search and many other approaches, and that the developed PSO+SVM approach has a similar result to GA+SVM. Therefore, the PSO+SVM approach is valuable for parameter determination and feature selection in an SVM.