Combined SVM-Based Feature Selection and Classification

Authors:
Julia Neumann;Christoph Schnörr;Gabriele Steidl
Affiliations:
Department of Mathematics and Computer Science, University of Mannheim, Mannheim, Germany D-68131;Department of Mathematics and Computer Science, University of Mannheim, Mannheim, Germany D-68131;Department of Mathematics and Computer Science, University of Mannheim, Mannheim, Germany D-68131
Venue:
Machine Learning
Year:
2005

Citing 11
Cited 45

A D. C. Optimization Algorithm for Solving the Trust-Region Subproblem

SIAM Journal on Optimization
Penalty/Barrier Multiplier Methods for Convex Programming Problems

SIAM Journal on Optimization
Feature Selection via Concave Minimization and Support Vector Machines

ICML '98 Proceedings of the Fifteenth International Conference on Machine Learning
Feature Selection and Dualities in Maximum Entropy Discrimination

UAI '00 Proceedings of the 16th Conference on Uncertainty in Artificial Intelligence
The concave-convex procedure

Neural Computation
Mathematical programming approaches to machine learning and data mining

Mathematical programming approaches to machine learning and data mining
An introduction to variable and feature selection

The Journal of Machine Learning Research
Use of the zero norm with linear models and kernel methods

The Journal of Machine Learning Research
Pattern Classification (2nd Edition)

Pattern Classification (2nd Edition)
Multiple kernel learning, conic duality, and the SMO algorithm

ICML '04 Proceedings of the twenty-first international conference on Machine learning
Support vector machines for histogram-based image classification

IEEE Transactions on Neural Networks

Direct convex relaxations of sparse SVM

Proceedings of the 24th international conference on Machine learning
Supervised feature selection via dependence estimation

Proceedings of the 24th international conference on Machine learning
Hybrid attribute reduction based on a novel fuzzy-rough model and information granulation

Pattern Recognition
Neighborhood classifiers

Expert Systems with Applications: An International Journal
Feature selection via sensitivity analysis of SVM probabilistic outputs

Machine Learning
Mixed feature selection based on granulation and approximation

Knowledge-Based Systems
Neighborhood rough set based heterogeneous feature subset selection

Information Sciences: an International Journal
An Information Criterion for Variable Selection in Support Vector Machines

The Journal of Machine Learning Research
An efficient kernel matrix evaluation measure

Pattern Recognition
Parameter determination of support vector machine and feature selection using simulated annealing approach

Applied Soft Computing
Crop classification by support vector machine with intelligently selected training data for an operational application

International Journal of Remote Sensing
Feature selection with dynamic mutual information

Pattern Recognition
Non-monotonic feature selection

ICML '09 Proceedings of the 26th Annual International Conference on Machine Learning
Efficient linearization of tree kernel functions

CoNLL '09 Proceedings of the Thirteenth Conference on Computational Natural Language Learning
Kernel matrix evaluation

IJCAI'07 Proceedings of the 20th international joint conference on Artifical intelligence
A rough set approach to feature selection based on ant colony optimization

Pattern Recognition Letters
Feature Selection via Maximizing Neighborhood Soft Margin

ACML '09 Proceedings of the 1st Asian Conference on Machine Learning: Advances in Machine Learning
Reverse engineering of tree kernel feature spaces

EMNLP '09 Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: Volume 1 - Volume 1
Selecting discrete and continuous features based on neighborhood decision error minimization

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
SpliceIT: A hybrid method for splice signal identification based on probabilistic and biological inference

Journal of Biomedical Informatics
Feature evaluation and selection based on neighborhood soft margin

Neurocomputing
Feature selection for SVM via optimization of kernel polarization with Gaussian ARD kernels

Expert Systems with Applications: An International Journal
Discriminative semi-supervised feature selection via manifold regularization

IEEE Transactions on Neural Networks
On reverse feature engineering of syntactic tree kernels

CoNLL '10 Proceedings of the Fourteenth Conference on Computational Natural Language Learning
Simultaneous feature selection and classification using kernel-penalized support vector machines

Information Sciences: an International Journal
Neighborhood based sample and feature selection for SVM classification learning

Neurocomputing
Operators for transforming kernels into quasi-local kernels that improve SVM accuracy

Journal of Intelligent Information Systems
Feature selection using support vector machines and bootstrap methods for ventricular fibrillation detection

Expert Systems with Applications: An International Journal
Combined Feature Selection and Cancer Prognosis Using Support Vector Machine Regression

IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB)
Comprehending and transferring facial expressions based on statistical shape and texture models

CGI'06 Proceedings of the 24th international conference on Advances in Computer Graphics
Embedded feature selection for support vector machines: state-of-the-art and future challenges

CIARP'11 Proceedings of the 16th Iberoamerican Congress conference on Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications
Should we search for a global minimizer of least squares regularized with an ℓ0 penalty to get the exact solution of an under determined linear system?

SSVM'11 Proceedings of the Third international conference on Scale Space and Variational Methods in Computer Vision
A DC programming approach for solving the symmetric Eigenvalue Complementarity Problem

Computational Optimization and Applications
A proof of convergence of the concave-convex procedure using zangwill's theory

Neural Computation
Parameterized attribute reduction with Gaussian kernel based fuzzy rough sets

Information Sciences: an International Journal
Feature selection via dependence maximization

The Journal of Machine Learning Research
A general lp-norm support vector machine via mixed 0-1 programming

MLDM'12 Proceedings of the 8th international conference on Machine Learning and Data Mining in Pattern Recognition
Feature selection by block addition and block deletion

ANNPR'12 Proceedings of the 5th INNS IAPR TC 3 GIRPR conference on Artificial Neural Networks in Pattern Recognition
Feature Based Rule Learner in Noisy Environment Using Neighbourhood Rough Set Model

International Journal of Software Science and Computational Intelligence
Optimizing the Gaussian kernel function with the formulated kernel target alignment criterion for two-class pattern classification

Pattern Recognition
Sparse high-dimensional fractional-norm support vector machine via DC programming

Computational Statistics & Data Analysis
Robust feature selection for SVMs under uncertain data

ICDM'13 Proceedings of the 13th international conference on Advances in Data Mining: applications and theoretical aspects
DCA based algorithms for feature selection in semi-supervised support vector machines

MLDM'13 Proceedings of the 9th international conference on Machine Learning and Data Mining in Pattern Recognition
White box radial basis function classifiers with component selection for clinical prediction models

Artificial Intelligence in Medicine
A survey on feature selection methods

Computers and Electrical Engineering

Quantified Score

Hi-index	0.00

Visualization

Abstract

Feature selection is an important combinatorial optimisation problem in the context of supervised pattern classification. This paper presents four novel continuous feature selection approaches directly minimising the classifier performance. In particular, we include linear and nonlinear Support Vector Machine classifiers. The key ideas of our approaches are additional regularisation and embedded nonlinear feature selection. To solve our optimisation problems, we apply difference of convex functions programming which is a general framework for non-convex continuous optimisation. Experiments with artificial data and with various real-world problems including organ classification in computed tomography scans demonstrate that our methods accomplish the desired feature selection and classification performance simultaneously.