Using Kernel Basis with Relevance Vector Machine for Feature Selection

Authors:
Frédéric Suard;David Mercier
Affiliations:
CEA, LIST, Laboratoire Intelligence Multi-capteurs et Apprentissage, Gif sur Yvette, France F-91191;CEA, LIST, Laboratoire Intelligence Multi-capteurs et Apprentissage, Gif sur Yvette, France F-91191
Venue:
ICANN '09 Proceedings of the 19th International Conference on Artificial Neural Networks: Part II
Year:
2009

Citing 7
Cited 0

The nature of statistical learning theory

The nature of statistical learning theory
Structural Modelling with Sparse Kernels

Machine Learning
Kernel Matching Pursuit

Machine Learning
Constructing Descriptive and Discriminative Nonlinear Features: Rayleigh Coefficients in Kernel Feature Spaces

IEEE Transactions on Pattern Analysis and Machine Intelligence
Multiple kernel learning, conic duality, and the SMO algorithm

ICML '04 Proceedings of the twenty-first international conference on Machine learning
Hierarchic Bayesian models for kernel learning

ICML '05 Proceedings of the 22nd international conference on Machine learning
A Direct Method for Building Sparse Kernel Learning Algorithms

The Journal of Machine Learning Research

Quantified Score

Hi-index	0.01

Visualization

Abstract

This paper presents an application of multiple kernels like Kernel Basis to the Relevance Vector Machine algorithm. The framework of kernel machines has been a source of many works concerning the merge of various kernels to build the solution. Within these approaches, Kernel Basis is able to combine both local and global kernels. The interest of such approach resides in the ability to deal with a large kind of tasks in the field of model selection, for example the feature selection. We propose here an application of RVM-KB to a feature selection problem, for which all data are decomposed into a set of kernels so that all points of the learning set correspond to a single feature of one data. The final result is the selection of the main features through the relevance vectors selection.