Learning the Kernel Function via Regularization

Authors:
Charles A. Micchelli;Massimiliano Pontil
Affiliations:
-;-
Venue:
The Journal of Machine Learning Research
Year:
2005

Citing 0
Cited 67

Multi-kernel regularized classifiers

Journal of Complexity
Feature space perspectives for learning the kernel

Machine Learning
Learning the kernel matrix by maximizing a KFD-based class separability criterion

Pattern Recognition
Kernel selection forl semi-supervised kernel machines

Proceedings of the 24th international conference on Machine learning
More efficiency in multiple kernel learning

Proceedings of the 24th international conference on Machine learning
Discriminant kernel and regularization parameter learning via semidefinite programming

Proceedings of the 24th international conference on Machine learning
A multiple kernel support vector machine scheme for feature selection and rule extraction from gene expression data of cancer tissue

Artificial Intelligence in Medicine
Classifier learning with a new locality regularization method

Pattern Recognition
Classifier learning with a new locality regularization method

Pattern Recognition
Learning dissimilarities by ranking: from SDP to QP

Proceedings of the 25th international conference on Machine learning
Multi-class Discriminant Kernel Learning via Convex Programming

The Journal of Machine Learning Research
Discriminatively regularized least-squares classification

Pattern Recognition
Credit Risk Evaluation Using Support Vector Machine with Mixture of Kernel

ICCS '07 Proceedings of the 7th international conference on Computational Science, Part II
Regularization Paths for ν-SVM and ν-SVR

ISNN '07 Proceedings of the 4th international symposium on Neural Networks: Advances in Neural Networks, Part III
Kernel-Based Inductive Transfer

ECML PKDD '08 Proceedings of the European conference on Machine Learning and Knowledge Discovery in Databases - Part II
Learning with sample dependent hypothesis spaces

Computers & Mathematics with Applications
Modeling adaptive kernels from probabilistic phylogenetic trees

Artificial Intelligence in Medicine
Error bounds of multi-graph regularized semi-supervised classification

Information Sciences: an International Journal
kFOIL: learning simple relational kernels

AAAI'06 Proceedings of the 21st national conference on Artificial intelligence - Volume 1
Class Prediction from Disparate Biological Data Sources Using an Iterative Multi-Kernel Algorithm

PRIB '09 Proceedings of the 4th IAPR International Conference on Pattern Recognition in Bioinformatics
Brain state decoding for rapid image retrieval

MM '09 Proceedings of the 17th ACM international conference on Multimedia
Extended kernel recursive least squares algorithm

IEEE Transactions on Signal Processing
Building sparse multiple-kernel SVM classifiers

IEEE Transactions on Neural Networks
Representation and feature selection using multiple kernel learning

IJCNN'09 Proceedings of the 2009 international joint conference on Neural Networks
Deterministic Error Analysis of Support Vector Regression and Related Regularized Kernel Methods

The Journal of Machine Learning Research
When Is There a Representer Theorem? Vector Versus Matrix Regularizers

The Journal of Machine Learning Research
Deriving the kernel from training data

MCS'07 Proceedings of the 7th international conference on Multiple classifier systems
Simultaneous tuning of hyperparameter and parameter for support vector machines

PAKDD'07 Proceedings of the 11th Pacific-Asia conference on Advances in knowledge discovery and data mining
A multiple kernel support vector machine scheme for simultaneous feature selection and rule-based classification

PAKDD'07 Proceedings of the 11th Pacific-Asia conference on Advances in knowledge discovery and data mining
Learning with kernels and logical representations

Probabilistic inductive logic programming
L2 regularization for learning kernels

UAI '09 Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence
Approximation of high-dimensional kernel matrices by multilevel circulant matrices

Journal of Complexity
Learning Translation Invariant Kernels for Classification

The Journal of Machine Learning Research
Regularizing multiple kernel learning using response surface methodology

Pattern Recognition
Rademacher chaos complexities for learning the kernel problem

Neural Computation
Solving structured sparsity regularization with proximal methods

ECML PKDD'10 Proceedings of the 2010 European conference on Machine learning and knowledge discovery in databases: Part II
Variable Sparsity Kernel Learning

The Journal of Machine Learning Research
An evolution strategy-based multiple kernels multi-criteria programming approach: The case of credit decision making

Decision Support Systems
Evolution strategies based adaptive Lp LS-SVM

Information Sciences: an International Journal
A new scheme to learn a kernel in regularization networks

Neurocomputing
Multiple-kernel SVM based multiple-task oriented data mining system for gene expression data analysis

Expert Systems with Applications: An International Journal
lp-Norm Multiple Kernel Learning

The Journal of Machine Learning Research
A Family of Simple Non-Parametric Kernel Learning Algorithms

The Journal of Machine Learning Research
Learning a Robust Relevance Model for Search Using Kernel Methods

The Journal of Machine Learning Research
Super-Linear Convergence of Dual Augmented Lagrangian Algorithm for Sparsity Regularized Estimation

The Journal of Machine Learning Research
Multiple Kernel Learning Algorithms

The Journal of Machine Learning Research
A kernel-based approach to exploiting interaction-networks in heterogeneous information sources for improved recommender systems

Proceedings of the 2nd International Workshop on Information Heterogeneity and Fusion in Recommender Systems
Generalized augmentation of multiple kernels

MCS'11 Proceedings of the 10th international conference on Multiple classifier systems
Structured Variable Selection with Sparsity-Inducing Norms

The Journal of Machine Learning Research
Learning bounds for support vector machines with learned kernels

COLT'06 Proceedings of the 19th annual conference on Learning Theory
Sampling and stability

MMCS'08 Proceedings of the 7th international conference on Mathematical Methods for Curves and Surfaces
Learning convex combinations of continuously parameterized basic kernels

COLT'05 Proceedings of the 18th annual conference on Learning Theory
Multi kernel learning with online-batch optimization

The Journal of Machine Learning Research
Algorithms for learning kernels based on centered alignment

The Journal of Machine Learning Research
Bound the learning rates with generalized gradients

WSEAS Transactions on Signal Processing
Multiple kernel learning with gaussianity measures

Neural Computation
A review of optimization methodologies in support vector machines

Neurocomputing
A meta-learning approach to the regularized learning-Case study: Blood glucose prediction

Neural Networks
A Bayesian approach to sparse dynamic network identification

Automatica (Journal of IFAC)
Distributed parametric and nonparametric regression with on-line performance bounds computation

Automatica (Journal of IFAC)
Learning the coordinate gradients

Advances in Computational Mathematics
An identity for kernel ridge regression

Theoretical Computer Science
Dynamic customer lifetime value prediction using longitudinal data: An improved multiple kernel SVR approach

Knowledge-Based Systems
On the convergence rate of lp-norm multiple kernel learning

The Journal of Machine Learning Research
Local scaling heuristic-based regularization for pattern classification

Neurocomputing
Learning bilinear model for matching queries and documents

The Journal of Machine Learning Research
Kernel regression with sparse metric learning

Journal of Intelligent & Fuzzy Systems: Applications in Engineering and Technology

Quantified Score

Hi-index	0.01

Visualization

Abstract

We study the problem of finding an optimal kernel from a prescribed convex set of kernels K for learning a real-valued function by regularization. We establish for a wide variety of regularization functionals that this leads to a convex optimization problem and, for square loss regularization, we characterize the solution of this problem. We show that, although K may be an uncountable set, the optimal kernel is always obtained as a convex combination of at most m+2 basic kernels, where m is the number of data examples. In particular, our results apply to learning the optimal radial kernel or the optimal dot product kernel.