Generalization performance of support vector machines and other pattern classifiers
Advances in kernel methods
An introduction to support Vector Machines: and other kernel-based learning methods
An introduction to support Vector Machines: and other kernel-based learning methods
Structural risk minimization over data-dependent hierarchies
IEEE Transactions on Information Theory
Support vector machines are universally consistent
Journal of Complexity
Sparseness of support vector machines
The Journal of Machine Learning Research
On Robustness Properties of Convex Risk Minimization Methods for Pattern Recognition
The Journal of Machine Learning Research
Supervised Neural Gas with General Similarity Measure
Neural Processing Letters
Support Vector Machine Soft Margin Classifiers: Error Analysis
The Journal of Machine Learning Research
Iterative Kernel Principal Component Analysis for Image Modeling
IEEE Transactions on Pattern Analysis and Machine Intelligence
Kernel Methods for Measuring Independence
The Journal of Machine Learning Research
Multi-kernel regularized classifiers
Journal of Complexity
The Journal of Machine Learning Research
Learnability of Gaussians with Flexible Variances
The Journal of Machine Learning Research
Consistent Feature Selection for Pattern Recognition in Polynomial Time
The Journal of Machine Learning Research
On linear separability of data sets in feature space
Neurocomputing
Supervised feature selection via dependence estimation
Proceedings of the 24th international conference on Machine learning
A kernel-based causal learning algorithm
Proceedings of the 24th international conference on Machine learning
Competing with wild prediction rules
Machine Learning
Non-asymptotic calibration and resolution
Theoretical Computer Science
Tailoring density estimation via reproducing kernel moment matching
Proceedings of the 25th international conference on Machine learning
Sparse multiscale gaussian process regression
Proceedings of the 25th international conference on Machine learning
Bouligand Derivatives and Robustness of Support Vector Machines for Regression
The Journal of Machine Learning Research
Consistency of the Group Lasso and Multiple Kernel Learning
The Journal of Machine Learning Research
The square root law of steganographic capacity
Proceedings of the 10th ACM workshop on Multimedia and security
A Hilbert Space Embedding for Distributions
ALT '07 Proceedings of the 18th international conference on Algorithmic Learning Theory
Assessing Nonlinear Granger Causality from Multivariate Time Series
ECML PKDD '08 Proceedings of the European conference on Machine Learning and Knowledge Discovery in Databases - Part II
Sample Selection Bias Correction Theory
ALT '08 Proceedings of the 19th international conference on Algorithmic Learning Theory
Nonparametric Independence Tests: Space Partitioning and Kernel Approaches
ALT '08 Proceedings of the 19th international conference on Algorithmic Learning Theory
Aggregation of SVM Classifiers Using Sobolev Spaces
The Journal of Machine Learning Research
The Journal of Machine Learning Research
Challenges and techniques for effective and efficient similarity search in large video databases
Proceedings of the VLDB Endowment
Learning from dependent observations
Journal of Multivariate Analysis
Distribution-based similarity measures for multi-dimensional point set retrieval applications
MM '08 Proceedings of the 16th ACM international conference on Multimedia
Unsupervised Classifier Selection Based on Two-Sample Test
DS '08 Proceedings of the 11th International Conference on Discovery Science
Benchmarking for Steganography
Information Hiding
Pattern analysis for the prediction of fungal pro-peptide cleavage sites
Discrete Applied Mathematics
ICML '09 Proceedings of the 26th Annual International Conference on Machine Learning
From Intracardiac Electrograms to Electrocardiograms: Models and Metamodels
FIMH '09 Proceedings of the 5th International Conference on Functional Imaging and Modeling of the Heart
A kernel approach to comparing distributions
AAAI'07 Proceedings of the 22nd national conference on Artificial intelligence - Volume 2
Transfer learning via dimensionality reduction
AAAI'08 Proceedings of the 23rd national conference on Artificial intelligence - Volume 2
Fast kernel-based independent component analysis
IEEE Transactions on Signal Processing
Extended kernel recursive least squares algorithm
IEEE Transactions on Signal Processing
Domain adaptation via transfer component analysis
IJCAI'09 Proceedings of the 21st international jont conference on Artifical intelligence
Reproducing kernel banach spaces for machine learning
IJCNN'09 Proceedings of the 2009 international joint conference on Neural Networks
Support vector machine for functional data classification
Neurocomputing
A Least-squares Approach to Direct Importance Estimation
The Journal of Machine Learning Research
Reproducing Kernel Banach Spaces for Machine Learning
The Journal of Machine Learning Research
A graph embedding method for wireless sensor networks localization
GLOBECOM'09 Proceedings of the 28th IEEE conference on Global telecommunications
Consistent Nonparametric Tests of Independence
The Journal of Machine Learning Research
Hilbert Space Embeddings and Metrics on Probability Measures
The Journal of Machine Learning Research
Vector field learning via spectral filtering
ECML PKDD'10 Proceedings of the 2010 European conference on Machine learning and knowledge discovery in databases: Part I
On complexity issues of online learning algorithms
IEEE Transactions on Information Theory
Support Vector Machines with the Ramp Loss and the Hard Margin Loss
Operations Research
Neural Networks
Universality, Characteristic Kernels and RKHS Embedding of Measures
The Journal of Machine Learning Research
Operators for transforming kernels into quasi-local kernels that improve SVM accuracy
Journal of Intelligent Information Systems
Domain adaptation in regression
ALT'11 Proceedings of the 22nd international conference on Algorithmic learning theory
Measuring statistical dependence with hilbert-schmidt norms
ALT'05 Proceedings of the 16th international conference on Algorithmic Learning Theory
Non-asymptotic calibration and resolution
ALT'05 Proceedings of the 16th international conference on Algorithmic Learning Theory
Defensive forecasting for linear protocols
ALT'05 Proceedings of the 16th international conference on Algorithmic Learning Theory
Function classes that approximate the bayes risk
COLT'06 Proceedings of the 19th annual conference on Learning Theory
Competing with wild prediction rules
COLT'06 Proceedings of the 19th annual conference on Learning Theory
A method to construct the mapping to the feature space for the dot product kernels
ICMLC'05 Proceedings of the 4th international conference on Advances in Machine Learning and Cybernetics
On-Line regression competitive with reproducing kernel hilbert spaces
TAMC'06 Proceedings of the Third international conference on Theory and Applications of Models of Computation
Consistency of support vector machines using additive kernels for additive models
Computational Statistics & Data Analysis
The Journal of Machine Learning Research
Learning Rates for Regularized Classifiers Using Trigonometric Polynomial Kernels
Neural Processing Letters
Batch mode active sampling based on marginal probability distribution matching
Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining
On ranking and generalization bounds
The Journal of Machine Learning Research
Feature selection via dependence maximization
The Journal of Machine Learning Research
Multisource domain adaptation and its application to early detection of fatigue
ACM Transactions on Knowledge Discovery from Data (TKDD) - Special Issue on the Best of SIGKDD 2011
Benchmarking for steganography by kernel fisher discriminant criterion
Inscrypt'11 Proceedings of the 7th international conference on Information Security and Cryptology
Coherence functions with applications in large-margin classification methods
The Journal of Machine Learning Research
Batch Mode Active Sampling Based on Marginal Probability Distribution Matching
ACM Transactions on Knowledge Discovery from Data (TKDD) - Special Issue on ACM SIGKDD 2012
Border-sensitive learning in kernelized learning vector quantization
IWANN'13 Proceedings of the 12th international conference on Artificial Neural Networks: advances in computational intelligence - Volume Part I
Journal of Multivariate Analysis
Change-point detection with feature selection in high-dimensional time-series data
IJCAI'13 Proceedings of the Twenty-Third international joint conference on Artificial Intelligence
Computers & Mathematics with Applications
Domain adaptation and sample bias correction theory and algorithm for regression
Theoretical Computer Science
Hi-index | 0.07 |
In this article we study the generalization abilities of several classifiers of support vector machine (SVM) type using a certain class of kernels that we call universal. It is shown that the soft margin algorithms with universal kernels are consistent for a large class of classification problems including some kind of noisy tasks provided that the regularization parameter is chosen well. In particular we derive a simple sufficient condition for this parameter in the case of Gaussian RBF kernels. On the one hand our considerations are based on an investigation of an approximation property---the so-called universality---of the used kernels that ensures that all continuous functions can be approximated by certain kernel expressions. This approximation property also gives a new insight into the role of kernels in these and other algorithms. On the other hand the results are achieved by a precise study of the underlying optimization problems of the classifiers. Furthermore, we show consistency for the maximal margin classifier as well as for the soft margin SVM's in the presence of large margins. In this case it turns out that also constant regularization parameters ensure consistency for the soft margin SVM's. Finally we prove that even for simple, noise free classification problems SVM's with polynomial kernels can behave arbitrarily badly.