Neural networks and the bias/variance dilemma
Neural Computation
An introduction to Kolmogorov complexity and its applications
An introduction to Kolmogorov complexity and its applications
A Method of Combining Multiple Experts for the Recognition of Unconstrained Handwritten Numerals
IEEE Transactions on Pattern Analysis and Machine Intelligence
Machine Learning
IEEE Transactions on Pattern Analysis and Machine Intelligence
Bias/variance decompositions for likelihood-based estimators
Neural Computation
Making large-scale support vector machine learning practical
Advances in kernel methods
Improved Generalization Through Explicit Optimization of Margins
Machine Learning
Complexity Measures of Supervised Classification Problems
IEEE Transactions on Pattern Analysis and Machine Intelligence
Machine Learning
On Bias, Variance, 0/1—Loss, and the Curse-of-Dimensionality
Data Mining and Knowledge Discovery
Choosing Multiple Parameters for Support Vector Machines
Machine Learning
Variance and Bias for General Loss Functions
Machine Learning
A Unifeid Bias-Variance Decomposition and its Applications
ICML '00 Proceedings of the Seventeenth International Conference on Machine Learning
Bounds on the Generalization Performance of Kernel Machine Ensembles
ICML '00 Proceedings of the Seventeenth International Conference on Machine Learning
A Brief Introduction to Boosting
IJCAI '99 Proceedings of the Sixteenth International Joint Conference on Artificial Intelligence
A Unified Bias-Variance Decomposition for Zero-One and Squared Loss
Proceedings of the Seventeenth National Conference on Artificial Intelligence and Twelfth Conference on Innovative Applications of Artificial Intelligence
Reducing multiclass to binary: a unifying approach for margin classifiers
The Journal of Machine Learning Research
The Journal of Machine Learning Research
Solving multiclass learning problems via error-correcting output codes
Journal of Artificial Intelligence Research
Use of fuzzy-logic-inspired features to improve bacterialrecognition through classifier fusion
IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Machine Learning
Collaborative prediction using ensembles of Maximum Margin Matrix Factorizations
ICML '06 Proceedings of the 23rd international conference on Machine learning
Demonstrating the stability of support vector machines for classification
Signal Processing - Signal processing in UWB communications
Journal of Biomedical Informatics
RotBoost: A technique for combining Rotation Forest and AdaBoost
Pattern Recognition Letters
AdaBoost with SVM-based component classifiers
Engineering Applications of Artificial Intelligence
Class-switching neural network ensembles
Neurocomputing
On the Stability and Bias-Variance Analysis of Kernel Matrix Learning
CAI '07 Proceedings of the 20th conference of the Canadian Society for Computational Studies of Intelligence on Advances in Artificial Intelligence
Feature Ranking Ensembles for Facial Action Unit Classification
ANNPR '08 Proceedings of the 3rd IAPR workshop on Artificial Neural Networks in Pattern Recognition
Recursive reduced least squares support vector regression
Pattern Recognition
Empirical analysis of support vector machine ensemble classifiers
Expert Systems with Applications: An International Journal
Bias-Variance Analysis for Ensembling Regularized Multiple Criteria Linear Programming Models
ICCS 2009 Proceedings of the 9th International Conference on Computational Science
Selective Ensemble Algorithms of Support Vector Machines Based on Constraint Projection
ISNN 2009 Proceedings of the 6th International Symposium on Neural Networks: Advances in Neural Networks - Part II
The Bias Variance Trade-Off in Bootstrapped Error Correcting Output Code Ensembles
MCS '09 Proceedings of the 8th International Workshop on Multiple Classifier Systems
Data & Knowledge Engineering
Zone analysis: a visualization framework for classification problems
Artificial Intelligence Review
Feature selection for bagging of support vector machines
PRICAI'06 Proceedings of the 9th Pacific Rim international conference on Artificial intelligence
Combining SVM classifiers for email anti-spam filtering
IWANN'07 Proceedings of the 9th international work conference on Artificial neural networks
Boosting support vector machines using multiple dissimilarities
KES'07/WIRN'07 Proceedings of the 11th international conference, KES 2007 and XVII Italian workshop on neural networks conference on Knowledge-based intelligent information and engineering systems: Part I
On the combination of dissimilarities for gene expression data analysis
ICANN'07 Proceedings of the 17th international conference on Artificial neural networks
Ensemble of dissimilarity based classifiers for cancerous samples classification
PRIB'07 Proceedings of the 2nd IAPR international conference on Pattern recognition in bioinformatics
CIARP'10 Proceedings of the 15th Iberoamerican congress conference on Progress in pattern recognition, image analysis, computer vision, and applications
Common scab detection on potatoes using an infrared hyperspectral imaging system
ICIAP'11 Proceedings of the 16th international conference on Image analysis and processing - Volume Part II
Diversified SVM ensembles for large data sets
ECML'06 Proceedings of the 17th European conference on Machine Learning
Classification of brain glioma by using SVMs bagging with feature selection
BioDM'06 Proceedings of the 2006 international conference on Data Mining for Biomedical Applications
Building ensembles of neural networks with class-switching
ICANN'06 Proceedings of the 16th international conference on Artificial Neural Networks - Volume Part I
FSKD'05 Proceedings of the Second international conference on Fuzzy Systems and Knowledge Discovery - Volume Part II
Improved response modeling based on clustering, under-sampling, and ensemble
Expert Systems with Applications: An International Journal
Tomographic considerations in ensemble bias/variance decomposition
MCS'10 Proceedings of the 9th international conference on Multiple Classifier Systems
Expert Systems with Applications: An International Journal
Bias-variance analysis in estimating true query model for information retrieval
Information Processing and Management: an International Journal
A MapReduce-based distributed SVM ensemble for scalable image classification and annotation
Computers & Mathematics with Applications
Hi-index | 0.00 |
Bias-variance analysis provides a tool to study learning algorithms and can be used to properly design ensemble methods well tuned to the properties of a specific base learner. Indeed the effectiveness of ensemble methods critically depends on accuracy, diversity and learning characteristics of base learners. We present an extended experimental analysis of bias-variance decomposition of the error in Support Vector Machines (SVMs), considering Gaussian, polynomial and dot product kernels. A characterization of the error decomposition is provided, by means of the analysis of the relationships between bias, variance, kernel type and its parameters, offering insights into the way SVMs learn. The results show that the expected trade-off between bias and variance is sometimes observed, but more complex relationships can be detected, especially in Gaussian and polynomial kernels. We show that the bias-variance decomposition offers a rationale to develop ensemble methods using SVMs as base learners, and we outline two directions for developing SVM ensembles, exploiting the SVM bias characteristics and the bias-variance dependence on the kernel param