Decision Combination in Multiple Classifier Systems
IEEE Transactions on Pattern Analysis and Machine Intelligence
Regularization theory and neural networks architectures
Neural Computation
The nature of statistical learning theory
The nature of statistical learning theory
Machine Learning
Machine Learning
IEEE Transactions on Pattern Analysis and Machine Intelligence
Boosting in the limit: maximizing the margin of learned ensembles
AAAI '98/IAAI '98 Proceedings of the fifteenth national/tenth conference on Artificial intelligence/Innovative applications of artificial intelligence
An equivalence between sparse approximation and support vector machines
Neural Computation
Optimal Linear Combination of Neural Networks for Improving Classification Performance
IEEE Transactions on Pattern Analysis and Machine Intelligence
A Theoretical Study on Six Classifier Fusion Strategies
IEEE Transactions on Pattern Analysis and Machine Intelligence
Ensembling neural networks: many could be better than all
Artificial Intelligence
A Tutorial on Support Vector Machines for Pattern Recognition
Data Mining and Knowledge Discovery
Locally Adaptive Metric Nearest-Neighbor Classification
IEEE Transactions on Pattern Analysis and Machine Intelligence
Combining Nearest Neighbor Classifiers Through Multiple Feature Subsets
ICML '98 Proceedings of the Fifteenth International Conference on Machine Learning
Generalisation Error Bounds for Sparse Linear Classifiers
COLT '00 Proceedings of the Thirteenth Annual Conference on Computational Learning Theory
ICML '97 Proceedings of the Fourteenth International Conference on Machine Learning
Dimensionality reduction via sparse support vector machines
The Journal of Machine Learning Research
Pattern Classification (2nd Edition)
Pattern Classification (2nd Edition)
Combining Pattern Classifiers: Methods and Algorithms
Combining Pattern Classifiers: Methods and Algorithms
A Feature Selection Newton Method for Support Vector Machine Classification
Computational Optimization and Applications
A Theoretical and Experimental Analysis of Linear Combiners for Multiple Classifier Systems
IEEE Transactions on Pattern Analysis and Machine Intelligence
A Sparse Support Vector Machine Approach to Region-Based Image Categorization
CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 1 - Volume 01
Pruning in ordered bagging ensembles
ICML '06 Proceedings of the 23rd international conference on Machine learning
An analysis of diversity measures
Machine Learning
Using boosting to prune bagging ensembles
Pattern Recognition Letters
Selective fusion of heterogeneous classifiers
Intelligent Data Analysis
Ensemble Pruning Via Semi-definite Programming
The Journal of Machine Learning Research
Exact 1-Norm Support Vector Machines Via Unconstrained Convex Differentiable Minimization
The Journal of Machine Learning Research
An Analysis of Ensemble Pruning Techniques Based on Ordered Aggregation
IEEE Transactions on Pattern Analysis and Machine Intelligence
Predictive Ensemble Pruning by Expectation Propagation
IEEE Transactions on Knowledge and Data Engineering
On the sparseness of 1-norm support vector machines
Neural Networks
Proceedings of the 4th international conference on Multiple classifier systems
MCS'03 Proceedings of the 4th international conference on Multiple classifier systems
Proceedings of the 4th international conference on Multiple classifier systems
MCS'03 Proceedings of the 4th international conference on Multiple classifier systems
A two-distribution compounded statistical model for Radar HRRP target recognition
IEEE Transactions on Signal Processing - Part I
Making use of population information in evolutionary artificialneural networks
IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Parallel consensual neural networks
IEEE Transactions on Neural Networks
Density-induced margin support vector machines
Pattern Recognition
Margin distribution based bagging pruning
Neurocomputing
Adaptive weighted fusion of local kernel classifiers for effective pattern classification
ICIC'11 Proceedings of the 7th international conference on Advanced Intelligent Computing
Margin optimization based pruning for random forest
Neurocomputing
Selective ensemble of support vector data descriptions for novelty detection
ISNN'12 Proceedings of the 9th international conference on Advances in Neural Networks - Volume Part I
Linear classifier combination and selection using group sparse regularization and hinge loss
Pattern Recognition Letters
Classifier ensemble using a heuristic learning with sparsity and diversity
ICONIP'12 Proceedings of the 19th international conference on Neural Information Processing - Volume Part II
| Hi-index | 0.01 |
An ensemble of multiple classifiers is widely considered to be an effective technique for improving accuracy and stability of a single classifier. This paper proposes a framework of sparse ensembles and deals with new linear weighted combination methods for sparse ensembles. Sparse ensemble is to sparsely combine the outputs of multiple classifiers by using a sparse weight vector. When the continuous outputs of multiple classifiers are provided in our methods, the problem of solving sparse weight vector can be formulated as linear programming problems in which the hinge loss or/and the 1-norm regularization are exploited. Both the hinge loss and the 1-norm regularization are techniques inducing sparsity used in machine learning. We only ensemble classifiers with nonzero weight coefficients. In these LP-based methods, the ensemble training error is minimized while the weight vector of ensemble learning is controlled, which can be thought as implementing the structure risk minimization rule and naturally explains good performance of these methods. The promising experimental results over UCI data sets and the radar high-resolution range profile data are presented.