Improving generalization performance of bagging ensemble via Bayesian approach

Authors:
Shuichi Kurogi;Kenta Harashima
Affiliations:
Kyushu Institute of Technology, Tobata, Kitakyushu, Fukuoka, Japan;Kyushu Institute of Technology, Tobata, Kitakyushu, Fukuoka, Japan
Venue:
CIRA'09 Proceedings of the 8th IEEE international conference on Computational intelligence in robotics and automation
Year:
2009

Citing 4
Cited 0

Competitive learning algorithms for vector quantization

Neural Networks
Bagging predictors

Machine Learning
Lossless Online Bayesian Bagging

The Journal of Machine Learning Research
A study of cross-validation and bootstrap for accuracy estimation and model selection

IJCAI'95 Proceedings of the 14th international joint conference on Artificial intelligence - Volume 2

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper describes a method for improving the generalization performance of bagging ensemble by means of using Bayesian approach. We examine the Bayesian prediction using bagging leaning machines for regression problems, and show a method to reduce the generalization loss defined by the square error of the prediction for test data. We examine and validate the effectiveness via numerical experiments using the CAN2s as learning machines, where the CAN2 is a neural net for learning efficient piecewise linear approximation of nonlinear functions.