Empirical comparison of bagging ensembles created using weak learners for a regression problem

Authors:
Karol Bańczyk;Olgierd Kempa;Tadeusz Lasota;Bogdan Trawiński
Affiliations:
Wrocław University of Technology, Institute of Informatics, Wrocław, Poland;Wrocław University of Environmental and Life Sciences, Dept. of Spatial Management, Wrocław, Poland;Wrocław University of Environmental and Life Sciences, Dept. of Spatial Management, Wrocław, Poland;Wrocław University of Technology, Institute of Informatics, Wrocław, Poland
Venue:
ACIIDS'11 Proceedings of the Third international conference on Intelligent information and database systems - Volume Part II
Year:
2011

Citing 14
Cited 0

The Strength of Weak Learnability

Machine Learning
Bagging predictors

Machine Learning
Data Mining: Practical Machine Learning Tools and Techniques, Second Edition (Morgan Kaufmann Series in Data Management Systems)

Data Mining: Practical Machine Learning Tools and Techniques, Second Edition (Morgan Kaufmann Series in Data Management Systems)
Statistical Comparisons of Classifiers over Multiple Data Sets

The Journal of Machine Learning Research
A Theoretical Analysis of Bagging as a Linear Combination of Classifiers

IEEE Transactions on Pattern Analysis and Machine Intelligence
Investigation of evolutionary optimization methods of TSK fuzzy model for real estate appraisal

International Journal of Hybrid Intelligent Systems - Recent Advances in Intelligent Paradigms Fusion and Their Applications
A study of statistical techniques and performance measures for genetics-based machine learning: accuracy and interpretability

Soft Computing - A Fusion of Foundations, Methodologies and Applications
Comparative Analysis of Premises Valuation Models Using KEEL, RapidMiner, and WEKA

ICCCI '09 Proceedings of the 1st International Conference on Computational Collective Intelligence. Semantic Web, Social Networks and Multiagent Systems
Comparison of data driven models for the valuation of residential premises using KEEL

International Journal of Hybrid Intelligent Systems - Hybrid Fuzzy Models
Comparing two genetic overproduce-and-choose strategies for fuzzy rule-based multiclassification systems generated by bagging and mutual information-based feature selection

International Journal of Hybrid Intelligent Systems - Hybrid Fuzzy Models
Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: Experimental analysis of power

Information Sciences: an International Journal
Exploration of bagging ensembles comprising genetic fuzzy models to assist with real estate appraisals

IDEAL'09 Proceedings of the 10th international conference on Intelligent data engineering and automated learning
Analysis of bagging ensembles of fuzzy models for premises valuation

ACIIDS'10 Proceedings of the Second international conference on Intelligent information and database systems: Part II
Comparison of bagging, boosting and stacking ensembles applied to real estate appraisal

ACIIDS'10 Proceedings of the Second international conference on Intelligent information and database systems: Part II

Quantified Score

Hi-index	0.00

Visualization

Abstract

The experiments, aimed to compare the performance of bagging ensembles using three different test sets composed of base, out-of-bag, and 30% holdout instances were conducted. Six weak learners including conjunctive rules, decision stump, decision table, pruned model trees, rule model trees, and multilayer perceptron, implemented in the data mining system WEKA, were applied. All algorithms were employed to real-world datasets derived from the cadastral system and the registry of real estate transactions, and cleansed by property valuation experts. The analysis of the results was performed using recently proposed statistical methodology including nonparametric tests followed by post-hoc procedures designed especially for multiple n×n comparisons. The results showed the lowest prediction error with base test set only in the case of model trees and a neural network.