Ensemble pruning using reinforcement learning

Authors:
Ioannis Partalas;Grigorios Tsoumakas;Ioannis Katakis;Ioannis Vlahavas
Affiliations:
Department of Informatics, Aristotle University of Thessaloniki, Thessaloniki, Greece;Department of Informatics, Aristotle University of Thessaloniki, Thessaloniki, Greece;Department of Informatics, Aristotle University of Thessaloniki, Thessaloniki, Greece;Department of Informatics, Aristotle University of Thessaloniki, Thessaloniki, Greece
Venue:
SETN'06 Proceedings of the 4th Helenic conference on Advances in Artificial Intelligence
Year:
2006

Citing 13
Cited 6

Instance-Based Learning Algorithms

Machine Learning
Technical Note: \cal Q-Learning

Machine Learning
C4.5: programs for machine learning

C4.5: programs for machine learning
Neural networks for pattern recognition

Neural networks for pattern recognition
Introduction to Reinforcement Learning

Introduction to Reinforcement Learning
The Power of Decision Tables

ECML '95 Proceedings of the 8th European Conference on Machine Learning
Generating Accurate Rule Sets Without Global Optimization

ICML '98 Proceedings of the Fifteenth International Conference on Machine Learning
Algorithm Selection using Reinforcement Learning

ICML '00 Proceedings of the Seventeenth International Conference on Machine Learning
Ensemble Methods in Machine Learning

MCS '00 Proceedings of the First International Workshop on Multiple Classifier Systems
Ensemble selection from libraries of models

ICML '04 Proceedings of the twenty-first international conference on Machine learning
Data Mining: Practical Machine Learning Tools and Techniques, Second Edition (Morgan Kaufmann Series in Data Management Systems)

Data Mining: Practical Machine Learning Tools and Techniques, Second Edition (Morgan Kaufmann Series in Data Management Systems)
Online adaptive policies for ensemble classifiers

Neurocomputing
Estimating continuous distributions in Bayesian classifiers

UAI'95 Proceedings of the Eleventh conference on Uncertainty in artificial intelligence

Greedy regression ensemble selection: Theory and an application to water quality prediction

Information Sciences: an International Journal
Player Co-Modelling in a Strategy Board Game: Discovering How to Play Fast

Cybernetics and Systems
Pruning an ensemble of classifiers via reinforcement learning

Neurocomputing
Evolving Computer Game Playing via Human-Computer Interaction: Machine Learning Tools in the Knowledge Engineering Life-Cycle

Proceedings of the 2008 conference on Knowledge-Based Software Engineering: Proceedings of the Eighth Joint Conference on Knowledge-Based Software Engineering
Focused Ensemble Selection: A Diversity-Based Method for Greedy Ensemble Selection

Proceedings of the 2008 conference on ECAI 2008: 18th European Conference on Artificial Intelligence
Voting-averaged combination method for regressor ensemble

ICIC'10 Proceedings of the 6th international conference on Advanced intelligent computing theories and applications: intelligent computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

Multiple Classifier systems have been developed in order to improve classification accuracy using methodologies for effective classifier combination. Classical approaches use heuristics, statistical tests, or a meta-learning level in order to find out the optimal combination function. We study this problem from a Reinforcement Learning perspective. In our modeling, an agent tries to learn the best policy for selecting classifiers by exploring a state space and considering a future cumulative reward from the environment. We evaluate our approach by comparing with state-of-the-art combination methods and obtain very promising results.