A study on the importance of selection pressure and low dimensional weak learners to produce robust ensembles

  • Authors:
  • Danilo Vasconcellos Vargas;Hirotaka Takano;Junichi Murata

  • Affiliations:
  • Kyushu University, Fukuoka, Japan;Kyushu University, Fukuoka, Japan;Kyushu University, Fukuoka, Japan

  • Venue:
  • Proceedings of the 15th annual conference companion on Genetic and evolutionary computation
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

Ensembles of classifiers have been studied for some time. It is widely known that weak learners should be accurate and diverse. However, in the real world there are many constraints and few have been said about the robustness of ensembles and how to develop it. In the context of random subspace methods, this paper addresses the question of developing ensembles to face problems under time constraints. Experiments show that selecting weak learners based on their accuracy can be used to create robust ensembles. Thus, the selection pressure in ensembles is a key technique to create not just effective ensembles but also robust ones. Moreover, the experiments motivate further research on ensembles made of low dimensional classifiers which achieve general accurate results.