Forest-RK: A New Random Forest Induction Method

  • Authors:
  • Simon Bernard;Laurent Heutte;Sébastien Adam

  • Affiliations:
  • Université de Rouen, LITIS EA 4108, Saint-Etienne du Rouvray, France 76801;Université de Rouen, LITIS EA 4108, Saint-Etienne du Rouvray, France 76801;Université de Rouen, LITIS EA 4108, Saint-Etienne du Rouvray, France 76801

  • Venue:
  • ICIC '08 Proceedings of the 4th international conference on Intelligent Computing: Advanced Intelligent Computing Theories and Applications - with Aspects of Artificial Intelligence
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper we present our work on the parametrization of Random Forests (RF), and more particularly on the number Kof features randomly selected at each node during the tree induction process. It has been shown that this hyperparameter can play a significant role on performance. However, the choice of the value of Kis usually made either by a greedy search that tests every possible value to choose the optimal one, either by choosing a priorione of the three arbitrary values commonly used in the literature. With this work we show that none of those three values is always better than the others. We thus propose an alternative to those arbitrary choices of Kwith a new "push-button" RF induction method, called Forest-RK, for which Kis not an hyperparameter anymore. Our experimentations show that this new method is at least as statistically accurate as the original RF method with a default Ksetting.