Convex Hull Ensemble Machine for Regression and Classification

  • Authors:
  • Yongdai Kim;Jinseog Kim

  • Affiliations:
  • Ewha Womans University, Department of Statistics, 120-750, Seoul, Korea;National University, Department of Statistics, 120-750, Seoul, Korea

  • Venue:
  • Knowledge and Information Systems
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

We propose a new ensemble algorithm called Convex Hull Ensemble Machine (CHEM). CHEM in Hilbert space is first developed and modified for regression and classification problems. We prove that the ensemble model converges to the optimal model in Hilbert space under regularity conditions. Empirical studies reveal that, for classification problems, CHEM has a prediction accuracy similar to that of boosting, but CHEM is much more robust with respect to output noise and never overfits datasets even when boosting does. For regression problems, CHEM is competitive with other ensemble methods such as gradient boosting and bagging.