Ensemble confidence estimates posterior probability

  • Authors:
  • Michael Muhlbaier;Apostolos Topalis;Robi Polikar

  • Affiliations:
  • Electrical and Computer Engineering, Rowan University, Glassboro, NJ;Electrical and Computer Engineering, Rowan University, Glassboro, NJ;Electrical and Computer Engineering, Rowan University, Glassboro, NJ

  • Venue:
  • MCS'05 Proceedings of the 6th international conference on Multiple Classifier Systems
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

We have previously introduced the Learn++ algorithm that provides surprisingly promising performance for incremental learning as well as data fusion applications. In this contribution we show that the algorithm can also be used to estimate the posterior probability, or the confidence of its decision on each test instance. On three increasingly difficult tests that are specifically designed to compare posterior probability estimates of the algorithm to that of the optimal Bayes classifier, we have observed that estimated posterior probability approaches to that of the Bayes classifier as the number of classifiers in the ensemble increase. This satisfying and intuitively expected outcome shows that ensemble systems can also be used to estimate confidence of their output.