Using an ensemble of classifiers to audit a production classifier

  • Authors:
  • Piero Bonissone;Neil Eklund;Kai Goebel

  • Affiliations:
  • GE Global Research, One Research Circle, Niskayuna, NY;GE Global Research, One Research Circle, Niskayuna, NY;GE Global Research, One Research Circle, Niskayuna, NY

  • Venue:
  • MCS'05 Proceedings of the 6th international conference on Multiple Classifier Systems
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

After deploying a classifier in production it is essential to support its lifecycle. This paper describes the application of an ensemble of classifiers to support two stages of the lifecycle of an on-line classifier used to underwrite life insurance applications: the monitoring of its decisions quality and the updating of the production classifier over time. All combinations of five classification methods and seven fusion methods were assessed from the perspective of accuracy and pairwise diversity of the classifiers, and accuracy, precision, and coverage of the fused classifiers. The proposed architecture consists of three off-line classifiers and a fusion module.