Reliability Assessment of Ensemble Classifiers: Application in Mammography

Authors:
Maciej A. Mazurowski;Jacek M. Zurada;Georgia D. Tourassi
Affiliations:
Computational Intelligence Laboratory Department of Electrical and Computer Engineering, University of Louisville, Louisville, KY 40292;Computational Intelligence Laboratory Department of Electrical and Computer Engineering, University of Louisville, Louisville, KY 40292;Duke Advanced Imaging Laboratories, Department of Radiology, Duke University Medical Center, Durham, NC 27705
Venue:
IWDM '08 Proceedings of the 9th international workshop on Digital Mammography
Year:
2008

Citing 7
Cited 1

Some aspects of Dempster-Shafer evidence theory for classification of multi-modality medical images taking partial volume effect into account

Pattern Recognition Letters
On Combining Classifiers

IEEE Transactions on Pattern Analysis and Machine Intelligence
Combining Pattern Classifiers: Methods and Algorithms

Combining Pattern Classifiers: Methods and Algorithms
Ensemble Clustering in Medical Diagnostics

CBMS '04 Proceedings of the 17th IEEE Symposium on Computer-Based Medical Systems
Multi-Classifier Systems: Review and a roadmap for developers

International Journal of Hybrid Intelligent Systems
Medical diagnosis with C4.5 rule preceded by artificial neural network ensemble

IEEE Transactions on Information Technology in Biomedicine
Switching between selection and fusion in combining classifiers: anexperiment

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Estimating confidence of individual rating predictions in collaborative filtering recommender systems

Expert Systems with Applications: An International Journal

Quantified Score

Hi-index	0.00

Visualization

Abstract

In classifier ensembles predictions of different classifiers regarding a query are combined into one final decision. It was previously shown that using ensemble techniques can significantly improve classification performance. In this study we build upon this result and propose to use variability in the predictions of classifiers contributing to the final decision as an indicator of its reliability. The study hypothesis is tested with respect to previously proposed information-theoretic computer-aided decision (IT-CAD) system for detection of masses in mammograms. A database of 1820 regions of interest (ROIs) extracted from digital database of screening mammography (DDSM) is used. Experimental results show that the proposed reliability assessment successfully identifies decisions that can not be trusted. Further, a low correlation between reliability and the classifier output is noted. This opens a possibility of combining reliability and ensemble output into one improved decision.