A web-based tool for the assessment of discrimination and calibration properties of prognostic models

Authors:
Azzam F. G. Taktak;Antonio Eleuteri;Stephen P. Lake;Anthony C. Fisher
Affiliations:
Department of Clinical Engineering, Royal Liverpool University Hospital, 1st Floor, Duncan Building, Daulby Street, Liverpool L7 8XP, UK;Department of Clinical Engineering, Royal Liverpool University Hospital, 1st Floor, Duncan Building, Daulby Street, Liverpool L7 8XP, UK;Department of Clinical Engineering, Royal Liverpool University Hospital, 1st Floor, Duncan Building, Daulby Street, Liverpool L7 8XP, UK;Department of Clinical Engineering, Royal Liverpool University Hospital, 1st Floor, Duncan Building, Daulby Street, Liverpool L7 8XP, UK
Venue:
Computers in Biology and Medicine
Year:
2008

Citing 2
Cited 1

Logistic regression and artificial neural network classification models: a methodology review

Journal of Biomedical Informatics
Double-blind evaluation and benchmarking of survival models in a multi-centre study

Computers in Biology and Medicine

Survival analysis in cancer using a partial logistic neural network model with Bayesian regularisation framework: a validation study

International Journal of Knowledge Engineering and Soft Data Paradigms

Quantified Score

Hi-index	0.00

Visualization

Abstract

Prognostic models are developed to assist clinicians in making decisions regarding treatment and follow-up management. The accuracy of these models is often assessed either in terms of their discrimination performance or calibration but rarely both. In this paper, we describe the development of an online tool for discrimination using Harrell C index and calibration using a Hosmer-Lemeshow type analysis (http://clinengnhs.liv.ac.uk/AADP/AADP_Welcome.htm). We show examples of using the tool on real data. We highlight situations where the model performed well in terms of either discrimination or calibration but not both depending on the sample size of the test set. We conclude that prognostic models should be assessed both in terms of discrimination and calibration and that calibration analysis should be carried out numerically and graphically.