Comparison between neural networks and multiple logistic regression to predict acute coronary syndrome in the emergency room

  • Authors:
  • Michael Green;Jonas Björk;Jakob Forberg;Ulf Ekelund;Lars Edenbrandt;Mattias Ohlsson

  • Affiliations:
  • Department of Theoretical Physics, Lund University, Sölvegatan 14A, SE-22362 Lund, Sweden;Competence Centre for Clinical Research, Lund University Hospital, SE-22185 Lund, Sweden;Department of Emergency Medicine, Lund University Hospital, SE-22185 Lund, Sweden;Department of Emergency Medicine, Lund University Hospital, SE-22185 Lund, Sweden;Department of Clinical Physiology, Malmö University Hospital, SE-20502 Malmö, Sweden;Department of Theoretical Physics, Lund University, Sölvegatan 14A, SE-22362 Lund, Sweden

  • Venue:
  • Artificial Intelligence in Medicine
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

Objective: Patients with suspicion of acute coronary syndrome (ACS) are difficult to diagnose and they represent a very heterogeneous group. Some require immediate treatment while others, with only minor disorders, may be sent home. Detecting ACS patients using a machine learning approach would be advantageous in many situations. Methods and materials: Artificial neural network (ANN) ensembles and logistic regression models were trained on data from 634 patients presenting an emergency department with chest pain. Only data immediately available at patient presentation were used, including electrocardiogram (ECG) data. The models were analyzed using receiver operating characteristics (ROC) curve analysis, calibration assessments, inter- and intra-method variations. Effective odds ratios for the ANN ensembles were compared with the odds ratios obtained from the logistic model. Results: The ANN ensemble approach together with ECG data preprocessed using principal component analysis resulted in an area under the ROC curve of 80%. At the sensitivity of 95% the specificity was 41%, corresponding to a negative predictive value of 97%, given the ACS prevalence of 21%. Adding clinical data available at presentation did not improve the ANN ensemble performance. Using the area under the ROC curve and model calibration as measures of performance we found an advantage using the ANN ensemble models compared to the logistic regression models. Conclusion: Clinically, a prediction model of the present type, combined with the judgment of trained emergency department personnel, could be useful for the early discharge of chest pain patients in populations with a low prevalence of ACS.