Machine learning score to predict in-hospital outcomes in patients hospitalized in cardiac intensive care unit

Abstract

Aims: Although some scores based on traditional statistical methods are available for risk stratification in patients hospitalized in cardiac intensive care units (CICUs), the interest of machine learning (ML) methods for risk stratification in this field is not well established. We aimed to build an ML model to predict in-hospital major adverse events (MAE) in patients hospitalized in CICU.

Methods and results: In April 2021, a French national prospective multicentre study involving 39 centres included all consecutive patients admitted to CICU. The primary outcome was in-hospital MAE, including death, resuscitated cardiac arrest, or cardiogenic shock. Using 31 randomly assigned centres as an index cohort (divided into training and testing sets), several ML models were evaluated to predict in-hospital MAE. The eight remaining centres were used as an external validation cohort. Among 1499 consecutive patients included (aged 64 ± 15 years, 70% male), 67 had in-hospital MAE (4.3%). Out of 28 clinical, biological, ECG, and echocardiographic variables, seven were selected to predict MAE in the training set (n = 844). Boosted cost-sensitive C5.0 technique showed the best performance compared with other ML methods [receiver operating characteristic area under the curve (AUROC) = 0.90, precision-recall AUC = 0.57, F1 score = 0.5]. Our ML score showed a better performance than existing scores (AUROC: ML score = 0.90 vs. Thrombolysis In Myocardial Infarction (TIMI) score: 0.56, Global Registry of Acute Coronary Events (GRACE) score: 0.52, Acute Heart Failure (ACUTE-HF) score: 0.65; all P < 0.05). Machine learning score also showed excellent performance in the external cohort (AUROC = 0.88).

Conclusion: This new ML score is the first to demonstrate improved performance in predicting in-hospital outcomes over existing scores in patients admitted to the intensive care unit based on seven simple and rapid clinical and echocardiographic variables.

Trial registration: ClinicalTrials.gov Identifier: NCT05063097.

Keywords: Death; Echocardiography; Intensive cardiac care unit; Machine learning; Outcomes.