External validation of the myocardial-ischaemic-injury-index machine learning algorithm for the early diagnosis of myocardial infarction: a multicentre cohort study

Lancet Digit Health. 2024 Jul;6(7):e480-e488. doi: 10.1016/S2589-7500(24)00088-8.

Abstract

Background: The myocardial-ischaemic-injury-index (MI3) is a novel machine learning algorithm for the early diagnosis of type 1 non-ST-segment elevation myocardial infarction (NSTEMI). The performance of MI3, both when using early serial blood draws (eg, at 1 h or 2 h) and in direct comparison with guideline-recommended algorithms, remains unknown. Our aim was to externally validate MI3 and compare its performance with that of the European Society of Cardiology (ESC) 0/1h-algorithm.

Methods: In this secondary analysis of a multicentre international diagnostic cohort study, adult patients (age >18 years) presenting to the emergency department with symptoms suggestive of myocardial infarction were prospectively enrolled from April 21, 2006, to Feb 27, 2019 in 12 centres from five European countries (Switzerland, Spain, Italy, Poland, and Czech Republic). Patients were excluded if they presented with ST-segment-elevation myocardial infarction, did not have at least two serial high-sensitivity cardiac troponin I (hs-cTnI) measurements, or if the final diagnosis remained unclear. The final diagnosis was centrally adjudicated by two independent cardiologists using all available medical records, including serial hs-cTnI measurements and cardiac imaging. The primary outcome was type 1 NSTEMI. The performance of MI3 was directly compared with that of the ESC 0/1h-algorithm.

Findings: Among 6487 patients, (median age 61·0 years [IQR 49·0-73·0]; 2122 [33%] female and 4365 [67%] male), 882 (13·6%) patients had type 1 NSTEMI. The median time difference between the first and second hs-cTnI measurement was 60·0 mins (IQR 57·0-70·0). MI3 performance was very good, with an area under the receiver-operating-characteristic curve of 0·961 (95% CI 0·957 to 0·965) and a good overall calibration (intercept -0·09 [-0·2 to 0·02]; slope 1·02 [0·97 to 1·08]). The originally defined MI3 score of less than 1·6 identified 4186 (64·5%) patients as low probability of having a type 1 NSTEMI (sensitivity 99·1% [95% CI 98·2 to 99·5]; negative predictive value [NPV] 99·8% [95% CI 99·6 to 99·9]) and an MI3 score of 49·7 or more identified 915 (14·1%) patients as high probability of having a type 1 NSTEMI (specificity 95·0% [94·3 to 95·5]; positive predictive value [PPV] 69·1% [66·0-72·0]). The sensitivity and NPV of the ESC 0/1h-algorithm were higher than that of MI3 (difference for sensitivity 0·88% [0·19 to 1·60], p=0·0082; difference for NPV 0·18% [0·05 to 0·32], p=0·016), and the rule-out efficacy was higher for MI3 (11% difference, p<0·0001). Specificity and PPV for MI3 were superior (difference for specificity 3·80% [3·24 to 4·36], p<0·0001; difference for PPV 7·84% [5·86 to 9·97], p<0·0001), and the rule-in efficacy was higher for the ESC 0/1h-algorithm (5·4% difference, p<0·0001).

Interpretation: MI3 performs very well in diagnosing type 1 NSTEMI, demonstrating comparability to the ESC 0/1h-algorithm in an emergency department setting when using early serial blood draws.

Funding: Swiss National Science Foundation, Swiss Heart Foundation, the EU, the University Hospital Basel, the University of Basel, Abbott, Beckman Coulter, Roche, Idorsia, Ortho Clinical Diagnostics, Quidel, Siemens, and Singulex.

Publication types

  • Multicenter Study
  • Validation Study

MeSH terms

  • Aged
  • Algorithms*
  • Biomarkers / blood
  • Cohort Studies
  • Early Diagnosis*
  • Emergency Service, Hospital
  • Europe
  • Female
  • Humans
  • Machine Learning*
  • Male
  • Middle Aged
  • Myocardial Infarction / diagnosis
  • Non-ST Elevated Myocardial Infarction* / diagnosis
  • Prospective Studies
  • Troponin I / blood

Substances

  • Troponin I
  • Biomarkers