Background and aims: We aimed to develop an easily deployable artificial intelligence (AI)-driven model for rapid prediction of urine culture test results.
Material and methods: We utilized a training dataset (n = 34,584 urine samples) and two separate, unseen test sets (n = 10,083 and 9,289 samples). Various machine learning models were compared for diagnostic performance. Predictive parameters included urinalysis results (dipstick and flow cytometry), patient demographics (age and gender), and sample collection method.
Results: Although more complex models achieved the highest AUCs for predicting positive cultures (highest: multilayer perceptron (MLP) with AUC of 0.884, 95% CI 0.878-0.89), multiple logistic regression (MLR) using only flow cytometry parameters achieved a very good AUC (0.858, 95% CI 0.852-0.865). To aid interpretation, prediction results of the MLP and MLR models were categorized based on likelihood ratio (LR) for positivity: highly unlikely (LR 0.1), unlikely (LR 0.3), grey zone (LR 0.9), likely (LR 5.0), and highly likely (LR 40). This resulted in 17%, 28%, 34%, 9%, and 13% of samples falling into each respective category for the MLR model and 20%, 26%, 31%, 7%, and 16% for the MLP model.
Conclusions: In conclusion, this robust model has the potential to assist clinicians in their decision-making process by providing insights prior to the availability of urine culture results in a significant portion of samples (∼2/3rd).
Keywords: Artificial intelligence; Clinical decision support; Likelihood ratio; Machine learning; Prediction model; Urinary tract infection; Urine culture.
Copyright © 2024 The Authors. Published by Elsevier B.V. All rights reserved.