Assessing the impact of real-time random safety audits through full propensity score matching on reliable data from the clinical information system

Abstract

Background: Evidence-based care processes are not always applied at the bedside in critically ill patients. Numerous studies have assessed the impact of checklists and related strategies on the process of care and patient outcomes. We aimed to evaluate the effects of real-time random safety audits on process-of-care and outcome variables in critical care patients.

Methods: This prospective study used data from the clinical information system to evaluate the impact of real-time random safety audits targeting 32 safety measures in two intensive care units during a 9-month period. We compared endpoints between patients attended with safety audits and those not attended with safety audits. The primary endpoint was mortality, measured by Cox hazard regression after full propensity-score matching. Secondary endpoints were the impact on adherence to process-of-care measures and on quality indicators.

Results: We included 871 patients; 228 of these were attended in ≥ 1 real-time random safety audits. Safety audits were carried out on 390 patient-days; most improvements in the process of care were observed in safety measures related to mechanical ventilation, renal function and therapies, nutrition, and clinical information system. Although the group of patients attended in safety audits had more severe disease at ICU admission [APACHE II score 21 (16-27) vs. 20 (15-25), p = 0.023]; included a higher proportion of surgical patients [37.3 % vs. 26.4 %, p = 0.003] and a higher proportion of mechanically ventilated patients [72.8 % vs. 40.3 %, p < 0.001]; averaged more days on mechanical ventilation, central venous catheter, and urinary catheter; and had a longer ICU stay [12.5 (5.5-23.3) vs. 2.9 (1.7-5.9), p < 0.001], ICU mortality did not differ significantly between groups (19.3 % vs. 18.8 % in the group without safety rounds). After full propensity-score matching, Cox hazard regression analysis showed real-time random safety audits were associated with a lower risk of mortality throughout the ICU stay (HR 0.31; 95 %CI 0.20-0.47).

Conclusions: Real-time random safety audits are associated with a reduction in the risk of ICU mortality. Exploiting data from the clinical information system is useful in assessing the impact of them on the care process, quality indicators, and mortality.

Keywords: Clinical Information System; Critical patients; Intensive care unit; Patient Safety; Quality indicators; Real world data; Real-time safety audits.