Validation of an electronic tool for flagging surgical site infections based on clinical practice patterns for triaging surveillance: Operational successes and barriers

Am J Infect Control. 2018 Feb;46(2):186-190. doi: 10.1016/j.ajic.2017.08.026. Epub 2017 Oct 12.

Abstract

Background: Surveillance is an effective strategy for reducing surgical site infections (SSIs); however, current identification methods are resource-intensive. Therefore, we sought to validate an electronic SSI triaging tool for detection of probable infections and identify operational barriers and challenges.

Methods: A retrospective cohort study was conducted among all Veterans Affairs Surgical Quality Improvement Program (VASQIP)-reviewed surgeries at 2 Veterans Affairs medical centers from October 1, 2011-September 30, 2014. During the postoperative period, clinical and administrative variables associated with SSI (relevant microbiology order, antibiotic order, radiology order, and administrative codes) were extracted from the electronic medical record and used to score the probability (high, intermediate, and low) that an SSI occurred. VASQIP manual chart review was used as the gold standard of comparison.

Results: VASQIP manual review identified 118 SSIs out of 3,700 surgeries (3.2%). There were 2,041, 1,428, and 231 surgeries that met criteria for low, intermediate, and high probability for SSI. The tool's area under the curve was 0.86 (95% confidence interval, 0.82-0.89). The sensitivity among low-probability surgeries was 92.4%, and the specificity among high-probability surgeries was 95.1%.

Conclusions: The electronic SSI tool has the potential to be used for triaging VASQIP surveillance toward the high-probability surgeries and to avoid manual review of surgeries with low probability of SSI.

Keywords: SSI surveillance; Surgical site infection surveillance; electronic SSI flagging tool; electronic surveillance tool.

Publication types

  • Research Support, U.S. Gov't, Non-P.H.S.

MeSH terms

  • Cohort Studies
  • Data Interpretation, Statistical
  • Electronic Health Records
  • Hospitals, Veterans / statistics & numerical data
  • Humans
  • Practice Patterns, Physicians'
  • Quality Assurance, Health Care
  • Quality Improvement
  • Retrospective Studies
  • Risk Factors
  • Surgical Procedures, Operative / adverse effects*
  • Surgical Wound Infection / epidemiology*
  • Surgical Wound Infection / etiology
  • Triage
  • United States
  • United States Department of Veterans Affairs
  • Validation Studies as Topic