Critical Appraisal of International Clinical Practice Guidelines in Kidney Transplantation Using the Appraisal of Guidelines for Research and Education II Tool: A Systematic Review

Transplantation. 2018 Sep;102(9):1419-1439. doi: 10.1097/TP.0000000000002255.

Abstract

Background: Although clinical practice guidelines (CPGs) are used for the development of local protocols in kidney transplantation (Ktx), the quality of their methodology is variable. This systematic review aimed to critically appraise international CPGs in all aspects of Ktx using the Appraisal of Guidelines for Research and Evaluation II tool.

Methods: Clinical Practice Guidelines in Ktx and donation published between 2010 and 2017 were identified from MEDLINE, Embase, National Guideline Clearinghouse, National Health Service and National Institute for Health and Care Excellence Evidence Searches, and the websites of transplant societies. Using Appraisal of Guidelines for Research and Evaluation II, 3 appraisers assessed the quality of CPGs. Interrater reliability was measured using the intraclass correlation coefficient (ICC).

Results: Searches identified 3168 records, and 115 CPGs were included. The highest scoring Appraisal of Guidelines for Research and Evaluation II domain was "scope and purpose" (80%; range, 30%-100%), followed by "clarity of presentation" (77%; range, 43%-98%), "editorial independence" (52%; range, 0%-94%), "rigor of development" (47%; range 6%-97%) and "stakeholder involvement" (41%; range, 11%-85%). The poorest scoring domain was "applicability" (31%; range, 3%-74%). Most CPGs were recommended for future use either with (63%) or without (18%) modifications. A small number (14%) were not recommended for future use or reviewers (5%) did not agree on recommending the CPG. The overall mean CPG quality score was 4 of 7 (range, 2-7). The mean ICC of 0.74 indicated substantial agreement between reviewers.

Conclusions: The quality of international CPGs in Ktx was variable, and most CPGs lacked key aspects of methodological robustness and transparency. Improvements in methodology, patient involvement, and strategies for implementation are required.

Publication types

  • Systematic Review

MeSH terms

  • Data Accuracy
  • Evidence-Based Medicine / standards*
  • Humans
  • Kidney Transplantation / standards*
  • Practice Guidelines as Topic / standards*
  • Practice Patterns, Physicians' / standards*
  • Stakeholder Participation