Practical guidance for using multiple data sources in systematic reviews and meta-analyses (with examples from the MUDS study)

Res Synth Methods. 2018 Mar;9(1):2-12. doi: 10.1002/jrsm.1277. Epub 2017 Dec 15.

Abstract

Data for individual trials included in systematic reviews may be available in multiple sources. For example, a single trial might be reported in 2 journal articles and 3 conference abstracts. Because of differences across sources, source selection can influence the results of systematic reviews. We used our experience in the Multiple Data Sources in Systematic Reviews (MUDS) study, and evidence from previous studies, to develop practical guidance for using multiple data sources in systematic reviews. We recommend the following: (1) Specify which sources you will use. Before beginning a systematic review, consider which sources are likely to contain the most useful data. Try to identify all relevant reports and to extract information from the most reliable sources. (2) Link individual trials with multiple sources. Write to authors to determine which sources are likely related to the same trials. Use a modified Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) flowchart to document both the selection of trials and the selection of sources. (3) Follow a prespecified protocol for extracting trial characteristics from multiple sources. Identify differences among sources, and contact study authors to resolve differences if possible. (4) Prespecify outcomes and results to examine in the review and meta-analysis. In your protocol, describe how you will handle multiple outcomes within each domain of interest. Look for outcomes using all eligible sources. (5) Identify which data sources were included in the review. Consider whether the results might have been influenced by data sources used. (6) To reduce bias, and to reduce research waste, share the data used in your review.

Keywords: meta-analysis; multiple data sources; reporting bias; risk of bias assessment; selective outcome reporting.

MeSH terms

  • Amines / therapeutic use
  • Bipolar Disorder / drug therapy
  • Clinical Trials as Topic
  • Cyclohexanecarboxylic Acids / therapeutic use
  • Data Collection
  • Gabapentin
  • Humans
  • Information Storage and Retrieval
  • Meta-Analysis as Topic*
  • Neuralgia / drug therapy
  • Quetiapine Fumarate / therapeutic use
  • Research Report
  • Review Literature as Topic*
  • Treatment Outcome
  • gamma-Aminobutyric Acid / therapeutic use

Substances

  • Amines
  • Cyclohexanecarboxylic Acids
  • Quetiapine Fumarate
  • gamma-Aminobutyric Acid
  • Gabapentin