An Empirical Evaluation of the Impact Scenario of Pooling Bodies of Evidence from Randomized Controlled Trials and Cohort Studies in Nutrition Research

Abstract

Only very few Cochrane nutrition reviews include cohort studies (CSs), but most evidence in nutrition research comes from CSs. We aimed to pool bodies of evidence (BoE) from randomized controlled trials (RCTs) derived from Cochrane reviews with matched BoE from CSs. The Cochrane Database of Systematic Reviews and MEDLINE were searched for systematic reviews (SRs) of RCTs and SRs of CSs. BoE from RCTs were pooled together with BoE from CSs using random-effects and common-effect models. Heterogeneity, 95% prediction intervals, contributed weight of BoE from RCTs to the pooled estimate, and whether integration of BoE from CSs modified the conclusion from BoE of RCTs were evaluated. Overall, 80 diet-disease outcome pairs based on 773 RCTs and 720 CSs were pooled. By pooling BoE from RCTs and CSs with a random-effects model, for 45 (56%) out of 80 diet-disease associations the 95% CI excluded no effect and showed mainly a reduced risk/inverse association. By pooling BoE from RCTs and CSs, median I2 = 46% and the median contributed weight of RCTs to the pooled estimates was 34%. The direction of effect between BoE from RCTs and pooled effect estimates was rarely opposite (n = 17; 21%). The integration of BoE from CSs modified the result (by examining the 95% CI) from BoE of RCTs in 35 (44%) of the 80 diet-disease associations. Our pooling scenario showed that the integration of BoE from CSs modified the conclusion from BoE of RCTs in nearly 50% of the associations, although the direction of effect was mainly concordant between BoE of RCTs and pooled estimates. Our findings provide insights for the potential impact of pooling both BoE in Cochrane nutrition reviews. CSs should be considered for inclusion in future Cochrane nutrition reviews, and we recommend analyzing RCTs and CSs in separate meta-analyses, or, if combined together, with a subgroup analysis.

Keywords: cohort studies; meta-analysis; nutrition; pooling; randomized controlled trials.