Generalizability of findings from a clinical sample to a community-based sample: A comparison of ADNI and ARIC

Alzheimers Dement. 2021 Aug;17(8):1265-1276. doi: 10.1002/alz.12293. Epub 2021 Feb 1.

Abstract

Introduction: Clinic-based study samples, including the Alzheimer's Disease Neuroimaging Initiative (ADNI), offer rich data, but findings may not generalize to community-based settings. We compared associations in ADNI to those in the Atherosclerosis Risk in Communities (ARIC) study to assess generalizability across the two settings.

Methods: We estimated cohort-specific associations among risk factors, cognitive test scores, and neuroimaging outcomes to identify and quantify the extent of significant and substantively meaningful differences in associations between cohorts. We explored whether using more homogenous samples improved comparability in effect estimates.

Results: The proportion of associations that differed significantly between cohorts ranged from 27% to 34% across sample subsets. Many differences were substantively meaningful (e.g., odds ratios [OR] for apolipoprotein E ε4 on amyloid positivity in ARIC: OR = 2.8, in ADNI: OR = 8.6).

Discussion: A higher proportion of associations differed significantly and substantively than would be expected by chance. Findings in clinical samples should be confirmed in more representative samples.

Keywords: Alzheimer's Disease Neuroimaging Initiative; Alzheimer's disease; Atherosclerosis Risk in Communities; dementia; generalizability.

Publication types

  • Comparative Study
  • Research Support, N.I.H., Extramural

MeSH terms

  • Aged
  • Alzheimer Disease* / genetics
  • Alzheimer Disease* / pathology
  • Apolipoprotein E4 / genetics
  • Atherosclerosis* / genetics
  • Atherosclerosis* / pathology
  • Cohort Studies*
  • Female
  • Humans
  • Magnetic Resonance Imaging
  • Male
  • Middle Aged
  • Neuroimaging*
  • Neuropsychological Tests / statistics & numerical data
  • Outcome Assessment, Health Care
  • Positron-Emission Tomography
  • Public Health*
  • Risk Factors

Substances

  • Apolipoprotein E4