A systematic review of social-validity assessments in the Journal of Applied Behavior Analysis: 2010-2020

J Appl Behav Anal. 2024 Jul;57(3):542-559. doi: 10.1002/jaba.1092. Epub 2024 Jun 7.

Abstract

We conducted a systematic review of studies published in the Journal of Applied Behavior Analysis between 2010 and 2020 to identify reports of social validity. A total of 160 studies (17.60%) published during this time included a measure of social validity. For each study, we extracted data on (a) the dimensions of social validity, (b) the methods used for collecting social-validity data, (c) the respondents, and (d) when social-validity data were collected. Most social-validity assessments measured the acceptability of intervention procedures and outcomes, with fewer evaluating goals. The most common method for collecting social validity data was Likert-type rating scales, followed by non-Likert-type questionnaires. In most studies, the direct recipients of the intervention provided feedback on social validity. Social-validity assessment data were often collected at the conclusion of the study. We provide examples of social-validity measurement methods, discuss their strengths and limitations, and provide recommendations for improving the future collection and reporting of social-validity data.

Keywords: consumer satisfaction; intervention acceptability; intervention preference; social validity.

Publication types

  • Systematic Review

MeSH terms

  • Applied Behavior Analysis*
  • Humans
  • Periodicals as Topic
  • Reproducibility of Results
  • Social Validity, Research