Chance-corrected measures for 2 × 2 tables that coincide with weighted kappa

Br J Math Stat Psychol. 2011 May;64(Pt 2):355-65. doi: 10.1348/2044-8317.002001. Epub 2010 Dec 7.

Abstract

Cohen's kappa is presently a standard tool for the analysis of agreement in a 2 × 2 reliability study, and weighted kappa is a standard statistic for summarizing a 2 × 2 validity study. The special cases of weighted kappa, for example Cohen's kappa, are chance-corrected measures of association. For various measures of 2 × 2 association it has been observed in the literature that, after correction for chance, they coincide with a special case of weighted kappa. This paper presents the general function, linear in both numerator and denominator, that becomes weighted kappa after correction for chance.

MeSH terms

  • Humans
  • Observer Variation*
  • Psychological Tests / statistics & numerical data*
  • Psychometrics / statistics & numerical data*
  • Reproducibility of Results