Free-Marginal Multirater Kappa multirater Kfree: An Alternative to Fleiss Fixed-Marginal Multirater KappaReportar como inadecuado




Free-Marginal Multirater Kappa multirater Kfree: An Alternative to Fleiss Fixed-Marginal Multirater Kappa - Descarga este documento en PDF. Documentación en PDF para descargar gratis. Disponible también para leer online.



Online Submission, Paper presented at the Joensuu Learning and Instruction Symposium (Joensuu, Finland, Oct 14-15, 2005)

Fleiss' popular multirater kappa is known to be influenced by prevalence and bias, which can lead to the paradox of high agreement but low kappa. It also assumes that raters are restricted in how they can distribute cases across categories, which is not a typical feature of many agreement studies. In this article, a free-marginal, multirater alternative to Fleiss' multirater kappa is introduced. Free-marginal Multirater Kappa (multirater K[free]), like its birater free-marginal counterparts (PABAK, S, RE, and K[m],) is not influenced by kappa and is appropriate for the typical agreement study, in which raters' distributions of cases into categories are not restricted. Recommendations for the proper use of multirater K[free] are included. (Contains 5 equations, 3 tables, and 3 figures.)

Descriptors: Multivariate Analysis, Statistical Distributions, Statistical Bias, Interrater Reliability, Validity





Autor: Randolph, Justus J.

Fuente: https://eric.ed.gov/?q=a&ft=on&ff1=dtySince_1992&pg=5476&id=ED490661







Documentos relacionados