From Agreement to Epistemic Alignment: A Signal Detection–Theoretic Model of Inter-Rater Reliability
Educational and Psychological Measurement
Published online on February 16, 2026
Abstract
Educational and Psychological Measurement, Ahead of Print.
Inter-rater reliability is commonly assessed using chance-corrected agreement coefficients such as Cohen’s κ, which summarize concordance among categorical judgments without modeling the inferential processes that generate them. As a result, κ is ...
Inter-rater reliability is commonly assessed using chance-corrected agreement coefficients such as Cohen’s κ, which summarize concordance among categorical judgments without modeling the inferential processes that generate them. As a result, κ is ...