On Bayesian Analysis of Multirater Ordinal Data: An Application to Automated Essay Grading
多评分者有序数据的贝叶斯分析:自动作文评分应用
A framework is proposed for the analysis of ordinal categorical data when ratings from several judges are available. I emphasize the tasks of estimating latent trait characteristics of individual items, regressing these latent traits on observed covariates, and comparing the performance of raters. The model is illustrated in the design and evaluation of an automated essay grader. This grader is based on a regression of variables, obtained from a grammar checker, on essay…