Psychometric Tests: Quantifying the Consequences of Low Reliability and Improving Reliability Estimation
心理测量检验:量化低信度后果并改进信度估计
We introduce a set of consequence-based measures that quantify the misclassification arising from imperfect reliability in multi-item psychometric scales. Particular attention is given to the probability of individuals in extreme latent-trait percentiles being correctly identified from their observed scores. These cost functions provide a principled and interpretable way to characterise how inadequate reliability distorts classification and reduces the informational value of…