本页提供题录、可核实摘要与阅读线索。AI 解读未完成全文核验,可能有误;具体假设、证明和结论请核对原文。仅依据书目生成的内容属于阅读导航,不是对论文结论的确认。
摘要保留来源文本,未经模型改写。材料不足时保留待解读状态;引用采用 OpenAlex 单条关联记录,不合计版本,缺失不视为零,也不代表论文质量。
正在核对对应版本的资源…
A training set of data has been used to construct a rule for predicting future responses. What is the error rate of this rule? This is an important question both for comparing models and for assessing a final selected model. The traditional answer to this question is given by cross-validation. The cross-validation estimate of prediction error is nearly unbiased but can be highly variable. Here we discuss bootstrap estimates of prediction error, which can be thought of as smoothed versions of cross-validation. We show that a particular bootstrap method, the .632+ rule, substantially outperforms cross-validation in a catalog of 24 simulation experiments. Besides providing point estimates, we also consider estimating the variability of an error rate estimate. All of the results here are nonparametric and apply to any possible prediction rule; however, we study only classification problems with 0–1 loss in detail. Our simulations include “smooth” prediction rules like Fisher's linear discriminant function and unsmooth ones like nearest neighbors.