Excess Optimism: How Biased is the Apparent Error of an Estimator Tuned by SURE?
过度乐观:经 SURE 调参后的表观误差有多大偏差?
Nearly all estimators in statistical prediction come with an associated tuning parameter, in one way or another. Common practice, given data, is to choose the tuning parameter value that minimizes a constructed estimate of the prediction error of the estimator; we focus on Stein’s unbiased risk estimator, or SURE, which forms an unbiased estimate of the prediction error by augmenting the observed training error with an estimate of the degrees of freedom of the estimator.…