Mind the spikes: Benign overfitting of kernels and neural networks in fixed dimension
注意尖峰:固定维度下核方法与神经网络的有益过拟合
The success of over-parameterized neural networks trained to near-zero training error has caused great interest in the phenomenon of benign overfitting, where estimators are statistically consistent even though they interpolate noisy training data. While benign overfitting in fixed dimension has been established for some learning methods, current literature suggests that for regression with typical kernel methods and wide neural networks, benign overfitting requires a…