A geometrical analysis of kernel ridge regression and its applications
核岭回归的几何分析及其应用
We obtain upper bounds for the estimation error of Kernel Ridge Regression (KRR) for all nonnegative regularization parameters, offering a geometric perspective on various phenomena in KRR. As applications: 1. We address the Multiple Descents problem, unifying the proofs of (In Proceedings of Thirty Third Conference on Learning Theory (2020) 2683–2711 PMLR) and (Ann. Statist. 49 (2021) 1029–1054) for polynomial kernels in nonasymptotic regime and we establish Multiple…