Benign Overfitting of Non-Sparse High-Dimensional Linear Regression with Correlated Noise
相关噪声下非稀疏高维线性回归的良性过拟合
We investigate the high-dimensional linear regression problem in the presence of noise correlated with Gaussian covariates. This correlation, known as endogeneity in regression models, often arises from unobserved variables and other factors. It has been a major challenge in causal inference and econometrics. When the covariates are high-dimensional, it has been common to assume sparsity on the true parameters and estimate them using regularization, even with the…