论文检索

主成分回归中经验风险最小化的预测表现AI 解读

This paper studies the predictive performance of empirical risk minimization for principal component regression. Our analysis accommodates the leading eigenvalues of the predictor covariance matrix growing either linearly or sublinearly with the number of predictors. Additionally, we allow for both light-tailed and heavy-tailed data. Our main result establishes that, under appropriate conditions, empirical risk minimization for principal component regression is consistent…

基于通用链式方法的依赖数据经验过程上确界集中不等式及统计学习应用AI 解读

This paper develops a general concentration inequality for the suprema of empirical processes with dependent data. The concentration inequality is obtained by combining generic chaining with a coupling-based strategy. Our framework accommodates high-dimensional and heavy-tailed (sub-Weibull) data. We demonstrate the usefulness of our result by deriving non-asymptotic predictive performance guarantees for empirical risk minimization in regression problems with dependent data.…

异质性面板中的个体平均估计AI 解读

In this work we introduce a unit averaging procedure to efficiently recover unit-specific parameters in a heterogeneous panel model. The procedure consists in estimating the parameter of a given unit using a weighted average of all the unit-specific parameter estimators in the panel. The weights of the average are determined by minimizing an MSE criterion we derive. We analyze the properties of the resulting minimum MSE unit averaging estimator in a local heterogeneity…

依赖数据下线性回归经验风险最小化的表现AI 解读

This paper establishes bounds on the performance of empirical risk minimization for large-dimensional linear regression. We generalize existing results by allowing the data to be dependent and heavy-tailed. The analysis covers both the cases of identically and heterogeneously distributed observations. Our analysis is nonparametric in the sense that the relationship between the regressand and the regressors is not specified. The main results of this paper show that the…