论文检索

高维线性回归的经验贝叶斯方法：矩估计与次线性样本复杂度AI 解读

We study empirical Bayes estimation of the prior in high-dimensional linear regression $\mathbf{y}=\mathbf{X}\mathbfβ+\mathbf{\varepsilon}$, where the regression coefficients are drawn independently from an unknown sub-Gaussian prior. In contrast to the sequence model, the design matrix couples the latent coefficients, so that recovering the prior requires deconvolving it from both the noise and copies of itself. We introduce the \emph{Empirical Bayes Method of Moments}…

借助多项式逼近建立高斯经验贝叶斯的尖锐遗憾界AI 解读

A central problem in the theory of empirical Bayes is to control the regret (excess risk) of a learned Bayes rule by the Hellinger distance between the estimated and true marginal densities. In the normal means model, the classical result of Jiang and Zhang (2009) achieves this only after regularizing the Bayes rule and incurs an extraneous cubic logarithmic factor through a delicate recursive argument. This paper introduces a new technique, based on polynomial approximation…

高维线性模型经验贝叶斯的梯度流方法AI 解读

Empirical Bayes provides a powerful framework for learning and adapting to latent structure in data. In sequence models where an independent observation is associated to each latent parameter, theory and methods around empirical Bayes are well-developed. However, in models where latent parameters and observed data interact through more complex designs, many statistical and algorithmic questions remain unanswered. In this work, we study a canonical setting of empirical Bayes…