Rényi's $α$-divergence variational Bayes for spike-and-slab high-dimensional linear regression
尖峰与厚尾先验高维线性回归的 Rényi α 散度变分贝叶斯方法
Sparse high-dimensional linear regression is a central problem in statistics, where the goal is often variable selection and/or coefficient estimation. We propose a mean-field variational Bayes approximation for sparse regression with spike-and-slab Laplace priors that replaces the standard Kullback-Leibler (KL) divergence objective with the Rényi's $α$ divergence: a one-parameter generalization of KL divergence indexed by $α\in (0, \infty) \setminus \{1\}$ that allows…