Quasi Black-Box Variational Inference with Natural Gradients for Bayesian Learning
用于贝叶斯学习的自然梯度准黑箱变分推断
We develop an optimization algorithm suitable for Bayesian learning in complex models. Our approach relies on natural gradient updates within a general black-box framework for efficient training with limited model-specific derivations. It applies within the class of exponential-family variational posterior distributions, for which we extensively discuss the Gaussian case for which the updates have a rather simple form. Our Quasi Black-box Variational Inference (QBVI)…