论文检索

贝叶斯学习中的经验贝叶斯：理解一种常见实践AI 解读

In applications of Bayesian procedures, once a class of priors has been chosen, it may be tempting to fix the prior's hyperparameters from the data, in an empirical Bayes (EB) fashion, usually by their maximum marginal likelihood estimates (MMLE). This is a quite common but questionable practice, lacking a rigorous theoretical basis. We provide a theoretical framework where this form of EB is regarded as a computational strategy for approximating a genuine Bayesian posterior…

预印本版本摘要 · 查看来源

半参数后验修正AI 解读

Abstract We present a new approach to semiparametric inference using corrected posterior distributions. The method allows us to leverage the adaptivity, regularization, and predictive power of nonparametric Bayesian procedures to estimate low-dimensional functionals of interest without being restricted by the holistic Bayesian formalism. Starting from a conventional posterior on the whole data-generating distribution, we correct the marginal posterior for each functional of…

未知流形邻域中的密度估计：贝叶斯非参数方法AI 解读

We study the Bayesian density estimation of data living in the offset of an unknown submanifold of the Euclidean space. In this perspective, we introduce a new notion of anisotropic Hölder for the underlying density and obtain posterior rates that are minimax optimal and adaptive to the regularity of the density, to the intrinsic dimension of the manifold, and to the size of the offset, provided that the latter is not too small—while still allowed to go to zero. Our Bayesian…

贝叶斯与频率学派反卷积模型中的 Wasserstein 收敛AI 解读

We study the multivariate deconvolution problem of recovering the distribution of a signal from independent and identically distributed observations additively contaminated with random errors having known distribution. For errors with ordinary smooth distribution, we recast the multidimensional problem as a one-dimensional problem leveraging the equivalence between the L1-Wasserstein and the max-sliced L1-Wasserstein metrics and derive an inversion inequality relating the…

理想的贝叶斯局部自适应AI 解读

Many real-life applications involve estimation of curves that exhibit complicated shapes including jumps or varying-frequency oscillations. Practical methods have been devised that can adapt to a locally varying complexity of an unknown function (e.g. variable-knot splines, sparse wavelet reconstructions, kernel methods or trees/forests). However, the overwhelming majority of existing asymptotic minimaxity theory is predicated on homogeneous smoothness assumptions. Focusing…

多元 Hawkes 过程的非参数贝叶斯估计AI 解读

This paper studies nonparametric estimation of parameters of multivariate Hawkes processes. We consider the Bayesian setting and derive posterior concentration rates. First, rates are derived for $\mathbb{L}_{1}$-metrics for stochastic intensities of the Hawkes process. We then deduce rates for the $\mathbb{L}_{1}$-norm of interactions functions of the process. Our results are exemplified by using priors based on piecewise constant functions, with regular or random…

筛先验下贝叶斯可信集的渐近频率学覆盖性质AI 解读

We investigate the frequentist coverage properties of (certain) Bayesian credible sets in a general, adaptive, nonparametric framework. It is well known that the construction of adaptive and honest confidence sets is not possible in general. To overcome this problem (in context of sieve type of priors), we introduce an extra assumption on the functional parameters, the so-called “general polished tail” condition. We then show that under standard assumptions, both the…

近似贝叶斯计算中的模型误设：后果与诊断AI 解读

Summary We analyse the behaviour of approximate Bayesian computation (ABC) when the model generating the simulated data differs from the actual data-generating process, i.e. when the data simulator in ABC is misspecified. We demonstrate both theoretically and in simple, but practically relevant, examples that when the model is misspecified different versions of ABC can yield substantially different results. Our theoretical results demonstrate that even though the model is…

最大边际似然经验贝叶斯后验的渐近行为AI 解读

We consider the asymptotic behaviour of the marginal maximum likelihood empirical Bayes posterior distribution in general setting. First, we characterize the set where the maximum marginal likelihood estimator is located with high probability. Then we provide oracle type of upper and lower bounds for the contraction rates of the empirical Bayes posterior. We also show that the hierarchical Bayes posterior achieves the same contraction rate as the maximum marginal likelihood…

半参数模型中光滑泛函的 Bernstein–von Mises 定理AI 解读

A Bernstein–von Mises theorem is derived for general semiparametric functionals. The result is applied to a variety of semiparametric problems in i.i.d. and non-i.i.d. situations. In particular, new tools are developed to handle semiparametric bias, in particular for nonlinear functionals and in cases where regularity is possibly low. Examples include the squared $L^{2}$-norm in Gaussian white noise, nonlinear functionals in density estimation, as well as functionals in…

自适应后验集中速率AI 解读

We investigate the problem of deriving posterior concentration rates under different loss functions in nonparametric Bayes. We first provide a lower bound on posterior coverages of shrinking neighbourhoods that relates the metric or loss under which the shrinking neighbourhood is considered, and an intrinsic pre-metric linked to frequentist separation rates. In the Gaussian white noise model, we construct feasible priors based on a spike and slab procedure reminiscent of…

《自适应非参数贝叶斯可信集的频率学覆盖率》讨论AI 解读

Discussion of "Frequentist coverage of adaptive nonparametric Bayesian credible sets" by Szab\'o, van der Vaart and van Zanten [arXiv:1310.4489v5].

贝叶斯模型选择中的相关摘要统计量AI 解读

Summary The choice of the summary statistics that are used in Bayesian inference and in particular in approximate Bayesian computation algorithms has bearings on the validation of the resulting inference. Those statistics are nonetheless customarily used in approximate Bayesian computation algorithms without consistency checks. We derive necessary and sufficient conditions on summary statistics for the corresponding Bayes factor to be convergent, namely to select the true…

密度线性泛函的 Bernstein–von Mises 定理AI 解读

In this paper, we study the asymptotic posterior distribution of linear functionals of the density by deriving general conditions to obtain a semi-parametric version of the Bernstein–von Mises theorem. The special case of the cumulative distributive function, evaluated at a specific point, is widely considered. In particular, we show that for infinite-dimensional exponential families, under quite general assumptions, the asymptotic posterior distribution of the functional…

长记忆或中间记忆高斯过程谱密度的贝叶斯非参数估计AI 解读

A stationary Gaussian process is said to be long-range dependent (resp., anti-persistent) if its spectral density $f(\lambda)$ can be written as $f(\lambda)=|\lambda|^{-2d}g(|\lambda|)$, where $0<d<1/2$ (resp., $-1/2<d<0$), and $g$ is continuous and positive. We propose a novel Bayesian nonparametric approach for the estimation of the spectral density of such processes. We prove posterior consistency for both $d$ and $g$, under appropriate conditions on the prior…

平稳高斯过程记忆参数极大似然估计的渐近理论AI 解读

Consistency, asymptotic normality, and efficiency of the maximum likelihood estimator for stationary Gaussian time series were shown to hold in the short memory case by Hannan (1973, Journal of Applied Probability 10, 130–145) and in the long memory case by Dahlhaus (1989, Annals of Statistics 34, 1045–1047). In this paper we extend these results to the entire stationarity region, including the case of antipersistence and noninvertibility.

过拟合混合模型中后验分布的渐近行为AI 解读

Summary We study the asymptotic behaviour of the posterior distribution in a mixture model when the number of components in the mixture is larger than the true number of components: a situation which is commonly referred to as an overfitted mixture. We prove in particular that quite generally the posterior distribution has a stable and interesting behaviour, since it tends to empty the extra components. This stability is achieved under some restriction on the prior, which…

Beta 混合后验的收敛速度与自适应非参数密度估计AI 解读

In this paper, we investigate the asymptotic properties of nonparametric Bayesian mixtures of Betas for estimating a smooth density on [0, 1]. We consider a parametrization of Beta distributions in terms of mean and scale parameters and construct a mixture of these Betas in the mean parameter, while putting a prior on this scaling parameter. We prove that such Bayesian nonparametric models have good frequentist asymptotic properties. We determine the posterior rate of…

贝叶斯阶数识别的误差界及其混合模型应用AI 解读

The efficiency of two Bayesian order estimators is studied. By using nonparametric techniques, we prove new underestimation and overestimation bounds. The results apply to various models, including mixture models. In this case, the errors are shown to be O(e−an) and $O((\log n)^{b}/\sqrt{n})$ (a, b>0), respectively.

平稳高斯强相依过程参数最大似然估计的有效渐近展开AI 解读

We establish the validity of an Edgeworth expansion to the distribution of the maximum likelihood estimator of the parameter of a stationary, Gaussian, strongly dependent process. The result covers ARFIMA-type models, including fractional Gaussian noise. The method of proof consists of three main ingredients: (i) verification of a suitably modified version of Durbin's general conditions for the validity of the Edgeworth expansion to the joint density of the log-likelihood…

长程依赖下样本自相关函数的有效 Edgeworth 展开AI 解读

We prove in this paper the validity of an Edgeworth expansion to the joint distribution of the sample autocorrelations of a stationary Gaussian long memory process. The method of proof relies on a verification of the suitably modified conditions for the validity of a multivariate Edgeworth expansion of Durbin (1980, Biometrika 67, 311–333). A simulation study proves the expansion to be useful and accurate.

ARFIMA 模型中基于似然的小样本推断AI 解读

The autoregressive fractionally integrated moving average (ARFIMA) model has become a popular approach for analyzing time series that exhibit long-range dependence. For the Gaussian case, there have been substantial advances in the area of likelihood-based inference, including development of the asymptotic properties of the maximum likelihood estimates and formulation of procedures for their computation. Small-sample inference, however, has not to date been studied. Here we…