论文检索

状态空间模型的粒子 MCMC 与相关粒子混合采样器AI 解读

Particle Markov Chain Monte Carlo (PMCMC) is a powerful approach to Bayesian computation for general state space models. Our article enables PMCMC to handle a larger number of observations and parameters compared to previous approaches by generating the parameters that are highly correlated with the states in a pseudo-marginal step(s) with the states ‘integrated out’; the rest of the parameters are generated conditional on the states. We make the pseudo-marginal step much…

状态空间模型的分块相关伪边际采样器AI 解读

Pseudo Marginal Metropolis-Hastings (PMMH) is a general approach to Bayesian inference when the likelihood is intractable, but can be estimated unbiasedly.Our article develops an efficient PMMH method that scales up better to higher dimensional state vectors than previous approaches.The improvement is achieved by the following innovations.First, a novel block version of PMMH that works with multiple particle filters is proposed.Second, the trimmed mean of the unbiased…

合成似然贝叶斯推断：渐近性质与调整AI 解读

Implementing Bayesian inference is often computationally challenging in complex models, especially when calculating the likelihood is difficult. Synthetic likelihood is one approach for carrying out inference when the likelihood is intractable, but it is straightforward to simulate from the model. The method constructs an approximate likelihood by taking a vector summary statistic as being multivariate normal, with the unknown mean and covariance estimated by simulation.…

股票市场的统计循环随机波动率模型AI 解读

The stochastic volatility (SV) model and its variants are widely used in the financial sector, while recurrent neural network (RNN) models are successfully used in many large-scale industrial applications of deep learning. We combine these two methods in a nontrivial way and propose a model, which we call the statistical recurrent stochastic volatility (SR-SV) model, to capture the dynamics of stochastic volatility. The proposed model is able to capture complex volatility…

循环条件异方差AI 解读

Summary We propose a new class of financial volatility models, called the REcurrent Conditional Heteroskedastic (RECH) models, to improve both in‐sample analysis and out‐of‐sample forecasting of the traditional conditional heteroskedastic models. In particular, we incorporate auxiliary deterministic processes, governed by recurrent neural networks, into the conditional variance of the traditional conditional heteroskedastic models, for example, GARCH‐type models, to flexibly…

混合边际分布的 Copula 建模AI 解读

This article extends the literature on copulas with discrete or continuous marginals to the case where some of the marginals are a mixture of discrete and continuous components. We do so by carefully defining the likelihood as the density of the observations with respect to a mixed measure. The treatment is quite general, although we focus on mixtures of Gaussian and Archimedean copulas. The inference is Bayesian with the estimation carried out by Markov chain Monte Carlo.…

通过高效数据子抽样加速 MCMCAI 解读

We propose subsampling Markov chain Monte Carlo (MCMC), an MCMC framework where the likelihood function for n observations is estimated from a random subset of m observations. We introduce a highly efficient unbiased estimator of the log-likelihood based on control variates, such that the computing cost is much smaller than that of the full log-likelihood in standard MCMC. The likelihood estimate is bias-corrected and used in two dependent pseudo-marginal algorithms to…

粒子高效重要性抽样AI 解读

The efficient importance sampling (EIS) method is a general principle for the numerical evaluation of high-dimensional integrals that uses the sequential structure of target integrands to build variance minimising importance samplers. Despite a number of successful applications in high dimensions, it is well known that importance sampling strategies are subject to an exponential growth in variance as the dimension of the integration increases. We solve this problem by…

非线性结构时间序列模型的贝叶斯推断AI 解读

We consider efficient methods for likelihood inference applied to structural models. In particular, we introduce a particle filter method which concentrates upon disturbances in the Markov state of the approximating solution to the structural model. A particular feature of such models is that the conditional distribution of interest for the disturbances is often multimodal. We provide a fast and effective method for approximating such distributions. We estimate a…

基于粒子滤波的 MCMC 模拟方法的若干性质AI 解读

Andrieu et al. (2010) prove that Markov chain Monte Carlo samplers still converge to the correct posterior distribution of the model parameters when the likelihood estimated by the particle filter (with a finite number of particles) is used instead of the likelihood. A critical issue for performance is the choice of the number of particles. We add the following contributions. First, we provide analytically derived, practical guidelines on the optimal number of particles to…

广义平滑有限混合模型AI 解读

We propose a general class of models and a unified Bayesian inference methodology for flexibly estimating the density of a response variable conditional on a possibly high-dimensional set of covariates. Our model is a finite mixture of component models with covariate-dependent mixing weights. The component densities can belong to any parametric family, with each model parameter being a deterministic function of covariates through a link function. Our MCMC methodology allows…

使用平滑自适应高斯混合的回归密度估计AI 解读

We model a regression density flexibly so that at each value of the covariates the density is a mixture of normals with the means, variances and mixture probabilities of the components changing smoothly as a function of the covariates. The model extends the existing models in two important ways. First, the components are allowed to be heteroscedastic regressions as the standard model with homoscedastic regressions can give a poor fit to heteroscedastic data, especially when…

Bayesian analysis is given of a random effects binary probit model that allows for heteroscedasticity. Real and simulated examples illustrate the approach and show that ignoring heteroscedasticity when it exists may lead to biased estimates and poor prediction. The computation is carried out by an efficient Markov chain Monte Carlo sampling scheme that generates the parameters in blocks. We use the Bayes factor, cross-validation of the predictive density, the deviance…

多重变点与混合创新模型的高效贝叶斯推断AI 解读

Time series subject to parameter shifts of random magnitude and timing are commonly modeled with a change-point approach using Chib's algorithm to draw the break dates. We outline some advantages of an alternative approach in which breaks come through mixture distributions in state innovations, and for which the sampler of Gerlach, Carter, and Kohn allows reliable and efficient inference. We show how the same sampler can be used to model shifts in variance that occur…

摘要暂缺

高斯 Copula 回归模型的高效贝叶斯推断AI 解读

A Gaussian copula regression model gives a tractable way of handling a multivariate regression when some of the marginal distributions are non-Gaussian. Our paper presents a general Bayesian approach for estimating a Gaussian copula model that can handle any combination of discrete and continuous marginals, and generalises Gaussian graphical models to the Gaussian copula framework. Posterior inference is carried out using a novel and efficient simulation method. The methods…

贝叶斯变量选择的自适应抽样AI 解读

Our paper proposes adaptive Monte Carlo sampling schemes for Bayesian variable selection in linear regression that improve on standard Markov chain methods. We do so by considering Metropolis–Hastings proposals that make use of accumulated information about the posterior distribution obtained during sampling. Adaptation needs to be done carefully to ensure that sampling is from the correct ergodic distribution. We give conditions for the validity of an adaptive sampling…

纵向数据的简约协方差矩阵估计AI 解读

This article proposes a data-driven method to identify parsimony in the covariance matrix of longitudinal data and to exploit any such parsimony to produce a statistically efficient estimator of the covariance matrix. The approach parameterizes the covariance matrix through the Cholesky decomposition of its inverse. For longitudinal data, this is a one-step-ahead predictive representation, and the Cholesky factor is likely to have off-diagonal elements that are zero or close…

样条非参数回归中的模型选择AI 解读

Summary A Bayesian approach is presented for model selection in nonparametric regression with Gaussian errors and in binary nonparametric regression. A smoothness prior is assumed for each component of the model and the posterior probabilities of the candidate models are approximated using the Bayesian information criterion. We study the model selection method by simulation and show that it has excellent frequentist properties and gives improved estimates of the regression…

摘要暂缺

动态混合模型的高效贝叶斯推断AI 解读

A Bayesian approach is presented for estimating a mixture of linear Gaussian state-space models. Such models are used to model interventions in time series and nonparametric regression. Markov chain Monte Carlo sampling is usually necessary to obtain the posterior distributions of such mixture models, because it is difficult to obtain them analytically. The methodological contribution of the article is to derive a set of recursions for dynamic mixture models that efficiently…

利用数据驱动先验进行加性非参数回归的变量选择与函数估计AI 解读

A hierarchical Bayesian approach is proposed for variable selection and function estimation in additive nonparametric Gaussian regression models and additive nonparametric binary regression models. The prior for each component function is an integrated Wiener process resulting in a posterior mean estimate that is a cubic smoothing spline. Each of the explanatory variables is allowed to be in or out of the model, and the regression functions are estimated by model averaging.…

自相关误差下的加性非参数回归AI 解读

Summary A Bayesian approach is presented for nonparametric estimation of an additive regression model with autocorrelated errors. Each of the potentially non-linear components is modelled as a regression spline using many knots, while the errors are modelled by a high order stationary autoregressive process parameterized in terms of its autocorrelations. The distribution of significant knots and partial autocorrelations is accounted for using subset selection. Our approach…

稳健二元非参数回归的贝叶斯方法AI 解读

This article presents a Bayesian approach to binary nonparametric regression that assumes that the argument of the link is an additive function of the explanatory variables and their multiplicative interactions. The article makes the following contributions. First, a comprehensive approach is presented in which the function estimates are smoothing splines with the smoothing parameters integrated out and the estimates are made robust to outliers. Second, the approach can…