论文检索

风险最小化参数的广义通用推断AI 解读

Abstract A common goal in statistics and machine learning is estimation of unknowns. Point estimates alone are of little value without an accompanying measure of uncertainty, but traditional uncertainty quantification methods, such as confidence sets and p-values, often require distributional or structural assumptions that may not be justified in modern applications. The present paper considers a very common case in machine learning, where the quantity of interest is the…

有效无先验可能性统计推断的高效蒙特卡洛方法AI 解读

Inferential models (IMs) offer prior-free, Bayesian-like posterior degrees of belief designed for statistical inference, which feature a frequentist-like calibration property that ensures reliability of said inferences. The catch is that IMs’ degrees of belief are possibilistic rather than probabilistic and, since the familiar Monte Carlo methods approximate probabilistic quantities, there are significant computational challenges associated with putting this framework into…

可能性推断模型：综述AI 解读

An inferential model (IM) is a model describing the construction of provably reliable, data-driven uncertainty quantification and inference about relevant unknowns. IMs and Fisher’s fiducial argument have similar objectives, but a fundamental distinction between the two is that the former doesn’t require that uncertainty quantification be probabilistic, offering greater flexibility and allowing for a proof of its reliability. Important recent developments have been made…

高维广义线性模型的贝叶斯模型选择一致性进展AI 解读

Uncovering genuine relationships between a response variable and a large collection of covariates is a fundamental and practically important problem. In the context of Gaussian linear models, both the Bayesian and non-Bayesian literature is well-developed and there are no substantial differences in the model selection consistency results available from the two schools. For generalized linear models (GLMs), however, Bayesian model selection consistency results are lacking in…

预测递归驱动的随时有效且渐近高效推断AI 解读

Summary Distinguishing two models is a fundamental and practically important statistical problem. Error rate control is crucial to the testing logic, but in complex nonparametric settings can be difficult to achieve, especially when the stopping rule that determines the data collection process is not available. This paper proposes an $ e $-process construction based on the predictive recursion algorithm originally designed to recursively fit nonparametric mixture models. The…

Dey、Martin 与 Williams 对《安全检验》的讨论贡献AI 解读

Congratulations to Grünwald, de Heide, and Koolen (GHK) for their contribution to the exciting and rapidly growing literature on safe/anytime-valid inference. GHK’s proposal focused on problems in which a statistical model is available that determines the quantity of interest—the model parameter—and provides a likelihood function that drives the e-value construction. When data are observed and analysed sequentially, however, the data analyst typically cannot say with any…

有效的无模型空间预测AI 解读

Predicting the response at an unobserved location is a fundamental problem in spatial statistics. Given the difficulty in modeling spatial dependence, especially in non-stationary cases, model-based prediction intervals are at risk of misspecification bias that can negatively affect their validity. Here we present a new approach for model-free nonparametric spatial prediction based on the conformal prediction machinery. Our key observation is that spatial data can be treated…

Ryan Martin对《通过下注估计有界随机变量均值》的讨论AI 解读

Congratulations to Waudby-Smith and Ramdas (WSR) for their excellent contribution to the rapidly growing literature on anytime-valid inference. Since some of my work involves imprecise probability, Professor Ramdas asked me privately what, if any, connections there are between e-values, etc. and imprecise probability. The answer to his question might be of general interest, so I’ll share it here. Following WSR, let (Xt:t≥1) be a [0,1]-valued process with distribution P∈Pμ…

噪声图像边界的稳健且速率最优的 Gibbs 后验推断AI 解读

Detection of an image boundary when the pixel intensities are measured with noise is an important problem in image segmentation. From a statistical point of view, a challenge is that likelihood-based methods require modeling the pixel intensities inside and outside the image boundary, even though these distributions are typically not of interest. Since misspecification of the pixel intensity distributions can negatively affect inference on the image boundary, it would be…

非正则模型的最优试验设计AI 解读

Classically, Fisher information is the relevant object in defining optimal experimental designs. However, for models that lack certain regularity, the Fisher information does not exist, and hence, there is no notion of design optimality available in the literature. This article seeks to fill the gap by proposing a so-called Hellinger information, which generalizes Fisher information in the sense that the two measures agree in regular problems, but the former also exists for…

《删失下生存函数的非参数广义 fiducial 推断》讨论AI 解读

It is a pleasure to participate in the discussion of the article by Cui & Hannig (2019). The authors are to be congratulated for their efforts and ingenuity in developing what is, to my knowledge, the first fiducial solution to a problem involving an infinite-dimensional parameter of interest. Specifically, the authors build on some existing machinery, summarized recently in Hannig et al. (2016) and the references therein, to construct a generalized fiducial distribution for…

一般后验可信区域的校准AI 解读

Summary Calibration of credible regions derived from under- or misspecified models is an important and challenging problem. In this paper, we introduce a scalar tuning parameter that controls the posterior distribution spread, and develop a Monte Carlo algorithm that sets this parameter so that the corresponding credible region achieves the nominal frequentist coverage probability.

递归贝叶斯预测分布AI 解读

P. Richard Hahna, Ryan Martinb* & Stephen G. Walkerca Booth School of Business, The University of Chicago, Chicago, ILb Department of Statistics, North Carolina State University, NCc Department of Mathematics, University of Texas at Austin, TXCONTACT Ryan Martin rgmarti3@ncsu.edu Department of Statistics, North Carolina State University, NC 27607Supplementary materials for this article are available online. Please go to www.tandfonline.com/r/JASA.ABSTRACTA Bayesian framework…

可信性函数与精确频率学派推断AI 解读

In the frequentist program, inferential methods with exact control on error rates are a primary focus. The standard approach, however, is to rely on asymptotic approximations, which may not be suitable. This article presents a general framework for the construction of exact frequentist procedures based on plausibility functions. It is shown that the plausibility function-based tests and confidence regions have the desired frequentist properties in finite samples—no…

边际推断模型：针对目标参数的无先验概率推断AI 解读

The inferential models (IM) framework provides prior-free, frequency-calibrated, and posterior probabilistic inference. The key is the use of random sets to predict unobservable auxiliary variables connected to the observable data and unknown parameters. When nuisance parameters are present, a marginalization step can reduce the dimension of the auxiliary variable which, in turn, leads to more efficient inference. For regular problems, exact marginalization can be achieved,…

条件推断模型：汇集信息以进行无先验概率推断AI 解读

Summary The inferential model (IM) framework provides valid prior-free probabilistic inference by focusing on predicting unobserved auxiliary variables. But, efficient IM-based inference can be challenging when the auxiliary variable is of higher dimension than the parameter. Here we show that features of the auxiliary variable are often fully observed and, in such cases, a simultaneous dimension reduction and information aggregation can be achieved by conditioning. This…

推断模型：无需先验的后验概率推断框架AI 解读

Posterior probabilistic statistical inference without priors is an important but so far elusive goal. Fisher’s fiducial inference, Dempster–Shafer theory of belief functions, and Bayesian inference with default priors are attempts to achieve this goal but, to date, none has given a completely satisfactory picture. This article presents a new framework for probabilistic inference, based on inferential models (IMs), which not only provides data-dependent probabilistic measures…

混合分布递归估计的一致性AI 解读

Mixture models have received considerable attention recently and Newton [Sankhyā Ser. A 64 (2002) 306–322] proposed a fast recursive algorithm for estimating a mixing distribution. We prove almost sure consistency of this recursive estimate in the weak topology under mild conditions on the family of densities being mixed. This recursive estimate depends on the data ordering and a permutation-invariant modification is proposed, which is an average of the original over…