论文检索

大规模伯努利数据的平滑样条 ANOVA 模型与随机化 GACVAI 解读

We propose the randomized Generalized Approximate Cross Validation (ranGACV) method for choosing multiple smoothing parameters in penalized likelihood estimates for Bernoulli data. The method is intended for application with penalized likelihood smoothing spline ANOVA models. In addition we propose a class of approximate numerical methods for solving the penalized likelihood variational problem which, in conjunction with the ranGACV method allows the application of smoothing…

变量选择问题AI 解读

The problem of variable selection is one of the most pervasive model selection problems in statistical applications. Often referred to as the problem of subset selection, it arises when one wants to model the relationship between a variable of interest and a subset of potential explanatory variables or predictors, but there is uncertainty about which subset to use. This vignette reviews some of the key developments that have led to the wide variety of approaches for this…

Lasso 型估计量的渐近性质AI 解读

We consider the asymptotic behavior ofregression estimators that minimize the residual sum of squares plus a penalty proportional to $\sum|\beta_j|^{\gamma}$. for some $\gamma > 0$. These estimators include the Lasso as a special case when $\gamma = 1$. Under appropriate conditions, we show that the limiting distributions can have positive probability mass at 0 when the true value of the parameter is 0.We also consider asymptotics for “nearly singular” designs.

通过模型选择自适应估计二次泛函AI 解读

We consider the problem of estimating $\|s\|^2$ when $s$ belongs to some separable Hilbert space and one observes the Gaussian process $Y(t) = \langles, t\rangle + \sigmaL(t)$, for all $t \epsilon \mathbb{H}$,where $L$ is some Gaussian isonormal process. This framework allows us in particular to consider the classical “Gaussian sequence model” for which $\mathbb{H} = l_2(\mathbb{N}*)$ and $L(t) = \sum_{\lambda\geq1}t_{\lambda}\varepsilon_{\lambda}$, where $(\varepsilon_{\lambda})_{\lambda\geq1}$…

偏最小二乘回归的特殊收缩性质AI 解读

Summary Partial least squares regression has been widely adopted within some areas as a useful alternative to ordinary least squares regression in the manner of other shrinkage methods such as principal components regression and ridge regression. In this paper we examine the nature of this shrinkage and demonstrate that partial least squares regression exhibits some undesirable properties.

包含交互项与平滑效应的贝叶斯回归建模AI 解读

There have been many recent suggestions as to how to build and estimate flexible Bayesian regression models, using constructs such as trees, neural networks, and Gaussian processes. Although there is much to commend these methods, their implementation and interpretation can be daunting for practitioners. This article presents a spline-based methodology for flexible Bayesian regression that is quite simple in terms of computation and interpretation. Smooth bivariate…

含交互项与平滑效应的贝叶斯回归建模AI 解读

There have been many recent suggestions as to how to build and estimate flexible Bayesian regression models, using constructs such as trees, neural networks, and Gaussian processes. Although there is much to commend these methods, their implementation and interpretation can be daunting for practitioners. This article presents a spline-based methodology for flexible Bayesian regression that is quite simple in terms of computation and interpretation. Smooth bivariate…

多重二次惩罚下的建模与平滑参数估计AI 解读

Summary Penalized likelihood methods provide a range of practical modelling tools, including spline smoothing, generalized additive models and variants of ridge regression. Selecting the correct weights for penalties is a critical part of using these methods and in the single-penalty case the analyst has several well-founded techniques to choose from. However, many modelling problems suggest a formulation employing multiple penalties, and here general methodology is lacking.…

多元正态协方差矩阵广义线性模型的极大似然估计AI 解读

The positive-definiteness constraint is the most awkward stumbling block in modelling the covariance matrix. Pourahmadi's (1999) unconstrained parameterisation models covariance using covariates in a similar manner to mean modelling in generalised linear models. The new covariance parameters have statistical interpretation as the regression coefficients and logarithms of prediction error variances corresponding to regressing a response on its predecessors. In this paper, the…

持续时间依赖与非参数异质性：蒙特卡洛研究AI 解读

We examine the behaviour of the nonparametric maximum likelihood estimator (NPMLE) for a discrete duration model with unobserved heterogeneity and unknown duration dependence. We find that a nonparametric specification of either the duration dependence or unobserved heterogeneity, when the other feature of the hazard is known to be absent, leads to estimators that are well behaved even in modestly sized samples. In contrast, there is a large and systematic bias in the…

张量积空间 ANOVA 模型AI 解读

To deal with the curse of dimensionality in high-dimensional nonparametric problems, we consider using tensor product space ANOVA models, which extend the popular additive models and are able to capture interactions of any order. The multivariate function is given an ANOVA decomposition, that is, it is expressed as a constant plus the sum of functions of one variable (main effects), plus the sum of functions of two variables (two-factor interactions)and so on. We assume the…

REACT 散点图平滑器：通过基表示的简约性实现超效率AI 解读

REACT estimators for the mean of a linear model involve three steps: transforming the model to a canonical form that provides an economical representation of the unknown mean vector, estimating the risks of a class of candidate linear shrinkage estimators, and adaptively selecting the candidate estimator that minimizes estimated risk. Applied to one- or higher-way layouts, the REACT method generates automatic scatterplot smoothers that compete well on standard datasets with…

REACT 散点平滑：通过简约基表示实现超效率AI 解读

REACT estimators for the mean of a linear model involve three steps: transforming the model to a canonical form that provides an economical representation of the unknown mean vector, estimating the risks of a class of candidate linear shrinkage estimators, and adaptively selecting the candidate estimator that minimizes estimated risk. Applied to one- or higher-way layouts, the REACT method generates automatic scatterplot smoothers that compete well on standard datasets with…

杂记：惩罚样条回归的最优平滑程度AI 解读

The optimal amount of smoothing in penalised spline regression is investigated. In particular, a simple closed form approximation to the optimal smoothing parameter is derived. Comparisons with its exact counterpart show it to be a useful starting point for measuring the optimal amount of smoothing in penalised spline regression. It also lends itself to the development of quick and simple rules for automatic smoothing parameter selection.

利用经验复杂度进行自适应模型选择AI 解读

Given $n$ independent replicates of a jointly distributed pair $(X, Y) \in \mathscr{R}^d \times \mathscr{R}$, we wish to select from a fixed sequence of model classes $\mathscr{F}_1, \mathscr{F}_2,\dots$ a deterministic prediction rule $f: \mathscr{R}^d \to \mathscr{R}$ whose risk is small.We investigate the possibility of empirically assessing the complexity of each model class, that is, the actual difficulty of the estimation problem within each class. The estimated…

多变量判别分析AI 解读

Many statistical methods for discriminant analysis do not adapt well or easily to situations where the number of variables is large, possibly even exceeding the number of cases in the training set. We explore a variety of methods for providing robust identification of future samples in this situation. We develop a range of flexible Bayesian methods, and primarily a new hierarchical covariance compromise method, akin to regularized discriminant analysis. Although the methods…

Good 非参数最大似然密度估计量的最优收敛率AI 解读

We study maximum penalized likelihood density estimation using the first roughness penalty functional of Good. We prove a simple pointwise comparison result with a kernel estimator based on the two-sided exponential kernel. This leads to $L^1$ convergence results similar to those for kernel estimators. We also prove Hellinger distance bounds for the roughness penalized estimator.

存在测量误差时的非参数回归AI 解读

In many regression applications the independent variable is measured with error. When this happens, conventional parametric and nonparametric regression techniques are no longer valid. We consider two different approaches to nonparametric regression. The first uses the SIMEX, simulation-extrapolation, method and makes no assumption about the distribution of the unobserved error-prone predictor. For this approach we derive an asymptotic theory for kernel regression which has…

利用数据驱动先验进行加性非参数回归的变量选择与函数估计AI 解读

A hierarchical Bayesian approach is proposed for variable selection and function estimation in additive nonparametric Gaussian regression models and additive nonparametric binary regression models. The prior for each component function is an integrated Wiener process resulting in a posterior mean estimate that is a cubic smoothing spline. Each of the explanatory variables is allowed to be in or out of the model, and the regression functions are estimated by model averaging.…

利用平滑样条进行广义可加混合模型推断AI 解读

Summary Generalized additive mixed models are proposed for overdispersed and correlated data, which arise frequently in studies involving clustered, hierarchical and spatial designs. This class of models allows flexible functional dependence of an outcome variable on covariates by using nonparametric regression, while accounting for correlation between observations by using random effects. We estimate nonparametric functions by using smoothing splines and jointly estimate…

Wedgelet：边缘的近极小极大估计AI 解读

We study a simple “horizon model” for the problem of recovering an image from noisy data; in this model the image has an edge with $\alpha$-Hölder regularity. Adopting the viewpoint of computational harmonic analysis, we develop an overcomplete collection of atoms called wedgelets, dyadically organized indicator functions with a variety of locations, scales and orientations. The wedgelet representation provides nearly optimal representations of objects in the horizon model,…

带宽选择：经典方法还是插件法？AI 解读

Bandwidth selection for procedures such as kernel density estimation and local regression have been widely studied over the past decade. Substantial “evidence” has been collected to establish superior performance of modern plug-in methods in comparison to methods such as cross validation; this has ranged from detailed analysis of rates of convergence, to simulations, to superior performance on real datasets. In this work we take a detailed look at some of this evidence,…

均匀分布对单调密度备择的检验AI 解读

The paper is concerned with testing uniformity versus a monotone den-sity. This problem arises in two important contexts, after transformations, testing whether a sample is a simple random sample or a biased sample, and testing whether the intensity function of a nonhomogeneous Poisson process is constant against monotone alternatives. A penalized likelihood ratio test ($P$-test) and a Dip likelihood test ($D$-test) are developed. The $D$-test is analogous to Hartigan and…

一类局部与全局稳健的回归估计量AI 解读

We present a new class of regression estimates called generalized τ estimates. These estimates are defined by minimizing the τ scale of the weighted residuals, with weights that penalize high-leverage observations. Like the τ estimates, the generalized τ estimates utilize for their definition two loss functions, ρ1 and ρ2, which together with the weights can be chosen to achieve simultaneously high breakdown point, finite gross error sensitivity, and high efficiency. We…