Hua Liang · Wolfgang Härdle · Raymond J. Carroll·刊期 1999-10-01 · 卷 27(5)·The Annals of Statistics已编入正刊
半参数部分线性测量误差模型的估计AI 解读
We consider the partially linear model relating a response $Y$ to predictors ($X, T$) with mean function $X^{\top}\beta + g(T)$ when the $X$’s are measured with additive error. The semiparametric likelihood estimate of Severini and Staniswalis leads to biased estimates of both the parameter $\beta$ and the function $g(\cdot)$ when measurement error is ignored. We derive a simple modification of their estimator which is a semiparametric version of the usual parametric…
This paper discusses the properties of an estimator of the memory parameter of a stationary long-memory time-series originally proposed by Robinson. As opposed to ‘‘narrow-band’’ estimators of the memory parameter (such as the Geweke and Porter-Hudak or the Gaussian semiparametric estimators) which use only the periodogram ordinates belonging to an interval which degenerates to zero as the sample size $n$ increases, this estimator builds a model of the spectral density of…
Locally asymptotically optimal tests based on autoregression rank scores are constructed for testing linear constraints on the structural parameters of AR processes. Such tests are asymptotically distribution free and do not require the estimation of nuisance parameters. They constitute robust, flexible and quite powerful alternatives to existing methods such as the classical correlogram-based parametric tests, the Gaussian Lagrange multiplier tests, the optimal non-Gaussian…
The nonparametric empirical likelihood approach is used to obtain simultaneous confidence tubes for multiple quantile plots based on $k$ independent (possibly right-censored) samples. These tubes are asymptotically distribution free, except when both $k \geq 3$ and censoring is present. Pointwise versions of the confidence tubes, however, are asymptotically distribution free in all cases. The various confidence tubes are valid under minimal conditions. The proposed methods…
Piet Groeneboom · Gerard Hooghiemstra · Hendrik P. Lopuhaä·刊期 1999-08-01 · 卷 27(4)·The Annals of Statistics已编入正刊
Groeneboom introduced a jump process that can be used (among other things) to study the asymptotic properties of the Grenander estimator of a monotone density. In this paper we derive the asymptotic normality of a suitably rescaled version of the $L_1$ error of the Grenander estimator, using properties of this jump process.
Usually, when testing the null hypothesis that a distribution has one mode against the alternative that it has two, the null hypothesis is interpreted as entailing that the density of the sampling distribution has a unique point of zero slope, which is a local maximum. In this paper we argue that a more appropriate null hypothesis is that the density has two points of zero slope, of which one is a local maximum and the other is a shoulder. We show that when a test for a…
Holger Dette · Linda M. Haines · Lorens Imhof·刊期 1999-08-01 · 卷 27(4)·The Annals of Statistics已编入正刊
有理模型与加权多项式回归的最优设计AI 解读
In this paper $D$-optimal designs for the weighted polynomial regression model of degree $p$ with efficiency function $(1 + x^2)^{-n}$ are presented. Interest in these designs stems from the fact that they are equivalent to locally $D$-optimal designs for inverse quadratic polynomial models. For the unrestricted design space $\mathbb{R}$ and $p < n$, the $D$-optimal designs put equal masses on $p + 1$ points which coincide with the zeros of an ultraspherical polynomial,…
A novel approach for constructing goodness-of-fit techniques in arbitrary finite dimensions is presented. Testing problems are considered as well as the construction of diagnostic plots. The approach is based on some new notions of mass concentration, and in fact, our basic testing problems are formulated as problems of ‘‘goodness-of-concentration.’’ It is this connection to concentration of measure that makes the approach conceptually simple. The presented test statistics…
In this paper, we address the problem of testing hypotheses using the likelihood ratio test statistic in nonidentifiable models, with application to model selection in situations where the parametrization for the larger model leads to nonidentifiability in the smaller model. We give two major applications: the case where the number of populations has to be tested in a mixture and the case of stationary ARMA$(p, q)$ processes where the order $(p, q)$ has to be tested. We give…
The breakdown point behavior of $M$-estimators in linear models with fixed designs, arising from planned experiments or qualitative factors, is characterized. Particularly, this behavior at fixed designs is quite different from that at designs which can be corrupted by outliers, the situation prevailing in the literature. For fixed designs, the breakdown points of robust $M$-estimators (those with bounded derivative of the score function), depend on the design and the…
Strong consistency for maximum quasi-likelihood estimators of regression parameters in generalized linear regression models is studied. Results parallel to the elegant work of Lai, Robbins and Wei and Lai and Wei on least squares estimation under both fixed and adaptive designs are obtained. Let $y_1,\dots, y_n$ and $x_1,\dots, x_n$ be the observed responses and their corresponding design points ($p \times 1$ vectors), respectively. For fixed designs, it is shown that if the…
In the regression model $\mathbf{Y} = \eta + \mathbf{BX} + \mathbf{Z}$ with $\mathbf{Z}$ unobserved, $\mathscr{E}\mathbf{Z} = \mathbf{0}$ and $\mathscr{E}\mathbf{ZZ}' = \mathbf{\Sigma}_{ZZ}$, the least squares estimator of $\mathbf{B}$ is $\hat{\mathbf{B}} = \mathbf{S}_{YX}\mathbf{S}_{XX}^{-1}$. If the rank of $\mathbf{B}$ is known to be $k$ less than the dimensions of $\mathbf{Y}$ and $\mathbf{X}$, the reduced rank regression estimator of $\mathbf{B}$, say $\mathbf{B}_k$,…
We consider the problem of estimating a mixture proportion using data from two different distributions as well as from a mixture of them. Under the model assumption that the log-likelihood ratio of the two densities is linear in the observations, we develop an empirical likelihood ratio based statistic for constructing confidence intervals for the mixture proportion. Under some regularity conditions, it is shown that this statistic converges to a chi-squared random variable.…
Juan A. Cuesta-Albertos · Carlos Matrán · Jes{\'u}s M. Rodríguez-Rodríguez · Eustasio del Barrio·刊期 1999-08-01 · 卷 27(4)·The Annals of Statistics已编入正刊
基于 L₂-Wasserstein 距离的拟合优度检验AI 解读
We consider the Wasserstein distance between a sample distribution and the set of normal distributions as a measure of nonnormality. By considering the standardized version of this distance we obtain a version of Shapiro–Wilk’s test of normality. The asymptotic behavior of the statistic is studied using approximations of the quantile process by Brownian bridges. This method differs from the “ad hoc” method of de Wet and Venter and permits a similar analysis for testing other…
The connection between large and small deviation results for the signed square root statistic $R$ is studied, both for likelihoods and for likelihood-like criterion functions. We show that if $p - 1$ Barlett identities are satisfied to first order, but the $p$th identity is violated to this order, then $\operator{cum}_q(R) = O(n^{-q/2})$ for $3 \leq q < p$, whereas $\operator{cum}_p(R) = \kappa_p n^{-(p-2)/2} + O(n^{-p/2})$. We also show that the large deviation behavior of $R$…
Given a statistical functional T and a parametric family of distributions, a bias reduced functional $\tilde{T}$ is defined by setting the expected value of the statistic equal to the observed value. Under certain regularity conditions this new statistic, called the target estimator, will have smaller bias and mean square error than the original estimator. The theoretical aspects are analyzed by using higher order von Mises expansions. Several examples are given, including $M$…
In this paper we study the problem of testing the functional form of a given regression model. A consistent test is proposed which is based on the difference of the least squares variance estimator in the assumed regression model and a nonparametric variance estimator. The corresponding test statistic can be shown to be asymptotically normal under the null hypothesis and under fixed alternatives with different rates of convergence corresponding to both cases. This provides a…
We consider hierarchical mixtures-of-experts (HME) models where exponential family regression models with generalized linear mean functions of the form $\psi(\alpha + \mathbf{x}^T \mathbf{\beta})$ are mixed. Here $\psi(\cdot)$ is the inverse link function. Suppose the true response $y$ follows an exponential family regression model with mean function belonging to a class of smooth functions of the form $\psi(h(\mathbf{x}))$ where $h(\cdot)\in W_{2; K_0}^{\infty}$ (a Sobolev…
We study wavelet function estimation via the approach of block thresholding and ideal adaptation with oracle. Oracle inequalities are derived and serve as guides for the selection of smoothing parameters. Based on an oracle inequality and motivated by the data compression and localization properties of wavelets, an adaptive wavelet estimator for nonparametric regression is proposed and the optimality of the procedure is investigated. We show that the estimator achieves…
Luis A. García-Escudero · Alfonso Gordaliza · Carlos Matrán·刊期 1999-06-01 · 卷 27(3)·The Annals of Statistics已编入正刊
多元广义修剪 k 均值的中心极限定理AI 解读
A central limit theorem for generalized trimmed $k$-means is obtained in a very general framework that covers the multivariate setting, general penalty functions and general $k \geq 1$. Several applications, including the location estimator case $(k = 1)$ for elliptical distributions and the construction of multivariate (not necessarily connected) tolerance zones, are also given.
We are concerned here with establishing the consistency and asymptotic normality for the maximum likelihood estimator of a “merit vector” $(u_0,\dots,u_t)$, representing the merits of $t +1$ teams (players, treatments, objects), under the Bradley–Terry model, as $t \to \infty$. This situation contrasts with the well-known Neyman–Scott problem under which the number of parameters grows with $t$ (the amount of sampling), and for which the maximum likelihood estimator fails…
We study a simple “horizon model” for the problem of recovering an image from noisy data; in this model the image has an edge with $\alpha$-Hölder regularity. Adopting the viewpoint of computational harmonic analysis, we develop an overcomplete collection of atoms called wedgelets, dyadically organized indicator functions with a variety of locations, scales and orientations. The wedgelet representation provides nearly optimal representations of objects in the horizon model,…
Regina Y. Liu · Jesse M. Parelius · Kesar Singh·刊期 1999-06-01 · 卷 27(3)·The Annals of Statistics已编入正刊
基于数据深度的多元分析:描述统计、图形与推断(含讨论及作者答复)AI 解读
A data depth can be used to measure the “depth” or “outlyingness” of a given multivariate sample with respect to its underlying distribution. This leads to a natural center-outward ordering of the sample points. Based on this ordering, quantitative and graphical methods are introduced for analyzing multivariate distributional characteristics such as location, scale, bias, skewness and kurtosis, as well as for comparing inference methods. All graphs are one-dimensional curves…
Let $(X_{1},Y_{1}), (X_{2},Y_{2}),\dots,(X_{n},Y_{n})$ be a random sample from a bivariate distribution function $F$ which is in the domain of attraction of a bivariate extreme value distribution function $G$. A subset $C$ of $\mathbb{R}^{2}$ is given, which contains none of the observations. We shall give an asymptotic confidence interval for $\Pr((X_{i},Y_{i}) \in C)$ under certain conditions.
We consider the partially linear model relating a response Y to predictors (X,T) with mean function X⊤β+g(T) when the X’s are measured with additive error. The semiparametric likelihood estimate of Severini and Staniswalis leads to biased estimates of both the parameter β and the function g(⋅) when measurement error is ignored. We derive a simple modification of their estimator which is a semiparametric version of the usual parametric…
This paper discusses the properties of an estimator of the memory parameter of a stationary long-memory time-series originally proposed by Robinson. As opposed to ‘‘narrow-band’’ estimators of the memory parameter (such as the Geweke and Porter-Hudak or the Gaussian semiparametric estimators) which use only the periodogram ordinates belonging to an interval which degenerates to zero as the sample size n increases, this estimator builds a model of the spectral density of…
The nonparametric empirical likelihood approach is used to obtain simultaneous confidence tubes for multiple quantile plots based on k independent (possibly right-censored) samples. These tubes are asymptotically distribution free, except when both k≥3 and censoring is present. Pointwise versions of the confidence tubes, however, are asymptotically distribution free in all cases. The various confidence tubes are valid under minimal conditions. The proposed methods…
Asymptotic normality of the L1 error of the Grenander estimator
Groeneboom introduced a jump process that can be used (among other things) to study the asymptotic properties of the Grenander estimator of a monotone density. In this paper we derive the asymptotic normality of a suitably rescaled version of the L1 error of the Grenander estimator, using properties of this jump process.
In this paper D-optimal designs for the weighted polynomial regression model of degree p with efficiency function (1+x2)−n are presented. Interest in these designs stems from the fact that they are equivalent to locally D-optimal designs for inverse quadratic polynomial models. For the unrestricted design space R and p<n, the D-optimal designs put equal masses on p+1 points which coincide with the zeros of an ultraspherical polynomial,…
In this paper, we address the problem of testing hypotheses using the likelihood ratio test statistic in nonidentifiable models, with application to model selection in situations where the parametrization for the larger model leads to nonidentifiability in the smaller model. We give two major applications: the case where the number of populations has to be tested in a mixture and the case of stationary ARMA(p,q) processes where the order (p,q) has to be tested. We give…
Breakdown points and variation exponents of robust M-estimators in linear models
The breakdown point behavior of M-estimators in linear models with fixed designs, arising from planned experiments or qualitative factors, is characterized. Particularly, this behavior at fixed designs is quite different from that at designs which can be corrupted by outliers, the situation prevailing in the literature. For fixed designs, the breakdown points of robust M-estimators (those with bounded derivative of the score function), depend on the design and the…
Strong consistency for maximum quasi-likelihood estimators of regression parameters in generalized linear regression models is studied. Results parallel to the elegant work of Lai, Robbins and Wei and Lai and Wei on least squares estimation under both fixed and adaptive designs are obtained. Let y1,…,yn and x1,…,xn be the observed responses and their corresponding design points (p×1 vectors), respectively. For fixed designs, it is shown that if the…
In the regression model Y=η+BX+Z with Z unobserved, EZ=0 and EZZ′=ΣZZ, the least squares estimator of B is B^=SYXSXX−1. If the rank of B is known to be k less than the dimensions of Y and X, the reduced rank regression estimator of B, say Bk,…
Tests of goodness of fit based on the L2-Wasserstein distance
The connection between large and small deviation results for the signed square root statistic R is studied, both for likelihoods and for likelihood-like criterion functions. We show that if p−1 Barlett identities are satisfied to first order, but the pth identity is violated to this order, then $\operator{cum}_q(R) = O(n^{-q/2})$ for 3≤q<p, whereas $\operator{cum}_p(R) = \kappa_p n^{-(p-2)/2} + O(n^{-p/2})$. We also show that the large deviation behavior of R…
Given a statistical functional T and a parametric family of distributions, a bias reduced functional T~ is defined by setting the expected value of the statistic equal to the observed value. Under certain regularity conditions this new statistic, called the target estimator, will have smaller bias and mean square error than the original estimator. The theoretical aspects are analyzed by using higher order von Mises expansions. Several examples are given, including M…
We consider hierarchical mixtures-of-experts (HME) models where exponential family regression models with generalized linear mean functions of the form ψ(α+xTβ) are mixed. Here ψ(⋅) is the inverse link function. Suppose the true response y follows an exponential family regression model with mean function belonging to a class of smooth functions of the form ψ(h(x)) where h(⋅)∈W2;K0∞ (a Sobolev…
A central limit theorem for multivariate generalized trimmed k-means
A central limit theorem for generalized trimmed k-means is obtained in a very general framework that covers the multivariate setting, general penalty functions and general k≥1. Several applications, including the location estimator case (k=1) for elliptical distributions and the construction of multivariate (not necessarily connected) tolerance zones, are also given.
We are concerned here with establishing the consistency and asymptotic normality for the maximum likelihood estimator of a “merit vector” (u0,…,ut), representing the merits of t+1 teams (players, treatments, objects), under the Bradley–Terry model, as t→∞. This situation contrasts with the well-known Neyman–Scott problem under which the number of parameters grows with t (the amount of sampling), and for which the maximum likelihood estimator fails…
We study a simple “horizon model” for the problem of recovering an image from noisy data; in this model the image has an edge with α-Hölder regularity. Adopting the viewpoint of computational harmonic analysis, we develop an overcomplete collection of atoms called wedgelets, dyadically organized indicator functions with a variety of locations, scales and orientations. The wedgelet representation provides nearly optimal representations of objects in the horizon model,…
Let (X1,Y1),(X2,Y2),…,(Xn,Yn) be a random sample from a bivariate distribution function F which is in the domain of attraction of a bivariate extreme value distribution function G. A subset C of R2 is given, which contains none of the observations. We shall give an asymptotic confidence interval for Pr((Xi,Yi)∈C) under certain conditions.