Design measures maximizing local power of asymptotically uniformly most powerful (AUMP) tests about the value of logitP outside the observation space are characterized.
The behavior of averaged periodograms and cross-periodograms of a broad class of nonstationary processes is studied. The processes include nonstationary ones that are fractional of any order, as well as asymptotically stationary fractional ones. The cross-periodogram can involve two nonstationary processes of possibly different orders, or a nonstationary and an asymptotically stationary one. The averaging takes place either over the whole frequency band, or over one that…
F. Jay Breidt · Richard A. Davis · A. Alexandre Trindade·刊期 2001-08-01 · 卷 29(4)·The Annals of Statistics已编入正刊
全通时间序列模型的最小绝对偏差估计AI 解读
An autoregressive moving average model in which all of the roots of the autoregressive polynomial are reciprocals of roots of the moving average polynomial and vice versa is called an all-pass time series model. All-pass models generate uncorrelated (white noise) time series, but these series are not independent in the non-Gaussian case. An approximation to the likelihood of the model in the case of Laplacian (two-sided exponential) noise yields a modified absolute…
We consider the problem of estimating the mean of a $p$-variate normal distribution with identity covariance matrix when the mean lies in a ball of radius $m$. It follows from general theory that dominating estimators of the maximum likelihood estimator always exist when the loss is squared error. We provide and describe explicit classes of improvements for all problems $(m, p)$. We show that,for small enough $m$, a wide class of estimators, including all Bayes estimators…
We consider a parametric spectral density with power-law behavior about a fractional pole at the unknown frequency $\omega$. The case of known $\omega$, especially $\omega =0$, is standard in the long memory literature. When $omega$ is unknown, asymptotic distribution theory for estimates of parameters, including the (long) memory parameter, is significantly harder. We study a form of Gaussian estimate.
We establish $n$-consistency of the estimate of $\omega$, and discuss…
David F. Findley · Benedikt M. Pötscher · Ching-Zong Wei·刊期 2001-06-01 · 卷 29(3)·The Annals of Statistics已编入正刊
时间序列数组族样本二阶矩的一致收敛AI 解读
We consider abstractly defined time series arrays y t(T), 1 \le t\le T, requiring only that their sample lagged second moments converge and that their end values y1+j(T) and yT-j(T) be of order less than T½ for each j \ge 0. We show that,under quite general assumptions, various types of arrays that arise naturally in time series analysis have these properties,including regression residuals from a time series regression, seasonal adjustments and infinite variance processes…
We study orthogonal decomposition of symmetric statistics based on samples drawn without replacement from finite populations. Several applications to finite population statistics are given:we establish one-term Edgeworth expansions for general asymptotically normal symmetric statistics, prove an Efron-Stein inequality and the consistency of the jackknife esti- mator of variance. Our expansions provide second order a.s. approximations to Wu’s jackknife histogram.
Work due to Junker and more recently due to Junker and Ellis characterized desired latent properties of an educational testing procedure in terms of a collection of other manifest properties. This is important because one can only propose tests for manifest quantities, not latent ones. Here, we complete the conversion of a pair of latent properties to equivalent conditions in terms of four manifest quantities and identify a general method for producing tests for manifest…
We study the problem of estimatingsome unknown regression function in a $\beta$-mixing dependent framework. To this end, we consider some collection of models which are finite dimensional spaces. A penalized least-squares estimator (PLSE) is built on a data driven selected model among this collection. We state non asymptotic risk bounds for this PLSE and give several examples where the procedure can be applied (autoregression, regression with arithmetically $\beta$-mixing…
We discuss here a general approach to the calculation of the asymptotic covariance of $M$-estimates for location parameters in statistical group models when an invariant objective function is used. The calculation reduces to standard tools in group representation theory and the calculation of some constants. Only the constants depend upon the precise forms of the density or of the objective function. If the group is sufficiently large this represents a major simplification…
When fitting, by least squares, a linear model (with an intercept term) with $p$ parameters to $n$ data points, the asymptotic behavior of the residual empirical process is shown to be the same as in the single sample problem provided $p^3 \log^2 (p) /n \to 0$ for any error density having finite variance and a bounded first derivative. No further conditions are imposed on the sequence of design matrices. The result is extended to more general estimates with the property that…
Log-linear modelling plays an important role in many statistical applications, particularly in the analysis of contingency table data.With the advent of powerful new computational techniques such as reversible jump MCMC, Bayesian analyses of these models, and in particular model selection and averaging, have become feasible. Coupled with this is the desire to construct and use suitably flexible prior structures which allow efficient computation while facilitating prior…
Ghosh and Ramamoorthi studied posterior consistency for survival models and showed that the posterior was consistent when the prior on the distribution of survival times was the Dirichlet process prior. In this paper,we study posterior consistency of survival models with neutral to the right process priors which include Dirichlet process priors. A set of sufficient conditions for posterior consistency with neutral to the right process priors are given. Interestingly, not all…
In this paper, we consider nonparametric least squares estimators of the mode of an unknown unimodal regression function. We establish almost sure convergence of these estimators with nearly optimal convergence rates, under the assumption of the exponential tail for the error distributions.
We suggest a method for monotonizing general kernel-type estimators, for example local linear estimators and Nadaraya .Watson estimators. Attributes of our approach include the fact that it produces smooth estimates, indeed with the same smoothness as the unconstrained estimate. The method is applicable to a particularly wide range of estimator types, it can be trivially modified to render an estimator strictly monotone and it can be employed after the smoothing step has…
Marian Hristache · Anatoli Juditsky · Vladimir Spokoiny·刊期 2001-06-01 · 卷 29(3)·The Annals of Statistics已编入正刊
单指标模型中指标系数的直接估计AI 解读
Single-index modeling is widely applied in,for example,econometric studies as a compromise between too restrictive parametric models and flexible but hardly estimable purely nonparametric models. By such modeling the statistical analysis usually focuses on estimating the index coefficients. The average derivative estimator (ADE) of the index vector is based on the fact that the average gradient of a single index function $f(x^{\top}\beta)$ is proportional to the index vector…
We compute the rate at which the posterior distribution concentrates around the true parameter value. The spaces we work in are quite general and include in finite dimensional cases. The rates are driven by two quantities: the size of the space, as measured by bracketing entropy, and the degree to which the prior concentrates in a small ball around the true parameter. We consider two examples.
Scatterplot smoothers estimate a regression function y = f(x) by local averaging of the observed data points (xi, yi). In using a smoother, the statistician must choose a “window width,” a crucial smoothing parameter that says just how locally the averaging is done. This paper concerns the databased choice of a smoothing parameter for splinelike smoothers, focusing on the comparison of two popular methods, Cp and generalized maximum likelihood. The latter is the MLE within…
We derive the asymptotic distribution of the sequential empirical process of the squared residuals of an ARCH(p) sequence. Unlike the residuals of an ARMA process, these residuals do not behave in this context like asymptotically independent random variables, and the asymptotic distribution involves a term depending on the parameters of the model. We show that in certain applications, including the detection of changes in the distribution of the unobservable innovations, our…
This paper is concerned with nonsequential optimal designs for a class of nonlinear growth models, which includes the asymptotic regression model. This design problem is intimately related to the problem of finding optimal designs for polynomial regression models with only partially known heteroscedastic structure. In each case, a straightforward application of the usual Doptimality criterion would lead to designs which depend on the unknown underlying parameters. To…
In this paper, the problem of constructing optimal blocked regular fractional factorial designs is considered. The concept of minimum aberration due to Fries and Hunter is a wellaccepted criterion for selecting good unblocked fractional factorial designs. Cheng, Steinberg and Sun showed that a minimum aberration design of resolution three or higher maximizes the number of twofactor interactions which are not aliases of main effects and also tends to distribute these…
Dan Geiger · David Heckerman · Henry King · Christopher Meek·刊期 2001-04-01 · 卷 29(2)·The Annals of Statistics已编入正刊
分层指数族:图模型与模型选择AI 解读
We describe a hierarchy of exponential families which is useful for distinguishing types of graphical models. Undirected graphical models with no hidden variables are linear exponential families (LEFs). Directed acyclic graphical (DAG) models and chain graphs with no hidden variables, includ ing DAG models with several families of local distributions, are curved exponential families (CEFs). Graphical models with hidden variables are what we term stratified exponential…
The subject of this paper is autoregressive (AR) modeling of a stationary, Gaussian discrete time process, based on a finite sequence of observations. The process is assumed to admit an AR($\infty$) representation with exponentially decaying coefficients. We adopt the nonparametric minimax framework and study how well the process can be approximated by a finiteorder AR model. A lower bound on the accuracy of AR approximations is derived, and a nonasymptotic upper bound on…
We develop a nonparametric estimation theory in a nonstationary environment, more precisely in the framework of null recurrent Markov chains. An essential tool is the split chain, which makes it possible to decompose the times series under consideration into independent and identical parts. A tail condition on the distribution of the recurrence time is introduced. This condition makes it possible to prove weak convergence results for sums of functions of the process…
We consider the problem of estimating the mean of a p-variate normal distribution with identity covariance matrix when the mean lies in a ball of radius m. It follows from general theory that dominating estimators of the maximum likelihood estimator always exist when the loss is squared error. We provide and describe explicit classes of improvements for all problems (m,p). We show that,for small enough m, a wide class of estimators, including all Bayes estimators…
We consider a parametric spectral density with power-law behavior about a fractional pole at the unknown frequency ω. The case of known ω, especially ω=0, is standard in the long memory literature. When omega is unknown, asymptotic distribution theory for estimates of parameters, including the (long) memory parameter, is significantly harder. We study a form of Gaussian estimate.
We establish n-consistency of the estimate of ω, and discuss…
We study the problem of estimatingsome unknown regression function in a β-mixing dependent framework. To this end, we consider some collection of models which are finite dimensional spaces. A penalized least-squares estimator (PLSE) is built on a data driven selected model among this collection. We state non asymptotic risk bounds for this PLSE and give several examples where the procedure can be applied (autoregression, regression with arithmetically β-mixing…
We discuss here a general approach to the calculation of the asymptotic covariance of M-estimates for location parameters in statistical group models when an invariant objective function is used. The calculation reduces to standard tools in group representation theory and the calculation of some constants. Only the constants depend upon the precise forms of the density or of the objective function. If the group is sufficiently large this represents a major simplification…
When fitting, by least squares, a linear model (with an intercept term) with p parameters to n data points, the asymptotic behavior of the residual empirical process is shown to be the same as in the single sample problem provided p3log2(p)/n→0 for any error density having finite variance and a bounded first derivative. No further conditions are imposed on the sequence of design matrices. The result is extended to more general estimates with the property that…
Single-index modeling is widely applied in,for example,econometric studies as a compromise between too restrictive parametric models and flexible but hardly estimable purely nonparametric models. By such modeling the statistical analysis usually focuses on estimating the index coefficients. The average derivative estimator (ADE) of the index vector is based on the fact that the average gradient of a single index function f(x⊤β) is proportional to the index vector…
The subject of this paper is autoregressive (AR) modeling of a stationary, Gaussian discrete time process, based on a finite sequence of observations. The process is assumed to admit an AR(∞) representation with exponentially decaying coefficients. We adopt the nonparametric minimax framework and study how well the process can be approximated by a finiteorder AR model. A lower bound on the accuracy of AR approximations is derived, and a nonasymptotic upper bound on…