Wetherill's estimator $\bar{w}$ is asymptotically equivalent to the mean of peaks and valleys in the sequence of responses in an up-and-down experiment. The asymptotic distribution of $\bar{w}$ is derived and the asymptotic variance expression is simplified. Some values of asymptotic means and variances are calculated for logistic response. They are compared with analogous values for the estimator suggested by Dixon and Mood. These estimators are also compared by some…
The problem of estimating shape and scale parameters for a distribution with regularly varying tails is related to that of nonparametrically estimating a density at a fixed point, in that optimal construction of the estimators depends substantially upon unknown features of the distribution. We show how to overcome this problem by using adaptive methods. Our main results hold very generally, for a large class of adaptive estimators. Later we consider specific versions of…
Suppose one is able to observe sequentially a series of independent observations $X_1, X_2, \cdots$ such that $X_1, X_2, \cdots, X_{\nu-1}$ are iid distributed according to a known distribution $F_0$ and $X_\nu, X_{\nu+1}, \cdots$ are iid distributed according to a known distribution $F_1$. Assume that $\nu$ is unknown and the problem is to raise an alarm as soon as possible after the distribution changes from $F_0$ to $F_1$. Formally, the problem is to find a stopping rule $N$…
The following problem is treated: Given $s$ not-necessarily-random samples from an unknown distribution $F$, and assuming that we know the sampling rule of each sample, is it possible to combine the samples in order to estimate $F$, and if so what is the natural way of doing it? More formally, this translates to the problem of determining whether there exists a nonparametric maximum likelihood estimate (NPMLE) of $F$ on the basis of $s$ samples from weighted versions of $F$,…
The dip test measures multimodality in a sample by the maximum difference, over all sample points, between the empirical distribution function, and the unimodal distribution function that minimizes that maximum difference. The uniform distribution is the asymptotically least favorable unimodal distribution, and the distribution of the test statistic is determined asymptotically and empirically when sampling from the uniform.
An asymptotic expansion of the nonnull distribution of the Wilks statistic for testing the linear hypothesis in multivariate analysis of variance is obtained up to the order $N^{-2}$ where $N$ is the sample size, for the first time in terms of noncentral beta distributions. The asymptotic distributions are better than the ones available in Anderson (1958) in the null case and in Sugiura and Fujikoshi (1969) and Posten and Bergman (1964) in the nonnull case. In fact, for…
Wlodzimierz Greblicki · Adam Krzyzak · Miroslaw Pawlak·刊期 1984-12-01 · 卷 12(4)·The Annals of Statistics已编入正刊
核回归估计的分布无关逐点一致性AI 解读
An estimate $\sum^n_{i=1} Y_iK((x - X_i)/h)/\sum^n_{j=1} K((x - X_j)/h)$, calculated from a sequence $(X_1, Y_1), \cdots, (X_n, Y_n)$ of independent pairs of random variables distributed as a pair $(X, Y)$, converges to the regression $E\{Y\mid X = x\}$ as $n$ tends to infinity in probability for almost all $(\mu) x \in R^d$, provided that $E|Y| < \infty, h \rightarrow 0$ and $nh^d \rightarrow \infty$ as $n \rightarrow \infty$. The result is true for all distributions $\mu$ o…
The problem of estimating an endpoint of a distribution is revisited, using the bootstrap and random subsample methods. Contrary to an example in Bickel and Freedman (1981) suggesting that these methods do not work here, it is shown that one can in fact construct asymptotically valid confidence intervals in some situations.
As an estimator of the population mean, the sample mean based only on the distinct units possesses a remarkable invariance property. Under three forms of simple random sampling, viz. simple random sampling without replacement (SRSWOR), simple random sampling with replacement (SRSWR), and fixed cost simple random sampling (SRSFC), it is admissible and unbiased; and asymptotically normally distributed if and only if the Erdos-Renyi-Hajek condition is satisfied. An important…
In this paper we consider exponential families of distributions and obtain under certain conditions a uniform large deviation result about the tail probability $P_\partial(\phi_\partial(\bar{X}_n) > \varepsilon), \varepsilon > 0$, where $\partial$ is the natural parameter and $\phi_\partial(\bar{X}_n)$ is the $\log$ likelihood ratio statistic for testing the null hypothesis $\{\partial\}$. The technique involves approximating certain convex compact sets in $R^k$ by…
We consider linear estimators for the mean $\theta$ of a Gaussian distribution $N(\theta, C)$ on a Hilbert space, when the covariance operator $C$ is known. It was argued in a previous work that the natural class of linear estimators is the class of measurable linear transformations. Using the simplest quadratic loss we prove that the linear estimator $L$ is admissible if and only if the operator $C^{-1/2}LC^{1/2}$ is Hilbert-Schmidt, self-adjoint, its eigenvalues are all…
Consider the problem of estimating, in a Bayesian framework and in the presence of additive Gaussian noise, a signal which is a step function. Best linear estimates and Bayes estimates are derived, evaluated and compared. A characterization of the Bayes estimates is presented. This characterization has an intuitive interpretation and also provides a way to compute the Bayes estimates with a number of operations of the order of $T^3$ where $T$ is the fixed time span. An…
In Hannan (1980), some limiting properties of the order selection criteria, AIC, BIC, and $\phi(p, q)$ for modeling stationary time series were derived. In this paper, we generalize these properties to the case in which the underlying process follows a nonstationary autoregressive model. We show that BIC and $\phi(p, 0)$ are weakly consistent. For the AIC, we prove that the asymptotic distribution given by Shibata (1976) for the stationary autoregressive models continues to…
This paper considers the asymptotic behavior of the maximum likelihood estimators (mle's) of the probabilities of a mixed Poisson distribution with a nonparametric mixing distribution. The vector of estimated probabilities is shown to converge in probability to the vector of mixed probabilities at rate $n^{1/2-\varepsilon}$ for any $\varepsilon > 0$ under a generalized $\chi^2$ distance function. It is then shown that any finite set of the mle's has the same joint limiting…
Suppose $F$ is a mixture of a known parametric family of distributions with an unknown nonparametric mixing distribution. Consider the problem of estimating the value $T(dF)$ of a smooth functional $T$ at the mixed distribution $F$. One nonparametric estimator of $T(dF)$ is $T(dF_n)$ where $F_n$ denotes the empirical distribution. Under a differentiability condition on $T$ given in this note, $T(dF_n)$ is shown to be fully efficient asymptotically in the sense that the…
Paul Janssen · Robert Serfling · Noel Veraverbeke·刊期 1984-12-01 · 卷 12(4)·The Annals of Statistics已编入正刊
一类统计泛函的渐近正态性及其离散程度度量应用AI 解读
A general class of statistical functionals is introduced and the asymptotic normality of the corresponding estimators is established. Included are certain measures of spread, proposed by Bickel and Lehmann (1979), for which the asymptotic distribution theory has been an open problem. The proofs involve some new results, of independent interest, for empirical and quantile processes.
We study robust estimation in the general normal regression model with random carriers permitting small departures from the model. The framework is that of Bickel (1981). We obtain solutions of Huber (1982), Krasker-Hampel (1980) and Krasker-Welsch (1982) as special cases as well as some new procedures. Our calculations indicate that the optimality properties of these estimates are more limited than suggested by Krasker and Welsch.
Theory for finding designs in estimating a linear functional of a regression function is developed for classes of regression functions which are infinite dimensional. These classes can be viewed as representing possible departures from an "ideal" simple model and thus describe a model robust setting. The estimates are restricted to be linear and the design (and estimate) sought is minimax for mean square error. The structure of the design is obtained in a variety of cases;…
Consider the general linear model $Y = x\beta + R$ with $Y$ and $R n$-dimensional, $\beta p$-dimensional, and $X$ an $n \times p$ matrix with rows $x'_i$. Let $\psi$ be given and let $\hat\beta$ be an $M$-estimator of $\beta$ satisfying $0 = \sum x_i\psi(Y_i - x'_i\hat\beta)$. Previous authors have considered consistency and asymptotic normality of $\hat\beta$ when $p$ is permitted to grow, but they have required at least $p^2/n \rightarrow 0$. Here the following result is…
Kernel estimates of an unknown multivariate density are investigated, with mild restrictions being placed on the kernel. A window selection rule is considered, which can be interpreted in terms of cross-validation. Under the mild assumption that the unknown density and its one-dimensional marginals are bounded, the rule is shown to be asymptotically optimal. This strengthens recent results of Peter Hall.
A class of maximum penalized likelihood estimators (MPLE) of the density function $f$ is constructed, through the use of a rather general roughness-penalty functional. This class contains all the density estimates in the literature that arise as solutions to MPLE problems with penalties on $f^{1/2}$. In addition, the flexibility of the penalty functional permits the construction of new spline estimates with improved performance at the peaks and valleys of the density curves.…
We consider the kernel estimate on the real line, $f_n(x) = (nh)^{-1} \sum^n_{i=1} K((X_i - x)/h),$ where $K$ is a bounded even density with compact support, and $X_1, \cdots, X_n$ are independent random variables with common density $f$. We treat the problem of placing a lower bound on the $L$1 error $J_n = E(\int |f_n - f|)$ which holds for all $f$. In particular, we show that there exist $A(K) \geq (9/125)^{1/5}$ depending only upon $K$, and $B^\ast(f) \geq 1$ depending…
We consider the Parzen-Rosenblatt kernel density estimate on $\mathbb{R}^d$ with data-dependent smoothing factor. Sufficient conditions on the asymptotic behavior of the smoothing factor are given under which the estimate is pointwise consistent almost everywhere for all densities $f$ to be estimated. When the smoothing factor is a function only of the sample size $n$, it is shown that these conditions are also necessary, a generalization of results by Deheuvels. The…
This paper is concerned with the problem of choosing a bandwidth parameter for nonparametric regression. We analyze a tapered Fourier series estimate and discuss the relationship of this estimate to a kernel estimate. We first consider a method based on an unbiased estimate of mean square error, and show that the bandwidth thus chosen is asymptotically optimal. Other methods are examined as well and are shown to be asymptotically equivalent. A small simulation shows,…
Asymptotic Properties of wˉ, an Estimator of the ED50 Suggested for Use in Up-and-Down Experiments in Bio-Assay
Wetherill's estimator wˉ is asymptotically equivalent to the mean of peaks and valleys in the sequence of responses in an up-and-down experiment. The asymptotic distribution of wˉ is derived and the asymptotic variance expression is simplified. Some values of asymptotic means and variances are calculated for logistic response. They are compared with analogous values for the estimator suggested by Dixon and Mood. These estimators are also compared by some…
Suppose one is able to observe sequentially a series of independent observations X1,X2,⋯ such that X1,X2,⋯,Xν−1 are iid distributed according to a known distribution F0 and Xν,Xν+1,⋯ are iid distributed according to a known distribution F1. Assume that ν is unknown and the problem is to raise an alarm as soon as possible after the distribution changes from F0 to F1. Formally, the problem is to find a stopping rule N…
The following problem is treated: Given s not-necessarily-random samples from an unknown distribution F, and assuming that we know the sampling rule of each sample, is it possible to combine the samples in order to estimate F, and if so what is the natural way of doing it? More formally, this translates to the problem of determining whether there exists a nonparametric maximum likelihood estimate (NPMLE) of F on the basis of s samples from weighted versions of F,…
An asymptotic expansion of the nonnull distribution of the Wilks statistic for testing the linear hypothesis in multivariate analysis of variance is obtained up to the order N−2 where N is the sample size, for the first time in terms of noncentral beta distributions. The asymptotic distributions are better than the ones available in Anderson (1958) in the null case and in Sugiura and Fujikoshi (1969) and Posten and Bergman (1964) in the nonnull case. In fact, for…
An estimate ∑i=1nYiK((x−Xi)/h)/∑j=1nK((x−Xj)/h), calculated from a sequence (X1,Y1),⋯,(Xn,Yn) of independent pairs of random variables distributed as a pair (X,Y), converges to the regression E{Y∣X=x} as n tends to infinity in probability for almost all (μ)x∈Rd, provided that E∣Y∣<∞,h→0 and nhd→∞ as n→∞. The result is true for all distributions μ o…
In this paper we consider exponential families of distributions and obtain under certain conditions a uniform large deviation result about the tail probability P∂(ϕ∂(Xˉn)>ε),ε>0, where ∂ is the natural parameter and ϕ∂(Xˉn) is the log likelihood ratio statistic for testing the null hypothesis {∂}. The technique involves approximating certain convex compact sets in Rk by…
We consider linear estimators for the mean θ of a Gaussian distribution N(θ,C) on a Hilbert space, when the covariance operator C is known. It was argued in a previous work that the natural class of linear estimators is the class of measurable linear transformations. Using the simplest quadratic loss we prove that the linear estimator L is admissible if and only if the operator C−1/2LC1/2 is Hilbert-Schmidt, self-adjoint, its eigenvalues are all…
Consider the problem of estimating, in a Bayesian framework and in the presence of additive Gaussian noise, a signal which is a step function. Best linear estimates and Bayes estimates are derived, evaluated and compared. A characterization of the Bayes estimates is presented. This characterization has an intuitive interpretation and also provides a way to compute the Bayes estimates with a number of operations of the order of T3 where T is the fixed time span. An…
In Hannan (1980), some limiting properties of the order selection criteria, AIC, BIC, and ϕ(p,q) for modeling stationary time series were derived. In this paper, we generalize these properties to the case in which the underlying process follows a nonstationary autoregressive model. We show that BIC and ϕ(p,0) are weakly consistent. For the AIC, we prove that the asymptotic distribution given by Shibata (1976) for the stationary autoregressive models continues to…
This paper considers the asymptotic behavior of the maximum likelihood estimators (mle's) of the probabilities of a mixed Poisson distribution with a nonparametric mixing distribution. The vector of estimated probabilities is shown to converge in probability to the vector of mixed probabilities at rate n1/2−ε for any ε>0 under a generalized χ2 distance function. It is then shown that any finite set of the mle's has the same joint limiting…
Suppose F is a mixture of a known parametric family of distributions with an unknown nonparametric mixing distribution. Consider the problem of estimating the value T(dF) of a smooth functional T at the mixed distribution F. One nonparametric estimator of T(dF) is T(dFn) where Fn denotes the empirical distribution. Under a differentiability condition on T given in this note, T(dFn) is shown to be fully efficient asymptotically in the sense that the…
Asymptotic Behavior of M-Estimators of p Regression Parameters when p2/n is Large. I. Consistency
Consider the general linear model Y=xβ+R with Y and Rn-dimensional, βp-dimensional, and X an n×p matrix with rows xi′. Let ψ be given and let β^ be an M-estimator of β satisfying 0=∑xiψ(Yi−xi′β^). Previous authors have considered consistency and asymptotic normality of β^ when p is permitted to grow, but they have required at least p2/n→0. Here the following result is…
A class of maximum penalized likelihood estimators (MPLE) of the density function f is constructed, through the use of a rather general roughness-penalty functional. This class contains all the density estimates in the literature that arise as solutions to MPLE problems with penalties on f1/2. In addition, the flexibility of the penalty functional permits the construction of new spline estimates with improved performance at the peaks and valleys of the density curves.…
We consider the kernel estimate on the real line, fn(x)=(nh)−1∑i=1nK((Xi−x)/h), where K is a bounded even density with compact support, and X1,⋯,Xn are independent random variables with common density f. We treat the problem of placing a lower bound on the $L$1 error Jn=E(∫∣fn−f∣) which holds for all f. In particular, we show that there exist A(K)≥(9/125)1/5 depending only upon K, and B∗(f)≥1 depending…
We consider the Parzen-Rosenblatt kernel density estimate on Rd with data-dependent smoothing factor. Sufficient conditions on the asymptotic behavior of the smoothing factor are given under which the estimate is pointwise consistent almost everywhere for all densities f to be estimated. When the smoothing factor is a function only of the sample size n, it is shown that these conditions are also necessary, a generalization of results by Deheuvels. The…