We provide an asymptotic formula for the mean integrated squared error (MISE) of nonlinear wavelet-based density estimators. We show that, unlike the analogous situation for kernel density estimators, this MISE formula is relatively unaffected by assumptions of continuity. In particular, it is available for densities which are smooth in only a piecewise sense. Another difference is that in the wavelet case the classical MISE formula is valid only for sufficiently small…
By using empirical process theory, the so-called excess mass approach is studied. It can be applied to various statistical problems, especially in higher dimensions, such as testing for multimodality, estimating density contour clusters, estimating nonlinear functionals of a density, density estimation, regression problems and spectral analysis. We mainly consider the problems of testing for multimodality and estimating density contour clusters, but the other problems also…
Heitjan and Rubin proposed a concept, "coarsening at random," generalizing Rubin's theory of missing at random. Their analysis was done in discrete sample spaces. We propose a generalization to general sample spaces. Among Heitjan and Rubin's applications was right-censoring in survival analysis. We discuss the application of the generalized theory to various censoring patterns in continuous time and connect to the modern theory of random censoring.
A method is proposed to deal with the problem of blind deconvolution of a special non-Gaussian linear process, in which the input to the linear system is a real- or complex-valued multilevel random sequence that satisfies certain regularity conditions. The gist of the method is to apply a linear filter to the observed process and adjust the filter until a multilevel output is obtained. It is shown that the deconvolution problem can be solved (with only scale/rotation and…
This paper develops extensions of the regression quantiles of Koenker and Bassett (1978) to autoregression. It generalizes several results of Jureckova (1992a) and Gutenbrunner and Jureckova (1992) in linear regression to autoregression models. In particular, it gives the asymptotic uniform linearity of linear rank-scores statistics based on residuals suitable in autoregression. It also discusses the two types of $L$-statistics appropriate in autoregression.
Certain three-dimensional images arising in medicine and astrophysics are modelled as a smooth random field, and experimenters are interested in the number of peaks or "hot-spots" present in such an image. This paper studies the Hadwiger characteristic of the excursion set of a random field. The excursion set is the set of points where the image exceeds a fixed threshold, and the Hadwiger characteristic, like the Euler characteristic, counts the number of connected…
We suppose that our observations can be decomposed into a fixed signal plus random noise, where the noise is modelled as a particular stationary Gaussian random field in $N$-dimensional Euclidean space. The signal has the form of a known function centered at an unknown location and multiplied by an unknown amplitude, and we are primarily interested in a test to detect such a signal. There are many examples where the signal scale or width is assumed known, and the test is…
Suppose that $X_1,\ldots, X_m$ are i.i.d. from a continuous distribution function $F$ and $Y_1,\ldots, Y_n$ are i.i.d. from a continuous distribution function $G; X$'s and $Y$'s are independent. A minimum variance unbiased estimator of $P\{X < Y\}$ is the Mann-Whitney statistic. We show that the Mann-Whitney statistic is admissible under a class of weighted squared error losses and is minimax under a proper weighted squared error loss.
The estimation of a common mean vector $\theta$ given two independent normal observations $X \sim N_p(\theta, \sigma^2_x I)$ and $Y \sim N_p(\theta, \sigma^2_y I)$ is reconsidered. It being known that the estimator $\eta X + (1 - \eta)Y$ is inadmissible when $\eta \in (0, 1)$, we show that when $\eta$ is 0 or 1, then the opposite is true, that is, the estimator is admissible. The general situation is that an estimator $X^\ast$ can be improved by shrinkage when there exists a…
This paper is concerned with estimating the loss of a point estimator when sampling from a spherically symmetric distribution. We examine the canonical setting of a general linear model where the dimension of the parameter space is greater than 4 and less than the dimension of the sampling space. We consider two location estimators--the least squares estimator and a shrinkage estimator--and we compare their unbiased loss estimator with an improved loss estimator. The…
Given data from a sample of noisy curves, we consider a nonlinear parametric regression model with unknown model function. An iterative algorithm for estimating individual parameters as well as the model function is introduced under the assumption of a certain shape invariance: the individual regression curves are obtained from a common shape function by linear transformations of the axes. Our algorithm is based on least-squares methods for parameter estimation and on…
A conservative finite-sample simultaneous confidence envelope for a density can be found by solving a finite set of finite-dimensional linear programming problems if the density is known to be monotonic or to have at most $k$ modes relative to a positive weight function. The dimension of the problems is at most $(n/\log n)^{1/3}$, where $n$ is the number of observations. The linear programs find densities attaining the largest and smallest values at a point among cumulative…
In this paper optimal rates of convergence are derived for estimates of sets in $N$-dimensional "black and white" pictures under smoothness conditions. It is assumed that the boundaries of the "black" regions have a smooth parameterisation, that is, that the boundaries are given by smooth functions from the sphere $S^{N-1}$ into $\mathbb{R}^N$. Furthermore, classes of convex regions are considered. Two models are studied: edge estimation models motivated by image…
A. P. Korostelev · L. Simar · A. B. Tsybakov·刊期 1995-04-01 · 卷 23(2)·The Annals of Statistics已编入正刊
单调边界的有效估计AI 解读
Let $g: \lbrack 0, 1\rbrack \rightarrow \lbrack 0, 1\rbrack$ be a monotone nondecreasing function and let $G$ be the closure of the set $\{(x, y) \in \lbrack 0, 1\rbrack \times \lbrack 0, 1\rbrack: 0 \leq y \leq g (x)\}$. We consider the problem of estimating the set $G$ from a sample of i.i.d. observations uniformly distributed in $G$. The estimation error is measured in the Hausdorff metric. We propose the estimator which is asymptotically efficient in the minimax sense.
Ian W. McKeague · A. M. Nikabadze · Yanqing Sun·刊期 1995-04-01 · 卷 23(2)·The Annals of Statistics已编入正刊
生存时间与协变量独立性的综合检验AI 解读
It has been over 60 years since Kolmogorov introduced a distribution-free omnibus test for the simple null hypothesis that a distribution function coincides with a given distribution function. Doob subsequently observed that Kolmogorov's approach could be simplified by transforming the empirical process to an empirical process based on uniform random variables. Recent use of more sophisticated transformations has led to the construction of asymptotically distribution-free…
In this paper, we prove that the Lynden-Bell estimator of a distribution function in the random truncation model is uniformly strong consistent over the whole half line, a problem left open by Woodroofe.
Let $\hat{F}_n$ be the Kaplan-Meier estimator of a distribution function $F$ computed from randomly censored data. We show that under optimal integrability assumptions on a function $\varphi$, the Kaplan-Meier integral $\int \varphi d\hat{F}_n$, when properly standardized, is asymptotically normal.
This paper considers efficient estimation of the Euclidean parameter $\theta$ in the proportional odds model $G(1 - G)^{-1} = \theta F(1 - F)^{-1}$ when two independent i.i.d. samples with distributions $F$ and $G$, respectively, are observed. The Fisher information $I(\theta)$ is calculated based on the solution of a pair of integral equations which are derived from a class of more general semiparametric models. A one-step estimate is constructed using an initial $\sqrt N$-c…
We derive upper bounds for the coverage error of confidence intervals for a population mean uniformly over large classes of populations and different types of confidence intervals. It is shown that the order of these bounds is achieved by the normal approximation method for constructing confidence intervals, uniformly over distributions with finite third moment, and, by an empirical Edgeworth correction of this approach, uniformly over smooth distributions with finite fourth…
This paper introduces the concept of dual likelihood as a method of improving accuracy in inference situations depending on martingale estimating equations. Asymptotic results are given for the dual likelihood ratio statistic, and the structure of the family of alternatives is explored. Applications to survival analysis and also to time series, likelihood inference and independent observations are given. Connections to nonparametric likelihood (including empirical…
Let $Y_1,\ldots, Y_n$ be independent identically distributed with density $p_0$ and let $\mathscr{F}$ be a space of densities. We show that the supremum of the likelihood ratios $\prod^n_{i=1} p(Y_i)/p_0(Y_i)$, where the supremum is over $p \in \mathscr{F}$ with $\|p^{1/2} - p^{1/2}_0\|_2 \geq \varepsilon$, is exponentially small with probability exponentially close to 1. The exponent is proportional to $n\varepsilon^2$. The only condition required for this to hold is that $\varepsilon$…
Thomas Mikosch · Tamar Gadrich · Claudia Kluppelberg · Robert J. Adler·刊期 1995-02-01 · 卷 23(1)·The Annals of Statistics已编入正刊
无限方差创新下 ARMA 模型的参数估计AI 解读
We consider a standard ARMA process of the form $\phi(B)X_t = \theta(B)Z_t$, where the innovations $Z_t$ belong to the domain of attraction of a stable law, so that neither the $Z_t$ nor the $X_t$ have a finite variance. Our aim is to estimate the coefficients of $\phi$ and $\theta$. Since maximum likelihood estimation is not a viable possibility (due to the unknown form of the marginal density of the innovation sequence), we adopt the so-called Whittle estimator, based on…
Richard A. Davis · Dawei Huang · Yi-Ching Yao·刊期 1995-02-01 · 卷 23(1)·The Annals of Statistics已编入正刊
自回归模型参数与阶数变化的检验AI 解读
The problem of testing whether or not a change has occurred in the parameter values and order of an autoregressive model is considered. It is shown that if the white noise in the AR model is weakly stationary with finite fourth moments, then under the null hypothesis of no changepoint, the normalized Gaussian likelihood ratio test statistic converges in distribution to the Gumbel extreme value distribution. An asymptotically distribution-free procedure for testing a change…
A new proof is given to a known result on the average run length to false alarm of the Shiryayev-Roberts change-point detection policy when the observations are nonlattice. Via the approach of this new proof, the average run length to false alarm can be calculated in the lattice case and for the mixed-type Shiryayev-Roberts scheme.
This paper develops extensions of the regression quantiles of Koenker and Bassett (1978) to autoregression. It generalizes several results of Jureckova (1992a) and Gutenbrunner and Jureckova (1992) in linear regression to autoregression models. In particular, it gives the asymptotic uniform linearity of linear rank-scores statistics based on residuals suitable in autoregression. It also discusses the two types of L-statistics appropriate in autoregression.
We suppose that our observations can be decomposed into a fixed signal plus random noise, where the noise is modelled as a particular stationary Gaussian random field in N-dimensional Euclidean space. The signal has the form of a known function centered at an unknown location and multiplied by an unknown amplitude, and we are primarily interested in a test to detect such a signal. There are many examples where the signal scale or width is assumed known, and the test is…
Admissibility and Minimaxity of the UMVU Estimator of P{X<Y}
Suppose that X1,…,Xm are i.i.d. from a continuous distribution function F and Y1,…,Yn are i.i.d. from a continuous distribution function G;X's and Y's are independent. A minimum variance unbiased estimator of P{X<Y} is the Mann-Whitney statistic. We show that the Mann-Whitney statistic is admissible under a class of weighted squared error losses and is minimax under a proper weighted squared error loss.
The estimation of a common mean vector θ given two independent normal observations X∼Np(θ,σx2I) and Y∼Np(θ,σy2I) is reconsidered. It being known that the estimator ηX+(1−η)Y is inadmissible when η∈(0,1), we show that when η is 0 or 1, then the opposite is true, that is, the estimator is admissible. The general situation is that an estimator X∗ can be improved by shrinkage when there exists a…
A conservative finite-sample simultaneous confidence envelope for a density can be found by solving a finite set of finite-dimensional linear programming problems if the density is known to be monotonic or to have at most k modes relative to a positive weight function. The dimension of the problems is at most (n/logn)1/3, where n is the number of observations. The linear programs find densities attaining the largest and smallest values at a point among cumulative…
In this paper optimal rates of convergence are derived for estimates of sets in N-dimensional "black and white" pictures under smoothness conditions. It is assumed that the boundaries of the "black" regions have a smooth parameterisation, that is, that the boundaries are given by smooth functions from the sphere SN−1 into RN. Furthermore, classes of convex regions are considered. Two models are studied: edge estimation models motivated by image…
Let g:[0,1]→[0,1] be a monotone nondecreasing function and let G be the closure of the set {(x,y)∈[0,1]×[0,1]:0≤y≤g(x)}. We consider the problem of estimating the set G from a sample of i.i.d. observations uniformly distributed in G. The estimation error is measured in the Hausdorff metric. We propose the estimator which is asymptotically efficient in the minimax sense.
Let F^n be the Kaplan-Meier estimator of a distribution function F computed from randomly censored data. We show that under optimal integrability assumptions on a function φ, the Kaplan-Meier integral ∫φdF^n, when properly standardized, is asymptotically normal.
This paper considers efficient estimation of the Euclidean parameter θ in the proportional odds model G(1−G)−1=θF(1−F)−1 when two independent i.i.d. samples with distributions F and G, respectively, are observed. The Fisher information I(θ) is calculated based on the solution of a pair of integral equations which are derived from a class of more general semiparametric models. A one-step estimate is constructed using an initial N-c…
Let Y1,…,Yn be independent identically distributed with density p0 and let F be a space of densities. We show that the supremum of the likelihood ratios ∏i=1np(Yi)/p0(Yi), where the supremum is over p∈F with ∥p1/2−p01/2∥2≥ε, is exponentially small with probability exponentially close to 1. The exponent is proportional to nε2. The only condition required for this to hold is that ε…
We consider a standard ARMA process of the form ϕ(B)Xt=θ(B)Zt, where the innovations Zt belong to the domain of attraction of a stable law, so that neither the Zt nor the Xt have a finite variance. Our aim is to estimate the coefficients of ϕ and θ. Since maximum likelihood estimation is not a viable possibility (due to the unknown form of the marginal density of the innovation sequence), we adopt the so-called Whittle estimator, based on…