Hall and Wellner proposed a natural extension of the Kolmogorov-Smirnov simultaneous confidence band for survival curve using the Kaplan-Meier estimator. They and Gill conjectured that the confidence band holds for all t up to the last observed failure time. A counterexample is given herein, showing that this may not always be true.
Gang Li · Myles Hollander · Ian W. McKeague · Jie Yang·刊期 1996-04-01 · 卷 24(2)·The Annals of Statistics已编入正刊
不完整生存数据中分位数函数的非参数似然比置信带AI 解读
The purpose of this paper is to derive confidence bands for quantile functions using a nonparametric likelihood ratio approach. The method is easy to implement and has several appealing properties. It applies to right-censored and left-truncated data, and it does not involve density estimation or even require the existence of a density. Previous approaches (e.g., bootstrap) have imposed smoothness conditions on the density. The performance of the proposed method is…
The NPMLE in the bivariate censoring model is not consistent for continuous data. The problem is caused by the singly censored observations. In this paper we prove that if we observe the censoring times or if the censoring times are discrete, then a NPMLE based on a slightly reduced data set, in particular, we interval censor the singly censored observations, is asymptotically efficient for this reduced data and moreover if we let the width of the interval converge to zero…
In survival analysis with censored data, we consider three closely related survival function estimators: the Kaplan-Meier, Nelson and moment estimators. We derive the Edgeworth expansions for these three estimators with Studentization. Edgeworth expansions for the corresponding bootstrap statistics are also given. It is found that the bootstrap approximation is better than the normal approximation for the Studentized Kaplan-Meier and Nelson estimators, but not so for the…
The maximum likelihood estimator (MLE) for the proportional hazards model with "case 1" interval censored data is studied. It is shown that the MLE for the regression parameter is asymptotically normal with $\sqrt{n}$ convergence rate and achieves the information bound, even though the MLE for the baseline cumulative hazard function only converges at $n^{1/3}$ rate. Estimation of the asymptotic variance matrix for the MLE of the regression parameter is also considered. To…
In this article we study function estimation via wavelet shrinkage for data with long-range dependence. We propose a fractional Gaussian noise model to approximate nonparametric regression with long-range dependence and establish asymptotics for minimax risks. Because of long-range dependence, the minimax risk and the minimax linear risk converge to 0 at rates that differ from those for data with independence or short-range dependence. Wavelet estimates with best selection…
Genetic epidemiology is almost unique among the sciences in that computation of a likelihood function is the accepted approach to statistical inference. In the context of genetic linkage analysis, in which genes are mapped by analysing the dependence in inheritance of different traits, the use of likelihood dates back to the early work of Fisher and Haldane, and has seldom been seriously challenged. After introducing the underlying genetic concepts, this paper reviews the…
We present general sufficient conditions for the almost sure $L_1$-consistency of histogram density estimates based on data-dependent partitions. Analogous conditions guarantee the almost-sure risk consistency of histogram classification schemes based on data-dependent partitions. Multivariate data are considered throughout. In each case, the desired consistency requires shrinking cells, subexponential growth of a combinatorial complexity measure and sublinear growth of the…
David L. Donoho · Iain M. Johnstone · Gérard Kerkyacharian · Dominique Picard·刊期 1996-04-01 · 卷 24(2)·The Annals of Statistics已编入正刊
基于小波阈值化的密度估计AI 解读
Density estimation is a commonly used test case for nonparametric estimation methods. We explore the asymptotic properties of estimators based on thresholding of empirical wavelet coefficients. Minimax rates of convergence are studied over a large range of Besov function classes $B_{\sigma pq}$ and for a range of global $L'_p$ error measures, $1 \leq p' < \infty$. A single wavelet threshold estimator is asymptotically minimax within logarithmic terms simultaneously over a…
The receiver operating characteristic (ROC) curve describes the performance of a diagnostic test used to discriminate between healthy and diseased individuals based on a variable measured on a continuous scale. The data consist of a training set of m responses $X_1, \dots, X_m$ from healthy individuals and n responses $Y_1, \dots, Y_n$ from diseased individuals. The responses are assumed i.i.d. from unknown distributions F and G, respectively. We consider estimation of the…
The principal components analysis of functional data is often enhanced by the use of smoothing. It is shown that an attractive method of incorporating smoothing is to replace the usual $L^2$-orthonormality constraint on the principal components by orthonormality with respect to an inner product that takes account of the roughness of the functions. The method is easily implemented in practice by making use of appropriate function transforms (Fourier transforms for periodic…
Let ${X_t, t \epsilon \mathbb{Z}}$ be an observable strictly stationary sequence of random variables and let $X_t = U_t + \varepsilon_t$, where ${U_t}$ is an AR (p) and ${\varepsilon_t}$ is a strictly stationary sequence representing errors of measurement in ${X_t}$, with $E{\varepsilon_1} = 0$. Under some broad assumptions on ${\varepsilon_t}$ we establish the consistency properties as well as the rates of convergence for the standard estimators for the autoregressive…
Consider an ergodic Markov chain on the real line, with parametric models for the conditional mean and variance of the transition distribution. Such a setting is an instance of a quasi-likelihood model. The customary estimator for the parameter is the maximum quasi-likelihood estimator. It is not efficient, but as good as the best estimator that ignores the parametric model for the conditional variance. We construct two efficient estimators. One is a convex combination of…
This paper establishes the asymptotic uniform linearity of M- and R-scores in a family of nonlinear time series and regression models. It also gives an asymptotic expansion of the standardized sequential residual empirical process in these models. These results are, in turn, used to obtain the asymptotic normality of certain classes of M-, R- and minimum distance estimators of the underlying parameters. The classes of estimators considered include analogs of Hodges-Lehmann,…
Gusztáv Morvai · Sidney Yakowitz · László Györfi·刊期 1996-02-01 · 卷 24(1)·The Annals of Statistics已编入正刊
遍历平稳时间序列的非参数推断AI 解读
The setting is a stationary, ergodic time series. The challenge is to construct a sequence of functions, each based on only finite segments of the past, which together provide a strongly consistent estimator for the conditional probability of the next observation, given the infinite past. Ornstein gave such a construction for the case that the values are from a finite set, and recently Algoet extended the scheme to time series with coordinates in a Polish space. The present…
In a recent paper, DiCiccio, Hall and Romano established that Owen's empirical likelihood is Bartlett correctable. This is an intriguing and perhaps surprising result and is the only nonparametric context in which Bartlett correctability is known to hold. An alternative, closely related nonparametric likelihood, referred to here as exponential empirical likelihood, may be constructed using Efron's method of nonparametric tilting. The purpose of this note is to show that…
This paper derives higher-order terms in the double-saddlepoint expansion of Skovgaard for a unidimensional conditional cumulative distribution function. Expansions for continuous and lattice random variables are derived. Results are applied to the sufficient statistic in logistic regression.
Under mild misspecifications of model assumptions, maximum likelihood estimates often remain consistent and asymptotically normal. Asymptotic normality will often hold for the signed root of the likelihood ratio statistic and the score statistic as well. However, standard estimates of asymptotic variance are usually inconsistent. This occurs when Bartlett's second identity fails. In the manner of McCullagh and Tibshirani, a variance correction may be used to adjust the…
We give a stochastic expansion for the empirical distribution function $\hat{F}_n$ of residuals in a p-dimensional linear model. This expansion holds for p increasing with n. It shows that, for high-dimensional linear models, $\hat{F}_n$ strongly depends on the chosen estimator $\hat{\theta}$ of the parameter $\theta$ of the linear model. In particular, if one uses an ML-estimator $\hat{\theta}_{ML}$ which is ML motivated by a wrongly specified error distribution function G,…
Direct use of the empirical quantile function provides a standard distribution-free approach to constructing confidence intervals and confidence bands for population quantiles. We apply this method to construct confidence intervals and confidence bands for regression quantiles and to construct prediction intervals based on sample regression quantiles. Comparison of the direct method with the studentization and the bootstrap methods are discussed. Simulation results show that…
The empirical Bayes linear loss two-action problem in the continuous one-parameter exponential family is studied. Previous results on this problem construct empirical Bayes tests via kernel density estimates. They also obtain upper bounds for the unconditional regret at some prior distribution. In this paper, we discuss the general question of how difficult the above empirical Bayes problem is, and why empirical Bayes rules based on kernel density estimates are useful.…
Asymptotically optimal and admissible compound decision rules are obtained in a Hilbert-parameterized Gaussian shift experiment. The component parameter set is restricted to compact. For the squared error loss, every compound Bayes estimator is admissible and every compound estimator Bayes versus full support hyperprior mixture of iid priors on the compound parameter is asymptotically optimal. For the latter class of rules induced by full support hyperpriors, asymptotic…
We investigate the degree to which posterior expectations are sensitive to prior distributions, using a local method based on functional differentiation. Invariance considerations suggest a family of norms which can be used to measure perturbations to the prior. The sensitivity measure is seen to depend heavily on the choice of norm; asymptotic results suggest which norm will yield the most useful results in practice. We find that to maintain asymptotically sensible…
Suppose that $X_{\sigma} | \mathbf{\theta} \sim N(\mathbf{\theta}, \sigma^2)$ and that $\sigma \to 0$. For which prior distributions on $\mathbf{\theta}$ is the posterior distribution of $\mathbf{\theta}$ given $X_{\sigma}$ asymptotically $N(X_{\sigma}, \sigma^2)$ when in fact $X_{\sigma} \sim N(\theta_0, \sigma^2)$? It is well known that the stated convergence occurs when $\mathbf{\theta}$ has a prior density that is positive and continuous at $\theta_0$. It turns out that…
The maximum likelihood estimator (MLE) for the proportional hazards model with "case 1" interval censored data is studied. It is shown that the MLE for the regression parameter is asymptotically normal with n convergence rate and achieves the information bound, even though the MLE for the baseline cumulative hazard function only converges at n1/3 rate. Estimation of the asymptotic variance matrix for the MLE of the regression parameter is also considered. To…
We present general sufficient conditions for the almost sure L1-consistency of histogram density estimates based on data-dependent partitions. Analogous conditions guarantee the almost-sure risk consistency of histogram classification schemes based on data-dependent partitions. Multivariate data are considered throughout. In each case, the desired consistency requires shrinking cells, subexponential growth of a combinatorial complexity measure and sublinear growth of the…
Density estimation is a commonly used test case for nonparametric estimation methods. We explore the asymptotic properties of estimators based on thresholding of empirical wavelet coefficients. Minimax rates of convergence are studied over a large range of Besov function classes Bσpq and for a range of global Lp′ error measures, 1≤p′<∞. A single wavelet threshold estimator is asymptotically minimax within logarithmic terms simultaneously over a…
The receiver operating characteristic (ROC) curve describes the performance of a diagnostic test used to discriminate between healthy and diseased individuals based on a variable measured on a continuous scale. The data consist of a training set of m responses X1,…,Xm from healthy individuals and n responses Y1,…,Yn from diseased individuals. The responses are assumed i.i.d. from unknown distributions F and G, respectively. We consider estimation of the…
The principal components analysis of functional data is often enhanced by the use of smoothing. It is shown that an attractive method of incorporating smoothing is to replace the usual L2-orthonormality constraint on the principal components by orthonormality with respect to an inner product that takes account of the roughness of the functions. The method is easily implemented in practice by making use of appropriate function transforms (Fourier transforms for periodic…
Let Xt,tϵZ be an observable strictly stationary sequence of random variables and let Xt=Ut+εt, where Ut is an AR (p) and εt is a strictly stationary sequence representing errors of measurement in Xt, with Eε1=0. Under some broad assumptions on εt we establish the consistency properties as well as the rates of convergence for the standard estimators for the autoregressive…
We give a stochastic expansion for the empirical distribution function F^n of residuals in a p-dimensional linear model. This expansion holds for p increasing with n. It shows that, for high-dimensional linear models, F^n strongly depends on the chosen estimator θ^ of the parameter θ of the linear model. In particular, if one uses an ML-estimator θ^ML which is ML motivated by a wrongly specified error distribution function G,…
Suppose that Xσ∣θ∼N(θ,σ2) and that σ→0. For which prior distributions on θ is the posterior distribution of θ given Xσ asymptotically N(Xσ,σ2) when in fact Xσ∼N(θ0,σ2)? It is well known that the stated convergence occurs when θ has a prior density that is positive and continuous at θ0. It turns out that…