Many of the popular nonparametric test statistics for censored survival data used in two-sample, $s$-sample trend and single continuous covariate situations are special cases of a general statistic, differing only in the choice of covariate-based label and weight function. Formulated in terms of counting processes and martingales this general statistic, standardized by the square root of its consistent variance estimator, is shown to be asymptotically normal under the null…
Bahadur has obtained an asymptotic almost sure representation for empirical quantiles of independent and identically distributed random variables. In this paper we present an analogous result for a large class of stationary linear processes.
Martingale and counting process techniques are applied to the problem of inference for general conditional hazard functions. This problem was first studied by Beran, who introduced a class of estimators for the conditional cumulative hazard and survival functions in the special case of time-independent covariates. Here the covariate can be time dependent; the classical i.i.d. assumptions are relaxed by replacing them with certain asymptotic stability assumptions, and models…
Consider an $m$-dimensional diffusion process $(X_t)$ with unknown drift and small known variance observed on a time interval $\lbrack 0, T\rbrack$. We derive here a general condition ensuring the asymptotic sufficiency, in the sense of Le Cam, of incomplete observations of $(X_t)_{0 \leq t \leq T}$ with respect to the complete observation of the diffusion as the variance goes to 0. We then construct estimators based on these partial observations which are consistent,…
Wahba compared the performance of generalized cross validation (GCV) and modified maximum likelihood (MML) procedures for choosing the smoothing parameter of a smoothing spline. This work makes a more careful study of the two procedures when the stochastic model motivating the modified maximum likelihood estimate is correct. In particular, it is shown that in the case of the linear smoothing spline with equally spaced observations, both estimates are asymptotically normal…
Suppose $z(\cdot)$ is a random process defined on a bounded set $R \subset \mathbb{R}^1$ with finite second moments. Consider the behavior of linear predictions based on $z(t_1), \ldots, z(t_n)$, where $t_1, t_2, \cdots$ is a dense sequence of points in $R$. Stein showed that if the second-order structure used to generate the predictions is incorrect but compatible with the correct second-order structure, the obtained predictions are uniformly asymptotically optimal as $n \rightarrow \infty$…
Andre Robert Dabrowski · David McDonald · Uwe Rosler·刊期 1990-09-01 · 卷 18(3)·The Annals of Statistics已编入正刊
离子通道的更新理论性质AI 解读
The membranes of cells, such as those found in heart and nerve tissue, contain structures known as ion channels. The current produced by an ion channel in a cell membrane has been modelled as a finite state-space Markov process. Statistical analysis of ion channels has been largely limited to the case where a single channel is observed, or where the stimulus to the channel is so slight that only one channel at a time is emitting current. In many experiments, however, several…
Let $l(\theta) = n^{-1} \log p(x, \theta)$ be the log likelihood of an $n$-dimensional $X$ under a $p$-dimensional $\theta$. Let $\hat{\theta}_j$ be the mle under $H_j: \theta^1 = \theta^1_0, \ldots, \theta^j = \theta^j_0$ and $\hat{\theta}_0$ be the unrestricted mle. Define $T_j$ as $\lbrack 2n\{l(\hat{\theta}_{j - 1}) - l(\hat{\theta}_j)\}\rbrack^{1/2} \operatorname{sgn}(\hat{\theta}^j_{j - 1} - \theta^j_0).$ Let $T = (T_1, \ldots, T_p)$. Then under regularity conditions,…
We discuss properties of some data-analytic methods which are intimately related to each other: alternating least squares (ALS), correspondence analysis and more recently Breiman and Friedman's ACE algorithm. The application of these methods to regression produces nonparametric estimators of nonlinear transformations, both of the response and the predictors. These procedures are among the most powerful tools for data analysis, but missing awareness of some artifacts could…
P. K. Bhattacharya · Ashis K. Gangopadhyay·刊期 1990-09-01 · 卷 18(3)·The Annals of Statistics已编入正刊
条件分位数的核估计与近邻估计AI 解读
Let $(X_1, Z_1), (X_2, Z_2), \ldots, (X_n, Z_n)$ be iid as $(X, Z), Z$ taking values in $R^1$, and for $0 < p < 1$, let $\xi_p(x)$ denote the conditional $p$-quantile of $Z$ given $X = x,$ i.e., $P(Z \leq \xi_p(x)\mid X = x) = p$. In this paper, kernel and nearest-neighbor estimators of $\xi_p(x)$ are proposed. In order to study the asymptotics of these estimates, Bahadur-type representations of the sample conditional quantiles are obtained. These representations are used to…
The paper deals with upper and lower bounds for the quality of (probability) density estimation. Connections are established between these problems and the theory of approximation of functions. Particularly, it is demonstrated how some of Kolmogorov's concepts work.
This paper investigates the use of Edgeworth expansions for approximating the distribution function of the normalized sum of $n$ independent and identically distributed lattice-valued random variables. We prove that the continuity-corrected Edgeworth series, using Sheppard-adjusted cumulants, is accurate to the same order in $n$ as the usual Edgeworth approximation for continuous random variables. Finally, as a partial justification of the Sheppard adjustments, it is shown…
The usual confidence interval for the variance $\sigma^2$ of a normal distribution is a function of the sample variance alone. In this paper, we construct confidence intervals for $\sigma^2$ that also depend on the sample mean. These intervals have the same length as the shortest interval depending only on the sample variance and have uniformly higher probability of coverage. The coverage probabilities of these intervals and others are compared.
We propose a definition of the partial autocorrelation function $\beta(\cdot)$ for multivariate stationary time series suggested by the canonical analysis of the forward and backward innovations. Here $\beta(\cdot)$ satisfies $\beta(-n) = \beta(n)', n = 0, 1, \cdots,$ where $\beta(0)$ is nonnegative definite, $\{\beta(n), n = 1, 2, \cdots\}$ is a sequence of square matrices having singular values less than or equal to 1 and such that the order of $\beta(n + 1)$ is equal to…
Consider the model $X_i = \rho X_{i - 1} + \varepsilon_i, |\rho| > 1$, where $X_0, \varepsilon_1, \varepsilon_2, \cdots$ are independent random variables with $\varepsilon_1, \varepsilon_2, \cdots$ having common density $\psi$. This paper gives sufficient conditions under which the sequence of experiments induced by $\{X_0, X_1, \cdots, X_n\}$ has a weak limit in the sense of Le Cam. In general, the limiting experiment is translation invariant and neither LAN nor LAMN. The…
We consider in this paper two widely studied examples of nonparametric and semiparametric models in which the standard information bounds are totally misleading. In fact, no estimators converge at the $n^{-\alpha}$ rate for any $\alpha > 0$, although the information is strictly positive "promising" that $n^{-1/2}$ is achievable. The examples are the estimation of $\int p^2$ and the slope in the model of Engle et al. A class of models in which the parameter of interest can be…
In this paper, an entropy approach is proposed to establish rates of convergence for estimators of a regression function. General regression problems are considered, with linear regression, splines and isotonic regression as special cases. The estimation methods studied are least squares, least absolute deviations and penalized least squares. Common features of these methods and various regression problems are highlighted.
In this paper we obtain the asymptotic distribution of robust nonparametric autoregression estimators for dependent observations. Weights based on kernel and nearest-neighbor methods are considered.
The bandwidth selection problem in kernel density estimation is investigated in situations where the observed data are dependent. The classical leave-out technique is extended, and thereby a class of cross-validated bandwidths is defined. These bandwidths are shown to be asymptotically optimal under a strong mixing condition. The leave-one out, or ordinary, form of cross-validation remains asymptotically optimal under the dependence model considered. However, a simulation…
For a random field $z(t)$ defined for $t \in R \subseteq \mathbb{R}^d$ with specified second-order structure (mean function $m$ and covariance function $K$), optimal linear prediction based on a finite number of observations is a straightforward procedure. Suppose $(m_0, K_0)$ is the second-order structure used to produce the predictions when in fact $(m_1, K_1)$ is the correct second-order structure and $(m_0, K_0)$ and $(m_1, K_1)$ are "compatible" on $R$. For bounded $R$,…
Let $X_1, X_2, \cdots$ be iid observations from a mixture density $f(x) = \int f(x \mid \theta)dG(\theta)$, where $f(x \mid \theta)$ is a known parametric family of density functions and $G$ is an unknown distribution function. This paper concerns estimating the mixing density $g = G'$ and the mixing distribution $G$. Fourier methods are used to derive kernel estimators, upper bounds for their rates of convergence and lower bounds for the optimal rate of convergence.…
For nonparametric regression estimation, when the unknown function belongs to a Sobolev smoothness class, sharp risk bounds for integrated mean square error have been found recently which improve on optimal rates of convergence results. The key to these has been the fact that under normality of the errors, the minimax linear estimator is asymptotically minimax in the class of all estimators. We extend this result to the nonnormal case, when the noise distribution is unknown.…
The ACE (alternating conditional expectations) algorithm developed by Breiman and Friedman is an iterative method for finding optimal transformations of variables in multiple regression. Recently, several authors have extended ACE to discriminant analysis, time series and principal components. The central idea of ACE and of each of these extensions is that an optimal transformation $\phi^\ast$ minimizes a squared error-related functional over a Hilbert space, subject to…
Let $f$ be a continuous and positive unknown density on a known compact interval $\mathscr{Y}$. Let $F$ denote the distribution function of $f$ and let $Q = F^{-1}$ denote its quantile function. A finite-parameter exponential family model based on $B$-splines is constructed. Maximum-likelihood estimation of the parameters of the model based on a random sample of size $n$ from $f$ yields estimates $\hat{f, F}$ and $\hat{Q}$ of $f, F$ and $Q$, respectively. Under mild…
Many of the popular nonparametric test statistics for censored survival data used in two-sample, s-sample trend and single continuous covariate situations are special cases of a general statistic, differing only in the choice of covariate-based label and weight function. Formulated in terms of counting processes and martingales this general statistic, standardized by the square root of its consistent variance estimator, is shown to be asymptotically normal under the null…
Consider an m-dimensional diffusion process (Xt) with unknown drift and small known variance observed on a time interval [0,T]. We derive here a general condition ensuring the asymptotic sufficiency, in the sense of Le Cam, of incomplete observations of (Xt)0≤t≤T with respect to the complete observation of the diffusion as the variance goes to 0. We then construct estimators based on these partial observations which are consistent,…
Suppose z(⋅) is a random process defined on a bounded set R⊂R1 with finite second moments. Consider the behavior of linear predictions based on z(t1),…,z(tn), where t1,t2,⋯ is a dense sequence of points in R. Stein showed that if the second-order structure used to generate the predictions is incorrect but compatible with the correct second-order structure, the obtained predictions are uniformly asymptotically optimal as n→∞…
Let l(θ)=n−1logp(x,θ) be the log likelihood of an n-dimensional X under a p-dimensional θ. Let θ^j be the mle under Hj:θ1=θ01,…,θj=θ0j and θ^0 be the unrestricted mle. Define Tj as [2n{l(θ^j−1)−l(θ^j)}]1/2sgn(θ^j−1j−θ0j). Let T=(T1,…,Tp). Then under regularity conditions,…
Let (X1,Z1),(X2,Z2),…,(Xn,Zn) be iid as (X,Z),Z taking values in R1, and for 0<p<1, let ξp(x) denote the conditional p-quantile of Z given X=x, i.e., P(Z≤ξp(x)∣X=x)=p. In this paper, kernel and nearest-neighbor estimators of ξp(x) are proposed. In order to study the asymptotics of these estimates, Bahadur-type representations of the sample conditional quantiles are obtained. These representations are used to…
This paper investigates the use of Edgeworth expansions for approximating the distribution function of the normalized sum of n independent and identically distributed lattice-valued random variables. We prove that the continuity-corrected Edgeworth series, using Sheppard-adjusted cumulants, is accurate to the same order in n as the usual Edgeworth approximation for continuous random variables. Finally, as a partial justification of the Sheppard adjustments, it is shown…
The usual confidence interval for the variance σ2 of a normal distribution is a function of the sample variance alone. In this paper, we construct confidence intervals for σ2 that also depend on the sample mean. These intervals have the same length as the shortest interval depending only on the sample variance and have uniformly higher probability of coverage. The coverage probabilities of these intervals and others are compared.
We propose a definition of the partial autocorrelation function β(⋅) for multivariate stationary time series suggested by the canonical analysis of the forward and backward innovations. Here β(⋅) satisfies β(−n)=β(n)′,n=0,1,⋯, where β(0) is nonnegative definite, {β(n),n=1,2,⋯} is a sequence of square matrices having singular values less than or equal to 1 and such that the order of β(n+1) is equal to…
Consider the model Xi=ρXi−1+εi,∣ρ∣>1, where X0,ε1,ε2,⋯ are independent random variables with ε1,ε2,⋯ having common density ψ. This paper gives sufficient conditions under which the sequence of experiments induced by {X0,X1,⋯,Xn} has a weak limit in the sense of Le Cam. In general, the limiting experiment is translation invariant and neither LAN nor LAMN. The…
We consider in this paper two widely studied examples of nonparametric and semiparametric models in which the standard information bounds are totally misleading. In fact, no estimators converge at the n−α rate for any α>0, although the information is strictly positive "promising" that n−1/2 is achievable. The examples are the estimation of ∫p2 and the slope in the model of Engle et al. A class of models in which the parameter of interest can be…
For a random field z(t) defined for t∈R⊆Rd with specified second-order structure (mean function m and covariance function K), optimal linear prediction based on a finite number of observations is a straightforward procedure. Suppose (m0,K0) is the second-order structure used to produce the predictions when in fact (m1,K1) is the correct second-order structure and (m0,K0) and (m1,K1) are "compatible" on R. For bounded R,…
Let X1,X2,⋯ be iid observations from a mixture density f(x)=∫f(x∣θ)dG(θ), where f(x∣θ) is a known parametric family of density functions and G is an unknown distribution function. This paper concerns estimating the mixing density g=G′ and the mixing distribution G. Fourier methods are used to derive kernel estimators, upper bounds for their rates of convergence and lower bounds for the optimal rate of convergence.…
The ACE (alternating conditional expectations) algorithm developed by Breiman and Friedman is an iterative method for finding optimal transformations of variables in multiple regression. Recently, several authors have extended ACE to discriminant analysis, time series and principal components. The central idea of ACE and of each of these extensions is that an optimal transformation ϕ∗ minimizes a squared error-related functional over a Hilbert space, subject to…
Let f be a continuous and positive unknown density on a known compact interval Y. Let F denote the distribution function of f and let Q=F−1 denote its quantile function. A finite-parameter exponential family model based on B-splines is constructed. Maximum-likelihood estimation of the parameters of the model based on a random sample of size n from f yields estimates f,F^ and Q^ of f,F and Q, respectively. Under mild…