Joachim Mocks · Pham Dinh Tuan · Theo Gasser·刊期 1984-03-01 · 卷 12(1)·The Annals of Statistics已编入正刊
重复刺激诱发的含噪信号同质性检验AI 解读
Two statistics are proposed for testing the homogeneity of signals, when these are noisy and repeatedly recorded. The distribution of the statistics is well approximated by the $\chi^2$ and the normal distribution, respectively, as shown by theoretical and simulation results. Power and insensitivity to other types of variation are discussed. The approach is developed in the context of analysing recordings of electric brain potentials being evoked by some stimulation, as…
We solve here the general nonstationary multivariate MA spectral factorization problem, i.e. the problem of obtaining all the possible MA models (with time-dependent coefficients) corresponding to a given (time-dependent) autocovariance function. Our result (Theorem 8) relies on a symbolic generalization (Theorem 1) of the classical factorization property of the characteristic polynomial associated with stationary autocovariance functions, and is obtained by means of a…
A conditional limit theorem is derived for a certain class of stochastic processes whose distributions constitute a nonergodic family. The limit theorem allows us to study the asymptotic behaviour under the conditional model of some standard statistical procedures by making use of results for ergodic families. Explosive Gaussian autoregressive processes are studied in some detail. Here the conditional process is shown to be a nonexplosive Gaussian autoregression bearing a…
A class of semi-Markov models, those which have proportional hazards and which are forward-going (if state $j$ can be reached from $i$, then $i$ cannot be reached from $j$), are shown to fit into the multiplicative intensity model of counting processes after suitable random time changes. Standard large-sample results for counting processes following this multiplicative model can therefore be used to make inferences on the above class of semi-Markov models, including the case…
The finite sample breakdown properties of $M$-estimators, defined by $\sum\rho(x_i - T) = \min!$, and of the associated Pitman-type or $P$-estimators, defined by $T = \frac{\int \exp\{-\Sigma \rho(x_i - \theta)\}\theta d\theta}{\int \exp\{-\Sigma\rho(x_i - \theta)\} d\theta},$ are investigated. If $\rho$ is symmetric, and $\psi = \rho'$ is monotone and bounded, then the breakdown point of either estimator is $\varepsilon^\ast = 1/2$. If $\psi$ decreases to 0 for large $x$ ("r…
Let $\hat{T}_n$ be an estimate of the form $\hat{T}_n = T(\hat{F}_n)$, where $\hat{F}_n$ is the sample $\operatorname{cdf}$ of $n \operatorname{iid}$ observations and $T$ is a locally quadratic functional defined on $\operatorname{cdf's}$. Then, the normalized jackknife estimates for bias, skewness, and variance of $\hat{T}_n$ approximate closely their bootstrap counterparts. Each of these estimates is consistent. Moreover, the jackknife and bootstrap estimates of variance…
A class of statistics generalizing $U$-statistics and $L$-statistics, and containing other varieties of statistic as well, such as trimmed $U$-statistics, is studied. Using the differentiable statistical function approach, differential approximations are obtained and the influence curves of these generalized $L$-statistics are derived. These results are employed to establish asymptotic normality for such statistics. Parallel generalizations of $M$- and $R$-statistics are…
This paper on estimating linear statistical relationships includes three lectures on linear functional and structural relationships, factor analysis, and simultaneous equations models. The emphasis is on relating the several models by a general approach and on the similarity of maximum likelihood estimators (under normality) in the different models. In the first two lectures the observable vector is decomposed into a "systematic part" and a random error; the systematic part…
Given a positive, normalized kernel and a finite measure on an Euclidean space, we construct a random density by convoluting the kernel with the Dirichlet random probability indexed by the finite measure. The posterior distribution of the random density given a sample is classified. The Bayes estimator of the density function is given.
This paper focuses on two aspects of the errors in variables problem--variance estimation of the classical estimators of slope and intercept, and the detection of influential observations. The behaviour of the jackknife, bootstrap, normal theory and influence function estimators of variability is examined under a number of sampling situations by Monte Carlo methods. In the multivariate case, perturbation analysis is used to calculate the influence function of the estimator…
The impact of survey design on standard multinomial-based methods for a multiway contingency table is studied, under nested loglinear models. The asymptotic null distribution of the Pearson chi-squared test statistic, $X^2$ (or the likelihood ratio test statistic, $G^2$) is obtained as a weighted sum of independent $\chi^2_1$ random variables, and the weights are then related to the familiar design effects (deffs) used by survey samplers. A simple correction to $X^2$ (or $G^2$…
An integral representation of the positive stable distributions is used to give a tabulation of the asymptotic test statistic for Watson's optimal invariant test for uniformity of distribution on a circle.
Wu (1980) defined the consistent directions of the least squares estimator in a linear model as the linear combinations of parameter estimates that are asymptotically consistent. For the polynomial regression model, a characterization of the space of consistent directions $S$ was obtained in terms of the convergence rates of the corresponding design sequence to its limit points. By employing a more general and yet simpler approach, we obtain here a similar result for any…
The expressions for coverage probability and ASN of the Stein's two-stage confidence interval procedure for estimating the normal mean have been obtained under the assumption that the underlying distribution is, in fact, different from normal but could be approximated by the first four terms of Edgeworth series. The comparison of coverage probabilities with the corresponding probabilities obtained for the normal distribution shows that the procedure is quite insensitive to…
In this paper, the hypothesis that a set of vectors lie in the subspace spanned by a prescribed subset of the principal component vectors for a normal population is considered. A class of invariant asymptotic tests based on the sample covariance matrix is derived. Tests in this class are shown to be consistent and their local power functions are given. The arguments used in deriving the class of tests are not heavily dependent on the assumption of normality nor on the use of…
The asymptotic distribution for the principal component roots under local alternatives to multiple population roots is derived. The asymptotic theory assumes the estimate of the population covariance or scatter matrix to be asymptotically normal and to possess certain invariance properties. These assumptions are satisfied for the affine-invariant $M$-estimates of scatter for an elliptical distribution. The local alternative framework is used in deriving a local power…
The problem of estimating an event, having positive probability content, based on a sample of $n$ observations is considered. A natural metric is shown to exist on the space of possible values for the event. This leads to the definition of optimal estimators. We derive optimal estimators for events which correspond to quantiles for the univariate exponential model. Further optimal estimators are derived for the events bounded by the ellipsoidal contours of the density…
The parameters of a stationary process can be viewed as functions of the spectral distribution function. This work concerns (estimators) parameters defined as integrals of $m (\geq 1)$-dimensional kernel functions with respect to the (sample) spectral distribution function. Conditions for asymptotic normality, almost sure convergence, and probability one bounds are derived for such estimators. The approach taken is based upon the reduction of an $m$-dimensional problem to…
Solutions of simultaneous equations of the maximum likelihood type or $M$-estimators can be represented as functionals. Existence and uniqueness of a root in a local region of the parameter space are proved under conditions that are easy to check. If only one root of the equation exists, the resulting statistical functional is Frechet differentiable and robust. When several solutions exists, conditions on the loss criterion used to select the root for the statistic ensure…
Consider the problem of estimating the unknown location parameter $\theta$ based on a random sample from $F(x - \theta)$, where $F$ is an unknown member of the class of distribution functions $\mathscr{F} = \{F: F$ is symmetric about 0 and $\sup_x |F(x) - \Phi(x)| \leq \varepsilon\}$, where $\Phi$ denotes the standard normal distribution function. Huber (1964) showed that $M$-estimation has a minimax property for this model, whereas Sacks and Ylvisaker (1972) showed that $L$-…
Konrad Behnen · Georg Neuhaus · Frits Ruymgaart·刊期 1983-12-01 · 卷 11(4)·The Annals of Statistics已编入正刊
两样本最优非参数得分函数的秩估计与相应自适应秩统计量AI 解读
In the general two-sample testing problem, $X_1, \cdots, X_m$ i.i.d. with continuous c.d.f. $F, Y_1, \cdots, Y_n$ i.i.d. with continuous c.d.f. $G$, and null hypothesis $H_0: F = G$ versus alternative $H_1: F \leq G, F \neq G$, we construct uniformly consistent and tractable rank estimators of the underlying optimal nonparametric score-function for a large subclass of (fixed) alternatives. Moreover, we prove asymptotic normality of the corresponding adaptive rank statistics…
We prove that the method of cross-validation suggested by A. W. Bowman and M. Rudemo achieves its goal of minimising integrated square error, in an asymptotic sense. The tail conditions we impose are only slightly more severe than the hypothesis of finite variance, and so least squares cross-validation does not exhibit the pathological behaviour which has been observed for Kullback-Leibler cross-validation. This is apparently the first time that a cross-validatory procedure…
Consider the multiclassification (discrimination) problem with known prior probabilities and a multi-dimensional vector of observations. Assume the underlying densities corresponding to the various classes are unknown but a training sample of size $N$ is available from each class. Rates of convergence to Bayes risk are investigated under smoothness conditions on the underlying densities of the type often seen in nonparametric density estimation. These rates can be…
For the nonparametric regression model $Y(t_i) = \theta(t_i) + \varepsilon(t_i)$ where $\theta$ is a smooth function to be estimated, $t_i$'s are nonrandom, $\varepsilon(t_i)$'s are i.i.d. errors, this paper studies the behavior of the kernel regression estimate $\hat{\theta}(t) = \big\lbrack \sum^n_{j=1}K \big(\frac{t_j - t}{\lambda}\big) Y(t_j) \big\rbrack / \big\lbrack\ sum^n_{j=1} K \big(\frac{t_j - t}{\lambda}\big) \big\rbrack$ when $\lambda$ is chosen by…
Two statistics are proposed for testing the homogeneity of signals, when these are noisy and repeatedly recorded. The distribution of the statistics is well approximated by the χ2 and the normal distribution, respectively, as shown by theoretical and simulation results. Power and insensitivity to other types of variation are discussed. The approach is developed in the context of analysing recordings of electric brain potentials being evoked by some stimulation, as…
A class of semi-Markov models, those which have proportional hazards and which are forward-going (if state j can be reached from i, then i cannot be reached from j), are shown to fit into the multiplicative intensity model of counting processes after suitable random time changes. Standard large-sample results for counting processes following this multiplicative model can therefore be used to make inferences on the above class of semi-Markov models, including the case…
Finite Sample Breakdown of M- and P-Estimators
The finite sample breakdown properties of M-estimators, defined by ∑ρ(xi−T)=min!, and of the associated Pitman-type or P-estimators, defined by T=∫exp{−Σρ(xi−θ)}dθ∫exp{−Σρ(xi−θ)}θdθ, are investigated. If ρ is symmetric, and ψ=ρ′ is monotone and bounded, then the breakdown point of either estimator is ε∗=1/2. If ψ decreases to 0 for large x ("r…
Let T^n be an estimate of the form T^n=T(F^n), where F^n is the sample cdf of niid observations and T is a locally quadratic functional defined on cdf′s. Then, the normalized jackknife estimates for bias, skewness, and variance of T^n approximate closely their bootstrap counterparts. Each of these estimates is consistent. Moreover, the jackknife and bootstrap estimates of variance…
Generalized L−,M−, and R-Statistics
A class of statistics generalizing U-statistics and L-statistics, and containing other varieties of statistic as well, such as trimmed U-statistics, is studied. Using the differentiable statistical function approach, differential approximations are obtained and the influence curves of these generalized L-statistics are derived. These results are employed to establish asymptotic normality for such statistics. Parallel generalizations of M- and R-statistics are…
The impact of survey design on standard multinomial-based methods for a multiway contingency table is studied, under nested loglinear models. The asymptotic null distribution of the Pearson chi-squared test statistic, X2 (or the likelihood ratio test statistic, G2) is obtained as a weighted sum of independent χ12 random variables, and the weights are then related to the familiar design effects (deffs) used by survey samplers. A simple correction to X2 (or G2…
Wu (1980) defined the consistent directions of the least squares estimator in a linear model as the linear combinations of parameter estimates that are asymptotically consistent. For the polynomial regression model, a characterization of the space of consistent directions S was obtained in terms of the convergence rates of the corresponding design sequence to its limit points. By employing a more general and yet simpler approach, we obtain here a similar result for any…
The asymptotic distribution for the principal component roots under local alternatives to multiple population roots is derived. The asymptotic theory assumes the estimate of the population covariance or scatter matrix to be asymptotically normal and to possess certain invariance properties. These assumptions are satisfied for the affine-invariant M-estimates of scatter for an elliptical distribution. The local alternative framework is used in deriving a local power…
The problem of estimating an event, having positive probability content, based on a sample of n observations is considered. A natural metric is shown to exist on the space of possible values for the event. This leads to the definition of optimal estimators. We derive optimal estimators for events which correspond to quantiles for the univariate exponential model. Further optimal estimators are derived for the events bounded by the ellipsoidal contours of the density…
The parameters of a stationary process can be viewed as functions of the spectral distribution function. This work concerns (estimators) parameters defined as integrals of m(≥1)-dimensional kernel functions with respect to the (sample) spectral distribution function. Conditions for asymptotic normality, almost sure convergence, and probability one bounds are derived for such estimators. The approach taken is based upon the reduction of an m-dimensional problem to…
Solutions of simultaneous equations of the maximum likelihood type or M-estimators can be represented as functionals. Existence and uniqueness of a root in a local region of the parameter space are proved under conditions that are easy to check. If only one root of the equation exists, the resulting statistical functional is Frechet differentiable and robust. When several solutions exists, conditions on the loss criterion used to select the root for the statistic ensure…
On the Minimax Property for R-Estimators of Location
Consider the problem of estimating the unknown location parameter θ based on a random sample from F(x−θ), where F is an unknown member of the class of distribution functions F={F:F is symmetric about 0 and supx∣F(x)−Φ(x)∣≤ε}, where Φ denotes the standard normal distribution function. Huber (1964) showed that M-estimation has a minimax property for this model, whereas Sacks and Ylvisaker (1972) showed that L-…
In the general two-sample testing problem, X1,⋯,Xm i.i.d. with continuous c.d.f. F,Y1,⋯,Yn i.i.d. with continuous c.d.f. G, and null hypothesis H0:F=G versus alternative H1:F≤G,F=G, we construct uniformly consistent and tractable rank estimators of the underlying optimal nonparametric score-function for a large subclass of (fixed) alternatives. Moreover, we prove asymptotic normality of the corresponding adaptive rank statistics…
Consider the multiclassification (discrimination) problem with known prior probabilities and a multi-dimensional vector of observations. Assume the underlying densities corresponding to the various classes are unknown but a training sample of size N is available from each class. Rates of convergence to Bayes risk are investigated under smoothness conditions on the underlying densities of the type often seen in nonparametric density estimation. These rates can be…
For the nonparametric regression model Y(ti)=θ(ti)+ε(ti) where θ is a smooth function to be estimated, ti's are nonrandom, ε(ti)'s are i.i.d. errors, this paper studies the behavior of the kernel regression estimate θ^(t)=[∑j=1nK(λtj−t)Y(tj)]/[sumj=1nK(λtj−t)] when λ is chosen by…