First, an approach to an upper bound for the risk matrix of GLSE's is established when the information on the parameter space of the structural parameter in the covariance matrix of the error can be utilized. Second, this result is applied to regression with (i) serial correlation and (ii) heteroscedastic covariance structure. In the heteroscedastic regression, the problem of estimating the common mean of two normal populations is studied in detail.
Let $\mathscr{E}^n$ be a statistical experiment based on $n$ i.i.d. observations. We compare $\mathscr{E}^n$ with $\mathscr{E}^{n+r_n}$. The gain of information due to the $r_n$ additional observations is measured by the deficiency distance $\Delta (\mathscr{E}^n, \mathscr{E}^{n+r_n})$, i.e., the maximum diminution of the risk functions. We show that under general dimensionality conditions $\Delta(\mathscr{E}^n, \mathscr{E}^{n+r_n})$ is of order $r_n/n$. Further the behavior…
The performance of a sequence of estimators $\{T_n\}$ of $g(\theta)$ can be measured by its inaccuracy rate $-\lim \inf_{n\rightarrow\infty} n^{-1} \log \mathbb{P}_\theta(\|T_n - g(\theta)\| > \varepsilon)$. For fixed $\varepsilon > 0$ optimality of consistent estimators $\operatorname{wrt}$ the inaccuracy rate is investigated. It is shown that for exponential families in standard representation with a convex parameter space the maximum likelihood estimator is optimal. If…
We prove a Donsker-type invariance principle for a nearest-neighbor-type conditional empirical process. As an application we show asymptotic normality of conditional quantiles and derive large-sample distribution-free tests and confidence bands for a conditional distribution function.
A class of empirical processes associated with $V$-statistics ($V$-empirical process) under random censoring, and a class of nonparametric estimators based on the corresponding quantile process are defined. The $V$-empirical process is the censored data analogue of the $U$-empirical process considered by Silverman (1976, 1983). The class of estimators is the analogue of the class of generalized $L$-statistics introduced by Serfling (1984) and it includes the results of…
Joseph C. Gardiner · V. Susarla · John Van Ryzin·刊期 1986-06-01 · 卷 14(2)·The Annals of Statistics已编入正刊
随机退出下指数平均寿命的时间序贯估计AI 解读
In the context of lifetesting, an asymptotically risk-efficient procedure for the estimation of the exponential mean lifetime is considered when the survival times of the units are subject to random censorship. The loss function is the sum of squared error due to estimation, cost of recruitment of the units, and cost of total time on test. Asymptotic properties of the sequential estimator and stopping time are described as the per unit cost of total time on test decreases to…
Let $(X, Y)$ be a pair of random variables such that $X = (X_1,\cdots, X_J)$ ranges over $C = \lbrack 0, 1\rbrack^J$. The conditional distribution of $Y$ given $X = x$ is assumed to belong to a suitable exponential family having parameter $\eta \in \mathbb{R}$. Let $\eta = f(x)$ denote the dependence of $\eta$ on $x$. Let $f^\ast$ denote the additive approximation to $f$ having the maximum possible expected log-likelihood under the model. Maximum likelihood is used to fit an…
Estimation by the method of sieves for a semimartingale regression model introduced by Aalen (1980) is studied. It is of interest to estimate functions which describe the influence of the covariates over time. An estimator for these functions is introduced and conditions which ensure consistency of the estimator in $L^2$-norm are given. Applications to diffusion processes and point processes with censored data are also discussed.
This paper is concerned with the problem of estimating the variable time delays of a signal arriving at an array of sensors. A procedure to estimate the parameters of a linear time delay model is proposed. The procedure compares the Fourier transforms at different frequencies (thereby taking the Doppler effect into consideration). Under regularity conditions, the estimate obtained is shown to be consistent and asymptotically normal. Simulations were carried out and the…
Let $X_t = \sum^\infty_{j=-\infty} c_jZ_{t-j}$ be a moving average process where the $Z_t$'s are iid and have regularly varying tail probabilities with index $\alpha > 0$. The limit distribution of the sample covariance function is derived in the case that the process has a finite variance but an infinite fourth moment. Furthermore, in the infinite variance case $(0 < \alpha < 2)$, the sample correlation function is shown to converge in distribution to the ratio of two…
This paper is concerned with model selection in time series analysis. An identification criterion is presented that is asymptotically equivalent to a Bayes decision rule. The discussion is conducted in the context of a general class of parametric time series models and consideration is given to the special case of order determination in autoregressive moving-average representations. Consistency of the criterion is proved.
Christian Genest · Kevin J. McConway · Mark J. Schervish·刊期 1986-06-01 · 卷 14(2)·The Annals of Statistics已编入正刊
外部贝叶斯意见汇总算子的刻画AI 解读
When a panel of experts is asked to provide some advice in the form of a group probability distribution, the question arises as to whether they should synthesize their opinions before or after they learn the outcome of an experiment. If the group posterior distribution is the same whatever the order in which the pooling and the updating are done, the pooling mechanism is said to be externally Bayesian by Madansky (1964). In this paper, we characterize all externally Bayesian…
Under the assumption of normal errors, confidence spheres for $p(p \geq 3)$ coefficients of a linear model centered at the positive part James-Stein estimators were recently proved, by Hwang and Casella, to dominate the usual confidence set with the same radius. In this paper, the same domination results are established under various spherically symmetric distributions. These distributions include uniform distributions, double exponential distributions, and multivariate $t$ d…
The confidence sets for a $q$-dimensional distribution studied in this paper have several attractive features: affine invariance, correct asymptotic level whatever the actual distribution may be, numerical feasibility, and a local asymptotic minimax optimality property. When dimension $q$ equals one, the confidence sets reduce to the usual Kolmogorov-Smirnov confidence bands, except that critical values are determined by bootstrapping.
Under the common principal component model $k$ covariance matrices $\mathbf{\Sigma}_1,\cdots,\mathbf{\Sigma}_k$ are simultaneously diagonalizable, i.e., there exists an orthogonal matrix $\mathbf{\beta}$ such that $\mathbf{\beta'\Sigma_i\beta = \Lambda_i}$ is diagonal for $i = 1,\cdots, k$. In this article we give the asymptotic distribution of the maximum likelihood estimates of $\mathbf{\beta}$ and $\mathbf{\Lambda}_i$. Using these results, we derive tests for (a) equality…
Blair M. Anderson · T. W. Anderson · Ingram Olkin·刊期 1986-06-01 · 卷 14(2)·The Annals of Statistics已编入正刊
多元方差分量模型的极大似然估计与似然比准则AI 解读
Maximum likelihood estimators are obtained for multivariate components of variance models under the condition that the effect covariance matrix is positive semidefinite with a maximum rank. The rank of the estimator is random. The estimation procedure leads to a likelihood ratio test that the rank of the effect matrix is not greater than a given number against the alternative that the rank is not greater than a larger specified number. Linear structural relationship models…
A strongly dependent Gaussian sequence has a spectral density $f(x, \theta)$ satisfying $f(x, \theta) \sim |x|^{-\alpha(\theta)} L_\theta(x)$ as $x \rightarrow 0$, where $0 < \alpha(\theta) < 1$ and $L_\theta(x)$ varies slowly at 0. Here $\theta$ is a vector of unknown parameters. An estimator for $\theta$ is proposed and shown to be consistent and asymptotically normal under appropriate conditions. These conditions are satisfied by fractional Gaussian noise and fractional…
For Bayesian analysis, an attractive method of modelling uncertainty in the prior distribution is through use of $\varepsilon$-contamination classes, i.e., classes of distributions which have the form $\pi = (1 - \varepsilon)\pi_0 + \varepsilon q, \pi_0$ being the base elicited prior, $q$ being a "contamination," and $\varepsilon$ reflecting the amount of error in $\pi_0$ that is deemed possible. Classes of contaminations that are considered include (i) all possible…
Gong and Samaniego (1981) define pseudo maximum likelihood estimation and derive the asymptotic distribution of the resulting estimates. This note gives a simpler and more elegant expression for the asymptotic variance of a pseudo maximum likelihood estimate.
We consider the following problem arising in robust estimation theory: Find the maximum asymptotic variance of a trimmed mean used to estimate an unknown location parameter when the error distribution is subject to asymmetric contamination. The model for the error distribution is $F = (1 - \varepsilon)F_0 + \varepsilon G$, where $F_0$ is a known distribution symmetric about $0, \varepsilon$ is fixed proportion of contamination, and $G$ is an unknown and possibly asymmetric…
The autoregressive orders selected by the criterion autoregressive transfer function (CAT) of Parzen (1974), a new version, CAT$^\ast$, of CAT introduced by Parzen (1977), and the CAT$_2$ criterion of Bhansali (1985) are shown to be asymptotically efficient in the sense defined by Shibata (1980, 1981). A generalization of the penalty function considered by Shibata (1980) is introduced. The order selected by the CAT$_\alpha$ criterion of Bhansali (1985), with any fixed $\alpha > 1$…
Radhika V. Kulkarni · Christopher Jennison·刊期 1986-03-01 · 卷 14(1)·The Annals of Statistics已编入正刊
Bechhofer–Kulkarni伯努利总体选择程序的最优性质AI 解读
In a recent article Bechhofer and Kulkarni proposed a class of closed adaptive sequential procedures for selecting that one of $k \geq 2$ Bernoulli populations with the largest single-trial success probability. These sequential procedures which take no more than $n$ observations from any one of the $k$ populations achieve the same probability of a correct selection as does a single-stage procedure which takes exactly $n$ observations from every one of the $k$ populations. In…
This paper shows that for sequential sampling without recall from a Dirichlet process, there exists a finite bound beyond which one will cease sampling with probability 1. The result is valid for Dirichlet processes defined on closed bounded intervals of the real line.
In the course of conducting a clinical trial to compare $K (\geq 2)$ treatments, it is often desirable to balance the trial with respect to the assignments of patients to treatments. On the other hand, some form of randomization of treatment assignments is essential for reducing experimental bias. In this article, the large-sample approximation to the null distribution of $K$-sample randomization tests generated from a broad class of restricted randomization rules is…
Let En be a statistical experiment based on n i.i.d. observations. We compare En with En+rn. The gain of information due to the rn additional observations is measured by the deficiency distance Δ(En,En+rn), i.e., the maximum diminution of the risk functions. We show that under general dimensionality conditions Δ(En,En+rn) is of order rn/n. Further the behavior…
The performance of a sequence of estimators {Tn} of g(θ) can be measured by its inaccuracy rate −liminfn→∞n−1logPθ(∥Tn−g(θ)∥>ε). For fixed ε>0 optimality of consistent estimators wrt the inaccuracy rate is investigated. It is shown that for exponential families in standard representation with a convex parameter space the maximum likelihood estimator is optimal. If…
Empirical Processes Associated with V-Statistics and a Class of Estimators Under Random Censoring
A class of empirical processes associated with V-statistics (V-empirical process) under random censoring, and a class of nonparametric estimators based on the corresponding quantile process are defined. The V-empirical process is the censored data analogue of the U-empirical process considered by Silverman (1976, 1983). The class of estimators is the analogue of the class of generalized L-statistics introduced by Serfling (1984) and it includes the results of…
Let (X,Y) be a pair of random variables such that X=(X1,⋯,XJ) ranges over C=[0,1]J. The conditional distribution of Y given X=x is assumed to belong to a suitable exponential family having parameter η∈R. Let η=f(x) denote the dependence of η on x. Let f∗ denote the additive approximation to f having the maximum possible expected log-likelihood under the model. Maximum likelihood is used to fit an…
Estimation by the method of sieves for a semimartingale regression model introduced by Aalen (1980) is studied. It is of interest to estimate functions which describe the influence of the covariates over time. An estimator for these functions is introduced and conditions which ensure consistency of the estimator in L2-norm are given. Applications to diffusion processes and point processes with censored data are also discussed.
Let Xt=∑j=−∞∞cjZt−j be a moving average process where the Zt's are iid and have regularly varying tail probabilities with index α>0. The limit distribution of the sample covariance function is derived in the case that the process has a finite variance but an infinite fourth moment. Furthermore, in the infinite variance case (0<α<2), the sample correlation function is shown to converge in distribution to the ratio of two…
Under the assumption of normal errors, confidence spheres for p(p≥3) coefficients of a linear model centered at the positive part James-Stein estimators were recently proved, by Hwang and Casella, to dominate the usual confidence set with the same radius. In this paper, the same domination results are established under various spherically symmetric distributions. These distributions include uniform distributions, double exponential distributions, and multivariate t d…
The confidence sets for a q-dimensional distribution studied in this paper have several attractive features: affine invariance, correct asymptotic level whatever the actual distribution may be, numerical feasibility, and a local asymptotic minimax optimality property. When dimension q equals one, the confidence sets reduce to the usual Kolmogorov-Smirnov confidence bands, except that critical values are determined by bootstrapping.
Under the common principal component model k covariance matrices Σ1,⋯,Σk are simultaneously diagonalizable, i.e., there exists an orthogonal matrix β such that β′Σiβ=Λi is diagonal for i=1,⋯,k. In this article we give the asymptotic distribution of the maximum likelihood estimates of β and Λi. Using these results, we derive tests for (a) equality…
A strongly dependent Gaussian sequence has a spectral density f(x,θ) satisfying f(x,θ)∼∣x∣−α(θ)Lθ(x) as x→0, where 0<α(θ)<1 and Lθ(x) varies slowly at 0. Here θ is a vector of unknown parameters. An estimator for θ is proposed and shown to be consistent and asymptotically normal under appropriate conditions. These conditions are satisfied by fractional Gaussian noise and fractional…
Robust Bayes and Empirical Bayes Analysis with ϵ-Contaminated Priors
For Bayesian analysis, an attractive method of modelling uncertainty in the prior distribution is through use of ε-contamination classes, i.e., classes of distributions which have the form π=(1−ε)π0+εq,π0 being the base elicited prior, q being a "contamination," and ε reflecting the amount of error in π0 that is deemed possible. Classes of contaminations that are considered include (i) all possible…
We consider the following problem arising in robust estimation theory: Find the maximum asymptotic variance of a trimmed mean used to estimate an unknown location parameter when the error distribution is subject to asymmetric contamination. The model for the error distribution is F=(1−ε)F0+εG, where F0 is a known distribution symmetric about 0,ε is fixed proportion of contamination, and G is an unknown and possibly asymmetric…
The autoregressive orders selected by the criterion autoregressive transfer function (CAT) of Parzen (1974), a new version, CAT∗, of CAT introduced by Parzen (1977), and the CAT2 criterion of Bhansali (1985) are shown to be asymptotically efficient in the sense defined by Shibata (1980, 1981). A generalization of the penalty function considered by Shibata (1980) is introduced. The order selected by the CATα criterion of Bhansali (1985), with any fixed α>1…
In a recent article Bechhofer and Kulkarni proposed a class of closed adaptive sequential procedures for selecting that one of k≥2 Bernoulli populations with the largest single-trial success probability. These sequential procedures which take no more than n observations from any one of the k populations achieve the same probability of a correct selection as does a single-stage procedure which takes exactly n observations from every one of the k populations. In…
K-Treatment Comparisons with Restricted Randomization Rules in Clinical Trials
In the course of conducting a clinical trial to compare K(≥2) treatments, it is often desirable to balance the trial with respect to the assignments of patients to treatments. On the other hand, some form of randomization of treatment assignments is essential for reducing experimental bias. In this article, the large-sample approximation to the null distribution of K-sample randomization tests generated from a broad class of restricted randomization rules is…