Graphical models are popular statistical tools which are used to represent dependent or causal complex systems. Statistically equivalent causal or directed graphical models are said to belong to a Markov equivalent class. It is of great interest to describe and understand the space of such classes. However, with currently known algorithms, sampling over such classes is only feasible for graphs with fewer than approximately 20 vertices. In this paper, we design reversible…
Uniformly most powerful tests are statistical hypothesis tests that provide the greatest power against a fixed null hypothesis among all tests of a given size. In this article, the notion of uniformly most powerful tests is extended to the Bayesian setting by defining uniformly most powerful Bayesian tests to be tests that maximize the probability that the Bayes factor, in favor of the alternative hypothesis, exceeds a specified threshold. Like their classical counterpart,…
Holger Dette · Viatcheslav B. Melas · Petr Shpilev·刊期 2013-08-01 · 卷 41(4)·The Annals of Statistics已编入正刊
稳健的 T 最优模型判别设计AI 解读
This paper considers the problem of constructing optimal discriminating experimental designs for competing regression models on the basis of the $T$-optimality criterion introduced by Atkinson and Fedorov [Biometrika 62 (1975a) 57–70]. $T$-optimal designs depend on unknown model parameters and it is demonstrated that these designs are sensitive with respect to misspecification. As a solution to this problem we propose a Bayesian and standardized maximin approach to construct…
Standard approaches to constructing nonparametric confidence bands for functions are frustrated by the impact of bias, which generally is not estimated consistently when using the bootstrap and conventionally smoothed function estimators. To overcome this problem it is common practice to either undersmooth, so as to reduce the impact of bias, or oversmooth, and thereby introduce an explicit or implicit bias estimator. However, these approaches, and others based on…
The uniform distribution on matrices with specified row and column sums is often a natural choice of null model when testing for structure in two-way tables (binary or nonnegative integer). Due to the difficulty of sampling from this distribution, many approximate methods have been developed. We will show that by exploiting certain symmetries, exact sampling and counting is in fact possible in many nontrivial real-world cases. We illustrate with real datasets including…
Population quantiles and their functions are important parameters in many applications. For example, the lower quantiles often serve as crucial quality indices for forestry products. Given several independent samples from populations satisfying the density ratio model, we investigate the properties of empirical likelihood (EL) based inferences. The induced EL quantile estimators are shown to admit a Bahadur representation that leads to asymptotically valid confidence…
The paper is devoted to the problem of estimation of a univariate component in a heteroscedastic nonparametric multiple regression under the mean integrated squared error (MISE) criteria. The aim is to understand how the scale function should be used for estimation of the univariate component. It is known that the scale function does not affect the rate of the MISE convergence, and as a result sharp constants are explored. The paper begins with developing a sharp-minimax…
This paper establishes that so-called instrumental variables enable the identification and the estimation of a fully nonparametric regression model with Berkson-type measurement error in the regressors. An estimator is proposed and proven to be consistent. Its practical performance and feasibility are investigated via Monte Carlo simulations as well as through an epidemiological application investigating the effect of particulate air pollution on respiratory health. These…
This paper investigates the Gaussian quasi-likelihood estimation of an exponentially ergodic multidimensional Markov process, which is expressed as a solution to a Lévy driven stochastic differential equation whose coefficients are known except for the finite-dimensional parameters to be estimated, where the diffusion coefficient may be degenerate or even null. We suppose that the process is discretely observed under the rapidly increasing experimental design with step size $h_{n}$…
In this paper nonparametric methods to assess the multivariate Lévy measure are introduced. Starting from high-frequency observations of a Lévy process $\mathbf{X} $, we construct estimators for its tail integrals and the Pareto–Lévy copula and prove weak convergence of these estimators in certain function spaces. Given $n$ observations of increments over intervals of length $\Delta_{n}$, the rate of convergence is $k_{n}^{-1/2}$ for $k_{n}=n\Delta_{n}$ which is natural…
We consider a multidimensional Itô semimartingale regularly sampled on $[0,t]$ at high frequency $1/\Delta_{n}$, with $\Delta_{n}$ going to zero. The goal of this paper is to provide an estimator for the integral over $[0,t]$ of a given function of the volatility matrix. To approximate the integral, we simply use a Riemann sum based on local estimators of the pointwise volatility. We show that although the accuracy of the pointwise estimation is at most $\Delta_{n}^{1/4}$,…
Considering two independent Poisson processes, we address the question of testing equality of their respective intensities. We first propose testing procedures whose test statistics are $U$-statistics based on single kernel functions. The corresponding critical values are constructed from a nonasymptotic wild bootstrap approach, leading to level $\alpha$ tests. Various choices for the kernel functions are possible, including projection, approximation or reproducing kernels.…
We consider optimal sequential allocation in the context of the so-called stochastic multi-armed bandit model. We describe a generic index policy, in the sense of Gittins [J. R. Stat. Soc. Ser. B Stat. Methodol. 41 (1979) 148–177], based on upper confidence bounds of the arm payoffs computed using the Kullback–Leibler divergence. We consider two classes of distributions for which instances of this general idea are analyzed: the kl-UCB algorithm is designed for one-parameter…
Minh Tang · Daniel L. Sussman · Carey E. Priebe·刊期 2013-06-01 · 卷 41(3)·The Annals of Statistics已编入正刊
潜在位置图上的普遍相合顶点分类AI 解读
In this work we show that, using the eigen-decomposition of the adjacency matrix, we can consistently estimate feature maps for latent position graphs with positive definite link function $\kappa$, provided that the latent positions are i.i.d. from some distribution $F$. We then consider the exploitation task of vertex classification where the link function $\kappa$ belongs to the class of universal kernels and class labels are observed for a number of vertices tending to…
We investigate the learning rate of multiple kernel learning (MKL) with $\ell_{1}$ and elastic-net regularizations. The elastic-net regularization is a composition of an $\ell_{1}$-regularizer for inducing the sparsity and an $\ell_{2}$-regularizer for controlling the smoothness. We focus on a sparse setting where the total number of kernels is large, but the number of nonzero components of the ground truth is relatively small, and show sharper convergence rates than the…
This paper proposes a widely applicable method of approximate maximum-likelihood estimation for multivariate diffusion process from discretely sampled data. A closed-form asymptotic expansion for transition density is proposed and accompanied by an algorithm containing only basic and explicit calculations for delivering any arbitrary order of the expansion. The likelihood function is thus approximated explicitly and employed in statistical estimation. The performance of our…
In this paper, we derive higher order Edgeworth expansions for the finite sample distributions of the subsampling-based $t$-statistic and the Wald statistic in the Gaussian location model under the so-called fixed-smoothing paradigm. In particular, we show that the error of asymptotic approximation is at the order of the reciprocal of the sample size and obtain explicit forms for the leading error terms in the expansions. The results are used to justify the second-order…
Johannes Schmidt-Hieber · Axel Munk · Lutz Dümbgen·刊期 2013-06-01 · 卷 41(3)·The Annals of Statistics已编入正刊
反卷积中的形状约束多尺度方法:定性特征的置信陈述AI 解读
We derive multiscale statistics for deconvolution in order to detect qualitative features of the unknown density. An important example covered within this framework is to test for local monotonicity on all scales simultaneously. We investigate the moderately ill-posed setting, where the Fourier transform of the error density in the deconvolution model is of polynomial decay. For multiscale testing, we consider a calibration, motivated by the modulus of continuity of Brownian…
Ngai Hang Chan · Shih-Feng Huang · Ching-Kang Ing·刊期 2013-06-01 · 卷 41(3)·The Annals of Statistics已编入正刊
长记忆时间序列的矩界与均方预测误差AI 解读
A moment bound for the normalized conditional-sum-of-squares (CSS) estimate of a general autoregressive fractionally integrated moving average (ARFIMA) model with an arbitrary unknown memory parameter is derived in this paper. To achieve this goal, a uniform moment bound for the inverse of the normalized objective function is established. An important application of these results is to establish asymptotic expressions for the one-step and multi-step mean squared prediction…
In a recent paper Yang and Stufken [Ann. Statist. 40 (2012a) 1665–1685] gave sufficient conditions for complete classes of designs for nonlinear regression models. In this note we demonstrate that there is an alternative way to validate this result. Our main argument utilizes the fact that boundary points of moment spaces generated by Chebyshev systems possess unique representations.
Zou [J. Amer. Statist. Assoc. 101 (2006) 1418–1429] proposed the Adaptive LASSO (ALASSO) method for simultaneous variable selection and estimation of the regression parameters, and established its oracle property. In this paper, we investigate the rate of convergence of the ALASSO estimator to the oracle distribution when the dimension of the regression parameters may grow to infinity with the sample size. It is shown that the rate critically depends on the choices of the…
Alexei Onatski · Marcelo J. Moreira · Marc Hallin·刊期 2013-06-01 · 卷 41(3)·The Annals of Statistics已编入正刊
高维数据球形性检验的渐近功效AI 解读
This paper studies the asymptotic power of tests of sphericity against perturbations in a single unknown direction as both the dimensionality of the data and the number of observations go to infinity. We establish the convergence, under the null hypothesis and contiguous alternatives, of the log ratio of the joint densities of the sample covariance eigenvalues to a Gaussian process indexed by the norm of the perturbation. When the perturbation norm is larger than the phase…
The generalized likelihood ratio (GLR) test proposed by Fan, Zhang and Zhang [Ann. Statist. 29 (2001) 153–193] and Fan and Yao [Nonlinear Time Series: Nonparametric and Parametric Methods (2003) Springer] is a generally applicable nonparametric inference procedure. In this paper, we show that although it inherits many advantages of the parametric maximum likelihood ratio (LR) test, the GLR test does not have the optimal power property. We propose a generally applicable test…
Alessandro Rinaldo · Sonja Petrović · Stephen E. Fienberg·刊期 2013-06-01 · 卷 41(3)·The Annals of Statistics已编入正刊
β 模型中的最大似然估计AI 解读
We study maximum likelihood estimation for the statistical model for undirected random graphs, known as the $\beta$-model, in which the degree sequences are minimal sufficient statistics. We derive necessary and sufficient conditions, based on the polytope of degree sequences, for the existence of the maximum likelihood estimator (MLE) of the model parameters. We characterize in a combinatorial fashion sample points leading to a nonexistent MLE, and nonestimability of the…
This paper considers the problem of constructing optimal discriminating experimental designs for competing regression models on the basis of the T-optimality criterion introduced by Atkinson and Fedorov [Biometrika 62 (1975a) 57–70]. T-optimal designs depend on unknown model parameters and it is demonstrated that these designs are sensitive with respect to misspecification. As a solution to this problem we propose a Bayesian and standardized maximin approach to construct…
This paper investigates the Gaussian quasi-likelihood estimation of an exponentially ergodic multidimensional Markov process, which is expressed as a solution to a Lévy driven stochastic differential equation whose coefficients are known except for the finite-dimensional parameters to be estimated, where the diffusion coefficient may be degenerate or even null. We suppose that the process is discretely observed under the rapidly increasing experimental design with step size hn…
In this paper nonparametric methods to assess the multivariate Lévy measure are introduced. Starting from high-frequency observations of a Lévy process X, we construct estimators for its tail integrals and the Pareto–Lévy copula and prove weak convergence of these estimators in certain function spaces. Given n observations of increments over intervals of length Δn, the rate of convergence is kn−1/2 for kn=nΔn which is natural…
We consider a multidimensional Itô semimartingale regularly sampled on [0,t] at high frequency 1/Δn, with Δn going to zero. The goal of this paper is to provide an estimator for the integral over [0,t] of a given function of the volatility matrix. To approximate the integral, we simply use a Riemann sum based on local estimators of the pointwise volatility. We show that although the accuracy of the pointwise estimation is at most Δn1/4,…
Considering two independent Poisson processes, we address the question of testing equality of their respective intensities. We first propose testing procedures whose test statistics are U-statistics based on single kernel functions. The corresponding critical values are constructed from a nonasymptotic wild bootstrap approach, leading to level α tests. Various choices for the kernel functions are possible, including projection, approximation or reproducing kernels.…
In this work we show that, using the eigen-decomposition of the adjacency matrix, we can consistently estimate feature maps for latent position graphs with positive definite link function κ, provided that the latent positions are i.i.d. from some distribution F. We then consider the exploitation task of vertex classification where the link function κ belongs to the class of universal kernels and class labels are observed for a number of vertices tending to…
We investigate the learning rate of multiple kernel learning (MKL) with ℓ1 and elastic-net regularizations. The elastic-net regularization is a composition of an ℓ1-regularizer for inducing the sparsity and an ℓ2-regularizer for controlling the smoothness. We focus on a sparse setting where the total number of kernels is large, but the number of nonzero components of the ground truth is relatively small, and show sharper convergence rates than the…
In this paper, we derive higher order Edgeworth expansions for the finite sample distributions of the subsampling-based t-statistic and the Wald statistic in the Gaussian location model under the so-called fixed-smoothing paradigm. In particular, we show that the error of asymptotic approximation is at the order of the reciprocal of the sample size and obtain explicit forms for the leading error terms in the expansions. The results are used to justify the second-order…
Maximum lilkelihood estimation in the β-model
We study maximum likelihood estimation for the statistical model for undirected random graphs, known as the β-model, in which the degree sequences are minimal sufficient statistics. We derive necessary and sufficient conditions, based on the polytope of degree sequences, for the existence of the maximum likelihood estimator (MLE) of the model parameters. We characterize in a combinatorial fashion sample points leading to a nonexistent MLE, and nonestimability of the…