We want to congratulate the authors for a thought-provoking and very interesting paper.Sparse modeling of the concentration matrix has enjoyed popularity in recent years.It has been framed as a computationally convenient convex ℓ 1constrained estimation problem in Yuan and Lin (2007) and can be applied readily to higher-dimensional problems.The authors argue-we think correctly-that the sparsity of the concentration matrix is for many applications more plausible after the…
I want to start by congratulating Professors Chandrasekaran, Parrilo and Willsky for this fine piece of work.Their paper, hereafter referred to as CPW, addresses one of the biggest practical challenges of Gaussian graphical models-how to make inferences for a graphical model in the presence of missing variables.The difficulty comes from the fact that the validity of conditional independence relationships implied by a graphical model relies critically on the assumption that…
While linear mixed modeling methods are foundational concepts introduced in any statistical education, adequate general methods for interval estimation involving models with more than a few variance components are lacking, especially in the unbalanced setting. Generalized fiducial inference provides a possible framework that accommodates this absence of methodology. Under the fabric of generalized fiducial inference along with sequential Monte Carlo methods, we present an…
This paper is concerned with the selection and estimation of fixed and random effects in linear mixed effects models. We propose a class of nonconcave penalized profile likelihood methods for selecting and estimating important fixed effects. To overcome the difficulty of unknown covariance matrix of random effects, we propose to use a proxy matrix in the penalized profile likelihood. We establish conditions on the choice of the proxy matrix and show that the proposed…
Venkat Chandrasekaran · Pablo A. Parrilo · Alan S. Willsky·刊期 2012-08-01 · 卷 40(4)·The Annals of Statistics已编入正刊
作者答复:通过凸优化选择潜变量图模型AI 解读
Introduction.We thank all the discussants for their careful reading of our paper, and for their insightful critiques.We would also like to thank the editors for organizing this discussion.Our paper contributes to the area of high-dimensional statistics which has received much attention over the past several years across the statistics, machine learning and signal processing communities.In this rejoinder we clarify and comment on some of the points raised in the…
We wish to congratulate the authors for their innovative contribution, which is bound to inspire much further research.We find latent variable model selection to be a fantastic application of matrix decomposition methods, namely, the superposition of low-rank and sparse elements.Clearly, the methodology introduced in this paper is of potential interest across many disciplines.In the following, we will first discuss this paper in more detail and then reflect on the…
Venkat Chandrasekaran · Pablo A. Parrilo · Alan S. Willsky·刊期 2012-08-01 · 卷 40(4)·The Annals of Statistics已编入正刊
通过凸优化选择潜变量图模型AI 解读
Suppose we observe samples of a subset of a collection of random variables. No additional information is provided about the number of latent variables, nor of the relationship between the latent and observed variables. Is it possible to discover the number of latent components, and to learn a statistical model over the entire collection of variables? We address this question in the setting in which the latent and observed variables are jointly Gaussian, with the conditional…
Estimation of large covariance matrices has drawn considerable recent attention, and the theoretical focus so far has mainly been on developing a minimax theory over a fixed parameter space. In this paper, we consider adaptive covariance matrix estimation where the goal is to construct a single procedure which is minimax rate optimal simultaneously over each parameter space in a large collection. A fully data-driven block thresholding estimator is proposed. The estimator is…
We consider full Bayesian inference in the multivariate normal mean model in the situation that the mean vector is sparse. The prior distribution on the vector of means is constructed hierarchically by first choosing a collection of nonzero means and next a prior on the nonzero values. We consider the posterior distribution in the frequentist set-up that the observations are generated according to a fixed mean vector, and are interested in the posterior distribution of the…
Whilst estimation of the marginal (total) causal effect of a point exposure on an outcome is arguably the most common objective of experimental and observational studies in the health and social sciences, in recent years, investigators have also become increasingly interested in mediation analysis. Specifically, upon evaluating the total effect of the exposure, investigators routinely wish to make inferences about the direct or indirect pathways of the effect of the exposure…
Young K. Lee · Enno Mammen · Byeong U. Park·刊期 2012-06-01 · 卷 40(3)·The Annals of Statistics已编入正刊
灵活的广义变系数回归模型AI 解读
This paper studies a very flexible model that can be used widely to analyze the relation between a response and multiple covariates. The model is nonparametric, yet renders easy interpretation for the effects of the covariates. The model accommodates both continuous and discrete random variables for the response and covariates. It is quite flexible to cover the generalized varying coefficient models and the generalized additive models as special cases. Under a weak condition…
Given a finite family of functions, the goal of model selection aggregation is to construct a procedure that mimics the function from this family that is the closest to an unknown regression function. More precisely, we consider a general regression model with fixed design and measure the distance between functions by the mean squared error at the design points. While procedures based on exponential weights are known to solve the problem of model selection aggregation in…
Gaorong Li · Heng Peng · Jun Zhang · Lixing Zhu·刊期 2012-06-01 · 卷 40(3)·The Annals of Statistics已编入正刊
基于稳健秩相关的变量筛选AI 解读
Independence screening is a variable selection method that uses a ranking criterion to select significant variables, particularly for statistical models with nonpolynomial dimensionality or “large $p$, small $n$” paradigms when $p$ can be as large as an exponential of the sample size $n$. In this paper we propose a robust rank correlation screening (RRCS) method to deal with ultra-high dimensional data. The new procedure is based on the Kendall $\tau$ correlation coefficient…
Balancing treatment allocation for influential covariates is critical in clinical trials. This has become increasingly important as more and more biomarkers are found to be associated with different diseases in translational research (genomics, proteomics and metabolomics). Stratified permuted block randomization and minimization methods [Pocock and Simon Biometrics 31 (1975) 103–115, etc.] are the two most popular approaches in practice. However, stratified permuted block…
John H. J. Einmahl · Andrea Krajina · Johan Segers·刊期 2012-06-01 · 卷 40(3)·The Annals of Statistics已编入正刊
任意维度尾部依赖的 M 估计量AI 解读
Consider a random sample in the max-domain of attraction of a multivariate extreme value distribution such that the dependence structure of the attractor belongs to a parametric model. A new estimator for the unknown parameter is defined as the value that minimizes the distance between a vector of weighted integrals of the tail dependence function and their empirical counterparts. The minimization problem has, with probability tending to one, a unique, global solution. The…
Let $\widetilde{X}_{M\times N}$ be a rectangular data matrix with independent real-valued entries $[\widetilde{x}_{ij}]$ satisfying $\mathbb{E} \widetilde{x}_{ij}=0$ and $\mathbb{E} \widetilde{x}^{2}_{ij}=\frac{1}{M}$, $N,M\to\infty$. These entries have a subexponential decay at the tails. We will be working in the regime $N/M=d_{N}$, $\lim_{N\to\infty}d_{N}\neq0,1,\infty$. In this paper we prove the edge universality of correlation matrices ${X}^{\dagger}X$, where the…
Traditionally, assessing the accuracy of inference based on regression quantiles has relied on the Bahadur representation. This provides an error of order $n^{-1/4}$ in normal approximations, and suggests that inference based on regression quantiles may not be as reliable as that based on other (smoother) approaches, whose errors are generally of order $n^{-1/2}$ (or better in special symmetric cases). Fortunately, extensive simulations and empirical applications show that…
A linear structural equation model relates random variables of interest and corresponding Gaussian noise terms via a linear equation system. Each such model can be represented by a mixed graph in which directed edges encode the linear equations and bidirected edges indicate possible correlations among noise terms. We study parameter identifiability in these models, that is, we ask for conditions that ensure that the edge coefficients and correlations appearing in a linear…
There is a surge in medical follow-up studies that include longitudinal covariates in the modeling of survival data. So far, the focus has been largely on right censored survival data. We consider survival data that are subject to both left truncation and right censoring. Left truncation is well known to produce biased sample. The sampling bias issue has been resolved in the literature for the case which involves baseline or time-varying covariates that are observable. The…
This paper studies the identification of the Lévy jump measure of a discretely-sampled semimartingale. We define successive Blumenthal–Getoor indices of jump activity, and show that the leading index can always be identified, but that higher order indices are only identifiable if they are sufficiently close to the previous one, even if the path is fully observed. This result establishes a clear boundary on which aspects of the jump measure can be identified on the basis of…
The analysis of the joint cumulative distribution function (CDF) with bivariate event time data is a challenging problem both theoretically and numerically. This paper develops a tensor spline-based sieve maximum likelihood estimation method to estimate the joint CDF with bivariate current status data. The $I$-splines are used to approximate the joint CDF in order to simplify the numerical computation of a constrained maximum likelihood estimation problem. The generalized…
Cécile Durot · Vladimir N. Kulikov · Hendrik P. Lopuhaä·刊期 2012-06-01 · 卷 40(3)·The Annals of Statistics已编入正刊
Grenander型估计量上确界范数误差的极限分布AI 解读
Let $f$ be a nonincreasing function defined on $[0,1]$. Under standard regularity conditions, we derive the asymptotic distribution of the supremum norm of the difference between $f$ and its Grenander-type estimator on sub-intervals of $[0,1]$. The rate of convergence is found to be of order $(n/\log n)^{-1/3}$ and the limiting distribution to be Gumbel.
M. J. Bayarri · J. O. Berger · A. Forte · G. García-Donato·刊期 2012-06-01 · 卷 40(3)·The Annals of Statistics已编入正刊
In objective Bayesian model selection, no single criterion has emerged as dominant in defining objective prior distributions. Indeed, many criteria have been separately proposed and utilized to propose differing prior choices. We first formalize the most general and compelling of the various criteria that have been suggested, together with a new criterion. We then illustrate the potential of these criteria in determining objective model selection priors by considering their…
Yuri I. Ingster · Theofanis Sapatinas · Irina A. Suslina·刊期 2012-06-01 · 卷 40(3)·The Annals of Statistics已编入正刊
病态逆问题中的极小极大信号检测AI 解读
Ill-posed inverse problems arise in various scientific fields. We consider the signal detection problem for mildly, severely and extremely ill-posed inverse problems with $l^{q}$-ellipsoids (bodies), $q\in(0,2]$, for Sobolev, analytic and generalized analytic classes of functions under the Gaussian white noise model. We study both rate and sharp asymptotics for the error probabilities in the minimax setup. By construction, the derived tests are, often, nonadaptive. Minimax…
Deviation optimal learning using greedy Q-aggregation
Independence screening is a variable selection method that uses a ranking criterion to select significant variables, particularly for statistical models with nonpolynomial dimensionality or “large p, small n” paradigms when p can be as large as an exponential of the sample size n. In this paper we propose a robust rank correlation screening (RRCS) method to deal with ultra-high dimensional data. The new procedure is based on the Kendall τ correlation coefficient…
Let XM×N be a rectangular data matrix with independent real-valued entries [xij] satisfying Exij=0 and Exij2=M1, N,M→∞. These entries have a subexponential decay at the tails. We will be working in the regime N/M=dN, limN→∞dN=0,1,∞. In this paper we prove the edge universality of correlation matrices X†X, where the…
Nearly root-n approximation for regression quantile processes
Traditionally, assessing the accuracy of inference based on regression quantiles has relied on the Bahadur representation. This provides an error of order n−1/4 in normal approximations, and suggests that inference based on regression quantiles may not be as reliable as that based on other (smoother) approaches, whose errors are generally of order n−1/2 (or better in special symmetric cases). Fortunately, extensive simulations and empirical applications show that…
The analysis of the joint cumulative distribution function (CDF) with bivariate event time data is a challenging problem both theoretically and numerically. This paper develops a tensor spline-based sieve maximum likelihood estimation method to estimate the joint CDF with bivariate current status data. The I-splines are used to approximate the joint CDF in order to simplify the numerical computation of a constrained maximum likelihood estimation problem. The generalized…
The limit distribution of the L∞-error of Grenander-type estimators
Let f be a nonincreasing function defined on [0,1]. Under standard regularity conditions, we derive the asymptotic distribution of the supremum norm of the difference between f and its Grenander-type estimator on sub-intervals of [0,1]. The rate of convergence is found to be of order (n/logn)−1/3 and the limiting distribution to be Gumbel.
Ill-posed inverse problems arise in various scientific fields. We consider the signal detection problem for mildly, severely and extremely ill-posed inverse problems with lq-ellipsoids (bodies), q∈(0,2], for Sobolev, analytic and generalized analytic classes of functions under the Gaussian white noise model. We study both rate and sharp asymptotics for the error probabilities in the minimax setup. By construction, the derived tests are, often, nonadaptive. Minimax…