论文检索

transnormal 模型下的多任务分位数回归AI 解读

We consider estimating multitask quantile regression under the transnormal model, with focus on high-dimensional setting. We derive a surprisingly simple closed-form solution through rank-based covariance regularization. In particular, we propose the rank-based ℓ1 penalization with positive-definite constraints for estimating sparse covariance matrices, and the rank-based banded Cholesky decomposition regularization for estimating banded precision matrices. By taking…

图式记录链接与去重的贝叶斯方法AI 解读

We propose an unsupervised approach for linking records across arbitrarily many files, while simultaneously detecting duplicate records within files. Our key innovation involves the representation of the pattern of links between records as a bipartite graph, in which records are directly linked to latent true individuals, and only indirectly linked to other records. This flexible representation of the linkage structure naturally allows us to estimate the attributes of the…

通过自动稀疏旋转实现快速贝叶斯因子分析AI 解读

Rotational post hoc transformations have traditionally played a key role in enhancing the interpretability of factor analysis. Regularization methods also serve to achieve this goal by prioritizing sparse loading matrices. In this work, we bridge these two paradigms with a unifying Bayesian framework. Our approach deploys intermediate factor rotations throughout the learning process, greatly enhancing the effectiveness of sparsity inducing priors. These automatic rotations…

An ongoing challenge in the analysis of document collections is how to summarize content in terms of a set of inferred themes that can be interpreted substantively in terms of topics. The current practice of parameterizing the themes in terms of most frequent words limits interpretability by ignoring the differential use of words across topics. Here, we show that words that are both frequent and exclusive to a theme are more effective at characterizing topical content, and…

Peter Hall 在高维数据与分类研究中的工作AI 解读

In this article, I summarise Peter Hall’s contributions to high-dimensional data, including their geometric representations and variable selection methods based on ranking. I also discuss his work on classification problems, concluding with some personal reflections on my own interactions with him. This article complements [Ann. Statist. 44 (2016) 1821–1836; Ann. Statist. 44 (2016) 1837–1853; Ann. Statist. 44 (2016) 1854–1866 and Ann. Statist. 44 (2016) 1867–1887], which…

随机块模型社区检测的极小极大速率AI 解读

Recently, network analysis has gained more and more attention in statistics, as well as in computer science, probability and applied mathematics. Community detection for the stochastic block model (SBM) is probably the most studied topic in network analysis. Many methodologies have been proposed. Some beautiful and significant phase transition results are obtained in various settings. In this paper, we provide a general minimax theory for community detection. It gives…

全基因组关联研究中高维误设混合模型的分析AI 解读

We study behavior of the restricted maximum likelihood (REML) estimator under a misspecified linear mixed model (LMM) that has received much attention in recent genome-wide association studies. The asymptotic analysis establishes consistency of the REML estimator of the variance of the errors in the LMM, and convergence in probability of the REML estimator of the variance of the random effects in the LMM to a certain limit, which is equal to the true variance of the random…

超大规模高斯图模型中的创新型可扩展高效估计AI 解读

Large-scale precision matrix estimation is of fundamental importance yet challenging in many contemporary applications for recovering Gaussian graphical models. In this paper, we suggest a new approach of innovated scalable efficient estimation (ISEE) for estimating large precision matrix. Motivated by the innovated transformation, we convert the original problem into that of large covariance matrix estimation. The suggested method combines the strengths of recent advances…

用于大型精度矩阵估计的偏相关筛选及其分类应用AI 解读

Given $n$ samples $X_{1},X_{2},\ldots,X_{n}$ from $N(0,\Sigma)$, we are interested in estimating the $p\times p$ precision matrix $\Omega=\Sigma^{-1}$; we assume $\Omega$ is sparse in that each row has relatively few nonzeros. We propose Partial Correlation Screening (PCS) as a new row-by-row approach. To estimate the $i$th row of $\Omega$, $1\leq i\leq p$, PCS uses a Screen step and a Clean step. In the Screen step, PCS recruits a (small) subset of indices using a…

学生化两样本 U 统计量的 Cramér 型中等偏差及应用AI 解读

Two-sample $U$-statistics are widely used in a broad range of applications, including those in the fields of biostatistics and econometrics. In this paper, we establish sharp Cramér-type moderate deviation theorems for Studentized two-sample $U$-statistics in a general framework, including the two-sample $t$-statistic and Studentized Mann–Whitney test statistic as prototypical examples. In particular, a refined moderate deviation theorem with second-order accuracy is…

稀疏主成分估计中的统计与计算权衡AI 解读

In recent years, sparse principal component analysis has emerged as an extremely popular dimension reduction technique for high-dimensional data. The theoretical challenge, in the simplest case, is to estimate the leading eigenvector of a population covariance matrix under the assumption that this eigenvector is sparse. An impressive range of estimators have been proposed; some of these are fast to compute, while others are known to achieve the minimax optimal rate over…

数字实验中异质性处理效应的非参数贝叶斯分析AI 解读

Randomized controlled trials play an important role in how Internet companies predict the impact of policy decisions and product changes. In these “digital experiments,” different units (people, devices, products) respond differently to the treatment. This article presents a fast and scalable Bayesian nonparametric analysis of such heterogenous treatment effects and their measurement in relation to observable covariates. New results and algorithms are provided for…

含大量控制变量的广义线性模型选择后推断AI 解读

This article considers generalized linear models in the presence of many controls. We lay out a general methodology to estimate an effect of interest based on the construction of an instrument that immunizes against model selection mistakes and apply it to the case of logistic binary choice model. More specifically we propose new methods for estimating and constructing confidence regions for a regression parameter of primary interest α0, a parameter in front of the regressor…

分析大规模依赖数据的若干方法AI 解读

We consider an approach to analyze big data of time series. Big dependent data are first transformed into functional time series of densities via nonparametric density estimation. We then discuss some tools for exploratory data analysis of the resulting functional time series. The tools employed include K-means cluster analysis and tree-based classification. For modeling, we propose a threshold approximate-factor model and a Hellinger distance autoregressive model for…

高维面板模型中的推断：枪支管制应用AI 解读

We consider estimation and inference in panel data models with additive unobserved individual specific heterogeneity in a high-dimensional setting. The setting allows the number of time-varying regressors to be larger than the sample size. To make informative estimation and inference feasible, we require that the overall contribution of the time-varying variables after eliminating the individual specific heterogeneity can be captured by a relatively small number of the…

超大规模协方差矩阵的复合已实现核估计及投资组合选择应用AI 解读

We propose a composite realized kernel to estimate the ex-post covariation of asset prices. These measures can in turn be used to forecast the covariation of future asset returns. Composite realized kernels are a data-efficient method, where the covariance estimate is composed of univariate realized kernels to estimate variances and bivariate realized kernels to estimate correlations. We analyze the merits of our composite realized kernels in an ultra high-dimensional…

高维协方差矩阵超对角线结构的检验AI 解读

The covariance matrices are essential quantities in econometric and statistical applications including portfolio allocation, asset pricing and factor analysis. Testing the entire covariance under high dimensionality endures large variability and causes a dilution of the signal-to-noise ratio and hence a reduction in the power. We consider a more powerful test procedure that focuses on testing along the super-diagonals of the high dimensional covariance matrix, which can…

存在结构不稳定性的高维因子模型收缩估计AI 解读

In large-scale panel data models with latent factors the number of factors and their loadings may change over time. Treating the break date as unknown, this article proposes an adaptive group-LASSO estimator that consistently determines the numbers of pre- and post-break factors and the stability of factor loadings if the number of factors is constant. We develop a cross-validation procedure to fine-tune the data-dependent LASSO penalties and show that after the number of…

通过正则化拉普拉斯反演估计波动率占用时间AI 解读

We propose a consistent functional estimator for the occupation time of the spot variance of an asset price observed at discrete times on a finite interval with the mesh of the observation grid shrinking to zero. The asset price is modeled nonparametrically as a continuous-time Itô semimartingale with nonvanishing diffusion coefficient. The estimation procedure contains two steps. In the first step we estimate the Laplace transform of the volatility occupation time and, in…

通过正则化核估计实现距离收缩与欧氏嵌入AI 解读

Summary Although recovering a Euclidean distance matrix from noisy observations is a common problem in practice, how well this could be done remains largely unknown. To fill in this void, we study a simple distance matrix estimate based on the so-called regularized kernel estimate. We show that such an estimate can be characterized as simply applying a constant amount of shrinkage to all observed pairwise distances. This fact allows us to establish risk bounds for the…

混合表示、包络表示与层级对偶AI 解读

Summary We develop a connection between mixture and envelope representations of objective functions that arise frequently in statistics. We refer to this connection by using the term ‘hierarchical duality’. Our results suggest an interesting and previously underexploited relationship between marginalization and profiling, or equivalently between the Fenchel–Moreau theorem for convex functions and the Bernstein–Widder theorem for Laplace transforms. We give several different…

可逆序列记忆长度的贝叶斯正则化AI 解读

Summary Variable order Markov chains have been used to model discrete sequential data in a variety of fields. A host of methods exist to estimate the history-dependent lengths of memory which characterize these models and to predict new sequences. In several applications, the data-generating mechanism is known to be reversible, but combining this information with the procedures mentioned is far from trivial. We introduce a Bayesian analysis for reversible dynamics, which…

高维均值的自适应双样本检验AI 解读

Several two-sample tests for high-dimensional data have been proposed recently, but they are powerful only against certain limited alternative hypotheses. In practice, since the true alternative hypothesis is unknown, it is unclear how to choose a powerful test. We propose an adaptive test that maintains high power across a wide range of situations, and study its asymptotic properties. Its finite sample performance is compared with existing tests. We apply it and other tests…

稀疏包络模型：多元线性回归的高效估计与响应变量选择AI 解读

The envelope model allows efficient estimation in multivariate linear regression. In this paper, we propose the sparse envelope model, which is motivated by applications where some response variables are invariant with respect to changes of the predictors and have zero regression coefficients. The envelope estimator is consistent but not sparse, and in many situations it is important to identify the response variables for which the regression coefficients are zero. The…