论文检索

高维预测回归中的 LASSO 推断AI 解读

LASSO inflicts shrinkage bias on estimated coefficients, which undermines asymptotic normality and invalidates standard inferential procedures based on the t -statistic. Given cross sectional data, the desparsified LASSO has emerged as a well-known remedy for correcting the shrinkage bias. In the context of high dimensional predictive regression, the desparsified LASSO faces an additional challenge: the Stambaugh bias arising from nonstationary regressors modeled as local…

是否应利用辅助网络信息改进大型协方差矩阵估计？AI 解读

This paper uses the auxiliary network information, observed in addition to the original sample, to infer latent network structures in the population correlation matrix and thus improve high-dimensional covariance matrix estimation. Building on estimated Location Indicator and Relative Importance matrices, we propose two Network-Guided estimators. Network-Guided Thresholding uses auxiliary network data to regularize the large and small elements in the sample covariance…

排序惩罚估计量：相关性稳健收缩方法的推断AI 解读

Variable correlations pose significant challenges for various LASSO-type shrinkage methods in big-data modeling. This paper presents a comprehensive framework for a correlation-robust shrinkage estimator, enhancing both the theoretical and practical aspects of high-dimensional estimation. We break down the penalty term into a “shrinkage” term and a “grouping” term, illustrating its distinctive properties in clustering highly correlated variables. We establish the…

利用充分维度关联进行高维统计推断与变量选择AI 解读

Simultaneous variable selection and statistical inference is challenging in high-dimensional data analysis. Most existing post-selection inference methods require explicitly specified regression models, which are often linear, as well as sparsity in the regression model. The performance of such procedures can be poor under either misspecified nonlinear models or a violation of the sparsity assumption. In this article, we propose a sufficient dimension association (SDA)…

高维空间极值的空间尺度感知尾部依赖建模AI 解读

Extreme events over large spatial domains may exhibit highly heterogeneous tail dependence characteristics, yet most existing spatial extremes models yield only one dependence class over the entire spatial domain. To accurately characterize dependence in extreme events, we propose a mixture model that achieves flexible dependence properties and allows high-dimensional inference (∼600 spatial locations in our data example) for extremes of spatial processes. We modify the…

因果 K 均值聚类AI 解读

Abstract Causal effects are often characterized at the population level, which can mask important heterogeneity across latent subgroups. Since the subgroup structure is unknown, identifying and evaluating subgroup specific effects is substantially more challenging than standard population level analysis. We address this problem by proposing Causal k-Means Clustering, a framework that uses k-means clustering ideas to recover unknown subgroup structure from individual level…

深度学习中分支与嵌套超参数的贝叶斯优化AI 解读

Hyperparameter optimization plays a crucial role in the success of neural networks as hyperparameters directly control the behavior and performance of the training algorithms. To obtain efficient tuning, Bayesian optimization based on Gaussian process is widely used. Despite numerous applications in deep learning, the existing methods rely on a convenient but restrictive assumption that the tuning parameters are independent of each other. However, tuning parameters with…

多元混合数据的最大二项似然方法AI 解读

Multivariate mixture data analysis presents numerous challenges and constitutes a vital area of interest in the fields of statistics and data science. Research into multivariate mixture structures holds relevance across diverse application domains and plays a pivotal role in the advancement of artificial intelligence and machine learning. In this article, we focus on nonparametric estimation techniques for multivariate mixture data. Specifically, we assume a known number of…

通过近似消息传递实现高维 Newey–Powell 检验AI 解读

We propose a high-dimensional extension of the heteroscedasticity test proposed in Newey and Powell (1987). Our test is based on expectile regression in the proportional asymptotic regime where $n/p \to \delta \in (0,1]$ . The asymptotic analysis of the test statistic uses the approximate message passing algorithm, from which we obtain the limiting distribution of the test and establish its asymptotic power. The numerical performance of the test is validated through an…

高维主成分分析中显著成分数量的估计AI 解读

Abstract We consider the problem of estimating the number of significant components in high-dimensional principal component analysis. We propose a new penalized approach using the explained variance ratio and the rigidity of the nonspiked sample eigenvalues of sample covariance matrices of $ p $ variables. Compared with methods in the existing literature, the consistency of the proposed estimator holds, not only for independent data, but also for some times series data when…

广义点过程可加模型AI 解读

Abstract In this article, we propose a generalized point process additive model with a scalar response and high-dimensional point process predictors. Our proposal is built upon four key components: a realization of a point process as a random counting measure, a generalized point process regression framework, a new kernel function for random measure through kernel embedding, and a suite of low-dimensional structures including the additive model, reduced basis representation,…

流形假说的统计探索AI 解读

Abstract The manifold hypothesis is a widely accepted tenet of machine learning which asserts that nominally high-dimensional data are in fact concentrated near a low-dimensional manifold, embedded in high-dimensional space. This phenomenon is observed empirically in many real-world situations, has led to development of a wide range of statistical methods in the last few decades, and has been suggested as a key factor in the success of modern AI technologies. We show that…

Chang 与 Lei 对《流形假设的统计探索》的讨论AI 解读

We congratulate the authors on an insightful paper that spans both a general theory of manifold emergence, and methodology for exploring hidden manifold structure in high-dimensional data. In summary, assuming the result of Theorem 1 holds, the effectiveness of PCA in elucidating the geometry of the latent domain from high-dimensional data is closely related to the statistical properties of the random functions (Xj)1≤j≤p such as distinguishability and stationarity. To…

Simon 等对《流形假说的统计探索》的讨论AI 解读

We congratulate the authors on their impressive effort and commend their tour de force. Our comments follow below. Theoretical foundations. The authors contribution is driven by embedding the manifold hypothesis in a rigorous statistical framework. The Latent Manifold Model (LMM) plays a central role by integrating latent variables, random functions, and structured noise within a unified construction. Grounded in Mercer’s theorem, the approach links correlation kernels with…

Stehlík 与 Schlather 对《流形假设的统计探索》的评论AI 解读

We congratulate the authors of Whiteley et al. (2025) for opening up a challenging world of exploration of the manifold hypothesis. We fully agree that principal component analysis (PCA) is one the most important tool data analysis that the underlying spectral representation needs generalization. An alternative to a purely statistical modelling is to try to include as much knowledge as possible into the generalization. Schlather and Reinbott (2021) suggest an algebraic…

基于稀疏张量分解的高维时间序列谱变点估计AI 解读

Abstract Multivariate time series may be subject to partial structural changes over certain frequency band, for instance, in neuroscience. We study the change point detection problem with high-dimensional time series, within the framework of frequency domain. The overarching goal is to locate all change points and delineate which series are activated by the change, over which frequencies. In practice, the number of activated series per change and frequency could span from a…

电子健康记录依赖知识图谱的统计推断AI 解读

Abstract The effective analysis of high-dimensional Electronic Health Record (EHR) data, with substantial potential for healthcare research, presents notable methodological challenges. Employing predictive modeling guided by a knowledge graph (KG), which enables efficient feature selection, can enhance both statistical efficiency and interpretability. While various methods have emerged for constructing KGs, existing techniques often lack statistical certainty concerning the…

正则化广义协方差估计量AI 解读

Summary This paper proposes the Regularized Generalized Covariance (RGCov) estimator, a ridge-type extension of the Generalized Covariance (GCov) estimator for high-dimensional stationary time series. By regularizing the GCov objective function, which involves the inverse of the covariance matrix, RGCov improves numerical stability while preserving positive definiteness. Under suitable conditions, the new estimator is consistent, asymptotically normal, and…

通过精确融合与稀疏正则化对类别特征建模AI 解读

Abstract We study the high-dimensional linear regression problem with categorical predictors that have many levels. We propose a new estimation approach, which performs model compression via two mechanisms by simultaneously encouraging (a) clustering of the regression coefficients to collapse some of the categorical levels together; and (b) sparsity of the regression coefficients. We present novel mixed integer programming formulations for our estimator, and develop a custom…

基于深度分位数过程回归的分布性离策略评估AI 解读

This paper investigates the off-policy evaluation (OPE) problem from a distributional perspective. Rather than focusing solely on the expectation of the total return, as in most existing OPE methods, we aim to estimate the entire return distribution. To this end, we introduce a quantile-based approach for OPE using deep quantile process regression, presenting a novel algorithm called Deep Quantile Process regression-based Off-Policy Evaluation (DQPOPE). We provide new…

概念漂移下的学习：混杂、不变性与降维AI 解读

Practitioners often face the challenge of deploying prediction models in new environments with shifted distributions of covariates and responses. With observational data, such shifts are often driven by unobserved confounding, and can in fact alter the concept of which model is best. This paper studies distribution shifts in the domain adaptation problem with unobserved confounding. We postulate a linear structural causal model to account for endogeneity and unobserved…

深度 Cox 模型的小批量估计：统计基础与实践指导AI 解读

The stochastic gradient descent (SGD) algorithm has been widely used to optimize deep Cox neural network (Cox-NN) by updating model parameters using mini-batches of data. We show that SGD aims to optimize the average of mini-batch partial-likelihood, which is different from the standard partial-likelihood. This distinction requires developing new statistical properties for the global optimizer, namely, the mini-batch maximum partial-likelihood estimator (mb-MPLE). We…

《混合类型超高维相关变量的广义因子模型》更正AI 解读

Wei Liu1, Huazhen Lin2, Shurong Zheng3 and Jin Liu41School of Mathematics, Sichuan University, Chengdu, China2Center of Statistical Research and School of Statistics, Southwestern University of Fin...

观察性研究中用于因果推断的人工智能贝叶斯生成模型AI 解读

Causal inference in observational studies with high-dimensional covariates presents significant challenges. We introduce CausalBGM, an AI-powered Bayesian generative modeling approach that captures the causal relationship among covariates, treatment, and outcome. The core innovation is to estimate the individual treatment effect (ITE) by learning the individual-specific distribution of a low-dimensional latent feature set (e.g., latent confounders) that drives changes in…