论文检索

通过汤普森采样实现探索驱动的迭代稀疏半定规划聚类AI 解读

High-dimensional sparse clustering is a challenging combinatorial problem due to the tight coupling between cluster assignment and variable selection. We demonstrate that semidefinite programming (SDP) relaxation of K-means is robust to variable over-selection by establishing minimax separation bounds. Leveraging this robustness, we offer a twist on the recent trend of using exogenous randomness to evaluate feature importance and control false discovery by partially shifting…

隐私约束下的 Knockoff 推断AI 解读

Model-X knockoff framework offers a model-free variable selection method that ensures finite sample false discovery rate (FDR) control. However, the complexity of generating knockoff variables, coupled with the model-free assumption, presents significant challenges for protecting data privacy in this context. In this paper, we propose a comprehensive framework for knockoff inference within the differential privacy paradigm. Our proposed method guarantees robust privacy…

HSCI：高维比例风险模型下的 Neyman 正交因果推断AI 解读

Valid treatment effect inference in survival studies is fundamental yet challenging when the treatment assignments and outcomes are confounded by many baseline covariates. To this end, in this paper we propose a high-dimensional survival causal inference (HSCI) framework that delivers valid inference under a sparse high-dimensional Cox proportional hazards outcome model and a high-dimensional logistic propensity score working model. To mitigate the nuisance estimation bias,…

SLOACI：利用替代结局的在线自适应因果推断AI 解读

Adaptive experimental designs have gained increasing attention across a range of domains. In this paper, we propose a new methodological framework, surrogate-leveraged online adaptive causal inference (SLOACI), which integrates predictive surrogate outcomes into adaptive designs to enhance efficiency. For downstream analysis, we construct the adaptive augmented inverse probability weighting estimator for the average treatment effect using collected data. Our procedure…

利用在线文本时间序列进行大语言模型驱动的 CPI 预测推断AI 解读

Forecasting the Consumer Price Index (CPI) is an important yet challenging task in economics, where most existing approaches rely on low-frequency, survey-based data. With the recent advances of large language models (LLMs), there is growing potential to leverage high-frequency online text data for improved CPI prediction, an area still largely unexplored. This paper proposes LLM-CPI, an LLM-based approach for CPI prediction inference incorporating online text time series.…

广义拉普拉斯矩阵潜在嵌入的特征向量渐近理论AI 解读

Laplacian matrices are commonly employed in many real applications, encoding the underlying latent structural information such as graphs and manifolds. The use of the normalization terms naturally gives rise to random matrices with dependency. It is well-known that dependency is a major bottleneck of new random matrix theory (RMT) developments. To this end, in this paper, we formally introduce a class of generalized (and regularized) Laplacian matrices, which contains the…

时间序列数据的高维 Knockoffs 推断AI 解读

We make some initial attempt to establish the theoretical and methodological foundation for the model-X knockoffs inference for time series data. We suggest the method of time series knockoffs inference (TSKI) by exploiting the ideas of subsampling and e-values to address the difficulty caused by the serial dependence. We also generalize the robust knockoffs inference in Barber, Candès, and Samworth to the time series setting to relax the assumption of known covariate…

HNCI：高维网络因果推断AI 解读

The problem of evaluating the effectiveness of a treatment or policy commonly appears in causal inference applications under network interference. In this paper, we suggest the new method of high-dimensional network causal inference (HNCI) that provides both valid confidence interval on the average direct treatment effect on the treated (ADET) and valid confidence set for the neighborhood size for interference effect. We exploit the model setting in Belloni et al. (2022) and…

因果森林对流形数据结构的自适应AI 解读

Researchers often hold the belief that random forests are "the cure to the world's ills" (Bickel, 2010). But how exactly do they achieve this? Focused on the recently introduced causal forests (Athey and Imbens, 2016; Wager and Athey, 2018), this manuscript aims to contribute to an ongoing research trend towards answering this question, proving that causal forests can adapt to the unknown covariate manifold structure. In particular, our analysis shows that a causal forest…

SIMPLE-RC：非尖锐原假设与弱信号下的群组网络推断AI 解读

Large-scale network inference with uncertainty quantification has important applications in natural, social, and medical sciences. The recent work of Fan, Fan, Han and Lv (2022) introduced a general framework of statistical inference on membership profiles in large networks (SIMPLE) for testing the sharp null hypothesis that a pair of given nodes share the same membership profiles. In real applications, there are often groups of nodes under investigation that may share…

利用深度神经网络进行不依赖维数的平均处理效应推断AI 解读

This paper investigates the estimation and inference of the average treatment effect (ATE) using deep neural networks (DNNs) in the potential outcomes framework. Under some regularity conditions, the observed response can be formulated as the response of a mean regression problem with both the confounding variables and the treatment indicator as the independent variables. Using such formulation, we investigate two methods for ATE estimation and inference based on the…

SIMPLE：大型网络中成员归属特征的统计推断AI 解读

Network data is prevalent in many contemporary big data applications in which a common interest is to unveil important latent links between different pairs of nodes. Yet a simple fundamental question of how to precisely quantify the statistical uncertainty associated with the identification of latent links still remains largely unexplored. In this paper, we propose the method of statistical inference on membership profiles in large networks (SIMPLE) in the setting of…

发散尖峰随机矩阵特征向量的渐近理论AI 解读

Characterizing the asymptotic distributions of eigenvectors for large random matrices poses important challenges yet can provide useful insights into a range of statistical applications. To this end, in this paper we introduce a general framework of asymptotic theory of eigenvectors (ATE) for large spiked random matrices with diverging spikes and heterogeneous variances, and establish the asymptotic properties of the spiked eigenvectors and eigenvalues for the scenario of…

自适应稳健变量选择AI 解读

Heavy-tailed high-dimensional data are commonly encountered in various scientific fields and pose great challenges to modern statistical analysis. A natural procedure to address this problem is to use penalized quantile regression with weighted $L_1$-penalty, called weighted robust Lasso (WR-Lasso), in which weights are introduced to ameliorate the bias problem induced by the $L_1$-penalty. In the ultra-high dimensional setting, where the dimensionality can grow…

高度相关及非高度相关协变量下的加性模型估计AI 解读

Motivated by normalizing DNA microarray data and by predicting the interest rates, we explore nonparametric estimation of additive models with highly correlated covariates. We introduce two novel approaches for estimating the additive components, integration estimation and pooled backfitting estimation. The former is designed for highly correlated covariates, and the latter is useful for nonhighly correlated covariates. Asymptotic normalities of the proposed estimators are…

基于特征筛减独立规则的高维分类AI 解读

Classification using high-dimensional features arises frequently in many contemporary statistical studies such as tumor classification using microarray or other high-throughput data. The impact of dimensionality on classifications is poorly understood. In a seminal paper, Bickel and Levina [Bernoulli 10 (2004) 989--1010] show that the Fisher discriminant performs poorly due to diverging spectra and they propose to use the independence rule to overcome the problem. We first…

利用因子模型估计高维协方差矩阵AI 解读

High dimensionality comparable to sample size is common in many statistical problems. We examine covariance matrix estimation in the asymptotic framework that the dimensionality $p$ tends to $\infty$ as the sample size $n$ increases. Motivated by the Arbitrage Pricing Theory in finance, a multi-factor model is employed to reduce dimensionality and to estimate the covariance matrix. The factors are observable and the number of factors $K$ is allowed to grow with $p$. We…

波动率矩阵非参数估计量的聚合AI 解读

An aggregated method of nonparametric estimators based on time-domain and state-domain estimators is proposed and studied. To attenuate the curse of dimensionality, we propose a factor modeling strategy. We first investigate the asymptotic behavior of nonparametric estimators of the volatility matrix in the time domain and in the state domain. Asymptotic normality is separately established for nonparametric estimators in the time domain and state domain. These two estimators…

时间域与状态域方法的动态整合波动率估计AI 解读

Time- and state-domain methods are two common approaches for nonparametric prediction. The former predominantly uses the data in the recent history while the latter mainly relies on historical information. The question of combining these two pieces of valuable information is an interesting challenge in statistics. We surmount this problem via dynamically integrating information from both the time and the state domains. The estimators from both domains are optimally combined…