论文检索

多元分类响应回归的条件概率张量分解AI 解读

In many modern regression applications, the response consists of multiple categorical random variables whose probability mass is a function of a common set of predictors. In this article, we propose a new method for modeling such a probability mass function in settings where the number of response variables, the number of categories per response, and the dimension of the predictor are large. Our method relies on a functional probability tensor decomposition: a decomposition…

通过联合正则化深度神经网络估计单细胞异质基因网络AI 解读

Estimation of intracellular gene networks has been a critical component of single-cell transcriptomic data analysis, which can provide crucial insights into the complex interplay between genes, facilitating the discovery of the biological basis of human life at single-cell resolution. Despite notable achievements, existing methodologies often falter in their practicality, primarily due to their narrow focus on simplistic linear relationships and inadequate handling of…

因子增广矩阵回归AI 解读

We introduce Factor-Augmented Matrix Regression (FAMAR) to address the growing applications of matrix-variate data and their associated challenges, particularly with high-dimensionality and covariate correlations. FAMAR encompasses two key algorithms. The first is a novel non-iterative approach that efficiently estimates the factors and loadings of the matrix factor model, using techniques of pre-training, diverse projection, and block-wise averaging. The second algorithm…

用于线性与非线性充分降维的带瓶颈层集成神经网络AI 解读

We introduce a unified, flexible, and easy-to-implement framework of sufficient dimension reduction that can accommodate both linear and nonlinear dimension reduction, and both the conditional distribution and the conditional mean as the targets of estimation. This unified framework is achieved by a specially structured neural network—the Belted and Ensembled Neural Network (BENN)—that consists of a narrow latent layer, which we call the belt, and a family of transformations…

高维条件因子模型估计的统一框架AI 解读

This article presents a general framework for estimating high-dimensional conditional latent factor models via constrained nuclear norm regularization. We establish large sample properties of the estimators and provide efficient algorithms for their computation. To improve practical applicability, we propose a cross-validation procedure for selecting the regularization parameter. Our framework unifies the estimation of various conditional factor models, enabling the…

多重矩等式检验的功效增强：超越二范数与无穷范数AI 解读

Tests based on the 2- and ∞-norm have received considerable attention in high-dimensional testing problems, as they are powerful against dense and sparse alternatives, respectively. The power enhancement principle of Fan et al. (2015) combines these two norms to construct improved tests that are powerful against both types of alternatives. In the context of testing whether a candidate parameter satisfies a large number of moment equalities, we construct tests that harness…

基于条件尖峰—厚尾先验的协变量细化稳健部分信息迁移AI 解读

The popularity of transfer learning stems from the fact that it can borrow information from useful auxiliary datasets. Existing statistical transfer learning methods usually adopt a global similarity measure between the source data and the target data, which may lead to inefficiency when only partial information is shared. In this paper, we propose a novel Bayesian transfer learning method named “CONCERT” to allow robust partial information transfer for high-dimensional data…

Riesz 表示元的对抗估计AI 解读

Many causal parameters are linear functionals of an underlying regression. The Riesz representer is a key component in the asymptotic variance of a semiparametrically estimated linear functional. We propose an adversarial framework to estimate the Riesz representer using general function spaces. We prove a nonasymptotic mean square rate in terms of an abstract quantity called the critical radius, then specialize it for neural networks, random forests, and reproducing kernel…

因子调整的模型平均AI 解读

We propose a model averaging method for high-dimensional regression with highly correlated covariates. We use a factor structure to model the covariate dependence, allowing the covariates to be decomposed into two uncorrelated or weakly correlated latent components: common factors and idiosyncratic components. The number of common factors is allowed to diverge. We average estimators from factor-adjusted candidate models with augmented predictors composed of estimated common…

因子数量的频带估计AI 解读

We introduce consistent estimators for the number of shocks driving large-dimensional dynamic factor models. Our estimator can be applied to single frequencies and specific frequency bands, making it suitable for disentangling shocks affecting dynamic models with a factor model representation. Noticeably, our estimator requires the time-series and cross-section size to diverge simultaneously without any constraint, and it is free of nuisance parameters, such as penalization…

SPARCC：右删失协变量模型中的半参数稳健估计AI 解读

In Huntington disease research, a current goal is to understand how symptoms change prior to a clinical diagnosis. Statistically, achieving this goal entails modeling symptom severity as a function of the covariate 'time of diagnosis,' which is often heavily right-censored in observational studies. Existing estimators that handle right-censored covariates, such as the complete case estimator and maximum likelihood estimator, vary in their statistical efficiency and…

高维广义线性混合模型的共轭梯度方法AI 解读

Generalized linear mixed models (GLMMs) are a widely used tool in statistical analysis. The main bottleneck of many computational approaches lies in the inversion of the high dimensional precision matrices associated with the random effects. Such matrices are typically sparse; however, the sparsity pattern resembles a multi partite random graph, which does not lend itself well to default sparse linear algebra techniques. Notably, we show that, for typical GLMMs, the Cholesky…

基于多样化投影的含潜在因子高维空间自回归AI 解读

We study one particular type of multivariate spatial autoregression (MSAR) model with diverging dimensions in both responses and covariates. This makes the usual MSAR models no longer applicable due to the high computational cost. To address this issue, we propose a factor-augmented spatial autoregression (FSAR) model. FSAR is a special case of MSAR but with a novel factor structure imposed on the high-dimensional random error vector. The latent factors of FSAR are assumed…

差分隐私切片逆回归：极小极大最优性与算法AI 解读

Privacy preservation has become a critical concern in high-dimensional data analysis due to the growing prevalence of data-driven applications. Since its proposal, sliced inverse regression has emerged as a widely used statistical technique to reduce the dimensionality of covariates while maintaining sufficient statistical information. In this paper, we propose optimally differentially private algorithms specifically designed to address privacy concerns in the context of…

短面板数据分析中的同质性识别新方法AI 解读

In panel data analysis, individual attributes are of importance in many real applications. With the advancement of data collection, it is often possible to acquire enough information for individual attributes in a collected panel dataset, and data from other individuals may contain the information for the attributes of the individual under concern. Homogeneity pursuit is an important topic in panel data analysis when individual attributes are of interest. Existing approaches…

基于卷积平滑支持向量机的去中心化网络高效分布式学习AI 解读

This article concerns efficiently classifying high-dimensional data over decentralized networks. Penalized support vector machines (SVMs) are widely used for high-dimensional classification tasks. However, the double nonsmoothness of the objective function poses significant challenges in developing efficient decentralized learning methods. Existing approaches frequently suffer from slow, sublinear convergence rates. To address this issue, we consider a convolution-based…

复杂时间动态下单调且平滑时变函数的同时推断AI 解读

We propose a new framework for the simultaneous inference of monotone and smoothly time-varying functions under complex temporal dynamics. This will be done utilizing the monotone rearrangement and the nonparametric estimation. We capitalize the Gaussian approximation for the nonparametric monotone estimator and construct the asymptotically correct simultaneous confidence bands (SCBs) using designed bootstrap methods. We investigate two general and practical scenarios. The…

预印本版本摘要 · 查看来源

大规模低秩回归模型下的迁移学习AI 解读

In high-dimensional multiple response regression problems, the large dimensionality of the coefficient matrix poses a challenge to parameter estimation. To address this challenge, low-rank matrix estimation methods have been developed to facilitate parameter estimation in the high-dimensional regime, where the number of parameters increases with sample size. Despite these methodological advances, accurately predicting multiple responses with limited target data remains a…

网络辅助的高维因子模型估计AI 解读

This article takes advantage of group-level heterogeneity and network cohesion phenomenon to improve the estimation accuracy of approximate factor models. As large heterogeneous panels become available, a grouped pattern of unobserved heterogeneity in the panel data is highlighted. Clustering of factor loadings provides a solution to model group-level heterogeneity. Moreover, networks are frequently observed in economics and finance, which capture the interconnectivity…

高维时间序列预测回归中有效协整秩的确定AI 解读

This article proposes a new approach to identifying the effective cointegration rank in high-dimensional unit-root (HDUR) time series from a prediction perspective using reduced-rank regression. For a HDUR process xt∈RN and a stationary series yt∈Rp of interest, our goal is to predict future values of yt using xt and lagged values of yt. The proposed framework consists of a two-step estimation procedure. First, the Principal Component Analysis is used to identify all…

随机权重矩阵与解释变量下空间自回归模型的拟得分匹配估计AI 解读

With the rapid advancements in technology for data collection, the application of the spatial autoregressive (SAR) model has become increasingly prevalent in real-world analysis, particularly when dealing with large datasets. However, the commonly used quasi-maximum likelihood estimation (QMLE) for the SAR model is not computationally scalable to handle the data with a large size. In addition, when establishing the asymptotic properties of the parameter estimators of the SAR…

包络矩阵自回归模型AI 解读

Matrix-valued data is commonly collected over time in many scientific fields. However, existing methods for handling such data are limited and often suffer from overparametrization. In response, Chen et al. (2021) introduced the matrix autoregressive (MAR) model as an alternative to traditional time series analysis, which relies on vectorization and vector autoregression frameworks. By preserving the original structure of matrices, the MAR model avoids the loss of valuable…

基于奇异值分解与小波阈值的混频时间序列季节调整AI 解读

In this article, we propose a novel seasonal adjustment method that accommodates time series observed at mixed frequencies and possessing possibly multiple abrupt changes in seasonality. We assume that the observed series is a known linear transformation of an underlying high frequency series whose seasonal component can be represented as a matrix with a low rank Singular Value Decomposition (SVD) structure, and the nonseasonal component is difference stationary. The right…

GARCH-MIDAS 模型的自适应组 LASSOAI 解读

This article investigates the variable selection problem in the generalized autoregressive conditional heteroscedasticity-mixed-data sampling (GARCH-MIDAS) model of Engle, Ghysels, and Sohn (Citation2013), and establishes the corresponding theoretical properties along with a feasible computational algorithm. The proposed method is based on a penalized log-partial likelihood with an adaptively group-weighted L2 penalty on the long-term component coefficients. The variable…