论文检索

迁移学习中最小范数插值器的泛化误差AI 解读

This paper establishes the generalization error of pooled min-$\ell_2$-norm interpolation in transfer learning, where data from diverse distributions are available. Min-norm interpolators arise naturally as implicit regularized limits of modern machine learning algorithms. Prior work has characterized their out-of-distribution risk when samples from the test distribution are unavailable during training. In many applications, however, limited test samples may be available at…

广义潜在因子模型的可识别性与统计推断AI 解读

Generalized latent factor analysis not only provides a useful latent embedding approach in statistics and machine learning, but also serves as a widely used tool across various scientific fields, such as psychometrics, econometrics, and social sciences. Ensuring the identifiability of latent factors and the loading matrix is essential for the model's estimability and interpretability, and various identifiability conditions have been employed by practitioners. However,…

处理效应变号点研究工具包AI 解读

This paper provides a toolkit for the study of distributional treatment effects (DTEs) focused on treatment-effect discontinuities defined as points where marginal distributional effects change sign. Building on the Treatment Effects Curve (TEC, Verme, 2010), the paper makes three contributions. First, we propose a methodological framework comprising a Horizontal Discontinuity Analysis (HDA) comparing groups in regions of opposite-signed effects using causal forests, and a…

Napkin 因果图下的因果推断AI 解读

Unmeasured confounding can render identification strategies based on adjustment functionals invalid. We study the "Napkin" graph, a causal structure that encapsulates features of M-bias, instrumental variables, and classical back-door and front-door settings, yet identifies the average treatment effect through a nonstandard ratio of two g-formulas. We develop influence-function-based estimators for this functional, including doubly-robust one-step and targeted minimum…

从有偏样本中学习AI 解读

The empirical risk minimization approach to data-driven decision making requires access to training data drawn under the same conditions as those that will be faced when the decision rule is deployed. However, in a number of settings, we may be concerned that our training sample is biased in the sense that some groups (characterized by either observable or unobservable attributes) may be under- or over-represented relative to the general population; and in this setting…

模型无关的纵向变量重要性轨迹摘要推断及其自杀预防应用AI 解读

Risk of suicide attempt varies over time. Understanding the importance of risk factors measured at a mental health visit can help clinicians evaluate future risk and provide appropriate care during the visit. In prediction settings where data are collected over time, such as in mental health care, it is often of interest to understand both the importance of variables for predicting the response at each time point and the importance summarized over the time series. Building…

非平衡熵正则最优传输的样本复杂度AI 解读

Optimal transport (OT) has become a central language for comparing probability measures, but exact balanced OT is often both too rigid for data with missing, created, or destroyed mass and subject to unfavorable high-dimensional sample complexity. Entropic regularization and unbalanced relaxations address these limitations in complementary ways. Entropy smooths the geometry, improves statistical behavior, and enables fast Sinkhorn-type algorithms, while unbalanced marginal…

半敲诈：一种具有有限样本保证的模型无关条件独立性检验方法AI 解读

Conditional independence testing (CIT) is essential for reliable scientific discovery. It prevents spurious findings and enables controlled feature selection. Recent CIT methods have used machine learning (ML) models as surrogates of the underlying distribution. However, model-agnostic approaches require a train-test split, which reduces statistical power. We introduce Semi-knockoffs, a CIT method that can accommodate any pre-trained model, avoids this split, and provides…

异质环境下的不变量分位数回归AI 解读

In this paper, we propose an invariant quantile regression (IQR) framework specifically designed for multi-environment datasets, which captures the invariance across different environments. This framework is closely related to transfer learning, causal inference, and fair machine learning, and is motivated by scenarios in which the conditional probability of the response given covariates varies, while certain key variables remain invariant. This perspective differs notably…

EnsembleIV：从集成学习器构造工具变量以处理机器学习生成变量AI 解读

Despite increasing popularity in empirical studies, the integration of machine learning generated variables into regression models for statistical inference suffers from the measurement error problem, which can bias estimation and threaten the validity of inferences. In this paper, we develop a novel approach to alleviate associated estimation biases. Our proposed approach, EnsembleIV, creates valid and strong instrumental variables from weak learners in an ensemble model,…

通过低秩基函数搜寻实现保护隐私的元分析AI 解读

A central challenge of meta-analysis is that the populations underlying existing studies often differ from the target population in unknown ways. We study the problem of predicting function-valued quantities, such as regression and conditional average treatment effect functions, for a new target population using only study-level covariates and study-specific function estimates. We propose MetaHunt, a new meta-analysis methodology based on a shared low-rank structure, in…

用双重机器学习估计具有总体代表性的因果效应AI 解读

Double Machine Learning is widely used to estimate treatment effects from non-experimental data. The "residuals-on-residuals" regression (RORR) is especially popular for its simplicity and computational tractability. However, with heterogeneous treatment effects, the proper interpretation of RORR may not be well understood. We show that, for non-binary treatments with continuous dose-response functions, RORR estimates a conditional variance-weighted average of derivatives…

超越预测的良性过拟合：普通最小二乘插值估计量AI 解读

Recent advances in deep learning have highlighted the phenomenon of benign overfitting in overparameterized statistical models, sparking significant interest in understanding its foundations. Owing to its simplicity and practical relevance, the ordinary least squares (OLS) interpolator has become a key object of study for gaining theoretical insight into this phenomenon. While the properties of OLS are well understood in classical underparameterized settings, its behavior in…

存在隐藏反悔见证变量时的近端中介分析AI 解读

Mediation analysis is essential for decomposing the causal effect of a treatment into direct and indirect pathways. However, many practical settings rely on the stringent assumption that recanting witnesses, defined as treatment-induced mediator-outcome confounders, are either absent or fully known a priori. Such a requirement is often untenable, especially when these variables remain unobservable due to measurement difficulties or privacy constraints. In this paper, we…

TrIM：变换迭代蒙德里安森林用于梯度降维与高维回归AI 解读

We propose a computationally efficient algorithm for gradient-based linear dimension reduction and high-dimensional regression. The algorithm initially computes a Mondrian forest and uses this estimator to identify a relevant feature subspace of the inputs from an estimate of the expected gradient outer product (EGOP) of the regression function. In addition, we introduce an iterative approach known as Transformed Iterative Mondrian (TrIM) forest to improve the Mondrian…

用于金砖四国长记忆汇率预测的神经 ARFIMA 模型AI 解读

Exchange rate forecasting remains a challenging problem, particularly for emerging economies, where the observed time series exhibit pronounced long-memory dependence, nonlinear dynamics, and sensitivity to macro-financial drivers. Classical models such as ARFIMA capture long-range persistence but fail to adequately represent nonlinear relationships, while modern machine learning approaches often neglect the underlying long-memory structure in macroeconomic series. To…

可扩展的贝叶斯双重机器学习框架及其在种族比例失衡评估中的应用AI 解读

Racial disproportionality in stop and search practices elicits substantial concerns about its societal and behavioral impacts. In London, Black individuals are about four times more likely to be stopped and searched than White individuals. Using data on stop and search events in London from January 2019 to December 2023, this paper aims to investigate disproportionality in the volume of stops for expressive crimes involving Black individuals compared to other ethnicities. We…

通过自动去偏机器学习与半监督 Riesz 回归实现预测辅助因果推断AI 解读

This study investigates semiparametric efficient estimation of causal and structural parameters in a semi-supervised setting. In our setting, unlabeled auxiliary regressors are available in addition to labeled observations consisting of outcomes and regressors. Our goal is to construct estimators of causal and structural parameters whose asymptotic variances are smaller than those of estimators constructed using only labeled data. We refer to this framework as…

ShrinkageTrees：用于生存分析与因果推断的贝叶斯树集成 R 包AI 解读

ShrinkageTrees is an R package for Bayesian tree ensembles in survival analysis and causal inference. The package implements Bayesian additive regression tree models for right- and interval-censored survival outcomes within an accelerated failure time (AFT) framework, with optional decomposition into prognostic and treatment-effect components for causal inference. Two complementary forms of regularisation are available: regularisation of the tree structure, via…

Rbreak：线性限制下的结构突变估计及线性模型树 R 包AI 解读

The package \texttt{rbreak} implements methods for detecting structural breaks and estimating break locations for linear multiple regression models under general linear restrictions on the coefficient vector. Restrictions can be within regimes, across regimes, or both, and are supported in two forms: an affine parameterization (Form A: \texttt{delta = S*theta + s}) and explicit linear constraints (Form B: \texttt{R*delta = r}). It provides break date estimation with…

以非线性因子扩展贝叶斯 VAR 的灵活方法AI 解读

This paper proposes a vector autoregression augmented with nonlinear factors that are modeled nonparametrically using regression trees. There are four main advantages of our model. First, the use of factor methods ensures that departures from linearity are modeled parsimoniously. In particular, they exhibit functional pooling where a small number of nonlinear factors are used to model common nonlinearities across variables. Second, modeling potential nonlinearities…

基于机器学习的去偏 U 统计量AI 解读

We propose a method to debias estimators based on U-statistics with machine-learning (ML) first steps. Standard plug-in estimators often suffer from regularization and model-selection biases, leading to invalid inference. We characterize orthogonal adjustment terms for two-step U-statistics, construct Debiased Machine Learning (DML) U-estimators, develop a cross-fitting algorithm, and establish a general asymptotic theory for inference with ML first steps. We illustrate the…

幂律衰减下解析谱算法的泛化误差曲线AI 解读

The generalization error curve of certain kernel regression method aims at determining the exact order of generalization error with various source condition, noise level and choice of the regularization parameter rather than the minimax rate. In this work, under mild assumptions, we rigorously provide a full characterization of the generalization error curves of the kernel gradient descent method (and a large class of analytic spectral algorithms) in kernel regression.…

处理内生性下样本选择模型的锐界与推断AI 解读

This paper provides partial identification and inference for treatment effects in nonparametric sample selection models with endogenous treatment and (weak) sample selection monotonicity. Outcomes are observed only for a non-randomly selected subsample and treatment is endogenous because of noncompliance with assignment. The proposed bounds for intensive margin treatment effects among compliers are sharp and tighter than those of Chen and Flores (2015). For inference, we…