每日简报

用自助法正则化注意力分数AI 解读

Vision transformers (ViT) rely on attention mechanism to weigh input features, and therefore attention scores have naturally been considered as explanations for its decision-making process. However, attention scores are almost always non-zero, resulting in noisy and diffused attention maps and limiting interpretability. Can we quantify uncertainty measures of attention scores and obtain regularized attention scores? To this end, we consider attention scores of ViT in a…

Banach 空间中光滑泛函估计的锐利去偏AI 解读

This paper studies the estimation of smooth functionals $f(θ)$ of a mean parameter $θ= \mathbb{E}_P[W]$ for a distribution $P$ on a general Banach space. We propose a cross-fitted estimator based on a single sample splitting and establish non-asymptotic moment bounds and Berry--Esséen bounds for both $m$-smooth and infinitely smooth functionals under the finite moment assumptions. Our framework is applied to precision matrix estimation and the inference of projection…

高维回归中的去偏估计：Javanmard 与 Montanari (2014) 的综述与复制AI 解读

High-dimensional statistical settings ($p \gg n$) pose fundamental challenges for classical inference, largely due to bias introduced by regularized estimators such as the LASSO. To address this, Javanmard and Montanari (2014) propose a debiased estimator that enables valid hypothesis testing and confidence interval construction. This report examines their debiased LASSO framework, which yields asymptotically normal estimators in high-dimensional settings. The key…

存在未测量混杂时连续时间动态处理的因果效应估计AI 解读

Modern medical research demands specialized causal inference methods evaluating complex continuous-time dynamic treatment regimens using observational data. For instance, obtaining the causal effects of intravenous administration, a continuous process involving dynamic adjustments of the treatment dose, can guide clinicians on drug use. However, the existing causal inference frameworks in longitudinal studies typically assume that time advances in discrete time steps.…

协整矩阵自回归模型AI 解读

Traditional econometric analyzes represent observations as vectors despite the inherent complexity of empirical data structures. When data are organized along dual classification dimensions, a matrix representation provides a more natural and interpretable framework. Building on recent advances in matrix autoregressive (MAR) modeling, this study introduces a novel error correction representation tailored for matrix-structured data. Through comparative analysis with existing…

弱重叠下因果效应估计的去混杂得分与表示学习AI 解读

Overlap, also known as positivity, is a key condition for causal treatment effect estimation. Many popular estimators suffer from high variance and become brittle when features differ strongly across treatment groups. This is especially challenging in high dimensions: the curse of dimensionality can make overlap implausible. To address this, we propose a class of feature representations called deconfounding scores, which preserve both identification and the target of…

采用参数扩展累积收缩先验的贝叶斯多组函数型因子模型AI 解读

Functional data consist of trajectories observed over a continuous domain, such as time, space, or wavelength. Here we consider curves observed on different groups of subjects and propose a Bayesian multi-group functional factor analysis framework that jointly models the data via an explicit decomposition into group-specific mean functions and latent components that capture both common and distinct latent structures across the groups. We represent these functional components…

数字孪生反事实框架：模拟潜在结果的验证架构AI 解读

The fundamental problem of causal inference - that the counterfactual outcome for any individual is never observed - has shaped the entire methodology of the field. Every existing approach substitutes assumptions for missing data: ignorability, parallel trends, exclusion restrictions. None produces the counterfactual itself. This paper proposes the Digital Twin Counterfactual Framework (DTCF): rather than estimating the counterfactual statistically, we simulate it using a…

社会科学实验样本流失的共形推断AI 解读

Attrition in survey and field experiments presents a challenge for social science research. Common approaches to deal with this problem -- such as complete case analysis, multiple imputation, and weighting methods -- rely on strong assumptions that may not hold in practice. This paper introduces a new method that combines recent advances in statistical inference with established tools for handling missing data. The approach produces prediction intervals for treatment effects…

从时间快照识别漂移、扩散与因果结构AI 解读

Stochastic differential equations (SDEs) are a fundamental tool for modelling dynamic processes, including gene regulatory networks (GRNs), contaminant transport, financial markets, and image generation. However, learning the underlying SDE from data is a challenging task, especially if individual trajectories are not observable. Motivated by burgeoning research in single-cell datasets, we present the first comprehensive approach for jointly identifying the drift and…

具有半长记忆误差的动态线性回归预测模型AI 解读

Dynamic linear regression models forecast the values of a time series based on a linear combination of a set of exogenous time series while incorporating a time series process for the error term. This error process is often assumed to follow a stationary autoregressive integrated moving average (ARIMA) model, or its seasonal variants, which are unable to capture a long-range dependence structure (long memory) of the error process. We propose a novel dynamic linear regression…

因果推断中的外推正则化AI 解读

Many common estimators in machine learning and causal inference are linear smoothers, where the prediction is a weighted average of the training outcomes. Some estimators, such as ordinary least squares and kernel ridge regression, allow for arbitrarily negative weights, which improve feature imbalance but often at the cost of increased dependence on parametric modeling assumptions and higher variance. By contrast, estimators like importance weighting and random forests…

通过广义贝叶斯对参数模型进行自适应非参数扰动AI 解读

Parametric Bayesian modeling offers a powerful and flexible toolbox for machine learning. Yet the model, however detailed, may still be wrong, and this can make inferences untrustworthy. In this paper we introduce a new class of semiparametric corrections for parametric Bayesian models, when the target of inference is a functional of the true data distribution. Our starting point is a fully Bayesian modeling approach, which explicitly accounts for the possibility that the…

基于实验预测广告增量效果：PIE 广告衡量方法AI 解读

Randomized controlled trials (RCTs) provide the most credible estimates of advertising incrementality but are difficult to scale. We propose Predicted Incrementality by Experimentation (PIE), which reframes ad measurement as a campaign-level prediction problem. PIE uses a sample of RCTs to learn a mapping from campaign features to causal effects, then applies it to campaigns not run as RCTs. Because the RCTs identify the causal effects, PIE can incorporate post-determined…

概念发生漂移时的学习：混杂、不变性与降维AI 解读

Practitioners often face the challenge of deploying prediction models in new environments with shifted distributions of covariates and responses. With observational data, such shifts are often driven by unobserved confounding, and can in fact alter the concept of which model is best. This paper studies distribution shifts in the domain adaptation problem with unobserved confounding. We postulate a linear structural causal model to account for endogeneity and unobserved…