Asger Waagepetersen · Asbjørn Risom · Niels Richard Hansen · Anton Rask Lundborg·首次提交 2026-07-03 · 修订 2026-07-03 · v1·arXiv预印本
结局适配的自动去偏机器学习AI 解读
Parameters of interest in causal inference, such as treatment or policy effects, can often be expressed as linear functionals of an outcome regression function. Automatic debiased machine learning (AutoDML) is a unified framework for obtaining asymptotically normal estimators of such parameters, which requires estimation of both a regression function and a Riesz representer. Existing AutoDML neural network architectures, such as RieszNet and MADNet, use a shared intermediate…
Conventional heteroskedasticity diagnostics ask whether the conditional variance of the regression disturbance varies with covariates. This paper asks a different question: when does that variation matter for inference on the estimand of interest? The paper develops a contrast-specific theory characterizing when covariance perturbations are inferentially relevant. We show that, for any linear contrast $a'β$ in a linear regression, the difference between the…
Gregor Steiner · Jeremie Houssineau · Mark F. J. Steel·首次提交 2025-11-20 · 修订 2026-07-03 · v3·arXiv预印本
允许工具变量潜在无效的可能性理论回归AI 解读
Instrumental variable regression is a common approach for causal inference in the presence of unobserved confounding. However, identifying valid instruments is often difficult in practice. In this paper, we propose a novel method based on possibility theory that performs posterior inference on the treatment effect, conditional on a user-specified set of potential violations of the instrument exogeneity assumption. Our method can provide valid results even when only a single,…
Anthony-Alexander Christidis · Stefan Van Aelst · Ruben Zamar·首次提交 2021-02-17 · 修订 2026-07-03 · v9·arXiv预印本
数据驱动的逻辑回归集成方法及其在基因组学中的应用AI 解读
Advances in data collecting technologies in genomics have significantly increased the need for tools designed to study the genetic basis of many diseases. Effective statistical methods should excel in both prediction accuracy and biomarker identification. We introduce a novel approach to high-dimensional binary classification that integrates regularization with ensembling techniques. The method constructs compact ensembles of interpretable models derived by optimizing a…
Enes Makalic · Daniel F. Schmidt·首次提交 2026-04-02 · 修订 2026-07-03 · v2·arXiv预印本
Wallace--Freeman 估计量的渐近理论与一阶偏差AI 解读
The Wallace--Freeman estimator is a classical minimum message length estimator whose relationship with likelihood-based asymptotic theory has not been fully developed. We show that, in regular parametric models, the Wallace--Freeman criterion is equivalent, up to constants, to a penalised likelihood criterion with penalty weight \(n^{-1}\). This representation places the estimator within the standard theory of penalised M-estimation and yields existence, consistency, an…
Mediation analysis provides a central framework for elucidating causal mechanisms, yet its application is often impeded by treatment-induced confounding, under which the widely used natural mediation effects are generally unidentifiable. Interventional effects have been proposed as an alternative when these confounders are observable; however, identifying and estimating interventional effects remains challenging when confounders are unmeasured. In this paper, we address this…
Christopher M. Crawford · Marie-Christine Düker · Younghoon Kim · Vladas Pipiras · Barbara L. Fredrickson 等 6 位作者·首次提交 2026-07-02 · 修订 2026-07-02 · v1·arXiv预印本
潜在高斯离散多变量时间序列的解析标准误AI 解读
Unlike their continuous-valued counterparts, there are no universally preferred methodologies for modeling discrete-valued time series. This is especially problematic in fields such as psychology and education, where repeated-measures data often take the form of count, dichotomous, and ordered categorical variables. To address the need for flexible methodology for analyzing discrete-valued time series data, a copula-style multivariate model defined through deterministic…
Mitchell A. Thornton·首次提交 2026-06-13 · 修订 2026-07-02 · v2·arXiv预印本
基于谱分解的核密度估计:数据驱动窗与叠加方法AI 解读
Kernel density estimation depends largely on one choice, the smoothing bandwidth. We treat bandwidth selection and density estimation in the characteristic-function domain, where the cyclic group-averaged covariance of the binned data has the squared empirical characteristic function as its spectrum: the true characteristic function sits over a sampling-noise floor of $1/n$, and the bandwidth is the spectral cutoff where the two meet. Several methods follow. An automatic…
Kirsten E. Landsiedel · Maya L. Petersen · Mark J. van der Laan·首次提交 2026-07-02 · 修订 2026-07-02 · v1·arXiv预印本
结局子抽样纵向两阶段设计的目标最大似然估计AI 解读
We consider efficient estimation of causal parameters in longitudinal two-stage designs with outcome subsampling, motivated by resampling designs in HIV-related mortality studies. In these studies, many participants become lost to follow-up; resampling designs address this by tracing a subset of lost individuals to ascertain their outcomes. Analyses often use inverse-probability-weighted Kaplan-Meier (wKM) estimators that discard longitudinal covariate information and suffer…
Ye Tian · Mengchu Li · Marco Avella Medina·首次提交 2026-07-02 · 修订 2026-07-02 · v1·arXiv预印本
异质性下的受污染多任务学习:基本极限与最优算法AI 解读
Integrating information across related tasks can improve estimation and prediction in transfer, multi-task, and federated learning, but contamination and heterogeneity make robust borrowing challenging. We study a contaminated multi-task empirical risk minimization (ERM) framework in which an $ε$ fraction of $K$ tasks, each with sample size $n$, may be arbitrarily contaminated while the remaining tasks are heterogeneous. Our goal is to estimate both the global minimizer of…
We study empirical Bayes estimation in high-dimensional linear regression. To facilitate computationally efficient estimation of the underlying prior, we adopt a variational empirical Bayes approach, introduced originally in Carbonetto and Stephens (2012) and Kim et al. (2022). We establish asymptotic consistency of the nonparametric maximum likelihood estimator (NPMLE) and its (computable) naive mean field variational surrogate under mild assumptions on the design and the…
Contrast-enhanced spectral mammography (CESM) acquires two images of each breast, a low-energy image and a recombined contrast image, but two questions central to building a classifier on them remain unsettled: whether the two image types carry comparable malignancy signal, and how a patient's several images should be combined into a single decision. Both are hard to answer reliably, because most published CESM classifiers split cross-validation folds at the image level,…
We prove a variance-aware pointwise majorizing-measure theorem for centered Gaussian processes. Classical generic chaining characterizes the scalar quantity $\mathbb E\sup_{x\in T}X_x$; the theorem here gives a simultaneous high-probability envelope for the entire field. For an ambient prior $μ$, the envelope at $x$ is governed by a pointwise Fernique-Talagrand functional \[Φ_μ(x):=\int_0^{4σ(x)}\sqrt{\log\frac{1}{μ(B_d(x,\varepsilon))}}\,d\varepsilon,\] together with the…
Measuring the long-term opportunity cost of interventions remains a critical challenge in e-commerce A/B testing. While strategic levers (such as dynamic pricing, ranking algorithms, and promotional campaigns) trigger shifts in consumer behaviour that persist over months, operational constraints necessitate fast decision-making cycles that are typically limited to weekly experimental windows. Standard metrics like revenue and conversion are inherently short-sighted, biasing…
Francis Bach·首次提交 2026-07-02 · 修订 2026-07-02 · v1·arXiv预印本
高斯位置模型中正则化变分与谱对数密度比估计AI 解读
We study ridge-regularized log-density-ratio estimation in the Gaussian location model with a common covariance matrix. By affine invariance, the model is written as q $\sim$ N(0, I), p $\sim$ N($Δ$, I), with linear features, where $Δ$ is a mean vector. The variational estimator is the empirical Kullback-Leibler (KL) log-normalized fit with a squared L2-penalty on its nonconstant coefficient, and the spectral estimator recently introduced in [1] replaces a single variational…
Xin Zhang · Lin Liu · Haitao Chu·首次提交 2025-09-09 · 修订 2026-07-02 · v2·arXiv预印本
随机临床试验中协变量调整 g-computation 的偏差减少AI 解读
G-computation is a powerful method for estimating unconditional treatment effects with covariate adjustment in randomized clinical trials. It typically relies on fitting canonical generalized linear models. However, this could be problematic when the sample size or event number is small relative to the number of covariates. Common issues include the underestimation of the variance and the potential nonexistence of maximum likelihood estimators. Bias reduction methods are…
Design-based inference, also known as randomization-based or finite-population inference, provides a principled framework for trustworthy statistical inference. It attributes randomness solely to the design mechanism, such as treatment assignment, survey sampling, or missingness, without imposing super-population distributional or modeling assumptions on the outcome data. From the seminal work of Fisher and Neyman to its recent resurgence, design-based inference has played a…
A critical assumption of observational studies is that all confounding variables must be known and sufficiently adjusted for to estimate causal effects. An implicit, and often overlooked, aspect of this assumption is that all confounding variables have been measured without error. In the social and medical sciences, latent traits such as motivation, self-efficacy, and ability measures are likely confounding variables. Because latent traits are not directly observable,…
Rajan Shankar · Ines Wilms · Jakob Raymaekers · Garth Tarr·首次提交 2025-11-19 · 修订 2026-07-01 · v2·arXiv预印本
利用均值偏移惩罚检测状态空间模型中的异常值AI 解读
State-space models (SSMs) provide a flexible framework for modelling time series data, but their reliance on Gaussian error assumptions makes them highly sensitive to outliers. We propose a robust estimation method, ROAMS, that mitigates the influence of additive outliers by introducing shift parameters at each timepoint in the observation equation of the SSM. These parameters allow the model to attribute non-zero shifts to outliers while leaving clean observations…
We estimate Kyle's (1985) price-impact coefficient $λ$ directly from daily equity order flow and test its ability to forecast the cross-section of subsequent stock returns. Using CRSP data from 2020 to 2025, we construct firm-month measures of signed order flow and two estimators of $\hatλ_{it}$: a within-month price-impact regression and an Amihud-style ratio. Signed order flow strongly predicts contemporaneous and one-month-ahead returns, while volume volatility predicts…
Yang Liu · Andrew Ying · Zongqi Xia · Jue Hou·首次提交 2026-07-01 · 修订 2026-07-01 · v1·arXiv预印本
真实世界证据中信息性治疗切换的工具变量方法AI 解读
Reproducible and generalizable assessment of treatment decisions requires principled handling of subsequent treatment switching that may inform expected outcomes and shift across cohorts and over time. To effectively account for informative treatment switching, we propose an instrumental variable approach that characterizes the poorly documented expected outcomes at switching as unmeasured confounding. After establishing the baseline treatment as a viable instrumental…
We propose for a quantile regression an estimation method for transferring knowledge using two $L_1$ penalties based on an estimator obtained from a source database. The proposed transfer learning estimator satisfies the properties of consistency and sparsity. Its convergence rate and asymptotic behavior are studied in several scenarios. This knowledge transfer results in a shorter computation time than that of the standard adaptive LASSO estimator. Another advantage of our…
This paper presents a method for constructing uniform confidence bands for the marginal treatment effect (MTE) function. The shape of the MTE function provides insight into how the unobserved propensity to receive treatment relates to the treatment effect. Our approach visualizes the statistical uncertainty of an estimated function, facilitating inferences about the function's shape. The proposed method is computationally inexpensive and requires only minimal information:…
Combined unilateral and bilateral binary outcomes frequently arise in studies involving paired organs. The risk difference is a clinically interpretable measure for comparing treatment effects between groups. Existing confidence interval methods are primarily based on asymptotic normality and may fail to adequately reflect finite-sample distributional features, particularly skewness. To address this issue, we propose a distribution-based confidence interval derived from the…
Conventional heteroskedasticity diagnostics ask whether the conditional variance of the regression disturbance varies with covariates. This paper asks a different question: when does that variation matter for inference on the estimand of interest? The paper develops a contrast-specific theory characterizing when covariance perturbations are inferentially relevant. We show that, for any linear contrast a′β in a linear regression, the difference between the…
The Wallace--Freeman estimator is a classical minimum message length estimator whose relationship with likelihood-based asymptotic theory has not been fully developed. We show that, in regular parametric models, the Wallace--Freeman criterion is equivalent, up to constants, to a penalised likelihood criterion with penalty weight n−1. This representation places the estimator within the standard theory of penalised M-estimation and yields existence, consistency, an…
Kernel density estimation depends largely on one choice, the smoothing bandwidth. We treat bandwidth selection and density estimation in the characteristic-function domain, where the cyclic group-averaged covariance of the binned data has the squared empirical characteristic function as its spectrum: the true characteristic function sits over a sampling-noise floor of 1/n, and the bandwidth is the spectral cutoff where the two meet. Several methods follow. An automatic…
Integrating information across related tasks can improve estimation and prediction in transfer, multi-task, and federated learning, but contamination and heterogeneity make robust borrowing challenging. We study a contaminated multi-task empirical risk minimization (ERM) framework in which an ε fraction of K tasks, each with sample size n, may be arbitrarily contaminated while the remaining tasks are heterogeneous. Our goal is to estimate both the global minimizer of…
We prove a variance-aware pointwise majorizing-measure theorem for centered Gaussian processes. Classical generic chaining characterizes the scalar quantity Esupx∈TXx; the theorem here gives a simultaneous high-probability envelope for the entire field. For an ambient prior μ, the envelope at x is governed by a pointwise Fernique-Talagrand functional Φμ(x):=∫04σ(x)logμ(Bd(x,ε))1dε, together with the…
We study ridge-regularized log-density-ratio estimation in the Gaussian location model with a common covariance matrix. By affine invariance, the model is written as q ∼ N(0, I), p ∼ N(Δ, I), with linear features, where Δ is a mean vector. The variational estimator is the empirical Kullback-Leibler (KL) log-normalized fit with a squared L2-penalty on its nonconstant coefficient, and the spectral estimator recently introduced in [1] replaces a single variational…
We estimate Kyle's (1985) price-impact coefficient λ directly from daily equity order flow and test its ability to forecast the cross-section of subsequent stock returns. Using CRSP data from 2020 to 2025, we construct firm-month measures of signed order flow and two estimators of λ^it: a within-month price-impact regression and an Amihud-style ratio. Signed order flow strongly predicts contemporaneous and one-month-ahead returns, while volume volatility predicts…
We propose for a quantile regression an estimation method for transferring knowledge using two L1 penalties based on an estimator obtained from a source database. The proposed transfer learning estimator satisfies the properties of consistency and sparsity. Its convergence rate and asymptotic behavior are studied in several scenarios. This knowledge transfer results in a shorter computation time than that of the standard adaptive LASSO estimator. Another advantage of our…