David McCoy · Wenxin Zhang · Alan Hubbard · Mark van der Laan · Alejandro Schuler·首次提交 2024-06-16 · 修订 2024-12-10 · v2·arXiv预印本
通过随机位移干预与交叉验证靶向学习自适应识别效应修饰因素AI 解读
In epidemiology, identifying subpopulations that are particularly vulnerable to exposures and those who may benefit differently from exposure-reducing interventions is essential. Factors such as age, gender-specific vulnerabilities, and physiological states such as pregnancy are critical for policymakers when setting regulatory guidelines. However, current semi-parametric methods for estimating heterogeneous treatment effects are often limited to binary exposures and can…
Ke Huang · Mingming Liu · Shujie Ma·首次提交 2021-08-12 · 修订 2024-12-09 · v5·arXiv预印本
Lipschitz 损失正则化经验风险最小化中稀疏深度 ReLU 网络的近最优学习AI 解读
We propose a sparse deep ReLU network (SDRN) estimator of the regression function obtained from regularized empirical risk minimization with a Lipschitz loss function. Our framework can be applied to a variety of regression and classification problems. We establish novel non-asymptotic excess risk bounds for our SDRN estimator when the regression function belongs to a Sobolev space with mixed derivatives. We obtain a new nearly optimal risk rate in the sense that the SDRN…
We extend nonparametric regression smoothing splines to a context where there is endogeneity and instrumental variables are available. Unlike popular existing estimators, the resulting estimator is one-step and relies on a unique regularization parameter. We derive rates of the convergence for the estimator and its first derivative, which are uniform in the support of the endogenous variable. We also address the issue of imposing monotonicity in estimation and extend the…
Dominic Magirr · Craig Wang · Xinlei Deng · Tim Morris · Mark Baillie·首次提交 2024-12-09 · 修订 2024-12-09 · v1·arXiv预印本
比例风险下限制平均生存时间检验与对数秩检验的效率比较AI 解读
Background: For RCTs with time-to-event endpoints, proportional hazard (PH) models are typically used to estimate treatment effects and logrank tests are commonly used for hypothesis testing. There is growing support for replacing this approach with a model-free estimand and assumption-lean analysis method. One alternative is to base the analysis on the difference in restricted mean survival time (RMST) at a specific time, a single-number summary measure that can be defined…
For highly skewed or fat-tailed distributions, mean or median-based methods often fail to capture the central tendencies in the data. Despite being a viable alternative, estimating the conditional mode given certain covariates (or mode regression) presents significant challenges. Nonparametric approaches suffer from the "curse of dimensionality", while semiparametric strategies often lead to non-convex optimization problems. In order to avoid these issues, we propose a novel…
Existing identification and estimation methods for semiparametric sample selection models rely heavily on exclusion restrictions. However, it is difficult in practice to find a credible excluded variable that has a correlation with selection but no correlation with the outcome. In this paper, we establish a new identification result for a semiparametric sample selection model without the exclusion restriction. The key identifying assumptions are nonlinearity on the selection…
Stefan Franssen · Jeanne Nguyen · Aad van der Vaart·首次提交 2024-11-29 · 修订 2024-11-29 · v1·arXiv预印本
半参数混合模型的Bernstein-von Mises定理AI 解读
Semiparametric mixture models are parametric models with latent variables. They are defined kernel, $p_θ(x | z)$, where z is the unknown latent variable, and $θ$ is the parameter of interest. We assume that the latent variables are an i.i.d. sample from some mixing distribution $F$. A Bayesian would put a prior on the pair $(θ, F)$. We prove consistency for these models in fair generality and then study efficiency. We first prove an abstract Semiparametric Bernstein-von…
We introduce $\textit{Stein transport}$, a novel methodology for Bayesian inference designed to efficiently push an ensemble of particles along a predefined curve of tempered probability distributions. The driving vector field is chosen from a reproducing kernel Hilbert space and can be derived either through a suitable kernel ridge regression formulation or as an infinitesimal optimal transport map in the Stein geometry. The update equations of Stein transport resemble…
This paper addresses one of the most prevalent problems encountered by political scientists working with difference-in-differences (DID) design: missingness in panel data. A common practice for handling missing data, known as complete case analysis, is to drop cases with any missing values over time. A more principled approach involves using nonparametric bounds on causal effects or applying inverse probability weighting based on baseline covariates. Yet, these methods are…
Saurabh Bhandari · Michael J. Daniels · Maria Josefsson · Donald M. Lloyd-Jones · Juned Siddique·首次提交 2024-11-27 · 修订 2024-11-27 · v1·arXiv预印本
纵向中介与事件时间结局的贝叶斯半参数因果中介分析AI 解读
Causal mediation analysis of observational data is an important tool for investigating the potential causal effects of medications on disease-related risk factors, and on time-to-death (or disease progression) through these risk factors. However, when analyzing data from a cohort study, such analyses are complicated by the longitudinal structure of the risk factors and the presence of time-varying confounders. Leveraging data from the Atherosclerosis Risk in Communities…
The problem of constructing a simultaneous confidence surface for the 2-dimensional mean function of a non-stationary functional time series is challenging as these bands can not be built on classical limit theory for the maximum absolute deviation between an estimate and the time-dependent regression function. In this paper, we propose a new bootstrap methodology to construct such a region. Our approach is based on a Gaussian approximation for the maximum norm of sparse…
This study introduces a debiasing method for regression estimators, including high-dimensional and nonparametric regression estimators. For example, nonparametric regression methods allow for the estimation of regression functions in a data-driven manner with minimal assumptions; however, these methods typically fail to achieve $\sqrt{n}$-consistency in their convergence rates, and many, including those in machine learning, lack guarantees that their estimators…
We rigorously quantify the improvement in the sample complexity of variational divergence estimations for group-invariant distributions. In the cases of the Wasserstein-1 metric and the Lipschitz-regularized $α$-divergences, the reduction of sample complexity is proportional to the group size if the group is finite. In addition to the published version at ICML 2023, our proof indeed has included the case when the group is infinite such as compact Lie groups, the convergence…
Tensor algebras give rise to one of the most powerful measures of similarity for sequences of arbitrary length called the signature kernel accompanied with attractive theoretical guarantees from stochastic analysis. Previous algorithms to compute the signature kernel scale quadratically in terms of the length and the number of the sequences. To mitigate this severe computational bottleneck, we develop a random Fourier feature-based acceleration of the signature kernel acting…
Alexander W. Levis · Edward H. Kennedy · Alec McClean · Sivaraman Balakrishnan · Larry Wasserman·首次提交 2024-11-21 · 修订 2024-11-21 · v1·arXiv预印本
随机干预、敏感性分析与最优传输AI 解读
Recent methodological research in causal inference has focused on effects of stochastic interventions, which assign treatment randomly, often according to subject-specific covariates. In this work, we demonstrate that the usual notion of stochastic interventions have a surprising property: when there is unmeasured confounding, bounds on their effects do not collapse when the policy approaches the observational regime. As an alternative, we propose to study generalized…
Ruicheng Ao · Hongyu Chen · David Simchi-Levi·首次提交 2024-11-18 · 修订 2024-11-20 · v2·arXiv预印本
预测引导的主动实验AI 解读
In this work, we introduce a new framework for active experimentation, the Prediction-Guided Active Experiment (PGAE), which leverages predictions from an existing machine learning model to guide sampling and experimentation. Specifically, at each time step, an experimental unit is sampled according to a designated sampling distribution, and the actual outcome is observed based on an experimental probability. Otherwise, only a prediction for the outcome is available. We…
Empirical Bayes (EB) is a popular framework for large-scale inference that aims to find data-driven estimators to compete with the Bayesian oracle that knows the true prior. Two principled approaches to EB estimation have emerged over the years: $f$-modeling, which constructs an approximate Bayes rule by estimating the marginal distribution of the data, and $g$-modeling, which estimates the prior from data and then applies the learned Bayes rule. For the Poisson model, the…
Matthew Blackwell · Ruofan Ma · Aleksei Opacic·首次提交 2024-07-09 · 修订 2024-11-19 · v2·arXiv预印本
因果机制中间结果检验中的隐含假设AI 解读
Political scientists are increasingly interested in assessing causal mechanisms, or determining not just if a causal effect exists but also why it occurs. Even so, many researchers avoid formal causal mediation analyses due to their stringent assumptions, instead opting to explore causal mechanisms through what we call intermediate outcome tests. These tests estimate the effect of the treatment on one or more mediators and view such effects as suggestive evidence of a causal…
We consider estimation of a linear functional of the treatment effect using adaptively collected data. This task finds a variety of applications including the off-policy evaluation (\textsf{OPE}) in contextual bandits, and estimation of the average treatment effect (\textsf{ATE}) in causal inference. While a certain class of augmented inverse propensity weighting (\textsf{AIPW}) estimators enjoys desirable asymptotic properties including the semi-parametric efficiency, much…
Semi-supervised learning (SSL) is an important theme in machine learning, in which we have a few labeled samples and many unlabeled samples. In this paper, for SSL in a regression problem, we consider a method of incorporating information on unlabeled samples into kernel functions. As a typical implementation, we employ Gaussian kernels whose centers are labeled and unlabeled input samples. Since the number of coefficients is larger than the number of labeled samples in this…
Silvia Novo · Germán Aneiros · Philippe Vieu·首次提交 2024-02-17 · 修订 2024-11-18 · v2·arXiv预印本
带测量误差的半函数型部分线性回归:基于kNN估计的方法AI 解读
This paper focuses on a semiparametric regression model in which the response variable is explained by the sum of two components. One of them is parametric (linear), the corresponding explanatory variable is measured with additive error and its dimension is finite ($p$). The other component models, in a nonparametric way, the effect of a functional variable (infinite dimension) on the response. $k$-NN based estimators are proposed for each component, and some asymptotic…
Markov-switching models are powerful tools that allow capturing complex patterns from time series data driven by latent states. Recent work has highlighted the benefits of estimating components of these models nonparametrically, enhancing their flexibility and reducing biases, which in turn can improve state decoding, forecasting, and overall inference. Formulating such models using penalized splines is straightforward, but practically feasible methods for a data-driven…
Micro-randomized trials (MRTs) are increasingly utilized for optimizing mobile health interventions, with the causal excursion effect (CEE) as a central quantity for evaluating interventions under policies that deviate from the experimental policy. However, MRT often contains missing data due to reasons such as missed self-reports or participants not wearing sensors, which can bias CEE estimation. In this paper, we propose a two-stage, doubly robust estimator for CEE in MRTs…
Joe de Keizer · Rémi Lenain · Raphaël Porcher · Sarah Zohar · Arthur Chatton 等 6 位作者·首次提交 2024-11-15 · 修订 2024-11-15 · v1·arXiv预印本
G计算提升个体随机化二分类响应临床试验的表现AI 解读
In a clinical trial, the random allocation aims to balance prognostic factors between arms, preventing true confounders. However, residual differences due to chance may introduce near-confounders. Adjusting on prognostic factors is therefore recommended, especially because the related increase of the power. In this paper, we hypothesized that G-computation associated with machine learning could be a suitable method for randomized clinical trials even with small sample sizes.…
Semiparametric mixture models are parametric models with latent variables. They are defined kernel, pθ(x∣z), where z is the unknown latent variable, and θ is the parameter of interest. We assume that the latent variables are an i.i.d. sample from some mixing distribution F. A Bayesian would put a prior on the pair (θ,F). We prove consistency for these models in fair generality and then study efficiency. We first prove an abstract Semiparametric Bernstein-von…
We introduce Stein transport, a novel methodology for Bayesian inference designed to efficiently push an ensemble of particles along a predefined curve of tempered probability distributions. The driving vector field is chosen from a reproducing kernel Hilbert space and can be derived either through a suitable kernel ridge regression formulation or as an infinitesimal optimal transport map in the Stein geometry. The update equations of Stein transport resemble…
This study introduces a debiasing method for regression estimators, including high-dimensional and nonparametric regression estimators. For example, nonparametric regression methods allow for the estimation of regression functions in a data-driven manner with minimal assumptions; however, these methods typically fail to achieve n-consistency in their convergence rates, and many, including those in machine learning, lack guarantees that their estimators…
We rigorously quantify the improvement in the sample complexity of variational divergence estimations for group-invariant distributions. In the cases of the Wasserstein-1 metric and the Lipschitz-regularized α-divergences, the reduction of sample complexity is proportional to the group size if the group is finite. In addition to the published version at ICML 2023, our proof indeed has included the case when the group is infinite such as compact Lie groups, the convergence…
Empirical Bayes estimation: When does g-modeling beat f-modeling in theory (and in practice)?
Empirical Bayes (EB) is a popular framework for large-scale inference that aims to find data-driven estimators to compete with the Bayesian oracle that knows the true prior. Two principled approaches to EB estimation have emerged over the years: f-modeling, which constructs an approximate Bayes rule by estimating the marginal distribution of the data, and g-modeling, which estimates the prior from data and then applies the learned Bayes rule. For the Poisson model, the…
Semi-functional partial linear regression with measurement error: An approach based on kNN estimation
This paper focuses on a semiparametric regression model in which the response variable is explained by the sum of two components. One of them is parametric (linear), the corresponding explanatory variable is measured with additive error and its dimension is finite (p). The other component models, in a nonparametric way, the effect of a functional variable (infinite dimension) on the response. k-NN based estimators are proposed for each component, and some asymptotic…