论文检索

基于深度分位数过程回归的分布性离策略评估AI 解读

This paper investigates the off-policy evaluation (OPE) problem from a distributional perspective. Rather than focusing solely on the expectation of the total return, as in most existing OPE methods, we aim to estimate the entire return distribution. To this end, we introduce a quantile-based approach for OPE using deep quantile process regression, presenting a novel algorithm called Deep Quantile Process regression-based Off-Policy Evaluation (DQPOPE). We provide new…

深度 Cox 模型的小批量估计：统计基础与实践指导AI 解读

The stochastic gradient descent (SGD) algorithm has been widely used to optimize deep Cox neural network (Cox-NN) by updating model parameters using mini-batches of data. We show that SGD aims to optimize the average of mini-batch partial-likelihood, which is different from the standard partial-likelihood. This distinction requires developing new statistical properties for the global optimizer, namely, the mini-batch maximum partial-likelihood estimator (mb-MPLE). We…

通过联合正则化深度神经网络估计单细胞异质基因网络AI 解读

Estimation of intracellular gene networks has been a critical component of single-cell transcriptomic data analysis, which can provide crucial insights into the complex interplay between genes, facilitating the discovery of the biological basis of human life at single-cell resolution. Despite notable achievements, existing methodologies often falter in their practicality, primarily due to their narrow focus on simplistic linear relationships and inadequate handling of…

用于线性与非线性充分降维的带瓶颈层集成神经网络AI 解读

We introduce a unified, flexible, and easy-to-implement framework of sufficient dimension reduction that can accommodate both linear and nonlinear dimension reduction, and both the conditional distribution and the conditional mean as the targets of estimation. This unified framework is achieved by a specially structured neural network—the Belted and Ensembled Neural Network (BENN)—that consists of a narrow latent layer, which we call the belt, and a family of transformations…

Riesz 表示元的对抗估计AI 解读

Many causal parameters are linear functionals of an underlying regression. The Riesz representer is a key component in the asymptotic variance of a semiparametrically estimated linear functional. We propose an adversarial framework to estimate the Riesz representer using general function spaces. We prove a nonasymptotic mean square rate in terms of an abstract quantity called the critical radius, then specialize it for neural networks, random forests, and reproducing kernel…

SPARCC：右删失协变量模型中的半参数稳健估计AI 解读

In Huntington disease research, a current goal is to understand how symptoms change prior to a clinical diagnosis. Statistically, achieving this goal entails modeling symptom severity as a function of the covariate 'time of diagnosis,' which is often heavily right-censored in observational studies. Existing estimators that handle right-censored covariates, such as the complete case estimator and maximum likelihood estimator, vary in their statistical efficiency and…

差分隐私切片逆回归：极小极大最优性与算法AI 解读

Privacy preservation has become a critical concern in high-dimensional data analysis due to the growing prevalence of data-driven applications. Since its proposal, sliced inverse regression has emerged as a widely used statistical technique to reduce the dimensionality of covariates while maintaining sufficient statistical information. In this paper, we propose optimally differentially private algorithms specifically designed to address privacy concerns in the context of…

随机权重矩阵与解释变量下空间自回归模型的拟得分匹配估计AI 解读

With the rapid advancements in technology for data collection, the application of the spatial autoregressive (SAR) model has become increasingly prevalent in real-world analysis, particularly when dealing with large datasets. However, the commonly used quasi-maximum likelihood estimation (QMLE) for the SAR model is not computationally scalable to handle the data with a large size. In addition, when establishing the asymptotic properties of the parameter estimators of the SAR…

控制错误发现率的局部关联搜索AI 解读

We introduce local conditional hypotheses that express how the relation between explanatory variables and outcomes changes across different contexts, described by covariates. By expanding upon the model-X knockoff filter, we show how to adaptively discover these local associations, all while controlling the false discovery rate. Our enhanced inferences can help explain sample heterogeneity and uncover interactions, making better use of the capabilities offered by modern…

利用深度神经网络对删失数据进行非参数推断AI 解读

Abstract We propose a novel deep learning approach to nonparametric statistical inference for the conditional hazard function of survival time with right-censored data. We use a deep neural network (DNN) to approximate the logarithm of a conditional hazard function given covariates and obtain a DNN likelihood-based estimator of the conditional hazard function. Such an estimation approach enhances model flexibility and hence relaxes structural and functional assumptions on…

多源无监督域适应的分布鲁棒学习AI 解读

Empirical risk minimization often performs poorly when the distribution of the target domain differs from those of the source domains. To address such potential distributional shifts, we develop an unsupervised domain adaptation approach that leverages labeled data from multiple source domains and unlabeled data from the target domain. We introduce a distributionally robust model that optimizes an adversarial reward based on explained variance across a class of target…

半球神经网络：从被动响应到前瞻性波动建模AI 解读

ABSTRACT We revisit maximum likelihood estimation (MLE) for macroeconomic density forecasting through a novel neural network architecture with dedicated mean and variance hemispheres. Our architecture features several key ingredients making MLE work in this context. First, the hemispheres share a common core at the entrance of the network, which accommodates various forms of time variation in the error variance. Second, we introduce a volatility emphasis constraint that…

定制已实现波动率：面向波动率预测的风险度量AI 解读

Standard realized volatility (RV) measures estimate the latent volatility of an asset price using high frequency data with no reference to how or where the estimate will subsequently be used. This paper presents methods for “tailoring” the estimate of volatility to the application in which it will be used. For example, if the volatility measure will be used in a specific parametric forecasting model, it may be possible to exploit that knowledge to construct a better measure…

贝叶斯非参数准似然AI 解读

A recent trend in Bayesian research has been revisiting generalizations of the likelihood that enable Bayesian inference without requiring the specification of a data generating mechanism. This article focuses on a Bayesian nonparametric extension of Wedderburn’s quasi-likelihood, using Bayesian additive regression trees to model the mean function. Here, the analyst posits only a structural relationship between the mean and variance of the outcome. We show that this approach…

用平均导数效应参数化连续处理的影响AI 解读

Summary The average treatment effect is commonly used to quantify the main effect of a binary treatment on an outcome. Extensions to continuous treatments are usually based on the dose-response curve or shift interventions, but both require strong overlap conditions, and the resulting curves may be difficult to summarize. This article focuses instead on average derivative effects, which are scalar estimands related to infinitesimal shift interventions requiring only local…

利用代理控制结局的数据整合后推断AI 解读

Summary Data integration methods aim to extract low-dimensional embeddings from high-dimensional outcomes to remove unwanted variation, such as batch effects and unmeasured covariates, across heterogeneous datasets. However, multiple hypothesis testing after integration can be biased due to data-dependent processes. We introduce a robust post-integrated inference method that accounts for latent heterogeneity by leveraging control outcomes. Using causal interpretations, we…

未知协方差下的高斯信息分解AI 解读

Abstract Common workflows in machine learning and statistics rely on the ability to partition the information in a dataset into independent portions. Recent work has shown that this may be possible even when conventional sample splitting is not, such as when the number of samples, $ n $, is one or when observations are not independent and identically distributed. In the case of multivariate Gaussian data, these alternatives to sample splitting require knowledge of the…

Wasserstein 生成式回归AI 解读

Abstract In this paper, we propose a new and unified approach for nonparametric regression and conditional distribution learning. Our approach simultaneously estimates a regression function and a conditional generator using a generative learning framework, where a conditional generator is a function that can generate samples from a conditional distribution. The main idea is to estimate a conditional generator satisfying the constraint that it produces a good regression…

利用生成式神经网络进行双重稳健条件独立检验AI 解读

Abstract This article addresses the problem of testing the conditional independence of two generic random vectors X and Y given a third random vector Z, which plays an important role in statistical and machine learning applications. We propose a new non-parametric testing procedure that avoids explicitly estimating any conditional distributions but instead requires sampling from the two marginal conditional distributions of X given Z and Y given Z. We further propose using a…

Abstract We develop a general theory of omitted variable bias for a wide range of common causal parameters, including average treatment effects, average causal derivatives, and policy effects from covariate shifts. We show how plausibility judgments on the maximum explanatory power of omitted variables are sufficient to bound the bias, facilitating sensitivity analysis in otherwise complex models. Finally, we provide statistical inference methods that can leverage modern…

利用双重机器学习估计平均偏效应AI 解读

Single-parameter summaries of variable effects in regression settings are desirable for ease of interpretation. However, (partially) linear models, for example, which would deliver these, may fit poorly to the data. On the other hand, an interpretable summary of the contribution of a given predictor is provided by the so-called average partial effect—the average slope of the regression function with respect to the predictor of interest. Although one can construct a doubly…

Summary Recent advances in causal inference have seen the development of methods that make use of the predictive power of machine learning algorithms. In this paper, we develop novel double machine learning procedures for panel data in which these algorithms are used to approximate high-dimensional and non-linear nuisance functions of the covariates. Our new procedures are extensions of the well-known correlated random effects, within-group, and first-difference estimators…

通过因果表征学习构建可解释的深度生成模型AI 解读

Recent developments in generative artificial intelligence (AI) rely on machine learning techniques such as deep learning and generative modeling to achieve state-of-the-art performance across wide-ranging domains. These methods’ surprising performance is due in part to their ability to learn implicit “representations” of complex, multi-modal data. Unfortunately, deep neural networks are notoriously black boxes that obscure these representations, making them difficult to…

可能性推断模型：综述AI 解读

An inferential model (IM) is a model describing the construction of provably reliable, data-driven uncertainty quantification and inference about relevant unknowns. IMs and Fisher’s fiducial argument have similar objectives, but a fundamental distinction between the two is that the former doesn’t require that uncertainty quantification be probabilistic, offering greater flexibility and allowing for a proof of its reliability. Important recent developments have been made…