论文检索

存在处理习惯化的时序实验中因果效应的极小极大设计AI 解读

Summary In many modern settings, such as an online marketplace, randomized experiments need to be executed over multiple time periods. In such temporal experiments, it has been observed that the effects of an intervention on an experimental unit may be large when the unit is first exposed to it, but then it attenuates after repeated exposures. This is typically due to units’ habituation to the intervention, or some other form of learning, such as when users gradually start…

数据整合：利用外部简化模型的参数估计比值AI 解读

Summary We consider the situation of estimating the parameters in a generalized linear prediction model, from an internal dataset, where the outcome variable $Y$ is binary and there are two sets of covariates, $X$ and $Z$. We have information from an external study that provides parameter estimates for a generalized linear model of $Y$ on $X$. We propose a method that makes limited assumptions about the similarity of the distributions in the two study populations. The method…

含高维干扰参数的广义线性模型检验AI 解读

Summary Generalized linear models often have high-dimensional nuisance parameters, as seen in applications such as testing gene-environment interactions or gene-gene interactions. In these scenarios, it is essential to test the significance of a high-dimensional subvector of the model’s coefficients. Although some existing methods can tackle this problem, they often rely on the bootstrap to approximate the asymptotic distribution of the test statistic, and are thus…

用于识别共同极端事件群组的球面聚类AI 解读

Summary There is growing empirical evidence that spherical $k$-means clustering performs well at identifying groups of concomitant extremes in high dimensions, thereby leading to sparse models. We provide one of the first theoretical results supporting this approach, but also demonstrate some pitfalls. Furthermore, we show that an alternative cost function may be more appropriate for identifying concomitant extremes, and it results in a novel spherical $k$-principal-component…

基于 F 建模的方差经验贝叶斯估计AI 解读

Summary We consider the problem of empirical Bayes estimation of multiple variances when provided with sample variances. Assuming an arbitrary prior on the variances, we derive different versions of the Bayes estimators using different loss functions. For one particular loss function, the resulting Bayes estimator relies on the marginal cumulative distribution function of the sample variances only. When replacing it with the empirical distribution function, we obtain an…

加权最小二乘估计的最优极小极大随机设计AI 解读

Summary This work studies an experimental design problem where the values of a predictor variable, denoted by $x$, are to be determined with the goal of estimating a function $m(x)$, which is observed with noise. A linear model is fitted to $m(x)$, but it is not assumed that the model is correctly specified. It follows that the quantity of interest is the best linear approximation of $m(x)$, which is denoted by $\ell(x)$. It is shown that in this framework the ordinary least…

可交换关系数组的回归AI 解读

Summary Relational arrays represent measures of association between pairs of actors, often in varied contexts or over time. Trade flows between countries, financial transactions between individuals, contact frequencies between school children in classrooms and dynamic protein-protein interactions are all examples of relational arrays. Elements of a relational array are often modelled as a linear function of observable covariates. Uncertainty estimates for regression…

时变处理边际结构Cox模型的工具变量估计AI 解读

Summary Robins (1998) introduced marginal structural models, a general class of counterfactual models for the joint effects of time-varying treatments in complex longitudinal studies subject to time-varying confounding. Robins (1998) established the identification of marginal structural model parameters under a sequential randomization assumption, which rules out unmeasured confounding of treatment assignment over time. The marginal structural Cox model is one of the most…

一般均衡下的大规模教育改革：来自印度的断点回归证据AI 解读

The economic consequences of large-scale government investments in education depend on general equilibrium effects in both the labor market and the education sector. I develop a general equilibrium model capturing the consequences of massive countrywide schooling initiatives. I provide unbiased estimates of the model’s elasticities, using a regression discontinuity derived from Indian government policy. The earnings returns to a year of education are 13.4%, and the general…

非参数混合模型的一致相合性AI 解读

We study uniform consistency in nonparametric mixture models as well as closely related mixture of regression (also known as mixed regression) models, where the regression functions are allowed to be nonparametric and the error distributions are assumed to be convolutions of a Gaussian density. We construct uniformly consistent estimators under general conditions while simultaneously highlighting several pain points in extending existing pointwise consistency results to…

无环有向混合图的嵌套马尔可夫性质AI 解读

Conditional independence models associated with directed acyclic graphs (DAGs) may be characterized in at least three different ways: via a factorization, the global Markov property (given by the d-separation criterion), and the local Markov property. Marginals of DAG models also imply equality constraints that are not conditional independences; the well-known “Verma constraint” is an example. Constraints of this type are used for testing edges, and in a computationally…

变量选择、单调似然比与组稀疏性AI 解读

In the pivotal variable selection problem, we derive the exact nonasymptotic minimax selector over the class of all s-sparse vectors, which is also the Bayes selector with respect to the uniform prior. While this optimal selector is, in general, not realizable in polynomial time, we show that its tractable counterpart (the scan selector) attains the minimax expected Hamming risk to within factor 2, and is also exact minimax with respect to the probability of wrong recovery.…

稳定算法的条件预测推断AI 解读

We investigate generically applicable and intuitively appealing prediction intervals based on k-fold cross-validation. We focus on the conditional coverage probability of the proposed intervals, given the observations in the training sample (hence, training conditional validity), and show that it is close to the nominal level, in an appropriate sense, provided that the underlying algorithm used for computing point predictions is sufficiently stable when feature-response…

分布函数检验与置信带的新方法AI 解读

We introduce new goodness-of-fit tests and corresponding confidence bands for distribution functions. They are inspired by multiscale methods of testing and based on refined laws of the iterated logarithm for the normalized uniform empirical process Un(t)/ t(1−t) and its natural limiting process, the normalized Brownian bridge process U(t)/ t(1−t). The new tests and confidence bands refine the procedures of Berk and Jones (1979) and Owen (1995). Roughly speaking, the high…

含测量误差的高维泊松模型：非线性非凸优化中的假设检验AI 解读

We study estimation and testing in the Poisson regression model with noisy high-dimensional covariates, which has wide applications in analyzing noisy big data. Correcting for the estimation bias due to the covariate noise leads to a nonconvex target function to minimize. Treating the high-dimensional issue further leads us to augment an amenable penalty term to the target function. We propose to estimate the regression parameter through minimizing the penalized target…

破解孟德尔随机化中的赢家诅咒：再随机化逆方差加权估计量AI 解读

Developments in genome-wide association studies and the increasing availability of summary genetic association data have made the application of two-sample Mendelian Randomization (MR) with summary data increasingly popular. Conventional two-sample MR methods often employ the same sample for selecting relevant genetic variants and for constructing final causal estimates. Such a practice often leads to biased causal effect estimates due to the well-known “winner’s curse”…

随机数据下迭代非凸优化的精确全局收敛保证AI 解读

We consider a general class of regression models with normally distributed covariates, and the associated nonconvex problem of fitting these models from data. We develop a general recipe for analyzing the convergence of iterative algorithms for this task from a random initialization. In particular, provided each iteration can be written as the solution to a convex optimization problem satisfying some natural conditions, we leverage Gaussian comparison theorems to derive a…

利用共形 p 值检验异常值AI 解读

This paper studies the construction of p-values for nonparametric outlier detection, from a multiple-testing perspective. The goal is to test whether new independent samples belong to the same distribution as a reference data set or are outliers. We propose a solution based on conformal inference, a general framework yielding p-values that are marginally valid but mutually dependent for different test points. We prove these p-values are positively dependent and enable exact…

高维潜在面板分位数回归及其资产定价应用AI 解读

We propose a generalization of the linear panel quantile regression model to accommodate both sparse and dense parts: sparse means that while the number of covariates available is large, potentially only a much smaller number of them have a nonzero impact on each conditional quantile of the response variable; while the dense part is represent by a low-rank matrix that can be approximated by latent factors and their loadings. Such a structure poses problems for traditional…

高维高斯位置混合模型的最优估计AI 解读

This paper studies the optimal rate of estimation in a finite Gaussian location mixture model in high dimensions without separation conditions. We assume that the number of components k is bounded and that the centers lie in a ball of bounded radius, while allowing the dimension d to be as large as the sample size n. Extending the one-dimensional result of Heinrich and Kahn (Ann. Statist. 46 (2018) 2844–2870), we show that the minimax rate of estimating the mixing…

刻画 SLOPE 的权衡：变分视角与 Donoho–Tanner 极限AI 解读

Sorted ℓ1 regularization has been incorporated into many methods for solving high-dimensional statistical estimation problems, including the SLOPE estimator in linear regression. In this paper, we study how this relatively new regularization technique improves variable selection by characterizing the optimal SLOPE trade-off between the false discovery proportion (FDP) and true positive proportion (TPP) or, equivalently, between measures of type I error and power. Assuming a…

基于离散优化的分组变量选择：计算与统计视角AI 解读

We present a new algorithmic framework for grouped variable selection that is based on discrete mathematical optimization. While there exist several appealing approaches based on convex relaxations and nonconvex heuristics, we focus on optimal solutions for the ℓ0-regularized formulation, a problem that is relatively unexplored due to computational challenges. Our methodology covers both high-dimensional linear regression and nonparametric sparse additive modeling with…

ScreeNOT：相关噪声下精确 MSE 最优的奇异值阈值化AI 解读

We derive a formula for optimal hard thresholding of the singular value decomposition in the presence of correlated additive noise; although it nominally involves unobservables, we show how to apply it even where the noise covariance structure is not a priori known or is not independently estimable. The proposed method, which we call ScreeNOT, is a mathematically solid alternative to Cattell’s ever-popular but vague scree plot heuristic from 1966. ScreeNOT has a surprising…

聚类稳健推断：实证实践指南AI 解读

Methods for cluster-robust inference are routinely used in economics and many other disciplines. However, it is only recently that theoretical foundations for the use of these methods in many empirically relevant situations have been developed. In this paper, we use these theoretical results to provide a guide to empirical practice. We do not attempt to present a comprehensive survey of the (very large) literature. Instead, we bridge theory and practice by providing a…