论文检索

交叉验证后自助法选择高维 M 估计量的惩罚参数AI 解读

We develop a new method for selecting the penalty parameter for ℓ1-penalized M-estimators in high dimensions, which we refer to as bootstrapping after cross validation. We derive rates of convergence for the corresponding ℓ1-penalized M-estimator and also for the post-ℓ1-penalized M-estimator, which refits the nonzero entries of the former estimator without penalty in the criterion function. We demonstrate via simulations that our methods are not dominated by cross…

受配给约束的生育：子女数量—质量权衡中的处理效应异质性AI 解读

We develop a generalized theory of rationed fertility to analyze treatment effect heterogeneity in the child quantity-quality trade-off. An exogenous increase in fertility can be either desired or undesired. We derive a positive rationing income effect on child quality for desired fertility increases but a negative rationing income effect for undesired fertility increases. We propose an econometric framework to identify treatment effects of desired and undesired fertility…

函数值空间过程的谱密度估计AI 解读

The spectral density function describes the second-order properties of a stationary stochastic process on Rd. This paper considers the nonparametric estimation of the spectral density of a continuous-time stochastic process taking values in a separable Hilbert space. Our estimator is based on kernel smoothing and can be applied to a wide variety of spatial sampling schemes including those in which data are observed at irregular spatial locations. Thus, it finds immediate…

通过神经对抗不变性学习从异质环境中追寻因果关系AI 解读

Pursuing causality from data is a fundamental problem in scientific discovery, treatment intervention, and transfer learning. This paper introduces a novel algorithmic method for addressing nonparametric invariance and causality learning in regression models across multiple environments, where the joint distribution of response variables and covariates varies, but the conditional expectations of outcome given an unknown set of quasi-causal variables are invariant. The…

预印本版本摘要 · 查看来源

基于样本协方差矩阵的完全随机缺失检验AI 解读

We study the problem of testing whether the missing values of a potentially high-dimensional dataset are Missing Completely at Random (MCAR). We relax the problem of testing MCAR to the problem of testing the compatibility of a collection of covariance matrices, motivated by the fact that this procedure is feasible when the dimension grows with the sample size. Our first contributions are to define a natural measure of the incompatibility of a collection of correlation…

鞅的 Yurinskii 耦合AI 解读

Yurinskii’s coupling is a popular theoretical tool for nonasymptotic distributional analysis in mathematical statistics and applied probability, offering a Gaussian strong approximation with an explicit error bound under easily verifiable conditions. Originally stated in ℓ2-norm for sums of independent random vectors, it has recently been extended both to the ℓp-norm, for 1≤p≤∞, and to vector-valued martingales in ℓ2-norm, under some strong conditions. We present as our main…

It is well-known that trimmed sample means are robust against heavy tails and data contamination. This paper analyzes the performance of trimmed means and related methods in two novel contexts. The first one consists of estimating expectations of functions in a given family, with uniform error bounds; this is closely related to the problem of estimating the mean of a random vector under a general norm. The second problem considered is that of regression with quadratic loss.…

强化学习中稳健策略评估的在线估计与推断AI 解读

Reinforcement learning has emerged as one of the prominent topics attracting attention in modern statistical learning, with policy evaluation being a key component. Unlike the traditional machine learning literature on this topic, our work emphasizes statistical inference for the model parameters and value functions of reinforcement learning algorithms. While most existing analyses assume random rewards to follow standard distributions, we embrace the concept of robust…

离散观测数据的函数主成分分析理论AI 解读

Functional data analysis is an important research field in statistics which treats data as random functions drawn from some infinite-dimensional functional space, and functional principal component analysis (FPCA) based on eigen-decomposition plays a central role for data reduction and representation. After nearly three decades of research, there remains a key problem unsolved, namely, the perturbation analysis of covariance operator for diverging number of eigencomponents…

Plackett–Luce 模型中似然估计量的统一分析AI 解读

The Plackett–Luce model has been extensively used for rank aggregation in social choice theory. A central statistical question in this model concerns estimating the utility vector that governs the model’s likelihood. In this paper, we investigate the asymptotic theory of utility vector estimation by maximizing different types of likelihood, such as full, marginal, and quasi-likelihood. Starting from interpreting the estimating equations of these estimators to gain some…

对称性：非参数回归中的一般结构AI 解读

In this paper, we present the framework of symmetry in nonparametric regression. This generalises the framework of covariate sparsity, where the regression function f:[0,1]d→R depends only on at most s

高维广义线性模型的贝叶斯模型选择一致性进展AI 解读

Uncovering genuine relationships between a response variable and a large collection of covariates is a fundamental and practically important problem. In the context of Gaussian linear models, both the Bayesian and non-Bayesian literature is well-developed and there are no substantial differences in the model selection consistency results available from the two schools. For generalized linear models (GLMs), however, Bayesian model selection consistency results are lacking in…

分布式强化学习中的估计与统计推断AI 解读

In this paper, we study distributional reinforcement learning from the perspective of statistical efficiency. We investigate distributional policy evaluation, aiming to estimate the complete return distribution (denoted $η^π$) attained by a given policy $π$. We use the certainty-equivalence method to construct our estimator $\hatη^π$, given a generative model is available. In this circumstance we need a dataset of size $\widetilde O\left(\frac{|\mathcal{S}||\mathcal{A}|}{\varepsilon^{2p}(1-γ)^{2p+2}}\right)$…

矩阵情境在线决策中的统计推断AI 解读

The study of online decision-making problems that leverage contextual information has drawn notable attention due to their significant applications in fields ranging from healthcare to autonomous systems. In modern applications, contextual information can be rich and is often represented as a matrix. Moreover, while existing online decision algorithms mainly focus on reward maximization, less attention has been devoted to statistical inference. To address these gaps, in this…

任意元素依赖下的结构化矩阵学习与马尔可夫转移核估计AI 解读

The problem of structured matrix estimation has been studied mostly under strong noise dependence assumptions. This paper considers a general framework of noisy low-rank-plus-sparse matrix recovery, where the noise matrix may come from any joint distribution with arbitrary dependence across entries. We propose an incoherent-constrained least-square estimator and prove its tightness both in the sense of deterministic lower bound and matching minimax risks under various noise…

连锁不平衡评分回归及跨祖源扩展的高维统计推断AI 解读

Linkage disequilibrium score regression (LDSC) has emerged as an essential tool for genetic and genomic analyses of complex traits, utilizing high-dimensional data derived from genome-wide association studies (GWAS). LDSC computes the linkage disequilibrium (LD) scores using an external reference panel, and integrates the LD scores with only summary data from the original GWAS. In this paper, we investigate LDSC within a fixed-effect data integration framework, underscoring…

深层马蹄高斯过程AI 解读

Deep Gaussian processes have recently been proposed as natural objects to fit, similarly to deep neural networks, possibly complex features present in modern data samples, such as compositional structures. Adopting a Bayesian nonparametric approach, it is natural to use deep Gaussian processes as prior distributions, and use the corresponding posterior distributions for statistical inference. We introduce the deep Horseshoe Gaussian process Deep–HGP, a new simple prior based…

协变量依赖转移概率的隐马尔可夫状态下，混合模型的稳健性AI 解读

This article studies the robustness of quasi-maximum-likelihood estimation in hidden Markov models when the regime-switching structure is misspecified. Specifically, we examine the case where the data-generating process features a hidden Markov regime sequence with covariate-dependent transition probabilities, but estimation proceeds under a simplified mixture model that assumes regimes are independent and identically distributed. We show that the parameters governing the…

从模型选择到模型平均：嵌套线性模型的比较AI 解读

Model selection (MS) and model averaging (MA) are two popular approaches when many candidate models exist. Theoretically, the estimation risk of an oracle MA is not larger than that of an oracle MS because the former is more flexible, but a foundational issue is this: Does MA offer a substantial improvement over MS? Recently, seminal work by Peng and Yang (2022) has answered this question under nested models with linear orthonormal series expansion. In the current paper, we…

重复测量反卷积估计量的更快一致收敛率AI 解读

Recently, Kurisu and Otsu (2022b, Econometric Theory 38(1), 172–193) derived the uniform convergence rates for the nonparametric deconvolution estimators proposed by Li and Vuong (1998, Journal of Multivariate Analysis 65(2), 139–165). This article shows that faster uniform convergence rates can be established for their estimators under the same assumptions. In addition, a new class of deconvolution estimators based on a variant of Kotlarski’s identity is also proposed. It…

需求的实解析离散选择模型：理论与含义AI 解读

We demonstrate that a large class of discrete choice models of demand can be approximated by real analytic demand models. We obtain this result by combining (i) a novel real analytic property of the mixed logit and the mixed probit models with any distribution of random coefficients and (ii) an approximation property of finite mixtures of Gumbel and Gaussian distributions. To illustrate some of the implications of this result, we discuss how real analyticity facilitates…

有限重叠的检验AI 解读

Extreme propensity scores arise in observational studies when treated and control units have very different characteristics. This is commonly referred to as limited overlap . In this paper, we propose a formal statistical test that helps assess the degree of limited overlap. Rejecting the null hypothesis in our test indicates either no or very mild degree of limited overlap and hence reassures that standard treatment effect estimators will be well behaved. One distinguishing…

空间相关数据模型的Moran’s I lasso估计AI 解读

Summary This paper proposes a lasso-based estimator which uses information embedded in the Moran statistic to develop a selection procedure called Moran’s I lasso (Mi-lasso) to solve the eigenvector spatial filtering (ESF) eigenvector selection problem. ESF uses a subset of eigenvectors from a spatial weights matrix to efficiently account for any omitted spatially correlated terms in a classical linear regression framework, thus eliminating the need for the researcher to…

半参数模型中的交叉拟合经验似然AI 解读

Summary We propose a new cross-fitted empirical likelihood (CFEL) inference procedure for low-dimensional parameters in the presence of complex, infinite dimensional nuisance parameters that may be estimated by modern machine-learning methods. Relying on the Neyman orthogonal moment condition and cross-fitting as a sample-splitting procedure, we show that our CFEL statistic is asymptotically pivotal under weak conditions often invoked in Wald-type approaches. Three examples…