论文检索

利用稀疏性平滑重参数化实现高维M估计的预言性质AI 解读

This paper establishes a unified non-linear regularization framework for high-dimensional $M$-estimation, encompassing both linear models and Cox's proportional hazards models. Rather than relying on traditional additive non-convex penalties, the proposed paradigm embeds sparsity directly into the transformation for the physical parameter $θ=φ(β)$ using a smooth ($C^2$) component-wise "ReParametrization map for Sparsity (RePS)" $φ$, and the penalty term is $λ\Vert β\Vert_1$ r…

不可识别与依赖情形下的一致阶数选择AI 解读

We provide sufficient conditions for the consistency of penalized least squares procedures that select the order (dimension) of a regression model from a sequence of nested classes, allowing for dependent, martingale-difference errors. The main contribution is to relax the classical identifiability requirement: parameters indexing classes larger than the true order need not be identified, provided the additional, excess directions admit a linear approximation to the truth in…

向量值分布强化学习的策略评估：希尔伯特空间嵌入方法AI 解读

We propose Kernel Embedding Distributional Reinforcement Learning (KE-DRL) an offline method to estimate kernel mean embeddings of conditional multivariate return distributions from observed offline trajectories with continuous state-action inputs and vector-valued rewards. KE-DRL approximates the conditional embedding and estimates its a finite-dictionary representation coefficients through a maximum mean discrepancy Bellman criterion. For a regular class of return…

基于大语言模型文本测量的再犯预测、同伴效应估计与预测辅助推断AI 解读

We provide a new framework for estimating peer effects when outcomes are multivariate behavioral measures derived from written text using an LLM and the network formation is endogenous. We obtain LLM embeddings and zero shot classification of more than 200,000 written exchanges among residents of low-security correctional facilities. We find that LLM embeddings improve out-of-sample recidivism prediction by up to 30% over pre-entry covariates alone using LASSO and LoRA…

超高维回归中最大检验校准的 Stein 收缩与诚实子模型选择AI 解读

Classical preliminary-test and Stein-type estimators interpolate between restricted and full regression fits, but OLS and chi-squared calibration fail when $p\gg n$ and the restriction is data-adaptive. We propose an honest sample-separated framework built around a common selected-null law. Independent selection data extend a mandatory core; separate estimation data pair a complete-design regularized full-model (FM) fit with a fresh exact-null submodel refit. A maximum…

通过条件中心化进行非线性 Granger 因果的 RKHS 推断AI 解读

Granger causality is commonly formulated through linear prediction in vector autoregressive models, limiting its ability to detect nonlinear predictive relationships. We propose a reproducing kernel Hilbert space (RKHS)-based test for nonlinear Granger non-causality in conditional mean for nonlinear autoregressive processes. The key idea is a conditional-centering decomposition of the target regression function into an own-history component and an orthogonal component…

众数估计的变分框架AI 解读

Multivariate mode estimation arises in many statistical problems such as inverse problems, multimodal sampling, and density-based clustering, but becomes challenging in moderate to high dimensions, especially when the underlying density is not directly evaluable. We introduce GERVE (Gibbs-measure Entropy-Regularized Variational Estimation), a sample-based method for estimating multivariate modes by approximating Gibbs distributions directly from samples, without estimating…

异常值污染下的稳健双重正则化变量选择AI 解读

Real data often contain unusual observations that can exert disproportionate effects on variable selection, especially in complex predictor settings. We propose a two-stage {\it sparse median outer product of gradients (smOPG)} method for variable selection in single index models with outlier contamination. We first estimate sparse local gradients via \(\ell_1\)-penalized local median regression and then recover the active predictor set from a rank-one sparse approximation…

连接局部与总体因果效应：近端工具变量方法AI 解读

Instrumental variable (IV) methods address treatment endogeneity, but with non-compliance and heterogeneous treatment effects a binary instrument generally identifies the local average treatment effect (LATE) among compliers rather than the population average treatment effect (ATE). When treatment effects and compliance probabilities are heterogeneous and dependent through latent factors, the ATE need not be identified by IV variation alone. We develop a proximal…

目标函数平衡：利用策略性不平衡估计因果效应AI 解读

When estimating the average treatment effect of a binary intervention with weights, investigators are often burdened with how best to leave imbalance in the distributions of observed covariates. This requires that investigators proceed cautiously, as imbalance in key (nonlinear transformations of) covariates potentially introduces bias into the ultimate estimated effect. This paper introduces Targeted Function Balancing (TFB), a flexible covariate balancing weights approach…

广义线性模型中多层模型与固定效应方法的比较AI 解读

We extend prior work comparing linear multilevel models (MLM) and fixed effect (FE) models to the generalized linear model (GLM) setting, where the coefficient on a treatment variable is of primary interest. This leads to three insights. (i) First, as in the linear setting, MLM can be thought of as a regularized form of FE (RegFE). This explains why group-level confounding can greatly bias MLM's treatment coefficient estimates. However, unlike the linear setting, there is…

随机特征方法与神经网络的平滑差异原则AI 解读

We study data-driven early stopping for spectral regularisation methods in the classical non-parametric regression setting. Building on the discrepancy principle, we propose a multi-scale stopping rule that applies to general kernel estimators and show that, unlike previous approaches, it achieves full adaptivity over all smoothness levels in the well-specified case. A key contribution of our work is an extension based on random feature approximations, which reduces…

Lévy 噪声下广义朗之万方程的历史条件化记忆与随机驱动推断AI 解读

We consider the identification of memory and stochastic forcing in a one-dimensional generalized Langevin equation with state-dependent Brownian noise and optional additive symmetric $α$-stable jumps. A finite-dimensional Markov embedding provides Kramers--Moyal conditional moment relations that separate memory drift, Brownian diffusion, and jump contributions. From increment ensembles conditioned on the observed velocity history, truncated statistics estimate the stable…

大规模数据变量选择的贝叶斯双向拆分框架AI 解读

Modern tabular datasets are becoming increasingly large, both in the number of samples and covariates, posing significant challenges for Bayesian variable selection due to the resulting computational burden. While there is extensive literature on scaling Bayesian inference to large numbers of observations or high-dimensional covariate spaces, comparatively little work addresses scalable Bayesian variable selection when both dimensions are large simultaneously in a practical…

高维聚类数据中的估计目标偏移与合成近似AI 解读

In high-dimensional clustered data, covariates whose distributions differ across clusters can act as proxies for unobserved cluster effects. We show that the marginal-model LASSO implicitly uses sparse combinations of such covariates to shift the estimation target from structural coefficients to a contaminated vector, which inflates false selections. We therefore propose the Synthetic Heterogeneous-Effects LASSO (SHEL), which augments the regression design with separately…

向量值核岭回归的稳健误差界AI 解读

While kernel-based learning methods for scalar-valued functions have been extensively studied, comparatively little work considers nonlinear vector-valued operators. Such operators with vector-valued outputs, e.g., state vectors and trajectories, commonly arise in system identification problems. In this paper, we study the problem of learning a vector-valued operator under the framework of vector-valued kernel ridge regression. We assume that the outputs take values in an…

审查员工具变量设计的局部稳健半参数方法AI 解读

I propose a locally robust semiparametric framework for estimating causal effects using examiner IV designs when adjustment for many or continuous covariates makes saturation infeasible or produces sparse cells. The key ingredient of this approach is an orthogonal moment function that removes the first-order effect of estimation errors in the two treatment regressions defining the examiner IV. I derive the orthogonal moment function and show that it remains valid under…

带工具变量的收缩贝叶斯因果森林AI 解读

Discovering interpretable subgroups whose complier effects deviate from the average is a central goal of instrumental variable analysis under imperfect compliance, yet existing tree-based methods degrade when most covariates are irrelevant to the effect. We propose Shrinkage Bayesian Causal Forest with Instrumental Variable (SBCF-IV) for discovering and estimating subgroups with heterogeneous Complier Average Causal Effects (CACE) in sparse high-dimensional settings. SBCF-IV…

通过惩罚成对加速失效时间模型选择传染病传播变量AI 解读

In infectious disease transmission, regression and variable selection for time-to-event outcomes are complicated by transmission-induced dependence that violates standard independence assumptions. Pairwise survival analysis addresses this dependence by modeling contact intervals in ordered pairs, defined as the time from the onset of infectiousness in the pair's first individual to their first infectious contact with the second individual. We propose a penalized pairwise…

正则化似然反卷积与后验密度重构AI 解读

Density deconvolution is an ill-posed inverse problem because recovering the latent density amplifies high-frequency variation in the observed data. We propose a two-stage likelihood procedure. The first estimator maximizes the convolution likelihood over a regularized Gaussian-mixture sieve; the second treats this fit as an empirical prior and averages the fitted conditional latent densities. Under fixed-model misspecification, the estimators generally have different…

通过汤普森采样实现探索驱动的迭代稀疏半定规划聚类AI 解读

High-dimensional sparse clustering is a challenging combinatorial problem due to the tight coupling between cluster assignment and variable selection. We demonstrate that semidefinite programming (SDP) relaxation of K-means is robust to variable over-selection by establishing minimax separation bounds. Leveraging this robustness, we offer a twist on the recent trend of using exogenous randomness to evaluate feature importance and control false discovery by partially shifting…

用于因果推断与模型发现的连续时间集合 Kalman–Bucy 平滑器AI 解读

Data assimilation (DA) integrates observational information with model predictions to improve state estimation in complex systems. While filtering provides the basis for online forecasts by using only past and present observations, it can exhibit delays and biases when the underlying dynamics evolve rapidly or undergo regime transitions. Smoothing, which additionally incorporates future observations, provides a natural pipeline for hindcasting and reanalysis that yields an…

变量投影稀疏函数主成分分析：可解释降维及拉曼光谱应用AI 解读

Functional principal component analysis (FPCA) provides low-rank representations of functional data but generally produces dense components, making it difficult to identify the localised regions contributing to dominant modes of variation. This limitation is particularly relevant in Raman spectroscopy, where spectra are observed over an ordered domain and interpretation often focuses on chemically meaningful spectral regions. This study proposes variable-projection sparse…

下尾Spearman相关曲线的Bernstein平滑估计与自助推断AI 解读

This paper studies a Bernstein-smoothed plug-in estimator for the lower-tail Spearman's rho curve, a rank-based measure of local concordance defined through a normalized copula integral over the lower-left square $[0,p]^2$. The estimator applies the lower-tail Spearman functional to the empirical Bernstein copula and introduces a degree parameter that controls finite-sample regularization. The contribution is target-specific estimation and inference for the lower-tail…