Finite-Sample Risk Approximation and Risk-Consistent Tuning for Generalized Ridge Estimation in Nonlinear Models: Controlling Extreme Realizations
非线性模型中广义岭估计的有限样本风险近似与风险一致调参AI 解读 ↓
本页整理公开书目信息,不生成学术质量评分。AI 解读根据题名及所注明的摘要或原文片段生成,未完成全文核验,可能有误;具体假设、证明与结论请核对原文。摘要保留来源文本,未经模型改写。
DOI 首次登记不等于接收或发表日期。部分更正、评论等条目没有独立摘要;缺少可靠材料时保留待补状态。
本页为预印本版本;arXiv 收录、作者填写的期刊信息以及作者既有发表经历,都不单独证明本篇已接收。作者发表记录按 OpenAlex 身份与完整姓名、本站覆盖期刊 ISSN 及正式卷期核对,只展示已核实例,档案仍可能误合并。
引用量采用 OpenAlex 单条关联记录,不合计多个记录;关联记录可能包含正式发表版本,不等于此版本单独引用。缺失不视为零,引用指标不代表论文质量。
关注作者按书目中的完整姓名匹配,同名和姓名变体需人工辨别。相关论文先按共享细分方向和具体方法排列,再参考通用方法与发表日期。
AI 根据所提供的论文材料归类:核心贡献是一般非线性模型的正则化风险理论,倾向得分仅作为应用出现,不足以限定其所属细分。
非线性模型中广义岭估计的有限样本风险近似与风险一致调参AI 解读 ↓
正在核对关联版本…
正在核对对应版本的资源…
Maximum likelihood estimation in nonlinear models can exhibit substantial instability in finite samples when the data provide limited information about certain parameters. Such instability is driven by rare but extreme realizations of the estimator, which can dominate mean squared error (MSE) and lead to poor performance of conventional estimators. To address this issue, we consider ridge estimators that directly target MSE through regularization and thereby control extreme realizations. Developing this approach raises several challenges, including characterizing finite-sample MSE, selecting the penalty parameter, and achieving oracle risk performance. We address these challenges using a unified framework based on a finite-sample approximation to the MSE. Building on higher-order expansions, we derive an explicit first-order approximation to the finite-sample MSE of generalized ridge estimators in a broad class of nonlinear models. This approximation reveals an explicit bias--variance trade-off and shows that generalized ridge estimators can improve upon the MLE in terms of MSE at the first-order level, even under target misspecification. It also provides a tractable foundation for analyzing data-driven tuning, enabling us to show that the proposed MSE-based selection rule achieves oracle risk consistency. Simulation results demonstrate that the proposed method substantially reduces the frequency and impact of extreme realizations, leading to large improvements in finite-sample risk relative to both the maximum likelihood estimator and cross-validation-based methods. An empirical illustration shows that the proposed MSE-based tuning approach can stabilize first-stage propensity score estimation and reveal sensitivity in subsequent treatment effect estimates that remains hidden under conventional estimators.
广义线性模型中多层模型与固定效应方法的比较
We extend prior work comparing linear multilevel models (MLM) and fixed effect (FE) models to the generalized linear model (GLM) setting, where the coefficient on a treatment variable is of primary interest. This leads to three insights. (i) First, as in the linear setting, MLM can be thought of as a regularized form of FE (RegFE). This explains why group-level confounding can greatly bias MLM's treatment coefficient estimates. However, unlike the linear setting, there is…
暴露或结局罕见时哪种正则化倾向得分与双稳健方法校准最佳?基于代理混杂调整的plasmode研究
Purpose. Confounding adjustment in health-care database studies screens large proxy libraries where events per variable are low, straining standard propensity score (PS) methods, and many regularized variable-selection strategies exist (outcome-adaptive LASSO [OAL], group LASSO/GLiDeR, highly adaptive LASSO [HAL]). Yet few comparisons have varied exposure prevalence within such a selection menu, and none pairs it with doubly robust estimation, compute accounting, and a…
目标函数的目标化高度自适应Lasso最小损失估计
We propose a Targeted Highly Adaptive Lasso for estimation of non-pathwise differentiable functional parameters such as the dose-response curve (DRC) for continuous exposure. We assume the target function lies in the $k$-th order smoothness class used to define the $k$-th order Highly Adaptive Lasso (HAL), which can be well approximated by linear spans of $k$-th order spline basis functions. We construct a projection of the true target function onto a large finite…
具有优化与统计保证的因果加性模型凸混合整数规划
We study the problem of learning a directed acyclic graph from data generated according to an additive, non-linear structural equation model with Gaussian noise. We express each non-linear function through a basis expansion, and derive a maximum likelihood estimator with a group l0-regularization that penalizes the number of edges in the graph. The resulting estimator is formulated through a convex mixed-integer program, enabling the use of branch-and-bound methods to obtain…
TMLE 因果效应估计:缺失数据与近正值性违背
We evaluate the performance of targeted maximum likelihood estimation (TMLE) for estimating the average treatment effect in missing data scenarios under varying levels of positivity violations. We employ model- and design-based simulations, with the latter using undersmoothed highly adaptive lasso on the 'WASH Benefits Bangladesh' dataset to mimic real-world complexities. Five missingness-directed acyclic graphs are considered, capturing common missing data mechanisms in…
含交互固定效应的高维离散选择模型及其因果推断应用
ABSTRACT We propose a two‐step procedure to estimate a high dimensional discrete choice panel with interactive fixed effects where the initial and final estimators are obtained via a nuclear‐norm regularized (NNR) maximum likelihood estimation and post‐NNR iterated estimation, respectively. We apply the method to make counterfactual predictions of choice probabilities. Simulations demonstrate nice finite sample performance in estimation and tests. An illustrative application…