Bootstrapping Lasso Estimators

In this article, we consider bootstrapping the Lasso estimator of the regression parameter in a multiple linear regression model. It is known that the standard bootstrap method fails to be consistent. Here, we propose a modified bootstrap method, and show that it provides valid approximation to the distribution of the Lasso estimator, for all possible values of the unknown regression parameter vector, including the case where some of the components are zero. Further, we establish consistency of the modified bootstrap method for estimating the asymptotic bias and variance of the Lasso estimator. We also show that the residual bootstrap can be used to consistently estimate the distribution and variance of the adaptive Lasso estimator. Using the former result, we formulate a novel data-based method for choosing the optimal penalizing parameter for the Lasso using the modified bootstrap. A numerical study is performed to investigate the finite sample performance of the modified bootstrap. The methodology proposed in the article is illustrated with a real data example.

摘要来源：OpenAlex 索引摘要（稿件版本未注明）

笔记与分组

同方向的基础文献

相关领域论文

共同方法：高维与机器学习、检验与推断、一般估计、正则化与变量选择、Bootstrap 与重抽样

A unified spectral analysis of high-dimensional linear regression: debiasing and thresholding

Ying-Ao Wang · Yunyi Zhang · Ye Zhang首次提交 2025-02-24 · 修订 2026-10-12 · v3arXiv预印本

高维线性回归的统一谱分析：去偏与阈值化AI 解读

We use spectral analysis to establish a unified theory of debiasing, thresholding, and simultaneous inference for high-dimensional linear regression with ill-conditioned designs. The methods include Ridge regression, spectral cut-off, and iterative and dynamical regression procedures. A common debiasing procedure uses two applications of the original linear algorithm with fixed parameters. Spectral analysis shows that debiasing squares the residual, while implementations…

正则化与变量选择 GMM 与矩条件 Bootstrap 与重抽样

被引：暂无数据

AI 解读阅读原文 ↗BibTeX ↓

共同方法：高维与机器学习、检验与推断、一般估计、正则化与变量选择、Bootstrap 与重抽样

Fridge: focused fine-tuning of ridge regression for personalize predictions

Kristoffer Herland Hellton · Nils Lid Hjort首次提交 2026-10-06 · 修订 2026-10-06 · v1arXiv预印本

Fridge：面向个体预测的岭回归聚焦调参AI 解读

Statistical prediction methods typically require some form of fine-tuning of tuning parameter(s), with $K$-fold cross-validation as the canonical procedure. For ridge regression there exist numerous procedures, but common for all, including cross-validation, is that one single parameter is chosen for all future predictions. We propose instead to calculate a unique tuning parameter for each individual for which we wish to predict an outcome. This generates an individualized…

正则化与变量选择 Bootstrap 与重抽样

被引：暂无数据

AI 解读阅读原文 ↗BibTeX ↓

共同方法：高维与机器学习、检验与推断、一般估计、正则化与变量选择、Bootstrap 与重抽样

Debiased and Simultaneous Inference for Heterogeneous Factorial Effect Modifiers via Residualized Walsh-Hadamard Scores

Tomoshige Nakamura · Ryo Emoto首次提交 2026-09-29 · 修订 2026-09-29 · v1arXiv预印本

基于残差化 Walsh–Hadamard 得分的异质析因效应修饰因子去偏与同时推断AI 解读

In factorial randomized experiments with $K$ binary treatment components, we study which baseline covariates modify component main effects and interactions. We define effect-modifier cells $(j,S)$, $j\in[p]$ and $\emptyset\neq S\subseteq[K]$, through the coefficients $θ^\ast_{jS}$ of population linear projections of conditional Walsh--Hadamard contrasts $τ_{S}$ onto standardized covariates. Using baseline-robust direct scores, we develop frequentist inference for all $p(2^K-1)$…

微观 · 因果推断多重检验与同时推断正则化与变量选择

关联记录被引 0 次 ↗OpenAlex · 核验 2026-10-08

AI 解读阅读原文 ↗BibTeX ↓

共同方法：高维与机器学习、检验与推断、一般估计、正则化与变量选择、Bootstrap 与重抽样

BRP-GABLE: An Interpretable Rule-Based Prediction Framework for Multiple Outcome Types

Yulong Li · Ke Wan · Toshio Shimokawa · Kensuke Tanioka首次提交 2026-09-29 · 修订 2026-09-29 · v1arXiv预印本

BRP-GABLE：适用于多种结果类型的可解释规则预测框架AI 解读

Interpretable prediction models are important in biomedical research, where predictive accuracy must often be balanced against the ability to examine predictor-outcome relationships. Automatic Binary Logistic Estimation (ABLE) provides interpretable rule-based representations by constructing additive models using threshold rules. However, the original method is restricted to binary outcomes, and its greedy forward construction follows a search path, making candidate rules…

预测与混频正则化与变量选择 Bootstrap 与重抽样

关联记录被引 0 次 ↗OpenAlex · 核验 2026-10-08

AI 解读阅读原文 ↗BibTeX ↓

共同方法：高维与机器学习、检验与推断、一般估计、正则化与变量选择、Bootstrap 与重抽样

A Dimension-Agnostic Bootstrap Anderson-Rubin Test For Instrumental Variable Regressions

Dennis Lim · Wenjie Wang · Yichong Zhang首次提交 2024-12-02 · 修订 2026-09-29 · v3arXiv预印本

工具变量回归中维度自适应的自助法 Anderson–Rubin 检验AI 解读

Weak-identification-robust tests for instrumental variable (IV) regressions are typically developed separately depending on whether the number of IVs is treated as fixed or increasing with the sample size, forcing researchers to make a stance on the asymptotic behavior, which is often ambiguous in practice. This paper proposes a bootstrap-based, dimension-agnostic Anderson-Rubin (AR) test that achieves correct asymptotic size regardless of whether the number of IVs is fixed…

工具变量 Bootstrap 与重抽样正则化与变量选择

关联记录被引 1 次 ↗OpenAlex · 核验 2026-09-30

AI 解读阅读原文 ↗BibTeX ↓

共同方法：高维与机器学习、检验与推断、一般估计、正则化与变量选择、Bootstrap 与重抽样

Data-Driven Tuning in Kernel Specification Tests: Selection Asymptotics, Validity, and Power

Yuhao Li首次提交 2025-05-02 · 修订 2026-09-28 · v2arXiv预印本

核设定检验的数据驱动调参：选择渐近理论、有效性与功效AI 解读

We develop model checks for conditional moment restrictions whose tuning parameters, the kernel bandwidth and the regularization level, are selected by cross-validation. The tests regress the estimated residuals on the covariates via kernel ridge regression (KRR), yielding a coefficient function in a reproducing kernel Hilbert space (RKHS) that vanishes under the null and is nonzero for any misspecification not annihilated by the Neyman projection. Our central contribution…

核、筛与局部多项式正则化与变量选择 GMM 与矩条件

关联记录被引 0 次 ↗OpenAlex · 核验 2026-09-30

AI 解读阅读原文 ↗BibTeX ↓