Selecting Penalty Parameters of High-Dimensional M-Estimators Using Bootstrapping after Cross Validation
We develop a new method for selecting the penalty parameter for ℓ1-penalized M-estimators in high dimensions, which we refer to as bootstrapping after cross validation. We derive rates of convergence for the corresponding ℓ1-penalized M-estimator and also for the post-ℓ1-penalized M-estimator, which refits the nonzero entries of the former estimator without penalty in the criterion function. We demonstrate via simulations that our methods are not dominated by cross…