Subset Selection with Shrinkage: Sparse Linear Modeling When the SNR Is Low II: Four Gaussian Noise Events Behind the Error Bounds Hold with High ProbabilityResearch Paper
Best subset selection fits a linear model using at most of candidate predictors. When the noise level is high relative to the signal, it overfits. Mazumder, Radchenko and Dedieu (arXiv:1708.03288v4; Operations Research, 2023) add a shrinkage penalty , , to the best-subsets problem and prove oracle inequalities for the…