High-Dimensional Statistics XII: An Oracle Inequality for Nonparametric Least SquaresTextbook
Regression is usually taught with a fixed parametric model: linear regression fits a -dimensional coefficient vector, and the estimation error is controlled by . Many regression problems in practice have no such finite-dimensional description — the regressor is only known to be, say, convex, monotone, or smooth, and the estimator is a least-squares fit…