Consistent Nonparametric Regression II: Nearest-Neighbor Weights with Vanishing Coefficients Are Consistent for Every Distribution of X (Theorem 2)Research Paper
Nonparametric regression estimates the regression function from i.i.d. observations without assuming a parametric form. The simplest such estimates are local averages: to predict at a point , average the responses of the sample points closest to . Nearest neighbor rules of this kind go back to…