Bandit Algorithms IX: Self-Normalized Concentration and Optimal DesignTextbook
Least-squares estimation from adaptively collected data is the statistical heart of linear bandits: the actions depend on past noise, so classical fixed-design theory does not apply. Chapter 20 of Lattimore–Szepesvári resolves this with the method of mixtures: the process is a…