Foundations of Reinforcement Learning VIII: Exponential Weights Has Regret for Bounded Losses and for Square and Log LossTextbook
Foster and Rakhlin's lecture notes Foundations of Reinforcement Learning and Interactive Decision Making build their theory of decision making on one recurring device: an estimator that keeps small error on any sequence of data, used as a subroutine by an algorithm that chooses decisions. That device is online learning, and the basic algorithm for it is Expo…