A Modern Introduction to Online Learning X: The Weighted Average Algorithm with a Uniform Prior Has Regret (d/α)(1 + ln(T/d + 1)) on α-Exp-Concave LossesTextbook
Online prediction compares the losses of a sequence of decisions with the losses of one fixed decision chosen after the sequence is known. A learner would like a regret guarantee that remains valid for every such competitor, even when the losses arrive in an arbitrary order. Exponentially weighted averaging is a way to make each decision from all feasible…