Online Learning and Online Convex Optimization 5: Online-to-Batch Conversion Bounds the Excess Risk by the Expected Average RegretResearch Paper
Online learning and stochastic learning ask different questions. An online learner faces an arbitrary sequence of loss functions and is judged by its regret: the excess of its cumulative loss over that of the best fixed hypothesis in hindsight. A stochastic learner receives independent samples from an unknown distribution and is judged by the risk of a…