Offline Planning and Online Learning Under Recovering Rewards: the purely periodic policy of Algorithm 2 earns at least γ_K·UB_R[K]·T − O(N)Research Paper
In many recommendation and promotion settings the reward of showing an item depends on how long it has been since the item was last shown: a promoted product in a live-streaming session, a notification, a piece of content whose appeal recovers while it rests. Bandits with recovering rewards model this. Kleinberg and Immorlica (FOCS 2018) studied recharging…