Contextual Bandits with Cross-Learning: UCB1.CL Has Expected Regret O(Kκ̄ log T/Δ*) and O(√(κ̄KT log T)) with Stochastic Rewards and Adversarial ContextsResearch Paper
In a contextual bandit a learner plays rounds; in round it observes a context , pulls one of arms and receives the reward of that arm in that context. In many applications the learner also learns what the pulled arm would have paid in other contexts. The motivating example of Balseiro, Golrezaei, Mahdian, Mirrokni and Schneider (arXiv:1809.09582)…