Linearly Parameterized Bandits 4: For Finitely Many Arms, the Uncertainty Ellipsoid Policy Has Regret at Most a₆|U|‖z‖ + a₇|U| Σᵤ min{log T/Δᵘ(z), TΔᵘ(z)}Research Paper
In a linearly parameterized bandit, the expected rewards of many arms are driven by a small number of unknown parameters. Each arm is a vector , and its expected reward is the inner product with an unknown parameter vector . Problems of this kind arise in marketing and revenue management, where each product is described by features…