Theorem 37.14: lower bound for easy games
ProvedBanditAlgorithm.partial_monitoring_easy_sqrt_lower_boundbandit-algorithmslower-boundminimax-regretpartial-monitoring
Let be a finite locally observable partial-monitoring game with a finite discrete signal alphabet and at least one pair of neighbouring actions. Then there are a game-dependent constant and a horizon such that
This is the lower half of the easy-game classification. It is obtained by testing two nearby stochastic environments on opposite sides of a neighbouring cell boundary.
Formalization Note The source says “for all large enough ”; the existential threshold makes that quantifier explicit.
Preamble
import Definitions.Def_PartialMonitoringGame import Mathlib.Data.Real.Sqrt open MeasureTheory ProbabilityTheory
Formal statement
theorem BanditAlgorithm.partial_monitoring_easy_sqrt_lower_bound
{k d : ℕ} {𝕊 : Type*}
[Fintype 𝕊] [MeasurableSpace 𝕊] [MeasurableSingletonClass 𝕊]
(G : PartialMonitoringGame k d 𝕊)
(h : LocallyObservable G ∧ HasNeighbouringActions G) :
∃ c : ℝ, 0 < c ∧ ∃ N : ℕ, ∀ n : ℕ, N ≤ n →
c * Real.sqrt n ≤ pmMinimaxRegret G n := by
sorrySource
Tor Lattimore and Csaba Szepesvári, Bandit Algorithms, Chapter 37, Section 37.4, Theorem 37.14 and proof sketch, printed p. 492 (PDF p. 500), https://tor-lattimore.com/downloads/book/book.pdf