Theorems 37.15–37.17: upper bound for easy games
ProvedBanditAlgorithm.partial_monitoring_easy_sqrt_upper_bound_discrete_signalsbandit-algorithmsminimax-regretpartial-monitoringupper-bound
Let be a finite locally observable partial-monitoring game with a finite discrete signal alphabet and at least one pair of neighbouring actions. Then there are a game-dependent constant and a horizon such that
This is the upper half of the easy-game classification. Algorithm 26 combines exponential weights with local loss-difference estimators; its factors depending on the fixed game, including , , and , are absorbed into .
Formalization Note Arbitrary finite real loss matrices are reduced to the source’s normalization by an affine rescaling, which preserves observability and rescales minimax regret.
Preamble
import Definitions.Def_PartialMonitoringGame import Mathlib.Data.Real.Sqrt open MeasureTheory ProbabilityTheory
Formal statement
theorem BanditAlgorithm.partial_monitoring_easy_sqrt_upper_bound_discrete_signals
{k d : ℕ} {𝕊 : Type*}
[Fintype 𝕊] [MeasurableSpace 𝕊] [MeasurableSingletonClass 𝕊]
(G : PartialMonitoringGame k d 𝕊)
(h : LocallyObservable G ∧ HasNeighbouringActions G) :
∃ C : ℝ, 0 < C ∧ ∃ N : ℕ, ∀ n : ℕ, N ≤ n →
pmMinimaxRegret G n ≤ C * Real.sqrt n := by
sorrySource
Tor Lattimore and Csaba Szepesvári, Bandit Algorithms, Chapter 37, Theorem 37.15 and Algorithm 26 on printed pp. 494–495, Theorem 37.17 on printed pp. 496 and 502, and the classification assembly in Section 37.8 on printed p. 503 (PDF pp. 502–511), https://tor-lattimore.com/downloads/book/book.pdf