Theorems 37.15–37.16: upper bound for hard games
ProvedBanditAlgorithm.partial_monitoring_hard_rpow_two_thirds_upper_bound_discrete_signalsbandit-algorithmsminimax-regretpartial-monitoringupper-bound
Let be a finite globally observable but not locally observable partial-monitoring game with a finite discrete signal alphabet. Then there are a game-dependent constant and a horizon such that
This is the upper half of the hard-game classification. Algorithm 26 and the global-observability estimate for its exploration–stability objective yield an explicit bound, whose fixed-game factors are absorbed into .
Formalization Note Lean writes the fractional power as Real.rpow, denoted by ^ with a real exponent in the displayed formal statement.
Preamble
import Definitions.Def_PartialMonitoringGame import Mathlib.Analysis.SpecialFunctions.Pow.Real open MeasureTheory ProbabilityTheory
Formal statement
theorem BanditAlgorithm.partial_monitoring_hard_rpow_two_thirds_upper_bound_discrete_signals
{k d : ℕ} {𝕊 : Type*}
[Fintype 𝕊] [MeasurableSpace 𝕊] [MeasurableSingletonClass 𝕊]
(G : PartialMonitoringGame k d 𝕊)
(h : GloballyObservable G ∧ ¬ LocallyObservable G) :
∃ C : ℝ, 0 < C ∧ ∃ N : ℕ, ∀ n : ℕ, N ≤ n →
pmMinimaxRegret G n ≤ C * (n : ℝ) ^ ((2 : ℝ) / 3) := by
sorrySource
Tor Lattimore and Csaba Szepesvári, Bandit Algorithms, Chapter 37, Theorem 37.15 and Algorithm 26 on printed pp. 494–495, Theorem 37.16 and its proof on printed pp. 496–498, and Section 37.8 on printed p. 503 (PDF pp. 502–511), https://tor-lattimore.com/downloads/book/book.pdf