Globally observable unit-loss games have minimax regret
ProvedBanditAlgorithm.partial_monitoring_globally_observable_unit_hard_upperbandit-algorithmspartial-monitoring
For a finite partial-monitoring game whose losses lie in , assume there are at least two actions and at least one outcome. If every loss-difference vector is globally observable, then there is a constant such that, for every horizon , the minimax regret is at most .
Preamble
import Theorems.Thm_BanditAlgorithm_partial_monitoring_globally_observable_bounded_vector_estimator import Theorems.Thm_BanditAlgorithm_partial_monitoring_algorithm26_master_bound import Theorems.Thm_BanditAlgorithm_pmPsi_le_quadratic import Theorems.Thm_BanditAlgorithm_pmMinimaxRegret_le_policy_of_unit_losses import Mathlib.Analysis.SpecialFunctions.Pow.Real import Mathlib.Data.Real.Sqrt set_option autoImplicit false open MeasureTheory ProbabilityTheory open scoped BigOperators namespace BanditAlgorithm
Formal statement
theorem partial_monitoring_globally_observable_unit_hard_upper
{k d : ℕ} {𝕊 : Type*}
[Fintype 𝕊] [MeasurableSpace 𝕊] [MeasurableSingletonClass 𝕊]
(G : PartialMonitoringGame k d 𝕊) (hk : 2 ≤ k) (hd : 0 < d)
(hL : ∀ a i, G.L a i ∈ Set.Icc (0 : ℝ) 1)
(hglo : GloballyObservable G) :
∃ C : ℝ, 0 < C ∧ ∀ n : ℕ, 1 ≤ n →
pmMinimaxRegret G n ≤ C * (n : ℝ) ^ ((2 : ℝ) / 3) := by sorrySource
Lattimore and Szepesvári, Bandit Algorithms, Cambridge University Press (2020), Chapter 37: Lemma 37.7 (p. 484), estimator identity (37.3) (p. 486), and proof of Theorem 37.16 (pp. 497–498). https://tor-lattimore.com/downloads/book/book.pdf