Locally observable regret upper bound for discrete signals
ProvedBanditAlgorithm.partial_monitoring_locally_observable_upper_bound_discrete_signalsbandit-algorithmsonline-learningpartial-monitoring
Let G be a locally observable finite partial-monitoring game with at least two actions, discrete finite signals, and losses in [0,1]. Then there is a constant C>0 such that for every horizon n,
The discrete-signal measurability hypothesis makes the history-dependent Algorithm 26 policy measurable. This is the unit-loss upper-bound component used in the easy regime of the classification theorem.
Preamble
import Definitions.Def_PartialMonitoringGame import Mathlib.Analysis.SpecialFunctions.Pow.Real import Mathlib.Data.Real.Sqrt open MeasureTheory ProbabilityTheory
Formal statement
theorem BanditAlgorithm.partial_monitoring_locally_observable_upper_bound_discrete_signals
{k d : ℕ} {𝕊 : Type*} [Fintype 𝕊] [MeasurableSpace 𝕊]
[MeasurableSingletonClass 𝕊]
(G : PartialMonitoringGame k d 𝕊) (hk : 2 ≤ k)
(hL : ∀ a i, G.L a i ∈ Set.Icc (0 : ℝ) 1)
(hloc : LocallyObservable G) :
∃ C : ℝ, 0 < C ∧ ∀ n : ℕ,
pmMinimaxRegret G n ≤
C * max 1 (pmLocObsConst G) * (k : ℝ) ^ ((3 : ℝ) / 2) *
Real.sqrt (n * Real.log k) := by
sorrySource
Tor Lattimore and Csaba Szepesvári, Bandit Algorithms, Chapter 37, Theorems 37.15 and 37.17, printed pp. 494--502, https://tor-lattimore.com/downloads/book/book.pdf