Theorem 37.22: zero regret without neighbouring actions
ProvedBanditAlgorithm.partial_monitoring_trivial_zero_regretbandit-algorithmsminimax-regretpartial-monitoring
Let be a finite adversarial partial-monitoring game with a finite discrete signal alphabet. If has no pair of neighbouring actions, then its minimax regret vanishes at every horizon:
This is the trivial branch of the classification theorem. Geometrically, the absence of neighbouring cells forces one action to be optimal throughout the outcome simplex, so the constant policy playing that action incurs no regret.
Formalization Note The discrete-signal instance matches the finite signal alphabet in the source and makes arbitrary history-dependent policies measurable.
Preamble
import Definitions.Def_PartialMonitoringGame open MeasureTheory ProbabilityTheory
Formal statement
theorem BanditAlgorithm.partial_monitoring_trivial_zero_regret
{k d : ℕ} {𝕊 : Type*}
[Fintype 𝕊] [MeasurableSpace 𝕊] [MeasurableSingletonClass 𝕊]
(G : PartialMonitoringGame k d 𝕊)
(h : ¬ HasNeighbouringActions G) :
∀ n : ℕ, pmMinimaxRegret G n = 0 := by
sorrySource
Tor Lattimore and Csaba Szepesvári, Bandit Algorithms, Chapter 37, Section 37.8, Theorem 37.22 and its proof, printed p. 503 (PDF p. 511), https://tor-lattimore.com/downloads/book/book.pdf