Geometric alternatives imply a square-root partial-monitoring lower bound
ProvedBanditAlgorithm.partial_monitoring_sqrt_lower_of_geometric_alternativesbanditsinformation-theorylower-boundpartial-monitoring
Suppose a finite partial-monitoring game has a neighbouring pair admitting symmetric outcome perturbations of size : each perturbation stays in the corresponding endpoint cell, outside-neighbourhood actions retain a uniform positive gap, and the two endpoint-relative gaps of every neighbourhood action sum to . Then there are constants and such that for all ,
The proof bounds every one-step signal KL divergence by , hence the full-history KL by , and chooses proportional to in the two-environment testing inequality.
Formalization Note The conclusion is independent of observability; observability is used elsewhere only to classify which upper bound also holds.
Preamble
import Definitions.Def_PartialMonitoringGame open MeasureTheory ProbabilityTheory
Formal statement
theorem BanditAlgorithm.partial_monitoring_sqrt_lower_of_geometric_alternatives
{k d : ℕ} {𝕊 : Type*} [Fintype 𝕊] [MeasurableSpace 𝕊] [DecidableEq 𝕊]
(G : PartialMonitoringGame k d 𝕊)
(hgeom : ∃ a b : Fin k, ∃ u q : Fin d → ℝ, ∃ ε δ : ℝ,
NeighbouringActions G a b ∧ 0 < ε ∧ 0 < δ ∧
(∑ i, q i) = 0 ∧
(∑ i, (G.L a i - G.L b i) * q i) = 1 ∧
∀ Δ : ℝ, 0 < Δ → Δ ≤ δ →
let ua := fun i ↦ u i - Δ * q i
let ub := fun i ↦ u i + Δ * q i
ua ∈ pmCell G a ∧ ub ∈ pmCell G b ∧
(∀ c : Fin k, c ∉ pmNeighbourhood G a b →
ε / 2 ≤ ∑ i, (G.L c i - G.L a i) * ua i ∧
ε / 2 ≤ ∑ i, (G.L c i - G.L b i) * ub i) ∧
(∀ c : Fin k, c ∈ pmNeighbourhood G a b →
(∑ i, (G.L c i - G.L a i) * ua i) +
(∑ i, (G.L c i - G.L b i) * ub i) = Δ)) :
∃ c : ℝ, 0 < c ∧ ∃ N : ℕ, ∀ n : ℕ, N ≤ n →
c * Real.sqrt n ≤ pmMinimaxRegret G n := by
sorrySource
Lattimore and Szepesvári, Bandit Algorithms (2020), Theorem 37.14 proof sketch, printed p. 492 (PDF p. 500), using the testing argument of Theorem 37.12, Eqs. (37.8)–(37.10); https://tor-lattimore.com/downloads/book/book.pdf