A neighbouring cell pair has a normalized transverse direction
ProvedBanditAlgorithm.partial_monitoring_neighbour_transverse_directionbanditsconvex-geometrylinear-algebrapartial-monitoring
For every neighbouring pair of actions in a finite partial-monitoring game, there is a tangent direction to the outcome simplex such that
The zero-sum condition preserves total probability under small perturbations, while the normalization makes the relative loss of the two actions change at unit speed. This is the elementary transverse direction used in two-environment lower bounds.
Formalization Note Neighbourhood excludes duplicate loss rows: otherwise the two equal cells would have to have both codimension zero and codimension one. Orthogonal projection away from the constant-vector subspace then constructs .
Preamble
import Definitions.Def_PartialMonitoringGame import Mathlib.Analysis.InnerProductSpace.PiL2 import Mathlib.Analysis.InnerProductSpace.Projection.FiniteDimensional import Mathlib.Tactic open MeasureTheory ProbabilityTheory Set
Formal statement
theorem BanditAlgorithm.partial_monitoring_neighbour_transverse_direction
{k d : ℕ} {𝕊 : Type*}
(G : PartialMonitoringGame k d 𝕊) (a b : Fin k)
(hab : NeighbouringActions G a b) :
∃ q : Fin d → ℝ,
(∑ i, q i) = 0 ∧
(∑ i, (G.L a i - G.L b i) * q i) = 1 := by
sorrySource
Lattimore and Szepesvári, Bandit Algorithms (2020), Theorem 37.14 proof sketch, printed p. 492 (PDF p. 500), transverse perturbations around a neighbouring cell face; https://tor-lattimore.com/downloads/book/book.pdf