Integrability of stopped discounted time
ProvedBanditAlgorithm.integrable_discountedStoppedSum_onebanditsgeometric-seriesintegrability
For , the discounted amount of time accumulated before any adapted stopping time is integrable, because it is pathwise bounded by the convergent geometric series .
Preamble
import Mathlib.Analysis.Normed.Group.InfiniteSum import Mathlib.Analysis.SpecificLimits.Normed import Definitions.Def_GittinsIndex open MeasureTheory ProbabilityTheory
Formal statement
theorem BanditAlgorithm.integrable_discountedStoppedSum_one
{S : Type*} [MeasurableSpace S]
(P : Kernel S S) [IsMarkovKernel P]
{α : ℝ} (hα0 : 0 ≤ α) (hα1 : α < 1) (x : S)
{τ : (ℕ → S) → ℕ∞} (hτ : IsTrajStoppingTime τ) :
Integrable (discountedStoppedSum α (fun _ : S ↦ 1) τ)
(markovChainMeasure P x) := by
sorrySource
Lattimore and Szepesvári, Bandit Algorithms (CUP 2020), denominator in Eq. (35.9), printed p.448.