Proof of Theorem 5.9 — every policy has average cost at least ρ* = lim (1 − β_n) J*_{β_n}(i)
ProvedArapostathisAC.SennottACOI.avgCost_ge_limitaverage-costp2o-batch-pfp2bp2o-gran-per-chapterp2o-plan-paperp2o-v1tauberianvanishing-discount
In the countable-state controlled Markov process of §5, assume Assumption 5.14 ( for all ). Let be a sequence in with , let , and suppose that
Then every admissible policy (history dependent, possibly randomized) satisfies
This is the lower bound of the proof of Theorem 5.9, obtained there from the Tauberian Theorem A.2; combined with it makes the limit policy AC-optimal.
Formalization Note The paper's is the limit from the first paragraph of the proof; the statement holds for the limit along any sequence along which it exists. lies in and the bound reads ENNReal.ofReal ρ ≤ avgCost M π i; automatically.
Preamble
import Mathlib import Definitions.Def_ArapostathisAC_SennottACOI_CMP import Definitions.Def_ArapostathisAC_SennottACOI_Assumptions open MeasureTheory ProbabilityTheory Filter Topology open scoped ENNReal
Formal statement
namespace ArapostathisAC.SennottACOI
variable {A : Type*} [MetricSpace A] [MeasurableSpace A] [BorelSpace A]
/-- Proof of Theorem 5.9 (p. 308): "By Theorem A.2 in the Appendix, J(i, π) ≥ ρ* for any π ∈ Π."
Under Assumption 5.14, if `β_n ∈ (0, 1)`, `β_n → 1` and `(1 − β_n) J*_{β_n}(i) → ρ*` for a state
`i`, then every admissible policy `π` (history dependent, randomized) has average cost
`J(i, π) ≥ ρ*`. -/
theorem avgCost_ge_limit (M : ArapostathisAC.VanishingDiscount.CMP A) (h14 : Assumption5_14 M)
(β : ℕ → ℝ) (hβ : ∀ n, β n ∈ Set.Ioo (0 : ℝ) 1) (hβ1 : Tendsto β atTop (𝓝 1))
(ρ : ℝ) (i : ℕ)
(hρ : Tendsto (fun n => (1 - β n) * (ArapostathisAC.VanishingDiscount.discValue M (β n) i).toReal) atTop (𝓝 ρ))
(π : ArapostathisAC.VanishingDiscount.Policy M) :
ENNReal.ofReal ρ ≤ ArapostathisAC.VanishingDiscount.avgCost M π i := by sorry
end ArapostathisAC.SennottACOI
Source
Arapostathis, Borkar, Fernández-Gaucherand, Ghosh, Marcus, Discrete-time controlled Markov processes with average cost criterion: a survey, SIAM J. Control Optim. 31(2) (1993), p. 308, proof of Theorem 5.9 ("By Theorem A.2 in the Appendix, J(i, π) ≥ ρ* for any π ∈ Π")
Human review
Confirmed by the mission captain (proposal self-audit).
Confirmed by the moderator at approval.