Remark 5.8(a), the half used — an ACOI with h bounded below gives J(i, f) ≤ ρ
ProvedArapostathisAC.SennottACOI.acoi_avgCost_leIn the countable-state controlled Markov process of §5, let , let be bounded below, and let . Suppose that for every state the series converges and
Then the average cost of satisfies for every state .
In the proof of Theorem 5.9 this gives for the limit policy ("Since is bounded below, the proof of Theorem 5.1 can be modified to show that ").
Formalization Note The paper's Remark 5.8(a) states more: that under (5.16) with bounded below, is the optimal average cost and every minimizing is AC-optimal. That does not follow for an arbitrary scalar : with and (bounded ), (5.16) holds, yet need not be the optimal cost. Only the inequality holds and is used, so only it is stated. The average cost is a in and enters as ENNReal.ofReal ρ.
import Mathlib import Definitions.Def_ArapostathisAC_SennottACOI_CMP import Definitions.Def_ArapostathisAC_SennottACOI_Assumptions open MeasureTheory ProbabilityTheory Filter Topology open scoped ENNReal
namespace ArapostathisAC.SennottACOI
variable {A : Type*} [MetricSpace A] [MeasurableSpace A] [BorelSpace A]
/-- Remark 5.8(a) (p. 308), the half used in the proof of Theorem 5.9 ("Since h(·) is bounded
below, the proof of Theorem 5.1 can be modified to show that J(i, f) ≤ ρ*"): if `ρ` is a real
number, `h : S → ℝ` is bounded below, `f ∈ Π_SD`, and for every state `i` the series
`Σ_j P(j | i, f(i)) h(j)` converges with `ρ + h(i) ≥ c(i, f(i)) + Σ_j P(j | i, f(i)) h(j)`, then
`J(i, f) ≤ ρ` for every state `i`. The printed remark further claims that `ρ` is the optimal
average cost, which does not follow; that part is not stated. -/
theorem acoi_avgCost_le (M : ArapostathisAC.VanishingDiscount.CMP A) (ρ : ℝ) (h : ℕ → ℝ) (hb : BddBelow (Set.range h))
(f : StationaryPolicy M) (hsum : ∀ i, Summable (fun j => ArapostathisAC.VanishingDiscount.prob M i (f.1 i) j * h j))
(hineq : ∀ i, M.c i (f.1 i) + ∑' j, ArapostathisAC.VanishingDiscount.prob M i (f.1 i) j * h j ≤ ρ + h i) (i : ℕ) :
ArapostathisAC.VanishingDiscount.avgCost M f.toPolicy i ≤ ENNReal.ofReal ρ := by sorry
end ArapostathisAC.SennottACOI
Confirmed by the mission captain (proposal self-audit).
Confirmed by the moderator at approval.