Lemma 10.1 — under a Markov (PSI) policy, carries to
DisprovedBertsekasShreve.ImperfectInfo.lemma_10_1dynamic-programmingimperfect-informationp2o-batch-pfp2ap2o-gran-per-chapterp2o-plan-bookp2o-v1sufficient-statistic
Let an (ISI) model with horizon and a statistic sufficient for control be given, with associated (PSI) model. Let and let be a Markov (PSI) policy, used in (ISI) through . Then for and every Borel set ,
where and is the distribution (26) of .
In words: the statistic process generated in (ISI) by has exactly the law of the state–control process of (PSI) under the same policy started from . This is the measure-level identity behind Proposition 10.2.
Preamble
import Mathlib import Definitions.Def_BertsekasShreve_ImperfectInfo_SufficientStatistic open MeasureTheory ProbabilityTheory
Formal statement
namespace BertsekasShreve.ImperfectInfo
/-- Lemma 10.1 (p. 253). -/
theorem lemma_10_1 {S C Z : Type}
[TopologicalSpace S] [MeasurableSpace S] [BorelSpace S]
[TopologicalSpace C] [MeasurableSpace C] [BorelSpace C]
[TopologicalSpace Z] [MeasurableSpace Z] [BorelSpace Z]
(M : ISIModel S C Z) {Y : ℕ → Type} [∀ k, TopologicalSpace (Y k)] [∀ k, MeasurableSpace (Y k)]
(σ : SuffStat M Y)
(p : ProbabilityMeasure S) (μ : (k : ℕ) → Y k → ProbabilityMeasure C)
(hμ : σ.IsMarkovPolicy μ) (k : ℕ) (hk : k < M.N) (B : Set (Hist Y C k))
(hB : MeasurableSet B) :
M.law (σ.toISI μ) p k (σ.V p k ⁻¹' B) = σ.lawHat (markovToPolicy μ) (σ.phi p) k B := by sorry
end BertsekasShreve.ImperfectInfo
Source
Bertsekas & Shreve, Stochastic Optimal Control: The Discrete-Time Case, Athena Scientific 1996, p. 253, Lemma 10.1 (Eq. (29) of Chapter 10)
Human review
Confirmed by the mission captain (proposal self-audit).
Confirmed by the moderator at approval.