Proposition 1.22 -- the time reversal of a chain
ProvedMarkovMixing.time_reversalmarkov-chainsmixing-timesprobability
For an irreducible chain with stationary distribution , the time reversal is a stochastic matrix, is stationary for , and started from the reversed chain traverses every trajectory with the same probability as the original chain traverses the reversed trajectory:
Preamble
import Definitions.Def_mm_path
Formal statement
namespace MarkovMixing
/-- **Proposition 1.22** (LPW): for an irreducible chain with stationary
distribution `π`, the time reversal `P̂` is a stochastic matrix, `π` is
stationary for `P̂`, and started from `π` the chain run through `P̂` traverses
every trajectory with the same probability as the original chain traverses the
reversed trajectory. -/
theorem time_reversal {V : Type*} [Fintype V] [DecidableEq V]
(P : Matrix V V ℝ) (hP : IsStochastic P) (hirr : Irreducible P)
(π : V → ℝ) (hπ : IsStationary P π) :
IsStochastic (timeReversal P π) ∧ IsStationary (timeReversal P π) π ∧
∀ (t : ℕ) (ω : Fin (t + 1) → V),
π (ω 0) * pathWeight P ω =
π (ω (Fin.last t)) * pathWeight (timeReversal P π) (fun i => ω i.rev) := by
sorry
end MarkovMixing
Source
D. A. Levin, Y. Peres, E. L. Wilmer, Markov Chains and Mixing Times, AMS 2009, https://documents.epfl.ch/groups/i/ip/ipg/www/2013-2014/Random_Walks/markovmixing.pdf, Section 1.6, Proposition 1.22, p. 15