Strong restart: given the past, the future is a fresh chain started at the last state
ProvedMarkovChainCLT.traj_map_shift_eq_comapLet be a Markov kernel on and let denote the Ionescu–Tulcea kernel that, given an initial segment , returns the law of the whole trajectory continuing from it. Let be the shift . Then
i.e. as an identity of kernels, pushing the conditional trajectory kernel forward along the -shift gives the trajectory kernel of the chain, precomposed with "read off the last coordinate".
The strong restart property. In words: conditionally on the first states , the future is a copy of the chain started afresh at , and in particular depends on only through . This is the Markov property in the form that quantitative arguments actually consume, and it is strictly stronger than the unconditional shift identity : the latter describes the law of a shifted trajectory averaged over everything, while this describes it given the entire past, and asserts that the past is forgotten apart from its final state.
Why it is the gateway to mixing estimates. All three classical mixing coefficients compare the past with the future . Bounding them requires expressing the conditional law of the future given the past, and this theorem is exactly that expression: combined with the decomposition , it says that conditioning on the first coordinates and then looking steps ahead yields the chain started from . A total-variation rate then bounds the mixing coefficient at lag by , uniformly in the split point.
Proof. By the fact that a path measure is determined by its finite-dimensional marginals, it suffices to check agreement after restricting to each initial segment . On the left, — an identity that holds definitionally with the length written as — so the left marginal is the -shift pushforward of . On the right it is precomposed with . The two are identified by induction on : the base case is the observation that shifting a length- segment down to length one just reads off , and the inductive step splits as one step after and applies the arbitrary-offset time-homogeneity lemma to move the shift past that step.
import Definitions.Def_MarkovChainPathMeasure open Filter Finset Function MeasurableEquiv MeasurableSpace MeasureTheory Preorder ProbabilityTheory open scoped ENNReal NNReal Topology
theorem MarkovChainCLT.traj_map_shift_eq_comap {S : Type*} [MeasurableSpace S]
(P : Kernel S S) [IsMarkovKernel P] (j : ℕ) :
(Kernel.traj (X := fun _ : ℕ => S) (BanditAlgorithm.markovChainStep P) j).map
(fun ω : ℕ → S => fun n => ω (j + n))
= (BanditAlgorithm.markovChainKernel P).comap (fun u : Π _i : Finset.Iic j, S =>
u ⟨j, Finset.mem_Iic.2 le_rfl⟩) (measurable_pi_apply _) := by sorry