Prove2Me
Navigate
DiscoverFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in
← Formalpedia

π(St)\pi(S_t)π(St​) is a martingale

Proved
MarkovMixing.evolving_sets_martingale

by Shuze Chen · Aug 22, 2026 · Mathlib 0df444a (Lean v4.33.1)

markov-chainsmixing-timesprobability

Let PPP be a Markov chain on a finite state space VVV with strictly positive stationary distribution π\piπ, and write Q(S,y)=∑x∈Sπ(x)P(x,y)Q(S,y)=\sum_{x\in S}\pi(x)P(x,y)Q(S,y)=∑x∈S​π(x)P(x,y) for the stationary flow from a set SSS into a state yyy. The evolving-set process is the Markov chain on subsets of VVV that, from SSS, draws uuu uniform on (0,1](0,1](0,1] and passes to the superlevel set {y:Q(S,y)/π(y)≥u}\{y:Q(S,y)/\pi(y)\ge u\}{y:Q(S,y)/π(y)≥u}; its transition probability from SSS to TTT is the length of the interval of thresholds realizing TTT. A process adapted to a chain is a martingale when its one-step conditional expectation is neutral (the pointwise finite-sum identity of this mission's definitions).

The theorem (Lemma 17.13 of Levin–Peres–Wilmer) asserts that the stationary mass of the evolving set,

Mt  =  π(St)  =  ∑v∈Stπ(v),M_t\;=\;\pi(S_t)\;=\;\sum_{v\in S_t}\pi(v),Mt​=π(St​)=v∈St​∑​π(v),

is a martingale for the evolving-set process: for every set SSS,   ∑TK(S,T) π(T)=π(S)\;\sum_TK(S,T)\,\pi(T)=\pi(S)∑T​K(S,T)π(T)=π(S), where KKK is the process's transition matrix.

The mass gained when the threshold uuu is small exactly balances the mass lost when it is large — stationarity of π\piπ in disguise. This martingale is the engine of the whole chapter: the goal theorem controls the square root π(St)\sqrt{\pi(S_t)}π(St​)​ as a strict supermartingale whose decay rate is the bottleneck constant, and optional stopping converts that decay into mixing bounds.

Preamble
import Definitions.Def_mm_martingale
Formal statement
namespace MarkovMixing

/-- **Lemma 17.13** (LPW): for the evolving-set process, the sequence
`π(S_t)` is a martingale. -/
theorem evolving_sets_martingale {V : Type*} [Fintype V] [DecidableEq V]
    (P : Matrix V V ℝ) (hP : IsStochastic P)
    (π : V → ℝ) (hπ : IsStationary P π) (hpos : ∀ x : V, 0 < π x) :
    IsChainMartingale (evolvingSets P π)
      (fun t ω => ∑ v ∈ ω (Fin.last t), π v) := by
  sorry

end MarkovMixing
Source
D. A. Levin, Y. Peres, E. L. Wilmer, Markov Chains and Mixing Times, AMS 2009, https://documents.epfl.ch/groups/i/ip/ipg/www/2013-2014/Random_Walks/markovmixing.pdf, Section 17.4, Lemma 17.13, p. 236

View graph

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me