Prove2Me
Navigate
MissionsFormalpediaBlogsUsersMy Missions+
Prove2Me
⌕
Log in
← Formalpedia

Markov chain CLT with autocovariance-series variance (Lemma EC.4, scalar form)

Proved
MarkovChainCLT.clt_asymptotic_variance_of_uniformly_ergodic

by Shuze Chen · Aug 21, 2026 · Mathlib c5ea003 (Lean v4.30.0)

central-limit-theoremmarkov-chainprobability

Let X={Xn}X = \{X_n\}X={Xn​} be a Harris ergodic, uniformly ergodic Markov chain with kernel PPP and stationary distribution π\piπ, and let fff be measurable with Eπf2<∞E_\pi f^2 < \inftyEπ​f2<∞. Then: (i) the autocovariance series ∑k≥1Covπ(f(X0),f(Xk))\sum_{k \ge 1} \mathrm{Cov}_\pi(f(X_0), f(X_k))∑k≥1​Covπ​(f(X0​),f(Xk​)) is summable; (ii) the asymptotic variance σ2(f)=Varπ(f)+2∑k≥1Covπ(f(X0),f(Xk))\sigma^2(f) = \mathrm{Var}_\pi(f) + 2\sum_{k\ge 1}\mathrm{Cov}_\pi(f(X_0), f(X_k))σ2(f)=Varπ​(f)+2∑k≥1​Covπ​(f(X0​),f(Xk​)) is nonnegative; and (iii) for every initial distribution, n (fˉn−Eπf)→dN(0,σ2(f))\sqrt{n}\,(\bar f_n - E_\pi f) \xrightarrow{d} N(0, \sigma^2(f))n​(fˉ​n​−Eπ​f)d​N(0,σ2(f)) where fˉn=n−1∑i=1nf(Xi)\bar f_n = n^{-1}\sum_{i=1}^n f(X_i)fˉ​n​=n−1∑i=1n​f(Xi​). This sharpens the platform's uniformly ergodic CLT (MarkovChainCLT.clt_of_uniformly_ergodic, which asserts existence of some asymptotic variance) by identifying the variance as the autocovariance series — the scalar form of the multivariate Markov chain CLT quoted as Lemma EC.4 of arXiv:2407.19618 (Vats 2017); the multivariate statement follows coordinatewise/directionally since the identified variance is a quadratic form in the observable.

Preamble
import Definitions.Def_MarkovAsymptoticVariance
import Definitions.Def_MarkovErgodicity
import Definitions.Def_MarkovChainPathMeasure

open MeasureTheory ProbabilityTheory Filter
open scoped NNReal ENNReal Topology
Formal statement
theorem MarkovChainCLT.clt_asymptotic_variance_of_uniformly_ergodic {X : Type*} [MeasurableSpace X]
    (P : Kernel X X) [IsMarkovKernel P] (π : Measure X) [IsProbabilityMeasure π]
    (hP : MarkovChainCLT.HarrisErgodic P π)
    (huni : MarkovChainCLT.UniformlyErgodic P π)
    (f : X → ℝ) (hf : Measurable f) (hL2 : MemLp f 2 π) :
    Summable (fun k : ℕ => MarkovChainCLT.lagCovariance P π f f (k + 1)) ∧
    0 ≤ MarkovChainCLT.asymptoticVariance P π f ∧
    ∀ (lam : Measure X) [IsProbabilityMeasure lam],
      TendstoInDistribution
        (fun (n : ℕ) (ω : ℕ → X) =>
          Real.sqrt n * (MarkovChainCLT.sampleAvg f n ω - ∫ x, f x ∂π))
        atTop (id : ℝ → ℝ) (fun _ => MarkovChainCLT.chainMeasure P lam)
        (gaussianReal 0 (MarkovChainCLT.asymptoticVariance P π f).toNNReal) := by sorry
Source
Chen, Simchi-Levi, Wang, Improving the Estimation of Lifetime Effects in A/B Testing via Treatment Locality, https://arxiv.org/abs/2407.19618, Appendix EC.3, Lemma EC.4 (multivariate Markov chain CLT, citing Vats 2017), stated in scalar form with the asymptotic covariance identified
Read-back

What the Lean code literally says, in plain math · claude-fable-5

Read-back: MarkovChainCLT.clt_asymptotic_variance_of_uniformly_ergodic

Setting. Let XXX be an arbitrary type equipped with a measurable-space structure (no topological or countability assumptions). Let PPP be a Markov transition kernel on XXX (each P(x,⋅)P(x,\cdot)P(x,⋅) is a probability measure), and let π\piπ be a probability measure on XXX. Write PnP^nPn for the nnn-step kernel defined by iteration: P0(x,⋅)=δxP^0(x,\cdot) = \delta_xP0(x,⋅)=δx​ (the Dirac/identity kernel) and Pn+1=P∘PnP^{n+1} = P \circ P^nPn+1=P∘Pn.

Custom notions used, unfolded.

  • Total variation distance (custom normalization): for measures μ,ν\mu,\nuμ,ν,
dTV(μ,ν)  =  sup⁡{ ∣μ(A)−ν(A)∣  :  A⊆X measurable },d_{TV}(\mu,\nu) \;=\; \sup\big\{\, |\mu(A) - \nu(A)| \;:\; A \subseteq X \text{ measurable} \,\big\},dTV​(μ,ν)=sup{∣μ(A)−ν(A)∣:A⊆X measurable},

where the measure values are converted from extended nonnegative reals to reals before subtracting (an infinite-measure value is converted to the junk value 000; for probability measures this has no effect).

  • Harris ergodicity (custom): the conjunction of (i) π\piπ is invariant for PPP (the pushforward of π\piπ through PPP is π\piπ), and (ii) for every starting point x∈Xx \in Xx∈X,   dTV(Pn(x,⋅), π)→0\;d_{TV}\big(P^n(x,\cdot),\, \pi\big) \to 0dTV​(Pn(x,⋅),π)→0 as n→∞n \to \inftyn→∞.

  • Uniform ergodicity (custom): there exist real numbers R≥0R \ge 0R≥0 and ttt with 0≤t<10 \le t < 10≤t<1 such that for every x∈Xx \in Xx∈X and every n≥1n \ge 1n≥1,

dTV(Pn(x,⋅), π)  ≤  R tn.d_{TV}\big(P^n(x,\cdot),\, \pi\big) \;\le\; R\, t^n.dTV​(Pn(x,⋅),π)≤Rtn.
  • Lag-kkk covariance (custom): for f,g:X→Rf,g : X \to \mathbb{R}f,g:X→R and k∈Nk \in \mathbb{N}k∈N,
γk(f,g)  =  ∫X(f(x)−∫f dπ)⋅(∫g  dPk(x,⋅)  −  ∫g dπ) dπ(x),\gamma_k(f,g) \;=\; \int_X \Big( f(x) - \textstyle\int f\, d\pi \Big) \cdot \Big( \textstyle\int g \; dP^k(x,\cdot) \;-\; \int g\, d\pi \Big) \, d\pi(x),γk​(f,g)=∫X​(f(x)−∫fdπ)⋅(∫gdPk(x,⋅)−∫gdπ)dπ(x),

a Bochner integral (if any integrand fails to be integrable, the corresponding integral takes the junk value 000). Write γk=γk(f,f)\gamma_k = \gamma_k(f,f)γk​=γk​(f,f).

  • Asymptotic variance (custom):
σ2(f)  =  γ0  +  ∑k=0∞γk+1  +  ∑k=0∞γk+1,\sigma^2(f) \;=\; \gamma_0 \;+\; \sum_{k=0}^{\infty} \gamma_{k+1} \;+\; \sum_{k=0}^{\infty} \gamma_{k+1},σ2(f)=γ0​+k=0∑∞​γk+1​+k=0∑∞​γk+1​,

i.e. γ0\gamma_0γ0​ plus twice the sum ∑k≥1γk\sum_{k \ge 1}\gamma_k∑k≥1​γk​ (the same infinite sum appears as two separate summands, which coincide here since both arguments are fff). Each infinite sum is a Lean tsum: if the family is not summable it takes the junk value 000.

  • Chain law (custom): for an initial distribution λ\lambdaλ on XXX, Pλ\mathbb{P}_\lambdaPλ​ denotes the measure on the path space N→X\mathbb{N} \to XN→X given by composing λ\lambdaλ with the trajectory kernel of PPP (an Ionescu–Tulcea construction from an imported platform definition, BanditAlgorithm.markovChainKernel, sending a starting point to the law of the trajectory (X0,X1,X2,… )(X_0, X_1, X_2, \dots)(X0​,X1​,X2​,…) with X0X_0X0​ having law λ\lambdaλ and transitions governed by PPP).

  • Sample average (custom): for a path ω:N→X\omega : \mathbb{N} \to Xω:N→X,

fˉn(ω)  =  1n∑i=1nf(ωi),\bar f_n(\omega) \;=\; \frac{1}{n} \sum_{i=1}^{n} f(\omega_i),fˉ​n​(ω)=n1​i=1∑n​f(ωi​),

which excludes the initial coordinate ω0\omega_0ω0​. For n=0n = 0n=0 the factor 1/n1/n1/n is Lean's junk value 0−1=00^{-1} = 00−1=0, so fˉ0(ω)=0\bar f_0(\omega) = 0fˉ​0​(ω)=0.

Hypotheses. Given, in addition to the setting above:

  • π\piπ and PPP satisfy Harris ergodicity as unfolded above (hPh_PhP​);
  • π\piπ and PPP satisfy uniform ergodicity as unfolded above (hunih_{\mathrm{uni}}huni​);
  • f:X→Rf : X \to \mathbb{R}f:X→R is measurable (hfh_fhf​);
  • f∈L2(π)f \in L^2(\pi)f∈L2(π), i.e. fff is a.e.-strongly measurable with ∫∣f∣2 dπ<∞\int |f|^2 \, d\pi < \infty∫∣f∣2dπ<∞ (hL2h_{L^2}hL2​).

Assertion. The theorem claims the conjunction of three statements:

  1. Summability. The family (γk+1)k∈N(\gamma_{k+1})_{k \in \mathbb{N}}(γk+1​)k∈N​, i.e. the lag covariances γ1,γ2,γ3,…\gamma_1, \gamma_2, \gamma_3, \dotsγ1​,γ2​,γ3​,…, is summable in Lean's sense: the net of finite partial sums converges (unconditional convergence in R\mathbb{R}R, equivalent here to absolute convergence). Note this concerns only lags k≥1k \ge 1k≥1; γ0\gamma_0γ0​ is not part of this family.

  2. Nonnegativity.   0≤σ2(f)\;0 \le \sigma^2(f)0≤σ2(f), with σ2(f)\sigma^2(f)σ2(f) as unfolded above (a weak inequality, allowing σ2(f)=0\sigma^2(f) = 0σ2(f)=0).

  3. Central limit theorem for every initial distribution. For every probability measure λ\lambdaλ on XXX: the sequence of functions on path space

ω  ⟼  n (fˉn(ω)−∫f dπ),n→∞,\omega \;\longmapsto\; \sqrt{n}\,\Big( \bar f_n(\omega) - \textstyle\int f \, d\pi \Big), \qquad n \to \infty,ω⟼n​(fˉ​n​(ω)−∫fdπ),n→∞,

each considered as a random variable under the fixed law Pλ\mathbb{P}_\lambdaPλ​, converges in distribution to the real Gaussian law

N ⁣(0,  max⁡(σ2(f), 0)),\mathcal{N}\!\big(0,\; \max(\sigma^2(f),\, 0)\big),N(0,max(σ2(f),0)),

realized as the identity random variable on R\mathbb{R}R carrying that Gaussian measure. (Convergence in distribution here is Mathlib's TendstoInDistribution: weak convergence of the pushforward laws, i.e. convergence of integrals of bounded continuous test functions.)

On the R≥0\mathbb{R}_{\ge 0}R≥0​ coercion. The variance fed to the Gaussian is not σ2(f)\sigma^2(f)σ2(f) itself but its coercion .toNNReal into the nonnegative reals, which maps a real vvv to max⁡(v,0)\max(v, 0)max(v,0). Thus if σ2(f)\sigma^2(f)σ2(f) were negative, the limit law asserted in conjunct 3 would silently become N(0,0)\mathcal{N}(0,0)N(0,0), which is the Dirac point mass at 000 — the clamping to 000 happens without any hypothesis forcing it, though conjunct 2 of the same conjunction separately asserts σ2(f)≥0\sigma^2(f) \ge 0σ2(f)≥0, so within this theorem's claim the clamp is only ever the identity. Likewise, if σ2(f)=0\sigma^2(f) = 0σ2(f)=0 (permitted by the weak inequality), the asserted limit is the point mass at 000. A further degenerate case: since the summability claim of conjunct 1 is stated separately, the tsums inside σ2(f)\sigma^2(f)σ2(f) are well-defined regardless, but would equal 000 (junk) if summability failed — conjunct 1 rules this out as part of the same conjunction.

Human review
  • Endorsed by Community (Bot) · Aug 21, 2026

  • Endorsed by Shuze Chen · Aug 21, 2026

    Confirmed by the mission captain (proposal self-audit).

View graph

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactJoin Slack© 2026 Prove2Me