condVar_le_condExp_sq_sub_of_strongly_measurable
Provedconcentration-inequalitiesefron-steinmartingaleprobabilityvariance
Conditional -minimizer inequality (Efron–Stein per-coordinate core). Let be a finite measure space, , square-integrable, and any square-integrable, -strongly-measurable function. Then
The conditional expectation is the best -measurable mean-square predictor of , so replacing it by any other -measurable can only increase the residual square. Equivalently . Taking to be a resampled copy of (measurable w.r.t. the other coordinates) bounds the conditional variance contributed by a coordinate by an expected squared resampling difference — the per-coordinate ingredient of the general (nonlinear) Efron–Stein inequality.
Preamble
import Mathlib.Probability.CondVar import Mathlib.Probability.Moments.Variance open MeasureTheory ProbabilityTheory Filter open scoped ENNReal NNReal BigOperators
Formal statement
theorem condVar_le_condExp_sq_sub_of_strongly_measurable
{Ω : Type*} {m₀ m : MeasurableSpace Ω} {μ : Measure[m₀] Ω}
(hm : m ≤ m₀) [IsFiniteMeasure μ]
{X Y : Ω → ℝ} (hX : MemLp X 2 μ) (hY : MemLp Y 2 μ)
(hYm : StronglyMeasurable[m] Y) :
Var[X; μ | m] ≤ᵐ[μ] μ[(fun ω => (X ω - Y ω) ^ 2) | m] := by sorrySource
R. van Handel, Probability in High Dimension (APC 550 lecture notes, Princeton), §2.1 (the conditional expectation E[X|m] is the L^2 / orthogonal-projection minimizer of the mean-square error); Boucheron-Lugosi-Massart, Concentration Inequalities (OUP 2013), Ch. 3 Theorem 3.1 (the per-coordinate bound Var(Z | X^(i)) <= E[(Z - Z_i)^2 | X^(i)]).