Marginal law of z̄ — the sample mean of the z_i is N(0, (1 + σ²/n) I)
ProvedRobustGeneralization.GaussLower.zbar_marginalgaussian-convolutiongaussian-modelp2o-batch-p200ap2o-gran-per-chapterp2o-plan-paperp2o-v1
Let and . Draw and then, given , i.i.d. from . The sample mean then has marginal law
Combined with , this converts the bound into a probability about a single standard Gaussian vector.
Formalization Note is added because the mean of zero samples is undefined. The marginal of is the one in the definitions file. The covariance is encoded by the standard deviation .
Preamble
import Mathlib import Definitions.Def_RobustGeneralization_GaussLower_Model open MeasureTheory ProbabilityTheory open scoped ENNReal
Formal statement
namespace RobustGeneralization.GaussLower
theorem zbar_marginal (d n : ℕ) (hn : 1 ≤ n) (σ : ℝ) (hσ : 0 < σ) :
(sampleMarginal d n σ).map (fun z => ((n : ℝ)⁻¹) • ∑ i, z i) =
gaussVec 0 (Real.sqrt (1 + σ ^ 2 / n)) := by sorry
end RobustGeneralization.GaussLower
Source
Schmidt, Santurkar, Tsipras, Talwar, Mądry, Adversarially Robust Generalization Requires More Data, arXiv:1804.11285v2, p. 30, §A.2, proof of Theorem 11, paragraph 'It remains to analyze the distribution of the vector z̄'
Human review
Confirmed by the mission captain (proposal self-audit).
Confirmed by the moderator at approval.