Loading home page…
Each mission turns a result from a paper or textbook into small Lean 4 statements anyone can tackle.
Campaigns group missions around a shared mathematical goal. Each one tracks a quantity, such as an upper or lower bound. Have a good candidate in mind? Ping us on Slack, Zulip, or WeChat.
Each mission turns a result from a paper or textbook into small Lean 4 statements anyone can tackle.
Campaigns group missions around a shared mathematical goal. Each one tracks a quantity, such as an upper or lower bound. Have a good candidate in mind? Ping us on Slack, Zulip, or WeChat.
Classical algorithms solve 3SUM in time. In a 2026 breakthrough, Alman and Vassilevska Williams gave a deterministic algorithm, refuting the integer 3SUM hypothesis. How low can the exponent go?
Building on existing Lean formalizations, this campaign tracks upper bounds for 3SUM on polynomially bounded integers, using a word RAM with -bit words, and pursues smaller exponents.
Classical algorithms solve all-pairs shortest paths in time. In a 2026 breakthrough, Alman and Vassilevska Williams refuted the APSP conjecture with a deterministic algorithm. How low can the exponent go?
Building on existing Lean formalizations, this campaign tracks upper bounds for exact APSP and pursues smaller exponents.
The irrationality measure of π quantifies how closely rational numbers can approximate it. This campaign seeks formal proofs of sharper upper bounds, starting with Mahler’s bound of 42.
The sharp Hlawka inequality for Schatten -norms is a cousin of the triangle inequality: it relates the norms of three matrices to the norms of their pairwise sums and their total sum. For complex diagonal matrices, an exact formula for the best possible comparison constant has been proved in Lean for every real . We conjecture that the same formula holds for all .
What is the smallest cutoff for which this formula holds for every real ?
References:
Is every odd number a sum of primes? This campaign tracks formalized proofs of the smallest that suffices.
Schnirelmann (1930) showed some finite works. Vinogradov (1937) showed that three is enough for all sufficiently large odd numbers. Tao (2012) proved unconditionally. Helfgott (2013) proved that every odd number greater than is a sum of three primes, though the proof is still unrefereed. Ideally, we can formalize this statement here. Note that three is optimal: is neither prime nor + prime.
Schoolbook matrix multiplication takes operations. The exponent is the infimum of all such that two matrices can be multiplied in arithmetic operations; trivially , and is conjectured but open.
Strassen gave the first nontrivial bound, , in 1969, and introduced the laser method in 1986 to reach . Coppersmith and Winograd's 1990 bound of stood for two decades. Every subsequent improvement comes from analyzing higher tensor powers of their construction with refined laser-method variants. That line reached in 2025, and the current record is , from August 2026. See Computational complexity of matrix multiplication for the full table. Can we formalize these results and even improve on them?
In PAC learning the learner receives a batch of examples, learns, and only then predicts. Online learning has no such separation: on each round the learner receives an instance, predicts its label, and then sees the true label, and the goal is to make few mistakes over the whole sequence, with no statistical assumption whatsoever on how the sequence is generated, adversarially if need be. Chapter 21 of Shalev-Shwartz and Ben-David, Understanding Machine Learning: From Theory to Algorithms (doi:10.1017/CBO9781107298019), develops this model along the same lines as the PAC theory. In the realizable case, mistake bounds replace sample complexity, and a combinatorial dimension due to Littlestone, , characterizes the best achievable bound exactly (Lemmas 21.6 and 21.7), playing the role the VC dimension plays for PAC learning, with and an arbitrarily large gap (Theorem 21.9). In the unrealizable case regret replaces excess risk; deterministic learners can be forced to regret (Cover), but randomized predictions restore sublinear regret through the Weighted-Majority algorithm of Littlestone, Warmuth and Vovk (Theorem 21.11). The chapter closes with online convex optimization, where Online Gradient Descent (Zinkevich) attains regret (Theorem 21.15), and with the online Perceptron, whose mistake bound follows from a round-specific surrogate loss (Theorem 21.16).
An online algorithm is a deterministic map from the history of past examples and the current instance to a prediction. For a sequence labeled by some , is the number of mistakes and the supremum over all such sequences (Definition 21.1). The Consistent algorithm predicts with any hypothesis of the version space (the hypotheses consistent with the past), Halving with its majority label, and SOA with the label for which has the larger Littlestone dimension, ties to . An -shattered tree of depth assigns an instance to every node of a complete binary tree so that every labeling is realized by some along the path it determines; is the maximal such depth (Definitions 21.4–21.5). In the unrealizable case predictions are , the loss is , and the regret against is (21.1). Weighted-Majority maintains over experts with costs and pays . Online Gradient Descent on a closed convex predicts , receives a convex , takes a subgradient at and projects back onto ; the online Perceptron is the special case on rounds with .
For experts, cost vectors , and ,
Theorem 21.3 (Halving makes at most mistakes); Lemma 21.6 ( for every ); Lemma 21.7 (); Theorem 21.15 (the three regret bounds of Online Gradient Descent); Theorem 21.16 (the online Perceptron bound and its separable case). Further items: Corollary 21.2, Theorem 21.9, Example 21.4, Cover's impossibility, Corollary 21.12 and the half of Theorem 21.10.
Corollary 21.8 is one of the cleanest characterizations in learning theory: the Littlestone dimension is exactly the optimal mistake bound, with SOA attaining it and Lemma 21.6 forbidding anything better. Theorem 21.11 is the engine of the unrealizable case and of a large part of online learning: the multiplicative-weights analysis with the potential gives regret against the best of experts, and with the experts of pp. 298–299 it yields Theorem 21.10, regret for any class of finite Littlestone dimension. Theorem 21.15 is the online counterpart of the SGD analysis of Chapter 14, and the derivation of Theorem 21.16 from it shows how a surrogate loss chosen per round turns a regret bound into a mistake bound, the Perceptron bound of Chapter 9 falling out as the separable case. On the platform, these items give the first online-learning model, reusing Mission X's subgradients and projections.
Corollary 21.2 and Theorem 21.3 are counting arguments on the version space, but formally they require tracking the version space along the history and the fact that a mistake by Halving halves it. Lemma 21.6 is the adversary argument: given a shattered tree, feed the instance at the current node and the label opposite to the prediction; the resulting sequence is labeled by some by the shattering property, and the algorithm errs on every round. Lemma 21.7 needs the combinatorial core of the chapter: if both restricted version spaces had Littlestone dimension equal to , their shattered trees could be glued under a new root to a deeper tree. Theorem 21.9 builds a shattered tree with all nodes at depth equal to ; Example 21.4 builds the dyadic tree. Theorem 21.11's proof is the book's: for , , the telescoping potential , the lower bound , and the choice of ; the hypothesis makes . Corollary 21.12 is the reduction of hypotheses to experts, and Theorem 21.10 is the expert construction with the counting bound (21.4) (Lemma A.5) and Lemma 21.13, which simulates SOA on the labels of ; small horizons are covered by the trivial bound . Theorem 21.15 is the telescoping argument of Lemma 14.1 with the projection lemma of Chapter 14 at every step; Theorem 21.16 applies it to with and solves the quadratic inequality (21.6).
Online algorithms are deterministic functions List (X × Y) → X → Y; a sequence is Fin T-indexed and the history at round is its first examples. Mistake bounds and the Littlestone dimension are suprema in ℕ∞, so mistakeBound, ldim and their comparisons are meaningful when infinite. Shattered trees are indexed by paths rather than by the book's node numbers , whose binary expansion is exactly the path; the two descriptions are the same tree. Halving and SOA break ties towards as in the book; Consistent is stated as a property of an algorithm. The unrealizable case uses real-valued predictions with the loss as the book does, and the theorems of that section assert the existence of an algorithm for each horizon , because Weighted-Majority takes as input. Weighted-Majority's distribution is written in unrolled form, , which is the update rule iterated from . Theorem 21.10 is stated for classes with and in its form, the form being Corollary 21.12; its lower bound, proved in Ben-David, Pál and Shalev-Shwartz (2009), is not stated. Online Gradient Descent is driven by a subgradient selector (Mission X's global subgradients), from , on a closed convex containing the comparator; the Lipschitz parts take LipschitzWith ρ (f t) and . The Perceptron's is the set of update rounds , which contains every prediction mistake whatever is and is the set the book's derivation actually uses; is any bound on for . Cover's impossibility is stated for deterministic -valued algorithms, the setting in which the book states it.
Not stated: the Doubling Trick (Exercise 4), Exercises 1–3 (specific tight examples), the SOA-based Expert algorithm as a separate definition (it is internal to the proof of Theorem 21.10), Lemma 21.13 and Corollary 21.14 as items, and the lower bound of Theorem 21.10.
Whether the quantization of the gravitational field is observable is a long-standing question at the interface of general relativity and quantum theory. In his 2013 talk Is a Graviton Detectable? (doi:10.1142/S0217751X1330041X), Freeman Dyson examined three families of hypothetical single-graviton detectors and estimated, for each, why it fails: LIGO-type interferometers (Sec. 3), atoms absorbing a graviton by the gravitoelectric effect (Secs. 4–5), and Gertsenshtein photon–graviton conversion in a magnetic field (Secs. 6–7).
Most of the paper consists of order-of-magnitude physical estimates. A part of it, however, consists of precise mathematical statements: exact algebraic consequences of the stated physical relations, and one genuine analytic inequality about the quadrupole factor that controls the graviton absorption cross-section of a bound particle. This mission collects those statements.
Sections 3. Let be the speed of light, Newton's constant and the reduced Planck constant. The Planck length is (Eq. (5)). A gravitational wave of strain amplitude and angular frequency has energy density (Eq. (2)); a single graviton of frequency has energy density at most (Eq. (3)).
Section 4. For an electron bound in a state with zero angular momentum about the -axis, with real wave function in cylindrical coordinates ( the distance from the -axis), let and define
The s-state of Eq. (19) is with .
Sections 6–7. For a transverse magnetic field , the mixing length is (Eq. (29)) and the photon-to-graviton conversion probability over a distance is (Eq. (28)). Vacuum nonlinearity slows the photon by the fraction (Eq. (36)), where is the fine-structure constant and the critical field, giving the coherence length (Eq. (37)).
For every nonzero, normalizable axially symmetric wave function with finite ,
Eq. (18) is what allows Dyson to conclude that the averaged absorption cross-section (Eq. (14)) is, for every bound particle, of the order of the Planck area; together with Eq. (20) it shows is of order unity for tightly bound s-states. The Section 3 bounds are the precise algebraic content of the argument that measuring distances to Planck accuracy forces the apparatus inside its own Schwarzschild radius. The Section 7 bounds are the algebraic content of the argument that vacuum birefringence limits Gertsenshtein conversion.
None of these statements has, to our knowledge, a machine-checked proof. Eq. (18) is a weighted Hardy-type inequality on the half line with sharp constant, applied slice by slice; formalizing it produces reusable one-dimensional weighted Hardy inequalities. Eq. (20) requires explicit Gamma-function integrals in cylindrical coordinates.
For Eq. (18) the difficulty is analytic: the inequality must hold for all admissible , including functions that are not compactly supported and may be singular on the -axis, and it is strict although its sharp constant is not attained. Boundary terms of the integration by parts behind Eq. (17) must be controlled using only the integrability assumptions. The printed Eq. (17) has the sign ; with that sign the integral is trivially positive and does not imply Eq. (18). The mission uses , the sign under which (17) implies (18). The algebraic milestones are elementary.
All quantities are real. is a function of ; is deriv in the first variable; integrals are Lebesgue integrals over the half plane . The admissible class for Eqs. (17)–(18) is: differentiable at every , and integrable on the half plane, and not almost-everywhere zero there. These hypotheses rule out the degenerate reading (Lean's division returns ). Eq. (20) requires and , the range in which the integrals in Eq. (16) converge. Physical constants are arbitrary positive reals; numerical cgs values (e.g. Eqs. (5), (21), (31)) are not formalized. The heuristic parts of the paper (Bohr–Rosenfeld argument, the sum rule (14), astrophysical source estimates, neutrino backgrounds) are out of scope.
Every learning paradigm of the book so far, ERM, SRM, MDL, RLM, is defined by a hypothesis class: the learner searches a predefined set of functions. Nearest Neighbor is the first method that is not. It memorizes the training set and labels a new point by the labels of its closest neighbors, on the assumption that the features are relevant to the labels in a way that makes close-by points likely to share a label. Chapter 19 of Shalev-Shwartz and Ben-David, Understanding Machine Learning: From Theory to Algorithms (doi:10.1017/CBO9781107298019), makes that assumption precise, a Lipschitz conditional probability, and proves a finite-sample guarantee: the expected error of the 1-NN rule on examples is at most twice the Bayes error plus (Theorem 19.3). The classical results of Cover and Hart (1967) and Stone (1977) are asymptotic; the book insists, as it did in §7.4, on a bound that says what a finite sample buys under an explicit prior assumption. The chapter also proves that the exponential dependence on the dimension is not an artifact (Theorem 19.4, the curse of dimensionality) and, in its exercises, extends the analysis to the -NN rule, whose error converges to times the Bayes error (Theorem 19.5).
The instance domain carries a metric ; for the analysis with the Euclidean distance and with the 0–1 loss. For a sample and a point , let reorder the sample by distance to . The -NN rule returns the majority label among ; the 1-NN rule is ; in general, for , the -NN rule with respect to is (19.1).
A distribution over has marginal and conditional probability ; the Bayes optimal rule is , and the standing assumption is that is -Lipschitz: . In the formalization a distribution with conditional probability is written condLaw DX η: draw , then . Every distribution with a regression function is of this form, so nothing is lost.
For , , a distribution over whose conditional probability is -Lipschitz, and the result of the 1-NN rule on ,
Lemma 19.1 (the Lipschitz reduction: ); Lemma 19.2 (the expected mass of the sets among missed by an i.i.d. sample of size is at most ); Theorem 19.4 (for integer and every learning rule there is a distribution with -Lipschitz and Bayes error on which the rule's expected error is at least whenever ); Lemma 19.7 (the majority of independent Bernoulli labels errs, against a label drawn from their mean , at most times as often as ); Theorem 19.5 (the -NN bound ). Lemma 19.6, the -fold version of Lemma 19.2 with bound , is a further item.
Theorem 19.3 is the book's answer to the question it raised in §7.4: consistency results say that the 1-NN error converges to twice the Bayes error, but not how fast, and the rate necessarily depends on the distribution. The Lipschitz constant and the dimension are exactly the prior knowledge the rule relies on, and Theorem 19.4 shows through the No-Free-Lunch theorem that a sample of size exponential in is genuinely required for some distributions in the class. Theorem 19.5 quantifies what larger buys, the factor improving to , at the price of the additive term growing linearly in . On the platform, this mission introduces the conditional-probability model of a distribution over and the Bayes rule, which Chapters 24 (generative models) and the nonparametric parts of the book use again, and the box-cover argument of Lemma 19.2, a small combinatorial-probability tool of independent use.
Lemma 19.1 is a computation once the expectation over and is decomposed as the book does: sample the unlabeled points first, find the nearest neighbor, then draw the two labels; the identity and finish it. Formally the work is in the decomposition itself, which is Fubini for condLaw and the product law, and in the measurability of the rule, which the statement assumes. Lemma 19.2 is and . Theorem 19.3 covers the cube by boxes of side , applies Lemma 19.2 to the boxes and sets ; a formal proof must handle not being an integer (take boxes per side, so when , which is what the book's already allows for) and the regime , where the trivial bound suffices. Theorem 19.4 is the No-Free-Lunch theorem on the grid of spacing , plus the observation that any -valued function on the grid extends to a -Lipschitz -valued function on the cube (McShane). Lemma 19.6 is Chernoff's bound below the mean; Lemma 19.7 is the delicate one: Chernoff with the function and the inequality for , , which the book states without proof. Theorem 19.5 assembles Lemmas 19.6 and 19.7 along the four steps of Exercise 4; to reach the book's constants with an integer number of boxes one takes boxes per side and Chernoff at in Lemma 19.6, or notes that the bound is trivial unless .
Labels are Bool; bernoulliLaw p is the Bernoulli law on Bool, condLaw DX η the distribution with marginal DX and conditional probability η, and bayesRule η the Bayes rule. The cube is the subtype cube d of EuclideanSpace ℝ (Fin d), so its metric is Euclidean and its Borel structure is inherited; the Lipschitz hypothesis is LipschitzWith c η with c : ℝ≥0, together with η x ∈ [0,1] (a conditional probability). A -NN rule is a learner h with IsKNNRuleWith k φ h: for every sample of size and every there is some reordering of the sample by distance to whose first entries feed ; ties are therefore broken arbitrarily, and the theorems hold for every choice. Majority votes predict iff strictly more than half of the labels are , the book's of Lemma 19.7. The nearest-neighbor distance is nnDist S x = ⨅ i, dist x (S i).1. Expectations over are Bochner integrals against iidLaw D m (Mission I), and the expectation statements assume the rule is measurable in , the book's Remark 3.1; without it the integrals would be junk. Lemmas 19.2 and 19.6 are stated for arbitrary measurable subsets of an arbitrary measurable space, as in the book, with (for the left side is while Lean reads as ). Lemma 19.7 uses the product of Bernoulli laws on Fin k → Bool.
Two statements are given as their proofs support them, and the deviations are recorded in the item texts. Theorem 19.4 takes an integer (the grid has spacing ), fixes with before choosing the distribution (Theorem 5.1 produces a distribution per ), and concludes that the expected true error is at least (Equation (5.2) in the proof of Theorem 5.1; the book's "greater than " is what its proof gives for only in the form of that expectation). Theorem 19.5 keeps the book's constants; the drafter checked that they are reachable with an integer number of boxes. Not stated: the general weighted-average rules of §19.1 beyond (19.1), the efficient implementation of §19.3, Exercise 3 (a one-line inequality, absorbed into the proof of Theorem 19.5).
Binary classification is the exception in practice; most prediction tasks have many labels, a structured label space, or ask for a ranking. Chapter 17 of Shalev-Shwartz and Ben-David, Understanding Machine Learning: From Theory to Algorithms (doi:10.1017/CBO9781107298019) extends linear predictors to these settings through one idea: a class-sensitive feature mapping that scores a candidate label, with the prediction . A cost-sensitive loss replaces the 0–1 loss, and the generalized hinge loss (17.3), , is its convex surrogate: it upper bounds , is tight under margin, and is convex and Lipschitz in . Multiclass SVM is then regularized loss minimization for this loss, and Corollaries 17.1 and 17.2 transfer the guarantees of Chapters 13 and 14 with no dependence on the number of labels. The same construction handles ranking: a linear ranking predictor scores each item, the Kendall tau loss has a pairwise hinge surrogate, and the NDCG surrogate reduces to an assignment problem whose linear relaxation is exact by the Birkhoff–von Neumann theorem (Claim 17.3, Lemma 17.4).
Labels form a finite nonempty type ; the feature mapping takes values in as in Mission VI, and the RLM rule and the SGD of Chapters 13 and 14 are those of Missions IX and X. An argmax predictor for is any with maximizing ; a canonical one is fixed by choosing among the maximizers, and likewise a canonical maximizer in the generalized hinge loss, which gives the SGD direction . The cost is nonnegative with . For ranking, an example is a list of instances with a score vector ; the linear predictor is , the Kendall tau loss is the fraction of pairs ordered differently, using the three-valued real sign, and permutations of are Mathlib's permutations of Fin r, with doubly stochastic and permutation matrices from Mathlib.
For over , , , and the Multiclass SVM learner with : , and for every with , .
Equation (17.3). The generalized hinge loss bounds for every argmax predictor, equals it under the margin condition, and is convex and -Lipschitz in with .
Corollary 17.2. SGD for multiclass learning with examples has for every .
Equation (17.7). The permutation induced by sorting maximizes over permutation vectors (the rearrangement inequality).
Claim 17.3. The doubly stochastic matrices are the convex hull of the permutation matrices.
Lemma 17.4. The assignment LP over doubly stochastic matrices has an optimal solution that is a permutation matrix.
Further items: Remark 17.2 (the binary case recovers the hinge loss) and the Kendall tau surrogate of §17.4.1 with its convexity and Lipschitz constant.
The generalized hinge loss is the device that lets the whole convex-learning machinery of Part II run on arbitrary finite label sets and on structured outputs, and Remark 17.3's observation that the bounds of Corollaries 17.1 and 17.2 do not depend on is what makes structured prediction (§17.3) and ranking with exponentially many labelings feasible. The ranking half of the chapter shows the pattern at work: the induced permutation is an argmax over a combinatorial set (17.7), so the NDCG loss admits a generalized hinge surrogate, and its subgradient is an assignment problem, solvable by the Hungarian method or, thanks to Birkhoff–von Neumann, by linear programming.
Nothing here is machine-checked except that Mathlib contains the Birkhoff–von Neumann theorem, which the corresponding item restates in the book's form. The statements are faithful with the clarifications that ties are broken canonically, that the Kendall tau surrogate is stated for tie-free score vectors (the book's rewriting of the pairwise indicator assumes ), and that Corollary 17.1 is stated with the measurability conventions of Mission IX.
Remark 17.2 is a two-element maximum and the entry point, and Equation (17.7) is Mathlib's rearrangement inequality for monovarying functions. The properties of the generalized hinge loss are elementary: the bound by choosing , the equality by showing every term is at most and the term is , convexity as a maximum of affine functions, and the Lipschitz bound by Cauchy–Schwarz on each term. Corollary 17.1 is Mission IX's Corollary 13.9 for the generalized hinge loss, which requires verifying convexity, the -Lipschitz property from , nonnegativity and boundedness at the origin (by , finite), the measurability of the loss and of the canonical argmax predictor as functions of , and the pointwise comparison with the -loss; Corollary 17.2 is the same with Mission X's Corollary 14.12 and Claim 14.6 for the subgradient. The Kendall tau surrogate is the pairwise hinge bound under no ties, plus the convexity and Lipschitz constant of an average of hinge terms. Lemma 17.4 follows from Birkhoff–von Neumann by the averaging argument of the book, or directly from the finiteness of the permutation matrices together with the fact that a linear function on a convex hull is minimized at an extreme point.
The label set is finite, so maxima over are attained and the losses are well defined; maximizers are chosen canonically, and every statement about argmax predictors holds for any choice. The multivector and TF-IDF constructions of §17.2.1, the reductions of §17.1, structured output prediction (§17.3), the NDCG loss and its surrogate (17.8), and bipartite ranking (§17.5) are not stated; the NDCG construction would need the sorting permutation and the discount function and is left for a later revision. Exercises are not stated except 17.4 through Equation (17.7).
Trivializing readings are excluded: the -risk in Corollaries 17.1 and 17.2 is that of a genuine argmax predictor, the Lipschitz constants are the book's, and the assignment lemma asserts optimality against every doubly stochastic matrix. Welcome contributions: the Lipschitz constant of a maximum of affine functions, the measurability of a canonical argmax over a finite label set, and the extreme-point argument of Lemma 17.4.
Chapter 15 bounded the sample complexity of large-margin halfspaces by the norms of the data and of the separator, independently of the dimension. Chapter 16 of Shalev-Shwartz and Ben-David, Understanding Machine Learning: From Theory to Algorithms (doi:10.1017/CBO9781107298019) removes the remaining obstacle to using halfspaces in very high-dimensional feature spaces: computation. After embedding the data by a feature map into a Hilbert space, every SVM-like problem has the form (16.2), and the representer theorem (Theorem 16.1) says that an optimal solution lies in the span of the mapped examples. Consequently the problem can be rewritten in terms of the coefficients and the kernel alone (16.3): this is the kernel trick. The chapter exhibits the polynomial and Gaussian kernels (Examples 16.1 and 16.2), characterizes the functions that are kernels as the positive semidefinite ones (Lemma 16.2), and shows that the SGD solver for Soft-SVM of §15.5 can be run entirely on kernel evaluations (Lemma 16.3).
A feature map takes values in a real Hilbert space, a complete real inner product space; its kernel is , and a function implements an inner product in some Hilbert space if it is the kernel of some feature map into some Hilbert space, quantified existentially in the universe of the domain. The Gram matrix of a sample is . The general objective (16.2) is with arbitrary and nondecreasing on . The SGD procedure of §15.5 in the feature space keeps with (iterates indexed from ) and, at each step, for the chosen index , adds to when ; its kernelized version keeps coefficients with and tests . Both are driven by the same sequence of chosen indices, which stands for the uniformly random choices of the book.
If is nondecreasing on and the problem (16.2) has an optimal solution, then there is such that is an optimal solution.
Equation (16.3). For the objective equals .
Example 16.1. The polynomial kernel on is for the monomial map into .
Example 16.2. On , the map into has ; the Gaussian kernel on is a kernel for every .
Lemma 16.2. A symmetric is a kernel iff all its Gram matrices are positive semidefinite.
Lemma 16.3. The kernelized SGD reproduces the feature-space SGD: for all , hence the outputs coincide.
Further items: Exercise 16.3 (kernel ridge regression: minimizers of the coefficient objective give minimizers of the ridge objective, and gives one), Exercise 16.4 ( is a kernel), Exercise 16.6 (the nearest-class-mean rule is a halfspace).
The representer theorem is the reason kernel methods exist: it reduces an optimization over an arbitrary Hilbert space to one over , and Lemma 16.2 says the reduction needs nothing but a positive semidefinite similarity function, so one may design the kernel directly, as in the string example of §16.2.1. Lemma 16.3 makes the connection to Chapter 14 concrete: a first-order method never leaves the span of the examples, so it too can be run on the Gram matrix. Together with Chapter 15, the chapter closes the book's treatment of linear predictors: expressive through the embedding, statistically controlled through the margin, and computable through the kernel.
Nothing here is machine-checked. The statements are faithful to the book with two clarifications: the representer theorem assumes the existence of an optimal solution, which the book's proof also assumes, and the kernel-SGD equivalence is stated for a fixed sequence of chosen indices, which is the content of the book's inductive proof.
Equation (16.3) and Exercise 16.6 are inner-product algebra and the entry points. The representer theorem needs the orthogonal decomposition with orthogonal to the span, which is available in Mathlib for the finite-dimensional, hence complete, subspace spanned by the , together with the Pythagorean identity and the monotonicity of . Example 16.1 is the multinomial expansion of as a sum over index vectors, packaged as an inner product in the Euclidean space indexed by . Example 16.2 needs the summability of and the exponential series, and, for the general Gaussian kernel, either an explicit construction or Lemma 16.2 together with the positive semidefiniteness of the Gaussian Gram matrix. Lemma 16.2 in the nontrivial direction is the construction of the reproducing kernel Hilbert space: the pre-Hilbert space of finite combinations of the functions , the inner product defined through , its well-definedness and positive definiteness from the Gram matrices, and the completion, which Mathlib provides for inner product spaces. Lemma 16.3 is an induction on with the identity . Exercise 16.3 combines the representer theorem with the identity between the two objectives on the span and the first-order condition for a convex quadratic; Exercise 16.4 needs a feature map such as , or the positive semidefiniteness of the min matrix.
Hilbert spaces are real, complete inner product spaces; the existential in IsKernel ranges over Hilbert spaces in the universe of the domain, which the reproducing kernel construction respects. The objective (16.2) has real-valued , so the hard-SVM instance with is not covered by the representer item as stated. The SGD procedures are deterministic given the index sequence; the random choice of indices is not modelled, exactly as in Lemma 16.3's proof. The string kernel of §16.2.1 and Exercise 16.1, the kernelized Perceptron (Exercise 16.2), Exercise 16.5 and part (2) of Exercise 16.6 are not stated.
Trivializing readings are excluded: the representer theorem asserts optimality against every , Lemma 16.2 is a biconditional with symmetry assumed as the book does, and the kernels of the examples are exhibited with explicit feature spaces where the book gives them. Welcome contributions: the orthogonal decomposition against a finite span, the multinomial identity of Example 16.1, and the reproducing kernel Hilbert space construction behind Lemma 16.2.
The sample complexity of learning halfspaces in grows with , which is bad news when features are many or infinite. Chapter 15 of Shalev-Shwartz and Ben-David, Understanding Machine Learning: From Theory to Algorithms (doi:10.1017/CBO9781107298019) introduces the support vector machine, the learning rule that replaces dimension by geometry. Among the halfspaces separating a sample, Hard-SVM picks the one of largest margin, the distance from the hyperplane to the nearest example (Claim 15.1, Lemma 15.2); if the data are separable with margin and lie in a ball of radius , the resulting classifier has error whatever the dimension (Theorem 15.4), and the Perceptron of Chapter 9 makes at most updates (Remark 15.1). Soft-SVM drops separability by allowing slack variables, and Claim 15.5 identifies it with regularized hinge-loss minimization, so that the stability theory of Chapter 13 applies: the hinge loss is -Lipschitz (Claim 15.6), and Corollary 15.7 gives an expected-risk bound depending only on the norms of the data and of the comparison halfspace. The chapter closes with the optimality conditions that explain the name: the Hard-SVM solution is a combination of the examples on the margin (Theorem 15.8, via the Fritz John conditions, Lemma 15.9).
Vectors live in as in Mission VI; labels are real numbers, with as a hypothesis wherever the book needs it. A sample is linearly separable if some halfspace has for all , and the margin of on the sample is . Hard-SVM solutions are minimizers of subject to , formalized as a relation; the minimizer is unique whenever the constraints are feasible, and the homogenous version sets . A distribution over is separable with a -margin if some unit (and ) has and almost surely. Soft-SVM is the problem under , ; its homogenous form is the regularized loss minimization rule of Mission IX for the hinge loss , and the 0–1 loss is . Expectations over samples are integrals against , with the measurability conventions of Mission IX.
For on almost surely, , and the Soft-SVM learner with : , and for every with , .
Claim 15.1. The distance from to with is .
Lemma 15.2. For a sample with both labels present, the normalized Hard-SVM output has unit norm and margin at least that of every unit-norm halfspace.
Theorem 15.4. Under homogenous -separability, with probability at least the 0–1 risk of the Hard-SVM output is at most .
Claim 15.5. Every feasible slack vector has average at least the hinge loss, and the hinge losses are feasible slacks.
Claim 15.6. For , is -Lipschitz.
Corollary 15.7, first parts. For every , and are at most .
Theorem 15.8. The homogenous Hard-SVM solution is with .
Lemma 15.9. Fritz John conditions, in the correct form with a multiplier on .
Further items: Exercise 15.1 (the two Hard-SVM formulations agree) and Exercise 15.2 (the Perceptron makes at most updates).
SVM is the bridge between the statistical theory of Part I and the kernel methods of Chapter 16: because the bounds of Theorem 15.4 and Corollary 15.7 involve only , and , the same algorithm can be run after an embedding into a huge or infinite-dimensional feature space, and Theorem 15.8, that the solution lies in the span of the examples, is what makes the embedding computable. Corollary 15.7 is also the first place where the abstract machinery of Chapter 13 is applied to a specific learning rule.
Nothing here is machine-checked. One correction is built in: the Fritz John lemma is stated with the multiplier on and nonnegative multipliers not all zero, since the printed form, with unweighted and unrestricted, fails already for and on the line. Theorem 15.8 is unaffected: its constraints are affine, so the multiplier on can be taken to be .
Claim 15.6 and Claim 15.5 are short inequalities and the intended entry points, and Exercise 15.2 is Theorem 9.1 of Mission VI with and . Claim 15.1 is the book's computation with the foot of the perpendicular and a Pythagorean inequality for every other point of the hyperplane, packaged as an infimum distance. Lemma 15.2 is the rescaling argument of the book, together with the observation that both labels force ; Exercise 15.1 needs the positivity of the optimal margin on a separable sample. Corollary 15.7 is Corollaries 13.8 and 13.9 of Mission IX for the hinge loss, whose Lipschitz constant is only on the support of , so the stability argument must be run with the almost-sure bound; the 0–1 clause is the pointwise inequality . Theorem 15.4 is the content of §26.3: Rademacher complexity of the class of norm-bounded halfspaces, the contraction lemma for the ramp loss, the observation that the Hard-SVM output has zero ramp loss on the sample and norm at most , and a concentration step, all of which will be items of the Rademacher mission. Theorem 15.8 is the KKT theorem for a strictly convex quadratic with affine constraints (Slater's condition holds), and Lemma 15.9 is the general Fritz John theorem for differentiable data, whose proof goes through a separation or penalty argument; neither is in Mathlib.
Hard-SVM and Soft-SVM are relations and learners, not programs; the margin is a real infimum over the sample; the ramp loss is defined but its bounds belong to Chapter 26. Theorem 15.4 is stated for any learner that returns the Hard-SVM solution whenever the sample is feasible, which is almost surely the case under the margin assumption, and bounds the failure event in outer measure. Corollary 15.7 carries the measurability conventions of Mission IX. The Fritz John lemma is stated correctly rather than as printed. The duality of §15.4, the SGD implementation of §15.5 (whose guarantee needs the trajectory bound of §14.5.3 rather than Theorem 14.11 as stated in Mission X), Exercises 15.3 and 15.4, and Remark 15.2 are not stated.
Trivializing readings are excluded: both labels must be present for the normalized Hard-SVM output, the margin assumption and the support condition are almost sure with respect to , and the risks are genuine integrals. Welcome contributions: the uniqueness of the Hard-SVM minimizer, the KKT conditions for affine constraints, and the pointwise comparison of the 0–1, ramp and hinge losses.
Chapter 3 of The Principles of Deep Learning Theory by D. A. Roberts and S. Yaida (arXiv:2106.10165) is the book's first complete example of its effective-theory method. For deep linear networks at initialization, the two- and four-point correlators of the network outputs can be computed exactly at any width and depth. The resulting formulas exhibit, in the simplest setting, the phenomena that organize the rest of the book: criticality of the weight variance , non-Gaussianity that grows with depth, and the depth-to-width ratio as the parameter controlling deviations from the infinite-width limit. This mission formalizes §§3.1–3.3. It is the second mission in a series formalizing the book (namespace DeepLearningTheory).
A deep linear network with widths (all positive) and zero biases maps an input to preactivations
(eqs. 3.1–3.2 with ). At initialization all weights are independent centered Gaussians with (eq. 3.4), with a layer-independent . For inputs let (eq. 3.9).
For every layer , a single input , and neurons ,
The closed forms show that a deep linear network is exactly Gaussian only in the strict infinite-width limit: at criticality the connected four-point correlator (3.29)–(3.30) is for equal widths , the first appearance of the depth-to-width ratio as the book's emergent scale. The same recursive method is reused for nonlinear networks in Chapters 4–5. The results are exact computations in the book; this mission formalizes them.
Each correlator is an expectation of a polynomial in exponentially many Gaussian weights. The book's recursion uses that the layer- weights are independent of the layer- preactivations, followed by Wick contraction of the two or four new weights. In Lean this requires independence of a weight family from a measurable function of the earlier layers, integrability of products of Gaussian polynomials, and careful handling of the Kronecker-delta bookkeeping in the sums (3.23).
n : ℕ → ℕ with n 0 the input dimension; neural indices are . Weights are a random field W : Ω → ℕ → ℕ → ℕ → ℝ on a probability space, only entries with , , are used.IsLinearNetInit P n CW W states mutual independence of all these weights and that each has law gaussianReal 0 (CW / n (ℓ-1)).linearPreact n (W ω) x ℓ i is ; inputKernel (n 0) x₁ x₂ is ; kron and wickDelta4 are the Kronecker delta and the three-term tensor structure.Chapter 4 of The Principles of Deep Learning Theory by D. A. Roberts and S. Yaida (arXiv:2106.10165) begins the analysis of general multilayer perceptrons (MLPs) with a nonlinear activation function at initialization. The first layer is exactly Gaussian; the second layer is the first place where non-Gaussianity appears, as a connected four-point correlator suppressed by and governed by the four-point vertex . This mission formalizes §§4.1–4.2, which are exact at any width. It is the third mission in a series formalizing the book (namespace DeepLearningTheory) and reuses the definitions of Mission II (Deep Linear Networks at Initialization).
An MLP with widths and activation maps inputs to preactivations
(eqs. 4.2, 4.30). At initialization all biases and weights are independent centered Gaussians with and (eqs. 4.3–4.4). The first-layer metric is (eq. 4.8), and denotes the expectation over a centered Gaussian vector with covariance (eq. 4.25), with .
with the four-point vertex (eq. 4.40).
These identities are the base case of the book's recursion (Chapter 4.3 onward) for the kernel and four-point vertex in deeper layers, and they show concretely that a finite-width network is not a Gaussian process: the connected correlator is generically nonzero for nonlinear . The results are exact computations in the book; this mission formalizes them.
The second layer is a Gaussian conditional on the first layer, with a random covariance (the stochastic metric, eq. 4.36). Turning this into unconditional correlators requires conditioning on the first-layer preactivations, independence of different first-layer neurons, and the identification of first-layer activation correlators with Gaussian expectations over the metric , which may be degenerate (e.g. repeated inputs). Integrability of against Gaussians must be controlled.
kron, inputKernel, WeightIndex. New definitions: mlpPreact (), IsMLPInit (independent Gaussian biases and weights with layer-dependent ), firstLayerMetric ( on finitely many inputs), gaussAvg (, via Mathlib's multivariateGaussian, which handles singular positive-semidefinite ), and HasPolyGrowth.Fin D (for the specific statements, or inputs, possibly repeated). is assumed where the formulas divide by .Chapter 13 showed that convex-Lipschitz-bounded and convex-smooth-bounded problems are learnable by regularized loss minimization; Chapter 14 of Shalev-Shwartz and Ben-David, Understanding Machine Learning: From Theory to Algorithms (doi:10.1017/CBO9781107298019) shows how to learn them with the simplest possible algorithm. Gradient descent moves against the gradient with a fixed step size and outputs the average of its iterates; its analysis (Lemma 14.1) is a single telescoping identity that bounds for any sequence of directions , and this generality is the whole point. It gives the rate for convex Lipschitz functions (Corollary 14.2), extends to nondifferentiable functions through subgradients (Definition 14.4, Lemmas 14.3 and 14.7), and, because it never used that the directions were gradients, extends to stochastic gradient descent, in which each direction is random with a subgradient as its conditional expectation (Theorem 14.8). Applied to the risk with a fresh example at each step, SGD is a learning algorithm whose sample complexity is the iteration count: examples for convex-Lipschitz-bounded problems (Corollary 14.12) and for convex-smooth-bounded ones (Theorem 14.13, Corollary 14.14). A projected, decreasing-step variant for strongly convex objectives has rate (Theorem 14.11).
Hypotheses are vectors in ; convex, Lipschitz and smooth losses, convex-Lipschitz-bounded and convex-smooth-bounded problems, and strong convexity are those of Mission IX. A vector is a subgradient of at if for all . The iterates of an update rule , are indexed from , and the output after steps is . The randomness of SGD is modelled as the chapter uses it in §14.5: a sample drawn i.i.d. from and an oracle with , where is a stochastic subgradient oracle for if for every . This is the book's condition in the case where the direction depends on the past only through and on fresh randomness, which is what every application in the book does; the expectation is then an integral over . For learning, is a subgradient of at , so that is a subgradient of at (14.13). The projection of onto a convex set is a nearest point of , and the strongly convex variant projects after each step with step size .
For a convex , , a measurable oracle with and , any with , and : ; and for every , gives .
Lemma 14.1. For any directions, ; with , and the average is at most .
Corollary 14.2. Subgradient descent on a convex -Lipschitz with has for every , and gives .
Lemma 14.7. A convex on is -Lipschitz iff all its subgradients have norm at most .
Lemma 14.9. For the projection of onto a convex and , .
Theorem 14.11. For -strongly convex , a closed convex , an oracle with and any , the projected variant with has .
Corollary 14.12. SGD on the risk of a convex-Lipschitz-bounded problem with examples has for every .
Theorem 14.13. For convex, -smooth, nonnegative losses and , SGD with gradient directions has .
Corollary 14.14. For a convex-smooth-bounded problem with and any , SGD with and has for every .
Further items: Lemma 14.3, Claims 14.5, 14.6 and 14.10, and the hinge-loss subgradient of Example 14.2.
SGD is the algorithm behind most of modern machine learning, and Theorem 14.8 is its basic guarantee: dimension-free, independent of the form of beyond convexity, and with a sample complexity matching the regularization bound of Chapter 13 up to a constant. Lemma 14.1 isolates the deterministic identity that makes both gradient descent and its stochastic version work, and Lemma 14.7 is the bridge between the Lipschitz assumption of Chapter 12 and the bounded directions the analysis needs. The learning corollaries make the point that runs through Part II of the book: for convex problems, optimization and learning are the same activity, and one pass over the data suffices.
Nothing here is machine-checked. The chapter's statements are essentially correct, and the formalization records the reading choices rather than corrections: the i.i.d.-oracle model of the randomness, the subgradient form of gradient descent, the bound at every point of the ball rather than at a minimizer, and, in Corollary 14.14, the assumptions and under which the derivation from Theorem 14.13 goes through.
Lemma 14.1 is a completed square and a telescoping sum and is the intended entry point; the clause is the substitution of . Corollary 14.2 is Lemma 14.1 with Jensen's inequality for the average and the subgradient inequality at each iterate, plus Lemma 14.7 to bound the directions. The subgradient facts need convex analysis: Lemma 14.3 in the direction "convex implies subgradients exist" is the supporting hyperplane theorem on , which Mathlib does not offer directly; Claim 14.5 uses the first-order characterization of convexity for differentiable functions; Lemma 14.7's "Lipschitz implies bounded subgradients" is the book's one-line argument along . Theorem 14.8 is Lemma 14.1 plus the conditioning argument of the book, which in the i.i.d.-oracle model is Fubini on the product : the iterate is a measurable function of , and integrating over first gives . Theorem 14.11 adds the projection lemma, the strong-convexity inequality of Claim 14.10, the telescoping of and the harmonic sum ; the second-moment hypothesis makes finite inductively. Corollary 14.12 is Theorem 14.8 for with the oracle of (14.13), which requires exchanging a subgradient inequality with the integral over . Theorem 14.13 replaces the Lipschitz bound by self-boundedness, , and rearranges; Corollary 14.14 is its arithmetic under the added assumptions. In all expectation statements the measurability of the iterates in the sample, from the measurability of the oracle, is a routine but necessary lemma.
Iterates are defined by structural recursion, so no argmin is chosen; the sample-driven SGD stops after updates; the projection onto is a chosen nearest point, unique for closed convex . Bounds are stated for every in the ball (or in ) rather than for a minimizer, which is what the proofs give and is stronger. The oracle bound is required surely (the book: with probability ); the almost-sure version is a routine extension. The second-moment hypothesis of Theorem 14.11 is a lower Lebesgue integral, so that a non-integrable oracle cannot satisfy it vacuously. The learning corollaries assume a measurable loss, nonnegative and bounded at the origin, so that the risks are genuine integrals, and a measurable selector of subgradients. Variable step sizes (§14.4.2), other averaging schemes (§14.4.3), SGD for regularized loss minimization (§14.5.3) and the exercises are not stated.
Trivializing readings are excluded: the expectations are over the product law of the examples with measurable integrands, the subgradient conditions are pointwise inequalities, and the iteration counts are the book's. Welcome contributions: Lemma 14.1 as a reusable telescoping lemma, the measurability of the SGD iterates, and the Fubini step that turns an oracle condition into the inequality (14.10).
Chapters 12 and 13 of Shalev-Shwartz and Ben-David, Understanding Machine Learning: From Theory to Algorithms (doi:10.1017/CBO9781107298019) leave binary classification for the general framework in which a hypothesis is a vector and the loss is a convex function of . Convexity makes the ERM problem tractable (Lemma 12.11), but Examples 12.8 and 12.9 show that convexity, even with a bounded class, does not by itself make a problem learnable: one-dimensional linear regression with the squared loss defeats every learner. The chapter therefore isolates two families, the convex-Lipschitz-bounded and the convex-smooth-bounded problems (Definitions 12.12 and 12.13), and Chapter 13 proves that both are learnable, not by ERM but by Regularized Loss Minimization with Tikhonov regularization, . The proof goes through a new idea: stability. Theorem 13.2 expresses the expected overfitting exactly as the expected effect of replacing one training example, strong convexity of the regularized objective bounds that effect (Lemma 13.5, Corollaries 13.6 and 13.7), and balancing the regularization against the fit gives oracle inequalities (Corollaries 13.8 and 13.10) and sample-complexity guarantees (Corollaries 13.9 and 13.11), with ridge regression as the worked example (Theorem 13.1).
Hypotheses are vectors in with the Euclidean norm, as in Mission VI; risk, empirical risk, the product law of a sample and agnostic PAC learnability are those of Mission I. A problem is convex when is convex and every is convex; it is convex-Lipschitz-bounded with parameters when moreover on and every is -Lipschitz on , and convex-smooth-bounded with parameters when every is nonnegative and differentiable with a -Lipschitz gradient. Lipschitzness and smoothness are required on all of because the RLM rule is unconstrained and its outputs need not lie in . The RLM rule is a relation: is an output on if it minimizes over , and a learner implements the rule if all its outputs are minimizers. For the losses of the chapter the minimizer exists and is unique. Given and a further example , is with replaced by ; a learner is on-average-replace-one-stable with rate if for every distribution. Strong convexity is Mathlib's StrongConvexOn, which is Definition 13.4 verbatim.
Expectations over samples are integrals against product laws. For them to be genuine, the theorems about arbitrary learners assume a jointly measurable loss bounded by a constant and a measurable learner, and the theorems about RLM assume a jointly measurable, nonnegative loss bounded at the origin and a measurable learner; for RLM the latter is automatic, since the minimizer is unique.
For a convex-Lipschitz-bounded problem with parameters and the RLM learner with : for every distribution, every and every , ; hence for every and , .
Examples 12.8–12.9. Linear regression on with the squared loss is not agnostic PAC learnable, over or over .
Theorem 13.2. For any measurable learner and , equals the replace-one expectation of (13.6).
Lemma 13.5. is -strongly convex; a strongly convex function plus a convex one is strongly convex; at a minimizer of a -strongly convex , .
Corollary 13.6. For a convex -Lipschitz loss and , RLM satisfies for every , is stable with that rate, and has .
Corollary 13.7. For a convex, nonnegative, -smooth loss and , the replace-one expectation is at most , and at most if .
Corollary 13.8. for every .
Corollary 13.10. .
Corollary 13.11. A convex-smooth-bounded problem with is learned by RLM with once .
Theorem 13.1. Ridge regression on the unit ball with labels in , and has .
Further items: Lemma 12.11, the hinge loss as a convex surrogate of the 0–1 loss, the stability-implies-no-overfitting remark of §13.2, and the ridge regression system (13.4)–(13.5).
Stability is the third route to learnability in the book after uniform convergence and nonuniform learnability, and the only one that applies to convex-Lipschitz-bounded problems in general, for which uniform convergence can fail (the book's Exercise 13.2). The chain from strong convexity through replace-one stability to oracle inequalities is the template for the analysis of every regularized learner, and Theorem 13.2 is an exact identity, not a bound. Ridge regression, support vector machines (Chapter 15) and the regularized algorithms of later chapters are all instances.
Nothing here is machine-checked. The sample sizes of Corollary 13.11 and Theorem 13.1 are the book's . Chaining Corollary 13.10 as printed would need , but the derivation of Corollary 13.7 actually gives the stability rate , with which suffices.
Lemma 12.11 and the hinge surrogate are direct. Lemma 13.5 is elementary but part (3) needs the limit of the strong-convexity inequality at a minimizer. Examples 12.8–12.9 require constructing the two finitely supported distributions of the book and computing the risk of a fixed output on each; the probability that all examples are of the second type is at least under both, and the deterministic learner's output on that sample decides which distribution defeats it. Theorem 13.2 is the exchangeability argument of the book: because swapping and preserves the product law; the formal work is the measure-preserving transposition on and the integrability of the functions involved. Corollaries 13.6 and 13.7 follow the book's pointwise derivation from (13.7) to (13.11) and (13.12) to (13.14), where the smooth case uses the self-boundedness of nonnegative smooth functions and the inequality ; passing to expectations then uses Theorem 13.2 and, for the smooth case, the symmetry . Corollaries 13.8 to 13.11 are the arithmetic of the book once (13.16), , is in hand, with the corrected constant for 13.11. The ridge system is the gradient condition for a strongly convex quadratic, and Theorem 13.1 is Corollary 13.11 applied to , which is -smooth with on the support. In every expectation statement the measurability of for the RLM rule, which the theorems take as a hypothesis, is provable from uniqueness of the minimizer and is worth a lemma.
Losses are real-valued functions of a vector and an example; Lipschitz and smoothness conditions are global on . The RLM rule is a minimizer relation with the regularization parameter as an explicit argument, and Corollary 13.9's learner uses a parameter depending on . Stability quantifies over and averages over the replaced index. Expectation statements carry measurability hypotheses that make every integral genuine, and the theorems about arbitrary learners assume a bounded loss. The minimum over is stated as "for every ", so no minimizer is needed. Definitions 12.1–12.9 and Claims 12.4–12.9 (general convex analysis) are not restated, nor are Examples 12.10–12.11, the discussion of §12.3 beyond the surrogate property, Remark 13.1, and Exercises 12.1–12.4 and 13.1–13.2.
Trivializing readings are excluded: the nonlearnability examples are stated as negations of the framework's learnability, the stability identity is an equality with both sides genuine integrals, and the constants of the oracle inequalities are the book's. Welcome contributions: the transposition invariance of product laws behind Theorem 13.2, the bound for RLM outputs, the measurability of the RLM minimizer, and the self-boundedness inequality (12.6).
The Shape Zero model (Shape Zero LLC, unpublished) aims to obtain all three factors of the Standard Model gauge structure — , and — from a single linear-algebra statement applied at three node sizes. A node carrying oscillator pairs has a -dimensional real state space with a complex structure . Within the model, the couplings that do no net work (passive couplings) are the symmetric matrices, and those that respect are the ones commuting with it. The claim is that the couplings satisfying both conditions form a real vector space of dimension exactly , which is the dimension of the unitary Lie algebra (Unitary group):
| node size | admissible dimension | Lie algebra |
|---|---|---|
| 1 | 1 | |
| 2 | 4 | |
| 3 | 9 |
The dimension count has so far been checked numerically for only, giving . A machine-checked proof covers every , and it is the claim a physicist examining the model would check first.
What this mission does NOT prove. This mission proves the linear algebra: symmetric matrices commuting with form a space of dimension . It does not prove the physics step that passivity forces a coupling to be symmetric. That step is a separate premise of the model, and a completed mission must not be read as establishing it.
Fix a natural number . Consider real matrices, with rows and columns indexed by two copies of , so that each matrix is written in block form with blocks:
Let be the identity matrix and define the standard complex structure
which satisfies . In the Lean development this matrix is PassivityUn.stdJ n, and the index type is PassivityUn.Blk n, the disjoint union of two copies of Fin n.
Two real linear subspaces of the -dimensional space of such matrices are defined:
symm n: the symmetric matrices, ;commJ n: the matrices commuting with , .The admissible coupling class admissible n is their intersection:
This is PassivityUn.admissible_finrank. It asserts the exact dimension for all at once, not for a particular node size.
The result itself. The goal identifies the admissible coupling class with the real form of the Hermitian matrices, the space whose dimension is that of (Hermitian matrix). Applied at it gives the dimensions , and , which the Shape Zero model matches with , and . Without a proof for general , the model rests on a finite numerical check.
Formalizing it. The underlying fact is standard linear algebra, a special case of the correspondence between real matrices commuting with a complex structure and complex-linear maps (Linear complex structure). No machine-checked statement of this exact dimension count was found in the platform library. The mission produces a verified, general- statement whose hypotheses are fully explicit, and it separates the verified linear algebra from the unverified physical premise.
Every step is standard linear algebra, so the difficulty is in the formal bookkeeping rather than the mathematics. The dimension of a subspace defined by equations is not computed by any Mathlib tactic. It has to be obtained by exhibiting an explicit linear equivalence with spaces of known dimension, and that requires moving between the matrix indexed by a disjoint union and its four blocks. Checking small cases numerically, as has already been done, does not extend to a statement about every .
ℝ), not complex. The complex structure enters only through the fixed real matrix .Fin n ⊕ Fin n (PassivityUn.Blk n) rather than Fin (2n), so that block decomposition via Mathlib's Matrix.fromBlocks is direct. The first copy of Fin n indexes the upper/left blocks.Module.finrank ℝ. The ambient space is finite-dimensional, so the convention that finrank of an infinite-dimensional space is never applies.The development needs only Mathlib's block matrices, transpose, linear maps and finrank. The block-characterization lemmas (M2, M3) are reusable for any statement relating real matrices commuting with to complex matrices. Contributions are welcome on the milestones and on the assembling isomorphism.
Mathlib.Data.Matrix.Block (block matrices, Matrix.fromBlocks). https://leanprover-community.github.io/mathlib4_docs/Mathlib/Data/Matrix/Block.htmlThe g-factor of a particle, nucleus or atom is the dimensionless number that measures its magnetic moment in units of the moment a classical particle with the same charge and angular momentum would have. Because it is both measured and computed to very high precision, small discrepancies between measured and predicted g-factors are used as tests of the Standard Model; the electron g-factor is known to about two parts in , and the muon g-factor has for two decades shown a several-standard-deviation tension between experiment and theory.
This mission formalizes the mathematical content of the Wikipedia article g-factor (physics): the definitions it gives, the elementary identities it states between them, and the numerical claims it makes about the experimental data.
All vectors live in , written as functions , with component playing the role of the component.
diracMagneticMoment).nuclearMagneton), the moment of a nucleon or nucleus with spin is (nuclearMagneticMoment).bohrMagneton) and electron orbital moment (electronOrbitalMagneticMoment).classicalMagneticMoment) and the angular momentum is (classicalAngularMomentum).The article defines the g-factor as the ratio of a particle's magnetic moment to the one "expected of a classical particle of the same charge and angular momentum", and says "by a quantum-mechanical argument analogous to the derivation of the classical magnetogyric ratio". The goal makes that classical baseline precise: for a system whose charge-to-mass ratio is the same for every particle (, ), with total charge and total mass ,
The goal is the statement that fixes the normalization of every g-factor in the article: it says that a classical body with uniform charge-to-mass ratio has gyromagnetic ratio exactly , i.e. , so any deviation from (such as ) is a genuinely non-classical effect. The milestones pin down the conventions (Dirac versus nuclear magneton, sign conventions for the electron orbital moment) and check the numerical claims the article makes from its data. None of these results is new; the contribution is a machine-checked, convention-explicit record of them.
The mathematics is elementary. The work is in the conventions: division by a mass or by is total in Lean and returns at , so positivity of masses and of must be carried explicitly, and the numerical milestones must be stated with the exact decimal values of the source rather than rounded ones.
Fin 3 → ℝ; the cross product is Mathlib's crossProduct. Component index 2 is the axis.Flow matching models a changing probability distribution using a time-dependent velocity field. A conditional model specifies a density and a velocity separately for each conditioning point. The mathematical question is whether those conditional descriptions determine a velocity for the mixture distribution. This mission concerns the continuity-equation formulation of Theorem 1 of Lipman, Chen, Ben-Hamu, Nickel, and Le, Flow Matching for Generative Modeling (ICLR 2023). The source is arXiv:2210.02747v2, Section 3.1 and Appendix A.
Fix a natural number and let . The conditioning distribution is a Borel probability measure on . At time , position , and conditioning point , write for the conditional density and for the conditional velocity. The variable is integrated against Lebesgue measure; is integrated against . These roles remain distinct even though both variables take values in the same space.
The conditional flux is . The marginal density, marginal flux, and marginal velocity are defined by
These definitions express equations (6) and (8) using a probability measure rather than a data-density function. This representation also allows discrete conditioning distributions. Every conditional density is strictly positive and normalized on , jointly measurable in , and integrable in at each fixed .
The divergence of a differentiable vector field is the sum of the diagonal entries of its derivative. A density and velocity satisfy the classical continuity equation when their flux is spatially differentiable and the density has time derivative equal to minus that divergence.
The goal asserts that is a positive probability density for every and that
The hypotheses require the conditional continuity equation for -almost every conditioning point, at each interior time and spatial point. They also specify a sufficient local domination package for differentiation under the integral. This is an explicit classical interpretation of the regularity qualification in the proof of Theorem 1.
Four supporting targets isolate the mathematical assertions used by this formulation: the probability-density property of equation (6); time differentiation under the conditioning integral; spatial divergence under the conditioning integral; and the velocity/flux identity corresponding to equation (8). The source contains these equations and operations rather than separately numbered supporting lemmas, so the milestone titles identify the relevant equation or proof passage.
The deliverable is a checked interface for passing from a measurable family of conditional continuity equations to the continuity equation of its mixture. It records which variables are differentiated, which measure is used for averaging, where positivity is needed, and which assumptions justify each analytic operation. The time and spatial differentiation lemmas are stated for general measures and integrands, making them reusable outside this particular probability model.
The mathematical result is already proved in the cited paper. The uploaded theorem items are open formalization targets, with explicit proof placeholders. Successful local compilation checks their types and imports; it does not establish their conclusions. The definition module contains no proof placeholders.
Pointwise differentiability of every conditional function does not by itself justify differentiating an integral over the conditioning variable. The regularity predicates therefore require a neighborhood independent of that variable, an integrable bound for the derivative norm throughout that neighborhood, and almost-everywhere measurability of the integrand and derivative. Time and space receive separate predicates because their derivatives take values in different spaces.
There is also a distinction between density normalization in and integrability in at a fixed position. The formal assumptions record both. A probability measure on the conditioning space does not make every measurable function integrable. These conditions prevent the totalized Bochner integral from silently supplying a default value where an intended integral fails to exist.
Space is represented by Fin d → ℝ, with its standard finite-product Borel structure and Lebesgue measure. Its norm is the standard product norm used by mathlib. All finite dimensions, including dimension zero, are included. Time-dependent functions are defined on all real times, while density assumptions apply on the closed unit interval and derivative conclusions apply on its interior. No endpoint time derivative is asserted.
The regularity package is one sufficient realization of the source's Leibniz-rule assumption, not a claim to the weakest possible hypotheses. Conditional continuity equations may hold almost everywhere in the conditioning variable; their exceptional sets may depend on the fixed time and position. Spatial differentiability of the marginal flux is part of the conclusion, so the equation cannot be satisfied merely through the default value of an undefined derivative.
The target is the PDE formulation. It does not assert existence of a global ODE flow, uniqueness of transported measures, or equality with a flow pushforward. Those require a separate transport development. It also asserts no endpoint approximation to a data distribution and no theorem about optimization, neural networks, or Gaussian paths. No marginal continuity equation or differentiation–integration interchange is assumed as an input.
Required infrastructure consists of Bochner integration, finite-dimensional differentiation, finite sums of derivative coordinates, and product-measure integration. Contributions may prove the supporting targets or the goal directly while preserving their statements and the distinction between classical PDE and flow-transport claims.
0df444a360eaa60ab8c11dca51a86af692955474. Differentiation under the integral.Since the 2019 revision of the SI, every unit in the system is fixed by assigning exact numerical values to seven defining constants: the caesium hyperfine transition frequency , the speed of light , the Planck constant , the elementary charge , the Boltzmann constant , the Avogadro constant and the luminous efficacy . Six of the seven base units — every one except the mole — therefore carry in their definition, and the caesium standard is the anchor of the whole system. The first caesium clock was built by Louis Essen and Jack Parry in 1955 (Nature 176, 280); the caesium frequency was tied to the ephemeris second by Markowitz, Hall, Essen and Parry in 1958 (Phys. Rev. Lett. 1, 105); the 13th CGPM adopted the caesium definition of the second in 1967, the CIPM added the "atom at rest at " qualification in 1997, the metre was redefined in terms of and the second in 1983, and the 26th CGPM fixed the present constant-based system in 2018, effective 2019 (Resolution 1 (2018)).
The audience for this mission is anyone who relies on those conversion factors being right: metrology, unit-aware computation, and formal libraries that want a machine-checked statement of what the SI actually fixes, rather than a table copied by hand.
All seven defining constants are exact decimal numbers, hence exact rationals:
each understood as the numerical value of the constant in its SI unit (hertz, metres per second, joule seconds, coulombs, joules per kelvin, reciprocal moles, lumens per watt).
From these one forms the four parameters of the caesium-133 hyperfine transition radiation:
its period, wavelength, photon energy and photon mass equivalent. The optical units bring in one further radiation, of frequency Hz, with period , wavelength , photon energy and luminous energy per photon .
Each line is the assertion that the displayed expression has numerical value exactly .
The radiation parameters ( and the 1967 definition of the second; and the claim that it lies between and cm; J; ); the individual base-unit relations for the kilogram, ampere, kelvin and candela; the derived units of energy, power, force, pressure and absorbed dose; the electromagnetic units, including as an exact multiple of ; the optical units and the parameters of the THz radiation; the katal; and finally the dependence statement: the formulas for the mole and the coulomb return the same value whatever the caesium frequency, while those for the second, metre, kilogram, ampere, kelvin and candela separate distinct positive frequencies.
What the results give is a machine-checked transcription of the exact arithmetic content of the 2019 SI: every coefficient in the table of base and derived units, checked against the defining constants rather than against another table. Downstream, a unit-conversion or dimensional-analysis development can cite these identities instead of re-deriving or re-typing sixteen-digit decimals, where a single transposed digit is a silent error.
What formalizing adds is faithfulness checking, not new mathematics. Every statement in this mission is a true identity between exact rational numbers; none of them is open in the mathematical sense.
This mission is arithmetically easy on purpose, and that should be stated plainly: each target is an equality between explicit rational numbers, and a solver who unfolds the constants and normalizes the arithmetic will close it. There is no analytic content, no limit, no inequality beyond the two decimal bounds on .
The real failure mode is transcription. The coefficients carry up to significant digits (the pascal), they are quotients of two decimals rather than single numbers, and the source displays several of them in a layout where a numerator and a denominator can easily be swapped. A statement that is off in the last digit is false, not approximately true, and is the kind of defect this mission exists to exclude.
Every quantity is modelled as an element of : the numerical value of the physical quantity in the corresponding SI unit. Dimensions are not tracked. A clause such as "" is formalized as the numerical identity , the unit bookkeeping being carried in the prose only; a development that wants dimensional safety must add a dimension layer on top. Decimal literals are exact rationals, not floating-point numbers, and no real-number approximation enters.
The statements are closed identities between explicit rationals, so none of them can be vacuous: each is either true or false, with no hypothesis to satisfy and no quantifier to exploit. The one quantified statement — the dependence of the unit formulas on the caesium frequency — ranges over all positive rationals and asserts non-equality in six cases and equality in two.
The definition layer is a single file of exact rational constants and the caesium radiation parameters; it is reusable by any later unit-related development. Contributions that would extend the mission usefully: a dimension-tracking layer over these constants, and the pre-2019 definitions (the krypton-86 metre, the IPK kilogram, the triple-point kelvin) stated in the same style for comparison.
Boosting answers a question raised by Kearns and Valiant: can a learner that is only slightly better than random guessing be turned into one that is arbitrarily accurate? Chapter 10 of Shalev-Shwartz and Ben-David, Understanding Machine Learning: From Theory to Algorithms (doi:10.1017/CBO9781107298019) defines γ-weak learnability (Definition 10.1), the PAC requirement with the accuracy replaced by the fixed value , and presents AdaBoost, the algorithm of Freund and Schapire that, given weak hypotheses, reweights the training set round by round and outputs a weighted majority vote. The chapter's main result (Theorem 10.2) is that the training error of AdaBoost's output decreases as in the number of rounds. Since the output is a halfspace over the predictions of base hypotheses, the chapter then bounds the VC-dimension of that class (Lemma 10.3), so that the number of rounds becomes a knob for the bias–complexity tradeoff. Example 10.1 shows a concrete weak learner, ERM over decision stumps for the class of 3-piece classifiers on the line, and the chapter remarks that, statistically, weak learnability is no easier than strong learnability: a class of infinite VC-dimension is not weakly learnable either.
The framework is that of Missions I and IV: binary classification over a domain with the 0–1 loss, distributions over with a labeling function , learners as functions of the sample, the VC-dimension, and ERM. Labels and hypotheses are Boolean, with values obtained through , , and is true exactly when . A γ-weak learner for with the function returns, for every , every and every measurable realizable by , a hypothesis with with probability at least once ; the failure event is bounded in outer measure as in Definition 3.1.
AdaBoost is formalized as a deterministic function of the sample and of the sequence of weak hypotheses that the weak learner returned. The distributions are defined by recursion: is uniform, , , and ; the output after rounds is . Rounds are indexed from , so is the book's . The class of Equation (10.4) consists of the functions with . Decision stumps over are the threshold functions and their negations ; a 3-piece classifier is outside and inside, with .
If and every round has , then the empirical 0–1 risk of AdaBoost's output after rounds is at most .
§10.1. A class of infinite VC-dimension is not γ-weak-learnable for any (domain with measurable singletons, measurable hypotheses).
Example 10.1. There is one sample-size function with which every ERM learner over the decision stumps is a -weak learner for the 3-piece classifiers.
Exercise 10.3. For a nonempty sample and , the error of under is exactly .
Lemma 10.3. If and , then .
Further item: Exercise 10.4 (1), for .
Theorem 10.2 is the reason AdaBoost works and the template for every analysis of boosting: a potential function, here , bounds the 0–1 training error and contracts by the factor at every round. Lemma 10.3 supplies the other half of the picture, an estimation-error bound growing only like up to logarithms, so that Theorem 6.8 turns the pair into a generalization guarantee for boosting. The remark of §10.1 places weak learning in the statistical landscape of Part I: the VC-dimension characterizes it too, and the gain of boosting is computational.
Nothing here is machine-checked. Two points where the book's text needs care are built into the statements. The weight is undefined when , and the algorithm's normalization then divides by ; in Lean the logarithm of a negative number is , so with the formal algorithm would ignore a perfect weak hypothesis and the bound could fail. The theorems therefore assume , which is the case in which the book's formulas are defined. And the book's derivation of "infinite VC-dimension implies not weakly learnable" from the lower bound of Theorem 6.8 at uses that bound outside the range in which Chapter 28 proves it; the statement itself is true, by the -point form of the No-Free-Lunch argument (Exercise 5.3 of Mission III) and Lemma B.1.
Exercise 10.4 (1) is a one-line embedding of into with the weights and is the entry point. Exercise 10.3 is the computation of the book: after the update, the weight of the mistakes of is and the weight of the correct examples is , and with these are equal. Theorem 10.2 needs, by induction on the round, the closed form of the distribution, the pointwise bound for the sign convention used, the telescoping product (10.2), the identity , the monotonicity of on and . Lemma 10.3 counts dichotomies: Sauer's lemma bounds the restrictions of to a shattered set by , choosing of them gives , the halfspaces of contribute by Theorem 9.2, and the inequality is solved with Lemma A.1; the finite-VC lower bound handles small , and the numeric slack of the book's chain must be checked. Example 10.1 combines a geometric observation, that one of the three regions of a 3-piece classifier has mass at most and a stump agrees with the other two, with the agnostic guarantee for ERM over the stumps from Theorem 6.7, applied with accuracy ; the best stump may only approach error because constant functions are not stumps, and the slack absorbs this. The §10.1 remark is the argument sketched above.
AdaBoost is a function of the sample and of the returned weak hypotheses; the weak learner's randomness and its failure probability (Remark 10.2) are not modelled, and Theorem 10.2 is the deterministic statement the book proves. Rounds are indexed from . The output uses negative, consistently with Mission VI. The class is a set of functions, so Lemma 10.3 is a statement about the VC-dimension of Mission IV, with the bound taken in through the integer part of the real right-hand side and the natural logarithm. Decision stumps are closed under negation, as the book's ; constant functions are not stumps. The efficient ERM for decision stumps (§10.1.1), the face-recognition features (§10.4), Exercises 10.1, 10.2, 10.4 (2)–(3) and 10.5 are not stated. The claims of §10.3 that piecewise-constant classifiers with pieces lie in and that this class shatters points depend on treating as a stump and on the sign convention; with real thresholds, does not shatter three points under either convention, so these claims are not stated.
Trivializing readings are excluded: the weak-error hypotheses are strict where the book's formulas require it, the VC bounds are in , and the weak-learner guarantee quantifies over all distributions and all realizable labelings. Welcome contributions: the closed form of , the contraction identity for , and the dichotomy count behind Lemma 10.3.
Part II of Shalev-Shwartz and Ben-David, Understanding Machine Learning: From Theory to Algorithms (doi:10.1017/CBO9781107298019) turns from the theory of learnability to hypothesis classes that can actually be learned by algorithms, and it starts with the family that almost every practical method is built on: linear predictors. Chapter 9 introduces the affine functions and the three classes obtained by composing them with a link: halfspaces for classification, linear regression for real-valued prediction, and logistic regression in between. For each class it gives an ERM algorithm and the guarantee that goes with it. For halfspaces in the separable case the algorithm is Rosenblatt's Perceptron, and the guarantee is the classical mistake bound (Theorem 9.1): the number of updates is at most , where bounds the data and is the norm of the smallest vector separating it with margin one. The chapter then computes the VC-dimension of halfspaces (Theorems 9.2 and 9.3), which by the fundamental theorem of Mission IV makes them learnable, derives the Least Squares normal equations for regression, and observes that the logistic loss is convex, the property later chapters exploit.
Vectors live in with its Euclidean inner product and norm. The affine functions are , homogenous when ; a halfspace hypothesis is , formalized as a Boolean predictor that is true exactly when (the book leaves unspecified; the VC computations do not depend on the convention). A sample with labels is separable if some has for all ; the constants of Theorem 9.1 are and . The Batch Perceptron starts at and, while some example has , adds ; since the algorithm may pick any mistaken example, a run is any sequence of updates obeying this rule, and the theorem is stated for all runs. For regression the loss is and the Least Squares system is with , written as the linear map , and . The logistic function is and the logistic loss is . The learning-theoretic notions (ERM, PAC and agnostic PAC learnability, VC-dimension) are those of Missions I and IV.
For a separable sample with labels in , every run of the Batch Perceptron of iterations satisfies , and some run of at most iterations ends with for every .
Equation (9.1). A sample is separable if and only if some satisfies for all .
Theorem 9.2. The VC-dimension of the homogenous halfspaces in is .
Theorem 9.3. The VC-dimension of the halfspaces in is .
Least Squares (9.6). The system always has a solution, and solves it if and only if is an ERM hypothesis for the squared loss over the homogenous linear predictors.
Further items: Exercise 9.3, the tightness of Theorem 9.1 (for every a sample with , and a run of exactly updates); the learnability of halfspaces by ERM, a consequence of Theorem 9.3 and the fundamental theorem; Exercise 9.2, is invertible iff the span ; and the convexity of the logistic loss in .
The Perceptron bound is one of the oldest results of learning theory (Novikoff 1962) and the model for every mistake bound in the online-learning chapters: it is independent of the dimension and of the number of examples, depending only on the geometry of the data through and . Theorems 9.2 and 9.3 are the first VC-dimension computations of a class used in practice and give, through Theorem 6.8, the sample complexity of learning halfspaces. The normal equations are the algorithmic content of linear regression, and the convexity of the logistic loss is why logistic regression is tractable in the nonseparable case, where ERM for halfspaces with the 0–1 loss is hard.
Nothing here is machine-checked in this form. Mathlib has the inner-product geometry, the Cauchy–Schwarz inequality, linear algebra of finite-dimensional spaces and convexity of compositions, but neither the Perceptron nor the VC-dimension of halfspaces.
Equation (9.1) is a rescaling and the intended entry point. The convexity of the logistic loss is the composition of the convex function with the linear map . Exercise 9.2 is the identification of the kernel of with the orthogonal complement of the span. The normal equations require showing that a convex quadratic is minimized exactly where its gradient vanishes, and that lies in the range of , which is the span of the . Theorem 9.1 is the book's proof: by induction on the run, and for any feasible , then Cauchy–Schwarz, and finally the passage from a feasible to the infimum ; the existence clause follows because a run can be extended as long as the stopping condition fails and all runs are bounded. Theorem 9.2 is the linear-dependence argument of the book, with a case analysis on the signs of the coefficients and on which side is nonempty, and the shattering of the standard basis; Theorem 9.3 lifts it to by appending a constant coordinate. The learnability of halfspaces is Theorem 6.7 applied to a class that must be shown measurable, nonempty, of finite VC-dimension and pointwise separable; the last needs rational approximations in which the offset moves below more slowly than approaches , so that boundary points keep their label.
Halfspaces are Boolean predictors with negative; the classes are sets of functions, so the VC-dimension is that of Mission IV. The Perceptron is a relation on sequences, not a program: this captures the algorithm's freedom to choose any mistaken example and makes the bound apply to all implementations. is an infimum, which is attained (the feasible set is closed and the norm is coercive), but the theorem does not need attainment. is a real supremum over the finite index set, equal to for the empty sample, where every run has length . The Least Squares statement is about the homogenous class and the sample , with ERM in the sense of Mission I; the bias term is handled by the book's reduction, appending a constant coordinate, and is not formalized separately. The learnability item states qualitative learnability and the ERM guarantee with an unspecified sample-complexity function; the quantitative rate is Theorem 6.8 of Mission IV. Linear programming (§9.1.1), the pseudo-inverse (§9.2.1), polynomial regression (§9.2.2), Exercises 9.1 and 9.4–9.6 are not stated.
Trivializing readings are excluded: labels are constrained to , runs must start at and update only on mistakes, the VC equalities are in , and the ERM equivalence is a biconditional. Welcome contributions: the two Perceptron invariants as separate lemmas, the shattering of the standard basis, and the pointwise separability of halfspaces.
The fundamental theorem of Mission IV says that a class of binary classifiers is PAC learnable exactly when its VC-dimension is finite. That leaves out classes one would like to learn, such as all polynomial classifiers over the line, whose VC-dimension is infinite although each degree separately is learnable. Chapter 7 of Shalev-Shwartz and Ben-David, Understanding Machine Learning: From Theory to Algorithms (doi:10.1017/CBO9781107298019) relaxes the definition. In nonuniform learnability (Definition 7.1) the sample size may depend on the hypothesis the learner is competing with: the learner must, for every , eventually do as well as up to , but how soon may depend on . The chapter's main result (Theorem 7.2) characterizes the nonuniformly learnable classes of binary classifiers as the countable unions of agnostic PAC learnable classes. The learning rule behind it is Structural Risk Minimization (SRM): write , weight the pieces, and minimize the empirical risk plus a confidence term that grows with the index (Theorems 7.3–7.5). Applied to a countable class described by a prefix-free code, SRM becomes the Minimum Description Length rule and yields a quantitative form of Occam's razor (Lemma 7.6, Theorem 7.7). The chapter closes the circle with a No-Free-Lunch result for the relaxed notion (Remark 7.2, Exercise 7.5).
The framework is that of Missions I, II and IV: examples in a domain , a hypothesis type with a class , a loss , risk and empirical risk , learners as functions of the sample, the uniform convergence property with an explicit rate , agnostic PAC learnability, and for binary classification the 0–1 loss, the VC-dimension and pointwise separability. The new module adds Definition 7.1 with an explicit rate and, as in Definition 3.4, learners whose outputs lie in ; the same notion for a family of learners indexed by the confidence , since the SRM and MDL rules take as an input; the rate of Equation (7.1), which is meaningful only when that set is nonempty; the index of Equation (7.4); the SRM rule as a minimizer of over the admissible hypotheses, those whose index has positive weight and a defined rate; prefix-free description languages and the MDL rule; and shattering of an infinite set.
For a class of measurable binary classifiers over a domain with measurable singletons, every subclass of which is pointwise separable, is nonuniformly learnable if and only if there are classes with , each agnostic PAC learnable.
Theorem 7.3. If is nonempty and each has the uniform convergence property, then is nonuniformly learnable (general loss).
Theorem 7.4. For weights with partial sums at most , uniformly convergent pieces with rates , , any and any : with probability at least , for every with at which is defined and every , .
Theorem 7.5. With and , every family of learners implementing the SRM rule satisfies the nonuniform guarantee with rate .
Lemma 7.6 (Kraft). For a prefix-free set of binary strings, every finite subfamily satisfies .
Theorem 7.7. For a prefix-free description language on a class with a -valued loss, and : with probability at least , every satisfies .
Further items: nonuniform learnability is implied by agnostic PAC learnability (§7.1); a nonuniformly learnable class of binary classifiers is a countable union of classes of finite VC-dimension (Exercise 7.5 (1)–(2)); a class shattering an infinite set admits no countable cover by classes of finite VC-dimension (Exercise 7.5 (3)) and is not nonuniformly learnable; over an infinite domain the class of all measurable classifiers is not nonuniformly learnable (Remark 7.2).
Theorem 7.2 is the second characterization theorem of the book's Part I and the one that explains why model selection works: any class that can be stratified into learnable pieces is learnable in the nonuniform sense, with the price of not knowing the index paid in sample size rather than in principle. SRM is the abstract form of every penalized learning rule, and the MDL bound of Theorem 7.7 is the cleanest instance, a bound in which the only property of the hypothesis that matters is the length of its description. Remark 7.2 shows the relaxation is not free: even nonuniformly, no learner handles all classifiers over an infinite domain.
Nothing here is machine-checked. The chapter's arguments are short but they combine everything before them: Hoeffding, the union bound with weights, the VC lower bound of Corollary 6.4 and the fundamental theorem. Three places where the book's statements need care are recorded in the formalization: the rate is an infimum that may be undefined for small ; the SRM rule takes as an input and so is a family of learners; and the fundamental theorem's uniform-convergence direction needs a measurability condition, which appears in Theorem 7.2 as hereditary pointwise separability.
The relaxation remark is a direct comparison of two definitions. Kraft's inequality is the coin-tossing argument of the book or an induction on the maximal length: it is the intended entry point. Theorem 7.4 is Theorem 7.3's engine: for each index and each in the set of Equation (7.1), the uniform convergence property bounds the failure by ; the passage from "every in the set" to the infimum uses continuity of the outer measure along an increasing union; the union over uses countable subadditivity and the partial-sum condition. Theorem 7.5 is Theorem 7.4 on the good event together with the two inequalities of the book's proof, using that the target is admissible when and that admissibility of the SRM output gives the bound for it. Theorem 7.3 asks for a single learner: SRM with a confidence schedule chosen so that, for each fixed index, the rate at level eventually falls below any , together with an approximate minimizer within ; the target hypothesis is admissible for large. Theorem 7.7 is Theorem 7.4 with singleton pieces and the weights , a one-sided Hoeffding bound for each , and Kraft's inequality. Exercise 7.5 (3) is the combinatorial construction of the book's hint, disjoint finite subsets of the shattered set with and a labeling that no realizes. The first half of Theorem 7.2 is Corollary 6.4 applied to the nonuniform learner at fixed , with constants chosen so that the two probability bounds actually contradict; the second half is the fundamental theorem on each piece followed by Theorem 7.3.
Learners output hypotheses in , in Definition 7.1 as in Definition 3.4. The rate is an infimum over the set of Equation (7.1), and every statement that uses it is guarded by the nonemptiness of that set; the weight may be , and encodes the book's indices . The SRM rule minimizes over admissible hypotheses, and an SRM family is one that returns an admissible minimizer whenever some hypothesis is admissible, which is the book's assumption that the argmin is attained (automatic for the 0–1 loss). Theorem 7.4's sum condition is on partial sums, and Kraft's inequality is on finite subfamilies, so no divergent series is silently zero. Theorem 7.7 assumes a -valued loss and . The binary-classification results assume measurable singletons and measurable hypotheses; Theorem 7.2 also assumes every subclass pointwise separable, which every class over a countable domain satisfies. Definition 7.8 (consistency) and the Memorize algorithm of §7.4 are not stated.
Trivializing readings are excluded: outputs in keep the risk an honest integral, the rate is never a junk infimum of the empty set, and the failure events are bounded in outer measure. Welcome contributions: a reusable weighted union bound over a countable family of uniform-convergence events, the continuity argument for the infimum rate, and the shattered-set combinatorics of Exercise 7.5.
Two different numbers describe the output of a lamp. Radiant flux is the power it radiates, in watts. Luminous flux is how much of that radiation the standard human eye registers, in lumens — a weighted integral of the radiated power in which each wavelength is counted according to the sensitivity of the eye at that wavelength. Their ratio
is the luminous efficacy of radiation, measured in lumens per watt: it says what fraction of the radiated power is usable for illumination. Photometry is built on this pair of quantities. The lumen and the candela are defined from the watt through exactly such a weighting, with the SI defining constant lm/W fixing the scale at the frequency Hz, and every efficiency figure quoted for a lamp — a tungsten filament at lm/W, a white LED above lm/W — is a statement about this ratio or its wall-plug variant.
The basic structural fact of the subject is that this ratio is bounded. Since the eye's sensitivity curve is normalized to a maximum of , no source, however designed, can exceed the maximum spectral luminous efficacy: lm/W under photopic (daylight, cone) vision, and about lm/W under scotopic (dark-adapted, rod) vision. Those two numbers are the ceilings against which every lighting technology is measured, and they are what this mission formalizes.
Wavelengths are real numbers (nanometres). A spectral radiant flux distribution of a source is modelled as a finite Borel measure on the wavelength axis: is the power, in watts, that the source radiates at wavelengths in . Its radiant flux is the total mass
A luminosity function (luminous efficiency function) with peak at is a measurable with
For photopic vision the CIE 1924 curve peaks at nm; the scotopic curve peaks at nm. The development assumes only the normalization above, never a specific tabulated curve, so every statement holds for the photopic curve, the scotopic curve, and any other normalized weighting.
Given a maximum spectral luminous efficacy — the value lm/W for photopic vision, lm/W for scotopic vision — the spectral luminous efficacy is and the luminous flux is
The luminous efficacy of radiation is , the dimensionless luminous efficiency is , and the luminous efficacy of a source (overall, or wall-plug, efficacy) is , where is the total input power the source consumes — electrical, chemical or other — of which the radiated part is .
Modelling the spectrum as a measure rather than as a density is what makes the two halves of the target statement expressible at once. A spectrum with a spectral radiant flux density is the measure , for which the formulas above reduce to the usual integrals
an ideal monochromatic source at , which has no density with respect to wavelength, is the point mass .
This is a maximum, not a supremum: the assertion is both that no spectral radiant flux distribution exceeds lm/W and that some distribution — the monochromatic source at nm — attains it exactly.
for a scotopic luminosity function with .
; ; ; luminous efficiency in ; the point mass at the peak realizes ; the reduction of to the integral formula for a spectrum with a density; invariance of under rescaling the spectrum; when ; and for a source radiating only where vanishes.
The ceiling is the reference point for the whole of lighting efficiency: quoted luminous efficiencies are efficacies divided by lm/W, so "" for a truncated K black body and "" for a tungsten filament are statements about the distance to this bound. The supporting statements are the facts that make such comparisons well posed — that the efficacy depends only on the shape of the spectrum and not on the wattage, that the wall-plug efficacy of a device is never better than the efficacy of its radiation, and that power radiated outside the response band is pure loss.
Formalizing the material produces a small, reusable measure-theoretic layer for photometric and, more generally, for weighted-average quantities: a bounded weight integrated against a finite measure, normalized by the total mass, with the extreme value attained at a point mass. Nothing here is open mathematics; the value of the mission is a machine-checked model in which the definitions of the International Electrotechnical Vocabulary are stated once and the standard consequences are derived from them, rather than each being asserted in prose.
The mathematical content is elementary — the ceiling is the inequality for — and the work is in the modelling. Three points need care.
First, attainment. On the space of densities the value lm/W is a supremum that is never attained: for the actual CIE curve the set is a single point, hence Lebesgue-null, so a density supported there is zero almost everywhere and has no radiant flux at all. A formalization restricted to densities would either have to weaken the goal to a supremum or state an attainment claim that is vacuously true. Measures avoid this: the monochromatic source is the point mass .
Second, division. Efficacy is a quotient, and the quotient of a real by zero is a junk value; every statement about therefore carries the hypothesis , which is also the physically meaningful one.
Third, integrability. The luminous flux is a Bochner integral, which returns for a non-integrable integrand; the mission's hypotheses ( measurable and bounded, finite) are what rule this degeneracy out.
The wavelength axis is all of , with Lebesgue measure where a density is used; no restriction to positive wavelengths or to a visible band is imposed, since the luminosity function already performs the restriction. A spectral radiant flux distribution is a finite Borel measure; the finiteness hypothesis is carried as a typeclass assumption and the positivity of the radiant flux as an explicit one. The luminosity function is assumed measurable with values in and equal to at its peak, and nothing more: no continuity, no unimodality, no tabulated values. The maximum spectral luminous efficacy appears as an explicit parameter , so that the photopic constant and the scotopic constant are instances of the same statements rather than separate developments. Units are not represented in the types: all quantities are plain real numbers, and lumens per watt appears only in the prose.
The goal is stated as " is the greatest element of the set of achievable efficacies", which rules out the two trivializing readings: a bare upper bound (true of any number above the ceiling) and an attainment claim over a class of spectra that is empty or null.
A complete development needs Mathlib's measure theory and Bochner integration only: finite measures, withDensity, Dirac measures, and monotonicity of the integral. The resulting definitions are reusable for any normalized weighted average of a finite measure, and contributions extending the model — mesopic weighting, black-body spectra and the efficacy figures computed from them, or the CIE curve as tabulated data — are welcome.
The Avogadro constant is the conversion factor between an amount of substance and a number of elementary entities (atoms, molecules, ions, ion pairs). Since the 2019 revision of the SI it is a defining constant with the exact value ; the pure number is called the Avogadro number. Before 2019 the mole was instead defined as the amount of substance in 12 grams of carbon-12, so was a measured quantity: the number of carbon-12 atoms in 12 g, equivalently the number of daltons in a gram, . The two definitions agree to within the experimental uncertainty of the dalton, but no longer by fiat.
The relations that carry this content — , , , , and the crystal/unit-cell count used by the Avogadro Project's X-ray crystal density measurements on silicon-28 spheres — are stated in every chemistry course and used without further comment. They are elementary, but they are also exactly the kind of unit-bookkeeping that is easy to state loosely and easy to get wrong by a factor, and they have no machine-checked formulation.
Fix a common positive scale for masses, volumes and amounts, and record on it three units: a mass unit (gram), a second mass unit (dalton), and an amount unit (mole), each a strictly positive real number. Write
For a sample containing entities, its amount of substance is ; for an entity of mass , the molar mass is ; for an entity occupying volume , the molar volume is ; the elementary amount is . For a crystal of volume whose unit cell has volume and contains entities, the number of entities in the crystal is .
All of these are modelled as real numbers; units appear as positive real parameters rather than as a dimension system, so every statement below is an identity between real numbers that holds for every admissible choice of , , .
Under the pre-2019 definition of the mole, let be the mass of one carbon-12 atom, let satisfy (a mole of carbon-12 weighs 12 grams), and let the dalton be one twelfth of the mass of a carbon-12 atom, . Then
That is: the Avogadro number under the old definition is exactly the number of daltons in a gram. The goal fixes no numerical value — it asserts the shape of the relation, and so survives any revision of the measured value of the dalton.
The six milestone lemmas are the remaining relations the source states: the inversion ; the 2019 statement ; the elementary-amount identity ; the pre-2019 numerical coincidence that a particle of mass has molar mass exactly when ; the worked numerical example that a water molecule occupies about when the molar volume of water is ; and the crystal/unit-cell amount relation.
The result itself is not new mathematics: each identity is one line of algebra once the model is fixed. What the mission produces is the model — a single, audited Lean formulation of amount of substance, molar mass, molar volume, the elementary amount, and the crystal count, in which the pre-2019 and post-2019 definitions of the mole can both be stated and compared, and in which the one place where the two definitions differ (the dalton is measured, the Avogadro number is fixed) is visible rather than hidden in a convention. That layer is reusable by any later formalization that needs to convert between microscopic and molar quantities, including the X-ray crystal density determination of from silicon-28 lattice measurements.
Status honesty: everything stated here is standard, textbook-level content, and all seven statements have been checked to be provable in the model as formalized. The mission's value is the faithful encoding and the audited definition layer, not the difficulty of the proofs.
The proofs are elementary real algebra; the difficulty is entirely in the statements. Two traps recur. First, division in Lean is total, so an identity such as carries no information at and can be satisfied vacuously; every statement here therefore either derives positivity from the unit data or takes the nondegeneracy hypothesis explicitly. Second, it is easy to write a unit relation that is true only for one choice of units — for instance, conflating the numerical value with the dimensional constant — and such a statement still compiles. Readers auditing this proposal should check each statement against both failure modes.
Units are positive real parameters bundled in a structure carrying together with proofs of their positivity; there is no dimension-tracking type system. Amounts, masses, volumes and entity counts are real numbers (the crystal's entities-per-cell count is a natural number). The Avogadro number is the exact rational , so the numerical milestone is a genuine rational-arithmetic bound, not a floating-point approximation. The water example is stated as a strict two-sided bound, , so that it cannot be satisfied by a rounded value.
A trivializing formalization is ruled out as follows: no statement is of the form "some quantity exists", every statement quantifies over an arbitrary admissible unit system, and the goal's hypotheses are simultaneously satisfiable (take , for any ), so the goal is not vacuous.
Contributions welcome: a dimension-typed refinement of the unit layer, and the X-ray crystal density relation for a cubic lattice, which the source describes only qualitatively and which is deliberately not claimed here.
A black body is an idealized body that absorbs all radiation falling on it and, when held at a fixed absolute temperature , re-emits radiation whose spectrum depends on alone. At the end of the nineteenth century two incompatible descriptions of that spectrum were on the table. Wien's distribution law (1896) fitted the measurements at short wavelengths and high temperatures but failed at long wavelengths. The formula Rayleigh obtained from classical equipartition, later the Rayleigh-Jeans law, reproduced the long-wavelength data and grew without bound at short wavelengths - the failure Ehrenfest named the ultraviolet catastrophe in 1911.
Planck's 1900 formula fits at every frequency. He reached it by refusing to treat the vibrational energy of the oscillators as a continuous quantity, writing it instead as an integer multiple of an energy element ; the constant entered physics as the proportionality factor in that hypothesis. Fitting black-body data, Planck obtained , within about of the value that today defines the SI.
What makes Planck's formula the successful one is not only that it fits the data. It contains both classical laws: it degenerates to Rayleigh-Jeans at low frequency and to Wien's law at high frequency, and unlike Rayleigh-Jeans it has a finite total emission. This mission formalizes those four statements - two limits and two integrability claims - about the spectral radiance function itself.
Fix three positive real parameters: the Planck constant , the speed of light , and the Boltzmann constant . They are kept as variables rather than numerical constants, so every statement is a theorem about the functional form, valid in any system of units. Let be an absolute temperature.
Per unit frequency , Planck's law gives the spectral radiance
which is the function planckFreq of the already-published definition bundle
BlackbodyRadiation_planck. That bundle also provides the dimensionless shape function
in terms of which .
Two further functions are introduced by this mission. The Rayleigh-Jeans spectral radiance, the classical equipartition prediction,
and Wien's distribution law, the short-wavelength approximation,
Write for the dimensionless frequency. All three radiances are positive on ; the two comparisons below are stated as ratios, which is the precise form of "agrees with, in this regime".
For all , all four of the following hold simultaneously:
The goal asserts only the shape of the truth - ratios tending to and membership or non-membership in - and fixes no constant, so it is not invalidated by any sharper rate or by the exact value of the total emission.
The four conjuncts are milestones in their own right, together with the two shape-function limits that drive them:
The result itself. The two limits are the sense in which Planck's law reproduces Wien's law for short wavelengths and the empirical long-wavelength formula, which is the criterion Planck was working to when he introduced ; the non-integrability of is the ultraviolet catastrophe, stated exactly rather than as an asymptotic remark; and the integrability of is what makes the total emitted power
CODATA2022.blackbody_exitance_eq_stefanBoltzmann, CODATA2022.bose_einstein_integral_cube),
both of which are Open.Formalizing it. The physics has been settled for over a century; none of it is open
mathematics. What is missing is machine-checked statements: the platform's existing
black-body development (BlackbodyRadiation_planck, and the mission Planck's Law and
Wien's Displacement Law) covers the peak of the spectrum and the exact radiation
constants, but not the two classical regimes, and not integrability. The limit and
integrability lemmas about produced here are reusable for any later work on
Bose-Einstein integrals, the Debye model, or the Stefan-Boltzmann constant.
The obvious argument for each limit is a one-line asymptotic expansion, and the obvious argument for integrability is "the integrand decays exponentially". Neither survives contact with a formal proof as stated. The ratio equals only after cancelling , and , which requires those factors to be nonzero - so the algebraic reduction is valid on a punctured neighbourhood, and must be transported to the limit through a congruence-along-a-filter step rather than by rewriting the function globally. At the ratio is a junk value, which is exactly why the limit is taken within .
For integrability the difficulty is at the two ends at once: near the integrand is but the defining expression is a quotient whose denominator vanishes, and near the exponential decay has to be turned into a dominating integrable function rather than a limit statement. Non-integrability of must be derived from unboundedness of , not asserted from the divergence of the integral, since an unproved-integrability integral in Lean silently evaluates to .
Everything is over with the Lebesgue (volume) measure; membership is
MeasureTheory.IntegrableOn ... (Set.Ioi 0) volume, which includes measurability.
One-sided limits are filters: is the neighbourhood filter of restricted
to , and is Filter.atTop. The three physical parameters and
the temperature are explicit real arguments, each carrying its own strict positivity
hypothesis; no statement is quantified over a possibly empty set of parameters, and every
hypothesis is satisfiable, so nothing here is vacuous.
The radiance functions are total: division by zero yields in Lean, so and the comparison ratios are at . That is harmless for the limits, which are taken strictly inside , and it is why the integrability statements are on rather than on . The comparisons are deliberately stated as ratios tending to rather than as differences tending to : the latter would be a weaker claim, and near it would be satisfied by functions that are not asymptotically equal.
Contributions welcome beyond the milestones: the corresponding statements in the wavelength parameterization, quantitative error bounds on the two approximations, and the integrability of on for general , which would close the remaining gap in the Stefan-Boltzmann chain.
The gravitational constant is the proportionality constant in Newton's law of universal gravitation and, through the Einstein gravitational constant , in the Einstein field equations. It is the least precisely known of the fundamental constants: the CODATA-recommended value is , a relative standard uncertainty of , and published high-precision measurements since the 1980s have at times been mutually exclusive. Everything that is known about is known through a small number of algebraic identities that convert a measurable quantity - a surface acceleration, a mean density, an orbital period - into a value of . Those identities, not the measurements, are what can be formalized, and they are what this mission collects.
The identities themselves are classical: the inverse-square law dates to Newton's Principia (1687), the notation to C. V. Boys in the 1890s, and the first laboratory determination to the Cavendish experiment of 1798, which reported a mean Earth density of - equivalent to in modern units, about above the modern value. The route from "mean density of the Earth" to "value of " is exactly one of the identities below.
All quantities are real numbers; no dimensional type discipline is imposed, and units are handled explicitly where they matter (see Formalization scope).
For a gravitational constant , point masses and a centre-to-centre distance , the Newtonian force is
For a spherically symmetric body of mass and radius , the surface gravity ("small ", as opposed to "big ") is
the ball volume is , and the mean density is .
A circular orbit of radius and period about a mass is the condition that the centripetal acceleration equals the gravitational acceleration:
The Einstein gravitational constant is .
For , and a circular orbit of radius and period about ,
This is the article's statement that is fixed by the period of an orbit and the volume it encloses. It is the weakest stable form of the orbital identity: no numerical value of , no unit system, and no choice of body are hard-coded into it.
The milestone list refines the goal into the chain the source uses: the "big / small " relation, its mean-density form (the Schiehallion-Cavendish route), , Kepler's third law for circular orbits, the grazing-satellite form , the relation to , and the SI cgs conversion of the recommended numerical value.
The result itself. The identities in this mission are the bridge between what an experiment measures and the number reported for : the mean-density form is what turns the Schiehallion and Cavendish results into values of ; the orbital form is what makes the product (the standard gravitational parameter, known far more accurately than either factor) the quantity celestial mechanics actually uses; the relation is what carries the Newtonian constant into general relativity.
Formalizing it. No claim here is open mathematics - each target is a consequence of real-field algebra, and the mission's contribution is a single, faithful, reusable Lean vocabulary for elementary Newtonian gravitation (force, surface gravity, mean density, circular orbits) together with machine-checked statements of the identities the literature quotes informally. The mission is a formalization task, not a research task, and it is presented as such.
The mathematical content is elementary; the difficulty is entirely in faithfulness, and it has two specific sources.
First, division in Lean's real numbers is total: . Several of these identities are therefore true but empty at degenerate arguments unless positivity hypotheses are stated, and conversely it is easy to over-hypothesize and end up proving a weaker claim than the source states. Each statement below fixes a particular choice, and that choice is the thing to audit.
Second, the SI/cgs target is a claim about units, which have no primitive representation here. It is stated in a model where each unit symbol is a real scale factor constrained by the relations between the systems; the honest reading of that target is "the two printed numerical values denote the same quantity given , and ", and nothing stronger.
Everything is over . The definition layer is a single definition item
providing newtonForce, surfaceGravity, ballVolume, meanDensity,
einsteinConstant, the predicate IsCircularOrbit, and the numerical constant
gravitationalConstantSI ; every theorem in the mission is
phrased through those, so the definition layer is the part that must be audited first.
The orbit condition is stated as a predicate on carrying and , rather than as a derived function, so that no target is vacuous: for every , and there is a satisfying it, so the hypotheses of the orbital targets are satisfiable, and the targets are not true merely for want of instances. No target is stated as an existence claim that a witness construction could trivialize.
Units are modelled as real scale factors rather than by a dimensional type system; a solver who wants a genuinely dimension-typed treatment is welcome to contribute it as a separate development, but the target here is the scale-factor statement.
A complete development needs nothing beyond Mathlib's ordered-field and Real.pi API.
The definition layer is intended to be reusable by any later mission on Newtonian
gravitation, orbital mechanics, or unit conversion.
The encyclopedic account of the speed of light makes two claims that look physical but whose content is mathematical. First, invariance: "the speed of light in vacuum is the same for all observers, no matter their relative velocity", so that light travels at "regardless of the motion of the source or the inertial reference frame of the observer". Second, unattainability: "is the upper limit for the speed at which information, matter, or energy can travel through space", and "particles with nonzero rest mass can be accelerated to approach but can never reach it". The supporting apparatus quoted in the same source is likewise mathematical: the Lorentz factor , which "diverges to infinity as approaches "; the Lorentz interval, in which spatial and temporal differences "are combined with a negative sign"; and the kinetic energy , from which the source concludes that "it would take an infinite amount of energy to accelerate an object with mass to the speed of light".
This mission isolates that mathematical core, in one spatial dimension, over the real numbers, and asks for machine-checked proofs of it. Nothing here depends on the numerical value : every statement is proved for an arbitrary parameter , which is the sense in which the source's claims are structural rather than metrological.
Fix a real constant , the invariant speed. Work in one spatial dimension, with a spatial coordinate and a time coordinate ; speeds are real numbers, and a speed is called subluminal when .
Four objects are used throughout, written in the prose exactly as in the mission's Lean development.
Relativistic velocity addition. For speeds ,
Lorentz factor. For a speed ,
Lorentz interval and Lorentz boost. The interval of an event is
and the boost of velocity sends the event to
Relativistic kinetic energy. For rest mass and speed ,
For every and every rest mass , all three of the following hold:
The three conjuncts are, in order, the invariance of light speed under a change of inertial frame, the fact that composing subluminal speeds never reaches , and the unboundedness of the energy required to approach . The goal deliberately asserts only the shape of the claims — no rate of divergence, no numerical constant — so it is not invalidated by any sharper quantitative statement a solver may prove separately.
The milestone list decomposes the goal along the four notions above: interval preservation under a boost, invariance of under composition, closure of the subluminal range under composition, divergence of at , and unboundedness of kinetic energy below .
The three conjuncts of the goal are what make a limit rather than merely a large speed. Closure of under says that no finite chain of subluminal boosts produces a luminal speed; invariance says that the boundary of that range is fixed by every boost; the energy statement says that the boundary is not approached at finite cost. Interval preservation is the geometric statement behind them: a boost is an isometry of the quadratic form , so the light cone is frame-independent.
These results are classical and have been standard since the 1905 formulation of special relativity; nothing in this mission is mathematically open. What the mission produces is the machine-checked version and a small reusable layer of one-dimensional relativistic kinematics: a search for declarations mentioning "Lorentz" in the Mathlib revision used for the drafting check returned none, so the definitions here are contributed rather than reused. The statements are stated for an arbitrary , so they can be reused at (natural units) without restatement.
The algebraic milestones are short once the right nonvanishing facts are in hand, and the obvious first attempt — clear denominators and call a ring normalizer — fails on all of them for the same reason: the denominators , , and must first be shown nonzero, and each of those facts needs the hypothesis , not merely . For velocity addition the usable identities are
whose positivity is where the strict inequality comes from.
The analytic milestone is the one that is not formal manipulation: must be shown to tend to along the punctured left neighbourhood of , which requires the inner expression to be shown positive, not merely convergent to , on a neighbourhood — the one-sided filter is essential, since takes a junk value beyond (see below).
All quantities are real; there is no vector or manifold structure, and spacetime is presented as a pair of coordinates . The invariant speed is a parameter with hypothesis ; the numerical SI value is never used. The definitions are total functions, so two junk-value conventions are fixed and must be respected when reading the statements:
No statement in the mission is vacuous: each hypothesis set is satisfiable, e.g. by , , , and the goal quantifies over all and all .
A complete development needs only Mathlib's real analysis: Real.sqrt, field-simplification and positivity reasoning, and one-sided neighbourhood filters for the divergence milestone. The definition layer (velocity addition, Lorentz factor, interval, boost, kinetic energy) is reusable beyond this mission — natural follow-ups, welcome as contributions, are the associativity and group structure of , the rapidity parametrization , time dilation and length contraction, and the composition law for boosts.
The read-backs attached to the draft items of this proposal are not blind and not independent: they were written by the same agent that drafted the Lean statements, at the explicit instruction of the proposal owner, with full sight of the source material and of the intended meaning. They should be read as an author's restatement, not as independent testimony, and they do not provide the error-catching value of an independent audit.
Missions I and II of this series showed that finite hypothesis classes are learnable, with and without the realizability assumption, by empirical risk minimization. Chapter 5 of Shalev-Shwartz and Ben-David, Understanding Machine Learning: From Theory to Algorithms (doi:10.1017/CBO9781107298019) asks the converse question: is prior knowledge, in the form of a restricted hypothesis class, really necessary? Could there be a universal learner, an algorithm that, given enough examples from any distribution, outputs a predictor of low risk? The No-Free-Lunch theorem (Theorem 5.1) answers no: for binary classification with the 0–1 loss over a domain , for every learning algorithm and every training-set size smaller than there is a distribution on which the learner fails with probability at least , even though that distribution is perfectly predictable by some function , so that another learner (ERM over ) succeeds. The consequence for the framework is Corollary 5.2: over an infinite domain, the class of all functions is not PAC learnable. This is the first lower bound of the book and the reason the rest of it is about the complexity of hypothesis classes rather than about universal algorithms.
The framework is the UnderstandingML_Framework module of Mission I, cited as a reference. Binary classification over a domain uses examples in , hypotheses and the 0–1 loss, so the risk of under a distribution over is , computed as the integral of the 0–1 loss. A learner is a function from samples of each size to hypotheses, and a sample of size has the law . PAC learnability of a class (Definition 3.1) requires a sample-complexity function and a learner such that for every , every distribution over and every measurable labeling function realizable by , samples of size yield with probability at least .
Two conventions specific to this mission. The domain is assumed to have measurable singletons (the book's Remark 3.1 assumes away measurability issues); this makes the finitely supported distributions of the proof honest probability measures and makes every under them a genuine integral. And " smaller than " is written in the extended natural numbers, so that an infinite domain satisfies it for every .
Let be any learning algorithm for binary classification with respect to the 0–1 loss over a domain with measurable singletons, and let be a training-set size with . Then there exists a probability distribution over such that
Lemma B.1 (Appendix B). If takes values in and , then for every , , and consequently .
Equation (5.2). Under the hypotheses of Theorem 5.1 there are and a measurable with and .
Corollary 5.2. For an infinite domain with measurable singletons, the class of all functions is not PAC learnable.
Two further items: Exercise 5.1, the passage from an expectation of at least to a probability of at least of exceeding for a -valued variable; and Exercise 5.3, the -fold version of Equation (5.2), with bound when , and is nonempty.
The No-Free-Lunch theorem is the book's first impossibility result and the conceptual pivot of Part I: it shows that learnability is a property of the pair (hypothesis class, learner) and not of the learner alone, and it motivates the bias–complexity tradeoff of §5.2 and the VC-dimension of Chapter 6, whose lower bound (Theorem 6.7, the "only if" direction of the fundamental theorem) is proved by the same symmetrization argument. Corollary 5.2 is the statement that the class of all functions has infinite sample complexity, the negative half of the characterization of learnable classes.
Nothing here is machine-checked. The proof is combinatorial and elementary but has real content for a formalization: a finite subset of the domain, the labelings of , the uniform distribution on labeled by each of them, an exchange of a maximum, an average and a minimum over labelings and sample sequences, and a pairing argument on labelings that differ at exactly one unseen point. Lemma B.1 is a reverse Markov inequality for bounded variables that later chapters also use.
Lemma B.1 is Markov's inequality applied to and is the entry point; Exercise 5.1 is its instance with and , giving , together with the inclusion of in . Theorem 5.1 follows from Equation (5.2) and Exercise 5.1 once one knows that is, under the finitely supported , almost everywhere equal to a measurable function with values in ; the set is the intersection of the event with the finite support of , which is measurable because singletons are. Equation (5.2) is the heart of the mission. One picks of size (available because ), lets be uniform on labeled by the -th function extended by off , and computes as an average over the sequences of instances, which requires identifying as a finitely supported measure on sequences, that is, the product of finitely supported measures. The inequalities (5.4)–(5.6) exchange max, average and min and restrict to the unseen points, and the pairing argument shows that for each unseen point the average over of the indicator that errs on it is exactly . Exercise 5.3 is the same argument with , where at least points are unseen. Corollary 5.2 takes , , and a set of size in the infinite domain, and derives the contradiction from Theorem 5.1 via the identification of for uniform on labeled by with the true error of Definition 3.1, where is uniform on ; the case is handled separately with a single point.
The items are stated in the joint-distribution form of the book's Chapter 5, with over and the risk under the 0–1 loss, rather than in the form of Definition 3.1; Corollary 5.2 is the bridge and is stated with the framework's PACLearnable. Witness labeling functions are required to be measurable, because a non-measurable would make true by Lean's convention for non-integrable functions rather than by content. Clause (2) of Theorem 5.1 is stated in the inner form (a measurable set of probability at least inside the event) rather than as a lower bound on the outer measure of the event, which for a non-measurable event would be the weaker statement. The size condition uses ENat.card, so infinite domains satisfy it. Learners are deterministic functions of the sample; the book's argument goes through for randomized learners by averaging, but the framework does not model them.
Trivializing readings are excluded: the distribution must be a probability measure, the failing set must be measurable with an honest lower bound, and the witness must be measurable. Welcome contributions: the finitely supported product law on sequences, the averaging identity (5.3), and the pairing argument on labelings of .
Mission I of this series set up the statistical learning framework of Shalev-Shwartz and Ben-David, Understanding Machine Learning: From Theory to Algorithms (doi:10.1017/CBO9781107298019) and proved, in the book's Chapters 2 and 3, that finite classes are PAC learnable under the realizability assumption. Chapter 4 removes that assumption. Its idea is the one that organizes the rest of the theory: if the empirical risks of all hypotheses in are simultaneously close to their true risks , then minimizing over is nearly as good as minimizing over , whatever the distribution is. A sample with that property is called -representative (Definition 4.1), and a class for which representative samples are guaranteed at some sample size is said to have the uniform convergence property (Definition 4.3). Lemma 4.2 turns representativeness into a guarantee for ERM, Corollary 4.4 turns uniform convergence into agnostic PAC learnability, Hoeffding's inequality (Lemma 4.5) gives uniform convergence for a single hypothesis, and a union bound gives it for a finite class: Corollary 4.6, the capstone, says every finite class with a loss in is agnostic PAC learnable by ERM with sample complexity .
The framework is the UnderstandingML_Framework module of Mission I, cited here as a reference. A domain is a measurable space, hypotheses form a type with a class , and a loss is given. The risk is , the empirical risk on is , and a sample of size has the product law . A hypothesis is an ERM hypothesis for if it lies in and minimizes over ; a learner is a function from samples of each size to hypotheses, and an ERM learner returns an ERM hypothesis on every sample.
is -representative with respect to , and if for every . has the uniform convergence property with the function if for every and every distribution over , a sample of i.i.d. examples is -representative with probability at least . is agnostic PAC learnable with the function and the learner if returns hypotheses in and, for every , every and every , with probability at least over . As in Mission I, "with probability at least " is an upper bound on the outer measure of the failure event, "" is written as ", ", and sample-complexity functions are carried explicitly rather than as minimal functions.
Let be a finite hypothesis class, a domain and a loss function whose sections are measurable. Then
Lemma 4.2. If is -representative and is an ERM hypothesis for , then for every .
Corollary 4.4. If has the uniform convergence property with , then every ERM learner for is an agnostic PAC learner with the function , and is agnostic PAC learnable as soon as an ERM learner exists.
Lemma 4.5 (Hoeffding's inequality). For a probability measure , a measurable with almost surely and mean , and ,
Chapter 4 is where the book's account of learnability becomes distribution-free in the agnostic sense: nothing is assumed about beyond being a probability distribution, and the guarantee is relative to the best hypothesis in the class. Lemma 4.2 and Corollary 4.4 are the reduction that every later generalization bound in the book (VC dimension, Rademacher complexity, covering numbers, compression) plugs into: prove uniform convergence, get ERM learnability. Corollary 4.6 is the first instance, and its dependence, against the of the realizable case, is the standard illustration of the price of agnosticism. Hoeffding's inequality is stated in the form the book uses everywhere afterward, for the product law of one distribution, with an almost-sure range bound and the mean written as an integral.
Nothing here is machine-checked. Mathlib has no Hoeffding inequality for sums of i.i.d. bounded variables on a product measure in this form, so Lemma 4.5 is a genuine contribution; its proof in the book's Appendix B goes through Hoeffding's lemma on the moment generating function of a bounded centered variable and the Chernoff bounding method, both of which will be needed by the concentration results of later missions.
Lemma 4.2 is three inequalities on real numbers and is the intended entry point. Corollary 4.4 is Lemma 4.2 applied on the complement of the failure event of uniform convergence at : the failure set of the learner is contained in the failure set of representativeness, and outer measure is monotone. Hoeffding's inequality is the substantial item: one needs the moment generating function bound (Lemma B.7 of the book, by convexity of the exponential on ), independence of the coordinates under Measure.pi to factor the expectation of the product, Markov's inequality, and the optimization over ; the two tails are treated separately and added. The degenerate cases are genuine: for the bound is and the claim holds trivially, and for Lean's convention makes the bound again. Corollary 4.6 combines Hoeffding for each with a union bound over the finite class and an arithmetic step showing that gives ; the empty class makes the uniform convergence clause vacuous. The second and third clauses of the goal then follow from Corollary 4.4, the third by exhibiting an ERM learner, which exists for a nonempty finite class by choosing a minimizer of .
The four items live in the general loss framework, not the binary-classification special case, because the chapter is stated for an arbitrary loss; Mission I's IsRepresentative and HasUniformConvergenceWith already carry the chapter's definitions, so no new definition module is introduced. Losses in Corollary 4.6 are real-valued with the range condition for every and measurability of for , which is what the book's "" and Remark 3.1 give. The book's "" is stated as "the guarantee holds with the function ", the same convention as Mission I. In Corollary 4.4 the ERM clause is universal over ERM learners, matching "the ERM paradigm is a successful agnostic PAC learner" for every choice of minimizer; the existence of an ERM learner is a separate hypothesis for the learnability clause because a class with no minimizers on some sample has no ERM rule. Hoeffding's inequality is on i.i.d. coordinates of Measure.pi; the book's "" is the definition of rather than an assumption.
Trivializing readings are excluded: the failure events are bounded in outer measure, so measurability of the events is not a loophole; representativeness is required for every ; the sample-complexity functions are the book's, with ceilings. Welcome contributions: Hoeffding's lemma on bounded centered variables, the factorization of the moment generating function under Measure.pi, and a reusable union bound over a finite class.
Chapters 2 and 3 of Shalev-Shwartz and Ben-David, Understanding Machine Learning: From Theory to Algorithms (Cambridge University Press, 2014, doi:10.1017/CBO9781107298019), set up the framework in which the whole book asks what learning is. A learner sees a sample drawn independently from an unknown distribution over examples, chooses a hypothesis from a class fixed in advance, and is judged by its risk, the expected loss on a fresh example. The natural rule is Empirical Risk Minimization: pick a hypothesis that does best on the sample. Chapter 2 shows that ERM over an unrestricted class overfits, that restricting the class is what makes learning possible, and that a finite class never overfits once the sample is larger than (Corollary 2.3). Chapter 3 turns this into a definition, Probably Approximately Correct learnability with its sample-complexity function , restates the finite-class result as Corollary 3.2, and then generalizes in two directions that the rest of the book lives in: the agnostic model, in which no hypothesis need be perfect and the learner competes with the best hypothesis in the class, and general loss functions, which cover regression, multiclass prediction and unsupervised tasks. Chapter 4 adds the notion of an ε-representative sample and of uniform convergence, the tool by which the finite-class result extends to the agnostic case; its definitions are included here since they complete the framework.
A domain of examples, a class of hypotheses and a loss . The risk of under a distribution is and its empirical risk on is ; a sample is drawn i.i.d., ; an ERM hypothesis minimizes over ; a learning algorithm maps samples of each size to hypotheses. In binary classification the examples are with over and a labeling function, and the true error is ; the realizability assumption says some has . is PAC learnable if some sample-complexity function and algorithm guarantee, for all , all and all realizable , true error at most with probability at least from examples; agnostic PAC learnability with respect to a loss asks instead for for every distribution over .
Every finite hypothesis class is PAC learnable with sample complexity
by the ERM rule: for a nonempty finite class of measurable hypotheses there is an ERM learner satisfying the PAC guarantee with that sample-complexity function.
Corollary 2.3: under realizability, with examples, every ERM hypothesis has true error at most with probability at least .
Corollaries 2.3 and 3.2 are the first learning theorem of the book and the template for all later sample-complexity bounds: a bad hypothesis is consistent with an i.i.d. sample with probability at most , and a union bound over the class turns this into a guarantee that holds uniformly over all distributions and all realizable labelings. Everything that follows, uniform convergence for finite classes, the fundamental theorem for classes of finite VC dimension, structural risk minimization, replaces the count by a finer measure of the class's complexity but keeps the argument. None of this is machine-checked. The mission fixes on the platform the objects that the rest of the series uses without change: risks, empirical risks, the product law of a sample, the ERM relation, and the four learnability notions of Definitions 3.1, 3.4, 4.1 and 4.3.
The milestone needs that, for a fixed measurable hypothesis whose true error exceeds , the product law gives the event "zero empirical risk" probability at most ; this is the product structure of Measure.pi on the event that each labeled example lies in the measurable set where the hypothesis agrees with , followed by , the union bound over the finite class and the observation that under realizability every ERM hypothesis has zero empirical risk, so a bad ERM hypothesis is a consistent bad hypothesis. The goal packages this as a learner: existence of an ERM hypothesis for every sample (a finite nonempty class has a minimizer), and the arithmetic of the ceiling.
The framework is the book's, with the risk as a Bochner integral, the sample law as a product measure, ERM as a relation and learners as deterministic functions of the sample; failure probabilities are stated as upper bounds on the outer measure of the failure set, the strong form of "with probability at least "; the comparison with is written without an infimum. Sample-complexity functions are carried explicitly: the book's as the minimal such function is not defined, and "" is stated as "the learner satisfies the guarantee with the function ". Hypotheses and labeling functions are assumed measurable (Remark 3.1). The union bound (Lemma 2.2) is Mathlib's measure_union_le and is not an item. Hypotheses: , , finite (and nonempty for the learner to exist).
Trivializing readings are excluded: the milestone's failure event ranges over every ERM hypothesis, and the goal quantifies over all distributions, all realizable labelings and all . Welcome contributions: the product-law bound for a fixed hypothesis and the union bound over a finset, which every later mission of the series reuses.