Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in
← Collections

The OR Formalization Drive

Help us formalize the operations research literature in Lean.

1094 missions

Missions

341–360 of 1094
OpenCompletedAll
🏆Completed
Linear OptimizationOperations ResearchOptimization·Captain: Shuze Chen

Disjunctive Programming X: Solving the Cut-Generating LP on the Simplex TableauTextbook

Motivation

Chapter 8 established an exact correspondence between lift-and-project cuts and simple disjunctive cuts, but its practical payoff is what this chapter develops: the cut-generating LP (CGLP)_k never needs to be formulated or solved on its own. Every pivot of (CGLP)_k can instead be mimicked directly on the much smaller simplex tableau of the original LP relaxation — replacing a large auxiliary linear program with bookkeeping on a tableau the solver already has. This chapter works out that correspondence at the level of individual pivots: which tableau pivot improves the resulting cut, and by how much, answered entirely in terms of ordinary tableau coefficients and two closed-form evaluation functions.

Setting

S:={1,…,m+p} and N:={m+p+1,…,m+p+n} index the surplus and structural variables of (LP) respectively — giving a direct correspondence between (LP)'s own variables and the surplus variables of Ãx≥b̃. For a basic solution with nonbasic set J (row set M1∪M2 from Chapter 8), Â:=Ã_J is the resulting nonsingular submatrix, and row k of the tableau reads x_k+ Σ_{j∈J}ā_{kj}s_j=ā_{k0}. Adding γ times row i to row k gives the composite row (9.10), x_k+γx_i+Σ_{j∈J}(ā_{kj}+γā_{ij})s_j=ā_{k0}+γā_{i0}, from which a new simple disjunctive cut can be read off whenever 0<ā_{k0}+γā_{i0}<1.

Formalization targets

Theorem 9.3 (goal) — the most-improving pivot column

The pivot column in row i most improving the cut from row k is indexed by l*∈J minimizing f⁺(γ_l) (if ā_{kl}ā_{il}<0) or f⁻(γ_l) (if ā_{kl}ā_{il}>0), over all l∈J with -ā_{k0}/ā_{i0}<γ_l<(1-ā_{k0})/ā_{i0}, γ_l:=-ā_{kl}/ā_{il}.

The chain of results building toward it

Lemma 9.1 (the tableau coefficients' closed form, eq. (9.4)-(9.5)) and Theorem 9.2 (the reduced costs of the CGLP columns u_i,v_i in terms of tableau coefficients, eq. (9.6)) are the two milestones the goal's own machinery is built from. Proposition 9.4, a bridge to Chapters 10-11's general split disjunctions, is included as a genuine milestone despite its payoff lying mostly outside this chapter.

Significance

The results themselves. This chapter is what makes lift-and-project cuts practical: instead of solving an (m+p+n)-row auxiliary LP from scratch for every candidate cut, a single pivot on the (LP)'s own tableau — guided by reduced costs that are themselves closed-form functions of tableau entries — identifies whether an improving cut exists and which one it is. Theorem 9.3's evaluation functions f⁺,f⁻ are exactly the tool a cutting-plane implementation would compute at every candidate pivot.

Formalizing it. No object in this mission exists on the platform prior to it or in Mathlib. This mission restates 08-cut-correspondence's (CGLP)_k apparatus locally, per the series convention and BRIEF.md's explicit instruction, and extends it with this chapter's own generalization to an arbitrary tableau row (needed since Lemma 9.1/Theorem 9.2 concern every basic variable's row, not only the disjunction row k).

Difficulty

Lemma 9.1's book proof is a four-case block-matrix verification (structural/surplus, basic/nonbasic); this mission instead states its content as the identity it is actually for — that the closed-form coefficients express every row's slack as an affine function of the nonbasic rows' slacks, for every point x — which follows tautologically from x=Â⁻¹b̂+Â⁻¹s_J's own definition once stated this way, without needing to reconstruct the block-matrix case analysis. Theorem 9.2's difficulty is that "reduced cost" is not already available as a formalized LP concept in this mission's apparatus; rather than build a generic LP reduced-cost theory, this mission follows the book's own derivation directly — explicitly constructing the pivoted-out extension of a basic solution (eq. (9.7)-(9.9)) and asserting that its objective value decomposes with r_{u_i},r_{v_i} as coefficients, which is genuine, non-circular content matching the proof's own final step ("we can then read the reduced costs... as the coefficients").

Formalization scope

This chapter makes the row/variable identification of Chapters 6-8 fully explicit (N directly indexes the structural variables), but no theorem's own displayed formula in this chunk needs that correspondence beyond what SurplusM's row-general treatment (this chunk's own generalization of 08-cut-correspondence's Surplus) already provides — see MODERATION_NOTES.md for why the S/N/B/R/P/Q block structure is proof machinery, not part of the stated content, throughout.

Theorem 9.3's range condition on γ_l, truncated in BRIEF.md's own excerpt, was completed by reading the PDF directly (confirmed identical to the range derived earlier in the same section): -ā_{k0}/ā_{i0}<γ_l<(1-ā_{k0})/ā_{i0}.

Selected references

  • E. Balas, Disjunctive Programming, Springer, 2018. DOI: 10.1007/978-3-030-00148-3, Chapter 9.
  • E. Balas, M. Perregaard, A precise correspondence between lift-and-project cuts, simple disjunctive cuts, and mixed integer Gomory cuts for 0-1 programming, Mathematical Programming B 94 (2003), 221–245 (cited in the text as [33], the origin of the tableau-pivoting procedure this chapter derives Lemma 9.1 and Theorem 9.2 from).
9 thms3 active usersReviewed
🏆Completed
Linear OptimizationOperations ResearchOptimization·Captain: Shuze Chen

Disjunctive Programming XI: The Cut-Generating LP Under a Ray NormalizationTextbook

Motivation

Lift-and-project (L&P) cuts strengthen the linear relaxation of a mixed 0-1 program by separating a fractional point from the convex hull of a disjunction such as xk≤0∨xk≥1x_k \le 0 \lor x_k \ge 1xk​≤0∨xk​≥1. Generating an optimal L&P cut means solving the cut-generating linear program (CGLP), a linear program lifted to a space with one new pair of variables per constraint of the original tableau — considerably larger than the tableau itself. Balas and Bonami showed that this higher-dimensional LP need not be solved explicitly at all: an optimal (or near-optimal) L&P cut can instead be produced by ordinary simplex pivots in the original LP tableau, each such pivot implicitly performing an entire block of pivots in the CGLP (E. Balas and P. Bonami, Generating lift-and-project cuts from the LP simplex tableau: open source implementation and testing of new variants, Mathematical Programming Computation 1 (2009), 165–199, https://doi.org/10.1007/s12532-009-0006-4). This correspondence is what made L&P cuts practical in commercial solvers: Perregaard's implementation in XPRESS needed only 5% of the iterations and 1.5% of the time of solving the CGLP explicitly, and Bonami's public implementation in COIN-OR put the method within reach of any solver.

A second, independent line of work asks how the CGLP's feasible region should be normalized. The textbook normalization (fixing the sum of the CGLP multipliers to 111) is scale-dependent — rescaling one constraint of the original system changes which cut the CGLP returns — so Balas and Perregaard proposed the ray normalization αy=1\alpha y = 1αy=1 instead (E. Balas and M. Perregaard, Lift-and-project for mixed 0-1 programming: recent progress, Discrete Applied Mathematics 123 (2002), 129–154, https://doi.org/10.1016/S0166-218X(01)00340-7). Under this normalization the CGLP's optimal value has a clean geometric meaning: it is exactly the distance, measured along a fixed ray from the point being separated, to the convex hull of the disjunctive set. This mission formalizes both results: the pivot correspondence (Theorem 10.1) and the optimal-value characterization under the ray normalization (Theorem 10.2, Theorem 10.3, and Corollary 10.4).

Setting

Fix a finite index set MMM for the rows of a simplex tableau over nnn variables, a matrix A∈RM×nA \in \mathbb R^{M \times n}A∈RM×n, and a right-hand side b:M→Rb : M \to \mathbb Rb:M→R, so that the tableau reads Ax≥bA x \ge bAx≥b (a "tilde" is dropped from the informal A~,b~\tilde A, \tilde bA~,b~ notation for the optimal-basis tableau of the linear relaxation). A basis is an injection ι:Fin n→M\iota : \mathrm{Fin}\, n \to Mι:Finn→M picking out nnn of the rows; write A^\hat AA^ for the n×nn \times nn×n submatrix A^ij=Aι(i),j\hat A_{ij} = A_{\iota(i), j}A^ij​=Aι(i),j​ and b^\hat bb^ for the corresponding subvector. From these, the standard tableau quantities are read off: aˉk0:=ekA^−1b^\bar a_{k0} := e_k \hat A^{-1} \hat baˉk0​:=ek​A^−1b^, aˉkj:=−(A^−1)kj\bar a_{kj} := -(\hat A^{-1})_{kj}aˉkj​:=−(A^−1)kj​, and the surplus of row i∈Mi \in Mi∈M at a point xxx, Surplusi(x):=(Ax−b)i\mathrm{Surplus}_i(x) := (Ax - b)_iSurplusi​(x):=(Ax−b)i​.

Fix a distinguished row kkk with a fractional basic variable, and a candidate pivot row i≠ki \ne ki=k. For ℓ\ellℓ ranging over the nonbasic columns JJJ, set γℓ:=−aˉkℓ/aˉiℓ\gamma_\ell := -\bar a_{k\ell}/\bar a_{i\ell}γℓ​:=−aˉkℓ​/aˉiℓ​; this is the value of a parameter γ\gammaγ at which the combined source row

xk+γxi+∑j∈J(aˉkj+γaˉij)xj=aˉk0+γaˉi0(10.1γ)x_k + \gamma x_i + \sum_{j \in J} (\bar a_{kj} + \gamma \bar a_{ij}) x_j = \bar a_{k0} + \gamma \bar a_{i0} \tag{10.1$_\gamma$}xk​+γxi​+j∈J∑​(aˉkj​+γaˉij​)xj​=aˉk0​+γaˉi0​(10.1γ​)

has its jjj-th coefficient pass through 000. The simple disjunctive cut obtained by applying the split disjunction z≤0∨z≥1z \le 0 \lor z \ge 1z≤0∨z≥1 (where zzz is the left side of (10.1γ_\gammaγ​)) to this row is the object CombinedCutSet.

On the CGLP side, (CGLP)k(\mathrm{CGLP})_k(CGLP)k​ is the cut-generating LP associated with the disjunction −xk≥0∨xk≥1-x_k \ge 0 \lor x_k \ge 1−xk​≥0∨xk​≥1 from Chapter 8: it has one pair of nonnegative multiplier variables (uρ,vρ)(u_\rho, v_\rho)(uρ​,vρ​) per row ρ∈M\rho \in Mρ∈M, plus u0,v0≥0u_0, v_0 \ge 0u0​,v0​≥0, tied together by the normalization ∑ρuρ+u0+∑ρvρ+v0=1\sum_\rho u_\rho + u_0 + \sum_\rho v_\rho + v_0 = 1∑ρ​uρ​+u0​+∑ρ​vρ​+v0​=1, and its feasible solutions (α,u,u0,v,v0,β)(\alpha, u, u_0, v, v_0, \beta)(α,u,u0​,v,v0​,β) correspond exactly to valid cuts αx≥β\alpha x \ge \betaαx≥β for the disjunction. A basic feasible solution to (CGLP)k(\mathrm{CGLP})_k(CGLP)k​ is described by a valid partition (M1,M2)(M_1, M_2)(M1​,M2​) of the nonbasic rows, with uρ=0u_\rho = 0uρ​=0 off M1M_1M1​ and vρ=0v_\rho = 0vρ​=0 off M2M_2M2​.

Separately, fix a disjunctive set and write PD⊆RnP_D \subseteq \mathbb R^nPD​⊆Rn for its convex hull — the object every cut ultimately wants to separate a point from. For a fixed direction y∈Rny \in \mathbb R^ny∈Rn and point xˉ∈Rn\bar x \in \mathbb R^nxˉ∈Rn, (CGLP)y(\mathrm{CGLP})_y(CGLP)y​ is the cut-generating LP under the ray normalization: pairs (α,β)(\alpha, \beta)(α,β) with αx≥β\alpha x \ge \betaαx≥β valid for every x∈PDx \in P_Dx∈PD​ and αy=1\alpha y = 1αy=1, minimizing the objective αxˉ−β\alpha \bar x - \betaαxˉ−β.

Formalization targets

Theorem 10.1. For a genuine ordered pivot chain j1,…,jtj_1, \dots, j_tj1​,…,jt​ inside JJJ (no repeats, each consecutive pair flipping the sign of aˉk,⋅\bar a_{k,\cdot}aˉk,⋅​ as γ\gammaγ increases — rule (b) of the theorem), the simple disjunctive cut from the combined row at γ=γjt\gamma = \gamma_{j_t}γ=γjt​​ equals the lift-and-project cut {x:β≤αx}\{x : \beta \le \alpha x\}{x:β≤αx} associated with a basic feasible solution to (CGLP)k(\mathrm{CGLP})_k(CGLP)k​ for the resulting basis J′:=(J∪{i})∖{jt}J' := (J \cup \{i\}) \setminus \{j_t\}J′:=(J∪{i})∖{jt​}:

CombinedCutSet(k,i,J,γjt)={x:β≤αx}.\mathrm{CombinedCutSet}(k, i, J, \gamma_{j_t}) = \{x : \beta \le \alpha x\}.CombinedCutSet(k,i,J,γjt​​)={x:β≤αx}.

Theorem 10.2. If (CGLP)y(\mathrm{CGLP})_y(CGLP)y​ is feasible, it has a finite minimum if and only if the ray meets the disjunctive hull:

finite min  ⟺  ∃ λ∈R, xˉ+λy∈PD.\text{finite min} \iff \exists\, \lambda \in \mathbb R,\ \bar x + \lambda y \in P_D.finite min⟺∃λ∈R, xˉ+λy∈PD​.

Theorem 10.3 (goal). If (CGLP)y(\mathrm{CGLP})_y(CGLP)y​ has an optimal solution (α~,β~)(\tilde\alpha, \tilde\beta)(α~,β~​), its optimal value is exactly the signed distance to PDP_DPD​ along the ray, and the corresponding boundary point lies exactly on the optimal hyperplane:

xˉTα~−β~=λ∗:=min⁡{λ:xˉ+λy∈PD},(xˉ+λ∗y)Tα~=β~.\bar x^{\mathsf T} \tilde\alpha - \tilde\beta = \lambda^* := \min\{\lambda : \bar x + \lambda y \in P_D\}, \qquad (\bar x + \lambda^* y)^{\mathsf T} \tilde\alpha = \tilde\beta.xˉTα~−β~​=λ∗:=min{λ:xˉ+λy∈PD​},(xˉ+λ∗y)Tα~=β~​.

Corollary 10.4. Taking y:=x∗−xˉy := x^* - \bar xy:=x∗−xˉ for a point x∗x^*x∗ in the lifted polyhedron PQP_QPQ​ gives an optimal solution whose hyperplane separates xˉ\bar xxˉ and meets the segment (xˉ,x∗](\bar x, x^*](xˉ,x∗] at the point closest to x∗x^*x∗.

The targets are ordered from the purely combinatorial pivot correspondence (10.1, independent of the ray normalization) through the abstract feasibility/boundedness dichotomy (10.2) to the concrete value formula that is this mission's goal (10.3), with the geometric illustration (10.4) as a companion result using the same machinery with a specific choice of ray.

Significance

Theorem 10.1 is the theoretical justification for every commercial L&P-cut implementation cited above: it says the pivot correspondence is not an approximation or a heuristic shortcut but an exact identity between a single LP pivot and a specific, describable sequence of CGLP pivots, which is what lets a solver generate an (quasi-)optimal L&P cut at the cost of ordinary simplex pivots instead of solving a much larger LP. Theorem 10.3 gives the ray-normalized CGLP an exact geometric meaning — its value is a distance, not merely a linear-programming optimum — which is what makes the ray normalization the more robust alternative to the scale-dependent constant-sum normalization used elsewhere in the book (§9), and is the basis for the geometric picture (Corollary 10.4, Fig. 10.3) of how a lift-and-project cut relates to the lifted polyhedron PQP_QPQ​.

Both directions are proved in the source text (Balas and Bonami 2009 for Theorem 10.1; Balas and Perregaard 2002 for Theorems 10.2/10.3 and Corollary 10.4) but have no formalized counterpart on this platform: no existing item treats cut-generating LPs, ray normalizations of a projection cone, or the correspondence between two different pivoting processes. This mission produces the first Lean statements of both.

Difficulty

The obvious temptation for Theorem 10.1 is to existentially weaken "the sequence of ttt pivots defined as follows" to "there exists some sequence of pivots realizing the same cut" — which would be true but not what the theorem says, and would erase the entire content that makes the result useful (an algorithm, not just an existence claim). The formalization instead carries the explicit ordered chain j1 :: middle ++ [jt] as data, with the three-part construction (rules (a), (b), (c)) encoded as hypotheses on that specific list via List.IsChain, so the theorem proved is the constructive one the book states, not a weaker existential shadow of it.

For Theorem 10.3, the proof pattern in the book resists a shortcut: showing λ0=λ∗\lambda_0 = \lambda^*λ0​=λ∗ requires deriving a contradiction from each strict inequality (λ0>λ∗\lambda_0 > \lambda^*λ0​>λ∗ violates optimality of the point on PDP_DPD​'s boundary; λ0<λ∗\lambda_0 < \lambda^*λ0​<λ∗ contradicts optimality of (α~,β~)(\tilde\alpha, \tilde\beta)(α~,β~​) for (CGLP)y(\mathrm{CGLP})_y(CGLP)y​ via a competing separating hyperplane), so there is no way to avoid formalizing both directions of the boundedness dichotomy already needed for Theorem 10.2 first.

Formalization scope

The ambient space is Fin n→R\mathrm{Fin}\ n \to \mathbb RFin n→R throughout, matching the rest of the series. (CGLP)y(\mathrm{CGLP})_y(CGLP)y​'s feasibility (IsCGLPYFeasible) is stated directly as validity of (α,β)(\alpha, \beta)(α,β) for PDP_DPD​ under αy=1\alpha y = 1αy=1, not through an explicit representation of the projection cone's extreme rays — this matches how the book's own Theorems 10.2/10.3 and Corollary 10.4 are phrased purely in terms of (α,β)(\alpha,\beta)(α,β)-validity for PDP_DPD​, never in terms of a specific disjunction's multipliers, so this is not a weakening relative to the source. PDP_DPD​ (the disjunctive hull that (CGLP)y(\mathrm{CGLP})_y(CGLP)y​ is defined against) and PQP_QPQ​ (the lifted polyhedron whose supporting hyperplane Corollary 10.4 describes) are kept as two independent Set (Fin n → ℝ) parameters with no assumed relationship between them, matching the book's own text, which never states one; conflating them would be a trivializing formalization that this mission explicitly avoids. "The point closest to x∗x^*x∗" on the segment (xˉ,x∗](\bar x, x^*](xˉ,x∗] is formalized via IsGreatest on the parameter t∈(0,1]t \in (0, 1]t∈(0,1] at which the optimal hyperplane meets the segment, rather than via an unformalized Euclidean-distance minimization, since that is what "closest" means for points colinear with xˉ\bar xxˉ and x∗x^*x∗ on a single ray.

Corollary 10.4 corrects a typo in the printed text: the corollary as printed reads "let y:=xˉy := \bar xy:=xˉ for some x∗∈PQx^* \in P_Qx∗∈PQ​", omitting "x∗−x^* -x∗−" before xˉ\bar xxˉ; the very next line's figure caption gives the intended formula unambiguously as y=x∗−xˉy = x^* - \bar xy=x∗−xˉ, and the formalization uses the corrected formula (see MODERATION_NOTES.md).

This mission depends on no other chunk's Lean definitions — the CGLP and tableau apparatus needed here (originally introduced in Chapters 8 and 9) is restated locally, per the series' convention against importing another draft mission's definitions across chunks that are being drafted concurrently. A complete development needs: Farkas-type separation for the boundedness dichotomy in Theorem 10.2, and careful bookkeeping of finite index sets and their images under the basis maps ι,ι′\iota, \iota'ι,ι′ for Theorem 10.1. The tableau infrastructure (Ahat, Bhat, Abar0, Abar, GammaOf) is reusable by any later mission touching the simplex-tableau side of lift-and-project cuts.

Selected references

  • E. Balas and P. Bonami, Generating lift-and-project cuts from the LP simplex tableau: open source implementation and testing of new variants, Mathematical Programming Computation 1 (2009), 165–199. https://doi.org/10.1007/s12532-009-0006-4
  • E. Balas and M. Perregaard, Lift-and-project for mixed 0-1 programming: recent progress, Discrete Applied Mathematics 123 (2002), 129–154. https://doi.org/10.1016/S0166-218X(01)00340-7
  • E. Balas, Disjunctive Programming, Springer, 2018, Chapter 10, §10.1 and §10.6. https://doi.org/10.1007/978-3-030-00148-3
8 thms3 active usersReviewed
🏆Completed
CombinatoricsConvex OptimizationOperations Research+1·Captain: mikedeng1

Convexity and Steinitz's Exchange Property III: Fenchel-Type Min-Max Duality with Primal and Dual Integrality for M-Concave and M-Convex FunctionsResearch Paper

Motivation

Several classical min-max theorems of combinatorial optimization say that a discrete maximization problem and a continuous minimization problem have the same optimal value, and that both have integral optimal solutions when the data are integral. Edmonds' polymatroid intersection theorem (1970), Fujishige's Fenchel-type duality for submodular functions (1984), Frank's discrete separation theorem for a submodular/supermodular pair (1982), and the potential characterizations of weighted matroid intersection (Frank's weight splitting theorem, 1981; Iri and Tomizawa's criterion for the assignment problem, 1976) are instances. Murota's paper Convexity and Steinitz's exchange property, 1996 places all of them under one theorem: a Fenchel-type min-max formula for a pair of an M-concave and an M-convex function, with integrality on both sides.

Timeline:

  • 1970: Edmonds proves the polymatroid intersection theorem.
  • 1982: Frank proves the discrete separation theorem for submodular/supermodular set functions, with integrality.
  • 1984: Fujishige proves a Fenchel-type min-max theorem for submodular functions.
  • 1976–1981: Iri and Tomizawa characterize optimality for independent assignment by potentials; Frank proves the weight splitting theorem for weighted matroid intersection (1981).
  • Early 1990s: Dress and Wenzel introduce valuated matroids.
  • 1995–1996: Murota proves the valuated matroid intersection theorem (SIAM J. Discrete Math. 9, 1996) and the M-concave intersection theorem (Bonn report, 1995), and in the present paper the Fenchel-type duality (Theorem 6.4).
  • Later: the result becomes the central duality theorem of discrete convex analysis (Murota, Discrete Convex Analysis, SIAM, 2003).

Setting

Let VVV be a finite nonempty set. For u∈Vu\in Vu∈V, χu∈ZV\chi_u\in\mathbb Z^Vχu​∈ZV is its characteristic vector; for x∈RVx\in\mathbb R^Vx∈RV, supp⁡±(x)\operatorname{supp}^{\pm}(x)supp±(x) are the sets of coordinates where xxx is positive or negative, x(X)=∑v∈Xx(v)x(X)=\sum_{v\in X}x(v)x(X)=∑v∈X​x(v), and ⟨p,x⟩=∑vp(v)x(v)\langle p,x\rangle=\sum_v p(v)x(v)⟨p,x⟩=∑v​p(v)x(v).

A finite integral base set is a finite nonempty B⊆ZVB\subseteq\mathbb Z^VB⊆ZV such that for x,y∈Bx,y\in Bx,y∈B and u∈supp⁡+(x−y)u\in\operatorname{supp}^+(x-y)u∈supp+(x−y) some v∈supp⁡−(x−y)v\in\operatorname{supp}^-(x-y)v∈supp−(x−y) has x−χu+χv∈Bx-\chi_u+\chi_v\in Bx−χu​+χv​∈B. These are exactly the integer points of integral base polytopes of submodular systems. B‾\overline BB is the convex hull of BBB.

A function ω:B→R\omega:B\to\mathbb Rω:B→R has the exchange property (EXC), and is called M-concave, if for x,y∈Bx,y\in Bx,y∈B and u∈supp⁡+(x−y)u\in\operatorname{supp}^+(x-y)u∈supp+(x−y) some v∈supp⁡−(x−y)v\in\operatorname{supp}^-(x-y)v∈supp−(x−y) has x−χu+χv, y+χu−χv∈Bx-\chi_u+\chi_v,\ y+\chi_u-\chi_v\in Bx−χu​+χv​, y+χu​−χv​∈B and

ω(x)+ω(y)≤ω(x−χu+χv)+ω(y+χu−χv).\omega(x)+\omega(y)\le\omega(x-\chi_u+\chi_v)+\omega(y+\chi_u-\chi_v).ω(x)+ω(y)≤ω(x−χu​+χv​)+ω(y+χu​−χv​).

A function ζ\zetaζ is M-convex when −ζ-\zeta−ζ is M-concave.

For ω:B1→R\omega:B_1\to\mathbb Rω:B1​→R and ζ:B2→R\zeta:B_2\to\mathbb Rζ:B2​→R the concave conjugate and convex conjugate are

ω∘(p)=min⁡x∈B1(⟨p,x⟩−ω(x)),ζ∙(p)=max⁡x∈B2(⟨p,x⟩−ζ(x)),\omega^\circ(p)=\min_{x\in B_1}\big(\langle p,x\rangle-\omega(x)\big),\qquad \zeta^\bullet(p)=\max_{x\in B_2}\big(\langle p,x\rangle-\zeta(x)\big),ω∘(p)=x∈B1​min​(⟨p,x⟩−ω(x)),ζ∙(p)=x∈B2​max​(⟨p,x⟩−ζ(x)),

and the concave closure and convex closure are ω^(b)=inf⁡p(⟨p,b⟩−ω∘(p))\hat\omega(b)=\inf_p(\langle p,b\rangle-\omega^\circ(p))ω^(b)=infp​(⟨p,b⟩−ω∘(p)) and ζˇ(b)=sup⁡p(⟨p,b⟩−ζ∙(p))\check\zeta(b)=\sup_p(\langle p,b\rangle-\zeta^\bullet(p))ζˇ​(b)=supp​(⟨p,b⟩−ζ∙(p)); they are finite exactly on B1‾\overline{B_1}B1​​ and B2‾\overline{B_2}B2​​.

The primal problem maximizes ω(x)−ζ(x)\omega(x)-\zeta(x)ω(x)−ζ(x) over x∈B1∩B2x\in B_1\cap B_2x∈B1​∩B2​; the relaxed primal problem maximizes ω^(b)−ζˇ(b)\hat\omega(b)-\check\zeta(b)ω^(b)−ζˇ​(b) over b∈B1‾∩B2‾b\in\overline{B_1}\cap\overline{B_2}b∈B1​​∩B2​​; the dual problem minimizes ζ∙(p)−ω∘(p)\zeta^\bullet(p)-\omega^\circ(p)ζ∙(p)−ω∘(p) over p∈RVp\in\mathbb R^Vp∈RV. A maximum over an empty family is −∞-\infty−∞.

Formalization targets

Goal: Theorem 6.4

If ω\omegaω and −ζ-\zeta−ζ satisfy (EXC), then

max⁡x∈B1∩B2(ω(x)−ζ(x))=max⁡b∈B1‾∩B2‾(ω^(b)−ζˇ(b))=inf⁡p∈RV(ζ∙(p)−ω∘(p)),\max_{x\in B_1\cap B_2}\big(\omega(x)-\zeta(x)\big)=\max_{b\in\overline{B_1}\cap\overline{B_2}}\big(\hat\omega(b)-\check\zeta(b)\big)=\inf_{p\in\mathbb R^V}\big(\zeta^\bullet(p)-\omega^\circ(p)\big),x∈B1​∩B2​max​(ω(x)−ζ(x))=b∈B1​​∩B2​​max​(ω^(b)−ζˇ​(b))=p∈RVinf​(ζ∙(p)−ω∘(p)),

with (P1) a finite dual infimum forces B1∩B2≠∅B_1\cap B_2\neq\emptysetB1​∩B2​=∅, and (P2) if B1∩B2≠∅B_1\cap B_2\neq\emptysetB1​∩B2​=∅ all values are finite and equal and the infimum is attained. If ω,ζ\omega,\zetaω,ζ are integer-valued, the infimum may be taken over p∈ZVp\in\mathbb Z^Vp∈ZV and is attained there when finite.

Milestones

  1. Lemma 6.3 (weak duality): for arbitrary ω,ζ\omega,\zetaω,ζ on finite nonempty sets, primal ≤\le≤ relaxed === dual (the Fenchel identity (6.5)).
  2. Lemma 6.1: (−f)∘(p)=−f∙(−p)(-f)^\circ(p)=-f^\bullet(-p)(−f)∘(p)=−f∙(−p) and (−f)∧=−fˇ(-f)^\wedge=-\check f(−f)∧=−fˇ​ on B‾\overline BB.
  3. Lemma 4.5: an M-concave ω\omegaω satisfies ω^=ω\hat\omega=\omegaω^=ω on BBB.
  4. Theorem 2.1: (B1) is equivalent to being the integer points of an integral submodular (or supermodular) base polytope, with the describing functions max⁡x∈Bx(X)\max_{x\in B}x(X)maxx∈B​x(X) and min⁡x∈Bx(X)\min_{x\in B}x(X)minx∈B​x(X).
  5. Theorem 6.5 (Frank's discrete separation theorem, cited in the paper).
  6. Lemma 6.7: four equivalent forms of boundedness of the dual problem.
  7. Theorem 6.6 (the M-concave intersection theorem, cited in the paper): optimality of x∗x^*x∗ for ω1+ω2\omega_1+\omega_2ω1​+ω2​ is equivalent to a potential p∗p^*p∗ with x∗x^*x∗ maximizing both ω1[−p∗]\omega_1[-p^*]ω1​[−p∗] and ω2[p∗]\omega_2[p^*]ω2​[p∗], integral when the data are.

Significance

The formula gives, in one statement, the integrality of an optimal solution of the relaxed primal problem (the essential content of the first half, as the paper observes on p. 296) and of the dual problem. The paper presents it as a unification of two groups of theorems: Edmonds' polymatroid intersection theorem, Fujishige's Fenchel-type duality and Frank's discrete separation theorem on one side, and Iri and Tomizawa's potential characterization for independent assignment with its extensions by Fujishige and Frank (weight splitting) on the other. In the paper it yields the primal and dual separation theorems (Theorems 6.8, 6.9) and the convolution results (Theorems 6.10, 6.11), and it is the prototype of the Fenchel-type duality of discrete convex analysis.

All results here are proved in the literature; none is known to be formalized. Mathlib has no submodular base polytopes, no matroid intersection theorem and no discrete convex analysis. A formal proof of Theorem 6.4 would also require formal proofs of the two cited results, Frank's discrete separation theorem and the M-concave intersection theorem, which the paper uses without proof.

Difficulty

Lemma 6.3 is polyhedral convex duality and holds for any functions. The content is equality with the integral problem: the relaxed maximum over the polytope B1‾∩B2‾\overline{B_1}\cap\overline{B_2}B1​​∩B2​​ must be attained at an integer point. For general finite sets it is not, and the intersection of two integral polytopes generally has fractional vertices. Both the integrality of B1‾∩B2‾\overline{B_1}\cap\overline{B_2}B1​​∩B2​​ (Edmonds) and the existence of an integral optimal potential depend on the exchange structure; a direct argument from the definitions of conjugates does not see it. The dual integrality claim, that ppp can be taken integral, is again specific to (EXC) and fails for general concave extensions.

Formalization scope

Lean conventions, all in namespace SteinitzExchange.Duality:

  • VVV is a type with [Fintype V] [DecidableEq V] [Nonempty V]; integer vectors are V → ℤ, real vectors V → ℝ; finite sets of integer vectors are Finset (V → ℤ).
  • A function on BBB is a total (V → ℤ) → ℝ used only at points of BBB. M-convexity of ζ\zetaζ is (EXC) for fun x => -ζ x; ω\omegaω lives on B1B_1B1​ and ζ\zetaζ on B2B_2B2​, which are distinct sets in general.
  • Conjugates are real-valued min/max over the finite set. The closures are real ⨅/⨆ over p∈RVp\in\mathbb R^Vp∈RV and are evaluated only on the convex hulls, where they equal the paper's values; off the hulls they carry a junk value instead of ∓∞\mp\infty∓∞, which no statement uses.
  • The three optimal values are in EReal, as suprema and infima of coerced reals, so no ∞−∞\infty-\infty∞−∞ occurs. EReal's supremum of the empty family is −∞-\infty−∞, the paper's convention. The dual infimum is never a real ⨅ (which would return 000 when unbounded and make (P1) meaningless).
  • Every "max" of the page includes attainment: (P2) asserts points xxx, bbb, ppp at which the three values are achieved; the integral dual infimum is attained when it is not −∞-\infty−∞.
  • "Integer-valued" means ω(x)∈Z\omega(x)\in\mathbb Zω(x)∈Z on B1B_1B1​ and ζ(x)∈Z\zeta(x)\in\mathbb Zζ(x)∈Z on B2B_2B2​; integral potentials and separating vectors are V → ℤ.
  • Theorem 2.1's "∀X⊂V\forall X\subset V∀X⊂V" is read as all X⊆VX\subseteq VX⊆V.

Formalizations that would trivialize the goal are excluded: an unrestricted real infimum for the dual, a convex closure built from ζ∘\zeta^\circζ∘ instead of ζ∙\zeta^\bulletζ∙, a single base set for both functions, and a relaxed maximum taken over all of RV\mathbb R^VRV instead of B1‾∩B2‾\overline{B_1}\cap\overline{B_2}B1​​∩B2​​.

Needed infrastructure: finite convex hulls and polyhedral Fenchel duality, submodular base polytopes and their integrality, Frank's separation theorem, and the valuated intersection theorem. The submodular-system layer (Theorem 2.1, Theorem 6.5) is reusable beyond this mission. Contributions to any milestone, including proofs of the two cited theorems, are welcome.

Selected references

  • K. Murota, Convexity and Steinitz's exchange property, Advances in Mathematics 124 (1996) 272–311. https://doi.org/10.1006/aima.1996.0084
  • K. Murota, Valuated matroid intersection I: optimality criteria, SIAM J. Discrete Math. 9 (1996) 545–561.
  • K. Murota, Submodular flow problem with a nonseparable cost function, Report 95843-OR, Forschungsinstitut für Diskrete Mathematik, Universität Bonn, 1995 (source of Theorem 6.6).
  • A. Frank, An algorithm for submodular functions on graphs, Annals of Discrete Mathematics 16 (1982) 97–120 (source of Theorem 6.5).
  • A. Frank, A weighted matroid intersection algorithm, J. Algorithms 2 (1981) 328–336.
  • J. Edmonds, Submodular functions, matroids and certain polyhedra, in: Combinatorial Structures and Their Applications, Gordon and Breach, New York, 1970, 69–87.
  • S. Fujishige, Theory of submodular programs: a Fenchel-type min-max theorem and subgradients of submodular functions, Mathematical Programming 29 (1984) 142–155.
  • M. Iri and N. Tomizawa, An algorithm for finding an optimal "independent assignment", J. Oper. Res. Soc. Japan 19 (1976) 32–57.
  • K. Murota, Discrete Convex Analysis, SIAM, 2003. https://doi.org/10.1137/1.9780898718508
18 thms7 active usersReviewed
Linear OptimizationOperations ResearchOptimization·Captain: Shuze Chen

Disjunctive Programming XII: Intersection Cuts, Generalized Intersection Cuts, and Lift-and-Project CutsTextbook

Motivation

Intersection cuts (Balas, 1971) are the founding construction of cutting-plane theory for mixed 0-1 and mixed-integer programs: given a fractional LP solution xˉ\bar xxˉ and a convex region SSS around it known to contain no feasible integer point, the hyperplane through the points where SSS's boundary meets the extreme rays of the LP cone at xˉ\bar xxˉ cuts off xˉ\bar xxˉ without cutting off any feasible solution. What makes intersection cuts foundational rather than merely one technique among many is a completeness question: do intersection cuts, iterated over every choice of cutting region, exhaust the strongest possible cuts — the facets of the integer hull itself — or only some weaker subclass? Balas answered this affirmatively for standard intersection cuts (those derived from convex sets free of feasible integer points, as originally defined), while a narrower, more recently popular variant restricted to lattice-free sets provably falls short of this completeness (E. Balas, Intersection Cuts — A New Type of Cutting Planes for Integer Programming, Operations Research 19 (1971), 19–39, https://doi.org/10.1287/opre.19.1.19). This mission formalizes that completeness theorem, together with a companion pair of results (Balas and Kis, 2016) pinning down exactly when a lift-and-project cut — a strictly more general cutting-plane construction from an arbitrary disjunction — coincides with a standard intersection cut, and what happens when it provably does not (E. Balas and T. Kis, On the relationship between standard intersection cuts, lift-and-project cuts, and generalized intersection cuts, Mathematical Programming A 160 (2016), 85–114, https://doi.org/10.1007/s10107-015-0975-1).

Setting

Fix a finite index set ι\iotaι (structural and surplus variables of an LP relaxation together), a basic index set I⊆ιI \subseteq \iotaI⊆ι and a nonbasic (cobasis) set JJJ, with optimal simplex-tableau coefficients aˉij\bar a_{ij}aˉij​ for i∈Ii \in Ii∈I, j∈Jj \in Jj∈J. The extreme ray of the LP cone C(J)C(J)C(J) at a basic solution xˉ\bar xxˉ associated with j∈Jj \in Jj∈J has direction rjr^jrj with rij=−aˉijr^j_i = -\bar a_{ij}rij​=−aˉij​ for i∈Ii \in Ii∈I, rjj=1r^j_j = 1rjj​=1, and rij=0r^j_i = 0rij​=0 otherwise; C(J)C(J)C(J) itself is the cone with apex xˉ\bar xxˉ generated by these n=∣J∣n = |J|n=∣J∣ rays. A convex set SSS is PIP_IPI​-free at xˉ\bar xxˉ if xˉ\bar xxˉ lies in int S\mathrm{int}\, SintS and int S\mathrm{int}\, SintS contains no point of the mixed-integer feasible set PIP_IPI​. The standard intersection cut (SIC) derived from such an SSS is ∑j∈J1λjxj≥1\sum_{j\in J} \tfrac{1}{\lambda_j} x_j \ge 1∑j∈J​λj​1​xj​≥1, where λj\lambda_jλj​ is the largest t≥0t \ge 0t≥0 with xˉ−trj∈S\bar x - t r^j \in Sxˉ−trj∈S.

The corner polyhedron corner(J)\mathrm{corner}(J)corner(J) is the convex hull of the integer points contained in C(J)C(J)C(J); it satisfies C(J)⊃corner(J)⊃conv(PI)C(J) \supset \mathrm{corner}(J) \supset \mathrm{conv}(P_I)C(J)⊃corner(J)⊃conv(PI​). A set FFF is a facet of a polyhedron QQQ if it is a proper extreme subset of QQQ of affine dimension exactly dim⁡(Q)−1\dim(Q) - 1dim(Q)−1.

For a lift-and-project cut, fix P:={x:A~x≥b~}P := \{x : \tilde A x \ge \tilde b\}P:={x:A~x≥b~} and a family of inequalities dtx≥d0td^t x \ge d^t_0dtx≥d0t​, t∈Tt \in Tt∈T, presenting a PIP_IPI​-free polyhedron S:={x:dtx≤d0t, t∈T}S := \{x : d^t x \le d^t_0,\ t\in T\}S:={x:dtx≤d0t​, t∈T}. The associated cut-generating LP (CGLP) constraint set (11.6) is

α−utA~−u0tdt=0,−β+utb~+u0td0t=0 (t∈T),∑t∈T(ute+u0t)=1,ut,u0t≥0,\alpha - u^t \tilde A - u^t_0 d^t = 0, \qquad -\beta + u^t \tilde b + u^t_0 d^t_0 = 0 \ (t\in T), \qquad \textstyle\sum_{t\in T}(u^t e + u^t_0) = 1, \qquad u^t, u^t_0 \ge 0,α−utA~−u0t​dt=0,−β+utb~+u0t​d0t​=0 (t∈T),∑t∈T​(ute+u0t​)=1,ut,u0t​≥0,

whose feasible solutions (α,β,{ut,u0t})(\alpha,\beta,\{u^t,u^t_0\})(α,β,{ut,u0t​}) correspond to valid lift-and-project (L&P) cuts αx≥β\alpha x \ge \betaαx≥β for the disjunction built from PPP and the terms dtx≥d0td^t x \ge d^t_0dtx≥d0t​. An inequality γ1x≥γ01\gamma^1 x \ge \gamma^1_0γ1x≥γ01​ dominates γ2x≥γ02\gamma^2 x \ge \gamma^2_0γ2x≥γ02​ on PPP if every x∈Px \in Px∈P satisfying the first also satisfies the second.

Formalization targets

Theorem 11.2 (goal). Every facet FFF of conv(PI)\mathrm{conv}(P_I)conv(PI​), defined by φx≥φ0\varphi x \ge \varphi_0φx≥φ0​ and cutting off some vertex vvv of PPP (i.e. φv<φ0\varphi v < \varphi_0φv<φ0​), is realized exactly by the standard intersection cut derived at vvv from T:={x:φx≤φ0}T := \{x : \varphi x \le \varphi_0\}T:={x:φx≤φ0​}:

T is PI-free at v,{x:1≤∑j∈J1λjxj}={x:φ0≤φx}.T \text{ is } P_I\text{-free at } v, \qquad \Big\{x : 1 \le \textstyle\sum_{j\in J} \tfrac{1}{\lambda_j} x_j\Big\} = \{x : \varphi_0 \le \varphi x\}.T is PI​-free at v,{x:1≤∑j∈J​λj​1​xj​}={x:φ0​≤φx}.

Corollary 11.3. Every vertex of a corner polyhedron not already in conv(PI)\mathrm{conv}(P_I)conv(PI​) is cut off by some standard intersection cut — the same completeness claim restated at the level of individual excluded vertices rather than facets.

Theorem 11.9. A sufficient condition for an L&P cut to reduce to a standard intersection cut: if a basic feasible CGLP solution's multipliers utu^tut are all supported on a single common nonsingular cobasis ι\iotaι, then

{x:β≤αx}={x:1≤∑jπj sj(x)}\{x : \beta \le \alpha x\} = \{x : 1 \le \textstyle\sum_j \pi_j\, s_j(x)\}{x:β≤αx}={x:1≤∑j​πj​sj​(x)}

for the intersection cut with coefficients πj:=max⁡tπjt\pi_j := \max_{t} \pi^t_jπj​:=maxt​πjt​, πjt:=dt(−aˉj)/(d0t−dtaˉ0)\pi^t_j := d^t(-\bar a_j)/(d^t_0 - d^t \bar a_0)πjt​:=dt(−aˉj​)/(d0t​−dtaˉ0​), expressed via the surplus values sjs_jsj​ at ι\iotaι's rows.

Theorem 11.11. When Theorem 11.9's condition fails — even after every positive rescaling of the solution — no intersection cut from SSS is equivalent to the L&P cut; and when the solution additionally uniquely minimizes the CGLP objective, the L&P cut is strictly better than, and dominated by none of, every intersection cut from SSS.

The targets move from the completeness statement itself (11.2, its vertex-level restatement 11.3) to the mechanism explaining why completeness holds in general: a sufficient condition for literal coincidence (11.9), and a proof that failure of that condition is never fatal to completeness because the L&P cut remains at least as strong, in a precise domination sense (11.11).

Significance

Theorem 11.2 is the theoretical justification for standard intersection cuts as a complete cutting plane paradigm: no facet of the integer hull is out of reach of some choice of PIP_IPI​-free cutting region, in sharp contrast to the restricted (lattice-free) variant that dominates the modern multi-row cut literature but is provably incomplete in this sense. Theorems 11.9 and 11.11 locate lift-and-project cuts precisely relative to this complete family: L&P cuts specialize exactly to intersection cuts under an explicit, checkable structural condition on the CGLP solution, and strictly dominate the intersection-cut family whenever that condition cannot be met — which is what makes lift-and-project the strictly more general (and, on general non-split disjunctions, strictly more powerful) construction.

Both directions are proved in the source (Balas 1971 for Theorem 11.2; Balas and Kis 2016 for Theorems 11.9 and 11.11) but have no counterpart on this platform: nothing existing treats intersection cuts, corner polyhedra, cut-generating LPs, or the correspondence between these two cutting-plane families. This mission produces the first Lean statements of all four.

Difficulty

The obvious shortcut for Theorem 11.2 is to treat "cuts off a vertex" and "is PIP_IPI​-free" as producing merely some valid cut, and stop there — Theorem 1.1 already guarantees that much. The actual content is the equality: the specific intersection cut constructed from the halfspace TTT does not just happen to be valid, it reconstructs φ\varphiφ itself, coefficient for coefficient, because TTT is a single hyperplane so every one of the LP cone's nnn extreme rays exits it through the same boundary. Losing sight of this collapses the theorem into a restatement of Theorem 1.1 with no new content.

For Theorem 11.11, the difficulty is that "no intersection cut from SSS is equivalent" must survive scaling: a naive argument might rule out one specific (α,β)(\alpha,\beta)(α,β)-representative satisfying Theorem 11.9's condition while missing that a positive rescaling of the same cut could still satisfy it under a different multiplier vector. The theorem's hypothesis is deliberately built to close this gap by quantifying over every positive scalar and every feasible solution realizing the rescaled pair, not just the given one.

Formalization scope

The ambient space is a generic finite index type ι for Theorem 11.2/Corollary 11.3 (structural and surplus variables together, matching 01-intro-duality's own convention for the intersection- cut apparatus), and Fin n → ℝ for the CGLP-based Theorems 11.9/11.11, matching the series' default. P_I is left as an abstract parameter throughout (never expanded into an explicit integrality predicate on a specific coordinate subset for Theorem 11.2, matching 01-intro- duality's own treatment), except in the corner-polyhedron definitions, where it is made concrete via a coordinate set Nprime since the corollary's statement depends on it directly. "Facet" and "extreme ray" are restated from 02b-polarity's conventions (affine dimension via Module.finrank of vectorSpan; IsExtreme) rather than reinvented, since Chapter 2 already pins these down precisely for this series. "Basic feasible solution" to the CGLP in Theorem 11.9 is captured entirely by the theorem's own submatrix-support condition, not through a separate, independently-derived basicness predicate — the book's own proof uses no other property of basicness, so adding one would be unused decoration, not additional fidelity. Cut equivalence throughout is formalized as exact set equality of the two halfspaces, matching the series' established convention (e.g. 10-split-closure's Theorem 10.1) for what "equivalent cuts" means.

This mission depends on no other chunk's Lean definitions: the intersection-cut apparatus (extremeRay, PIFree) is restated from 01-intro-duality, the facet apparatus (PolyDim, IsFacet) from 02b-polarity, and the tableau apparatus (Ahat, Bhat, Abar, Abar0, SurplusM) from 08-cut-correspondence/09-simplex-tableau/10-split-closure, per the series convention against importing another draft mission's definitions while chunks are drafted concurrently. A trivializing formalization to rule out explicitly: collapsing Theorem 11.2 to "some intersection cut is valid and cuts off vvv" (already implied by Theorem 1.1 alone) rather than the literal set-equality with the facet's own inequality, which is this theorem's actual content.

Selected references

  • E. Balas, Intersection Cuts — A New Type of Cutting Planes for Integer Programming, Operations Research 19 (1971), 19–39. https://doi.org/10.1287/opre.19.1.19
  • E. Balas and T. Kis, On the relationship between standard intersection cuts, lift-and-project cuts, and generalized intersection cuts, Mathematical Programming A 160 (2016), 85–114. https://doi.org/10.1007/s10107-015-0975-1
  • E. Balas and M. Perregaard, Generalized intersection cuts and a new cut generating paradigm, Mathematical Programming A 137 (2013), 19–35. https://doi.org/10.1007/s10107-011-0483-x
  • E. Balas, Disjunctive Programming, Springer, 2018, Chapter 11, §11.1–11.5. https://doi.org/10.1007/978-3-030-00148-3
11 thms3 active users
🏆Completed
Linear OptimizationOperations ResearchOptimization·Captain: Shuze Chen

Disjunctive Programming XIII: Monoidal Cut Strengthening and the Gomory Mixed-Integer CutTextbook

Motivation

The Gomory mixed-integer (GMI) cut is the single most widely deployed cutting plane in practical mixed-integer programming: every commercial solver generates it, from a simplex tableau row, essentially for free. Yet the GMI cut is not the strongest cut derivable from the same row: once a subset of the variables is known to be integer-constrained, that integrality can be used to tighten the cut's coefficients further, a technique due to Balas and Jeroslow that predates and motivates most of the general disjunctive-cut machinery of this book (E. Balas and R. G. Jeroslow, Strengthening cuts for mixed integer programs, European Journal of Operational Research 4 (1980), 224–234, https://doi.org/10.1016/0377-2217(80)90106-X). This mission formalizes the culmination of that line of work: two refinements of the GMI cut, each strictly stronger than the plain GMI coefficient on part of the variable set, obtained by applying monoidal cut strengthening — optimizing a cut's coefficients over an algebraic monoid of admissible integer shifts — to the two-term split disjunction that produces the GMI cut in the first place (E. Balas and R. Jeroslow, as above; the monoidal strengthening framework itself due to R. E. Gomory and E. L. Johnson, and formalized in the generality used here by G. Nemhauser and L. Wolsey and by J. -P. P. Richard, Y. Li and A. Miller).

Setting

Fix a row of a simplex tableau: y=a0−∑j∈Jajxjy = a_0 - \sum_{j\in J} a_j x_jy=a0​−∑j∈J​aj​xj​, with xj≥0x_j \ge 0xj​≥0 for j∈Jj \in Jj∈J, xjx_jxj​ integer for jjj in a subset J1⊆JJ_1 \subseteq JJ1​⊆J, and 0<a0<10 < a_0 < 10<a0​<1. If yyy is itself integer-constrained, every feasible solution satisfies the split disjunction y≤0∨y≥1y \le 0 \lor y \ge 1y≤0∨y≥1, from which the ordinary GMI cut αx≥1\alpha x \ge 1αx≥1 follows, with αj:=max⁡{aj/a0, −aj/(1−a0)}\alpha_j := \max\{a_j/a_0,\ -a_j/(1-a_0)\}αj​:=max{aj​/a0​, −aj​/(1−a0​)} uniformly over all of JJJ.

For a general qqq-term disjunction ⋁h∈Q(∑jajhxj≥a0h)\bigvee_{h\in Q}(\sum_j a^h_j x_j \ge a^h_0)⋁h∈Q​(∑j​ajh​xj​≥a0h​) with a known background lower bound b0h≤a0hb^h_0 \le a^h_0b0h​≤a0h​ on each term's left side, the cut monoid is

M:={μ∈Zq:∑h∈Qμh≥0}.M := \{\mu \in \mathbb{Z}^q : \textstyle\sum_{h\in Q} \mu_h \ge 0\}.M:={μ∈Zq:∑h∈Q​μh​≥0}.

Given the disjunction and the lower bounds, replacing each term's coefficient ajha^h_jajh​ (for jjj in the integer-constrained set J1J_1J1​) with ajh+μhj(a0h−b0h)a^h_j + \mu^j_h(a^h_0 - b^h_0)ajh​+μhj​(a0h​−b0h​) for any fixed μj∈M\mu^j \in Mμj∈M leaves the disjunction — and hence the disjunctive cut it implies — valid; optimizing this replacement over the whole monoid strengthens the resulting cut. For the normalized qqq-term disjunction ⋁i∈Q(∑jaijxj≥ai0)\bigvee_{i\in Q}(\sum_j a_{ij}x_j \ge a_{i0})⋁i∈Q​(∑j​aij​xj​≥ai0​) (each right-hand side scaled to a common reference), the unstrengthened cut coefficient is βj:=max⁡i∈Qaij/ai0\beta_j := \max_{i\in Q} a_{ij}/a_{i0}βj​:=maxi∈Q​aij​/ai0​.

Formalization targets

Theorem 11.19. For the general qqq-term disjunctive-cut situation, every x≥0x \ge 0x≥0 satisfying the background lower bound and the disjunction also satisfies the monoidally-strengthened cut ∑jαjxj≥α0\sum_j \alpha_j x_j \ge \alpha_0∑j​αj​xj​≥α0​, with

αj={inf⁡μj∈Mmax⁡h∈Qθh[ajh+μhj(a0h−b0h)],j∈J1,max⁡h∈Qθhajh,j∈J∖J1,α0=min⁡h∈Qθha0h.\alpha_j = \begin{cases} \inf_{\mu^j\in M}\max_{h\in Q}\theta_h[a^h_j+\mu^j_h(a^h_0-b^h_0)], & j\in J_1, \\ \max_{h\in Q}\theta_h a^h_j, & j\in J\setminus J_1,\end{cases} \qquad \alpha_0 = \min_{h\in Q}\theta_h a^h_0.αj​={infμj∈M​maxh∈Q​θh​[ajh​+μhj​(a0h​−b0h​)],maxh∈Q​θh​ajh​,​j∈J1​,j∈J∖J1​,​α0​=h∈Qmin​θh​a0h​.

Proposition 11.22. For the normalized disjunction, and any fixed monoid elements mj∈Mm^j \in Mmj∈M (j∈J1j\in J_1j∈J1​), every x≥0x\ge0x≥0 integer on J1J_1J1​ satisfying the disjunction and the background lower bound also satisfies the strengthened disjunction with each term's coefficients shifted by mjm^jmj — the fact that licenses optimizing over the whole monoid afterward.

Corollary 11.25. For each disjunct index kkk, the cut δkx≥1\delta^k x \ge 1δkx≥1 is valid, with δjk:=min⁡{(akj+ak0−bk)/ak0, βj}\delta^k_j := \min\{(a_{kj}+a_{k0}-b_k)/a_{k0},\ \beta_j\}δjk​:=min{(akj​+ak0​−bk​)/ak0​, βj​} on J1J_1J1​ and δjk:=βj\delta^k_j :=\beta_jδjk​:=βj​ elsewhere — a version of monoidal strengthening needing no optimization over MMM at all.

Theorem 11.26 (goal). Specializing the same monoidal strengthening machinery to the two-term split disjunction y≤0∨y≥1y \le 0 \lor y \ge 1y≤0∨y≥1 itself: both α+x≥1\alpha^+ x \ge 1α+x≥1 and α−x≥1\alpha^- x \ge 1α−x≥1 are valid cuts, with α+\alpha^+α+ given by a three-case piecewise formula (eq. (11.55)) refining the GMI coefficient on part of J1J_1J1​, and α−\alpha^-α− symmetric (eq. (11.56)).

The targets move from the general monoidal-strengthening theorem (11.19) through its validity engine in normalized form (Proposition 11.22, directly cited by the intermediate Theorem 11.23 that the goal specializes) and its optimization-free cousin (Corollary 11.25, immediately preceding the goal in the same subsection) to the concrete payoff for the single most-used cut in practice.

Significance

Theorem 11.26's cuts are not a theoretical curiosity: Corollary 11.27 (not drafted this pass) gives an explicit, checkable condition under which each cut is strictly stronger than the plain GMI cut, and Example 4 (p. 187–188) gives a fully worked six-variable instance where the improvement is concrete and numerically verifiable. Since the GMI cut is generated by essentially every mixed-integer solver at essentially every node of a branch-and-cut search, a cheap, always-valid strengthening of it — derivable from the same tableau row with no extra data beyond knowing which variables are integer-constrained — has direct practical reach far beyond this one book.

Both directions are proved in the source (Balas and Jeroslow 1980 for the underlying strengthening idea; this book's own Theorem 11.19/Proposition 11.22/Theorem 11.23 chain for the general monoidal framework applied here) but have no counterpart on this platform: nothing existing treats monoidal cut strengthening, the cut monoid itself, or a refinement of the GMI cut. This mission produces the first Lean statements of all four targets.

Difficulty

The obvious shortcut for Theorem 11.26 is to collapse α+\alpha^+α+'s three-case definition into the plain GMI formula max⁡{aj/a0, −aj/(1−a0)}\max\{a_j/a_0,\ -a_j/(1-a_0)\}max{aj​/a0​, −aj​/(1−a0​)} applied uniformly — after all, that formula already gives a valid cut, and the strengthened cases can only make individual coefficients smaller (better). But a uniform formula reproduces exactly the plain GMI cut and can never be strictly stronger than it, which is the entire content the goal theorem (via Corollary 11.27) is building toward; the piecewise case split over J1+J^+_1J1+​ (where aj>1a_j>1aj​>1), J1>J^{>}_1J1>​ (where a0−1≤aj≤1a_0-1\le a_j\le1a0​−1≤aj​≤1), and the rest is not incidental bookkeeping but the mechanism by which integrality actually buys something.

For Proposition 11.22 and Theorem 11.19, the difficulty is that the strengthening must remain valid simultaneously for every choice of the monoid element μj\mu^jμj (or mjm^jmj) — not merely for some cleverly chosen one — since Theorem 11.19's conclusion then takes an infimum over the entire monoid MMM, which is generally infinite. Fixing a single "obviously good" μj\mu^jμj and stopping there would prove a weaker, non-optimized statement.

Formalization scope

The ambient space is Fin n → ℝ throughout, matching the series default, with the disjunction index set Q represented as Fin q and the cut monoid CutMonoid q : Set (Fin q → ℤ). Theorem 11.19 is formalized with scalar per-term coefficients ajha^h_jajh​ (one real number per disjunct hhh and variable jjj), rather than the fully general "each term a multi-row system Ahx≥a0hA^h x \ge a^h_0Ahx≥a0h​" framing the book's surrounding prose (§11.8's opening) sketches before specializing: every downstream result this mission needs (Proposition 11.22 onward, via (11.38)) is already stated at the single-inequality-per-term level, so this is not a weakening relative to what is actually used, only relative to a more general preamble that is never itself given a numbered, formalizable statement. AlphaJStrengthened uses sInf over the (possibly infinite) monoid literally, not a fixed near-optimal representative. AlphaPlus/AlphaMinus use the exact three-case structure of (11.55)/(11.56) — collapsing them into the uniform GMI formula is the trivializing formalization this mission rules out, since a uniform formula could never realize the theorem's actual (strictly stronger, on part of the domain) claim.

This mission depends on no other chunk's Lean definitions; it restates 11a-intersection-cuts's disjunctive-cut vocabulary only informally (the underlying disjunctive-cut idea, not any specific Lean declaration), per the series convention. A complete development needs: properties of sInf over an unbounded-below-safe subset of ℤ-indexed reals, and case analysis on Int.floor/ Int.ceil for the piecewise formulas. The cut-monoid and unstrengthened/strengthened-coefficient definitions are reusable by any later mission touching monoidal strengthening (e.g. a future mission on Theorem 11.23's full Lopsided-cut construction or the multiple-term-disjunction material of §11.9.2–11.9.3, not drafted this pass).

Selected references

  • E. Balas and R. G. Jeroslow, Strengthening cuts for mixed integer programs, European Journal of Operational Research 4 (1980), 224–234. https://doi.org/10.1016/0377-2217(80)90106-X
  • R. E. Gomory and E. L. Johnson, T-space and cutting planes, Mathematical Programming 96 (2003), 341–375. https://doi.org/10.1007/s10107-003-0389-3
  • J.-P. P. Richard, Y. Li, and L. A. Miller, Valid inequalities for MIPs and group polyhedra from approximate liftings, Mathematical Programming A 118 (2009), 253–277. https://doi.org/10.1007/s10107-007-0190-9
  • E. Balas, Disjunctive Programming, Springer, 2018, Chapter 11, §11.8–11.9. https://doi.org/10.1007/978-3-030-00148-3
8 thms4 active users
🏆Completed
CombinatoricsGraph TheoryOperations Research+1·Captain: mikedeng1

A Linear-Time Algorithm for Finding a Sparse k-Connected Spanning Subgraph of a k-Connected Graph 1: The FOREST Decomposition Preserves Local Edge-ConnectivityResearch Paper

Motivation

Many graph algorithms for connectivity questions run in time proportional to the number of edges. When the question is only whether a graph is kkk-edge-connected, or what its local edge-connectivities are up to a threshold kkk, most edges are irrelevant: a spanning subgraph with O(k∣V∣)O(k|V|)O(k∣V∣) edges already carries the answer. Such a subgraph is called a sparse certificate. Computing one first and running the expensive algorithm on it replaces ∣E∣|E|∣E∣ by k∣V∣k|V|k∣V∣ in the running time of connectivity testing, of Matula-type edge-connectivity algorithms, and of sss–ttt flow computations used as connectivity oracles.

Nagamochi and Ibaraki (Algorithmica 7, 1992) gave a procedure, FOREST, that computes such a certificate for edge-connectivity and, on simple graphs, for node-connectivity, with a single graph search. The same partition of the edges into forests is the engine of their deterministic minimum-cut algorithm for multigraphs (SIAM J. Discrete Math. 5, 1992), which later became the maximum-adjacency ordering of the Stoer–Wagner minimum-cut algorithm (J. ACM 44, 1997).

Timeline:

  • 1927: Menger identifies the minimum number of edges separating two nodes with the maximum number of edge-disjoint paths between them.
  • 1992: Nagamochi and Ibaraki publish Procedure FOREST and prove that its iii-th prefix preserves local edge-connectivity up to iii in multigraphs, and local node-connectivity up to iii in simple graphs.
  • 1993: Cheriyan, Kao and Thurimella (SIAM J. Comput. 22) obtain sparse certificates by scan-first search; Frank, Ibaraki and Nagamochi (J. Graph Theory 17) give a shorter proof for the node-connectivity case.
  • 1994: Nishizeki and Poljak (Discrete Appl. Math. 55) publish the forest-decomposition lemma (Lemma 2.1 below), found independently.

Setting

A graph G=(V,E)G = (V, E)G=(V,E) is finite and undirected, has ∣V∣≥2|V| \ge 2∣V∣≥2 nodes, may have multiple edges (several edges with the same pair of end nodes), and has no self-loop. It is simple if no two edges have the same end nodes. For F⊆EF \subseteq EF⊆E, (V,F)(V, F)(V,F) is the spanning subgraph with edge set FFF. It is a forest if it has no cycle; two parallel edges form a cycle. It is a maximal spanning forest in (V,H)(V, H)(V,H), for F⊆HF \subseteq HF⊆H, if adding any edge of H∖FH \setminus FH∖F to FFF creates a cycle.

The local edge-connectivity λ(x,y;H)\lambda(x, y; H)λ(x,y;H) is the minimum number of edges of HHH whose removal leaves no path from xxx to yyy; parallel edges count separately. It is ∞\infty∞ when x=yx = yx=y.

Procedure FOREST keeps a label r(v)∈Nr(v) \in \mathbb{N}r(v)∈N on every node, initially 000, and classes E1,E2,…,E∣E∣E_1, E_2, \dots, E_{|E|}E1​,E2​,…,E∣E∣​, initially empty. While an unscanned node exists, it picks an unscanned node xxx of largest label; for every unscanned edge eee from xxx to a node yyy, it puts eee into Er(y)+1E_{r(y)+1}Er(y)+1​, increases r(x)r(x)r(x) by one if r(x)=r(y)r(x) = r(y)r(x)=r(y), increases r(y)r(y)r(y) by one, and marks eee scanned; then it marks xxx scanned. Ties among nodes and the order of edges are free. On termination, Gi=(V,E1∪⋯∪Ei)G_i = (V, E_1 \cup \cdots \cup E_i)Gi​=(V,E1​∪⋯∪Ei​).

Formalization targets

Goal: Theorem 2.1 (pp. 588–589), without the running time

For every graph GGG and every completed execution of FOREST on GGG:

  1. every edge lies in exactly one class EiE_iEi​, 1≤i≤∣E∣1 \le i \le |E|1≤i≤∣E∣;
  2. for i=1,…,∣E∣i = 1, \dots, |E|i=1,…,∣E∣,
λ(x,y;Gi)≥min⁡{λ(x,y;G), i}for all x,y∈V;(2.1)\lambda(x, y; G_i) \ge \min\{\lambda(x, y; G),\ i\} \qquad \text{for all } x, y \in V; \tag{2.1}λ(x,y;Gi​)≥min{λ(x,y;G), i}for all x,y∈V;(2.1)
  1. ∣Ei∣≤∣V∣−1|E_i| \le |V| - 1∣Ei​∣≤∣V∣−1 for all iii;
  2. if GGG is simple, ∣Ei∣≤∣V∣−i|E_i| \le |V| - i∣Ei​∣≤∣V∣−i for i≤∣V∣−1i \le |V| - 1i≤∣V∣−1 and Ei=∅E_i = \emptysetEi​=∅ for i≥∣V∣i \ge |V|i≥∣V∣.

Milestones

  • Lemma 2.2 (p. 587): during the execution, a node vvv has incident edges in exactly the classes E1,…,Er(v)E_1, \dots, E_{r(v)}E1​,…,Er(v)​.
  • Lemma 2.3 (p. 587): each (V,Ei)(V, E_i)(V,Ei​) is a forest at every instant.
  • Lemma 2.4 (p. 588): (a) an edge (u,v)(u, v)(u,v) added to EiE_iEi​ has its end nodes joined by a path in Ei−1E_{i-1}Ei−1​; (b) a path in EjE_jEj​ between uuu and vvv yields a path in every EiE_iEi​, i<ji < ji<j.
  • Lemma 2.5 (p. 588): each output (V,Ei)(V, E_i)(V,Ei​) is a maximal spanning forest in G−E1∪⋯∪Ei−1G - E_1 \cup \cdots \cup E_{i-1}G−E1​∪⋯∪Ei−1​.
  • Lemma 2.1 (p. 584): any sequence of successive maximal spanning forests satisfies (2.1).

Companions

  • the sparse certificate (p. 589): if λ(x,y;G)≥k\lambda(x, y; G) \ge kλ(x,y;G)≥k for all x,yx, yx,y, then GkG_kGk​ is kkk-edge-connected with ∣E(Gk)∣≤k(∣V∣−1)|E(G_k)| \le k(|V| - 1)∣E(Gk​)∣≤k(∣V∣−1), and ∣E(Gk)∣≤k∣V∣−k(k+1)/2|E(G_k)| \le k|V| - k(k+1)/2∣E(Gk​)∣≤k∣V∣−k(k+1)/2 for simple GGG;
  • Lemma 2.6 (p. 589): for k≤δ(G)k \le \delta(G)k≤δ(G), GkG_kGk​ has a node of degree exactly kkk.

Significance

(2.1) says that one search produces, for every threshold kkk at once, a subgraph with at most k(∣V∣−1)k(|V|-1)k(∣V∣−1) edges that keeps every local edge-connectivity up to kkk. Any algorithm whose running time grows with ∣E∣|E|∣E∣ can then be run on GkG_kGk​ in place of GGG; §4 of the paper uses this to speed up kkk-connectivity tests and the computation of local connectivities. The same forest partition is the structural fact behind the Nagamochi–Ibaraki and Stoer–Wagner minimum-cut algorithms. Lemma 2.6 shows that the certificate is tight: its edge-connectivity is exactly kkk when λ(G)≥k\lambda(G) \ge kλ(G)≥k.

The results are proved in the paper. No machine-checked proof of them is known. Formalizing them means formalizing a graph search with free tie-breaking as a transition system, reasoning about invariants of all its executions, and proving a cut-counting statement for multigraphs. Mathlib's connectivity notions, such as SimpleGraph.IsEdgeReachable, do not see parallel edges, so the multigraph cut theory here is new.

Difficulty

Lemma 2.1 is a short cut argument once maximality is available. The difficulty is showing that FOREST, which assigns each edge to a class by looking only at the label of one end node, produces maximal forests in the successive residual graphs (Lemma 2.5). The obvious invariant, that the class of an edge is the first forest it does not close a cycle in, is not what line 7 computes. The label r(y)r(y)r(y) records only which classes touch yyy, not which component of each class contains yyy. The paper's argument needs Lemma 2.4(a): at the moment an edge is added to EiE_iEi​ its ends already lie in one tree of Ei−1E_{i-1}Ei−1​. That relies on the choice of the unscanned node of largest label, on the order of lines 8 and 9, and on an argument about the scan order of tree roots.

Formalization scope

  • Graphs. A graph is a finite node type V with ∣V∣≥2|V| \ge 2∣V∣≥2, a finite edge type E, and ends : E → Sym2 V with no diagonal value (no self-loops). Parallel edges are distinct elements of E. Simplicity is injectivity of ends, and edge subsets are Finset E. A forest is an edge set in which every edge is a bridge, a condition that sees parallel edges.
  • Connectivity. λ\lambdaλ is an infimum in ℕ∞ over separating edge sets, ∞\infty∞ at x=yx = yx=y. (2.1) is kept "for all x,yx, yx,y", as printed.
  • FOREST. FOREST is a nondeterministic step relation (select, scan, finish) on explicit states: labels, class index per edge (000 = unscanned), scanned nodes, current node and selection order. The theorems quantify over every run from the initial state, so no tie-breaking rule is fixed. "At some time instant" is a state of the run; "upon completion" is a run whose last state has every node scanned. Lemma 2.2 is stated at every state, not only after a scan block (the other steps change neither labels nor classes). Lemma 2.4(a) assumes i≥2i \ge 2i≥2, since E0E_0E0​ does not exist.
  • Exclusions. Theorem 2.1's clause "is found in O(∣V∣+∣E∣)O(|V| + |E|)O(∣V∣+∣E∣) time", the bucket implementation, and the time bound of the certificate are not formalized: the paper fixes no machine model. The goal consists of the structural conclusions only. The bound printed "if GGG is multiple" is stated for every loopless graph.
  • Non-triviality. The goal is about the classes of a run of FOREST. An arbitrary partition of EEE into maximal spanning forests is Lemma 2.1's hypothesis, not a formalization of Theorem 2.1. A statement in which the classes are unconstrained variables, or in which the run hypotheses cannot be met, would be trivial. A separate sanity file checks that a complete run on the triangle K3K_3K3​ exists and attains ∣E1∣=∣V∣−1|E_1| = |V| - 1∣E1​∣=∣V∣−1, ∣E2∣=∣V∣−2|E_2| = |V| - 2∣E2​∣=∣V∣−2.
  • Welcome contributions. Useful reusable infrastructure includes:
    • a cut and Menger layer for finite multigraphs;
    • forest and bridge lemmas for edge-indexed graphs;
    • invariant-style reasoning over runs.

Selected references

  • H. Nagamochi, T. Ibaraki, A linear-time algorithm for finding a sparse kkk-connected spanning subgraph of a kkk-connected graph, Algorithmica 7 (1992) 583–596. https://doi.org/10.1007/BF01758778
  • H. Nagamochi, T. Ibaraki, Computing edge-connectivity in multigraphs and capacitated graphs, SIAM J. Discrete Math. 5 (1992) 54–66. https://doi.org/10.1137/0405004
  • T. Nishizeki, S. Poljak, kkk-connectivity and decomposition of graphs into forests, Discrete Appl. Math. 55 (1994) 295–301. https://doi.org/10.1016/0166-218X(94)90014-0
  • J. Cheriyan, M.-Y. Kao, R. Thurimella, Scan-first search and sparse certificates: an improved parallel algorithm for kkk-vertex connectivity, SIAM J. Comput. 22 (1993) 157–174. https://doi.org/10.1137/0222013
  • A. Frank, T. Ibaraki, H. Nagamochi, On sparse subgraphs preserving connectivity properties, J. Graph Theory 17 (1993) 275–281. https://doi.org/10.1002/jgt.3190170302
  • M. Stoer, F. Wagner, A simple min-cut algorithm, J. ACM 44 (1997) 585–591. https://doi.org/10.1145/263867.263872
10 thms3 active usersReviewed
🏆Completed
Linear OptimizationOperations ResearchOptimization·Captain: Shuze Chen

Disjunctive Programming XIV: Disjunctive Cuts from the V-Polyhedral RepresentationTextbook

Motivation

The lift-and-project cut-generating LP (CGLP) is the workhorse of the book's cutting-plane machinery, but its number of variables grows with qqq, the number of terms in the disjunction — a real computational cost for disjunctions with many terms. An alternative representation of the same disjunctive hull, built from vertices and extreme rays rather than from a dual LP, trades this away: its number of variables is fixed at nnn regardless of qqq, at the price of a constraint set that is generally exponential in size (T. H. Kim, V-polyhedral disjunctive cuts, PhD thesis and papers with E. Balas; the underlying representation traces to the classical Minkowski–Weyl theorem for polyhedra). This mission formalizes the chapter's capstone: the V-polyhedral, lift-and-project, and generalized-intersection-cut families — three representations that look structurally different — coincide exactly.

Setting

A disjunctive set in V-polyhedral (vertex-ray) form is F:=⋃h∈QPhF := \bigcup_{h\in Q} P^hF:=⋃h∈Q​Ph, Ph:=conv Vh+cone RhP^h := \mathrm{conv}\,V^h + \mathrm{cone}\,R^hPh:=convVh+coneRh, where VhV^hVh/RhR^hRh are the (finite) sets of vertices and extreme rays of the hhh-th disjunct. The conic hull of a set SSS is the set of all finite nonnegative combinations of its elements. For a reference point xF∈Fx_F \in FxF​∈F, the disjunctive cone CxFC_{x_F}CxF​​ is the homogenization, at xFx_FxF​, of the translated disjunctive system: (x′,x0′)∈Rn×R+(x',x_0') \in \mathbb{R}^n \times \mathbb{R}_+(x′,x0′​)∈Rn×R+​ with Ax′+(AxF−b)x0′≥0Ax' + (Ax_F-b)x_0' \ge 0Ax′+(AxF​−b)x0′​≥0 and ⋁h(Dhx′+(DhxF−d0h)x0′≥0)\bigvee_h(D^hx' + (D^hx_F-d^h_0)x_0' \ge 0)⋁h​(Dhx′+(DhxF​−d0h​)x0′​≥0).

For a relaxation P~h\tilde P^hP~h of each disjunct with Ph⊆P~h⊆C(xh)P^h \subseteq \tilde P^h \subseteq C(x^h)Ph⊆P~h⊆C(xh) (the LP cone at the disjunct's own optimum xhx^hxh), write V~h\tilde V^hV~h, R~h\tilde R^hR~h for its vertices and rays, and C:=conv(⋃hV~h)+cone(⋃hR~h)C := \mathrm{conv}(\bigcup_h \tilde V^h) + \mathrm{cone}(\bigcup_h \tilde R^h)C:=conv(⋃h​V~h)+cone(⋃h​R~h) for the single combined polyhedron they generate. The associated L&P cut-generating LP is

α=uhD~h,β≤uhd~0h(h∈Q),∑h∈Quhe=1,uh≥0.\alpha = u^h \tilde D^h, \qquad \beta \le u^h \tilde d^h_0 \quad (h\in Q), \qquad \textstyle\sum_{h\in Q} u^h e = 1, \qquad u^h \ge 0.α=uhD~h,β≤uhd~0h​(h∈Q),∑h∈Q​uhe=1,uh≥0.

Formalization targets

Proposition 12.1. αx≥β\alpha x \ge \betaαx≥β is valid for FFF if and only if αp≥β\alpha p \ge \betaαp≥β for every p∈Vhp \in V^hp∈Vh and αr≥0\alpha r \ge 0αr≥0 for every r∈Rhr \in R^hr∈Rh, over every h∈Qh \in Qh∈Q.

Proposition 12.3. For a cut αx≥β\alpha x \ge \betaαx≥β tight at xFx_FxF​ (αxF=β\alpha x_F = \betaαxF​=β) and x∈Fx \in Fx∈F: αx<β\alpha x < \betaαx<β if and only if α(x−xF)<0\alpha(x - x_F) < 0α(x−xF​)<0 for the corresponding point (x−xF,1)(x - x_F, 1)(x−xF​,1) of CxFC_{x_F}CxF​​.

Theorem 12.4. If (α,β)(\alpha,\beta)(α,β) satisfies αp≥β\alpha p \ge \betaαp≥β for every p∈V~hp \in \tilde V^hp∈V~h and αr≥0\alpha r \ge 0αr≥0 for every r∈R~hr \in \tilde R^hr∈R~h (over every hhh), and the mixed-integer feasible set PIP_IPI​ lies in the combined polyhedron CCC, then αx≥β\alpha x \ge \betaαx≥β is valid for PIP_IPI​.

Theorem 12.5 (goal). (α,β)(\alpha,\beta)(α,β) is valid for the combined vertex-ray system if and only if there exists a multiplier u={uh}h∈Qu = \{u^h\}_{h\in Q}u={uh}h∈Q​ making it simultaneously a feasible solution of the CGLP above and a generalized intersection cut from

S:={x∈Rn:uhD~hx≤uhd~0h, h∈Q}.S := \{x \in \mathbb{R}^n : u^h \tilde D^h x \le u^h \tilde d^h_0,\ h \in Q\}.S:={x∈Rn:uhD~hx≤uhd~0h​, h∈Q}.

The targets move from the elementary generator-validity fact (12.1) and its algorithmic companion (12.3, which the iterative cut-generation procedure of §12.1 uses to search only adjacent extreme points) through the same validity criterion generalized to a relaxed system (12.4) to the three-way unification (12.5) that is the entire point of introducing the V-polyhedral representation in the first place.

Significance

Theorem 12.5 explains why the V-polyhedral approach is worth having at all: it produces exactly the same cuts as the lift-and-project CGLP, so nothing is lost by switching representations, while the computational cost profile is reversed (the book's own estimate, not part of this mission's targets, shows the V-polyhedral approach at least q3q^3q3 times cheaper for a qqq-term disjunction using P~h=C(xh)\tilde P^h = C(x^h)P~h=C(xh)). This matters directly for disjunctions with many terms — split disjunctions used one or two at a time throughout most of the earlier chapters — which the CGLP approach makes increasingly expensive as qqq grows, but which the V-polyhedral approach handles without a growing variable count.

Both directions are proved in the source (this book's own §12, citing the underlying V-polyhedral cut idea to Balas's joint work with T. H. Kim, and the GIC-to-L&P equivalence to §11.4's own Theorem 11.5) but have no formalized counterpart on this platform: nothing existing treats V-polyhedral representations, disjunctive cones, or a three-way cut-family equivalence. This mission produces the first Lean statements of all four targets.

Difficulty

The obvious shortcut for Theorem 12.5 is to state only "the V-polyhedral cuts and the L&P cuts coincide" and treat the GIC leg as a footnote, since the book's own two-line proof dispatches the GIC equivalence by citing an earlier theorem rather than re-deriving it. But the theorem's actual claim is a three-way equivalence with a specific, described SSS built from the very multipliers that solve the CGLP — dropping the GIC leg, or defining SSS independently of those multipliers, would understate what is being asserted (the book's own remark following the theorem stresses that the GIC-defining points and the V-polyhedral vertices are typically different points that nonetheless yield equivalent cuts, which is exactly the content a two-way statement would erase).

For Theorem 12.4, the subtlety is that CCC (the combined polyhedron) is not the union ⋃hP~h\bigcup_h \tilde P^h⋃h​P~h but its convex hull — a strictly larger set in general — so validity for CCC's generators is a priori a stronger requirement than validity for each P~h\tilde P^hP~h separately; the theorem's force is that this stronger validity is still exactly what is needed (and obtained) to conclude validity for PIP_IPI​.

Formalization scope

The ambient space is Fin n → ℝ throughout, matching the series default, with the disjunction index Q left as a general type for Propositions 12.1/12.3 (so the same Ph/DisjSet definitions serve any finite disjunction) and specialized to [Fintype Q] where a finite sum over disjuncts is needed (Theorem 12.4's combined polyhedron, the CGLP of Theorem 12.5). V^h/R^h (Proposition 12.1) and Ṽ^h/R̃^h (Theorem 12.4) are formalized with the same underlying definitions (Ph, IsVPolyhedralValid) applied to different vertex/ray data, per BRIEF.md's explicit warning that these are distinct objects — not by duplicating the definitions under two names. "Is a generalized intersection cut from SSS" (IsGICFromS) is formalized via the exact characterization Theorem 11.4's own remark in 11a-intersection-cuts gives for the GIC family (valid outside SSS's interior, and a genuine cut), rather than by re-deriving the underlying extreme-ray construction — a trivializing formalization this mission rules out would instead drop this leg's dependence on the same multiplier u that witnesses the CGLP leg, decoupling S from the solution it is supposed to come from.

This mission depends on no other chunk's Lean definitions; it restates 02a-convex-hull's vertex/extreme-point vocabulary, 11a-intersection-cuts's cut apparatus, and 11b-monoidal-strengthening's disjunctive-cut conventions only informally, per the series convention. Theorem 12.2 (the extreme-ray/edge correspondence underlying the "adjacent vertices only" search strategy) was not drafted this pass — see HARD.md — since a faithful, non-circular formalization of "edge of a polytope incident with a point" needs face-lattice machinery beyond what any earlier chunk in this series has built. The ConicHull/DisjunctiveCone/CombinedC definitions are reusable by any later mission touching V-polyhedral cut generation.

Selected references

  • E. Balas and T. H. Kim, Cutting planes from extended LP formulations, Mathematical Programming 156 (2016), 587–606. https://doi.org/10.1007/s10107-015-0885-2
  • E. Balas and M. Perregaard, Generalized intersection cuts and a new cut generating paradigm, Mathematical Programming A 137 (2013), 19–35. https://doi.org/10.1007/s10107-011-0483-x
  • A. Kazachkov, Non-Recursive Cut Generation, PhD dissertation, Carnegie Mellon University, 2018 (cited by Balas for the relaxation-based V-polyhedral cut generator of §12.2).
  • E. Balas, Disjunctive Programming, Springer, 2018, Chapter 12. https://doi.org/10.1007/978-3-030-00148-3
7 thms3 active users
🏆Completed
CombinatoricsLinear OptimizationOperations Research+1·Captain: Shuze Chen

Disjunctive Programming XV: Dominants of Polytopes and Upper SeparationTextbook

Motivation

Many real-world disjunctive models are not unions of polyhedra in a single shared space, but unions of polyhedra in different spaces linked by a logical implication: some action affecting one set of entities has consequences for another. Balas's treatment of such models (§17 of the book, following [17]) reduces to understanding a single auxiliary object attached to each polytope in isolation: its dominant, the set of points that dominate (coordinatewise) some feasible point. Dominants and their duals, blockers, have a long history in combinatorial optimization — blocking-pair theory for covering and packing polyhedra traces to Fulkerson (D. R. Fulkerson, Blocking and anti-blocking pairs of polyhedra, Mathematical Programming 1 (1971), 168–194, https://doi.org/10.1007/BF01584085) — but this chapter develops a self-contained, constructive theory tailored to polytopes inside the unit cube, culminating in an exact, facet-complete description of the dominant for an arbitrary such polytope.

Setting

For a polyhedron P⊆R+nP \subseteq \mathbb{R}^n_+P⊆R+n​, the dominant is P+:=P+R+n={y≥0:y≥x for some x∈P}P^+ := P + \mathbb{R}^n_+ = \{y \ge 0 : y \ge x \text{ for some } x \in P\}P+:=P+R+n​={y≥0:y≥x for some x∈P}, and the blocker is P∗:={π∈R+n:πx≥1 for all x∈P}P^* := \{\pi \in \mathbb{R}^n_+ : \pi x \ge 1 \text{ for all } x \in P\}P∗:={π∈R+n​:πx≥1 for all x∈P} — the covering inequalities valid for PPP. (The blocker is not the reverse polar of 02b-polarity: restricting to the nonnegative orthant is essential and changes the object.) For x∗∈R+nx^* \in \mathbb{R}^n_+x∗∈R+n​, the upper-separation value is αP(x∗):=min⁡{πx∗:π∈P∗}\alpha_P(x^*) := \min\{\pi x^* : \pi \in P^*\}αP​(x∗):=min{πx∗:π∈P∗}; a violated covering inequality for x∗x^*x∗ exists exactly when αP(x∗)<1\alpha_P(x^*) < 1αP​(x∗)<1. A polytope P⊆[0,1]nP \subseteq [0,1]^nP⊆[0,1]n is upper monotone (with respect to [0,1]n[0,1]^n[0,1]n) if P=P+∩[0,1]nP = P^+ \cap [0,1]^nP=P+∩[0,1]n — the natural "closure" condition under which the theory of this chapter applies cleanly.

For S⊆N:={1,…,n}S \subseteq N := \{1,\dots,n\}S⊆N:={1,…,n}, write a(S):=∑j∈Saja(S) := \sum_{j\in S} a_ja(S):=∑j∈S​aj​. Given P⊆RnP \subseteq \mathbb{R}^nP⊆Rn and a coordinate subset SSS, the projection PSP^SPS keeps only the SSS-coordinates, letting the rest range freely. ISI^SIS is the set of valid inequalities πx≥1\pi x \ge 1πx≥1 of PSP^SPS with πj>0\pi_j > 0πj​>0 exactly on SSS, tight at ∣S∣|S|∣S∣ linearly independent points of PSP^SPS.

Formalization targets

Proposition 13.1. For an upper monotone P=⋂iPiP = \bigcap_i P_iP=⋂i​Pi​ (each PiP_iPi​ a single inequality in [0,1]n[0,1]^n[0,1]n), P+=⋂iPi+P^+ = \bigcap_i P_i^+P+=⋂i​Pi+​.

Theorem 13.3. For P={x∈[0,1]n:ax≥1}P = \{x \in [0,1]^n : ax \ge 1\}P={x∈[0,1]n:ax≥1} (a≥0a \ge 0a≥0) upper monotone,

P+={x≥0:∑j∈Sajxj1−a(N∖S)≥1 for every S⊆N with 1−a(N∖S)>0}.P^+ = \Big\{x \ge 0 : \sum_{j\in S} \frac{a_j x_j}{1-a(N\setminus S)} \ge 1 \text{ for every } S\subseteq N \text{ with } 1-a(N\setminus S)>0\Big\}.P+={x≥0:j∈S∑​1−a(N∖S)aj​xj​​≥1 for every S⊆N with 1−a(N∖S)>0}.

Theorem 13.5. For the same PPP and any x∗≥0x^* \ge 0x∗≥0, with xq∗x^*_qxq∗​ the greatest coordinate value xj∗x^*_jxj∗​ satisfying a(N∖S(xj∗))<1a(N\setminus S(x^*_j))<1a(N∖S(xj∗​))<1 and xj∗≤g(xj∗)x^*_j \le g(x^*_j)xj∗​≤g(xj∗​): S(αP)=S(xq∗)S(\alpha_P) = S(x^*_q)S(αP​)=S(xq∗​) and αP=g(xq∗)\alpha_P = g(x^*_q)αP​=g(xq∗​), an explicit, computable value.

Theorem 13.7 (goal). For an arbitrary polytope P⊆[0,1]nP \subseteq [0,1]^nP⊆[0,1]n (not necessarily upper monotone):

P+={x≥0:πx≥1 for every S⊆N and π∈IS},P^+ = \{x \ge 0 : \pi x \ge 1 \text{ for every } S \subseteq N \text{ and } \pi \in I^S\},P+={x≥0:πx≥1 for every S⊆N and π∈IS},

and every one of these inequalities is facet-defining for P+P^+P+.

Corollary 13.8. Every facet-defining inequality of P+P^+P+ has at most dim⁡(P)+1\dim(P)+1dim(P)+1 nonzero coefficients.

The targets move from the intersection-distributivity fact (13.1) through an explicit, exponentially-large but fully closed-form facet system for the single-inequality case (13.3) and its constructive, polynomial evaluation recipe (13.5) to the fully general facet characterization (13.7, requiring no monotonicity assumption at all) and its immediate corollary on facet sparsity (13.8).

Significance

Theorem 13.7 is a rare case in polyhedral combinatorics of a complete and exact facet description obtained for the dominant of an arbitrary polytope, not merely a valid relaxation or an algorithmic separation oracle — every facet is accounted for, and every listed inequality is genuinely a facet, not merely valid. Corollary 13.8's support bound is the mechanism that makes Theorem 13.10 (not part of this mission) tractable: it lets the facets of a dominant built from a disjunction of polytopes in different spaces be characterized purely in terms of each factor's own low-dimensional facets, avoiding an exponential blowup in the combined space.

Both directions are proved in the source (Balas's own treatment, following the joint framework of [17]) but have no counterpart on this platform: nothing existing treats dominants, blockers, or upper monotonicity. This mission produces the first Lean statements of all five targets.

Difficulty

The obvious shortcut for Theorem 13.7 is to state only the validity half of the claim (every inequality from ISI^SIS is valid for P+P^+P+) and treat "facet-defining" as a decoration — after all, Proposition 13.1's polar-style validity argument generalizes easily. But the theorem's actual force is the converse: not merely that these inequalities suffice to describe P+P^+P+, but that none of them is redundant, and no other facet exists. The book's own converse proof needs a genuine perturbation argument (splitting a facet candidate with fewer than ∣S∣|S|∣S∣ independent tight points into two distinct valid inequalities averaging back to it, contradicting facetness) — this is where the real content lives, and a formalization that only captures the forward direction would understate the theorem substantially.

For Theorem 13.5, the difficulty is that S(α)S(\alpha)S(α) and g(α)g(\alpha)g(α) are themselves defined in terms of α\alphaα, so "the largest xj∗x^*_jxj∗​ satisfying [a condition stated in terms of S(xj∗)S(x^*_j)S(xj∗​) and g(xj∗)g(x^*_j)g(xj∗​)]" is a genuinely self-referential extremal characterization, not a closed-form formula one could simply plug into — hence its faithful statement (via IsGreatest over an explicit, self-referential candidate set) rather than an unwound algebraic expression.

Formalization scope

The ambient space is Fin n → ℝ throughout, matching the series default. Dominant/Blocker are given their own names (not reusing, even informally, 02b-polarity's polar/reverse-polar vocabulary), per BRIEF.md's explicit warning that the nonnegativity restriction makes these different objects. PolyDim/IsFacet are restated from 02b-polarity/11a-intersection-cuts (affine dimension via Module.finrank of vectorSpan, faces via IsExtreme), since Chapter 2 already pins these down precisely for this series and Chapter 13's own facet claims use the same notion. IsUpperMonotone is stated exactly as Definition 4 (P = P⁺ ∩ [0,1]ⁿ), not paraphrased as coordinatewise monotonicity, per BRIEF.md's explicit warning that these are different conditions.

IsInIS (membership in ISI^SIS) uses LinearIndependent ℝ directly for the "|S| linearly independent points" hypothesis, matching the book's own wording; since every such point satisfies πx=1\pi x=1πx=1, a linear dependence among them is automatically an affine dependence (the coefficients of any nontrivial linear relation among them must sum to zero), so this is not a weakening of the more familiar "affinely independent" reading a reader might otherwise expect. A trivializing formalization to rule out explicitly: describing Theorem 13.7's P+P^+P+ using only the validity half of the claim (dropping "each of these inequalities is facet-defining for P+P^+P+") — this mission states both conjuncts, since the facet-exactness is the theorem's genuine content beyond a Farkas-style validity certificate.

This mission depends on no other chunk's Lean definitions; it restates the affine-dimension/facet vocabulary of 02b-polarity/11a-intersection-cuts only informally, per the series convention. Corollary 13.6 (an O(n)O(n)O(n)-time algorithmic claim for computing αP\alpha_PαP​) is out-of-cone per BRIEF.md: it is fully quantified, not a veto-V3 case, but is a computational-complexity statement outside this mission's polyhedral-characterization scope.

Selected references

  • D. R. Fulkerson, Blocking and anti-blocking pairs of polyhedra, Mathematical Programming 1 (1971), 168–194. https://doi.org/10.1007/BF01584085
  • E. Balas and R. G. Jeroslow, Strengthening cuts for mixed integer programs (for the broader monotonization-of-polyhedra context cited by this chapter's introduction), European Journal of Operational Research 4 (1980), 224–234. https://doi.org/10.1016/0377-2217(80)90106-X
  • E. Balas, Disjunctive Programming, Springer, 2018, Chapter 13, §13.1–13.2. https://doi.org/10.1007/978-3-030-00148-3
8 thms4 active users
🏆Completed
CombinatoricsGraph TheoryOperations Research+1·Captain: mikedeng1

A Linear-Time Algorithm for Finding a Sparse k-Connected Spanning Subgraph of a k-Connected Graph 2: FOREST's Forests E_i Preserve Local Node-Connectivity up to i in a Simple GraphResearch Paper

Motivation

Given a kkk-connected graph, many connectivity algorithms run in time that grows with the number of edges ∣E∣|E|∣E∣. A sparse certificate is a spanning subgraph with only O(k∣V∣)O(k|V|)O(k∣V∣) edges that is still kkk-connected; computing one first and running the expensive algorithm on it replaces ∣E∣|E|∣E∣ by k∣V∣k|V|k∣V∣ in the bound. Finding a kkk-connected spanning subgraph with the minimum number of edges is NP-complete for every fixed k≥2k \ge 2k≥2 (Garey and Johnson, problem GT31), so the question is how cheaply a sparse, not necessarily minimum, certificate can be found.

Nagamochi and Ibaraki (Algorithmica 7 (1992) 583–596) answered this with a single linear-time scanning procedure, FOREST, which partitions the edges into classes E1,E2,…,E∣E∣E_1, E_2, \dots, E_{|E|}E1​,E2​,…,E∣E∣​. They showed that the prefix unions E1∪⋯∪EkE_1 \cup \dots \cup E_kE1​∪⋯∪Ek​ are certificates for edge-connectivity and, for simple graphs, for node-connectivity. The node-connectivity result is the subject of this mission; the edge-connectivity result is the preceding mission of this series.

Timeline:

  • 1980: Galil gives an algorithm testing κ(G)≥k\kappa(G) \ge kκ(G)≥k whose running time depends on ∣E∣|E|∣E∣ (SIAM J. Comput. 9).
  • Before 1992 (as cited on p. 583): Suzuki et al. give O(∣E∣)O(|E|)O(∣E∣)-time algorithms for sparse 2- and 3-node-connected spanning subgraphs; Nishizeki and Poljak find, for general kkk, a kkk-node-connected spanning subgraph with at most k(∣V∣−1)k(|V|-1)k(∣V∣−1) edges in O(∣V∣1/2∣E∣2)O(|V|^{1/2}|E|^2)O(∣V∣1/2∣E∣2) time.
  • 1992: Nagamochi and Ibaraki prove that FOREST, which runs in O(∣V∣+∣E∣)O(|V| + |E|)O(∣V∣+∣E∣) time, yields a kkk-node-connected spanning subgraph GkG_kGk​ of every simple kkk-node-connected graph, with ∣E(Gk)∣≤k∣V∣−k(k+1)/2|E(G_k)| \le k|V| - k(k+1)/2∣E(Gk​)∣≤k∣V∣−k(k+1)/2. Their Theorem 3.1 states a stronger, local form.
  • 1993: Cheriyan, Kao and Thurimella isolate "scan-first search" as the general principle behind such certificates (SIAM J. Comput. 22 (1993)).

Setting

A graph G=(V,E)G = (V, E)G=(V,E) has a finite node set VVV with ∣V∣≥2|V| \ge 2∣V∣≥2 and a finite edge set EEE; each edge has an unordered pair of two distinct end nodes. In this mission the graph is simple: no two edges have the same end nodes. For F⊆EF \subseteq EF⊆E, (V,F)(V, F)(V,F) is the spanning subgraph with edge set FFF.

The local node-connectivity κ(x,y;H)\kappa(x, y; H)κ(x,y;H) of nodes x,yx, yx,y in a graph HHH on VVV is ∣V∣−1|V| - 1∣V∣−1 if xxx and yyy are adjacent in HHH, and otherwise the minimum size of a node set W⊆V−{x,y}W \subseteq V - \{x, y\}W⊆V−{x,y} whose deletion leaves no xxx–yyy path. The node connectivity is κ(G)=min⁡x,yκ(x,y;G)\kappa(G) = \min_{x, y} \kappa(x, y; G)κ(G)=minx,y​κ(x,y;G).

Procedure FOREST keeps a label r(v)≥0r(v) \ge 0r(v)≥0 on each node, initially 000. While some node is unscanned, it chooses an unscanned node xxx of largest label; for each unscanned edge e=(x,y)e = (x, y)e=(x,y) it puts eee into the class Er(y)+1E_{r(y)+1}Er(y)+1​, increases r(x)r(x)r(x) by one if r(x)=r(y)r(x) = r(y)r(x)=r(y), and increases r(y)r(y)r(y) by one; then it marks xxx scanned. Ties are broken arbitrarily. The time instants are the states between these elementary operations; Ei∗E^*_iEi∗​ denotes the class iii at an instant, and EiE_iEi​ its final value. Put

Gi=(V, E1∪E2∪⋯∪Ei).G_i = (V,\ E_1 \cup E_2 \cup \dots \cup E_i).Gi​=(V, E1​∪E2​∪⋯∪Ei​).

Formalization targets

Goal: Theorem 3.1

For a simple graph GGG and the classes of any completed run of FOREST, for 1≤i≤∣E∣1 \le i \le |E|1≤i≤∣E∣,

κ(x,y;Gi) ≥ min⁡{κ(x,y;G), i}for any x,y∈V.(3.1)\kappa(x, y; G_i) \ \ge\ \min\{\kappa(x, y; G),\ i\} \qquad \text{for any } x, y \in V. \tag{3.1}κ(x,y;Gi​) ≥ min{κ(x,y;G), i}for any x,y∈V.(3.1)

The statement is local: it holds pair by pair, not only for the global minimum, and for every tie-breaking of the procedure.

Milestones, in the order the proof uses them

  1. Lemma 2.2: at every instant, a node vvv meets EiE_iEi​ exactly for i=1,…,r(v)i = 1, \dots, r(v)i=1,…,r(v).
  2. Lemma 2.4(b): at every instant, a uuu–vvv path in Ej∗E^*_jEj∗​ yields uuu–vvv paths in every Ei∗E^*_iEi∗​, i<ji < ji<j.
  3. In-degree at most one (§2, p. 588): orienting each edge from the earlier-scanned to the later-scanned end, every node has at most one entering arc in each class.
  4. Lemma 3.1: if an xxx–yyy path of Ej∗E^*_jEj∗​ has the form x,u1,…,uk=w,yx, u_1, \dots, u_k = w, yx,u1​,…,uk​=w,y with k=1k = 1k=1 or u1u_1u1​ scanned before www, then any www–xxx and www–yyy paths in Ei∗E^*_iEi∗​ (i<ji < ji<j) share a node other than www.
  5. Lemma 3.2: for a node cut set W={w1,…,wi}W = \{w_1, \dots, w_i\}W={w1​,…,wi​} of Gi+1G_{i+1}Gi+1​ (in scan order) separating a component XXX from the rest YYY, immediately after wtw_twt​ is scanned every XXX–YYY path of Et∗E^*_tEt∗​ passes through wtw_twt​, and Ej∗E^*_jEj∗​ has no XXX–YYY path for t+1≤j≤i+1t + 1 \le j \le i + 1t+1≤j≤i+1.

A companion item states the paper's announcement in §3: GkG_kGk​ is kkk-node-connected for every 1≤k≤κ(G)1 \le k \le \kappa(G)1≤k≤κ(G).

Significance

Theorem 3.1 at i=ki = ki=k shows that the first kkk classes of FOREST form a kkk-node-connected spanning subgraph whenever GGG is, and the edge-count analysis of the companion mission bounds its size by k∣V∣−k(k+1)/2k|V| - k(k+1)/2k∣V∣−k(k+1)/2. Since FOREST runs in linear time, any algorithm testing κ(G)≥k\kappa(G) \ge kκ(G)≥k can be run on GkG_kGk​ instead of GGG; the paper uses this to improve the bound for testing κ(G)≥k\kappa(G) \ge kκ(G)≥k from O(max⁡{k2∣V∣1/2,k∣V∣}∣E∣)O(\max\{k^2|V|^{1/2}, k|V|\}|E|)O(max{k2∣V∣1/2,k∣V∣}∣E∣) to O(max⁡{k3∣V∣3/2,k2∣V∣2})O(\max\{k^3|V|^{3/2}, k^2|V|^2\})O(max{k3∣V∣3/2,k2∣V∣2}), and similar gains for computing the number of node-disjoint paths between two nodes. The local form (3.1) is what makes the sss–ttt applications possible.

The result is proved on paper. As far as a search of the platform shows, neither FOREST nor local node-connectivity has a machine-checked treatment there; Mathlib has no notion of vertex connectivity of a pair of nodes. This mission produces a formal model of FOREST as a nondeterministic transition system and the statements needed to verify the paper's proof step by step.

Difficulty

For edge-connectivity the analogous statement follows from a general principle: any sequence of maximal spanning forests, each taken in what remains of the graph, preserves local edge-connectivity up to its length. The obvious attempt is to prove (3.1) the same way, from the fact that each EiE_iEi​ is a maximal spanning forest of what the earlier classes leave. The paper gives no such argument for node-connectivity: its proof uses the specific scan order of FOREST in an essential way, through the orientation of edges from earlier- to later-scanned nodes and the in-degree bound of that orientation (Lemmas 3.1 and 3.2). The argument tracks, for a hypothetical node cut WWW of size iii in Gi+1G_{i+1}Gi+1​, the classes at the moments the nodes of WWW are scanned, which requires reasoning about intermediate states of the algorithm and about paths in several classes at once. None of this reduces to a static property of the output partition.

Formalization scope

  • Graphs. A node type V and an edge type E, both finite, with ends : E → Sym2 V; loop-freeness is ∀ e, ¬ (ends e).IsDiag and simplicity is Function.Injective ends. The standing assumptions of p. 583 and p. 589 (∣V∣≥2|V| \ge 2∣V∣≥2, no self-loop, a simple graph when node-connectivity is discussed) appear as hypotheses; §2 items are stated for loopless graphs, as on the page.
  • Connectivity. κ(x,y;(V,F))\kappa(x, y; (V, F))κ(x,y;(V,F)) is valued in N∞\mathbb N_\inftyN∞​: ∣V∣−1|V| - 1∣V∣−1 on adjacent pairs, the minimum node cut otherwise, and ⊤\top⊤ when x=yx = yx=y, where (3.1) holds trivially.
  • FOREST. A nondeterministic step relation with three steps (select, scan, finish), a run of length KKK from the initial state, and completion when every node is scanned. Every tie-breaking is allowed, so the theorems quantify over all completed runs. A time instant is a state of a run; "scanned before" compares positions in the run's selection order; "immediately after wtw_twt​ has been scanned" is the state right after the finish step of wtw_twt​.
  • Excluded. The running time "O(∣V∣+∣E∣)O(|V| + |E|)O(∣V∣+∣E∣)" and everything in §4 (the connectivity-testing algorithms and their bounds) are not stated: the paper fixes no machine model. The edge bounds on ∣Ei∣|E_i|∣Ei​∣ belong to the edge-connectivity mission.
  • Ruled out. Stating (3.1) for an arbitrary partition into maximal spanning forests, or reading the classes Ej∗E^*_jEj∗​ of Lemmas 3.1–3.2 off the final state, would state a different theorem from the one the paper proves; the classes are those of a run of FOREST at the instant the page specifies.
  • Infrastructure. Reachability avoiding a node set, walks and paths in SimpleGraph, and invariants of the FOREST transition system. The definitions duplicate those of the edge-connectivity mission by design and are candidates for a shared layer. Contributions of general lemmas about the run (label invariants, monotonicity of classes along a run) are welcome.

Selected references

  • H. Nagamochi, T. Ibaraki, A linear-time algorithm for finding a sparse kkk-connected spanning subgraph of a kkk-connected graph, Algorithmica 7 (1992), 583–596. https://doi.org/10.1007/BF01758778
  • Z. Galil, Finding the vertex connectivity of graphs, SIAM J. Comput. 9 (1980), 197–199. https://doi.org/10.1137/0209016
  • J. Cheriyan, M.-Y. Kao, R. Thurimella, Scan-first search and sparse certificates: an improved parallel algorithm for kkk-vertex connectivity, SIAM J. Comput. 22 (1993), 157–174. https://doi.org/10.1137/0222013
  • M. R. Garey, D. S. Johnson, Computers and Intractability: A Guide to the Theory of NP-Completeness, Freeman, 1979.
9 thms3 active usersReviewed
🏆Completed
CombinatoricsLinear OptimizationOperations Research+1·Captain: Shuze Chen

Disjunctive Programming XVI: Unions of Upper Monotone Polytopes and PolymatroidsTextbook

Motivation

This mission is the sixteenth and last of the Disjunctive Programming series, and its goal theorem is the book's own closing result. The chapter's arc closes a loop opened at the very start of the book: Theorem 2.1 (02a-convex-hull) gave the convex hull of a union of polyhedra in the same space via lifting; this chapter's Theorem 13.13 (not drafted in this mission — see below) gives the dominant of a union of polytopes in different spaces, and the chapter's final result specializes that machinery to the case where the two polytopes are polymatroids — obtaining a fully explicit, closed-form convex hull in the original variable space, with no lifting at all. Polymatroids are among the most heavily studied objects in combinatorial optimization, from Edmonds's foundational greedy-algorithm characterization onward (J. Edmonds, Submodular functions, matroids, and certain polyhedra, in Combinatorial Structures and Their Applications, Gordon and Breach, 1970, 69–87), and a disjunction of two polymatroids — "satisfy one covering system or the other" — arises naturally whenever two competing combinatorial resource constraints interact.

Setting

Fix a ground set N={1,…,n}N = \{1,\dots,n\}N={1,…,n}. A set function r:2N→Rr : 2^N \to \mathbb{R}r:2N→R is a polymatroid rank function if r(∅)=0r(\emptyset)=0r(∅)=0, rrr is nondecreasing, and rrr is submodular: r(A)+r(B)≥r(A∪B)+r(A∩B)r(A)+r(B) \ge r(A\cup B)+r(A\cap B)r(A)+r(B)≥r(A∪B)+r(A∩B) for all A,B⊆NA,B\subseteq NA,B⊆N. (A related but distinct condition, used earlier in the chapter for "Application 1," additionally requires r(A)≤∣A∣r(A)\le|A|r(A)≤∣A∣ on every proper subset — matroid rank functions satisfy both.) The associated polymatroid is

P(r):={x∈R+n:∑j∈Axj≤r(A) for all A⊆N}.P(r) := \Big\{x \in \mathbb{R}^n_+ : \textstyle\sum_{j\in A} x_j \le r(A) \text{ for all } A \subseteq N\Big\}.P(r):={x∈R+n​:∑j∈A​xj​≤r(A) for all A⊆N}.

For two ground sets M,NM,NM,N and set functions r1,r2r_1,r_2r1​,r2​, the disjoint-space union is Z(r1,r2):={(x,y)∈[0,1]m×[0,1]n:x∈P(r1) or y∈P(r2)}Z(r_1,r_2) := \{(x,y)\in[0,1]^m\times[0,1]^n : x\in P(r_1) \text{ or } y\in P(r_2)\}Z(r1​,r2​):={(x,y)∈[0,1]m×[0,1]n:x∈P(r1​) or y∈P(r2​)}. For polymatroid rank functions r1,r2r_1,r_2r1​,r2​ on the same ground set NNN, Π:={π≥0:πx≤1 for x∈P(r1)∪P(r2)}\Pi := \{\pi \ge 0 : \pi x \le 1 \text{ for } x \in P(r_1)\cup P(r_2)\}Π:={π≥0:πx≤1 for x∈P(r1​)∪P(r2​)} and U:={u≥0:∑AuAri(A)≤1, i=1,2}U := \{u \ge 0 : \sum_A u_A r_i(A) \le 1,\ i=1,2\}U:={u≥0:∑A​uA​ri​(A)≤1, i=1,2} (indexed by all subsets A⊆NA \subseteq NA⊆N) are the auxiliary polytopes the final proof reduces to.

Formalization targets

Proposition 13.16. For set functions r1,r2r_1,r_2r1​,r2​ satisfying the Application-1 conditions,

conv(Z(r1,r2))={(x,y):∣A∣−x(A)∣A∣−r1(A)+∣B∣−y(B)∣B∣−r2(B)≥1 ∀A⊆M,B⊆N with r1(A)<∣A∣, r2(B)<∣B∣}.\mathrm{conv}(Z(r_1,r_2)) = \Big\{(x,y) : \frac{|A|-x(A)}{|A|-r_1(A)} + \frac{|B|-y(B)}{|B|-r_2(B)} \ge 1 \ \forall A\subseteq M, B\subseteq N \text{ with } r_1(A)<|A|,\ r_2(B)<|B|\Big\}.conv(Z(r1​,r2​))={(x,y):∣A∣−r1​(A)∣A∣−x(A)​+∣B∣−r2​(B)∣B∣−y(B)​≥1 ∀A⊆M,B⊆N with r1​(A)<∣A∣, r2​(B)<∣B∣}.

Corollary 13.21. The same-space specialization: conv(P(r1)∪P(r2))={w∈[0,1]n:w=x+y,[the same displayed inequality, A,B⊆N]}\mathrm{conv}(P(r_1)\cup P(r_2)) = \{w\in[0,1]^n : w=x+y, \text{[the same displayed inequality, } A,B\subseteq N\text{]}\}conv(P(r1​)∪P(r2​))={w∈[0,1]n:w=x+y,[the same displayed inequality, A,B⊆N]}.

Proposition 13.22. Π\PiΠ is exactly the projection, onto π\piπ, of {πj≤∑A∋juA (j∈N), ∑AuAri(A)≤1 (i=1,2), π,u≥0}\{\pi_j \le \sum_{A\ni j} u_A\ (j\in N),\ \sum_A u_A r_i(A)\le1\ (i=1,2),\ \pi,u\ge0\}{πj​≤∑A∋j​uA​ (j∈N), ∑A​uA​ri​(A)≤1 (i=1,2), π,u≥0}.

Proposition 13.23. Every extreme point of Π\PiΠ arises from an extreme point of UUU via πj=∑A∋juA\pi_j = \sum_{A\ni j} u_Aπj​=∑A∋j​uA​.

Theorem 13.24 (goal, the book's closing theorem). For polymatroid rank functions r1,r2r_1,r_2r1​,r2​,

conv(P(r1)∪P(r2))={x≥0:x(A)≤max⁡{r1(A),r2(A)} ∀A⊆N;  r2(B)−r1(B)r1(A)r2(B)−r1(B)r2(A)x(A)+r1(A)−r2(A)r1(A)r2(B)−r1(B)r2(A)x(B)≤1\mathrm{conv}(P(r_1)\cup P(r_2)) = \Big\{x\ge0 : x(A)\le\max\{r_1(A),r_2(A)\}\ \forall A\subseteq N;\ \ \frac{r_2(B)-r_1(B)}{r_1(A)r_2(B)-r_1(B)r_2(A)}x(A) + \frac{r_1(A)-r_2(A)}{r_1(A)r_2(B)-r_1(B)r_2(A)}x(B) \le 1conv(P(r1​)∪P(r2​))={x≥0:x(A)≤max{r1​(A),r2​(A)} ∀A⊆N;  r1​(A)r2​(B)−r1​(B)r2​(A)r2​(B)−r1​(B)​x(A)+r1​(A)r2​(B)−r1​(B)r2​(A)r1​(A)−r2​(A)​x(B)≤1  ∀A,B⊆N with (r1(A)−r2(A))(r1(B)−r2(B))<0}.\ \forall A,B\subseteq N \text{ with } (r_1(A)-r_2(A))(r_1(B)-r_2(B))<0\Big\}. ∀A,B⊆N with (r1​(A)−r2​(A))(r1​(B)−r2​(B))<0}.

The targets trace the book's own tower: the disjoint-space specialization (13.16) and its same-space corollary (13.21) establish the lifted description; Propositions 13.22-13.23 build the blocker/projection machinery; Theorem 13.24 collapses everything into the unlifted, original-variable-space closed form that is the book's final word.

Significance

Theorem 13.24 is a genuinely rare achievement in polyhedral combinatorics: a complete, explicit, non-lifted facet description for the union of two polymatroids — objects whose individual facet structure is already exponential and only tractable via the greedy algorithm and submodular minimization. That the union of two such objects still admits a closed form, stated purely in terms of the two rank functions evaluated at pairs of subsets, is the payoff the entire chapter's machinery (dominants, blockers, upper monotonicity, disjoint-space unions) was built toward. The result strictly generalizes an earlier theorem restricted to matroid polyhedra, obtained there by different techniques specific to matroids; this proof works because polymatroid optimization (Edmonds's greedy algorithm) survives in the more general submodular, non-0/1-truncated setting.

Both directions are proved in the source (Balas's own chapter, building on Edmonds's polymatroid theory and the disjoint-union machinery developed earlier in the same chapter) but have no counterpart on this platform: nothing existing treats polymatroids, polymatroid rank functions, or a closed-form union of two polymatroids. Mathlib's Combinatorics/Matroid/* covers matroids and their rank functions but not this strictly more general polymatroid object (an integer- or real-valued submodular monotone set function, not a matroid's 0/1-truncated rank). This mission produces the first Lean statements of all five targets.

Difficulty

The obvious shortcut for Theorem 13.24 is to state only the "single active subset" family of inequalities (x(A)≤max⁡{r1(A),r2(A)}x(A)\le\max\{r_1(A),r_2(A)\}x(A)≤max{r1​(A),r2​(A)}) and treat the two-subset family as a minor addendum — but the two-subset inequalities are not optional refinements, they are half of the facet system, arising from the genuinely two-dimensional case of the underlying linear program (a basic feasible solution of UUU with two nonzero components). Dropping them, or stating them only for a special case of A,BA,BA,B, would produce a strictly weaker (and generally invalid, since it would omit real facets) description.

The condition (r1(A)−r2(A))(r1(B)−r2(B))<0(r_1(A)-r_2(A))(r_1(B)-r_2(B))<0(r1​(A)−r2​(A))(r1​(B)−r2​(B))<0 is easy to state but not to motivate without the underlying linear algebra: it is exactly the condition under which the 2×22\times22×2 system uAr1(A)+uBr1(B)=1u_Ar_1(A)+u_Br_1(B)=1uA​r1​(A)+uB​r1​(B)=1, uAr2(A)+uBr2(B)=1u_Ar_2(A)+u_Br_2(B)=1uA​r2​(A)+uB​r2​(B)=1 has a solution with both uA,uB>0u_A,u_B>0uA​,uB​>0 — a fact the book verifies by direct computation (Cramer's rule) rather than a structural argument, which is why this mission states the condition exactly as derived rather than paraphrasing it into a more "intuitive" but unfaithful form.

Formalization scope

The ambient space is Fin n → ℝ throughout (or Fin m → ℝ / Fin n → ℝ separately for Proposition 13.16's disjoint spaces), matching the series default; subsets A,B⊆NA,B\subseteq NA,B⊆N are Finset (Fin n), and the auxiliary variable uuu of Propositions 13.22-13.23 is indexed by Finset (Fin n) itself (a genuine Fintype for fixed n), matching "uAu_AuA​ for all A⊆NA\subseteq NA⊆N" directly. IsApp1SetFunction and IsPolymatroidRankFunction are kept as two distinct predicates — the goal theorem uses the latter, Proposition 13.16/Corollary 13.21 the former — matching BRIEF.md's explicit warning to locate and preserve the book's own exact numbered conditions rather than infer a single merged notion. A trivializing formalization to rule out explicitly: stating Theorem 13.24 with only the single-subset inequality family, which would omit the two-subset facets that are half of the theorem's actual content.

This mission depends on no other chunk's Lean definitions; it restates 13a-dominants's dominant/blocker/upper-monotone vocabulary only informally (the underlying object, not any specific Lean declaration), per the series convention, since no chunk in this series can import another's draft module. Theorem 13.13 (the general dominant of a disjoint-space union) and Theorem 13.18 (the general same-space reduction) — the two results whose specializations Proposition 13.16 and Corollary 13.21 respectively are — were not drafted this pass; see HARD.md. As the last mission of the whole book, this chunk's items.yaml closes the series begun in 01-intro-duality: sixteen missions, one book, spanning from the founding disjunctive Farkas lemma to this closed-form union of two polymatroids.

Selected references

  • J. Edmonds, Submodular functions, matroids, and certain polyhedra, in Combinatorial Structures and Their Applications, Gordon and Breach, 1970, 69–87 (reprinted in Combinatorial Optimization — Eureka, You Shrink!, LNCS 2570, Springer, 2003, 11–26, https://doi.org/10.1007/3-540-36478-1_2).
  • E. Balas, A. Bockmayr, N. Pisaruk, and L. Wolsey, On unions and dominants of polytopes, Mathematical Programming A 99 (2004), 223–239. https://doi.org/10.1007/s10107-003-0432-4
  • E. Balas, Disjunctive Programming, Springer, 2018, Chapter 13, §13.2.1–13.8 (the book's final chapter). https://doi.org/10.1007/978-3-030-00148-3
9 thms3 active usersReviewed
Operations ResearchProbabilityStochastic Systems·Captain: Shuze Chen

Processing Networks I: The Equivalence of SPN StabilityTextbook

Motivation

A stochastic processing network (SPN) is the general model behind manufacturing lines, call centers, computer systems, communication networks and hospital wards: a collection of buffers holding waiting work, a collection of activities (servers) that consume items from buffers and produce items into others, and stochastic primitives — arrival processes and service requirements — that drive the whole system forward in continuous time. Before any control policy can be designed, evaluated, or proved to work, the modeler needs a single, unambiguous, checkable notion of what it means for such a system to be stable: to settle into statistical equilibrium rather than pile up work without bound.

The difficulty is that "stability" has several natural, superficially different candidate definitions — positive recurrence of the underlying Markov chain, existence of a unique stationary distribution, convergence in distribution of queue lengths — each convenient for a different purpose (positive recurrence for verifying via drift criteria, a stationary distribution for computing long-run averages, distributional convergence for interpreting simulation output). J. G. Dai and J. Michael Harrison's Processing Networks: Fluid Models and Stability (Cambridge University Press, forthcoming; cited here from the authors' own pre-publication draft, 2020-4-2, http://spnbook.org) opens its technical development by proving these candidates coincide, so that the rest of the book — and, in practice, most stability results for queueing networks published since Rybko and Stolyar's and Dai's foundational work in the 1990s — can speak of "SPN stability" as one well-posed property.

Setting

An SPN has III buffers, indexed 1,…,I1, \dots, I1,…,I, and JJJ activities (service types), indexed 1,…,J1, \dots, J1,…,J. External work arrives into buffer iii according to a counting process Ei(t)E_i(t)Ei​(t); activity jjj, whenever engaged, requires a service time and produces an output vector into the buffers on completion. The baseline stochastic assumptions (Assumption 2.1) specify these primitives precisely: the III external arrival processes are independent Poisson processes with rates λ1,…,λI≥0\lambda_1, \dots, \lambda_I \ge 0λ1​,…,λI​≥0 (no arrivals into a buffer with rate 000); for each activity jjj, the matched pairs of processing variables — service time and output vector, (vj(ℓ),φj(ℓ))ℓ≥1(v_j(\ell), \varphi_j(\ell))_{\ell \ge 1}(vj​(ℓ),φj​(ℓ))ℓ≥1​ — form an i.i.d. sequence with finite means mj=E[vj(1)]>0m_j = \mathbb{E}[v_j(1)] > 0mj​=E[vj​(1)]>0 and Γj=E[φj(1)]≥0\Gamma_j = \mathbb{E}[\varphi_j(1)] \ge 0Γj​=E[φj​(1)]≥0; each such pair has a joint phase-type distribution (realized as the absorption time and terminal mark of a finite-state continuous-time Markov chain, per Appendix D.9); and the initial processing variables, the arrival process, and the JJJ processing-variable sequences are, collectively, mutually independent.

Under a fixed control policy, the SPN generates two continuous-time processes: the service-count process N(t)∈Z+JN(t) \in \mathbb{Z}_+^JN(t)∈Z+J​ and the buffer-contents process Z(t)∈Z+IZ(t) \in \mathbb{Z}_+^IZ(t)∈Z+I​. Assumption 3.1 (Markov representation) requires these to be embeddable in a richer, irreducible Markov chain X={X(t),t≥0}X = \{X(t), t \ge 0\}X={X(t),t≥0} on a countable state space X\mathcal{X}X: a function f:X→Z+J×Z+If : \mathcal{X} \to \mathbb{Z}_+^J \times \mathbb{Z}_+^If:X→Z+J​×Z+I​ with (N(t),Z(t))=f(X(t))(N(t), Z(t)) = f(X(t))(N(t),Z(t))=f(X(t)) on every sample path, whose level sets B(z)={x:f(x)=(n,z) for some n}B(z) = \{x : f(x) = (n,z)\ \text{for some } n\}B(z)={x:f(x)=(n,z) for some n} are finite for every buffer-content vector zzz, and which has at least one empty state x∗x^\astx∗ with f(x∗)=(0,0)f(x^\ast) = (0,0)f(x∗)=(0,0).

Formalization targets

Goal: Proposition 3.5 — equivalent definitions of stability

X positive recurrent  ⟺  X has a unique stationary distribution π  ⟺  Z(t) converges in distribution to a non-defective limit,X \text{ positive recurrent} \iff X \text{ has a unique stationary distribution } \pi \iff Z(t) \text{ converges in distribution to a non-defective limit},X positive recurrent⟺X has a unique stationary distribution π⟺Z(t) converges in distribution to a non-defective limit,

and, when these hold, for every bounded h:X→Rh : \mathcal{X} \to \mathbb{R}h:X→R and every initial distribution of X(0)X(0)X(0),

Pr⁡{lim⁡t→∞1t∫0th(X(s)) ds=hˉ}=1,hˉ:=∑x∈Xπ(x) h(x).\Pr\left\{ \lim_{t \to \infty} \frac{1}{t} \int_0^t h(X(s))\, ds = \bar h \right\} = 1, \qquad \bar h := \sum_{x \in \mathcal{X}} \pi(x)\, h(x).Pr{t→∞lim​t1​∫0t​h(X(s))ds=hˉ}=1,hˉ:=x∈X∑​π(x)h(x).

Definition 3.6 then names an SPN stable exactly when these equivalent conditions hold — the weakest possible target, since it commits to no particular one of the three characterizations, only to their joint truth or falsity.

Supporting milestones

Two strong laws of large numbers for the primitive stochastic elements (Propositions 2.2 and 2.3) — the arrival counts Ei(t)/t→λiE_i(t)/t \to \lambda_iEi​(t)/t→λi​ and the processing-variable sample means 1n∑ℓ≤nvj(ℓ)→mj\frac{1}{n}\sum_{\ell \le n} v_j(\ell) \to m_jn1​∑ℓ≤n​vj​(ℓ)→mj​, 1n∑ℓ≤nφj(ℓ)→Γj\frac{1}{n}\sum_{\ell \le n} \varphi_j(\ell) \to \Gamma_jn1​∑ℓ≤n​φj​(ℓ)→Γj​ — and two structural results about the ambient chain: Lemma 3.7, a drift-type sufficient condition for positive recurrence that foreshadows the fluid-model methodology of later chapters, and Proposition 3.9, a sufficient condition (reachability of the empty state) for the irreducibility that Assumption 3.1 itself demands.

Significance

The result itself. Proposition 3.5 is what turns "is this queueing network stable?" into a single question rather than three potentially different ones, and it licenses every later chapter of the book (and a large fraction of the queueing-theory literature going back to the 1990s fluid-limit program of Rybko–Stolyar, Dai, and others) to prove stability via whichever characterization is most convenient — typically positive recurrence via a Lyapunov drift argument — while concluding all three, including the practically important long-run-average SLLN. Every one of the thirteen other missions in this series builds directly on Definition 3.6: their goal theorems all conclude "the SPN is stable," meaning exactly the three-way equivalence established here.

Formalizing it. No result in this mission or its milestones has a prior formal counterpart on Prove2Me: a search for "positive recurrent," "stationary distribution Markov chain," and "irreducible Markov chain" surfaced only MarkovMixing's PositiveRecurrent predicate, defined for a countable-state discrete-time chain — a different object from Assumption 3.1's continuous-time ambient chain, reused here only conceptually (as the pattern for a mean-return-time definition), not as a Lean dependency. This mission is a from-scratch formalization of the model (baseline stochastic assumptions, Markov representation) and of positive recurrence, stationary-distribution uniqueness, and distributional convergence for it.

Difficulty

The obvious first attempt — define XXX as an arbitrary countable-state Markov chain and directly import a Mathlib theorem relating its recurrence, its stationary distribution, and long-run convergence — fails because Mathlib currently has no general countable-state continuous-time Markov chain theory of the kind Appendix D of the book develops (its own finite-state CTMC stationary-distribution result is unproven substrate, not applicable to a countably infinite state space). The formalization instead works at the level of the chain's embedded discrete-time jump chain, which is where Lean's PMF-based machinery is available, and states the three equivalent conditions and the SLLN conclusion directly as hypotheses to be discharged, rather than inheriting them from a pre-existing continuous-time framework. A second difficulty is Assumption 2.1(d)'s independence clause, which is a genuine three-way mutual independence of σ\sigmaσ-algebras (initial processing variables, arrival process, and the collection of all JJJ processing-variable sequences), not the pairwise independence a careless reading might substitute — a weaker hypothesis here would silently make later derivations in the series unsound.

Formalization scope

The ambient chain's state space Xstate is an arbitrary countable type ([Countable Xstate], not Fintype) — no result may assume finiteness anywhere. The chain itself is represented by its one-step jump kernel jump : Xstate → PMF Xstate (stepIter gives nnn-step iteration, Irreducible requires every state to reach every other in finitely many jump-chain steps); positive recurrence is mean return time under jump, defined via the standard first-return-time renewal decomposition. IsStable is defined as positive recurrence of the jump chain — one of the three equivalent conditions — with the goal theorem itself certifying the equivalence, so the choice carries no loss of faithfulness. Buffer contents and service counts are Fin I → ℕ and Fin J → ℕ-valued, matching the book's Z+I\mathbb{Z}_+^IZ+I​, Z+J\mathbb{Z}_+^JZ+J​. A formalization that took IsStable to mean, say, only distributional convergence of ZZZ (dropping the chain-level characterizations) would be a strictly weaker, trivializing shortcut — ruled out here by proving all three equivalent and stating the SLLN as part of the same goal theorem. The definitions in this mission (BaselineAssumptions, MarkovRepresentation, IsStable) are the shared substrate every other mission of the series is built on, and are the primary reusable contribution; contributions completing the by sorry proofs, particularly of the goal theorem (which the book proves via appeal to general CTMC theory in its Appendix D, not reproduced here), are welcome.

Selected references

  • J. G. Dai and J. Michael Harrison, Processing Networks: Fluid Models and Stability, Cambridge University Press (forthcoming), pre-publication draft 2020-4-2. http://spnbook.org
  • A. N. Rybko and A. L. Stolyar, "Ergodicity of stochastic processes describing the operation of open queueing networks," Problemy Peredachi Informatsii 28 (1992), 3–26.
  • J. G. Dai, "On positive Harris recurrence of multiclass queueing networks: a unified approach via fluid limit models," Annals of Applied Probability 5 (1995), 49–77.
11 thms2 active usersReviewed
🏆Completed
Bandit AlgorithmsMachine LearningOperations Research+1·Captain: mikedeng1

Improved Algorithms for Linear Stochastic Bandits I: High-Probability Regret Bound for the OFUL AlgorithmResearch Paper

Motivation

In a linear stochastic bandit, a learner repeatedly chooses an action from a set of vectors and receives a noisy reward whose mean is linear in the action. The model underlies contextual recommendation, adaptive routing and dynamic pricing, where each option is described by features and the payoff of a feature vector must be learned while it is exploited. The quality of a strategy is measured by its regret: the reward lost, relative to always playing the best action, over the first nnn rounds.

The optimism-in-the-face-of-uncertainty principle (play as if the most favourable parameter consistent with the data were true) was introduced for linear bandits by Auer (2002), and developed by Dani, Hayes and Kakade (2008) (ConfidenceBall, regret O(dnlog⁡3/2n)O(d\sqrt n\log^{3/2} n)O(dn​log3/2n) with confidence sets from a union bound over time) and Rusmevichientong and Tsitsiklis (2010). Abbasi-Yadkori, Pál and Szepesvári (NIPS 2011) replaced the union bound by a self-normalized martingale inequality that holds uniformly in time. It gives smaller confidence ellipsoids and, through them, a high-probability regret bound for the resulting algorithm, OFUL, that improves the earlier ones by logarithmic factors. The inequality became the standard tool for linear and kernelized bandits and for linear reinforcement learning.

Setting

Fix a dimension d≥1d \ge 1d≥1 and an unknown parameter θ∗∈Rd\theta_* \in \mathbb R^dθ∗​∈Rd. In round t=1,2,…t = 1, 2, \dotst=1,2,… the learner is given a nonempty decision set Dt⊆RdD_t \subseteq \mathbb R^dDt​⊆Rd, chooses Xt∈DtX_t \in D_tXt​∈Dt​, and observes the reward

Yt=⟨Xt,θ∗⟩+ηt.Y_t = \langle X_t, \theta_* \rangle + \eta_t .Yt​=⟨Xt​,θ∗​⟩+ηt​.

There is a filtration {Ft}t≥0\{F_t\}_{t \ge 0}{Ft​}t≥0​ such that XtX_tXt​ is Ft−1F_{t-1}Ft−1​-measurable and ηt\eta_tηt​ is FtF_tFt​-measurable and conditionally RRR-sub-Gaussian: E[eληt∣Ft−1]≤exp⁡(λ2R2/2)\mathbf E[e^{\lambda\eta_t} \mid F_{t-1}] \le \exp(\lambda^2R^2/2)E[eληt​∣Ft−1​]≤exp(λ2R2/2) for all λ∈R\lambda \in \mathbb Rλ∈R, with R≥0R \ge 0R≥0 fixed.

For a regularization parameter λ>0\lambda > 0λ>0 let V‾t=λI+∑s=1tXsXs⊤\overline V_t = \lambda I + \sum_{s=1}^t X_sX_s^\topVt​=λI+∑s=1t​Xs​Xs⊤​ and let θ^t=V‾t−1∑s=1tYsXs\widehat\theta_t = \overline V_t^{-1}\sum_{s=1}^t Y_sX_sθt​=Vt−1​∑s=1t​Ys​Xs​ be the regularized least-squares estimate. With ∥v∥A=v⊤Av\|v\|_A = \sqrt{v^\top A v}∥v∥A​=v⊤Av​ and a known bound ∥θ∗∥2≤S\|\theta_*\|_2 \le S∥θ∗​∥2​≤S, the confidence ellipsoid is

Ct={θ:∥θ^t−θ∥V‾t≤R2log⁡(det⁡(V‾t)1/2det⁡(λI)−1/2/δ)+λ1/2S}.C_t = \Big\{\theta : \|\widehat\theta_t - \theta\|_{\overline V_t} \le R\sqrt{2\log\big(\det(\overline V_t)^{1/2}\det(\lambda I)^{-1/2}/\delta\big)} + \lambda^{1/2}S\Big\}.Ct​={θ:∥θt​−θ∥Vt​​≤R2log(det(Vt​)1/2det(λI)−1/2/δ)​+λ1/2S}.

The OFUL algorithm chooses, in round ttt, a pair (Xt,θ~t)(X_t, \widetilde\theta_t)(Xt​,θt​) maximizing ⟨x,θ⟩\langle x, \theta \rangle⟨x,θ⟩ over Dt×Ct−1D_t \times C_{t-1}Dt​×Ct−1​. The pseudo-regret is Rn=∑t=1n⟨xt∗−Xt,θ∗⟩R_n = \sum_{t=1}^n \langle x^*_t - X_t, \theta_* \rangleRn​=∑t=1n​⟨xt∗​−Xt​,θ∗​⟩, where ⟨xt∗,θ∗⟩=max⁡x∈Dt⟨x,θ∗⟩\langle x^*_t, \theta_*\rangle = \max_{x\in D_t}\langle x,\theta_*\rangle⟨xt∗​,θ∗​⟩=maxx∈Dt​​⟨x,θ∗​⟩.

Formalization targets

Goal: Theorem 3, the regret of OFUL

If ∥Xt∥2≤L\|X_t\|_2 \le L∥Xt​∥2​≤L, ⟨x,θ∗⟩∈[−1,1]\langle x, \theta_*\rangle \in [-1,1]⟨x,θ∗​⟩∈[−1,1] for all x∈Dtx \in D_tx∈Dt​, and λ≥max⁡(1,L2)\lambda \ge \max(1, L^2)λ≥max(1,L2), then for every δ>0\delta > 0δ>0, with probability at least 1−δ1 - \delta1−δ,

∀n≥0,Rn≤4ndlog⁡(λ+nL2/d)(λ1/2S+R2log⁡(1/δ)+dlog⁡(1+nL2/(λd))).\forall n \ge 0, \quad R_n \le 4\sqrt{nd\log(\lambda + nL^2/d)}\Big(\lambda^{1/2}S + R\sqrt{2\log(1/\delta) + d\log(1 + nL^2/(\lambda d))}\Big).∀n≥0,Rn​≤4ndlog(λ+nL2/d)​(λ1/2S+R2log(1/δ)+dlog(1+nL2/(λd))​).

Milestone: Theorem 1, the self-normalized bound

For any positive definite VVV, V‾t=V+∑s≤tXsXs⊤\overline V_t = V + \sum_{s\le t}X_sX_s^\topVt​=V+∑s≤t​Xs​Xs⊤​ and St=∑s≤tηsXsS_t = \sum_{s \le t}\eta_sX_sSt​=∑s≤t​ηs​Xs​: with probability at least 1−δ1-\delta1−δ, for all t≥0t \ge 0t≥0,

∥St∥V‾t−12≤2R2log⁡(det⁡(V‾t)1/2det⁡(V)−1/2/δ).\|S_t\|^2_{\overline V_t^{-1}} \le 2R^2\log\big(\det(\overline V_t)^{1/2}\det(V)^{-1/2}/\delta\big).∥St​∥Vt−1​2​≤2R2log(det(Vt​)1/2det(V)−1/2/δ).

Milestones: Theorem 2, the confidence ellipsoids

With probability at least 1−δ1 - \delta1−δ, θ∗∈Ct\theta_* \in C_tθ∗​∈Ct​ for all t≥0t \ge 0t≥0 (first claim). If ∥Xt∥2≤L\|X_t\|_2 \le L∥Xt​∥2​≤L, then with probability at least 1−δ1-\delta1−δ, for all ttt, ∥θ^t−θ∗∥V‾t≤Rdlog⁡((1+tL2/λ)/δ)+λ1/2S\|\widehat\theta_t - \theta_*\|_{\overline V_t} \le R\sqrt{d\log((1 + tL^2/\lambda)/\delta)} + \lambda^{1/2}S∥θt​−θ∗​∥Vt​​≤Rdlog((1+tL2/λ)/δ)​+λ1/2S (second claim, stated here for d≥2d \ge 2d≥2).

Significance

Theorem 3 bounds the regret of OFUL by O(dnlog⁡n)O(d\sqrt n\log n)O(dn​logn) with high probability, uniformly over the horizon, so it holds for an unknown horizon without restarting. The bound applies to arbitrary, even adversarially changing, decision sets. Theorem 1 is the ingredient that makes this possible: a deviation bound for a vector-valued martingale, normalized by its own random covariance, that holds for all times simultaneously and whose logarithmic term is a determinant rather than a union-bound count. The same inequality underlies regret analyses of generalized linear bandits, kernelized bandits, linear Markov decision processes and many confidence-sequence constructions.

All three results are proved in the paper's appendices (not included in the source file used here). None of them is formalized in the stated generality. Prove2Me holds the special cases V=λIV = \lambda IV=λI, R=1R = 1R=1, δ<1\delta < 1δ<1 of Theorems 1 and 2 (from the Bandit Algorithms textbook series), a pathwise LinUCB regret lemma that assumes the confidence event, and the elliptical potential lemma. A formal proof of Theorem 3 would be the first machine-checked high-probability regret bound for OFUL with the paper's confidence sets.

Difficulty

The actions are chosen adaptively, by an argmax over a data-dependent set, so the sequence XtX_tXt​ has no independence structure and the least-squares estimate is not a sum of independent terms. A fixed-design concentration bound followed by a union bound over time and over a covering of the sphere loses logarithmic factors and does not produce the determinant in the radius; that is the route of the earlier work that Theorem 1 improves. Theorem 1 must hold for all times at once for a quantity normalized by the random matrix V‾t\overline V_tVt​, which is itself built from the adaptively chosen actions; a bound for each fixed ttt does not give it.

Formalization scope

Vectors are Fin d → ℝ, matrices Matrix (Fin d) (Fin d) ℝ, and ∥x∥A\|x\|_A∥x∥A​ is Real.sqrt (x ⬝ᵥ A *ᵥ x). Rounds are indexed t+1t+1t+1 for t:Nt : ℕt:N, so sums over s≤ts \le ts≤t are sums over Finset.range t at index s + 1, and the time-0 objects are empty sums. The probability space is standard Borel, as Mathlib's conditional sub-Gaussianity (HasCondSubgaussianMGF, variance proxy R2R^2R2) requires; this is an added hypothesis. Every "with probability at least 1−δ1-\delta1−δ, for all ttt" is stated as an outer-measure bound ≤δ\le \delta≤δ on the failure event, with the time quantifier inside the event. det⁡(⋅)1/2\det(\cdot)^{1/2}det(⋅)1/2 is the real square root of the determinant; the matrices inverted are positive definite, so Lean's junk inverse never occurs.

OFUL is a predicate on the whole process: in every round the chosen pair maximizes ⟨x,θ⟩\langle x,\theta\rangle⟨x,θ⟩ over Dt×Ct−1D_t \times C_{t-1}Dt​×Ct−1​, with any tie-breaking. Runs exist whenever the decision sets are nonempty and compact. The measurability of the actions is assumed, as in Theorem 1. The optimal reward ⟨xt∗,θ∗⟩\langle x^*_t, \theta_*\rangle⟨xt∗​,θ∗​⟩ is the supremum over DtD_tDt​, finite because of the reward bound.

Two corrections to the printed Theorem 3 are made and disclosed. The printed nL/dnL/dnL/d is replaced by nL2/dnL^2/dnL2/d, which is what the determinant–trace bound det⁡V‾n≤(λ+nL2/d)d\det\overline V_n \le (\lambda + nL^2/d)^ddetVn​≤(λ+nL2/d)d gives; for L≤1L \le 1L≤1 the corrected bound implies the printed one. The hypothesis λ≥max⁡(1,L2)\lambda \ge \max(1, L^2)λ≥max(1,L2) is added: for λ<1\lambda < 1λ<1 the printed logarithm can be negative, and the printed bound would then assert Rn≤0R_n \le 0Rn​≤0. In the second claim of Theorem 2, d≥2d \ge 2d≥2 is added, because at d=1d = 1d=1 the claim does not follow from the first claim and the paper's proof is not available.

The goal is a probability bound over the noise, not the pathwise statement "if θ∗∈Ct−1\theta_* \in C_{t-1}θ∗​∈Ct−1​ for all ttt then Rn≤…R_n \le \dotsRn​≤…". The pathwise statement assumes the confidence event instead of proving it, and is already on the platform. The confidence sets inside the OFUL predicate use the same δ\deltaδ as the conclusion.

Needed infrastructure: maximal inequalities for nonnegative supermartingales, Gaussian integrals of quadratic forms on Rd\mathbb R^dRd, log-determinant bounds for sums of rank-one updates, and the determinant–trace inequality. The platform rows BanditAlgorithm.self_normalized_martingale_bound, BanditAlgorithm.least_squares_confidence_ellipsoid and BanditAlgorithm.elliptical_potential_lemma are referenced as tools. Proofs of the milestones, generalizations of the existing special cases to general VVV and RRR, and reusable determinant lemmas are all welcome.

Selected references

  • Y. Abbasi-Yadkori, D. Pál, Cs. Szepesvári, Improved Algorithms for Linear Stochastic Bandits, Advances in Neural Information Processing Systems 24 (NIPS), 2011. https://proceedings.neurips.cc/paper/2011
  • P. Auer, Using Confidence Bounds for Exploitation-Exploration Trade-offs, Journal of Machine Learning Research 3, 2002. https://www.jmlr.org/papers/v3/auer02a.html
  • V. Dani, T. P. Hayes, S. M. Kakade, Stochastic Linear Optimization under Bandit Feedback, COLT, 2008. http://colt2008.cs.helsinki.fi/papers/80-Dani.pdf
  • P. Rusmevichientong, J. N. Tsitsiklis, Linearly Parameterized Bandits, Mathematics of Operations Research 35(2), 2010. https://doi.org/10.1287/moor.1100.0446
  • T. Lattimore, Cs. Szepesvári, Bandit Algorithms, Cambridge University Press, 2020, Chapters 19–20. https://doi.org/10.1017/9781108571401
12 thms6 active usersReviewed
🏆Completed
Control TheoryDynamic ProgrammingOperations Research+1·Captain: mikedeng1

Robust Control of Markov Decision Processes with Uncertain Transition Matrices 1: Perfect Duality and the Robust Dynamic Programming Recursion for Finite-Horizon MDPsResearch Paper

Motivation

A Markov decision process (MDP) is solved by dynamic programming once its transition probabilities are known. In practice they are estimated from data, and the optimal policy of an MDP can be sensitive to estimation error: a policy computed from point estimates may perform much worse under the true transition matrices. Nilim and El Ghaoui (Oper. Res. 53(5), 2005) study the robust version of the problem, in which the controller minimises the worst-case expected cost when the transition matrices are only known to lie in given uncertainty sets, and motivate it with aircraft routing under uncertain weather.

Earlier work on MDPs with uncertain transition probabilities includes Satia and Lave (1973) and White and Eldeib (1994), which treat interval and set-valued transition models, and Givan, Leach and Dean (1997) on bounded-parameter MDPs. The robust Bellman recursion under a rectangularity assumption was obtained independently by Iyengar (Columbia technical report 2002, published as Robust dynamic programming, Math. Oper. Res. 30(2), 2005). This mission targets the finite-horizon result of Nilim and El Ghaoui: Theorem 1, which shows that the robust problem is solved by a recursion of the same shape as the nominal one and that the associated min–max game has a value.

Setting

The states form a finite set X={1,…,n}\mathcal X=\{1,\dots,n\}X={1,…,n}, the decision horizon is T={0,1,…,N−1}T=\{0,1,\dots,N-1\}T={0,1,…,N−1}, and the action set A\mathcal AA is finite, nonempty and the same in every state. Costs are ct(i,a)≥0c_t(i,a)\ge0ct​(i,a)≥0 for t∈Tt\in Tt∈T, and there is a terminal cost cN(i)c_N(i)cN​(i). The system starts in a given state i0i_0i0​.

Write Δn={p∈R+n:pT1=1}\Delta_n=\{p\in\mathbb R^n_+ : p^{\mathsf T}\mathbf 1=1\}Δn​={p∈R+n​:pT1=1} for the probability simplex. For every action aaa and state iii, a nonempty set Pia⊆Δn\mathcal P_i^a\subseteq\Delta_nPia​⊆Δn​ describes the possible iii-th rows of the transition matrix under aaa. No convexity or closedness is assumed. The rectangular uncertainty property says the uncertainty set of the matrix PaP^aPa is the product Pa=P1a×⋯×Pna\mathcal P^a=\mathcal P_1^a\times\cdots\times\mathcal P_n^aPa=P1a​×⋯×Pna​.

A controller policy π=(a0,…,aN−1)\pi=(\mathbf a_0,\dots,\mathbf a_{N-1})π=(a0​,…,aN−1​) consists of maps at:X→A\mathbf a_t:\mathcal X\to\mathcal Aat​:X→A, and Π=AnN\Pi=\mathcal A^{nN}Π=AnN is the set of such policies. A policy of nature τ=(Pta)a∈A,t∈T\tau=(P_t^a)_{a\in\mathcal A,t\in T}τ=(Pta​)a∈A,t∈T​ picks, for every stage, action and state, a row pia(t)∈Piap_i^a(t)\in\mathcal P_i^apia​(t)∈Pia​. The admissible set is T=(⨂aPa)N\mathcal T=(\bigotimes_a\mathcal P^a)^NT=(⨂a​Pa)N, so nature may change the matrices from stage to stage. The expected total cost is

CN(π,τ)=E(∑t=0N−1ct(it,at(it))+cN(iN)),C_N(\pi,\tau)=\mathbf E\Big(\sum_{t=0}^{N-1}c_t(i_t,\mathbf a_t(i_t))+c_N(i_N)\Big),CN​(π,τ)=E(t=0∑N−1​ct​(it​,at​(it​))+cN​(iN​)),

where the state iti_tit​ evolves as a Markov chain with transition matrix Ptat(i)P_t^{\mathbf a_t(i)}Ptat​(i)​ from state iii. The support function of a set P\mathcal PP is σP(v)=sup⁡{pTv:p∈P}\sigma_{\mathcal P}(v)=\sup\{p^{\mathsf T}v : p\in\mathcal P\}σP​(v)=sup{pTv:p∈P}. The robust recursion (7) starts from vN=cNv_N=c_NvN​=cN​ and sets

vt(i)=min⁡a∈A(ct(i,a)+σPia(vt+1)),v_t(i)=\min_{a\in\mathcal A}\big(c_t(i,a)+\sigma_{\mathcal P_i^a}(v_{t+1})\big),vt​(i)=a∈Amin​(ct​(i,a)+σPia​​(vt+1​)),

and for a fixed π\piπ the evaluation recursion (10) starts from vNπ=cNv_N^\pi=c_NvNπ​=cN​ and sets vtπ(i)=ct(i,at(i))+σPiat(i)(vt+1π)v_t^\pi(i)=c_t(i,\mathbf a_t(i))+\sigma_{\mathcal P_i^{\mathbf a_t(i)}}(v_{t+1}^\pi)vtπ​(i)=ct​(i,at​(i))+σPiat​(i)​​(vt+1π​).

Formalization targets

Goal: Theorem 1 (Robust Dynamic Programming)

min⁡π∈Πsup⁡τ∈TCN(π,τ)=v0(i0)=sup⁡τ∈Tmin⁡π∈ΠCN(π,τ),\min_{\pi\in\Pi}\sup_{\tau\in\mathcal T}C_N(\pi,\tau)=v_0(i_0)=\sup_{\tau\in\mathcal T}\min_{\pi\in\Pi}C_N(\pi,\tau),π∈Πmin​τ∈Tsup​CN​(π,τ)=v0​(i0​)=τ∈Tsup​π∈Πmin​CN​(π,τ),

together with three further statements. First, sup⁡τCN(π,τ)=v0π(i0)\sup_{\tau}C_N(\pi,\tau)=v_0^\pi(i_0)supτ​CN​(π,τ)=v0π​(i0​) for every π\piπ. Second, every policy that chooses actions attaining the minimum in (7) (rule (8)) achieves v0(i0)v_0(i_0)v0​(i0​) in the worst case. Third, every nature policy whose rows attain the suprema σPia(vt+1)\sigma_{\mathcal P_i^a}(v_{t+1})σPia​​(vt+1​) (rule (9)) forces the value v0(i0)v_0(i_0)v0​(i0​) on every controller.

Milestones

  1. Lemma 1: a problem max⁡qTv0\max q^{\mathsf T}v_0maxqTv0​ subject to vt≤gt(vt+1)v_t\le g_t(v_{t+1})vt​≤gt​(vt+1​) with monotone gtg_tgt​ and q≥0q\ge0q≥0 is solved by the recursion vt=gt(vt+1)v_t=g_t(v_{t+1})vt​=gt​(vt+1​).
  2. Support functions of nonempty subsets of Δn\Delta_nΔn​ are componentwise nondecreasing.
  3. The constraint maps of problems (15) and (16) are componentwise nondecreasing.
  4. Eq. (14): for fixed π\piπ and fixed matrices, CN(π,τ)C_N(\pi,\tau)CN​(π,τ) is the value of a linear program.
  5. Eq. (16): sup⁡τ∈TCN(π,τ)=v0π(i0)\sup_{\tau\in\mathcal T}C_N(\pi,\tau)=v_0^\pi(i_0)supτ∈T​CN​(π,τ)=v0π​(i0​).
  6. Eq. (15): sup⁡τ∈Tmin⁡πCN(π,τ)=v0(i0)\sup_{\tau\in\mathcal T}\min_{\pi}C_N(\pi,\tau)=v_0(i_0)supτ∈T​minπ​CN​(π,τ)=v0​(i0​).

Significance

Theorem 1 shows that, under rectangular uncertainty, robustness costs one inner optimisation per state and action: the expected continuation cost pTvt+1p^{\mathsf T}v_{t+1}pTvt+1​ of nominal dynamic programming is replaced by the support function σPia(vt+1)\sigma_{\mathcal P_i^a}(v_{t+1})σPia​​(vt+1​). The equality of the min–max and max–min values says that it does not matter whether nature commits before or after the controller. The optimal controller policy remains deterministic and Markov. The later sections of the paper build on this recursion. They cover the discounted infinite-horizon case, the gap between stationary and time-varying uncertainty, and the computation of σ\sigmaσ for likelihood and entropy models, which the other missions of this series formalize.

The result is proved in the paper, and independently by Iyengar. It has no machine-checked proof that this mission is aware of. A formal proof yields a reusable development: a finite-horizon MDP with a forward-defined expected cost, the link between that expectation and backward linear programs, and the finite-horizon robust Bellman equation for arbitrary nonempty uncertainty sets.

Difficulty

The nominal Bellman recursion is standard. The robust statement is harder than "apply the nominal recursion under the worst matrix", because no single worst matrix need exist. The sets Pia\mathcal P_i^aPia​ are neither closed nor convex, so the suprema in σ\sigmaσ need not be attained, and T\mathcal TT is not compact. Minimax theorems for convex–concave or compact games therefore do not apply. The expected cost is defined forward, as an expectation over a Markov chain, while the recursions run backward, and connecting the two is part of the work. The max–min side needs nature policies that come within any tolerance of the value simultaneously at every stage, state and action.

Formalization scope

  • States are Fin n and stages Fin N. Values v0,…,vNv_0,\dots,v_Nv0​,…,vN​ are indexed by natural numbers, and only t≤Nt\le Nt≤N is meaningful. Vectors are Fin n → ℝ with the componentwise order.
  • The model is a structure holding the costs (ct≥0c_t\ge0ct​≥0), the terminal cost (no sign assumed), and the row sets. Every row set must be nonempty and contained in stdSimplex ℝ (Fin n). Nonemptiness is implicit in the paper: without it T\mathcal TT is empty, and a real supremum over an empty index is 000.
  • Rectangularity is built in: a nature policy is a function τ(t,a,i)\tau(t,a,i)τ(t,a,i) with τ(t,a,i)∈Pia\tau(t,a,i)\in\mathcal P_i^aτ(t,a,i)∈Pia​. Nature does not observe the realised trajectory, and stationary nature (Ts\mathcal T_sTs​) is not the set used here.
  • CNC_NCN​ is defined by the forward state distribution, not by a backward recursion. Defining it backward would make the evaluation statements hold by definition, which is the trivializing formalization this choice rules out.
  • σP\sigma_{\mathcal P}σP​ is the real sSup of {pTv}\{p^{\mathsf T}v\}{pTv}. This is the true supremum because the set is nonempty and bounded above by max⁡jvj\max_j v_jmaxj​vj​.
  • Maxima over nature are suprema: ⨆ τ in the goal and IsLUB in the milestones, because the row sets need not be closed. Minima over the finite nonempty Π\PiΠ and over A\mathcal AA are ⨅. The argmax rule (9) is stated only for nature policies attaining the row suprema. The argmin rule (8) is stated for every attaining policy.
  • The terminal value vN=cNv_N=c_NvN​=cN​ is not printed in Theorem 1. It is taken from the proof and from Step 1 of the paper's algorithm (p. 785). The composition g1∘⋯∘gNg_1\circ\cdots\circ g_Ng1​∘⋯∘gN​ in Lemma 1 is read as g0∘⋯∘gN−1g_0\circ\cdots\circ g_{N-1}g0​∘⋯∘gN−1​.
  • Not included: Corollary 1 (the sequential game) and the accuracy part of Theorem 2. Contributions of either as additional theorems on these definitions are welcome.

Selected references

  • A. Nilim, L. El Ghaoui, Robust Control of Markov Decision Processes with Uncertain Transition Matrices, Operations Research 53(5):780–798, 2005. https://doi.org/10.1287/opre.1050.0216
  • G. N. Iyengar, Robust Dynamic Programming, Mathematics of Operations Research 30(2):257–280, 2005. https://doi.org/10.1287/moor.1040.0129
  • J. K. Satia, R. E. Lave, Markovian Decision Processes with Uncertain Transition Probabilities, Operations Research 21(3):728–740, 1973. https://doi.org/10.1287/opre.21.3.728
  • C. C. White, H. K. Eldeib, Markov Decision Processes with Imprecise Transition Probabilities, Operations Research 42(4):739–749, 1994. https://doi.org/10.1287/opre.42.4.739
  • M. L. Puterman, Markov Decision Processes: Discrete Stochastic Dynamic Programming, Wiley, 1994. https://doi.org/10.1002/9780470316887
11 thms4 active usersReviewed
🏆Completed
Bandit AlgorithmsMachine LearningOperations Research·Captain: mikedeng1

Improved Algorithms for Linear Stochastic Bandits II: Constant High-Probability Regret of UCB(δ)Research Paper

Motivation

The stochastic multi-armed bandit is the basic model of sequential decision making under uncertainty: a learner repeatedly chooses one of ddd actions, observes a noisy reward for the chosen action only, and must balance exploring poorly known actions against exploiting the one that currently looks best. It underlies adaptive clinical trials, online advertising, recommendation, dynamic pricing and many simulation-optimization procedures in operations research.

The standard algorithm is UCB (Auer, Cesa-Bianchi and Fischer, 2002, doi:10.1023/A:1013689704352), which plays the arm with the largest upper confidence bound on its mean. Its confidence widths grow with the current time ttt (or with a horizon nnn fixed in advance), and its guarantee is on the expected regret, which grows like log⁡n\log nlogn. Lai and Robbins (1985, doi:10.1016/0196-8858(85)90002-8) showed that logarithmic growth of the expected regret cannot be avoided by a consistent algorithm.

Abbasi-Yadkori, Pál and Szepesvári (NIPS 2011) proved a self-normalized concentration inequality for vector-valued martingales that holds uniformly over time. Section 6 of their paper applies it to the ddd-armed bandit. The resulting confidence intervals depend on neither the horizon nor the current time. The UCB variant built on them, UCB(δ\deltaδ), has pseudo-regret bounded by a constant, independent of the horizon, on a single event of probability at least 1−δ1-\delta1−δ. This mission formalizes that section.

Setting

There are d≥1d \ge 1d≥1 arms with unknown means μ1,…,μd∈R\mu_1, \dots, \mu_d \in \mathbb Rμ1​,…,μd​∈R. Write μ∗=max⁡1≤i≤dμi\mu_* = \max_{1 \le i \le d} \mu_iμ∗​=max1≤i≤d​μi​ for the best mean and Δi=μ∗−μi≥0\Delta_i = \mu_* - \mu_i \ge 0Δi​=μ∗​−μi​≥0 for the gap of arm iii.

Randomness lives on a probability space (Ω,F,P)(\Omega, \mathcal F, P)(Ω,F,P) with a filtration (Ft)t≥0(\mathcal F_t)_{t \ge 0}(Ft​)t≥0​. In round t=1,2,…t = 1, 2, \dotst=1,2,… the learner plays an arm ItI_tIt​ that is Ft−1\mathcal F_{t-1}Ft−1​-measurable and receives the reward μIt+ηt\mu_{I_t} + \eta_tμIt​​+ηt​. The noise ηt\eta_tηt​ is Ft\mathcal F_tFt​-measurable and conditionally 1-sub-Gaussian:

E[eληt∣Ft−1]≤eλ2/2for all λ∈R.\mathbf E\left[e^{\lambda\eta_t} \mid \mathcal F_{t-1}\right] \le e^{\lambda^2/2} \qquad \text{for all } \lambda \in \mathbb R .E[eληt​∣Ft−1​]≤eλ2/2for all λ∈R.

The noise need not be independent or identically distributed across rounds, and the rewards need not be bounded.

After ttt rounds, Ni,tN_{i,t}Ni,t​ is the number of plays of arm iii and X‾i,t\overline X_{i,t}Xi,t​ is the average reward received from it. For a confidence level δ>0\delta > 0δ>0 the confidence width is

ci,t=1+Ni,tNi,t2(1+2log⁡d (1+Ni,t)1/2δ)(3)c_{i,t} = \sqrt{\frac{1 + N_{i,t}}{N_{i,t}^2}\left(1 + 2\log\frac{d\,(1 + N_{i,t})^{1/2}}{\delta}\right)} \qquad (3)ci,t​=Ni,t2​1+Ni,t​​(1+2logδd(1+Ni,t​)1/2​)​(3)

with ci,t=+∞c_{i,t} = +\inftyci,t​=+∞ when Ni,t=0N_{i,t} = 0Ni,t​=0. UCB(δ\deltaδ) plays, in round ttt, an arm that maximizes X‾i,t−1+ci,t−1\overline X_{i,t-1} + c_{i,t-1}Xi,t−1​+ci,t−1​; in particular every arm is played once before any comparison is made. The pseudo-regret after nnn rounds is

Rn=∑t=1n(μ∗−μIt).R_n = \sum_{t=1}^n \left(\mu_* - \mu_{I_t}\right).Rn​=t=1∑n​(μ∗​−μIt​​).

This is the linear bandit of the paper with the standard basis of Rd\mathbb R^dRd as decision set and θ∗=μ\theta_* = \muθ∗​=μ.

Formalization targets

Goal: Theorem 7 (constant regret of UCB(δ\deltaδ))

For every δ>0\delta > 0δ>0, with probability at least 1−δ1-\delta1−δ, for all n≥0n \ge 0n≥0 simultaneously,

Rn≤∑i:Δi>0(3Δi+16Δilog⁡2dΔiδ).R_n \le \sum_{i : \Delta_i > 0}\left(3\Delta_i + \frac{16}{\Delta_i}\log\frac{2d}{\Delta_i\delta}\right).Rn​≤i:Δi​>0∑​(3Δi​+Δi​16​logΔi​δ2d​).

The right-hand side depends only on the gaps, ddd and δ\deltaδ.

Milestone: Lemma 6 (confidence intervals)

For any adapted choice of arms (not only UCB(δ\deltaδ)) and every δ>0\delta > 0δ>0, with probability at least 1−δ1-\delta1−δ,

∣X‾i,t−μi∣≤ci,tfor all arms i and all t≥0.|\overline X_{i,t} - \mu_i| \le c_{i,t} \qquad \text{for all arms } i \text{ and all } t \ge 0 .∣Xi,t​−μi​∣≤ci,t​for all arms i and all t≥0.

Significance

The result. Theorem 7 shows that, once a confidence level is fixed, a UCB-type algorithm can stop paying for exploration after finitely many rounds: with probability 1−δ1-\delta1−δ the total regret over an infinite horizon is bounded. The paper notes that this does not contradict the Lai–Robbins lower bound, which concerns expected regret; on the failure event of probability δ\deltaδ the regret may grow linearly. Lemma 6 is the practical content behind this: anytime-valid confidence intervals for adaptively sampled means under martingale noise, usable for stopping rules, best-arm identification and any sequential procedure that inspects its estimates at data-dependent times.

Formalizing it. Both results are proved in the paper's appendices (F and G). No machine-checked proof of either is known to exist. The platform already has the self-normalized martingale bound for V=λIV = \lambda IV=λI and unit sub-Gaussian noise (BanditAlgorithm.self_normalized_martingale_bound, listed here as a reference item), and UCB bounds with horizon-dependent widths and in-expectation or pathwise conclusions. Neither is Theorem 7. The mission produces a formal account of time-uniform confidence intervals for adaptively sampled arm means, and of a regret bound that is uniform in the horizon.

Difficulty

Two points separate this from textbook UCB analyses. First, the number of samples Ni,tN_{i,t}Ni,t​ of an arm is itself random and depends on past noise, so a fixed-sample concentration inequality with a union bound over times does not give widths that are free of ttt: a union bound over all ttt costs a factor that diverges. The time-uniform event must come from a maximal (self-normalized) inequality applied to the martingale ∑sηs1{Is=i}\sum_s \eta_s \mathbf 1\{I_s = i\}∑s​ηs​1{Is​=i}. Second, the regret statement is uniform in nnn with constants depending on the gaps; converting a condition of the form "c(N)≥Δi/2c(N) \ge \Delta_i/2c(N)≥Δi​/2" into an explicit bound on NNN requires solving an inequality in which NNN appears both polynomially and inside a logarithm, and the explicit constants 333 and 161616 must come out of that step.

Formalization scope

The Lean development lives in the namespace ImprovedLinBandits.UCBDelta.

  • Arms are Fin d with 0 < d in the goal; means are μ : Fin d → ℝ, μ∗\mu_*μ∗​ is ⨆ i, μ i (the maximum over a nonempty finite type).
  • Rounds are indexed t + 1 for t : ℕ: the arm I (t + 1) is ℱ t-measurable, the noise η (t + 1) is ℱ (t + 1)-measurable and satisfies Mathlib's HasCondSubgaussianMGF (ℱ t) … (η (t + 1)) 1 P. Values at index 000 are unused.
  • The sample space is assumed to be a standard Borel space, which Mathlib's conditional sub-Gaussianity requires; this hypothesis is not in the paper.
  • "With probability at least 1−δ1-\delta1−δ, for all …" is stated as: the outer probability of the failure event, with the quantifiers over arms and times inside it, is at most δ\deltaδ. For δ≥1\delta \ge 1δ≥1 the statements are trivially true, as in the paper.
  • The rule (4) is read with the statistics of rounds 1,…,t−11, \dots, t-11,…,t−1, because the printed X‾i,t\overline X_{i,t}Xi,t​, ci,tc_{i,t}ci,t​ already count round ttt. An unplayed arm, whose width is +∞+\infty+∞ in the paper, is played before the indices are compared. Every tie-breaking rule is allowed, and measurability of the chosen arm is assumed rather than derived.
  • The printed Theorem 7 has no quantifier on nnn; it is formalized in the uniform-in-nnn form, matching the section's claim of constant regret and the time-uniform event of Lemma 6.
  • Lean's division by zero makes X‾i,t\overline X_{i,t}Xi,t​ and ci,tc_{i,t}ci,t​ equal to 000 when Ni,t=0N_{i,t} = 0Ni,t​=0. Lemma 6 therefore excludes Ni,t=0N_{i,t} = 0Ni,t​=0 explicitly (where the paper's inequality is vacuous), and the run predicate handles unplayed arms separately. The regret bound sums over arms with Δi>0\Delta_i > 0Δi​>0, so its divisions are well defined.

A trivializing formalization is ruled out: the confidence event is not assumed as a hypothesis of Theorem 7, the i.i.d. bandit model is not substituted for the martingale noise model, and no bound on the means or rewards is imposed.

Useful infrastructure for solvers: the self-normalized bound of Theorem 1 in the scalar case (d=1d = 1d=1, λ=1\lambda = 1λ=1, As=1{Is=i}A_s = \mathbf 1\{I_s = i\}As​=1{Is​=i}, V‾t=1+Ni,t\overline V_t = 1 + N_{i,t}Vt​=1+Ni,t​), a union bound over arms, and elementary inequalities inverting N↦1+NN2(1+2log⁡(d1+N/δ))N \mapsto \frac{1+N}{N^2}(1 + 2\log(d\sqrt{1+N}/\delta))N↦N21+N​(1+2log(d1+N​/δ)). Lemmas about pull counts and empirical means under adaptive sampling are reusable beyond this mission and are welcome as contributions.

Selected references

  • Y. Abbasi-Yadkori, D. Pál, Cs. Szepesvári, Improved Algorithms for Linear Stochastic Bandits, Advances in Neural Information Processing Systems 24 (NIPS), 2011. https://papers.nips.cc/paper/2011/hash/e1d5be1c7f2f456670de3d53c7b54f4a-Abstract.html
  • P. Auer, N. Cesa-Bianchi, P. Fischer, Finite-time Analysis of the Multiarmed Bandit Problem, Machine Learning 47, 2002. https://doi.org/10.1023/A:1013689704352
  • T. L. Lai, H. Robbins, Asymptotically Efficient Adaptive Allocation Rules, Advances in Applied Mathematics 6, 1985. https://doi.org/10.1016/0196-8858(85)90002-8
  • J.-Y. Audibert, R. Munos, Cs. Szepesvári, Exploration–exploitation tradeoff using variance estimates in multi-armed bandits, Theoretical Computer Science 410, 2009. https://doi.org/10.1016/j.tcs.2009.01.016
6 thms5 active usersReviewed
🏆Completed
Control TheoryDynamic ProgrammingOperations Research+1·Captain: mikedeng1

Robust Control of Markov Decision Processes with Uncertain Transition Matrices 3: Stationary Policies Suffice and the Stationary/Time-Varying Uncertainty Gap Vanishes GeometricallyResearch Paper

Motivation

A Markov decision process (MDP) is controlled with transition probabilities estimated from data, and optimal policies computed for the estimated model can perform badly when the estimates are off. Robust MDPs replace the single transition model by a set of models and optimize the worst case over that set. Two readings of "the set" are possible. In the stationary uncertainty model, the unknown transition matrices are fixed but unknown; this is the reading that confidence regions from statistics support, but the resulting min–max problem is hard to solve. In the time-varying uncertainty model, an adversary ("nature") may pick different matrices at every stage; this relaxation is solved exactly by robust dynamic programming. Nilim and El Ghaoui (Oper. Res. 2005) solve the second problem in place of the first, and Theorem 4 of their paper justifies the substitution for discounted costs: in the infinite horizon the two readings, and the restriction to stationary controllers, all give the same value, and in the finite horizon the two readings differ by an amount that decays geometrically in the horizon.

Timeline:

  • 1973: Satia and Lave study MDPs with uncertain transition probabilities (Oper. Res. 21).
  • 1994: Puterman's monograph collects the nominal theory, including the optimality of stationary deterministic policies for discounted finite MDPs (Wiley).
  • 2001: Bagnell, Ng and Schneider state a robust Bellman recursion for stationary games without proof (CMU-RI-TR-01-25).
  • 2005: Iyengar (Math. Oper. Res. 30) and Nilim and El Ghaoui independently prove the robust Bellman recursion under rectangular uncertainty; Nilim and El Ghaoui add Theorem 4.
  • 2013: Wiesemann, Kuhn and Rustem extend robust MDPs beyond rectangular sets (Math. Oper. Res. 38).

Setting

States form a finite set X={0,…,n−1}\mathcal X = \{0,\dots,n-1\}X={0,…,n−1} and actions a finite nonempty set A\mathcal AA. A stage cost c(i,a)≥0c(i,a)\ge 0c(i,a)≥0 is given for every state and action, together with a discount factor 0<ν<10<\nu<10<ν<1 and an initial state i0i_0i0​. For every action aaa and state iii a nonempty set Pia\mathcal P_i^aPia​ of probability vectors in the simplex Δn\Delta_nΔn​ is given: the possible rows of the transition matrix PaP^aPa. Rectangularity means that every row is chosen independently: one stage of nature is a family (Pa)a∈A(P^a)_{a\in\mathcal A}(Pa)a∈A​ with iii-th row of PaP^aPa in Pia\mathcal P_i^aPia​, and the set of such families is Q\mathcal QQ.

A controller policy π=(a0,a1,… )\pi=(\mathbf a_0,\mathbf a_1,\dots)π=(a0​,a1​,…) assigns an action at(i)\mathbf a_t(i)at​(i) to each state at each stage; the set of all of them is Π\PiΠ, and the stationary ones (the same map at every stage) form Πs\Pi_sΠs​. A nature policy τ=(Pta)\tau=(P_t^a)τ=(Pta​) picks one element of Q\mathcal QQ per stage; the set is T\mathcal TT, and the stationary ones form Ts\mathcal T_sTs​. Starting from μ0=ei0\mu_0 = e_{i_0}μ0​=ei0​​, the state law evolves by μt+1(j)=∑iμt(i)Ptat(i)(i,j)\mu_{t+1}(j)=\sum_i \mu_t(i)P_t^{\mathbf a_t(i)}(i,j)μt+1​(j)=∑i​μt​(i)Ptat​(i)​(i,j). The discounted costs over horizon NNN and over the infinite horizon are

CN(π,τ)=∑t=0N−1νt∑iμt(i) c(i,at(i)),C∞(π,τ)=lim⁡N→∞CN(π,τ).C_N(\pi,\tau)=\sum_{t=0}^{N-1}\nu^t\sum_i\mu_t(i)\,c(i,\mathbf a_t(i)),\qquad C_\infty(\pi,\tau)=\lim_{N\to\infty}C_N(\pi,\tau).CN​(π,τ)=t=0∑N−1​νti∑​μt​(i)c(i,at​(i)),C∞​(π,τ)=N→∞lim​CN​(π,τ).

For a controller class C∈{Π,Πs}\mathcal C\in\{\Pi,\Pi_s\}C∈{Π,Πs​} and a nature class S∈{T,Ts}\mathcal S\in\{\mathcal T,\mathcal T_s\}S∈{T,Ts​} the robust values are ϕ∞(C,S)=inf⁡π∈Csup⁡τ∈SC∞(π,τ)\phi_\infty(\mathcal C,\mathcal S)=\inf_{\pi\in\mathcal C}\sup_{\tau\in\mathcal S}C_\infty(\pi,\tau)ϕ∞​(C,S)=infπ∈C​supτ∈S​C∞​(π,τ) and ϕN(Π,S)=inf⁡π∈Πsup⁡τ∈SCN(π,τ)\phi_N(\Pi,\mathcal S)=\inf_{\pi\in\Pi}\sup_{\tau\in\mathcal S}C_N(\pi,\tau)ϕN​(Π,S)=infπ∈Π​supτ∈S​CN​(π,τ). Finally cmax⁡=max⁡i,ac(i,a)c_{\max}=\max_{i,a}c(i,a)cmax​=maxi,a​c(i,a) and εN=νNcmax⁡/(1−ν)\varepsilon_N=\nu^Nc_{\max}/(1-\nu)εN​=νNcmax​/(1−ν).

Formalization targets

Goal: Theorem 4 (p. 786)

ϕ∞(Π,T)=ϕ∞(Πs,Ts)=ϕ∞(Πs,T)=ϕ∞(Π,Ts),\phi_\infty(\Pi,\mathcal T)=\phi_\infty(\Pi_s,\mathcal T_s)=\phi_\infty(\Pi_s,\mathcal T)=\phi_\infty(\Pi,\mathcal T_s),ϕ∞​(Π,T)=ϕ∞​(Πs​,Ts​)=ϕ∞​(Πs​,T)=ϕ∞​(Π,Ts​), 0≤ϕN(Π,T)−ϕN(Π,Ts)≤νNcmax⁡1−νfor every N.0\le \phi_N(\Pi,\mathcal T)-\phi_N(\Pi,\mathcal T_s)\le \frac{\nu^N c_{\max}}{1-\nu}\quad\text{for every }N .0≤ϕN​(Π,T)−ϕN​(Π,Ts​)≤1−ννNcmax​​for every N.

The second line is the paper's "the gap goes to zero at a geometric rate ν\nuν", with the constant the paper's own argument produces.

Milestones (proof order of the paper)

  1. Eq. (34): CN(π,τ)≤C∞(π,τ)≤CN(π,τ)+εNC_N(\pi,\tau)\le C_\infty(\pi,\tau)\le C_N(\pi,\tau)+\varepsilon_NCN​(π,τ)≤C∞​(π,τ)≤CN​(π,τ)+εN​ for all π∈Π\pi\in\Piπ∈Π, τ∈T\tau\in\mathcal Tτ∈T, NNN.
  2. Eq. (35): ϕN(Π,T)≤ϕ∞(Π,T)≤ϕN(Π,T)+εN\phi_N(\Pi,\mathcal T)\le\phi_\infty(\Pi,\mathcal T)\le\phi_N(\Pi,\mathcal T)+\varepsilon_NϕN​(Π,T)≤ϕ∞​(Π,T)≤ϕN​(Π,T)+εN​.
  3. Step (e): the same sandwich for ϕN(Π,Ts)\phi_N(\Pi,\mathcal T_s)ϕN​(Π,Ts​) and ϕ∞(Π,Ts)\phi_\infty(\Pi,\mathcal T_s)ϕ∞​(Π,Ts​).
  4. Eq. (33): for every ε>0\varepsilon>0ε>0 and all large NNN, ϕ∞(Πs,Ts)−ε≤ϕN(Π,T)≤ϕ∞(Πs,Ts)\phi_\infty(\Pi_s,\mathcal T_s)-\varepsilon\le\phi_N(\Pi,\mathcal T)\le\phi_\infty(\Pi_s,\mathcal T_s)ϕ∞​(Πs​,Ts​)−ε≤ϕN​(Π,T)≤ϕ∞​(Πs​,Ts​).
  5. Step (c): for every stationary π\piπ, sup⁡τ∈TC∞(π,τ)=sup⁡τ∈TsC∞(π,τ)\sup_{\tau\in\mathcal T}C_\infty(\pi,\tau)=\sup_{\tau\in\mathcal T_s}C_\infty(\pi,\tau)supτ∈T​C∞​(π,τ)=supτ∈Ts​​C∞​(π,τ), hence ϕ∞(Πs,T)=ϕ∞(Πs,Ts)\phi_\infty(\Pi_s,\mathcal T)=\phi_\infty(\Pi_s,\mathcal T_s)ϕ∞​(Πs​,T)=ϕ∞​(Πs​,Ts​).
  6. Step (d), nominal fact: for stationary τ\tauτ, inf⁡π∈ΠCN(π,τ)→inf⁡π∈ΠsC∞(π,τ)\inf_{\pi\in\Pi}C_N(\pi,\tau)\to\inf_{\pi\in\Pi_s}C_\infty(\pi,\tau)infπ∈Π​CN​(π,τ)→infπ∈Πs​​C∞​(π,τ).
  7. Step (d): ϕ∞(Π,Ts)=ϕ∞(Πs,Ts)\phi_\infty(\Pi,\mathcal T_s)=\phi_\infty(\Pi_s,\mathcal T_s)ϕ∞​(Π,Ts​)=ϕ∞​(Πs​,Ts​).

Significance

The first half of Theorem 4 says that, for discounted robust MDPs with rectangular uncertainty, nothing is gained by either player from non-stationary behaviour: the controller may restrict itself to stationary deterministic policies and nature's time variation buys it nothing. This is what makes the stationary game (6), solved by the robust Bellman recursion of Theorem 3, the right infinite-horizon object. The second half is a quantitative guarantee for practitioners: solving the tractable time-varying problem (4) instead of the statistically motivated but hard stationary problem (3) costs at most νNcmax⁡/(1−ν)\nu^Nc_{\max}/(1-\nu)νNcmax​/(1−ν) in value.

The result is proved on paper. As far as a search of the platform shows (September 2026), no robust MDP result has a machine-checked proof here; the nominal counterpart, optimality of stationary policies for discounted finite MDPs, is on the platform as BertsekasDP.discounted_main_theorem in a different model encoding (state-dependent control sets). A complete development contributes a reusable encoding of robust MDPs with time-varying and stationary adversaries, the truncation estimates for discounted costs, and a formal record of one step whose printed argument is incomplete (Step (d), see Difficulty).

Difficulty

The truncation estimates (34), (35) and Step (e) are elementary. The equalities in (31) are not: they compare values of games whose players have infinite-dimensional strategy sets, and the paper writes "min" and "max" where the infima and suprema need not be attained, since the row sets are neither closed nor convex. Two steps of the printed proof rely on results the mission does not import. Step (a) identifies ϕN(Π,T)\phi_N(\Pi,\mathcal T)ϕN​(Π,T) with iterates of the robust Bellman recursion, which is Theorems 1 and 3 of the paper (formalized in sibling missions of this series). Step (c) says only "following similar steps as in Step (a)". Step (d) is incomplete as printed: it shows that for each fixed stationary nature the controller's best time-varying and best stationary responses agree, which is a statement about a max–min value, whereas ϕ∞(Π,Ts)\phi_\infty(\Pi,\mathcal T_s)ϕ∞​(Π,Ts​) is a min–max value. The obvious attempt to exchange the infimum over Π\PiΠ with the supremum over Ts\mathcal T_sTs​ from that per-nature fact alone fails; the exchange requires a duality statement for the stationary game.

Formalization scope

States are Fin n; the action type is finite and nonempty. The row sets are an arbitrary family rows a i ⊆ stdSimplex ℝ (Fin n) with each set nonempty; nonemptiness is implicit in the paper and explicit here, and no convexity or closedness is assumed. A stage of nature is the subtype of families A → Fin n → (Fin n → ℝ) whose rows lie in the given sets, so rectangularity is built in. Controller policies are sequences ℕ → Fin n → A, nature policies sequences of stage choices; stationary policies of either player are the constant sequences. CNC_NCN​ is defined from the forward state distribution (not from a Bellman recursion) and reads only stages <N<N<N, so the finite-horizon values over infinite sequences are exactly the paper's values (3) and (4) with stage costs νtc\nu^tcνtc and zero terminal cost. C∞C_\inftyC∞​ is the sum of the series of nonnegative stage costs, which converges for 0≤ν<10\le\nu<10≤ν<1 and equals lim⁡NCN\lim_N C_NlimN​CN​. Every min and max of the paper is a real infimum ⨅ or supremum ⨆; all families are nonempty and lie in [0,cmax⁡/(1−ν)][0,c_{\max}/(1-\nu)][0,cmax​/(1−ν)], and attainment is not assumed anywhere. The discount factor satisfies 0<ν<10<\nu<10<ν<1, as in §4 of the paper.

The rate in the goal is the explicit bound νNcmax⁡/(1−ν)\nu^Nc_{\max}/(1-\nu)νNcmax​/(1−ν); a formalization stating only that the gap tends to zero, or stating (31) with the infinite-horizon cost replaced by a Bellman fixed point, proves a different theorem and is not accepted.

A complete development needs: the stochastic-matrix facts for the forward distribution, geometric-series bounds, robust value iteration for the time-varying and the stationary adversary, and nominal stationarity of discounted MDPs. The model and truncation estimates are reusable for any discounted robust MDP result. Contributions of any milestone, and of proofs of Step (c) and Step (d) by any route, are welcome.

Selected references

  • A. Nilim, L. El Ghaoui, Robust Control of Markov Decision Processes with Uncertain Transition Matrices, Operations Research 53(5):780–798, 2005. https://doi.org/10.1287/opre.1050.0216
  • G. N. Iyengar, Robust Dynamic Programming, Mathematics of Operations Research 30(2):257–280, 2005. https://doi.org/10.1287/moor.1040.0129
  • M. L. Puterman, Markov Decision Processes: Discrete Stochastic Dynamic Programming, Wiley, 1994. https://doi.org/10.1002/9780470316887
  • J. K. Satia, R. E. Lave, Markovian Decision Processes with Uncertain Transition Probabilities, Operations Research 21(3):728–740, 1973. https://doi.org/10.1287/opre.21.3.728
  • J. A. Bagnell, A. Y. Ng, J. Schneider, Solving Uncertain Markov Decision Processes, Technical Report CMU-RI-TR-01-25, Carnegie Mellon University, 2001.
  • W. Wiesemann, D. Kuhn, B. Rustem, Robust Markov Decision Processes, Mathematics of Operations Research 38(1):153–183, 2013. https://doi.org/10.1287/moor.1120.0566
10 thms3 active usersReviewed
🏆Completed
CombinatoricsGraph TheoryOperations Research·Captain: mikedeng1

λ1, Isoperimetric Inequalities for Graphs, and Superconcentrators 1: A Diameter Bound from λ1Research Paper

Motivation

The eigenvalues of the Laplacian of a graph carry metric information about the graph. The second-smallest one, λ1(G)\lambda_1(G)λ1​(G), was named the algebraic connectivity by Fiedler (Fiedler 1973), who showed it is positive exactly for connected graphs. N. Alon and V. D. Milman (J. Combin. Theory Ser. B 38 (1985) 73–88) showed that a large λ1\lambda_1λ1​ also forces two further properties: small diameter and a concentration of measure phenomenon, in which almost every vertex is close to any set containing half the vertices. They used these facts to build explicit expanders and superconcentrators, which are sparse networks with strong connectivity guarantees used in the theory of computation and in communication network design.

This mission covers Section 2 of that paper, "The Main Tools": the edge-count inequality (Lemma 2.1), the isoperimetric inequalities (Theorems 2.5 and 2.6), and the resulting diameter bound (Theorem 2.7).

Timeline:

  • 1973: Fiedler introduces λ1(G)\lambda_1(G)λ1​(G) as algebraic connectivity and proves λ1≤nn−1min⁡vd(v)\lambda_1 \le \frac{n}{n-1}\min_v d(v)λ1​≤n−1n​minv​d(v).
  • 1985: Alon and Milman prove the isoperimetric and diameter bounds of Section 2.
  • 1986: Alon proves the converse direction, that edge expansion implies a spectral gap (Alon 1986).
  • Later work sharpened the constant in the diameter bound, e.g. Chung 1989.

Setting

Let G=(V,E)G = (V, E)G=(V,E) be a finite, connected, simple graph on n=∣V∣≥2n = |V| \ge 2n=∣V∣≥2 vertices. Write d(v)d(v)d(v) for the degree of a vertex vvv, d=max⁡vd(v)d = \max_v d(v)d=maxv​d(v) for the maximum degree, and AGA_GAG​ for the adjacency matrix. The Laplacian is the V×VV \times VV×V matrix

Q=QG=diag⁡(d(v))v∈V−AG.Q = Q_G = \operatorname{diag}(d(v))_{v \in V} - A_G .Q=QG​=diag(d(v))v∈V​−AG​.

For real functions fff on VVV with scalar product (f,g)=∑vf(v)g(v)(f, g) = \sum_v f(v)g(v)(f,g)=∑v​f(v)g(v), the quadratic form of QQQ is (Qf,f)=∑{u,v}∈E(f(u)−f(v))2≥0(Qf, f) = \sum_{\{u,v\} \in E} (f(u) - f(v))^2 \ge 0(Qf,f)=∑{u,v}∈E​(f(u)−f(v))2≥0. The eigenvalues of QQQ, counted with multiplicity, are real and are written 0=λ0≤λ1≤⋯≤λn−10 = \lambda_0 \le \lambda_1 \le \dots \le \lambda_{n-1}0=λ0​≤λ1​≤⋯≤λn−1​. The algebraic connectivity λ1=λ1(G)\lambda_1 = \lambda_1(G)λ1​=λ1​(G) is the second-smallest of them.

For vertices u,vu, vu,v, dist⁡(u,v)\operatorname{dist}(u, v)dist(u,v) is the number of edges of a shortest path from uuu to vvv. For disjoint vertex sets A,BA, BA,B the paper writes ρ\rhoρ for the distance between them, a=∣A∣/na = |A|/na=∣A∣/n and b=∣B∣/nb = |B|/nb=∣B∣/n for their relative sizes, and EAE_AEA​ (EBE_BEB​) for the set of edges with both endpoints in AAA (in BBB). [x][x][x] denotes the integer part of x≥0x \ge 0x≥0.

Formalization targets

Goal: Theorem 2.7 (p. 79)

dist⁡(u,v)  ≤  2[2d/λ1 log⁡2n]for all u,v∈V.\operatorname{dist}(u, v) \;\le\; 2\left[\sqrt{2d/\lambda_1}\,\log_2 n\right] \qquad\text{for all } u, v \in V.dist(u,v)≤2[2d/λ1​​log2​n]for all u,v∈V.

Milestones, in the order the proof uses them

  1. Section 2, p. 76: 0=λ0<λ10 = \lambda_0 < \lambda_10=λ0​<λ1​ for connected GGG.
  2. Eq. (2.1), Rayleigh's principle: if ∑vf(v)=0\sum_v f(v) = 0∑v​f(v)=0 then (Qf,f)≥λ1∥f∥2(Qf, f) \ge \lambda_1 \|f\|^2(Qf,f)≥λ1​∥f∥2.
  3. Lemma 2.1: for nonempty A,BA, BA,B at distance ρ≥1\rho \ge 1ρ≥1,
λ1n≤1ρ2(1a+1b)(∣E∣−∣EA∣−∣EB∣).\lambda_1 n \le \frac{1}{\rho^2}\Big(\frac1a + \frac1b\Big)\big(|E| - |E_A| - |E_B|\big).λ1​n≤ρ21​(a1​+b1​)(∣E∣−∣EA​∣−∣EB​∣).
  1. Remark 2.3: λ1≤nn−1min⁡vd(v)\lambda_1 \le \frac{n}{n-1}\min_v d(v)λ1​≤n−1n​minv​d(v).
  2. Theorem 2.5: if ρ>1\rho > 1ρ>1 then
b≤1−a1+(λ1/d) aρ2.b \le \frac{1-a}{1 + (\lambda_1/d)\,a\rho^2}.b≤1+(λ1​/d)aρ21−a​.
  1. Theorem 2.6: if every AAA–BBB distance exceeds a real ρ≥1\rho \ge 1ρ≥1, then
b≤(1−a)exp⁡ ⁣(−ln⁡(1+2a)[λ1/(2d) ρ]).b \le (1-a)\exp\!\Big(-\ln(1+2a)\Big[\sqrt{\lambda_1/(2d)}\,\rho\Big]\Big).b≤(1−a)exp(−ln(1+2a)[λ1​/(2d)​ρ]).

Each statement keeps the paper's explicit constants. The goal is the endpoint of this chain and the paper's headline graph-theoretic bound.

Significance

Theorem 2.7 gives, for any family of graphs of bounded maximum degree whose algebraic connectivity stays bounded away from zero, a diameter of order log⁡n\log nlogn. By the paper's Remark 2.8, the 4-regular graphs constructed in its Section 4 show that this order cannot be improved. Theorem 2.6 is a discrete concentration of measure inequality: the proportion of vertices at distance more than ρ\rhoρ from a set of relative size aaa decays exponentially in ρλ1/(2d)\rho\sqrt{\lambda_1/(2d)}ρλ1​/(2d)​. It is the graph analogue of the Gromov–Milman concentration for manifolds, and Section 3 of the paper applies it to cubes and other product graphs. Theorem 2.5 is the input for the construction of expanders from graphs with a spectral gap (Theorem 4.3 of the paper).

All results are proved in the paper, and the formal work here is a machine-checked version of known proofs. As far as could be determined, none of the four inequalities (Lemma 2.1, Theorems 2.5–2.7) has been formalized in Lean or elsewhere. Mathlib has the Laplacian matrix, its positive semidefiniteness, and the relation between its kernel and connected components, but no statement about its second eigenvalue. The spectral facts (milestones 1–2), stated for Mathlib's Matrix.IsHermitian.eigenvalues₀, are reusable for any future work on algebraic connectivity.

Difficulty

The combinatorial steps are short. The work is at the interface between the spectral definition and the quadratic form. Mathlib defines eigenvalues through the spectral theorem for a Hermitian matrix, sorted into a list. Obtaining Rayleigh's principle for the second eigenvalue from that list, with the constant functions as the eigenvector of λ0=0\lambda_0 = 0λ0​=0, takes a Courant–Fischer-type argument over an orthonormal eigenbasis. It does not follow from positive semidefiniteness alone. Strict positivity of λ1\lambda_1λ1​ additionally needs that the kernel of QQQ is one-dimensional for a connected graph.

Theorem 2.6 iterates Theorem 2.5 over a sequence of neighbourhoods {v:dist⁡(v,A)≤jμ}\{v : \operatorname{dist}(v, A) \le j\mu\}{v:dist(v,A)≤jμ} with a real step length μ\muμ, so it needs bookkeeping of integer parts and of real-valued distance thresholds. Theorem 2.7 then combines Theorem 2.6 with Remark 2.3 and needs the estimate 12 2−[log⁡2n]<1/n\tfrac12\, 2^{-[\log_2 n]} < 1/n21​2−[log2​n]<1/n with the integer part kept. Replacing [⋅][\cdot][⋅] by the real number inside it changes the statement.

Formalization scope

  • Graphs are Mathlib SimpleGraph V on a Fintype vertex type with decidable adjacency. Every item assumes G.Connected and 2≤∣V∣2 \le |V|2≤∣V∣ (the goal writes 1<∣V∣1 < |V|1<∣V∣, as the paper does).
  • QQQ is G.lapMatrix ℝ. λ1\lambda_1λ1​ is the mission definition AlonMilman.Diameter.lambda1: the eigenvalue at index n−2n-2n−2 of eigenvalues₀, which lists the eigenvalues in decreasing order. It is 000 by convention when n<2n < 2n<2, a case no theorem uses.
  • λ1\lambda_1λ1​ is defined spectrally. Defining it as the best constant in Eq. (2.1) would make Rayleigh's principle definitional and remove the spectral content of the mission, so that formalization is excluded. Likewise the goal quantifies over all pairs of vertices of a connected graph and does not use SimpleGraph.diam without connectivity, since that is 000 for a disconnected graph.
  • Distances are SimpleGraph.dist (a natural number). "The distance between AAA and BBB is ρ\rhoρ" is encoded as ρ≤dist⁡(u,v)\rho \le \operatorname{dist}(u, v)ρ≤dist(u,v) for all u∈Au \in Au∈A, v∈Bv \in Bv∈B. Because the bounds weaken as ρ\rhoρ decreases, this is equivalent to the paper's exact distance. In Theorem 2.6 ρ\rhoρ is real and the hypothesis is strict.
  • EAE_AEA​ is AlonMilman.Diameter.edgesWithin G A. All counts are cast to R\mathbb RR before subtraction, a=∣A∣/na = |A|/na=∣A∣/n is a real quotient, [x][x][x] is Nat.floor, log⁡2\log_2log2​ is Real.logb 2, and ln⁡\lnln is Real.log.
  • Lemma 2.1 requires A,BA, BA,B nonempty (so a,b>0a, b > 0a,b>0). Theorems 2.5 and 2.6 hold as stated for empty sets and carry no such hypothesis.

Contributions welcome: proofs of any milestone, and in particular general Mathlib-style lemmas for Rayleigh quotients and eigenvalues₀, which have uses beyond this mission.

Selected references

  • N. Alon, V. D. Milman, λ1, isoperimetric inequalities for graphs, and superconcentrators, J. Combin. Theory Ser. B 38 (1985) 73–88. https://doi.org/10.1016/0095-8956(85)90092-9
  • M. Fiedler, Algebraic connectivity of graphs, Czechoslovak Math. J. 23 (1973) 298–305. https://doi.org/10.21136/CMJ.1973.101168
  • N. Alon, Eigenvalues and expanders, Combinatorica 6 (1986) 83–96. https://doi.org/10.1007/BF02579166
  • F. R. K. Chung, Diameters and eigenvalues, J. Amer. Math. Soc. 2 (1989) 187–196. https://doi.org/10.1090/S0894-0347-1989-0965008-X
9 thms3 active usersReviewed
🏆Completed
Operations ResearchProbabilityStochastic Systems·Captain: Shuze Chen

Processing Networks II: Subcriticality is Necessary for StabilityTextbook

Motivation

Before a queueing network's stability can be studied in any depth, a much cruder question has to be settled: is stability even possible for the given arrival rates and service capacities, under any control policy at all? For a single M/M/1 queue the answer is the familiar λ<μ\lambda < \muλ<μ, but a general stochastic processing network (SPN) — many buffers, many activities, servers that can be pooled or shared across job classes — has no single scalar "utilization" to compare against a threshold. J. G. Dai and J. Michael Harrison's Processing Networks: Fluid Models and Stability (Cambridge University Press, forthcoming; cited here from the authors' pre-publication draft, 2020-4-2, http://spnbook.org) answers this with a linear program: the static planning problem, first formulated by Harrison (2000). This mission formalizes the theorem that answers the crude question in one direction — no control policy can stabilize a network outside the region that program identifies — which is why, as the book puts it, "throughout the remainder of this book, attention is essentially restricted to subcritical networks."

Setting

An SPN has III buffers, indexed by i∈Ii \in \mathcal{I}i∈I, and JJJ activities, indexed by j∈Jj \in \mathcal{J}j∈J. Its first-order data — the quantities that matter for a capacity calculation, as opposed to full stochastic detail — are: the I×JI \times JI×J material requirement matrix BBB (BijB_{ij}Bij​ = number of class-iii items one type-jjj service consumes), the I×JI \times JI×J mean output matrix Γ\GammaΓ (its jjjth column is the expected output vector of a type-jjj service), the mean service times mj>0m_j > 0mj​>0, the K×JK \times JK×J capacity consumption matrix AAA (server pool kkk against activity jjj), and the server-pool capacities b∈R+Kb \in \mathbb{R}_+^Kb∈R+K​. From these,

R:=(B−Γ)M−1,M:=diag⁡(m1,…,mJ),R := (B - \Gamma)M^{-1}, \qquad M := \operatorname{diag}(m_1, \dots, m_J),R:=(B−Γ)M−1,M:=diag(m1​,…,mJ​),

so that RijR_{ij}Rij​ is the long-run average rate at which activity jjj depletes buffer iii's content.

Given an arrival-rate vector λ∈R+I\lambda \in \mathbb{R}_+^Iλ∈R+I​, the static planning problem (SPP) is the linear program

γ∗(λ):=min⁡x≥0, γ γs.t.Rx=λ,Ax≤γb,\gamma^\ast(\lambda) := \min_{x \ge 0,\, \gamma} \ \gamma \quad \text{s.t.} \quad Rx = \lambda, \quad Ax \le \gamma b,γ∗(λ):=x≥0,γmin​ γs.t.Rx=λ,Ax≤γb,

whose decision variable xjx_jxj​ is a long-run average activity rate and whose objective γ\gammaγ upper-bounds every server pool's utilization. The network is subcritical at λ\lambdaλ if γ∗(λ)<1\gamma^\ast(\lambda) < 1γ∗(λ)<1, and the subcritical region is Λ:={λ:γ∗(λ)<1}\Lambda := \{\lambda : \gamma^\ast(\lambda) < 1\}Λ:={λ:γ∗(λ)<1}.

An SPN is stable (Definition 3.6, mission I) when its ambient Markov chain is positive recurrent, equivalently has a unique stationary distribution, equivalently its buffer contents converge in distribution to a non-defective limit. This mission's chapter portion (Chapters 4-5) also treats three extensions used elsewhere in the book: a Markovian arrival process replacing independent Poisson arrivals; alternate routing with immediate commitment, where arrivals must be routed into an eligible buffer at the instant they arrive, with routing rates constrained by an augmented version of the SPP; and processor sharing (PS) networks, whose service discipline falls outside the book's ordinary relaxed-control framework and is instead analyzed through an equivalent head-of-line (EHL) model built to have the same generator.

Formalization targets

Goal: Theorem 5.2 — only subcritical networks can be stable

(baseline stochastic assumptions) ∧ (Markov representation) ∧ (SPN stable)  ⟹  λ∈Λ.\text{(baseline stochastic assumptions)} \ \wedge \ \text{(Markov representation)} \ \wedge \ \text{(SPN stable)} \implies \lambda \in \Lambda.(baseline stochastic assumptions) ∧ (Markov representation) ∧ (SPN stable)⟹λ∈Λ.

This is the weakest target that captures the chapter's content: it asserts nothing about which policy achieves stability, or whether subcriticality is sufficient (Chapters 6 onward answer that, case by case, and Chapter 5 itself gives two counterexamples where it is not) — only that subcriticality is unconditionally necessary.

Further results (milestones)

Proposition 4.1 (a strong law of large numbers for class-level arrivals under randomized routing), Proposition 4.4 (PS-network stability reduces to EHL-model stability), Proposition 5.1 (for a unitary network, subcriticality reduces to the classical load condition ρ<b\rho < bρ<b), and Corollaries 5.4-5.6 (the same necessity conclusion under a Markovian arrival process, under alternate routing, and its consequence for maximally stable policies).

Significance

The result itself. Theorem 5.2 converts "can this network be stabilized at all?" from an open-ended search over control policies into a single linear-program feasibility check on first-order data alone. Corollary 5.6 turns this into the standard proof template every later chapter uses: exhibit a policy whose implementation does not reference λ\lambdaλ, show it is stable throughout the subcritical region, and conclude maximal stability — without having to separately characterize the true stability region Λ∗\Lambda^\astΛ∗, which the book calls "a deep mathematical problem" in general.

Formalizing it. A search of the platform for "processing network," "static planning problem," and "linear program" returned no hits: the SPN-specific static planning problem — its decision variables xxx tied to a network's material-balance matrix RRR and capacity matrix AAA — has no existing counterpart, though the platform's linear-optimization field (16 missions) has general LP duality substrate a future proof of Proposition 5.1 or Theorem 5.2 could draw on. This mission is a from-scratch formalization of the SPP, the subcritical region, and the necessity theorem.

Difficulty

The natural first attempt states Theorem 5.2 as a claim about the buffer-contents process Z(t)Z(t)Z(t) directly. This fails to separate cleanly from the proof, because the actual argument passes through an auxiliary quantity — the stationary mean x:=Eπ[N(0)]x := \mathbb{E}_\pi[N(0)]x:=Eπ​[N(0)] under the chain's (unique, by stability) stationary distribution π\piπ — that has no meaning outside a specific proof strategy. The formalization instead states the goal purely in terms of the data (R,A,b)(R, A, b)(R,A,b) and the hypothesis of stability, exactly as the book's own statement does, leaving xxx's construction to the (currently sorry) proof. A second difficulty is Corollary 5.4's Markovian arrival process: naively reusing BaselineAssumptions with a non-Poisson arrival process is impossible, since Poisson-ness is a mandatory structural field of that definition, not an optional hypothesis — the corollary needs its own hypothesis structure that changes exactly the one clause Assumption 2.1(a) contributes and nothing else.

Formalization scope

Buffers and activities are Fin I, Fin J; matrices are Matrix over ℝ. The subcritical region is defined via the optimal SPP value γ∗\gamma^\astγ∗, formalized with Mathlib's IsLeast (attained infimum, matching the book's own "γ∗≤1\gamma^\ast \le 1γ∗≤1 iff xxx exists" phrasing, which presupposes attainment) rather than a bare existential — a formalization using, say, sInf would silently commit to junk values on an infeasible or unbounded LP and would not obviously match the book's own usage of γ∗\gamma^\astγ∗ as literally attained. The basic SPN model's full state-process construction (Sections 2.3-2.4) is not re-derived from scratch here; Theorem 5.2 instead takes the structural facts its own proof invokes — the capacity constraint AN(t)≤bAN(t) \le bAN(t)≤b (Eq. 2.11) and the material-requirement matrix BBB — as explicit data, reusing mission I's BaselineAssumptions and MarkovRepresentation for the stochastic and Markov-chain apparatus. Proposition 4.4's shared- generator fact between a PS network and its EHL model (the actual content the book's construction of Section 4.4 establishes) is likewise taken as an explicit hypothesis rather than rebuilt from the refined-class/phase-type machinery of Eqs. (4.19)-(4.29); reconstructing that machinery from scratch, or reproving Proposition 4.1's SLLN from the chain's strong Markov property at regeneration times, are both welcome future contributions. A formalization that stated Theorem 5.2 with Λ\LambdaΛ replaced by an unconstrained existential (dropping the LP structure entirely) would trivialize the chapter's actual content — the LP-feasibility characterization is what makes Λ\LambdaΛ checkable, and is preserved here in full.

Selected references

  • J. G. Dai and J. Michael Harrison, Processing Networks: Fluid Models and Stability, Cambridge University Press (forthcoming), pre-publication draft 2020-4-2. http://spnbook.org
  • J. M. Harrison, "Brownian models of open processing networks: canonical representation of workload," Annals of Applied Probability 10 (2000), 75-103.
  • J. G. Dai and W. Lin, "Maximum pressure policies in stochastic processing networks," Operations Research 53 (2005), 197-218.
13 thms3 active usersReviewed
🏆Completed
Convex OptimizationOperations ResearchOptimization+1·Captain: mikedeng1

Robust Control of Markov Decision Processes with Uncertain Transition Matrices 4: The Dual of the Worst-Case Expectation over a Kullback-Leibler BallResearch Paper

Motivation

A robust Markov decision process replaces the unknown transition probabilities of an MDP by sets of plausible values and optimises against the worst case. Nilim and El Ghaoui (Oper. Res. 53 (2005)) showed that, when the uncertainty is rectangular (each row of each transition matrix varies independently in its own set), the robust problem is solved by a Bellman-type recursion. Each step of that recursion needs, for every state and action, the value of an inner problem: the largest expectation of the next-stage value vector over the uncertainty set of one transition row. The recursion is only as tractable as this inner problem.

The paper studies several uncertainty models built from statistical estimates of the transition rows. In the entropy model the uncertain row is any distribution within a prescribed Kullback–Leibler divergence of a nominal distribution. For this model the paper reduces the inner problem to the minimisation of a scalar convex function, which is then solved by bisection. Iyengar (Math. Oper. Res. 30 (2005)) obtained the same robust recursion independently, and the same scalar reduction is the basic computation in later KL-constrained distributionally robust optimisation. This mission formalizes that reduction and the properties of the scalar function that the paper derives from it.

Setting

Let n≥1n\ge 1n≥1 and let Δn={p∈Rn:p≥0, ∑jp(j)=1}\Delta_n=\{p\in\mathbb R^n : p\ge 0,\ \sum_j p(j)=1\}Δn​={p∈Rn:p≥0, ∑j​p(j)=1} be the probability simplex. For p,q∈Rnp,q\in\mathbb R^np,q∈Rn the Kullback–Leibler divergence is

D(p∥q)=∑jp(j)log⁡p(j)q(j),D(p\|q)=\sum_j p(j)\log\frac{p(j)}{q(j)},D(p∥q)=j∑​p(j)logq(j)p(j)​,

with 0log⁡0=00\log 0=00log0=0. Fix a nominal distribution q∈Δnq\in\Delta_nq∈Δn​ with q(j)>0q(j)>0q(j)>0 for every jjj, and a level β>0\beta>0β>0. The entropy uncertainty set is

P={p∈Δn:D(p∥q)≤β}.\mathcal P=\{p\in\Delta_n : D(p\|q)\le\beta\}.P={p∈Δn​:D(p∥q)≤β}.

For a vector v∈Rnv\in\mathbb R^nv∈Rn (in the MDP, the value function of the next stage), the inner problem (17) is

σP(v)=max⁡p∈PpTv.\sigma_{\mathcal P}(v)=\max_{p\in\mathcal P} p^{\mathsf T}v .σP​(v)=p∈Pmax​pTv.

The paper's scalar dual function (47) is, for λ>0\lambda>0λ>0,

σ(λ)=λlog⁡(∑jq(j) ev(j)/λ)+βλ.\sigma(\lambda)=\lambda\log\Big(\sum_j q(j)\,e^{v(j)/\lambda}\Big)+\beta\lambda .σ(λ)=λlog(j∑​q(j)ev(j)/λ)+βλ.

Write vmax⁡=max⁡jv(j)v_{\max}=\max_j v(j)vmax​=maxj​v(j) and Q(v)=∑j: v(j)=vmax⁡q(j)Q(v)=\sum_{j:\,v(j)=v_{\max}}q(j)Q(v)=∑j:v(j)=vmax​​q(j), the qqq-mass of the maximisers of vvv. The tilted distribution at λ>0\lambda>0λ>0 is p∗(j)=q(j)ev(j)/λ/∑iq(i)ev(i)/λp^*(j)=q(j)e^{v(j)/\lambda}/\sum_i q(i)e^{v(i)/\lambda}p∗(j)=q(j)ev(j)/λ/∑i​q(i)ev(i)/λ.

In Lean, vectors are Fin n → ℝ, Δn\Delta_nΔn​ is stdSimplex ℝ (Fin n), and DDD, P\mathcal PP, σ\sigmaσ, p∗p^*p∗, vmax⁡v_{\max}vmax​, Q(v)Q(v)Q(v) are klDiv, klBall, dualFn, tiltedDist, vmax, maxMass in the namespace RobustMDP.EntropyInner.

Formalization targets

Goal: the dual of the inner problem (§6.2, Eq. (47), p. 791)

max⁡p∈PpTv=inf⁡λ>0σ(λ),\max_{p\in\mathcal P} p^{\mathsf T}v=\inf_{\lambda>0}\sigma(\lambda),p∈Pmax​pTv=λ>0inf​σ(λ),

with the maximum attained. This is kl_ball_inner_problem_dual. It holds for every nnn, every vvv, every q>0q>0q>0 in Δn\Delta_nΔn​ and every β>0\beta>0β>0.

Milestones

  1. §6.1: max⁡p∈ΔnD(p∥q)=max⁡i(−log⁡qi)\max_{p\in\Delta_n}D(p\|q)=\max_i(-\log q_i)maxp∈Δn​​D(p∥q)=maxi​(−logqi​), and for β≥max⁡i(−log⁡qi)\beta\ge\max_i(-\log q_i)β≥maxi​(−logqi​) the set P\mathcal PP is all of Δn\Delta_nΔn​ and the inner value is vmax⁡v_{\max}vmax​.
  2. Eq. (48): qTv+βλ≤σ(λ)≤vmax⁡+βλq^{\mathsf T}v+\beta\lambda\le\sigma(\lambda)\le v_{\max}+\beta\lambdaqTv+βλ≤σ(λ)≤vmax​+βλ for λ>0\lambda>0λ>0.
  3. §6.2, the optimal distribution: pTv−λD(p∥q)≤λlog⁡∑jq(j)ev(j)/λp^{\mathsf T}v-\lambda D(p\|q)\le\lambda\log\sum_j q(j)e^{v(j)/\lambda}pTv−λD(p∥q)≤λlog∑j​q(j)ev(j)/λ on Δn\Delta_nΔn​, with equality at p∗p^*p∗.
  4. §6.2, elimination of μ\muμ: min⁡μ[μ+βλ+λ∑jq(j)e(v(j)−μ)/λ−1]=σ(λ)\min_{\mu}\big[\mu+\beta\lambda+\lambda\sum_j q(j)e^{(v(j)-\mu)/\lambda-1}\big]=\sigma(\lambda)minμ​[μ+βλ+λ∑j​q(j)e(v(j)−μ)/λ−1]=σ(λ).
  5. Eq. (49): σ(λ)=vmax⁡+(β+log⁡Q(v))λ+o(λ)\sigma(\lambda)=v_{\max}+(\beta+\log Q(v))\lambda+o(\lambda)σ(λ)=vmax​+(β+logQ(v))λ+o(λ) as λ→0+\lambda\to0^+λ→0+.
  6. Eq. (50): σ(λ)=qTv+βλ+o(1)\sigma(\lambda)=q^{\mathsf T}v+\beta\lambda+o(1)σ(λ)=qTv+βλ+o(1) as λ→∞\lambda\to\inftyλ→∞.
  7. §6.3: if β≥−log⁡Q(v)\beta\ge-\log Q(v)β≥−logQ(v), then inf⁡λ>0σ=vmax⁡\inf_{\lambda>0}\sigma=v_{\max}infλ>0​σ=vmax​ and the inner value is vmax⁡v_{\max}vmax​.

Significance

The goal turns an nnn-dimensional optimisation over a nonpolyhedral convex set into a one-dimensional convex minimisation whose objective costs O(n)O(n)O(n) to evaluate. Combined with the bisection bracket from (48) and the behaviour at 000 from (49), it gives the paper's O(nlog⁡(vmax⁡/δ))O(n\log(v_{\max}/\delta))O(nlog(vmax​/δ)) cost per inner problem (§6.4), and hence the per-step cost of the robust Bellman recursion under entropy uncertainty. Milestone 7 identifies exactly when the uncertainty set is large enough that the robust step ignores the nominal model; unlike the cruder threshold of milestone 1, it depends on vvv.

The result is proved in the paper modulo "standard duality arguments". The paper gives no proof of the duality step itself, and its expansions (49)–(50) are proved only in outline in Appendix C. No formal proof of any of these statements is known to exist; Mathlib has the measure-theoretic Donsker–Varadhan ingredients but not the finite, constrained dual stated here. The mission produces a machine-checked version of the whole chain, with the attainment questions (which side is a max, which is only an infimum) settled explicitly.

Difficulty

The inequality max⁡PpTv≤σ(λ)\max_{\mathcal P}p^{\mathsf T}v\le\sigma(\lambda)maxP​pTv≤σ(λ) for every λ>0\lambda>0λ>0 is the routine half. The obstacle is the reverse inequality. The paper appeals to Lagrangian strong duality under a Slater condition, but the Lagrangian dual function equals σ(λ)\sigma(\lambda)σ(λ) only for λ>0\lambda>0λ>0; at λ=0\lambda=0λ=0 it is vmax⁡v_{\max}vmax​, and the dual infimum may be approached only as λ→0+\lambda\to0^+λ→0+. A proof that looks for a minimiser λ∗>0\lambda^*>0λ∗>0 and a matching primal point p∗p^*p∗ fails in precisely the regime β≥−log⁡Q(v)\beta\ge-\log Q(v)β≥−logQ(v) of milestone 7, where no such λ∗\lambda^*λ∗ exists and the primal optimum sits on the face of the simplex spanned by the maximisers of vvv. The strong-duality argument must also handle the boundary of Δn\Delta_nΔn​, where D(⋅∥q)D(\cdot\|q)D(⋅∥q) is not differentiable.

Formalization scope

  • Vectors are Fin n → ℝ; Δn\Delta_nΔn​ is stdSimplex ℝ (Fin n). D(p∥q)D(p\|q)D(p∥q) is a local finite sum with Lean's log⁡0=0\log 0=0log0=0, which gives 0log⁡0=00\log0=00log0=0; Mathlib's measure-valued InformationTheory.klDiv is not used.
  • Standing hypotheses in every theorem: q∈Δnq\in\Delta_nq∈Δn​, q(j)>0q(j)>0q(j)>0 for all jjj, and β>0\beta>0β>0, as in §6.1. No restriction on vvv is imposed; the "without loss of generality v≥0v\ge0v≥0" of the paper's §5 is not assumed here.
  • The primal "max" is stated with IsGreatest (attained, since the KL ball is compact). The paper's "min⁡λ>0σ(λ)\min_{\lambda>0}\sigma(\lambda)minλ>0​σ(λ)" is an infimum, stated with IsGLB over {σ(λ):λ>0}\{\sigma(\lambda):\lambda>0\}{σ(λ):λ>0}: it is not attained when β≥−log⁡Q(v)\beta\ge-\log Q(v)β≥−logQ(v).
  • dualFn is total in λ\lambdaλ and equals 000 at λ=0\lambda=0λ=0 (division by zero), not the paper's σ(0)=vmax⁡\sigma(0)=v_{\max}σ(0)=vmax​. Every statement uses λ>0\lambda>0λ>0; the value at 000 appears as the one-sided limit of (49). Accordingly (48) is stated for λ>0\lambda>0λ>0.
  • vmax⁡v_{\max}vmax​ is ⨆ j, v j, the attained maximum over the finite nonempty index set; max⁡i(−log⁡qi)\max_i(-\log q_i)maxi​(−logqi​) likewise.
  • (49) is stated as a limit along 𝓝[>] 0 together with a little-o remainder; (50) as a limit along atTop.
  • Milestone 7 uses the non-strict condition β≥−log⁡Q(v)\beta\ge-\log Q(v)β≥−logQ(v) of the paper's first sentence, which contains the strict version of its second.
  • Trivializing formalizations are excluded: the statements quantify over all nnn, vvv and qqq, so a constant vvv, n=1n=1n=1, or the whole-simplex case of milestone 1 does not discharge the goal.

Useful infrastructure: a finite Gibbs variational inequality, compactness of the KL ball, and convexity and one-sided asymptotics of the log-sum-exp function in the temperature parameter. These are reusable for any KL-constrained robust optimisation mission. Proofs of the milestones, alternative proofs of the goal that avoid a general strong-duality theorem, and the sharper O(λe−t/λ)O(\lambda e^{-t/\lambda})O(λe−t/λ) remainder of Appendix C are all welcome.

Selected references

  • A. Nilim and L. El Ghaoui, Robust Control of Markov Decision Processes with Uncertain Transition Matrices, Operations Research 53(5):780–798, 2005. https://doi.org/10.1287/opre.1050.0216
  • G. N. Iyengar, Robust Dynamic Programming, Mathematics of Operations Research 30(2):257–280, 2005. https://doi.org/10.1287/moor.1040.0129
  • M. D. Donsker and S. R. S. Varadhan, Asymptotic evaluation of certain Markov process expectations for large time, I, Communications on Pure and Applied Mathematics 28(1):1–47, 1975. https://doi.org/10.1002/cpa.3160280102
10 thms3 active usersReviewed
🏆Completed
CombinatoricsGraph TheoryGroup Theory+2·Captain: mikedeng1

λ1, Isoperimetric Inequalities for Graphs, and Superconcentrators 2: Cayley Graphs of Finite Quotients of a Property (T) Group Are Linear EnlargersResearch Paper

Motivation

An expander is a sparse graph in which every set of vertices has many neighbours outside itself. Expanders are the building blocks of superconcentrators (sparse directed graphs that route any rrr inputs to any rrr outputs along vertex-disjoint paths), of sorting and switching networks, and of many constructions in complexity theory and coding; the survey of Hoory, Linial and Wigderson (Bull. AMS 2006) describes these uses. Random regular graphs are expanders with high probability, but applications need explicit families with fixed degree and a uniform expansion constant.

Alon and Milman (J. Combin. Theory Ser. B 38 (1985)) replace combinatorial expansion by a spectral quantity, the second-smallest eigenvalue λ1\lambda_1λ1​ of the matrix Q=D−AQ = D - AQ=D−A of a graph, which Fiedler called the algebraic connectivity (Czech. Math. J. 1973). Their Theorem 4.3 shows that a regular graph with λ1\lambda_1λ1​ bounded away from 000 yields an expander. This mission formalizes their Section 4 source of such graphs: Cayley graphs of the finite quotients of a group with Kazhdan's property (T).

Timeline:

  • 1967: Kazhdan introduces property (T) and proves that SL(n,Z)SL(n,\mathbb{Z})SL(n,Z), n≥3n \ge 3n≥3, has it (Funct. Anal. Appl. 1 (1967)).
  • 1973: Margulis uses property (T) to give the first explicit expander family (Probl. Inf. Transm. 9 (1973)).
  • 1981: Gabber and Galil give a variant of Margulis' construction with an explicit expansion constant, proved by Fourier analysis (J. Comput. Syst. Sci. 22 (1981)).
  • 1985: Alon and Milman state the construction in terms of λ1\lambda_1λ1​ (Lemma 4.8, Theorem 4.9) and link it to the concentration property of Section 2 of their paper.

Setting

Let TTT be a finite group. A finite multigraph on TTT is a symmetric matrix M=(Mw,u)M = (M_{w,u})M=(Mw,u​) of nonnegative integers, Mw,uM_{w,u}Mw,u​ being the number of edges joining www and uuu (diagonal entries count loops). It is kkk-regular if every row sums to kkk. Its matrix is Q=diag⁡(d(v))−MQ = \operatorname{diag}(d(v)) - MQ=diag(d(v))−M with d(v)=∑uMv,ud(v) = \sum_u M_{v,u}d(v)=∑u​Mv,u​, a real symmetric positive semidefinite matrix. Its eigenvalues, repeated according to multiplicity, are 0=λ0≤λ1≤⋯≤λ∣T∣−10 = \lambda_0 \le \lambda_1 \le \dots \le \lambda_{|T|-1}0=λ0​≤λ1​≤⋯≤λ∣T∣−1​, and λ1(G)\lambda_1(G)λ1​(G) denotes the second of them.

Let HHH be a group, S⊆HS \subseteq HS⊆H a finite set with S=S−1S = S^{-1}S=S−1, and ϕ:H→T\phi : H \to Tϕ:H→T a homomorphism onto TTT. The Cayley multigraph G(T,ϕ(S))G(T, \phi(S))G(T,ϕ(S)) joins www and uuu by as many edges as there are s∈Ss \in Ss∈S with wu−1=ϕ(s)w u^{-1} = \phi(s)wu−1=ϕ(s). It is ∣S∣|S|∣S∣-regular, and its matrix is Q=∣S∣⋅I−∑s∈Sπ(ϕ(s))Q = |S| \cdot I - \sum_{s\in S} \pi(\phi(s))Q=∣S∣⋅I−∑s∈S​π(ϕ(s)), where π(t)\pi(t)π(t) is the permutation matrix of the left regular representation, (π(t))w,u=1(\pi(t))_{w,u} = 1(π(t))w,u​=1 iff wu−1=tw u^{-1} = twu−1=t.

An (n,k,ε)(n,k,\varepsilon)(n,k,ε)-enlarger (Definition 4.1) is a kkk-regular graph on nnn vertices with λ1≥ε\lambda_1 \ge \varepsilonλ1​≥ε.

A unitary representation π\piπ of HHH in a complex Hilbert space VVV is essentially nontrivial (Definition 4.5) if no nonzero vector is fixed by every π(h)\pi(h)π(h). A discrete group HHH has property (T) (Definition 4.6) if there are ε>0\varepsilon > 0ε>0 and a finite K⊆HK \subseteq HK⊆H such that for every essentially nontrivial unitary representation π\piπ and every unit vector yyy some h∈Kh \in Kh∈K satisfies ∣(π(h)y,y)∣<1−ε|(\pi(h)y, y)| < 1 - \varepsilon∣(π(h)y,y)∣<1−ε.

Formalization targets

Goal: Theorem 4.9

Let HHH have property (T), let SSS be a finite generating set of HHH with S=S−1S = S^{-1}S=S−1, and let ϕi:H→Ti\phi_i : H \to T_iϕi​:H→Ti​ be surjective homomorphisms onto finite groups with ∣Ti∣→∞|T_i| \to \infty∣Ti​∣→∞. Then there is one ε>0\varepsilon > 0ε>0 with

G(Ti,ϕi(S)) is a (∣Ti∣, ∣S∣, ε)-enlarger for every i with ∣Ti∣≥2.G(T_i, \phi_i(S)) \text{ is a } (|T_i|,\ |S|,\ \varepsilon)\text{-enlarger for every } i \text{ with } |T_i| \ge 2 .G(Ti​,ϕi​(S)) is a (∣Ti​∣, ∣S∣, ε)-enlarger for every i with ∣Ti​∣≥2.

The constant is unspecified: the theorem asserts uniformity in iii, not a value.

Milestones, in the order the paper's argument uses them

  1. Lemma 4.7. For any generating set SSS of a property (T) group there is ε>0\varepsilon > 0ε>0 such that every essentially nontrivial unitary representation and every unit vector yyy admit s∈Ss \in Ss∈S with ∣(π(s)y,y)∣<1−ε|(\pi(s)y,y)| < 1-\varepsilon∣(π(s)y,y)∣<1−ε.
  2. Proof of Lemma 4.8, essential nontriviality. For ϕ\phiϕ onto TTT, every nonzero vector of W={v:∑tvt=0}W = \{v : \sum_t v_t = 0\}W={v:∑t​vt​=0} is moved by some π(ϕ(h))\pi(\phi(h))π(ϕ(h)).
  3. Proof of Lemma 4.8, Rayleigh's principle. For the Cayley multigraph, min⁡{(Qy,y):y∈W, ∥y∥=1}=λ1(G)\min\{(Qy,y) : y \in W,\ \|y\| = 1\} = \lambda_1(G)min{(Qy,y):y∈W, ∥y∥=1}=λ1​(G).
  4. Lemma 4.8. With HHH, SSS and ε\varepsilonε as in Lemma 4.7, SSS finite and S=S−1S = S^{-1}S=S−1, and ϕ\phiϕ onto a finite group TTT, the Cayley graph G(T,ϕ(S))G(T,\phi(S))G(T,ϕ(S)) is a (∣T∣,∣S∣,ε)(|T|, |S|, \varepsilon)(∣T∣,∣S∣,ε)-enlarger.

Significance

Theorem 4.9 turns an analytic property of one infinite group into a uniform spectral bound for infinitely many finite graphs of fixed degree. With Theorem 4.3 of the paper it produces explicit families of linear expanders, hence of linear superconcentrators; for H=SL(n,Z)H = SL(n,\mathbb{Z})H=SL(n,Z), n≥3n \ge 3n≥3, and its reductions modulo iii the paper obtains infinitely many explicit families of (n,4,ε)(n, 4, \varepsilon)(n,4,ε)-enlargers. The same mechanism underlies later work on expanders from groups, surveyed in Lubotzky's monograph (Birkhäuser 1994).

The result is proved in the paper, modulo Lemma 4.7, which the paper refers to Margulis for. The formalization adds a checked account of every step, including Lemma 4.7 itself. At the pinned Mathlib revision there is no notion of property (T), of Kazhdan constants, or of the algebraic connectivity of a multigraph, and no machine-checked version of Theorem 4.9 is known on this platform.

Difficulty

The combinatorial and linear-algebra steps are routine; the substance is in two places. First, Lemma 4.7: Definition 4.6 supplies a constant for one finite set KKK, nothing in the definition relates KKK to a given generating set SSS, the paper gives no proof, and the standard references state the textbook form ∥π(h)y−y∥≥ε\|\pi(h)y - y\| \ge \varepsilon∥π(h)y−y∥≥ε rather than the paper's absolute-value form ∣(π(h)y,y)∣<1−ε|(\pi(h)y,y)| < 1-\varepsilon∣(π(h)y,y)∣<1−ε. Second, the uniformity: a spectral gap for each fixed quotient is easy, since a connected graph has λ1>0\lambda_1 > 0λ1​>0, but a bound that does not decay as ∣Ti∣→∞|T_i| \to \infty∣Ti​∣→∞ is exactly what cannot come from any finite computation and must come from property (T) through Lemma 4.8. The Rayleigh quotient of milestone 3 is taken over real vectors, while Lemma 4.7 is stated for complex Hilbert spaces.

Formalization scope

Groups are Lean types with a Group instance; the finite groups TTT carry Fintype and DecidableEq. Graphs are multigraphs given by symmetric matrices Matrix T T ℕ, with loops allowed. This matters: when ϕ\phiϕ identifies two generators or sends one to the identity, the degree is still ∣S∣|S|∣S∣, and a loop contributes 000 to QQQ. Mathlib's SimpleGraph Cayley graph forgets these multiplicities and is not used. λ1\lambda_1λ1​ is the second-smallest eigenvalue with multiplicity of the real symmetric matrix QQQ (via Matrix.IsHermitian.eigenvalues₀). It is defined spectrally, as in the paper, and not as a Rayleigh minimum. It is only meaningful for ∣T∣≥2|T| \ge 2∣T∣≥2, and the goal excludes trivial quotients explicitly. Unitary representations are homomorphisms into the unitary group of bounded operators on a complex Hilbert space in universe Type. Compact subsets of a discrete group are finite sets.

A trivializing formalization is ruled out. Property (T) is not replaced by the hypothesis that the regular representations of the quotients have no almost-invariant vectors, which would make Theorem 4.9 a restatement of its hypothesis. And λ1\lambda_1λ1​ is not defined as the minimum of (Qy,y)(Qy,y)(Qy,y) over zero-sum unit vectors, which would make milestone 3 true by definition.

A complete development needs basic Kazhdan-constant manipulations, Courant–Fischer for real symmetric matrices, and the regular representation of a finite group as a unitary representation. The regularity of Cayley multigraphs and the identity Q=∣S∣I−∑sπ(ϕ(s))Q = |S| I - \sum_s \pi(\phi(s))Q=∣S∣I−∑s​π(ϕ(s)) are short. The spectral and representation-theoretic lemmas are reusable beyond this mission. Contributions of intermediate lemmas, such as the variational characterization of eigenvalues₀ or the invariance of the zero-sum subspace, are welcome.

Selected references

  • N. Alon, V. D. Milman, λ1, Isoperimetric inequalities for graphs, and superconcentrators, J. Combin. Theory Ser. B 38 (1985) 73–88. https://doi.org/10.1016/0095-8956(85)90092-9
  • D. A. Kazhdan, Connection of the dual space of a group with the structure of its closed subgroups, Funct. Anal. Appl. 1 (1967) 63–65. https://doi.org/10.1007/BF01075866
  • G. A. Margulis, Explicit constructions of concentrators, Probl. Inf. Transm. 9 (1973) 325–332. http://mi.mathnet.ru/ppi1162
  • O. Gabber, Z. Galil, Explicit constructions of linear-sized superconcentrators, J. Comput. Syst. Sci. 22 (1981) 407–420. https://doi.org/10.1016/0022-0000(81)90040-4
  • M. Fiedler, Algebraic connectivity of graphs, Czech. Math. J. 23 (1973) 298–305. https://doi.org/10.21136/CMJ.1973.101168
  • A. Lubotzky, Discrete Groups, Expanding Graphs and Invariant Measures, Birkhäuser, 1994. https://doi.org/10.1007/978-3-0346-0332-4
  • B. Bekka, P. de la Harpe, A. Valette, Kazhdan's Property (T), Cambridge University Press, 2008. https://doi.org/10.1017/CBO9780511542749
  • S. Hoory, N. Linial, A. Wigderson, Expander graphs and their applications, Bull. AMS 43 (2006) 439–561. https://doi.org/10.1090/S0273-0979-06-01126-8
12 thms3 active usersReviewed
Operations ResearchProbabilityStochastic Systems·Captain: Shuze Chen

Processing Networks III: Fluid Model Stability Implies SPN StabilityTextbook

Motivation

A stochastic processing network (SPN) — buffers holding waiting work, activities that consume items from buffers and produce items into others, driven by stochastic arrivals and service requirements — is stable, in the sense of mission I's Definition 3.6, exactly when its ambient Markov chain is positive recurrent. That definition is correct, but it is a statement about an infinite-state continuous-time Markov chain, and Markov chains of that kind almost never admit a hand-computed stationary distribution or a directly verifiable positive-recurrence criterion for anything beyond the smallest examples. What is needed is a method that turns "is this specific queueing network, under this specific control policy, stable?" into a tractable, purely deterministic question. J. G. Dai and J. Michael Harrison's Processing Networks: Fluid Models and Stability (Cambridge University Press, forthcoming; cited here from the authors' pre-publication draft, 2020-4-2, http://spnbook.org) supplies exactly this method in Chapter 6, and the theorem that licenses it — Theorem 6.2 — is introduced by the authors themselves as "the fulcrum that supports all other results developed in this book." Every stability theorem in the remaining eight chapters of the book (feedforward and generalized Jackson networks, the Rybko–Stolyar boundary, back-pressure control, proportionally fair allocation, task allocation, packet networks) is an application of this one theorem to a model-specific fluid model.

The method traces to Rybko and Stolyar's 1992 study of a single two-station network and to J. G. Dai's 1995 unification of fluid-limit stability arguments across general queueing networks (Annals of Applied Probability 5, 49–77), with independent contemporaneous work by A. Stolyar for discrete state spaces and a parallel probabilistic route through reflecting Brownian motion due to Dupuis and Williams (1994). This mission formalizes the version of the argument specific to Dai and Harrison's general SPN framework.

Setting

Under a fixed control policy, an SPN with III buffers and JJJ activities generates four continuous-time processes: the cumulative departure process D(t)∈Z+ID(t) \in \mathbb{Z}_+^ID(t)∈Z+I​, the cumulative service-completion process F(t)∈Z+JF(t) \in \mathbb{Z}_+^JF(t)∈Z+J​, the cumulative service-effort process T(t)∈R+JT(t) \in \mathbb{R}_+^JT(t)∈R+J​, and the buffer-contents process Z(t)∈Z+IZ(t) \in \mathbb{Z}_+^IZ(t)∈Z+I​. The model's first-order data — the I×JI \times JI×J material-requirement matrix BBB, the I×JI \times JI×J expected-output matrix Γ\GammaΓ, the vector mmm of mean service times, the K×JK \times JK×J capacity-consumption matrix AAA, the KKK-vector bbb of server-pool capacities, and the vector λ\lambdaλ of external arrival rates — determine six basic relationships that Chapter 2 derives directly from the SPN's construction, and that this mission packages as IsFluidModelSolution.

To study scaling limits, Section 6.3 constructs, on one common probability space, a whole family of versions of the SPN's processes, one for each initial state xxx of the ambient chain: the superscripted Dx,Fx,Tx,ZxD^x, F^x, T^x, Z^xDx,Fx,Tx,Zx. Writing ∣x∣|x|∣x∣ for the total initial buffer content, the fluid-scaled processes are

(D^x,F^x,T^x,Z^x)(t,ω):=1∣x∣(Dx,Fx,Tx,Zx)(∣x∣t,ω),t≥0.\big(\hat D^x, \hat F^x, \hat T^x, \hat Z^x\big)(t,\omega) := \tfrac{1}{|x|}\big(D^x, F^x, T^x, Z^x\big)(|x|t, \omega), \qquad t \ge 0.(D^x,F^x,T^x,Z^x)(t,ω):=∣x∣1​(Dx,Fx,Tx,Zx)(∣x∣t,ω),t≥0.

A fluid limit path (Definition 6.6) is any limit of such a family, along a sequence of initial states with ∣xn∣→∞|x_n| \to \infty∣xn​∣→∞, uniform on compact time intervals (u.o.c.). A fluid model solution is any four-tuple satisfying the six equations above, whether or not it arises as an actual limit — a purely deterministic notion.

Formalization targets

Goal: Theorem 6.2 — fluid limit stability implies SPN stability

fluid limit of the SPN is stable⟹ambient Markov chain X is positive recurrent,\text{fluid limit of the SPN is stable} \quad\Longrightarrow\quad \text{ambient Markov chain } X \text{ is positive recurrent},fluid limit of the SPN is stable⟹ambient Markov chain X is positive recurrent,

where "fluid limit... is stable" (Definition 6.1) means: there is γ>0\gamma > 0γ>0 such that every fluid limit path (D^,F^,T^,Z^)(\hat D, \hat F, \hat T, \hat Z)(D^,F^,T^,Z^) has Z^(t)=0\hat Z(t) = 0Z^(t)=0 for all t≥γ∣Z^(0)∣t \ge \gamma |\hat Z(0)|t≥γ∣Z^(0)∣. This is the weakest possible target: it asserts only that fluid limit paths are eventually driven to zero, with no rate or further structure attached, and it is exactly the hypothesis every later chapter's Lyapunov argument is built to establish.

Supporting milestones

Theorem 6.5 (existence of fluid limits): along any sequence of initial states with ∣xn∣→∞|x_n| \to \infty∣xn​∣→∞, the fluid-scaled processes have a u.o.c.-convergent subsequence, and every such limit is automatically a fluid model solution — the bridge from the purely equational Definition 6.3 (used by every later chapter) to the genuinely stochastic Definition 6.1 (needed by this theorem). Its proof rests on two convergence lemmas (6.7: compactness of the scaled service-effort process via an equicontinuity argument; 6.8: the scaled completion process converges exactly when the scaled effort process does) and, behind Lemma 6.8, a uniform strong law of large numbers for a "delayed" random walk (Lemma 6.9). A separate uniform-integrability result (Lemma 6.10) supplies the remaining ingredient the goal theorem's proof needs to convert an almost-sure fluid-scale limit into the expectation bound mission I's Lemma 3.7 requires.

Significance

The result itself. Theorem 6.2 converts a probabilistic stability question about an infinite-state Markov chain into a real-analysis question about a deterministic dynamical system: does every solution of a fixed, checkable system of equations reach zero in finite time, uniformly in its starting size? Every one of the book's remaining eight chapters answers a version of this question for a specific policy and concludes SPN stability via this theorem alone — none of them re-derives positive recurrence directly.

Formalizing it. No prior formalization of fluid limits, fluid models, or scaling-limit stability of any stochastic system exists on Prove2Me (q=fluid limit, q=fluid model, q=u.o.c. convergence, q=queueing network stability all return zero hits). This mission is a from-scratch formalization of the model data, the fluid equations, the per-state process family, and the two notions of fluid stability, together with the five supporting results and the goal theorem that connects them — the shared infrastructure the rest of the fourteen-mission series depends on.

Difficulty

The obvious shortcut — state Theorem 6.2 using fluid model stability (Definition 6.3, the purely equational notion) in place of fluid limit stability (Definition 6.1) — would produce a strictly easier, unfaithful theorem: fluid model solutions are not restricted to arise as actual scaling limits, so the genuine content of Theorem 6.2 (that convergence of a stochastic family forces a probabilistic conclusion) would be lost, and the theorem would reduce to a tautology once Theorem 6.5 is assumed. The two notions are visually almost identical in the book's own text ("γ∣Z^(0)∣\gamma|\hat Z(0)|γ∣Z^(0)∣-attraction to the origin," applied to two different objects) and keeping them distinct is this mission's central discipline. A second difficulty is that Mathlib has no existing theory of stochastic-process scaling limits, u.o.c. convergence, or the specific renewal/SLLN machinery (Lemma 6.9's uniform strong law for a state-dependent "delayed" random walk) the proof needs — every one of these had to be defined from the ground up rather than instantiated from a general framework.

Formalization scope

The ambient chain's state space is an arbitrary countable type, following mission 01; the per-state process family SPNProcessFamily takes Dx,Fx,Tx,ZxD^x, F^x, T^x, Z^xDx,Fx,Tx,Zx as given real-valued functions satisfying exactly the pathwise properties (Eqs. 2.31–2.32) that Section 6.4's proofs use, since Chapter 2's construction of these processes from primitive stochastic elements is that chapter's own "recap" of already-established facts, not a numbered result of Chapter 6. UOCConverges is stated by its direct ε\varepsilonε-NNN-on-every-compact-interval meaning, and Lemma 6.9's "sup⁡x\sup_xsupx​" is likewise stated by its direct ε\varepsilonε-NNN meaning rather than a Lean supremum expression, because the state space may be countably infinite and an explicit supremum over an unbounded-above family of reals would silently collapse to a junk value of zero in that case — a real risk of trivializing the statement that this formalization avoids outright. A formalization that reused FluidModelStable as the goal theorem's hypothesis, or that dropped ∣Z^(0)∣=1|\hat Z(0)|=1∣Z^(0)∣=1 from Theorem 6.5, would each be a trivializing shortcut of exactly the kind ruled out above. The five definitions (FluidEquationData, IsFluidModelSolution, SPNProcessFamily, FluidLimitPath, FluidLimitStable) are the primary reusable contribution — the shared vocabulary every later mission in the series restates in its own namespace, since drafts do not import one another. Contributions completing the six by sorry proofs are welcome.

Selected references

  • J. G. Dai and J. Michael Harrison, Processing Networks: Fluid Models and Stability, Cambridge University Press (forthcoming), pre-publication draft 2020-4-2. http://spnbook.org
  • J. G. Dai, "On positive Harris recurrence of multiclass queueing networks: a unified approach via fluid limit models," Annals of Applied Probability 5 (1995), 49–77.
  • A. N. Rybko and A. L. Stolyar, "Ergodicity of stochastic processes describing the operation of open queueing networks," Problemy Peredachi Informatsii 28 (1992), 3–26.
  • P. Dupuis and R. J. Williams, "Lyapunov functions for semimartingale reflecting Brownian motions," Annals of Probability 22 (1994), 680–702.
11 thms3 active usersReviewed
PreviousNext

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me