Prove2Me
Navigate
DiscoverFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Operations Research

889 missions · 513 completed

The discipline of applying mathematical analysis to complex decision problems in operations: allocating scarce resources, scheduling, routing, inventory, and the design of service and production systems. Drawing on mathematical programming, stochastic modeling, queueing, simulation, and game-theoretic reasoning, it seeks policies that perform provably well in systems shaped by constraints, congestion, and uncertainty.

Missions

Open376Completed513All889
🏆Completed
CombinatoricsGraph Theory·Captain: mikedeng1

λ1, Isoperimetric Inequalities for Graphs, and Superconcentrators 1: A Diameter Bound from λ1Research Paper

Motivation

The eigenvalues of the Laplacian of a graph carry metric information about the graph. The second-smallest one, λ1(G)\lambda_1(G)λ1​(G), was named the algebraic connectivity by Fiedler (Fiedler 1973), who showed it is positive exactly for connected graphs. N. Alon and V. D. Milman (J. Combin. Theory Ser. B 38 (1985) 73–88) showed that a large λ1\lambda_1λ1​ also forces two further properties: small diameter and a concentration of measure phenomenon, in which almost every vertex is close to any set containing half the vertices. They used these facts to build explicit expanders and superconcentrators, which are sparse networks with strong connectivity guarantees used in the theory of computation and in communication network design.

This mission covers Section 2 of that paper, "The Main Tools": the edge-count inequality (Lemma 2.1), the isoperimetric inequalities (Theorems 2.5 and 2.6), and the resulting diameter bound (Theorem 2.7).

Timeline:

  • 1973: Fiedler introduces λ1(G)\lambda_1(G)λ1​(G) as algebraic connectivity and proves λ1≤nn−1min⁡vd(v)\lambda_1 \le \frac{n}{n-1}\min_v d(v)λ1​≤n−1n​minv​d(v).
  • 1985: Alon and Milman prove the isoperimetric and diameter bounds of Section 2.
  • 1986: Alon proves the converse direction, that edge expansion implies a spectral gap (Alon 1986).
  • Later work sharpened the constant in the diameter bound, e.g. Chung 1989.

Setting

Let G=(V,E)G = (V, E)G=(V,E) be a finite, connected, simple graph on n=∣V∣≥2n = |V| \ge 2n=∣V∣≥2 vertices. Write d(v)d(v)d(v) for the degree of a vertex vvv, d=max⁡vd(v)d = \max_v d(v)d=maxv​d(v) for the maximum degree, and AGA_GAG​ for the adjacency matrix. The Laplacian is the V×VV \times VV×V matrix

Q=QG=diag⁡(d(v))v∈V−AG.Q = Q_G = \operatorname{diag}(d(v))_{v \in V} - A_G .Q=QG​=diag(d(v))v∈V​−AG​.

For real functions fff on VVV with scalar product (f,g)=∑vf(v)g(v)(f, g) = \sum_v f(v)g(v)(f,g)=∑v​f(v)g(v), the quadratic form of QQQ is (Qf,f)=∑{u,v}∈E(f(u)−f(v))2≥0(Qf, f) = \sum_{\{u,v\} \in E} (f(u) - f(v))^2 \ge 0(Qf,f)=∑{u,v}∈E​(f(u)−f(v))2≥0. The eigenvalues of QQQ, counted with multiplicity, are real and are written 0=λ0≤λ1≤⋯≤λn−10 = \lambda_0 \le \lambda_1 \le \dots \le \lambda_{n-1}0=λ0​≤λ1​≤⋯≤λn−1​. The algebraic connectivity λ1=λ1(G)\lambda_1 = \lambda_1(G)λ1​=λ1​(G) is the second-smallest of them.

For vertices u,vu, vu,v, dist⁡(u,v)\operatorname{dist}(u, v)dist(u,v) is the number of edges of a shortest path from uuu to vvv. For disjoint vertex sets A,BA, BA,B the paper writes ρ\rhoρ for the distance between them, a=∣A∣/na = |A|/na=∣A∣/n and b=∣B∣/nb = |B|/nb=∣B∣/n for their relative sizes, and EAE_AEA​ (EBE_BEB​) for the set of edges with both endpoints in AAA (in BBB). [x][x][x] denotes the integer part of x≥0x \ge 0x≥0.

Formalization targets

Goal: Theorem 2.7 (p. 79)

dist⁡(u,v)  ≤  2[2d/λ1 log⁡2n]for all u,v∈V.\operatorname{dist}(u, v) \;\le\; 2\left[\sqrt{2d/\lambda_1}\,\log_2 n\right] \qquad\text{for all } u, v \in V.dist(u,v)≤2[2d/λ1​​log2​n]for all u,v∈V.

Milestones, in the order the proof uses them

  1. Section 2, p. 76: 0=λ0<λ10 = \lambda_0 < \lambda_10=λ0​<λ1​ for connected GGG.
  2. Eq. (2.1), Rayleigh's principle: if ∑vf(v)=0\sum_v f(v) = 0∑v​f(v)=0 then (Qf,f)≥λ1∥f∥2(Qf, f) \ge \lambda_1 \|f\|^2(Qf,f)≥λ1​∥f∥2.
  3. Lemma 2.1: for nonempty A,BA, BA,B at distance ρ≥1\rho \ge 1ρ≥1,
λ1n≤1ρ2(1a+1b)(∣E∣−∣EA∣−∣EB∣).\lambda_1 n \le \frac{1}{\rho^2}\Big(\frac1a + \frac1b\Big)\big(|E| - |E_A| - |E_B|\big).λ1​n≤ρ21​(a1​+b1​)(∣E∣−∣EA​∣−∣EB​∣).
  1. Remark 2.3: λ1≤nn−1min⁡vd(v)\lambda_1 \le \frac{n}{n-1}\min_v d(v)λ1​≤n−1n​minv​d(v).
  2. Theorem 2.5: if ρ>1\rho > 1ρ>1 then
b≤1−a1+(λ1/d) aρ2.b \le \frac{1-a}{1 + (\lambda_1/d)\,a\rho^2}.b≤1+(λ1​/d)aρ21−a​.
  1. Theorem 2.6: if every AAA–BBB distance exceeds a real ρ≥1\rho \ge 1ρ≥1, then
b≤(1−a)exp⁡ ⁣(−ln⁡(1+2a)[λ1/(2d) ρ]).b \le (1-a)\exp\!\Big(-\ln(1+2a)\Big[\sqrt{\lambda_1/(2d)}\,\rho\Big]\Big).b≤(1−a)exp(−ln(1+2a)[λ1​/(2d)​ρ]).

Each statement keeps the paper's explicit constants. The goal is the endpoint of this chain and the paper's headline graph-theoretic bound.

Significance

Theorem 2.7 gives, for any family of graphs of bounded maximum degree whose algebraic connectivity stays bounded away from zero, a diameter of order log⁡n\log nlogn. By the paper's Remark 2.8, the 4-regular graphs constructed in its Section 4 show that this order cannot be improved. Theorem 2.6 is a discrete concentration of measure inequality: the proportion of vertices at distance more than ρ\rhoρ from a set of relative size aaa decays exponentially in ρλ1/(2d)\rho\sqrt{\lambda_1/(2d)}ρλ1​/(2d)​. It is the graph analogue of the Gromov–Milman concentration for manifolds, and Section 3 of the paper applies it to cubes and other product graphs. Theorem 2.5 is the input for the construction of expanders from graphs with a spectral gap (Theorem 4.3 of the paper).

All results are proved in the paper, and the formal work here is a machine-checked version of known proofs. As far as could be determined, none of the four inequalities (Lemma 2.1, Theorems 2.5–2.7) has been formalized in Lean or elsewhere. Mathlib has the Laplacian matrix, its positive semidefiniteness, and the relation between its kernel and connected components, but no statement about its second eigenvalue. The spectral facts (milestones 1–2), stated for Mathlib's Matrix.IsHermitian.eigenvalues₀, are reusable for any future work on algebraic connectivity.

Difficulty

The combinatorial steps are short. The work is at the interface between the spectral definition and the quadratic form. Mathlib defines eigenvalues through the spectral theorem for a Hermitian matrix, sorted into a list. Obtaining Rayleigh's principle for the second eigenvalue from that list, with the constant functions as the eigenvector of λ0=0\lambda_0 = 0λ0​=0, takes a Courant–Fischer-type argument over an orthonormal eigenbasis. It does not follow from positive semidefiniteness alone. Strict positivity of λ1\lambda_1λ1​ additionally needs that the kernel of QQQ is one-dimensional for a connected graph.

Theorem 2.6 iterates Theorem 2.5 over a sequence of neighbourhoods {v:dist⁡(v,A)≤jμ}\{v : \operatorname{dist}(v, A) \le j\mu\}{v:dist(v,A)≤jμ} with a real step length μ\muμ, so it needs bookkeeping of integer parts and of real-valued distance thresholds. Theorem 2.7 then combines Theorem 2.6 with Remark 2.3 and needs the estimate 12 2−[log⁡2n]<1/n\tfrac12\, 2^{-[\log_2 n]} < 1/n21​2−[log2​n]<1/n with the integer part kept. Replacing [⋅][\cdot][⋅] by the real number inside it changes the statement.

Formalization scope

  • Graphs are Mathlib SimpleGraph V on a Fintype vertex type with decidable adjacency. Every item assumes G.Connected and 2≤∣V∣2 \le |V|2≤∣V∣ (the goal writes 1<∣V∣1 < |V|1<∣V∣, as the paper does).
  • QQQ is G.lapMatrix ℝ. λ1\lambda_1λ1​ is the mission definition AlonMilman.Diameter.lambda1: the eigenvalue at index n−2n-2n−2 of eigenvalues₀, which lists the eigenvalues in decreasing order. It is 000 by convention when n<2n < 2n<2, a case no theorem uses.
  • λ1\lambda_1λ1​ is defined spectrally. Defining it as the best constant in Eq. (2.1) would make Rayleigh's principle definitional and remove the spectral content of the mission, so that formalization is excluded. Likewise the goal quantifies over all pairs of vertices of a connected graph and does not use SimpleGraph.diam without connectivity, since that is 000 for a disconnected graph.
  • Distances are SimpleGraph.dist (a natural number). "The distance between AAA and BBB is ρ\rhoρ" is encoded as ρ≤dist⁡(u,v)\rho \le \operatorname{dist}(u, v)ρ≤dist(u,v) for all u∈Au \in Au∈A, v∈Bv \in Bv∈B. Because the bounds weaken as ρ\rhoρ decreases, this is equivalent to the paper's exact distance. In Theorem 2.6 ρ\rhoρ is real and the hypothesis is strict.
  • EAE_AEA​ is AlonMilman.Diameter.edgesWithin G A. All counts are cast to R\mathbb RR before subtraction, a=∣A∣/na = |A|/na=∣A∣/n is a real quotient, [x][x][x] is Nat.floor, log⁡2\log_2log2​ is Real.logb 2, and ln⁡\lnln is Real.log.
  • Lemma 2.1 requires A,BA, BA,B nonempty (so a,b>0a, b > 0a,b>0). Theorems 2.5 and 2.6 hold as stated for empty sets and carry no such hypothesis.

Contributions welcome: proofs of any milestone, and in particular general Mathlib-style lemmas for Rayleigh quotients and eigenvalues₀, which have uses beyond this mission.

Selected references

  • N. Alon, V. D. Milman, λ1, isoperimetric inequalities for graphs, and superconcentrators, J. Combin. Theory Ser. B 38 (1985) 73–88. https://doi.org/10.1016/0095-8956(85)90092-9
  • M. Fiedler, Algebraic connectivity of graphs, Czechoslovak Math. J. 23 (1973) 298–305. https://doi.org/10.21136/CMJ.1973.101168
  • N. Alon, Eigenvalues and expanders, Combinatorica 6 (1986) 83–96. https://doi.org/10.1007/BF02579166
  • F. R. K. Chung, Diameters and eigenvalues, J. Amer. Math. Soc. 2 (1989) 187–196. https://doi.org/10.1090/S0894-0347-1989-0965008-X
9 thms3 active usersReviewed
🏆Completed
Control TheoryDynamic ProgrammingOptimization·Captain: mikedeng1

Robust Control of Markov Decision Processes with Uncertain Transition Matrices 3: Stationary Policies Suffice and the Stationary/Time-Varying Uncertainty Gap Vanishes GeometricallyResearch Paper

Motivation

A Markov decision process (MDP) is controlled with transition probabilities estimated from data, and optimal policies computed for the estimated model can perform badly when the estimates are off. Robust MDPs replace the single transition model by a set of models and optimize the worst case over that set. Two readings of "the set" are possible. In the stationary uncertainty model, the unknown transition matrices are fixed but unknown; this is the reading that confidence regions from statistics support, but the resulting min–max problem is hard to solve. In the time-varying uncertainty model, an adversary ("nature") may pick different matrices at every stage; this relaxation is solved exactly by robust dynamic programming. Nilim and El Ghaoui (Oper. Res. 2005) solve the second problem in place of the first, and Theorem 4 of their paper justifies the substitution for discounted costs: in the infinite horizon the two readings, and the restriction to stationary controllers, all give the same value, and in the finite horizon the two readings differ by an amount that decays geometrically in the horizon.

Timeline:

  • 1973: Satia and Lave study MDPs with uncertain transition probabilities (Oper. Res. 21).
  • 1994: Puterman's monograph collects the nominal theory, including the optimality of stationary deterministic policies for discounted finite MDPs (Wiley).
  • 2001: Bagnell, Ng and Schneider state a robust Bellman recursion for stationary games without proof (CMU-RI-TR-01-25).
  • 2005: Iyengar (Math. Oper. Res. 30) and Nilim and El Ghaoui independently prove the robust Bellman recursion under rectangular uncertainty; Nilim and El Ghaoui add Theorem 4.
  • 2013: Wiesemann, Kuhn and Rustem extend robust MDPs beyond rectangular sets (Math. Oper. Res. 38).

Setting

States form a finite set X={0,…,n−1}\mathcal X = \{0,\dots,n-1\}X={0,…,n−1} and actions a finite nonempty set A\mathcal AA. A stage cost c(i,a)≥0c(i,a)\ge 0c(i,a)≥0 is given for every state and action, together with a discount factor 0<ν<10<\nu<10<ν<1 and an initial state i0i_0i0​. For every action aaa and state iii a nonempty set Pia\mathcal P_i^aPia​ of probability vectors in the simplex Δn\Delta_nΔn​ is given: the possible rows of the transition matrix PaP^aPa. Rectangularity means that every row is chosen independently: one stage of nature is a family (Pa)a∈A(P^a)_{a\in\mathcal A}(Pa)a∈A​ with iii-th row of PaP^aPa in Pia\mathcal P_i^aPia​, and the set of such families is Q\mathcal QQ.

A controller policy π=(a0,a1,… )\pi=(\mathbf a_0,\mathbf a_1,\dots)π=(a0​,a1​,…) assigns an action at(i)\mathbf a_t(i)at​(i) to each state at each stage; the set of all of them is Π\PiΠ, and the stationary ones (the same map at every stage) form Πs\Pi_sΠs​. A nature policy τ=(Pta)\tau=(P_t^a)τ=(Pta​) picks one element of Q\mathcal QQ per stage; the set is T\mathcal TT, and the stationary ones form Ts\mathcal T_sTs​. Starting from μ0=ei0\mu_0 = e_{i_0}μ0​=ei0​​, the state law evolves by μt+1(j)=∑iμt(i)Ptat(i)(i,j)\mu_{t+1}(j)=\sum_i \mu_t(i)P_t^{\mathbf a_t(i)}(i,j)μt+1​(j)=∑i​μt​(i)Ptat​(i)​(i,j). The discounted costs over horizon NNN and over the infinite horizon are

CN(π,τ)=∑t=0N−1νt∑iμt(i) c(i,at(i)),C∞(π,τ)=lim⁡N→∞CN(π,τ).C_N(\pi,\tau)=\sum_{t=0}^{N-1}\nu^t\sum_i\mu_t(i)\,c(i,\mathbf a_t(i)),\qquad C_\infty(\pi,\tau)=\lim_{N\to\infty}C_N(\pi,\tau).CN​(π,τ)=t=0∑N−1​νti∑​μt​(i)c(i,at​(i)),C∞​(π,τ)=N→∞lim​CN​(π,τ).

For a controller class C∈{Π,Πs}\mathcal C\in\{\Pi,\Pi_s\}C∈{Π,Πs​} and a nature class S∈{T,Ts}\mathcal S\in\{\mathcal T,\mathcal T_s\}S∈{T,Ts​} the robust values are ϕ∞(C,S)=inf⁡π∈Csup⁡τ∈SC∞(π,τ)\phi_\infty(\mathcal C,\mathcal S)=\inf_{\pi\in\mathcal C}\sup_{\tau\in\mathcal S}C_\infty(\pi,\tau)ϕ∞​(C,S)=infπ∈C​supτ∈S​C∞​(π,τ) and ϕN(Π,S)=inf⁡π∈Πsup⁡τ∈SCN(π,τ)\phi_N(\Pi,\mathcal S)=\inf_{\pi\in\Pi}\sup_{\tau\in\mathcal S}C_N(\pi,\tau)ϕN​(Π,S)=infπ∈Π​supτ∈S​CN​(π,τ). Finally cmax⁡=max⁡i,ac(i,a)c_{\max}=\max_{i,a}c(i,a)cmax​=maxi,a​c(i,a) and εN=νNcmax⁡/(1−ν)\varepsilon_N=\nu^Nc_{\max}/(1-\nu)εN​=νNcmax​/(1−ν).

Formalization targets

Goal: Theorem 4 (p. 786)

ϕ∞(Π,T)=ϕ∞(Πs,Ts)=ϕ∞(Πs,T)=ϕ∞(Π,Ts),\phi_\infty(\Pi,\mathcal T)=\phi_\infty(\Pi_s,\mathcal T_s)=\phi_\infty(\Pi_s,\mathcal T)=\phi_\infty(\Pi,\mathcal T_s),ϕ∞​(Π,T)=ϕ∞​(Πs​,Ts​)=ϕ∞​(Πs​,T)=ϕ∞​(Π,Ts​), 0≤ϕN(Π,T)−ϕN(Π,Ts)≤νNcmax⁡1−νfor every N.0\le \phi_N(\Pi,\mathcal T)-\phi_N(\Pi,\mathcal T_s)\le \frac{\nu^N c_{\max}}{1-\nu}\quad\text{for every }N .0≤ϕN​(Π,T)−ϕN​(Π,Ts​)≤1−ννNcmax​​for every N.

The second line is the paper's "the gap goes to zero at a geometric rate ν\nuν", with the constant the paper's own argument produces.

Milestones (proof order of the paper)

  1. Eq. (34): CN(π,τ)≤C∞(π,τ)≤CN(π,τ)+εNC_N(\pi,\tau)\le C_\infty(\pi,\tau)\le C_N(\pi,\tau)+\varepsilon_NCN​(π,τ)≤C∞​(π,τ)≤CN​(π,τ)+εN​ for all π∈Π\pi\in\Piπ∈Π, τ∈T\tau\in\mathcal Tτ∈T, NNN.
  2. Eq. (35): ϕN(Π,T)≤ϕ∞(Π,T)≤ϕN(Π,T)+εN\phi_N(\Pi,\mathcal T)\le\phi_\infty(\Pi,\mathcal T)\le\phi_N(\Pi,\mathcal T)+\varepsilon_NϕN​(Π,T)≤ϕ∞​(Π,T)≤ϕN​(Π,T)+εN​.
  3. Step (e): the same sandwich for ϕN(Π,Ts)\phi_N(\Pi,\mathcal T_s)ϕN​(Π,Ts​) and ϕ∞(Π,Ts)\phi_\infty(\Pi,\mathcal T_s)ϕ∞​(Π,Ts​).
  4. Eq. (33): for every ε>0\varepsilon>0ε>0 and all large NNN, ϕ∞(Πs,Ts)−ε≤ϕN(Π,T)≤ϕ∞(Πs,Ts)\phi_\infty(\Pi_s,\mathcal T_s)-\varepsilon\le\phi_N(\Pi,\mathcal T)\le\phi_\infty(\Pi_s,\mathcal T_s)ϕ∞​(Πs​,Ts​)−ε≤ϕN​(Π,T)≤ϕ∞​(Πs​,Ts​).
  5. Step (c): for every stationary π\piπ, sup⁡τ∈TC∞(π,τ)=sup⁡τ∈TsC∞(π,τ)\sup_{\tau\in\mathcal T}C_\infty(\pi,\tau)=\sup_{\tau\in\mathcal T_s}C_\infty(\pi,\tau)supτ∈T​C∞​(π,τ)=supτ∈Ts​​C∞​(π,τ), hence ϕ∞(Πs,T)=ϕ∞(Πs,Ts)\phi_\infty(\Pi_s,\mathcal T)=\phi_\infty(\Pi_s,\mathcal T_s)ϕ∞​(Πs​,T)=ϕ∞​(Πs​,Ts​).
  6. Step (d), nominal fact: for stationary τ\tauτ, inf⁡π∈ΠCN(π,τ)→inf⁡π∈ΠsC∞(π,τ)\inf_{\pi\in\Pi}C_N(\pi,\tau)\to\inf_{\pi\in\Pi_s}C_\infty(\pi,\tau)infπ∈Π​CN​(π,τ)→infπ∈Πs​​C∞​(π,τ).
  7. Step (d): ϕ∞(Π,Ts)=ϕ∞(Πs,Ts)\phi_\infty(\Pi,\mathcal T_s)=\phi_\infty(\Pi_s,\mathcal T_s)ϕ∞​(Π,Ts​)=ϕ∞​(Πs​,Ts​).

Significance

The first half of Theorem 4 says that, for discounted robust MDPs with rectangular uncertainty, nothing is gained by either player from non-stationary behaviour: the controller may restrict itself to stationary deterministic policies and nature's time variation buys it nothing. This is what makes the stationary game (6), solved by the robust Bellman recursion of Theorem 3, the right infinite-horizon object. The second half is a quantitative guarantee for practitioners: solving the tractable time-varying problem (4) instead of the statistically motivated but hard stationary problem (3) costs at most νNcmax⁡/(1−ν)\nu^Nc_{\max}/(1-\nu)νNcmax​/(1−ν) in value.

The result is proved on paper. As far as a search of the platform shows (September 2026), no robust MDP result has a machine-checked proof here; the nominal counterpart, optimality of stationary policies for discounted finite MDPs, is on the platform as BertsekasDP.discounted_main_theorem in a different model encoding (state-dependent control sets). A complete development contributes a reusable encoding of robust MDPs with time-varying and stationary adversaries, the truncation estimates for discounted costs, and a formal record of one step whose printed argument is incomplete (Step (d), see Difficulty).

Difficulty

The truncation estimates (34), (35) and Step (e) are elementary. The equalities in (31) are not: they compare values of games whose players have infinite-dimensional strategy sets, and the paper writes "min" and "max" where the infima and suprema need not be attained, since the row sets are neither closed nor convex. Two steps of the printed proof rely on results the mission does not import. Step (a) identifies ϕN(Π,T)\phi_N(\Pi,\mathcal T)ϕN​(Π,T) with iterates of the robust Bellman recursion, which is Theorems 1 and 3 of the paper (formalized in sibling missions of this series). Step (c) says only "following similar steps as in Step (a)". Step (d) is incomplete as printed: it shows that for each fixed stationary nature the controller's best time-varying and best stationary responses agree, which is a statement about a max–min value, whereas ϕ∞(Π,Ts)\phi_\infty(\Pi,\mathcal T_s)ϕ∞​(Π,Ts​) is a min–max value. The obvious attempt to exchange the infimum over Π\PiΠ with the supremum over Ts\mathcal T_sTs​ from that per-nature fact alone fails; the exchange requires a duality statement for the stationary game.

Formalization scope

States are Fin n; the action type is finite and nonempty. The row sets are an arbitrary family rows a i ⊆ stdSimplex ℝ (Fin n) with each set nonempty; nonemptiness is implicit in the paper and explicit here, and no convexity or closedness is assumed. A stage of nature is the subtype of families A → Fin n → (Fin n → ℝ) whose rows lie in the given sets, so rectangularity is built in. Controller policies are sequences ℕ → Fin n → A, nature policies sequences of stage choices; stationary policies of either player are the constant sequences. CNC_NCN​ is defined from the forward state distribution (not from a Bellman recursion) and reads only stages <N<N<N, so the finite-horizon values over infinite sequences are exactly the paper's values (3) and (4) with stage costs νtc\nu^tcνtc and zero terminal cost. C∞C_\inftyC∞​ is the sum of the series of nonnegative stage costs, which converges for 0≤ν<10\le\nu<10≤ν<1 and equals lim⁡NCN\lim_N C_NlimN​CN​. Every min and max of the paper is a real infimum ⨅ or supremum ⨆; all families are nonempty and lie in [0,cmax⁡/(1−ν)][0,c_{\max}/(1-\nu)][0,cmax​/(1−ν)], and attainment is not assumed anywhere. The discount factor satisfies 0<ν<10<\nu<10<ν<1, as in §4 of the paper.

The rate in the goal is the explicit bound νNcmax⁡/(1−ν)\nu^Nc_{\max}/(1-\nu)νNcmax​/(1−ν); a formalization stating only that the gap tends to zero, or stating (31) with the infinite-horizon cost replaced by a Bellman fixed point, proves a different theorem and is not accepted.

A complete development needs: the stochastic-matrix facts for the forward distribution, geometric-series bounds, robust value iteration for the time-varying and the stationary adversary, and nominal stationarity of discounted MDPs. The model and truncation estimates are reusable for any discounted robust MDP result. Contributions of any milestone, and of proofs of Step (c) and Step (d) by any route, are welcome.

Selected references

  • A. Nilim, L. El Ghaoui, Robust Control of Markov Decision Processes with Uncertain Transition Matrices, Operations Research 53(5):780–798, 2005. https://doi.org/10.1287/opre.1050.0216
  • G. N. Iyengar, Robust Dynamic Programming, Mathematics of Operations Research 30(2):257–280, 2005. https://doi.org/10.1287/moor.1040.0129
  • M. L. Puterman, Markov Decision Processes: Discrete Stochastic Dynamic Programming, Wiley, 1994. https://doi.org/10.1002/9780470316887
  • J. K. Satia, R. E. Lave, Markovian Decision Processes with Uncertain Transition Probabilities, Operations Research 21(3):728–740, 1973. https://doi.org/10.1287/opre.21.3.728
  • J. A. Bagnell, A. Y. Ng, J. Schneider, Solving Uncertain Markov Decision Processes, Technical Report CMU-RI-TR-01-25, Carnegie Mellon University, 2001.
  • W. Wiesemann, D. Kuhn, B. Rustem, Robust Markov Decision Processes, Mathematics of Operations Research 38(1):153–183, 2013. https://doi.org/10.1287/moor.1120.0566
10 thms3 active usersReviewed
🏆Completed
CombinatoricsGraph TheoryTheoretical Computer Science·Captain: mikedeng1

A Linear-Time Algorithm for Finding a Sparse k-Connected Spanning Subgraph of a k-Connected Graph 2: FOREST's Forests E_i Preserve Local Node-Connectivity up to i in a Simple GraphResearch Paper

Motivation

Given a kkk-connected graph, many connectivity algorithms run in time that grows with the number of edges ∣E∣|E|∣E∣. A sparse certificate is a spanning subgraph with only O(k∣V∣)O(k|V|)O(k∣V∣) edges that is still kkk-connected; computing one first and running the expensive algorithm on it replaces ∣E∣|E|∣E∣ by k∣V∣k|V|k∣V∣ in the bound. Finding a kkk-connected spanning subgraph with the minimum number of edges is NP-complete for every fixed k≥2k \ge 2k≥2 (Garey and Johnson, problem GT31), so the question is how cheaply a sparse, not necessarily minimum, certificate can be found.

Nagamochi and Ibaraki (Algorithmica 7 (1992) 583–596) answered this with a single linear-time scanning procedure, FOREST, which partitions the edges into classes E1,E2,…,E∣E∣E_1, E_2, \dots, E_{|E|}E1​,E2​,…,E∣E∣​. They showed that the prefix unions E1∪⋯∪EkE_1 \cup \dots \cup E_kE1​∪⋯∪Ek​ are certificates for edge-connectivity and, for simple graphs, for node-connectivity. The node-connectivity result is the subject of this mission; the edge-connectivity result is the preceding mission of this series.

Timeline:

  • 1980: Galil gives an algorithm testing κ(G)≥k\kappa(G) \ge kκ(G)≥k whose running time depends on ∣E∣|E|∣E∣ (SIAM J. Comput. 9).
  • Before 1992 (as cited on p. 583): Suzuki et al. give O(∣E∣)O(|E|)O(∣E∣)-time algorithms for sparse 2- and 3-node-connected spanning subgraphs; Nishizeki and Poljak find, for general kkk, a kkk-node-connected spanning subgraph with at most k(∣V∣−1)k(|V|-1)k(∣V∣−1) edges in O(∣V∣1/2∣E∣2)O(|V|^{1/2}|E|^2)O(∣V∣1/2∣E∣2) time.
  • 1992: Nagamochi and Ibaraki prove that FOREST, which runs in O(∣V∣+∣E∣)O(|V| + |E|)O(∣V∣+∣E∣) time, yields a kkk-node-connected spanning subgraph GkG_kGk​ of every simple kkk-node-connected graph, with ∣E(Gk)∣≤k∣V∣−k(k+1)/2|E(G_k)| \le k|V| - k(k+1)/2∣E(Gk​)∣≤k∣V∣−k(k+1)/2. Their Theorem 3.1 states a stronger, local form.
  • 1993: Cheriyan, Kao and Thurimella isolate "scan-first search" as the general principle behind such certificates (SIAM J. Comput. 22 (1993)).

Setting

A graph G=(V,E)G = (V, E)G=(V,E) has a finite node set VVV with ∣V∣≥2|V| \ge 2∣V∣≥2 and a finite edge set EEE; each edge has an unordered pair of two distinct end nodes. In this mission the graph is simple: no two edges have the same end nodes. For F⊆EF \subseteq EF⊆E, (V,F)(V, F)(V,F) is the spanning subgraph with edge set FFF.

The local node-connectivity κ(x,y;H)\kappa(x, y; H)κ(x,y;H) of nodes x,yx, yx,y in a graph HHH on VVV is ∣V∣−1|V| - 1∣V∣−1 if xxx and yyy are adjacent in HHH, and otherwise the minimum size of a node set W⊆V−{x,y}W \subseteq V - \{x, y\}W⊆V−{x,y} whose deletion leaves no xxx–yyy path. The node connectivity is κ(G)=min⁡x,yκ(x,y;G)\kappa(G) = \min_{x, y} \kappa(x, y; G)κ(G)=minx,y​κ(x,y;G).

Procedure FOREST keeps a label r(v)≥0r(v) \ge 0r(v)≥0 on each node, initially 000. While some node is unscanned, it chooses an unscanned node xxx of largest label; for each unscanned edge e=(x,y)e = (x, y)e=(x,y) it puts eee into the class Er(y)+1E_{r(y)+1}Er(y)+1​, increases r(x)r(x)r(x) by one if r(x)=r(y)r(x) = r(y)r(x)=r(y), and increases r(y)r(y)r(y) by one; then it marks xxx scanned. Ties are broken arbitrarily. The time instants are the states between these elementary operations; Ei∗E^*_iEi∗​ denotes the class iii at an instant, and EiE_iEi​ its final value. Put

Gi=(V, E1∪E2∪⋯∪Ei).G_i = (V,\ E_1 \cup E_2 \cup \dots \cup E_i).Gi​=(V, E1​∪E2​∪⋯∪Ei​).

Formalization targets

Goal: Theorem 3.1

For a simple graph GGG and the classes of any completed run of FOREST, for 1≤i≤∣E∣1 \le i \le |E|1≤i≤∣E∣,

κ(x,y;Gi) ≥ min⁡{κ(x,y;G), i}for any x,y∈V.(3.1)\kappa(x, y; G_i) \ \ge\ \min\{\kappa(x, y; G),\ i\} \qquad \text{for any } x, y \in V. \tag{3.1}κ(x,y;Gi​) ≥ min{κ(x,y;G), i}for any x,y∈V.(3.1)

The statement is local: it holds pair by pair, not only for the global minimum, and for every tie-breaking of the procedure.

Milestones, in the order the proof uses them

  1. Lemma 2.2: at every instant, a node vvv meets EiE_iEi​ exactly for i=1,…,r(v)i = 1, \dots, r(v)i=1,…,r(v).
  2. Lemma 2.4(b): at every instant, a uuu–vvv path in Ej∗E^*_jEj∗​ yields uuu–vvv paths in every Ei∗E^*_iEi∗​, i<ji < ji<j.
  3. In-degree at most one (§2, p. 588): orienting each edge from the earlier-scanned to the later-scanned end, every node has at most one entering arc in each class.
  4. Lemma 3.1: if an xxx–yyy path of Ej∗E^*_jEj∗​ has the form x,u1,…,uk=w,yx, u_1, \dots, u_k = w, yx,u1​,…,uk​=w,y with k=1k = 1k=1 or u1u_1u1​ scanned before www, then any www–xxx and www–yyy paths in Ei∗E^*_iEi∗​ (i<ji < ji<j) share a node other than www.
  5. Lemma 3.2: for a node cut set W={w1,…,wi}W = \{w_1, \dots, w_i\}W={w1​,…,wi​} of Gi+1G_{i+1}Gi+1​ (in scan order) separating a component XXX from the rest YYY, immediately after wtw_twt​ is scanned every XXX–YYY path of Et∗E^*_tEt∗​ passes through wtw_twt​, and Ej∗E^*_jEj∗​ has no XXX–YYY path for t+1≤j≤i+1t + 1 \le j \le i + 1t+1≤j≤i+1.

A companion item states the paper's announcement in §3: GkG_kGk​ is kkk-node-connected for every 1≤k≤κ(G)1 \le k \le \kappa(G)1≤k≤κ(G).

Significance

Theorem 3.1 at i=ki = ki=k shows that the first kkk classes of FOREST form a kkk-node-connected spanning subgraph whenever GGG is, and the edge-count analysis of the companion mission bounds its size by k∣V∣−k(k+1)/2k|V| - k(k+1)/2k∣V∣−k(k+1)/2. Since FOREST runs in linear time, any algorithm testing κ(G)≥k\kappa(G) \ge kκ(G)≥k can be run on GkG_kGk​ instead of GGG; the paper uses this to improve the bound for testing κ(G)≥k\kappa(G) \ge kκ(G)≥k from O(max⁡{k2∣V∣1/2,k∣V∣}∣E∣)O(\max\{k^2|V|^{1/2}, k|V|\}|E|)O(max{k2∣V∣1/2,k∣V∣}∣E∣) to O(max⁡{k3∣V∣3/2,k2∣V∣2})O(\max\{k^3|V|^{3/2}, k^2|V|^2\})O(max{k3∣V∣3/2,k2∣V∣2}), and similar gains for computing the number of node-disjoint paths between two nodes. The local form (3.1) is what makes the sss–ttt applications possible.

The result is proved on paper. As far as a search of the platform shows, neither FOREST nor local node-connectivity has a machine-checked treatment there; Mathlib has no notion of vertex connectivity of a pair of nodes. This mission produces a formal model of FOREST as a nondeterministic transition system and the statements needed to verify the paper's proof step by step.

Difficulty

For edge-connectivity the analogous statement follows from a general principle: any sequence of maximal spanning forests, each taken in what remains of the graph, preserves local edge-connectivity up to its length. The obvious attempt is to prove (3.1) the same way, from the fact that each EiE_iEi​ is a maximal spanning forest of what the earlier classes leave. The paper gives no such argument for node-connectivity: its proof uses the specific scan order of FOREST in an essential way, through the orientation of edges from earlier- to later-scanned nodes and the in-degree bound of that orientation (Lemmas 3.1 and 3.2). The argument tracks, for a hypothetical node cut WWW of size iii in Gi+1G_{i+1}Gi+1​, the classes at the moments the nodes of WWW are scanned, which requires reasoning about intermediate states of the algorithm and about paths in several classes at once. None of this reduces to a static property of the output partition.

Formalization scope

  • Graphs. A node type V and an edge type E, both finite, with ends : E → Sym2 V; loop-freeness is ∀ e, ¬ (ends e).IsDiag and simplicity is Function.Injective ends. The standing assumptions of p. 583 and p. 589 (∣V∣≥2|V| \ge 2∣V∣≥2, no self-loop, a simple graph when node-connectivity is discussed) appear as hypotheses; §2 items are stated for loopless graphs, as on the page.
  • Connectivity. κ(x,y;(V,F))\kappa(x, y; (V, F))κ(x,y;(V,F)) is valued in N∞\mathbb N_\inftyN∞​: ∣V∣−1|V| - 1∣V∣−1 on adjacent pairs, the minimum node cut otherwise, and ⊤\top⊤ when x=yx = yx=y, where (3.1) holds trivially.
  • FOREST. A nondeterministic step relation with three steps (select, scan, finish), a run of length KKK from the initial state, and completion when every node is scanned. Every tie-breaking is allowed, so the theorems quantify over all completed runs. A time instant is a state of a run; "scanned before" compares positions in the run's selection order; "immediately after wtw_twt​ has been scanned" is the state right after the finish step of wtw_twt​.
  • Excluded. The running time "O(∣V∣+∣E∣)O(|V| + |E|)O(∣V∣+∣E∣)" and everything in §4 (the connectivity-testing algorithms and their bounds) are not stated: the paper fixes no machine model. The edge bounds on ∣Ei∣|E_i|∣Ei​∣ belong to the edge-connectivity mission.
  • Ruled out. Stating (3.1) for an arbitrary partition into maximal spanning forests, or reading the classes Ej∗E^*_jEj∗​ of Lemmas 3.1–3.2 off the final state, would state a different theorem from the one the paper proves; the classes are those of a run of FOREST at the instant the page specifies.
  • Infrastructure. Reachability avoiding a node set, walks and paths in SimpleGraph, and invariants of the FOREST transition system. The definitions duplicate those of the edge-connectivity mission by design and are candidates for a shared layer. Contributions of general lemmas about the run (label invariants, monotonicity of classes along a run) are welcome.

Selected references

  • H. Nagamochi, T. Ibaraki, A linear-time algorithm for finding a sparse kkk-connected spanning subgraph of a kkk-connected graph, Algorithmica 7 (1992), 583–596. https://doi.org/10.1007/BF01758778
  • Z. Galil, Finding the vertex connectivity of graphs, SIAM J. Comput. 9 (1980), 197–199. https://doi.org/10.1137/0209016
  • J. Cheriyan, M.-Y. Kao, R. Thurimella, Scan-first search and sparse certificates: an improved parallel algorithm for kkk-vertex connectivity, SIAM J. Comput. 22 (1993), 157–174. https://doi.org/10.1137/0222013
  • M. R. Garey, D. S. Johnson, Computers and Intractability: A Guide to the Theory of NP-Completeness, Freeman, 1979.
9 thms3 active usersReviewed
🏆Completed
CombinatoricsLinear OptimizationOptimization·Captain: Shuze Chen

Disjunctive Programming XV: Dominants of Polytopes and Upper SeparationTextbook

Motivation

Many real-world disjunctive models are not unions of polyhedra in a single shared space, but unions of polyhedra in different spaces linked by a logical implication: some action affecting one set of entities has consequences for another. Balas's treatment of such models (§17 of the book, following [17]) reduces to understanding a single auxiliary object attached to each polytope in isolation: its dominant, the set of points that dominate (coordinatewise) some feasible point. Dominants and their duals, blockers, have a long history in combinatorial optimization — blocking-pair theory for covering and packing polyhedra traces to Fulkerson (D. R. Fulkerson, Blocking and anti-blocking pairs of polyhedra, Mathematical Programming 1 (1971), 168–194, https://doi.org/10.1007/BF01584085) — but this chapter develops a self-contained, constructive theory tailored to polytopes inside the unit cube, culminating in an exact, facet-complete description of the dominant for an arbitrary such polytope.

Setting

For a polyhedron P⊆R+nP \subseteq \mathbb{R}^n_+P⊆R+n​, the dominant is P+:=P+R+n={y≥0:y≥x for some x∈P}P^+ := P + \mathbb{R}^n_+ = \{y \ge 0 : y \ge x \text{ for some } x \in P\}P+:=P+R+n​={y≥0:y≥x for some x∈P}, and the blocker is P∗:={π∈R+n:πx≥1 for all x∈P}P^* := \{\pi \in \mathbb{R}^n_+ : \pi x \ge 1 \text{ for all } x \in P\}P∗:={π∈R+n​:πx≥1 for all x∈P} — the covering inequalities valid for PPP. (The blocker is not the reverse polar of 02b-polarity: restricting to the nonnegative orthant is essential and changes the object.) For x∗∈R+nx^* \in \mathbb{R}^n_+x∗∈R+n​, the upper-separation value is αP(x∗):=min⁡{πx∗:π∈P∗}\alpha_P(x^*) := \min\{\pi x^* : \pi \in P^*\}αP​(x∗):=min{πx∗:π∈P∗}; a violated covering inequality for x∗x^*x∗ exists exactly when αP(x∗)<1\alpha_P(x^*) < 1αP​(x∗)<1. A polytope P⊆[0,1]nP \subseteq [0,1]^nP⊆[0,1]n is upper monotone (with respect to [0,1]n[0,1]^n[0,1]n) if P=P+∩[0,1]nP = P^+ \cap [0,1]^nP=P+∩[0,1]n — the natural "closure" condition under which the theory of this chapter applies cleanly.

For S⊆N:={1,…,n}S \subseteq N := \{1,\dots,n\}S⊆N:={1,…,n}, write a(S):=∑j∈Saja(S) := \sum_{j\in S} a_ja(S):=∑j∈S​aj​. Given P⊆RnP \subseteq \mathbb{R}^nP⊆Rn and a coordinate subset SSS, the projection PSP^SPS keeps only the SSS-coordinates, letting the rest range freely. ISI^SIS is the set of valid inequalities πx≥1\pi x \ge 1πx≥1 of PSP^SPS with πj>0\pi_j > 0πj​>0 exactly on SSS, tight at ∣S∣|S|∣S∣ linearly independent points of PSP^SPS.

Formalization targets

Proposition 13.1. For an upper monotone P=⋂iPiP = \bigcap_i P_iP=⋂i​Pi​ (each PiP_iPi​ a single inequality in [0,1]n[0,1]^n[0,1]n), P+=⋂iPi+P^+ = \bigcap_i P_i^+P+=⋂i​Pi+​.

Theorem 13.3. For P={x∈[0,1]n:ax≥1}P = \{x \in [0,1]^n : ax \ge 1\}P={x∈[0,1]n:ax≥1} (a≥0a \ge 0a≥0) upper monotone,

P+={x≥0:∑j∈Sajxj1−a(N∖S)≥1 for every S⊆N with 1−a(N∖S)>0}.P^+ = \Big\{x \ge 0 : \sum_{j\in S} \frac{a_j x_j}{1-a(N\setminus S)} \ge 1 \text{ for every } S\subseteq N \text{ with } 1-a(N\setminus S)>0\Big\}.P+={x≥0:j∈S∑​1−a(N∖S)aj​xj​​≥1 for every S⊆N with 1−a(N∖S)>0}.

Theorem 13.5. For the same PPP and any x∗≥0x^* \ge 0x∗≥0, with xq∗x^*_qxq∗​ the greatest coordinate value xj∗x^*_jxj∗​ satisfying a(N∖S(xj∗))<1a(N\setminus S(x^*_j))<1a(N∖S(xj∗​))<1 and xj∗≤g(xj∗)x^*_j \le g(x^*_j)xj∗​≤g(xj∗​): S(αP)=S(xq∗)S(\alpha_P) = S(x^*_q)S(αP​)=S(xq∗​) and αP=g(xq∗)\alpha_P = g(x^*_q)αP​=g(xq∗​), an explicit, computable value.

Theorem 13.7 (goal). For an arbitrary polytope P⊆[0,1]nP \subseteq [0,1]^nP⊆[0,1]n (not necessarily upper monotone):

P+={x≥0:πx≥1 for every S⊆N and π∈IS},P^+ = \{x \ge 0 : \pi x \ge 1 \text{ for every } S \subseteq N \text{ and } \pi \in I^S\},P+={x≥0:πx≥1 for every S⊆N and π∈IS},

and every one of these inequalities is facet-defining for P+P^+P+.

Corollary 13.8. Every facet-defining inequality of P+P^+P+ has at most dim⁡(P)+1\dim(P)+1dim(P)+1 nonzero coefficients.

The targets move from the intersection-distributivity fact (13.1) through an explicit, exponentially-large but fully closed-form facet system for the single-inequality case (13.3) and its constructive, polynomial evaluation recipe (13.5) to the fully general facet characterization (13.7, requiring no monotonicity assumption at all) and its immediate corollary on facet sparsity (13.8).

Significance

Theorem 13.7 is a rare case in polyhedral combinatorics of a complete and exact facet description obtained for the dominant of an arbitrary polytope, not merely a valid relaxation or an algorithmic separation oracle — every facet is accounted for, and every listed inequality is genuinely a facet, not merely valid. Corollary 13.8's support bound is the mechanism that makes Theorem 13.10 (not part of this mission) tractable: it lets the facets of a dominant built from a disjunction of polytopes in different spaces be characterized purely in terms of each factor's own low-dimensional facets, avoiding an exponential blowup in the combined space.

Both directions are proved in the source (Balas's own treatment, following the joint framework of [17]) but have no counterpart on this platform: nothing existing treats dominants, blockers, or upper monotonicity. This mission produces the first Lean statements of all five targets.

Difficulty

The obvious shortcut for Theorem 13.7 is to state only the validity half of the claim (every inequality from ISI^SIS is valid for P+P^+P+) and treat "facet-defining" as a decoration — after all, Proposition 13.1's polar-style validity argument generalizes easily. But the theorem's actual force is the converse: not merely that these inequalities suffice to describe P+P^+P+, but that none of them is redundant, and no other facet exists. The book's own converse proof needs a genuine perturbation argument (splitting a facet candidate with fewer than ∣S∣|S|∣S∣ independent tight points into two distinct valid inequalities averaging back to it, contradicting facetness) — this is where the real content lives, and a formalization that only captures the forward direction would understate the theorem substantially.

For Theorem 13.5, the difficulty is that S(α)S(\alpha)S(α) and g(α)g(\alpha)g(α) are themselves defined in terms of α\alphaα, so "the largest xj∗x^*_jxj∗​ satisfying [a condition stated in terms of S(xj∗)S(x^*_j)S(xj∗​) and g(xj∗)g(x^*_j)g(xj∗​)]" is a genuinely self-referential extremal characterization, not a closed-form formula one could simply plug into — hence its faithful statement (via IsGreatest over an explicit, self-referential candidate set) rather than an unwound algebraic expression.

Formalization scope

The ambient space is Fin n → ℝ throughout, matching the series default. Dominant/Blocker are given their own names (not reusing, even informally, 02b-polarity's polar/reverse-polar vocabulary), per BRIEF.md's explicit warning that the nonnegativity restriction makes these different objects. PolyDim/IsFacet are restated from 02b-polarity/11a-intersection-cuts (affine dimension via Module.finrank of vectorSpan, faces via IsExtreme), since Chapter 2 already pins these down precisely for this series and Chapter 13's own facet claims use the same notion. IsUpperMonotone is stated exactly as Definition 4 (P = P⁺ ∩ [0,1]ⁿ), not paraphrased as coordinatewise monotonicity, per BRIEF.md's explicit warning that these are different conditions.

IsInIS (membership in ISI^SIS) uses LinearIndependent ℝ directly for the "|S| linearly independent points" hypothesis, matching the book's own wording; since every such point satisfies πx=1\pi x=1πx=1, a linear dependence among them is automatically an affine dependence (the coefficients of any nontrivial linear relation among them must sum to zero), so this is not a weakening of the more familiar "affinely independent" reading a reader might otherwise expect. A trivializing formalization to rule out explicitly: describing Theorem 13.7's P+P^+P+ using only the validity half of the claim (dropping "each of these inequalities is facet-defining for P+P^+P+") — this mission states both conjuncts, since the facet-exactness is the theorem's genuine content beyond a Farkas-style validity certificate.

This mission depends on no other chunk's Lean definitions; it restates the affine-dimension/facet vocabulary of 02b-polarity/11a-intersection-cuts only informally, per the series convention. Corollary 13.6 (an O(n)O(n)O(n)-time algorithmic claim for computing αP\alpha_PαP​) is out-of-cone per BRIEF.md: it is fully quantified, not a veto-V3 case, but is a computational-complexity statement outside this mission's polyhedral-characterization scope.

Selected references

  • D. R. Fulkerson, Blocking and anti-blocking pairs of polyhedra, Mathematical Programming 1 (1971), 168–194. https://doi.org/10.1007/BF01584085
  • E. Balas and R. G. Jeroslow, Strengthening cuts for mixed integer programs (for the broader monotonization-of-polyhedra context cited by this chapter's introduction), European Journal of Operational Research 4 (1980), 224–234. https://doi.org/10.1016/0377-2217(80)90106-X
  • E. Balas, Disjunctive Programming, Springer, 2018, Chapter 13, §13.1–13.2. https://doi.org/10.1007/978-3-030-00148-3
6 thms3 active usersReviewed
🏆Completed
CombinatoricsGraph TheoryTheoretical Computer Science·Captain: mikedeng1

A Linear-Time Algorithm for Finding a Sparse k-Connected Spanning Subgraph of a k-Connected Graph 1: The FOREST Decomposition Preserves Local Edge-ConnectivityResearch Paper

Motivation

Many graph algorithms for connectivity questions run in time proportional to the number of edges. When the question is only whether a graph is kkk-edge-connected, or what its local edge-connectivities are up to a threshold kkk, most edges are irrelevant: a spanning subgraph with O(k∣V∣)O(k|V|)O(k∣V∣) edges already carries the answer. Such a subgraph is called a sparse certificate. Computing one first and running the expensive algorithm on it replaces ∣E∣|E|∣E∣ by k∣V∣k|V|k∣V∣ in the running time of connectivity testing, of Matula-type edge-connectivity algorithms, and of sss–ttt flow computations used as connectivity oracles.

Nagamochi and Ibaraki (Algorithmica 7, 1992) gave a procedure, FOREST, that computes such a certificate for edge-connectivity and, on simple graphs, for node-connectivity, with a single graph search. The same partition of the edges into forests is the engine of their deterministic minimum-cut algorithm for multigraphs (SIAM J. Discrete Math. 5, 1992), which later became the maximum-adjacency ordering of the Stoer–Wagner minimum-cut algorithm (J. ACM 44, 1997).

Timeline:

  • 1927: Menger identifies the minimum number of edges separating two nodes with the maximum number of edge-disjoint paths between them.
  • 1992: Nagamochi and Ibaraki publish Procedure FOREST and prove that its iii-th prefix preserves local edge-connectivity up to iii in multigraphs, and local node-connectivity up to iii in simple graphs.
  • 1993: Cheriyan, Kao and Thurimella (SIAM J. Comput. 22) obtain sparse certificates by scan-first search; Frank, Ibaraki and Nagamochi (J. Graph Theory 17) give a shorter proof for the node-connectivity case.
  • 1994: Nishizeki and Poljak (Discrete Appl. Math. 55) publish the forest-decomposition lemma (Lemma 2.1 below), found independently.

Setting

A graph G=(V,E)G = (V, E)G=(V,E) is finite and undirected, has ∣V∣≥2|V| \ge 2∣V∣≥2 nodes, may have multiple edges (several edges with the same pair of end nodes), and has no self-loop. It is simple if no two edges have the same end nodes. For F⊆EF \subseteq EF⊆E, (V,F)(V, F)(V,F) is the spanning subgraph with edge set FFF. It is a forest if it has no cycle; two parallel edges form a cycle. It is a maximal spanning forest in (V,H)(V, H)(V,H), for F⊆HF \subseteq HF⊆H, if adding any edge of H∖FH \setminus FH∖F to FFF creates a cycle.

The local edge-connectivity λ(x,y;H)\lambda(x, y; H)λ(x,y;H) is the minimum number of edges of HHH whose removal leaves no path from xxx to yyy; parallel edges count separately. It is ∞\infty∞ when x=yx = yx=y.

Procedure FOREST keeps a label r(v)∈Nr(v) \in \mathbb{N}r(v)∈N on every node, initially 000, and classes E1,E2,…,E∣E∣E_1, E_2, \dots, E_{|E|}E1​,E2​,…,E∣E∣​, initially empty. While an unscanned node exists, it picks an unscanned node xxx of largest label; for every unscanned edge eee from xxx to a node yyy, it puts eee into Er(y)+1E_{r(y)+1}Er(y)+1​, increases r(x)r(x)r(x) by one if r(x)=r(y)r(x) = r(y)r(x)=r(y), increases r(y)r(y)r(y) by one, and marks eee scanned; then it marks xxx scanned. Ties among nodes and the order of edges are free. On termination, Gi=(V,E1∪⋯∪Ei)G_i = (V, E_1 \cup \cdots \cup E_i)Gi​=(V,E1​∪⋯∪Ei​).

Formalization targets

Goal: Theorem 2.1 (pp. 588–589), without the running time

For every graph GGG and every completed execution of FOREST on GGG:

  1. every edge lies in exactly one class EiE_iEi​, 1≤i≤∣E∣1 \le i \le |E|1≤i≤∣E∣;
  2. for i=1,…,∣E∣i = 1, \dots, |E|i=1,…,∣E∣,
λ(x,y;Gi)≥min⁡{λ(x,y;G), i}for all x,y∈V;(2.1)\lambda(x, y; G_i) \ge \min\{\lambda(x, y; G),\ i\} \qquad \text{for all } x, y \in V; \tag{2.1}λ(x,y;Gi​)≥min{λ(x,y;G), i}for all x,y∈V;(2.1)
  1. ∣Ei∣≤∣V∣−1|E_i| \le |V| - 1∣Ei​∣≤∣V∣−1 for all iii;
  2. if GGG is simple, ∣Ei∣≤∣V∣−i|E_i| \le |V| - i∣Ei​∣≤∣V∣−i for i≤∣V∣−1i \le |V| - 1i≤∣V∣−1 and Ei=∅E_i = \emptysetEi​=∅ for i≥∣V∣i \ge |V|i≥∣V∣.

Milestones

  • Lemma 2.2 (p. 587): during the execution, a node vvv has incident edges in exactly the classes E1,…,Er(v)E_1, \dots, E_{r(v)}E1​,…,Er(v)​.
  • Lemma 2.3 (p. 587): each (V,Ei)(V, E_i)(V,Ei​) is a forest at every instant.
  • Lemma 2.4 (p. 588): (a) an edge (u,v)(u, v)(u,v) added to EiE_iEi​ has its end nodes joined by a path in Ei−1E_{i-1}Ei−1​; (b) a path in EjE_jEj​ between uuu and vvv yields a path in every EiE_iEi​, i<ji < ji<j.
  • Lemma 2.5 (p. 588): each output (V,Ei)(V, E_i)(V,Ei​) is a maximal spanning forest in G−E1∪⋯∪Ei−1G - E_1 \cup \cdots \cup E_{i-1}G−E1​∪⋯∪Ei−1​.
  • Lemma 2.1 (p. 584): any sequence of successive maximal spanning forests satisfies (2.1).

Companions

  • the sparse certificate (p. 589): if λ(x,y;G)≥k\lambda(x, y; G) \ge kλ(x,y;G)≥k for all x,yx, yx,y, then GkG_kGk​ is kkk-edge-connected with ∣E(Gk)∣≤k(∣V∣−1)|E(G_k)| \le k(|V| - 1)∣E(Gk​)∣≤k(∣V∣−1), and ∣E(Gk)∣≤k∣V∣−k(k+1)/2|E(G_k)| \le k|V| - k(k+1)/2∣E(Gk​)∣≤k∣V∣−k(k+1)/2 for simple GGG;
  • Lemma 2.6 (p. 589): for k≤δ(G)k \le \delta(G)k≤δ(G), GkG_kGk​ has a node of degree exactly kkk.

Significance

(2.1) says that one search produces, for every threshold kkk at once, a subgraph with at most k(∣V∣−1)k(|V|-1)k(∣V∣−1) edges that keeps every local edge-connectivity up to kkk. Any algorithm whose running time grows with ∣E∣|E|∣E∣ can then be run on GkG_kGk​ in place of GGG; §4 of the paper uses this to speed up kkk-connectivity tests and the computation of local connectivities. The same forest partition is the structural fact behind the Nagamochi–Ibaraki and Stoer–Wagner minimum-cut algorithms. Lemma 2.6 shows that the certificate is tight: its edge-connectivity is exactly kkk when λ(G)≥k\lambda(G) \ge kλ(G)≥k.

The results are proved in the paper. No machine-checked proof of them is known. Formalizing them means formalizing a graph search with free tie-breaking as a transition system, reasoning about invariants of all its executions, and proving a cut-counting statement for multigraphs. Mathlib's connectivity notions, such as SimpleGraph.IsEdgeReachable, do not see parallel edges, so the multigraph cut theory here is new.

Difficulty

Lemma 2.1 is a short cut argument once maximality is available. The difficulty is showing that FOREST, which assigns each edge to a class by looking only at the label of one end node, produces maximal forests in the successive residual graphs (Lemma 2.5). The obvious invariant, that the class of an edge is the first forest it does not close a cycle in, is not what line 7 computes. The label r(y)r(y)r(y) records only which classes touch yyy, not which component of each class contains yyy. The paper's argument needs Lemma 2.4(a): at the moment an edge is added to EiE_iEi​ its ends already lie in one tree of Ei−1E_{i-1}Ei−1​. That relies on the choice of the unscanned node of largest label, on the order of lines 8 and 9, and on an argument about the scan order of tree roots.

Formalization scope

  • Graphs. A graph is a finite node type V with ∣V∣≥2|V| \ge 2∣V∣≥2, a finite edge type E, and ends : E → Sym2 V with no diagonal value (no self-loops). Parallel edges are distinct elements of E. Simplicity is injectivity of ends, and edge subsets are Finset E. A forest is an edge set in which every edge is a bridge, a condition that sees parallel edges.
  • Connectivity. λ\lambdaλ is an infimum in ℕ∞ over separating edge sets, ∞\infty∞ at x=yx = yx=y. (2.1) is kept "for all x,yx, yx,y", as printed.
  • FOREST. FOREST is a nondeterministic step relation (select, scan, finish) on explicit states: labels, class index per edge (000 = unscanned), scanned nodes, current node and selection order. The theorems quantify over every run from the initial state, so no tie-breaking rule is fixed. "At some time instant" is a state of the run; "upon completion" is a run whose last state has every node scanned. Lemma 2.2 is stated at every state, not only after a scan block (the other steps change neither labels nor classes). Lemma 2.4(a) assumes i≥2i \ge 2i≥2, since E0E_0E0​ does not exist.
  • Exclusions. Theorem 2.1's clause "is found in O(∣V∣+∣E∣)O(|V| + |E|)O(∣V∣+∣E∣) time", the bucket implementation, and the time bound of the certificate are not formalized: the paper fixes no machine model. The goal consists of the structural conclusions only. The bound printed "if GGG is multiple" is stated for every loopless graph.
  • Non-triviality. The goal is about the classes of a run of FOREST. An arbitrary partition of EEE into maximal spanning forests is Lemma 2.1's hypothesis, not a formalization of Theorem 2.1. A statement in which the classes are unconstrained variables, or in which the run hypotheses cannot be met, would be trivial. A separate sanity file checks that a complete run on the triangle K3K_3K3​ exists and attains ∣E1∣=∣V∣−1|E_1| = |V| - 1∣E1​∣=∣V∣−1, ∣E2∣=∣V∣−2|E_2| = |V| - 2∣E2​∣=∣V∣−2.
  • Welcome contributions. Useful reusable infrastructure includes:
    • a cut and Menger layer for finite multigraphs;
    • forest and bridge lemmas for edge-indexed graphs;
    • invariant-style reasoning over runs.

Selected references

  • H. Nagamochi, T. Ibaraki, A linear-time algorithm for finding a sparse kkk-connected spanning subgraph of a kkk-connected graph, Algorithmica 7 (1992) 583–596. https://doi.org/10.1007/BF01758778
  • H. Nagamochi, T. Ibaraki, Computing edge-connectivity in multigraphs and capacitated graphs, SIAM J. Discrete Math. 5 (1992) 54–66. https://doi.org/10.1137/0405004
  • T. Nishizeki, S. Poljak, kkk-connectivity and decomposition of graphs into forests, Discrete Appl. Math. 55 (1994) 295–301. https://doi.org/10.1016/0166-218X(94)90014-0
  • J. Cheriyan, M.-Y. Kao, R. Thurimella, Scan-first search and sparse certificates: an improved parallel algorithm for kkk-vertex connectivity, SIAM J. Comput. 22 (1993) 157–174. https://doi.org/10.1137/0222013
  • A. Frank, T. Ibaraki, H. Nagamochi, On sparse subgraphs preserving connectivity properties, J. Graph Theory 17 (1993) 275–281. https://doi.org/10.1002/jgt.3190170302
  • M. Stoer, F. Wagner, A simple min-cut algorithm, J. ACM 44 (1997) 585–591. https://doi.org/10.1145/263867.263872
10 thms3 active usersReviewed
🏆Completed
Linear OptimizationOptimization·Captain: Shuze Chen

Disjunctive Programming XIII: Monoidal Cut Strengthening and the Gomory Mixed-Integer CutTextbook

Motivation

The Gomory mixed-integer (GMI) cut is the single most widely deployed cutting plane in practical mixed-integer programming: every commercial solver generates it, from a simplex tableau row, essentially for free. Yet the GMI cut is not the strongest cut derivable from the same row: once a subset of the variables is known to be integer-constrained, that integrality can be used to tighten the cut's coefficients further, a technique due to Balas and Jeroslow that predates and motivates most of the general disjunctive-cut machinery of this book (E. Balas and R. G. Jeroslow, Strengthening cuts for mixed integer programs, European Journal of Operational Research 4 (1980), 224–234, https://doi.org/10.1016/0377-2217(80)90106-X). This mission formalizes the culmination of that line of work: two refinements of the GMI cut, each strictly stronger than the plain GMI coefficient on part of the variable set, obtained by applying monoidal cut strengthening — optimizing a cut's coefficients over an algebraic monoid of admissible integer shifts — to the two-term split disjunction that produces the GMI cut in the first place (E. Balas and R. Jeroslow, as above; the monoidal strengthening framework itself due to R. E. Gomory and E. L. Johnson, and formalized in the generality used here by G. Nemhauser and L. Wolsey and by J. -P. P. Richard, Y. Li and A. Miller).

Setting

Fix a row of a simplex tableau: y=a0−∑j∈Jajxjy = a_0 - \sum_{j\in J} a_j x_jy=a0​−∑j∈J​aj​xj​, with xj≥0x_j \ge 0xj​≥0 for j∈Jj \in Jj∈J, xjx_jxj​ integer for jjj in a subset J1⊆JJ_1 \subseteq JJ1​⊆J, and 0<a0<10 < a_0 < 10<a0​<1. If yyy is itself integer-constrained, every feasible solution satisfies the split disjunction y≤0∨y≥1y \le 0 \lor y \ge 1y≤0∨y≥1, from which the ordinary GMI cut αx≥1\alpha x \ge 1αx≥1 follows, with αj:=max⁡{aj/a0, −aj/(1−a0)}\alpha_j := \max\{a_j/a_0,\ -a_j/(1-a_0)\}αj​:=max{aj​/a0​, −aj​/(1−a0​)} uniformly over all of JJJ.

For a general qqq-term disjunction ⋁h∈Q(∑jajhxj≥a0h)\bigvee_{h\in Q}(\sum_j a^h_j x_j \ge a^h_0)⋁h∈Q​(∑j​ajh​xj​≥a0h​) with a known background lower bound b0h≤a0hb^h_0 \le a^h_0b0h​≤a0h​ on each term's left side, the cut monoid is

M:={μ∈Zq:∑h∈Qμh≥0}.M := \{\mu \in \mathbb{Z}^q : \textstyle\sum_{h\in Q} \mu_h \ge 0\}.M:={μ∈Zq:∑h∈Q​μh​≥0}.

Given the disjunction and the lower bounds, replacing each term's coefficient ajha^h_jajh​ (for jjj in the integer-constrained set J1J_1J1​) with ajh+μhj(a0h−b0h)a^h_j + \mu^j_h(a^h_0 - b^h_0)ajh​+μhj​(a0h​−b0h​) for any fixed μj∈M\mu^j \in Mμj∈M leaves the disjunction — and hence the disjunctive cut it implies — valid; optimizing this replacement over the whole monoid strengthens the resulting cut. For the normalized qqq-term disjunction ⋁i∈Q(∑jaijxj≥ai0)\bigvee_{i\in Q}(\sum_j a_{ij}x_j \ge a_{i0})⋁i∈Q​(∑j​aij​xj​≥ai0​) (each right-hand side scaled to a common reference), the unstrengthened cut coefficient is βj:=max⁡i∈Qaij/ai0\beta_j := \max_{i\in Q} a_{ij}/a_{i0}βj​:=maxi∈Q​aij​/ai0​.

Formalization targets

Theorem 11.19. For the general qqq-term disjunctive-cut situation, every x≥0x \ge 0x≥0 satisfying the background lower bound and the disjunction also satisfies the monoidally-strengthened cut ∑jαjxj≥α0\sum_j \alpha_j x_j \ge \alpha_0∑j​αj​xj​≥α0​, with

αj={inf⁡μj∈Mmax⁡h∈Qθh[ajh+μhj(a0h−b0h)],j∈J1,max⁡h∈Qθhajh,j∈J∖J1,α0=min⁡h∈Qθha0h.\alpha_j = \begin{cases} \inf_{\mu^j\in M}\max_{h\in Q}\theta_h[a^h_j+\mu^j_h(a^h_0-b^h_0)], & j\in J_1, \\ \max_{h\in Q}\theta_h a^h_j, & j\in J\setminus J_1,\end{cases} \qquad \alpha_0 = \min_{h\in Q}\theta_h a^h_0.αj​={infμj∈M​maxh∈Q​θh​[ajh​+μhj​(a0h​−b0h​)],maxh∈Q​θh​ajh​,​j∈J1​,j∈J∖J1​,​α0​=h∈Qmin​θh​a0h​.

Proposition 11.22. For the normalized disjunction, and any fixed monoid elements mj∈Mm^j \in Mmj∈M (j∈J1j\in J_1j∈J1​), every x≥0x\ge0x≥0 integer on J1J_1J1​ satisfying the disjunction and the background lower bound also satisfies the strengthened disjunction with each term's coefficients shifted by mjm^jmj — the fact that licenses optimizing over the whole monoid afterward.

Corollary 11.25. For each disjunct index kkk, the cut δkx≥1\delta^k x \ge 1δkx≥1 is valid, with δjk:=min⁡{(akj+ak0−bk)/ak0, βj}\delta^k_j := \min\{(a_{kj}+a_{k0}-b_k)/a_{k0},\ \beta_j\}δjk​:=min{(akj​+ak0​−bk​)/ak0​, βj​} on J1J_1J1​ and δjk:=βj\delta^k_j :=\beta_jδjk​:=βj​ elsewhere — a version of monoidal strengthening needing no optimization over MMM at all.

Theorem 11.26 (goal). Specializing the same monoidal strengthening machinery to the two-term split disjunction y≤0∨y≥1y \le 0 \lor y \ge 1y≤0∨y≥1 itself: both α+x≥1\alpha^+ x \ge 1α+x≥1 and α−x≥1\alpha^- x \ge 1α−x≥1 are valid cuts, with α+\alpha^+α+ given by a three-case piecewise formula (eq. (11.55)) refining the GMI coefficient on part of J1J_1J1​, and α−\alpha^-α− symmetric (eq. (11.56)).

The targets move from the general monoidal-strengthening theorem (11.19) through its validity engine in normalized form (Proposition 11.22, directly cited by the intermediate Theorem 11.23 that the goal specializes) and its optimization-free cousin (Corollary 11.25, immediately preceding the goal in the same subsection) to the concrete payoff for the single most-used cut in practice.

Significance

Theorem 11.26's cuts are not a theoretical curiosity: Corollary 11.27 (not drafted this pass) gives an explicit, checkable condition under which each cut is strictly stronger than the plain GMI cut, and Example 4 (p. 187–188) gives a fully worked six-variable instance where the improvement is concrete and numerically verifiable. Since the GMI cut is generated by essentially every mixed-integer solver at essentially every node of a branch-and-cut search, a cheap, always-valid strengthening of it — derivable from the same tableau row with no extra data beyond knowing which variables are integer-constrained — has direct practical reach far beyond this one book.

Both directions are proved in the source (Balas and Jeroslow 1980 for the underlying strengthening idea; this book's own Theorem 11.19/Proposition 11.22/Theorem 11.23 chain for the general monoidal framework applied here) but have no counterpart on this platform: nothing existing treats monoidal cut strengthening, the cut monoid itself, or a refinement of the GMI cut. This mission produces the first Lean statements of all four targets.

Difficulty

The obvious shortcut for Theorem 11.26 is to collapse α+\alpha^+α+'s three-case definition into the plain GMI formula max⁡{aj/a0, −aj/(1−a0)}\max\{a_j/a_0,\ -a_j/(1-a_0)\}max{aj​/a0​, −aj​/(1−a0​)} applied uniformly — after all, that formula already gives a valid cut, and the strengthened cases can only make individual coefficients smaller (better). But a uniform formula reproduces exactly the plain GMI cut and can never be strictly stronger than it, which is the entire content the goal theorem (via Corollary 11.27) is building toward; the piecewise case split over J1+J^+_1J1+​ (where aj>1a_j>1aj​>1), J1>J^{>}_1J1>​ (where a0−1≤aj≤1a_0-1\le a_j\le1a0​−1≤aj​≤1), and the rest is not incidental bookkeeping but the mechanism by which integrality actually buys something.

For Proposition 11.22 and Theorem 11.19, the difficulty is that the strengthening must remain valid simultaneously for every choice of the monoid element μj\mu^jμj (or mjm^jmj) — not merely for some cleverly chosen one — since Theorem 11.19's conclusion then takes an infimum over the entire monoid MMM, which is generally infinite. Fixing a single "obviously good" μj\mu^jμj and stopping there would prove a weaker, non-optimized statement.

Formalization scope

The ambient space is Fin n → ℝ throughout, matching the series default, with the disjunction index set Q represented as Fin q and the cut monoid CutMonoid q : Set (Fin q → ℤ). Theorem 11.19 is formalized with scalar per-term coefficients ajha^h_jajh​ (one real number per disjunct hhh and variable jjj), rather than the fully general "each term a multi-row system Ahx≥a0hA^h x \ge a^h_0Ahx≥a0h​" framing the book's surrounding prose (§11.8's opening) sketches before specializing: every downstream result this mission needs (Proposition 11.22 onward, via (11.38)) is already stated at the single-inequality-per-term level, so this is not a weakening relative to what is actually used, only relative to a more general preamble that is never itself given a numbered, formalizable statement. AlphaJStrengthened uses sInf over the (possibly infinite) monoid literally, not a fixed near-optimal representative. AlphaPlus/AlphaMinus use the exact three-case structure of (11.55)/(11.56) — collapsing them into the uniform GMI formula is the trivializing formalization this mission rules out, since a uniform formula could never realize the theorem's actual (strictly stronger, on part of the domain) claim.

This mission depends on no other chunk's Lean definitions; it restates 11a-intersection-cuts's disjunctive-cut vocabulary only informally (the underlying disjunctive-cut idea, not any specific Lean declaration), per the series convention. A complete development needs: properties of sInf over an unbounded-below-safe subset of ℤ-indexed reals, and case analysis on Int.floor/ Int.ceil for the piecewise formulas. The cut-monoid and unstrengthened/strengthened-coefficient definitions are reusable by any later mission touching monoidal strengthening (e.g. a future mission on Theorem 11.23's full Lopsided-cut construction or the multiple-term-disjunction material of §11.9.2–11.9.3, not drafted this pass).

Selected references

  • E. Balas and R. G. Jeroslow, Strengthening cuts for mixed integer programs, European Journal of Operational Research 4 (1980), 224–234. https://doi.org/10.1016/0377-2217(80)90106-X
  • R. E. Gomory and E. L. Johnson, T-space and cutting planes, Mathematical Programming 96 (2003), 341–375. https://doi.org/10.1007/s10107-003-0389-3
  • J.-P. P. Richard, Y. Li, and L. A. Miller, Valid inequalities for MIPs and group polyhedra from approximate liftings, Mathematical Programming A 118 (2009), 253–277. https://doi.org/10.1007/s10107-007-0190-9
  • E. Balas, Disjunctive Programming, Springer, 2018, Chapter 11, §11.8–11.9. https://doi.org/10.1007/978-3-030-00148-3
5 thms3 active usersReviewed
🏆Completed
Linear OptimizationOptimization·Captain: Shuze Chen

Disjunctive Programming IX: The Correspondence Between Lift-and-Project Cuts and Simple Disjunctive CutsTextbook

Motivation

Chapter 6 built lift-and-project (L&P) cuts from a cut-generating LP, and Chapter 7 surveyed alternative nonlinear constructions reaching the same integer hull. This chapter asks a sharper question: how do L&P cuts relate, coefficient for coefficient, to older, more classical cutting planes — simple disjunctive cuts and mixed integer Gomory cuts, derived directly from a simplex tableau rather than from an auxiliary LP? The answer is an exact correspondence: every L&P cut from a basic solution of the cut-generating LP is equivalent to a specific simple disjunctive cut from a specific tableau basis, and conversely. This correspondence is not merely of theoretical interest — it converts a question about an infinite family of cuts into a finite, countable one (bases of a linear system), and it is what lets the chapter's capstone result, Theorem 8.7, establish a uniform rank bound of ppp (the number of 0-1 variables) across four cut families at once, by proving it for one and transporting the proof to the other three.

Setting

(CGLP)k(CGLP)_k(CGLP)k​ (eq. (8.1)) is the cut-generating LP for the disjunction −xk≥0∨xk≥1-x_k \ge 0 \lor x_k \ge 1−xk​≥0∨xk​≥1, with an added normalization constraint ue+u0+ve+v0=1ue+u_0+ve+v_0=1ue+u0​+ve+v0​=1 that makes its feasible polytope bounded — so a "basic solution" can be identified with an extreme point of that polytope. Given a basic solution with u0,v0>0u_0,v_0>0u0​,v0​>0 and basic u/vu/vu/v-components indexed by M1,M2M_1,M_2M1​,M2​ (Lemma 8.1-8.2), the n×nn\times nn×n submatrix A^\hat AA^ of A~\tilde AA~ indexed by J:=M1∪M2J:=M_1\cup M_2J:=M1​∪M2​ is nonsingular, giving a simplex tableau in which xkx_kxk​ is expressed as xk=aˉk0−∑j∈Jaˉkjxjx_k = \bar a_{k0} - \sum_{j\in J}\bar a_{kj}x_jxk​=aˉk0​−∑j∈J​aˉkj​xj​ (eq. (8.5)). The simple disjunctive cut from xk≤0∨xk≥1x_k\le 0 \lor x_k\ge 1xk​≤0∨xk​≥1 applied to this row has coefficients πj:=max⁡{πj1,πj2}\pi_j := \max\{\pi^1_j,\pi^2_j\}πj​:=max{πj1​,πj2​}, π0:=aˉk0(1−aˉk0)\pi_0 := \bar a_{k0}(1-\bar a_{k0})π0​:=aˉk0​(1−aˉk0​) (eq. (8.7)-(8.8)).

Formalization targets

Theorem 8.7 (goal) — a uniform rank bound across four cut families

The rank of the LP relaxation PPP with respect to (a) unstrengthened L&P cuts, (b) simple disjunctive cuts, (c) strengthened L&P cuts, (d) mixed integer Gomory cuts (equivalently, strengthened simple disjunctive cuts) is at most ppp, the number of 0-1 variables.

The chain of results building toward it

Lemma 8.1 (basicness forces u0,v0>0u_0,v_0>0u0​,v0​>0), Lemma 8.2 (a basic solution's index sets give a nonsingular submatrix), Lemma 8.3 (0<aˉk0<10<\bar a_{k0}<10<aˉk0​<1), Theorem 8.4A (a basic L&P cut equals a simple disjunctive cut), Theorem 8.4B (the converse: every simple disjunctive cut from a valid basis equals some basic L&P cut), and Theorem 8.5 (the same correspondence, strengthened).

Significance

The results themselves. Theorems 8.4A/8.4B are, in the book's own words, an "exact correspondence between lift-and-project cuts for a mixed 0-1 program and earlier cuts from the literature" — placing L&P cuts, simple disjunctive cuts, and (via Theorem 8.5) mixed integer Gomory cuts on the same logical footing, all generated by choosing a basis of one underlying linear system. Theorem 8.7 is the payoff: a single uniform bound covering four cut families that the literature had previously bounded (if at all) by separate arguments, and by contrast to the unbounded rank of pure-integer fractional Gomory cuts, exhibiting a case where the mixed 0-1 structure yields much stronger guarantees.

Formalizing it. No object in this mission exists on the platform prior to it or in Mathlib. This mission restates 06-lift-project-cuts's (CGLP)(CGLP)(CGLP) apparatus and Theorem 6.4's strengthened cut formula locally, per the series convention that a draft mission cannot import another draft mission's definitions, adapted throughout to this chapter's normalized (CGLP)k(CGLP)_k(CGLP)k​ and its disjunction on a single fixed coordinate kkk.

Difficulty

Formalizing "basic solution" required a genuine choice: unlike Chapter 6, (CGLP)k(CGLP)_k(CGLP)k​'s normalization constraint makes its feasible set a bounded polytope, so this mission identifies "basic solution" with an extreme point of that polytope (Set.extremePoints) for Lemma 8.1 (whose own statement has no reference to specific index sets), while Lemmas 8.2 onward take the basic index sets M1,M2M_1,M_2M1​,M2​ directly as hypothesis data, matching how those theorems are themselves phrased ("let the basic components... be indexed by M1M_1M1​ and M2M_2M2​"). Theorem 8.7's rank bound required designing one generic HasRankAtMost predicate, parametrized by an abstract cut-closure operator, applicable uniformly to all four families — mirroring the book's own proof structure, which establishes the bound for one family and transports it to the other three via Theorems 8.4A/8.4B and 8.5, rather than arguing each part from scratch.

Formalization scope

The row/variable identification gap (see MODERATION_NOTES.md). The book's own eq. (8.4)- (8.5) identifies certain rows of the augmented, m+p+nm+p+nm+p+n-row matrix A~\tilde AA~ (those that are bound constraints xj≥0x_j\ge 0xj​≥0) with the variables they bound, so that a chosen nonbasic row set JJJ doubles as a set of "nonbasic variables." This mission's abstract row type does not track that identification (matching the abstraction already used throughout 06-lift-project-cuts and 07-higher-dim): Surplus instead defines the tableau row's nonbasic quantities directly as the slack expression sj:=(A~x)j−b~js_j := (\tilde Ax)_j - \tilde b_jsj​:=(A~x)j​−b~j​, a genuine affine function of xxx for every row, which reduces to xjx_jxj​ itself exactly when row jjj is that bound constraint — mathematically equivalent to the book's own substitution, stated without needing the row-to-variable lookup. Eq. (8.10)'s "j∈J∩N′j\in J\cap N'j∈J∩N′" strengthening-eligibility test has the same gap; this mission takes the row-positions eligible for strengthening as an explicit Finset parameter rather than deriving membership from row identity.

Corollary 8.6 is out of scope for this mission — see HARD.md. Its facet-counting bound depends on the same row/variable identification (the printed bound is (m+p+n−1n)\binom{m+p+n-1}{n}(nm+p+n−1​), excluding row kkk specifically because it is xkx_kxk​'s own bound row) and would additionally require a general notion of "number of facets of a polyhedron" that this mission's abstraction, and Mathlib, do not provide; it does not feed Theorem 8.7's own proof, which cites only Theorems 8.4A/8.4B and 8.5.

Theorem 8.7 is stated via one generic HasRankAtMost predicate applied to SplitConvexify (part a) and three closure operators (SimpleDisjClosureOfSet, StrengthenedLPClosureOfSet, MIGClosureOfSet, parts b-d) defined by intersecting a represented polyhedron with every cut of the corresponding family, then lifted to bare sets by quantifying over every linear representation — since, unlike the split-convexification closure, these three cut families are defined via an explicit basis or CGLP solution and so genuinely need some concrete representation of the current polyhedron at each step of the recursion (the same representation-dependence Theorem 7.5's Lovász-Schrijver iteration required in 07-higher-dim).

Selected references

  • E. Balas, Disjunctive Programming, Springer, 2018. DOI: 10.1007/978-3-030-00148-3, Chapter 8.
  • E. Balas, M. Perregaard, A precise correspondence between lift-and-project cuts, simple disjunctive cuts, and mixed integer Gomory cuts for 0-1 programming, Mathematical Programming B 94 (2003), 221–245 (cited in the text as [33], the origin of Lemma 8.2 and Theorems 8.4A/8.4B).
  • E. Balas, M. Perregaard, Lift-and-project for mixed 0-1 programming: recent progress, Discrete Applied Mathematics 123 (2002), 129–154 (cited in the text as [32], the origin of Theorem 8.5's strengthened-cut coefficient identification).
  • F. Eisenbrand, A. Schulz, Bounds on the Chvátal rank of polytopes in the 0-1 cube, in Integer Programming and Combinatorial Optimization (IPCO 7), LNCS 1610 (1999), 137–150 (cited in the text as [73], the source of the unbounded pure-integer Gomory rank result this chapter's Theorem 8.7 contrasts with).
11 thms3 active usersReviewed
🏆Completed
Linear OptimizationOptimization·Captain: Shuze Chen

Disjunctive Programming VII: Lift-and-Project Cuts for Mixed 0-1 ProgramsTextbook

Motivation

A mixed 0-1 program's feasible region is a disjunctive set built from the split disjunctions xj≤0∨xj≥1x_j \le 0 \lor x_j \ge 1xj​≤0∨xj​≥1, one per binary variable — a special case general enough that Chapter 2's convex-hull machinery applies directly, yet structured enough to produce closed-form cutting planes efficiently. The resulting lift-and-project (L&P) cuts, generated by solving a small auxiliary linear program (the cut-generating LP, CGLP) rather than by hand-derived combinatorial argument, were part of a cluster of ideas that drove a dramatic improvement in commercial mixed-integer solvers' practical performance from the mid-1990s onward. This chapter develops the theory that makes L&P cuts computationally practical: how to bound how many rounds of cutting are needed (disjunctive rank), what can and cannot be guaranteed about intermediate fractional solutions during sequential convexification, how to generate a cut cheaply by solving the CGLP only over the LP relaxation's active variables and lift the result back to the full variable space in closed form, and how to strengthen a single-disjunction cut into one valid for the whole integer program using the integrality of the other 0-1 variables.

Setting

For the mixed 0-1 program min⁡{cx:Ax≥b, x≥0, xj∈{0,1}, j=1,…,p}\min\{cx : Ax \ge b,\ x \ge 0,\ x_j \in \{0,1\},\ j=1,\dots,p\}min{cx:Ax≥b, x≥0, xj​∈{0,1}, j=1,…,p}, let PPP be its LP relaxation (written {x:A~x≥b~}\{x : \tilde A x \ge \tilde b\}{x:A~x≥b~} after folding in the bound constraints) and D:={x∈P:xj≤0∨xj≥1, j=1,…,p}D := \{x \in P : x_j \le 0 \lor x_j \ge 1,\ j=1,\dots,p\}D:={x∈P:xj​≤0∨xj​≥1, j=1,…,p} its disjunctive feasible set. Sequential convexification produces P1:=conv(P∩{x1∈{0,1}})P_1 := \mathrm{conv}(P \cap \{x_1 \in \{0,1\}\})P1​:=conv(P∩{x1​∈{0,1}}), then P1j:=conv(P1∩{xj∈{0,1}})P_{1j} := \mathrm{conv}(P_1 \cap \{x_j \in \{0,1\}\})P1j​:=conv(P1​∩{xj​∈{0,1}}), and so on. The cut-generating LP (CGLP) for the disjunction on coordinate jjj asks for (α,β)(\alpha,\beta)(α,β) and multipliers u,v≥0u,v \ge 0u,v≥0, scalars u0,v0u_0,v_0u0​,v0​, satisfying α−uA~+u0ej=0\alpha - u\tilde A + u_0 e_j = 0α−uA~+u0​ej​=0, $\alpha

  • v\tilde A - v_0 e_j = 0,, ,\beta - u\tilde b = 0,, ,\beta - v\tilde b - v_0 = 0.Solving‘(CGLP)‘onlyovera∗∗restricted∗∗setofactiverows/columns. Solving `(CGLP)` only over a **restricted** set of active rows/columns .Solving‘(CGLP)‘onlyovera∗∗restricted∗∗setofactiverows/columnsM_R, R$ gives (CGLP)^R, whose solution can be lifted back to a solution of the full (CGLP) in closed form.

Formalization targets

Theorem 6.4 (goal) — the general mixed-integer cut-lifting formula

γk=min⁡{αk1+u0⌈mˉk⌉, αk2−v0⌊mˉk⌋} (k∈N′),γk=αk (k∉N′),mˉk=αk2−αk1u0+v0,\gamma_k = \min\{\alpha^1_k + u_0\lceil \bar m_k\rceil,\ \alpha^2_k - v_0\lfloor \bar m_k\rfloor\} \ (k \in N'), \qquad \gamma_k = \alpha_k\ (k \notin N'), \qquad \bar m_k = \frac{\alpha^2_k - \alpha^1_k}{u_0+v_0},γk​=min{αk1​+u0​⌈mˉk​⌉, αk2​−v0​⌊mˉk​⌋} (k∈N′),γk​=αk​ (k∈/N′),mˉk​=u0​+v0​αk2​−αk1​​,

with γx≥β\gamma x \ge \betaγx≥β valid for the whole mixed 0-1 program, strengthening a cut αx≥β\alpha x \ge \betaαx≥β valid only for the single disjunction on jjj.

The chain of results building toward it

Theorem 6.1 (an extreme point of P1P_1P1​ cut off at a facet of P1jP_{1j}P1j​ cannot be fractional in x1x_1x1​ without being fractional in xjx_jxj​ too), Theorem 6.2 (an explicit closed-form extension of a restricted CGLP solution to the full CGLP), and Corollary 6.3 (the same fact, stated transparently via a max⁡{α1,α2}\max\{\alpha^1,\alpha^2\}max{α1,α2} formula and asserted feasible for the full CGLP).

Significance

The results themselves. Theorem 6.4 is what turns lift-and-project cuts from "valid for one binary variable's split" into genuine cuts for the whole mixed-integer program, using no information beyond the integrality of the other 0-1 variables — this strengthening step is part of why L&P cuts became practically competitive with other cutting-plane families. Theorem 6.2 and Corollary 6.3's cut-lifting property is, independently, what makes generating L&P cuts affordable at industrial scale: solving the CGLP only over a problem's few hundred active variables rather than its hundreds of thousands of total variables, then reading off the remaining coefficients in closed form.

Formalizing it. No object in this mission — the cut-generating LP, its restricted version, or the mixed-integer cut-lifting formula — exists on the platform prior to this mission or in Mathlib. This mission restates the disjunctive-set and convex-hull vocabulary of the earlier missions in this series locally (per the series convention that a draft mission cannot import another draft mission's definitions), applied specifically to the split disjunction on a single 0-1 variable.

Difficulty

The natural first attempt at Theorem 6.1 assumes that once x1x_1x1​ has been "locked in" by sequential convexification, every subsequent cut generated while processing later variables respects that integrality — the book's own Figures 6.1-6.2 refute this directly, exhibiting facet- defining cuts that cut through the interior of an edge at a point fractional in every coordinate. Theorem 6.1's genuine content is the narrower but still useful fact that extreme points of the right intersection cannot exhibit this failure. The difficulty in Theorem 6.4 is recognizing that naively substituting xj−mx≤0∨xj−mx≥1x_j - mx \le 0 \lor x_j - mx \ge 1xj​−mx≤0∨xj​−mx≥1 for varying integer vectors mmm gives a family of valid cuts, not a single one — the theorem's content is the closed-form choice of mmm (via rounding mˉk\bar m_kmˉk​ up or down, whichever yields the smaller coefficient) that is provably optimal within this family, not merely one valid choice among many.

Formalization scope

All results are stated over Fin n → ℝ with the CGLP's row space left as an abstract finite type M (rather than fixing the exact m+p+n-row block structure the book's own augmented matrix à has), since the substantive content of every theorem in this chapter depends only on dot products against columns of Ã, never on which literal row a given bound constraint occupies. Alpha1/Alpha2 (Corollary 6.3's row-restricted dot products) and Alpha1_64/Alpha2_64 (Theorem 6.4's eq.-(6.4) values, which add or subtract u0u_0u0​/v0v_0v0​ at the disjunction coordinate) are kept as separate definitions throughout, per BRIEF.md's explicit warning that the two chapters' "α1,α2\alpha^1,\alpha^2α1,α2" notation refers to different formulas despite the shared symbol.

Theorem 6.2's closed-form extension is formalized via the values it assigns (matching every printed formula for ū_{m+i}, v̄_{m+i}, ᾱ_i), without committing to the book's own literal row-block indexing (m+i vs. m+n+i) for the fresh rows a full reading of the source does not fully disambiguate for variables outside the 0-1 index set — Corollary 6.3, the chapter's own "more transparent" restatement of the same fact, is instead formalized with an explicit fresh-row construction (AtilExt, BtilExt) verifying genuine feasibility for the extended (CGLP). In Theorem 6.4, u0,v0>0u_0, v_0 > 0u0​,v0​>0 is stated as an explicit hypothesis, matching BRIEF.md's flag that this positivity (needed for mˉk\bar m_kmˉk​'s division) is implicit in the CGLP feasibility setup rather than a free-standing assumption of the printed theorem.

A trivializing formalization is ruled out explicitly: Theorem 6.4's conclusion is stated as genuine validity for the full MIPDisjunctiveSet (imposing 0/10/10/1 simultaneously on every k∈N′k \in N'k∈N′), not merely as the closed-form formula for γ\gammaγ with no accompanying validity claim, which would omit the theorem's actual mathematical content.

Selected references

  • E. Balas, Disjunctive Programming, Springer, 2018. DOI: 10.1007/978-3-030-00148-3, Chapter 6.
  • E. Balas, S. Ceria, G. Cornuéjols, A lift-and-project cutting plane algorithm for mixed 0-1 programs, Mathematical Programming 58 (1993), 295–324 (cited in the text as [19], the origin of Theorems 6.2 and the CGLP construction).
  • E. Balas, M. Perregaard, A precise correspondence between lift-and-project cuts, simple disjunctive cuts, and mixed integer Gomory cuts for 0-1 programming, Mathematical Programming 94 (2003) (cited in the text as [20], the origin of Corollary 6.3).
5 thms3 active usersReviewed
🏆Completed
Linear OptimizationOptimization·Captain: Shuze Chen

Disjunctive Programming V: Moving Between Conjunctive and Disjunctive Normal FormsTextbook

Motivation

Chapter 2 gives a compact lifted description of the closed convex hull of a disjunctive set once it is written as a union of polyhedra (its disjunctive normal form, DNF). But most discrete optimization problems present their feasible region the opposite way: as a conjunction of many small disjunctions (the conjunctive normal form, CNF) — "linear constraints, and x1∈{0,1}x_1 \in \{0,1\}x1​∈{0,1}, and x2∈{0,1}x_2 \in \{0,1\}x2​∈{0,1}, and so on" — each easy to reason about on its own but expensive to convert to DNF directly, since converting a CNF with ttt conjuncts of q1,…,qtq_1,\dots,q_tq1​,…,qt​ terms each can blow the DNF up to as many as q1×⋯×qtq_1 \times \cdots \times q_tq1​×⋯×qt​ polyhedra. Chapter 4 develops the machinery for moving between these two extremes without paying that combinatorial cost all at once: the basic step, which merges two conjuncts into one, and the hull-relaxation, an intermediate polyhedral relaxation that tightens monotonically with every basic step performed, converging exactly to the true convex hull once the disjunctive set reaches DNF.

Setting

A disjunctive set is in regular form (RF) if F=⋂j∈TSjF = \bigcap_{j \in T} S_jF=⋂j∈T​Sj​ with each Sj=⋃i∈QjPiS_j = \bigcup_{i \in Q_j} P_iSj​=⋃i∈Qj​​Pi​ a union of polyhedra. SjS_jSj​ is elementary if every PiP_iPi​ is a halfspace (the RF is then the CNF), and improper if SjS_jSj​ literally equals a single polyhedron PiP_iPi​. Writing T∗T^*T∗ for the improper indices, P0:=⋂j∈T∗SjP_0 := \bigcap_{j \in T^*} S_jP0​:=⋂j∈T∗​Sj​ is FFF's polyhedral part. The hull-relaxation of a regular form is

h-rel(F):=⋂j∈Tcl conv(Sj),h\text{-}\mathrm{rel}(F) := \bigcap_{j \in T} \mathrm{cl}\,\mathrm{conv}(S_j),h-rel(F):=j∈T⋂​clconv(Sj​),

a relaxation of FFF distinct from cl conv(F)\mathrm{cl}\,\mathrm{conv}(F)clconv(F) itself: it convexifies each conjunct before intersecting, which is generally weaker. A basic step replaces two conjuncts Sk,SlS_k, S_lSk​,Sl​ (k≠lk \ne lk=l) of a regular form by their intersection Sk∩SlS_k \cap S_lSk​∩Sl​ (itself brought to DNF via distributivity), reducing the number of conjuncts by one; repeating this ∣T∣−1|T|-1∣T∣−1 times brings any regular form to DNF. For a convex set SSS, its extreme direction vectors are the extreme rays of its recession cone.

Formalization targets

Theorem 4.7 (goal) — the hull-relaxation hierarchy

For a sequence of regular forms F0,…,FtF_0, \dots, F_tF0​,…,Ft​ of the same disjunctive set, with F0F_0F0​ in CNF, FtF_tFt​ in DNF, and each FiF_iFi​ obtained from Fi−1F_{i-1}Fi−1​ by a basic step:

P0=h-rel(F0)⊇h-rel(F1)⊇⋯⊇h-rel(Ft)=cl conv(Ft).P_0 = h\text{-}\mathrm{rel}(F_0) \supseteq h\text{-}\mathrm{rel}(F_1) \supseteq \cdots \supseteq h\text{-}\mathrm{rel}(F_t) = \mathrm{cl}\,\mathrm{conv}(F_t).P0​=h-rel(F0​)⊇h-rel(F1​)⊇⋯⊇h-rel(Ft​)=clconv(Ft​).

The chain of lemmas the goal is built from

Theorem 4.1 (Sk∩Sl=⋃(i,j)(Pi∩Pj)S_k \cap S_l = \bigcup_{(i,j)}(P_i \cap P_j)Sk​∩Sl​=⋃(i,j)​(Pi​∩Pj​), the basic-step identity), Theorem 4.4 (the hull of a union of halfspaces is Rn\mathbb{R}^nRn or the halfspace itself), Lemma 4.5 (h-rel(F0)=P0h\text{-}\mathrm{rel}(F_0) = P_0h-rel(F0​)=P0​ for a CNF F0F_0F0​), and Lemma 4.6 (cl conv(S1∩S2)⊆cl conv(S1)∩cl conv(S2)\mathrm{cl}\,\mathrm{conv}(S_1 \cap S_2) \subseteq \mathrm{cl}\,\mathrm{conv}(S_1) \cap \mathrm{cl}\,\mathrm{conv}(S_2)clconv(S1​∩S2​)⊆clconv(S1​)∩clconv(S2​), driving each inclusion of the chain).

The sharpening and payoff results

Theorem 4.8 (an exact extreme-point/extreme-direction criterion for when Lemma 4.6 is equality), Corollary 4.9 (a worked case where merging "0-1" disjunctions brings no gain), and Theorem 4.10 (any regular form is the projection of a mixed 0-1 program using no more binary variables than the original CNF).

Significance

The results themselves. Theorem 4.7 turns the exponential CNF-to-DNF blowup into a controllable, monotone process: rather than converting all at once, a solver can perform basic steps selectively — wherever Theorem 4.8's criterion promises a genuine tightening — and always have a valid, improving polyhedral relaxation available at every intermediate stage. Theorem 4.10 is what makes this practical for integer programming specifically: it shows the number of 0-1 variables needed never has to grow, no matter how many basic steps are performed, only the number of continuous lifted variables does.

Formalizing it. No object in this mission — regular form, the hull-relaxation operator, basic steps, or extreme direction vectors — exists on the platform prior to this mission or in Mathlib. This mission restates the disjunctive-set and convex-hull vocabulary of the earlier missions in this series locally (per the series convention that a draft mission cannot import another draft mission's definitions).

Difficulty

The obvious first attempt collapses h-rel to cl conv throughout, reasoning that since the chain ends at cl conv(Ft)\mathrm{cl}\,\mathrm{conv}(F_t)clconv(Ft​), the intermediate terms should behave the same way. This is exactly backwards: h-rel is always at least as large as the true convex hull at every intermediate stage (Lemma 4.6 gives containment, not equality, in general), and the chapter's own Example 1 exhibits a CNF whose hull-relaxation strictly exceeds cl conv(F)\mathrm{cl}\,\mathrm{conv}(F)clconv(F) until enough basic steps have been performed. The real difficulty Theorem 4.8 isolates is recognizing which basic steps actually tighten the relaxation: merging conjuncts whose extreme points and directions already coincide with those of the pairwise intersections gains nothing (Corollary 4.9's worked case), while merging conjuncts that interact more intricately can produce a strictly tighter bound — and no general rule beyond Theorem 4.8's own extreme-point criterion identifies which case holds.

Formalization scope

All results are stated over Fin n → ℝ with matrices Matrix (Fin m) (Fin n) ℝ. A regular form's conjuncts are represented as an arbitrary function T → Set (Fin n → ℝ) (rather than requiring every conjunct's internal polyhedral structure to be uniformly tracked through the whole chapter), with IsDisjunctiveUnion/IsElementaryDisjunction as existential well-formedness predicates asserting each conjunct genuinely is a union of polyhedra/halfspaces where that matters. IsBasicStepOf states a basic step abstractly via an index-type equivalence, since its mathematical content is which two conjuncts merge and into what, not any particular relabeling scheme; Theorem 4.7's own sequence of regular forms is a dependent family T : Fin (t+1) → Type* precisely because each basic step genuinely changes the index type (one fewer conjunct).

Theorem 4.7's three-part conclusion (initial equality, step-by-step containments, final equality) is stated as a conjunction rather than a single chained relation, since Lean has no native mixed equality/containment chain notation; this preserves the chapter's own warning that only the last hull-relaxation in the chain is asserted equal to the true convex hull. Theorem 4.10's index set MiM_iMi​ (which term of each original disjunction a given conjunct's disjunct picked) is taken as given structural data satisfying the book's own defining relationship, matching the source's own treatment of MiM_iMi​ as a named auxiliary index set rather than a from-scratch construction. Chapter 4's §4.5–4.6 (a machine-sequencing application with its own bespoke scheduling objects, Theorems 4.11–4.12) is out of scope for this mission — it introduces application-specific vocabulary not shared by the chapter's general hull-relaxation theory, not because it is difficult.

A trivializing formalization is ruled out explicitly: every theorem is stated for generic finite index types, never fixed at a small size that would collapse a union or intersection to a single term, and the chapter's own propositional-logic DNF/CNF conversion (informal narrative via truth tables in §1.3) is not itself a formalization target — this mission works entirely at the polyhedral-set level the chapter's own numbered results occupy.

Selected references

  • E. Balas, Disjunctive Programming, Springer, 2018. DOI: 10.1007/978-3-030-00148-3, Chapter 4, §4.1–4.4.
  • V. Chvátal, Linear Programming, W. H. Freeman, 1983 (cited in the text as [12], the origin of Theorem 4.1's basic step).
  • E. Balas, Disjunctive programming: Properties of the convex hull of feasible points, Discrete Applied Mathematics 89 (1998), 3–44 (the origin of the hull-relaxation hierarchy).
9 thms3 active usersReviewed
🏆Completed
Linear OptimizationOptimization·Captain: Shuze Chen

Disjunctive Programming IV: Sequential Convexification of Disjunctive SetsTextbook

Motivation

Computing the convex hull of a disjunctive set — a union of finitely many polyhedra — is generally hard in direct proportion to how many polyhedra are in the union: Chapter 2's Theorem 2.1 gives a compact lifted description, but working with it still means reasoning about all the disjunctions of the program simultaneously. A natural question, with obvious practical consequences for integer and combinatorial optimization, is whether the convex hull can instead be built up incrementally: impose one disjunction, take the convex hull of what results, then impose the next disjunction on that, and so on. If this "sequential convexification" procedure always reached the true convex hull, computing facets of a hard disjunctive set would reduce to a sequence of much easier single-disjunction computations. Balas shows the answer is negative in general — a two-variable integer program is a standard counterexample — but identifies an important class of disjunctive programs, the facial ones, for which sequential convexification always works. This class includes 0-1 programming (pure or mixed), nonconvex quadratic programming, separable programming, and the linear complementarity problem, though not general integer programming.

Setting

Let F0:={x∈Rn:Ax≥b, x≥0}F_0 := \{x \in \mathbb{R}^n : Ax \ge b,\ x \ge 0\}F0​:={x∈Rn:Ax≥b, x≥0}. A disjunctive program in conjunctive normal form has constraint set

F:={x∈F0:∀j∈S, ∃ i∈Qj, dix≥di0},F := \Big\{x \in F_0 : \forall j \in S,\ \exists\, i \in Q_j,\ d_i x \ge d_{i0}\Big\},F:={x∈F0​:∀j∈S, ∃i∈Qj​, di​x≥di0​},

for a finite set SSS and, for each j∈Sj \in Sj∈S, a finite set QjQ_jQj​ of halfspace data (di,di0)i∈Qj(d_i, d_{i0})_{i \in Q_j}(di​,di0​)i∈Qj​​ — one elementary disjunction per j∈Sj \in Sj∈S. The program is facial if every inequality dix≥di0d_i x \ge d_{i0}di​x≥di0​ appearing in some disjunction defines a face of F0F_0F0​, i.e. F0∩{x:dix≥di0}F_0 \cap \{x : d_i x \ge d_{i0}\}F0​∩{x:di​x≥di0​} is an extreme subset of F0F_0F0​ for every such iii. Fixing an ordering σ\sigmaσ of SSS, the sequential-convexification recursion sets F0F_0F0​ (step zero) to be the base polyhedron and, for each subsequent step, imposes the next disjunction and reconvexifies: Fk+1:=conv[⋃i∈Qσ(k)(Fk∩{x:dix≥di0})]F_{k+1} := \mathrm{conv}\big[\bigcup_{i \in Q_{\sigma(k)}} (F_k \cap \{x : d_i x \ge d_{i0}\})\big]Fk+1​:=conv[⋃i∈Qσ(k)​​(Fk​∩{x:di​x≥di0​})].

For the necessity direction, write Dj:=⋁i∈Qj(dix≥di0)D_j := \bigvee_{i \in Q_j}(d_i x \ge d_{i0})Dj​:=⋁i∈Qj​​(di​x≥di0​) and, reversing every inequality, Dˉj:=⋁i∈Qj(dix≤di0)\bar D_j := \bigvee_{i \in Q_j}(d_i x \le d_{i0})Dˉj​:=⋁i∈Qj​​(di​x≤di0​).

Formalization targets

Theorem 3.1 (goal) — faciality is sufficient

F facial  ⟹  F∣S∣=conv(F),for every ordering σ of S.F \text{ facial} \implies F_{|S|} = \mathrm{conv}(F), \quad \text{for every ordering } \sigma \text{ of } S.F facial⟹F∣S∣​=conv(F),for every ordering σ of S.

This is the weakest correct statement of the recursion's endpoint: it asserts the sequential procedure reaches exactly conv(F)\mathrm{conv}(F)conv(F) (not, say, some fixed superset), and — since σ\sigmaσ is universally quantified — that this holds regardless of the order in which disjunctions are imposed.

Lemma 3.2 — the halfspace-intersection lemma

P⊆H+  ⟹  H−∩conv(P)=conv(H−∩P),P \subseteq H^+ \implies H^- \cap \mathrm{conv}(P) = \mathrm{conv}(H^- \cap P),P⊆H+⟹H−∩conv(P)=conv(H−∩P),

for a union PPP of finitely many polyhedra and opposite halfspaces H+,H−H^+, H^-H+,H−.

Theorem 3.3 — the exact necessary-and-sufficient condition

conv[(conv Fj−1)∩Dj]=conv(Fj−1∩Dj)  ⟺  the constraint boundary condition holds for Fj−1,Dj.\mathrm{conv}\big[(\mathrm{conv}\,F_{j-1}) \cap D_j\big] = \mathrm{conv}(F_{j-1} \cap D_j) \iff \text{the constraint boundary condition holds for } F_{j-1}, D_j.conv[(convFj−1​)∩Dj​]=conv(Fj−1​∩Dj​)⟺the constraint boundary condition holds for Fj−1​,Dj​.

Significance

The results themselves. Theorem 3.1 is what makes sequential convexification a practical tool rather than a theoretical curiosity: for a 0-1 program with nnn binary variables, it lets the convex hull be built in nnn stages, each requiring only the facets of a two-term disjunction — tractable, in contrast to generating facets of the full integer hull directly. Theorem 3.3 puts the boundary of applicability on rigorous footing: faciality is sufficient but not necessary, and Theorem 3.3 pins down the exact condition, showing precisely why sequential convexification is a genuinely restrictive property (holding for 0-1 programs but not general integer programs) rather than a universal fact about unions of polyhedra.

Formalizing it. No object in this mission — faciality, the sequential-convexification recursion, or the relative-boundary constraint condition — exists on the platform prior to this mission or in Mathlib. This mission restates the disjunctive-set vocabulary of the earlier missions in this series locally (per the series convention that a draft mission cannot import another draft mission's definitions) and is otherwise self-contained.

Difficulty

The natural first guess is that sequential convexification should always work, since at each step the procedure only discards points excluded by a valid disjunction. The book's own two-variable integer-programming example (imposing integrality on x1x_1x1​, then on x2x_2x2​) refutes this directly: the resulting set strictly contains the true integer hull. The reason faciality repairs this is subtle and is exactly what Lemma 3.2 isolates: the recursion's correctness at each step needs the previous partial hull, intersected with the new disjunction's halfspace, to already equal the convex hull of the intersection taken before convexifying — and this commutation of convex hull and halfspace intersection is exactly what fails when the halfspace does not respect a face of the underlying polyhedron. Theorem 3.3 shows this is not merely Lemma 3.2's specific route to a sufficient condition, but the precise dividing line: the "if" direction says checking the boundary condition only for segments between two points already suffices, which is what makes facial sufficiency provable by induction in the first place.

Formalization scope

All results are stated over Fin n → ℝ with matrices Matrix (Fin m) (Fin n) ℝ. The disjunction structure uses a finite index type S with a dependent family of finite index types Qidx : S → Type*, matching the book's S, Q_j. Faciality (Facial) uses Mathlib's IsExtreme directly, matching the book's own primary definition of "defines a face" rather than its immediate "clearly equivalent" restatement (F₀ ⊆ {d_i x ≤ d_{i0}}). The relative boundary in Theorem 3.3 ("the boundary of Dˉj\bar D_jDˉj​ in the affine space spanned by Dˉj\bar D_jDˉj​") is Mathlib's intrinsicFrontier, the standard formalization of a set's boundary relative to its own affine hull. The book's own "∈\in∈" in the constraint boundary condition's conclusion (rather than "⊆\subseteq⊆", which set-membership syntax would require for a set on the left) is read as set inclusion, the only mathematically sound reading, and is transcribed as ⊆ in the Lean statement while the milestone's verbatim text preserves the book's own "∈\in∈" unchanged, per the verbatim-quotation convention.

A trivializing formalization is ruled out explicitly: Theorem 3.1 is stated for an arbitrary finite S and Qidx, not fixed at a small size (e.g. |S| = 1, which would make the recursion's endpoint trivially equal to a single step and prove nothing about sequencing), and the recursion's ordering σ is universally quantified rather than fixed to a canonical choice, matching the theorem's own order-independence claim.

Selected references

  • E. Balas, Disjunctive Programming, Springer, 2018. DOI: 10.1007/978-3-030-00148-3, Chapter 3.
  • E. Balas, Disjunctive programming: Properties of the convex hull of feasible points, Discrete Applied Mathematics 89 (1998), 3–44 (cited in the text as [6], the origin of Theorem 3.1).
  • R. Stubbs, S. Mehrotra, A branch-and-cut method for 0-1 mixed convex programming, Mathematical Programming 86 (1999), 515–532 (cited in the text as [116], extending sequential convexifiability to convex mixed 0-1 programs).
5 thms3 active usersReviewed
🏆Completed
Linear OptimizationOptimization·Captain: Shuze Chen

Disjunctive Programming III: Projecting Polyhedra and the Convex Hull via PolarityTextbook

Motivation

Theorem 2.1 (the previous mission in this series) shows that the closed convex hull of a union of polyhedra has a compact description after lifting to a higher-dimensional space. That description comes in two dual flavors: a primal one, as the projection of an explicit lifted polyhedron, and a polar one, characterizing the hull's facets directly via a cone built from the disjuncts' own data. Both flavors matter in practice: a cutting-plane algorithm needs to know exactly which inequalities are facet-defining (so as not to waste effort generating redundant cuts), and the two routes — projection and polarity — offer complementary tools for deciding this. This mission formalizes both routes and the machinery connecting them, closing out Chapter 2 of Balas, Disjunctive Programming (Springer, 2018).

The projection route (§2.2–2.3) develops general facts about projecting an arbitrary polyhedron that predate and underlie the disjunctive-programming application: the classical projection formula via extreme rays of a projection cone, how dimension and facet structure behave under projection, and a refinement (via a coordinate transformation) that eliminates the redundant inequalities the plain projection formula can produce. The polarity route (§2.4) develops the reverse polar, an object introduced by Balas specifically for this purpose, whose iterated application recovers the closed convex hull of a disjunctive set directly, culminating in an exact characterization of when an inequality is facet-defining purely in terms of extreme rays of an explicit cone W0W_0W0​.

Setting

For a matrix system (A,B,b)(A,B,b)(A,B,b) with mmm rows, let Q:={(u,x)∈Rp×Rq:Au+Bx≤b}Q := \{(u,x) \in \mathbb{R}^p \times \mathbb{R}^q : Au+Bx \le b\}Q:={(u,x)∈Rp×Rq:Au+Bx≤b}, and let Projx(Q):={x:∃ u, (u,x)∈Q}\mathrm{Proj}_x(Q) := \{x : \exists\, u,\ (u,x) \in Q\}Projx​(Q):={x:∃u, (u,x)∈Q} be its projection onto the xxx-space. The projection cone is W:={v:vA=0, v≥0}W := \{v : vA=0,\ v \ge 0\}W:={v:vA=0, v≥0}. A vector vvv is an extreme ray of a cone WWW if v≠0v \ne 0v=0, v∈Wv \in Wv∈W, and the ray it generates is an extreme subset of WWW. The dimension dim⁡(P)\dim(P)dim(P) of a polyhedron is the dimension of its affine hull, and a set FFF is a facet of PPP if it is a proper face of PPP of dimension dim⁡(P)−1\dim(P)-1dim(P)−1. Partitioning (A,B,b)(A,B,b)(A,B,b)'s rows into those tight throughout QQQ (the equality subsystem) and the rest, rrr and r∗r^*r∗ denote the rank of the tight rows' combined and AAA-only submatrices, respectively.

For S⊆RnS \subseteq \mathbb{R}^nS⊆Rn, the polar is S0:={x:xy≤1 ∀y∈S}S^0 := \{x : xy \le 1\ \forall y \in S\}S0:={x:xy≤1 ∀y∈S} and the reverse polar is S#:={x:xy≥1 ∀y∈S}S^\# := \{x : xy \ge 1\ \forall y \in S\}S#:={x:xy≥1 ∀y∈S}; more generally the scaled polar at level α0\alpha_0α0​ is F(α0):={y:xy≥α0 ∀x∈F}F_{(\alpha_0)} := \{y : xy \ge \alpha_0\ \forall x \in F\}F(α0​)​:={y:xy≥α0​ ∀x∈F}. For a disjunctive set F=⋃h∈QPhF = \bigcup_{h \in Q} P_hF=⋃h∈Q​Ph​ with Ph:={x:Ahx≥bh}P_h := \{x : A_h x \ge b_h\}Ph​:={x:Ah​x≥bh​} and Q∗:={h:Ph≠∅}Q^* := \{h : P_h \ne \emptyset\}Q∗:={h:Ph​=∅}, the cone W0:={(α,α0):∃ (uh)h∈Q∗, ∀h, uhAh=α, α0≤uhbh, uh≥0}W_0 := \{(\alpha,\alpha_0) : \exists\, (u_h)_{h \in Q^*},\ \forall h,\ u_h A_h = \alpha,\ \alpha_0 \le u_h b_h,\ u_h \ge 0\}W0​:={(α,α0​):∃(uh​)h∈Q∗​, ∀h, uh​Ah​=α, α0​≤uh​bh​, uh​≥0}.

Formalization targets

Theorem 2.18 (goal) — facet characterization via polarity

For a full-dimensional disjunctive set FFF (dim⁡(F)=n\dim(F)=ndim(F)=n) and α0≠0\alpha_0 \ne 0α0​=0:

αx≥α0 defines a facet of cl conv(F)  ⟺  (α,α0) is an extreme ray of W0.\alpha x \ge \alpha_0 \text{ defines a facet of } \mathrm{cl\,conv}(F) \iff (\alpha,\alpha_0) \text{ is an extreme ray of } W_0.αx≥α0​ defines a facet of clconv(F)⟺(α,α0​) is an extreme ray of W0​.

The polarity chain feeding the goal

Proposition 2.13 (0∈cl conv(S)  ⟺  S#=∅  ⟺  S#0 \in \mathrm{cl\,conv}(S) \iff S^\# = \emptyset \iff S^\#0∈clconv(S)⟺S#=∅⟺S# bounded), Theorem 2.14 (S##=cl conv(S)+cl cone(S)S^{\#\#} = \mathrm{cl\,conv}(S) + \mathrm{cl\,cone}(S)S##=clconv(S)+clcone(S) when 0∉cl conv(S)0 \notin \mathrm{cl\,conv}(S)0∈/clconv(S)), Corollary 2.15 (cl conv(S)=S00∩S##\mathrm{cl\,conv}(S) = S^{00} \cap S^{\#\#}clconv(S)=S00∩S##), Theorem 2.16 (the scaled polar stabilizes: F(α0)###=F(α0)#F_{(\alpha_0)}^{\#\#\#} = F_{(\alpha_0)}^{\#}F(α0​)###​=F(α0​)#​), and Corollary 2.17 (F(α0)={α:(α,α0)∈W0}F_{(\alpha_0)} = \{\alpha : (\alpha,\alpha_0) \in W_0\}F(α0​)​={α:(α,α0​)∈W0​}) — each the weakest statement needed for the next.

The projection track (independent of the goal's direct proof, sharing its definitions)

Theorem 2.5 (Projx(Q)={x:(vB)x≤vb, v∈extr(W)}\mathrm{Proj}_x(Q) = \{x : (vB)x \le vb,\ v \in \mathrm{extr}(W)\}Projx​(Q)={x:(vB)x≤vb, v∈extr(W)}), Proposition 2.6 (projection preserves integrality), Theorem 2.7 (dim⁡(Projx(Q))=dim⁡(Q)−p+r∗\dim(\mathrm{Proj}_x(Q)) = \dim(Q)-p+r^*dim(Projx​(Q))=dim(Q)−p+r∗), Corollaries 2.8–2.10 (facet/face behavior under projection), and Proposition 2.11 / Corollary 2.12 (sharper facet characterizations via a coordinate-transformed projection cone).

Significance

The results themselves. Theorem 2.18 is the practical payoff of the entire polarity apparatus: it turns "is this inequality facet-defining for the convex hull of a union of polyhedra" from a geometric question into an algebraic one about extreme rays of an explicit, finitely-generated cone built directly from the disjuncts' own constraint data — exactly the kind of question a cutting-plane algorithm needs answered to avoid generating redundant cuts. The projection track is foundational general polyhedral theory in its own right (Theorem 2.5's formula underlies Benders decomposition and classical Fourier-Motzkin elimination as special cases, per the book's own remarks), independently useful beyond the disjunctive setting.

Formalizing it. No object in this mission — polars, reverse polars, projection cones, extreme rays of a cone, or the dimension/facet apparatus of a polyhedron — exists on the platform prior to this mission or in Mathlib (a q=polar search returns only an unrelated cyclic-polytope construction from the Hirsch-conjecture series, with different conventions and object). This mission restates the disjunctive-set vocabulary of the companion ConvexHull mission locally (per the series convention that a draft mission cannot import another draft mission's definitions) and builds the polarity apparatus from scratch on top of it.

Difficulty

The natural first attempt at Theorem 2.18 tries to characterize facets of cl conv(F)\mathrm{cl\,conv}(F)clconv(F) directly from the lifted-polyhedron representation of Theorem 2.1, projecting facet by facet. This misses the point of the polarity route entirely: Theorem 2.18's proof instead goes through F(α0)F_{(\alpha_0)}F(α0​)​, showing a vertex of F(α0)F_{(\alpha_0)}F(α0​)​ corresponds to a nonhomogeneous subset of rank nnn of F(α0)F_{(\alpha_0)}F(α0​)​'s own defining system being tight — algebra entirely in the dual space of multipliers, never touching the lifted polyhedron's facets directly. The two obstacles Theorem 2.14 and Proposition 2.13 exist to clear are, respectively: reverse polars do not satisfy the ordinary polar's clean involution property (an extra cl cone(S)\mathrm{cl\,cone}(S)clcone(S) summand appears, capturing recession directions the reverse-polar construction alone cannot see), and reverse polars are either empty or automatically unbounded (never merely "small"), which is why the apparatus needs the normalization 0∉cl conv(F)0 \notin \mathrm{cl\,conv}(F)0∈/clconv(F) throughout.

Formalization scope

All results are stated over finite index sets and matrices Matrix (Fin (m h)) (Fin n) ℝ (disjunctive-set data, m : Q → ℕ dependent) or Matrix (Fin m) (Fin p) ℝ / Matrix (Fin m) (Fin q) ℝ (projection-track data). PolyDim and IsFacet are stated generically over any real vector space (via Module.finrank of vectorSpan and Mathlib's IsExtreme), so the same definitions serve both Poly2-shaped pairs and cl conv F ⊆ Fin n → ℝ directly in Theorem 2.18. IsExtremeRay is likewise stated generically, reused for cones in plain vector space, (v,v0)-space, and the triple (v,w,v0)-space Proposition 2.11 needs.

Two results (Proposition 2.11, Corollary 2.12) build on a coordinate-transformed polyhedron Q̃/cone W̃ that the book itself only cites from [14] rather than constructing; consistent with the book's own treatment, this mission takes W̃ (or its (v,v0)-projection) as given data together with its defining relationship to Proj_x(Q), rather than re-deriving the transformation — a choice recorded in MODERATION_NOTES.md, not a weakening of either statement's content. Proposition 2.11's complexity remark ("O(max{m,q}³)") is a proof aside about the transformation's cost, not part of either result's mathematical claim, and is out of scope per the book-wide disposition (triage.json).

A trivializing formalization is ruled out explicitly: the projection-track results are stated for generic m, p, q, never fixed at small values, and Theorem 2.18 is stated for a generic finite disjunctive index set Q, not specialized to |Q| = 1 (which would collapse W_0 to ordinary LP polarity and prove nothing about unions).

Selected references

  • E. Balas, Disjunctive Programming, Springer, 2018. DOI: 10.1007/978-3-030-00148-3, Chapter 2, §2.2–2.4.
  • E. Balas, Disjunctive programming: Properties of the convex hull of feasible points, Discrete Applied Mathematics 89 (1998), 3–44 (cited in the text as [6], the origin of the reverse-polar apparatus alongside [10]).
  • Balas, Pordli (cited as [14] in the text) — the coordinate-transformation construction behind Proposition 2.11 and Corollary 2.12.
  • Balas, Portugal (cited as [30] in the text) — the source of the dimensional results of §2.2.2.
18 thms3 active usersReviewed
🏆Completed
CombinatoricsGraph TheoryLinear Optimization·Captain: mikedeng1

Cones of Matrices and Set-Functions and 0–1 Optimization II: One Round of N on the Stable Set Polytope Gives Exactly the Odd Hole ConstraintsResearch Paper

Motivation

The stable set problem (vertex packing) asks for a largest set of pairwise non-adjacent nodes of a graph. It is NP-hard, and its polyhedral study, the description of the stable set polytope STAB(G)\mathrm{STAB}(G)STAB(G) by linear inequalities, is one of the most studied topics of polyhedral combinatorics. Classes of valid inequalities (clique, odd hole, odd antihole, wheel constraints) and the graph classes they describe exactly (perfect, ttt-perfect, hhh-perfect graphs) organize much of that literature; see Grötschel, Lovász and Schrijver, Geometric Algorithms and Combinatorial Optimization (Springer, 1988).

Lovász and Schrijver (SIAM J. Optim. 1(2), 1991) introduced a general lift-and-project procedure for 0–1 programs: lift a relaxation KKK into a space of matrices, impose linear conditions that every 0–1 point satisfies, and project back. One round of their operator NNN gives a tighter relaxation N(K)N(K)N(K) that still contains every 0–1 point of KKK; nnn rounds give the 0–1 hull. The procedure is an ancestor of the Sherali–Adams and Lasserre hierarchies, and the stable set problem is its first test case. This mission formalizes the paper's exact description of what one round of NNN does to the fractional stable set polytope: it adds precisely the odd hole constraints.

Setting

Let G=(V,E)G = (V, E)G=(V,E) be a finite graph with no isolated nodes, n=∣V∣n = |V|n=∣V∣. Vectors of RV∪{0}\mathbb{R}^{V \cup \{0\}}RV∪{0} have a distinguished coordinate x0x_0x0​; RV\mathbb{R}^VRV sits inside as the hyperplane H0={x0=1}H_0 = \{x_0 = 1\}H0​={x0​=1}, via x↦(1,x)x \mapsto (1, x)x↦(1,x).

  • FRAC(G)⊆RV\mathrm{FRAC}(G) \subseteq \mathbb{R}^VFRAC(G)⊆RV is the solution set of the nonnegativity constraints xi≥0x_i \ge 0xi​≥0 (i∈Vi \in Vi∈V) and the edge constraints xi+xj≤1x_i + x_j \le 1xi​+xj​≤1 (ij∈Eij \in Eij∈E).
  • FR(G)⊆RV∪{0}\mathrm{FR}(G) \subseteq \mathbb{R}^{V\cup\{0\}}FR(G)⊆RV∪{0} is the cone given by xi≥0x_i \ge 0xi​≥0 and xi+xj≤x0x_i + x_j \le x_0xi​+xj​≤x0​; it is the cone spanned by the vectors (1,x)(1, x)(1,x) with x∈FRAC(G)x \in \mathrm{FRAC}(G)x∈FRAC(G).
  • QQQ is the cone spanned by the 0–1 vectors with x0=1x_0 = 1x0​=1. For a convex cone KKK, its polar cone is K∗={u:uTx≥0 ∀x∈K}K^* = \{u : u^{\mathsf T}x \ge 0 \ \forall x \in K\}K∗={u:uTx≥0 ∀x∈K}.
  • M(K)=M(K,Q)M(K) = M(K, Q)M(K)=M(K,Q) is the set of (n+1)×(n+1)(n+1)\times(n+1)(n+1)×(n+1) matrices Y=(yij)Y = (y_{ij})Y=(yij​) that are symmetric, satisfy yii=y0iy_{ii} = y_{0i}yii​=y0i​ for i∈Vi \in Vi∈V, and satisfy uTYv≥0u^{\mathsf T} Y v \ge 0uTYv≥0 for all u∈K∗u \in K^*u∈K∗, v∈Q∗v \in Q^*v∈Q∗.
  • N(K)={Ye0:Y∈M(K)}N(K) = \{Y e_0 : Y \in M(K)\}N(K)={Ye0​:Y∈M(K)}, and N(G)={x∈RV:(1,x)∈N(FR(G))}N(G) = \{x \in \mathbb{R}^V : (1, x) \in N(\mathrm{FR}(G))\}N(G)={x∈RV:(1,x)∈N(FR(G))}.
  • A set C⊆VC \subseteq VC⊆V is an odd hole if it induces a chordless cycle of odd length ∣C∣≥3|C| \ge 3∣C∣≥3 (triangles included). Its odd hole constraint is ∑i∈Cxi≤12(∣C∣−1)\sum_{i \in C} x_i \le \frac12(|C| - 1)∑i∈C​xi​≤21​(∣C∣−1).

Formalization targets

Goal: Theorem 2.3 (p. 178)

For every finite graph GGG without isolated nodes,

N(G)={x∈RV:xi≥0 (i∈V),  xi+xj≤1 (ij∈E),  ∑i∈Cxi≤12(∣C∣−1) (C an odd hole)}.N(G) = \Big\{x \in \mathbb{R}^V : x_i \ge 0\ (i \in V),\ \ x_i + x_j \le 1\ (ij \in E),\ \ \sum_{i \in C} x_i \le \tfrac12(|C|-1)\ (C \text{ an odd hole})\Big\}.N(G)={x∈RV:xi​≥0 (i∈V),  xi​+xj​≤1 (ij∈E),  i∈C∑​xi​≤21​(∣C∣−1) (C an odd hole)}.

Milestones, in the order the proof uses them

  1. Lemma 1.3 (p. 171): for a convex cone K⊆QK \subseteq QK⊆Q and i∈Vi \in Vi∈V, N(K)⊆(K∩Hi)+(K∩Gi)N(K) \subseteq (K \cap H_i) + (K \cap G_i)N(K)⊆(K∩Hi​)+(K∩Gi​), with Hi={xi=0}H_i = \{x_i = 0\}Hi​={xi​=0}, Gi={xi=x0}G_i = \{x_i = x_0\}Gi​={xi​=x0​}.
  2. Lemma 2.2 (p. 178): if both the deletion and the contraction of some node vvv give inequalities valid for KKK, then aTx≤ba^{\mathsf T}x \le baTx≤b is valid for N(K)N(K)N(K).
  3. Part (1) of the proof of Theorem 2.3 (p. 178): for an odd hole CCC and i∈Ci \in Ci∈C, the deletion and contraction of iii in the odd hole constraint are valid for FRAC(G)\mathrm{FRAC}(G)FRAC(G).
  4. Observation of Section 2.b (p. 177): every Y∈M(FR(G))Y \in M(\mathrm{FR}(G))Y∈M(FR(G)) has yij=0y_{ij} = 0yij​=0 for ij∈Eij \in Eij∈E.
  5. Part (2) of the proof of Theorem 2.3 (p. 178): x∈N(G)x \in N(G)x∈N(G) if and only if some nonnegative symmetric YYY with y00=1y_{00} = 1y00​=1, yi0=yii=xiy_{i0} = y_{ii} = x_iyi0​=yii​=xi​ satisfies xi+xj+xk−1≤yik+yjk≤xkx_i + x_j + x_k - 1 \le y_{ik} + y_{jk} \le x_kxi​+xj​+xk​−1≤yik​+yjk​≤xk​ for all i,j,ki, j, ki,j,k with ij∈Eij \in Eij∈E.
  6. Lemma 2.4 (p. 178): a system a(ij)≤yi+yj≤b(ij)a(ij) \le y_i + y_j \le b(ij)a(ij)≤yi​+yj​≤b(ij), y≥0y \ge 0y≥0, y∣U=0y|_U = 0y∣U​=0 on a graph is infeasible if and only if a walk with a negative alternating sum of one of four types exists.

Significance

Theorem 2.3 gives a complete description of one round of NNN on the stable set problem: the only new constraints are the odd hole constraints. Consequences:

  • For ttt-perfect graphs (those for which nonnegativity, edge and odd hole constraints describe STAB(G)\mathrm{STAB}(G)STAB(G)), N(G)=STAB(G)N(G) = \mathrm{STAB}(G)N(G)=STAB(G).
  • It is the base case for the paper's bounds on the NNN-index of stable set inequalities (Theorem 2.13), and it contrasts with the semidefinite operator N+N_+N+​, which after one round already satisfies clique, odd antihole and wheel constraints.
  • Lemma 2.4 is a combinatorial feasibility criterion for systems with two variables per inequality, useful beyond this paper.

The result has been proved since 1991. At the time of drafting, Prove2Me holds no formalization of it or of any part of the Lovász–Schrijver construction, and Mathlib has none. The mission produces a formal account of the NNN operator on the stable set polytope and a formal proof of the walk criterion for two-variable systems.

Difficulty

The inclusion of N(G)N(G)N(G) in the odd hole system is a short argument once Lemma 1.3 is available. The reverse inclusion is the substance: given xxx satisfying all odd hole constraints, one must exhibit a lifted matrix YYY. A direct appeal to Farkas' lemma yields a certificate with no visible relation to odd cycles; the difficulty is to show that every obstruction to solvability of the matrix system forces a violated odd hole constraint, which is what Lemma 2.4 and the analysis of its four walk types accomplish. Case (d) of that analysis needs the odd hole constraints; the other cases need only the edge constraints. Lemma 2.4 itself is called folklore on the page and is stated without proof there.

A further point: Lemma 2.4 is stated for lower bounds 0≤a0 \le a0≤a, while the lower bounds that arise from the matrix system, xi+xj+xk−1x_i + x_j + x_k - 1xi​+xj​+xk​−1, can be negative.

Formalization scope

  • Coordinates of RV∪{0}\mathbb{R}^{V\cup\{0\}}RV∪{0} are indexed by Option V, with none the coordinate x0x_0x0​. Graphs are Mathlib SimpleGraphs on a finite type VVV with decidable adjacency. Every statement about a graph carries the paper's standing assumption that GGG has no isolated nodes (∀ v, ∃ w, G.Adj v w).
  • MMM is defined by condition (iii), never by its rewritings. Lemma 1.3 and Lemma 2.2 take the cone KKK closed, a hypothesis the paper leaves tacit (its cones are polyhedral); for a non-closed KKK Lemma 1.3 is false. FR(G)\mathrm{FR}(G)FR(G) is polyhedral, so the goal needs no such hypothesis.
  • FR(G)\mathrm{FR}(G)FR(G) is defined by its constraints; this agrees with the cone over FRAC(G)\mathrm{FRAC}(G)FRAC(G) because GGG has no isolated nodes.
  • Lemma 2.2 is stated in cone form: KKK is any closed convex cone inside FR(G)\mathrm{FR}(G)FR(G), and validity is read on the slice x0=1x_0 = 1x0​=1. The paper's extra hypothesis STAB(G)⊆K\mathrm{STAB}(G) \subseteq KSTAB(G)⊆K is dropped, which strengthens the lemma.
  • Deletion and contraction of a node are coefficient vectors on the same graph (coefficients set to 000), not inequalities on the subgraphs G−vG - vG−v and G−Γ(v)−vG - \Gamma(v) - vG−Γ(v)−v.
  • Odd holes are chordless odd cycles including triangles; triangles are needed, as 121\tfrac12\mathbf 121​1 satisfies all other constraints on a triangle.
  • The matrix system of part (2) is stated as an equivalence; the page uses one direction.
  • Lemma 2.4 uses edge values on unordered pairs and strict inequalities, exactly as printed.

A trivializing formalization is ruled out: the goal is the set equality for every graph without isolated nodes, not the existence of a lifted matrix and not a single graph.

Not formalized here: the semidefinite operator N+N_+N+​, the operator N^\hat NN^, algorithmic statements (Theorems 1.6, 2.1, Corollary 2.5), and the set-function results of Section 3.

Reusable beyond this mission: the matrix cone layer (QQQ, MMM, NNN), the stable-set cones, and the two-variable feasibility criterion of Lemma 2.4. Contributions of any of the milestones, and of general facts about polar cones of polyhedral cones in this setting, are welcome.

Selected references

  • L. Lovász and A. Schrijver, Cones of matrices and set-functions and 0–1 optimization, SIAM Journal on Optimization 1(2) (1991) 166–190. https://doi.org/10.1137/0801013
  • M. Grötschel, L. Lovász and A. Schrijver, Geometric Algorithms and Combinatorial Optimization, Springer, 1988. https://doi.org/10.1007/978-3-642-97881-4
  • H. D. Sherali and W. P. Adams, A hierarchy of relaxations between the continuous and convex hull representations for zero-one programming problems, SIAM Journal on Discrete Mathematics 3(3) (1990) 411–430. https://doi.org/10.1137/0403036
13 thms3 active usersReviewed
🏆Completed
Convex OptimizationLinear OptimizationOptimization·Captain: mikedeng1

Cones of Matrices and Set-Functions and 0–1 Optimization I: n Rounds of the Lovász–Schrijver N Operator Give the 0–1 HullResearch Paper

Motivation

A 0–1 integer program asks for the best 0–1 vector satisfying a system of linear inequalities. Its linear relaxation is easy to optimize over, but the relaxation is usually much larger than the convex hull of the 0–1 solutions. Lift-and-project methods close this gap systematically: they lift the relaxation to a higher-dimensional space, add constraints that every 0–1 point satisfies there, and project back, obtaining a tighter relaxation that still contains every 0–1 solution.

L. Lovász and A. Schrijver introduced one of the two standard lift-and-project hierarchies in Cones of matrices and set-functions and 0–1 optimization (SIAM J. Optim., 1991). Their operators NNN and N+N_+N+​ represent a 0–1 point xxx by the matrix xxTxx^{\mathsf T}xxT, impose linear (and for N+N_+N+​ semidefinite) constraints on such matrices, and project back to Rn+1\mathbb R^{n+1}Rn+1. The same paper applies the operators to the stable set polytope, where one round already produces the odd hole, odd wheel, clique and odd antihole constraints. The Lovász–Schrijver hierarchy, the Sherali–Adams hierarchy (1990) and Lasserre's semidefinite hierarchy (2001) are the three reference lift-and-project methods; their rank lower bounds are a standard tool for proving that a relaxation cannot solve a combinatorial problem in few rounds.

This mission formalizes the first structural fact about the operator NNN: iterating it nnn times on any relaxation in nnn variables yields exactly the 0–1 hull (Theorem 1.4 of the paper).

Setting

Vectors live in Rn+1\mathbb R^{n+1}Rn+1 with coordinates x0,x1,…,xnx_0, x_1, \dots, x_nx0​,x1​,…,xn​; the space Rn\mathbb R^nRn of the original problem is the hyperplane x0=1x_0 = 1x0​=1, and polytopes are replaced by the convex cones they generate.

  • A convex cone is a nonempty set closed under addition and nonnegative scaling. For a set SSS, cone⁡(S)\operatorname{cone}(S)cone(S) is the set of nonnegative combinations of finitely many vectors of SSS.
  • The polar cone of KKK is K∗={u:uTx≥0 for all x∈K}K^* = \{u : u^{\mathsf T}x \ge 0 \text{ for all } x \in K\}K∗={u:uTx≥0 for all x∈K}.
  • A 0–1 vector has every coordinate, x0x_0x0​ included, equal to 000 or 111. The cube cone QQQ is the cone spanned by the 0–1 vectors with x0=1x_0 = 1x0​=1; it is the cone over the unit cube.
  • For a convex cone KKK, K∘K^\circK∘ is the cone spanned by the 0–1 vectors in KKK. For K⊆QK \subseteq QK⊆Q this is the cone over the convex hull of the 0–1 points of the relaxation.

For convex cones K1,K2⊆QK_1, K_2 \subseteq QK1​,K2​⊆Q, the matrix cone M(K1,K2)M(K_1, K_2)M(K1​,K2​) consists of the (n+1)×(n+1)(n+1)\times(n+1)(n+1)×(n+1) real matrices Y=(yij)Y = (y_{ij})Y=(yij​) such that

  1. YYY is symmetric;
  2. yii=y0iy_{ii} = y_{0i}yii​=y0i​ for 1≤i≤n1 \le i \le n1≤i≤n (the diagonal equals the 0th column);
  3. uTYv≥0u^{\mathsf T} Y v \ge 0uTYv≥0 for every u∈K1∗u \in K_1^*u∈K1∗​ and v∈K2∗v \in K_2^*v∈K2∗​.

M+(K1,K2)M_+(K_1, K_2)M+​(K1​,K2​) adds the condition that YYY is positive semidefinite. The projections are N(K1,K2)={Ye0:Y∈M(K1,K2)}N(K_1, K_2) = \{Ye_0 : Y \in M(K_1, K_2)\}N(K1​,K2​)={Ye0​:Y∈M(K1​,K2​)} and N+(K1,K2)={Ye0:Y∈M+(K1,K2)}N_+(K_1, K_2) = \{Ye_0 : Y \in M_+(K_1, K_2)\}N+​(K1​,K2​)={Ye0​:Y∈M+​(K1​,K2​)}, where e0e_0e0​ is the 0th unit vector. The cut operator is N(K)=N(K,Q)N(K) = N(K, Q)N(K)=N(K,Q), and its iterates are N0(K)=KN^0(K) = KN0(K)=K, Nt(K)=N(Nt−1(K))N^t(K) = N(N^{t-1}(K))Nt(K)=N(Nt−1(K)).

Two families of hyperplanes appear in the proofs: Hi={x:xi=0}H_i = \{x : x_i = 0\}Hi​={x:xi​=0} and Gi={x:xi=x0}G_i = \{x : x_i = x_0\}Gi​={x:xi​=x0​}, the hyperplanes through the two opposite facets of QQQ in direction iii.

Formalization targets

Goal: Theorem 1.4

For every closed convex cone K⊆QK \subseteq QK⊆Q,

Nn(K)=K∘.N^n(K) = K^\circ .Nn(K)=K∘.

The statement is uniform in nnn and in KKK: no polyhedrality, no bound on the number of constraints, and no assumption that KKK contains a 0–1 point.

Milestones

  1. Condition (iii″). For a closed convex cone K⊆QK \subseteq QK⊆Q and a symmetric YYY with yii=y0iy_{ii} = y_{0i}yii​=y0i​: Y∈M(K,Q)Y \in M(K, Q)Y∈M(K,Q) if and only if every column of YYY is in KKK and the difference of the first column and any other column is in KKK.
  2. Lemma 1.1. For closed convex cones K1,K2⊆QK_1, K_2 \subseteq QK1​,K2​⊆Q,
(K1∩K2)∘⊆N+(K1,K2)⊆N(K1,K2)⊆K1∩K2.(K_1 \cap K_2)^\circ \subseteq N_+(K_1, K_2) \subseteq N(K_1, K_2) \subseteq K_1 \cap K_2 .(K1​∩K2​)∘⊆N+​(K1​,K2​)⊆N(K1​,K2​)⊆K1​∩K2​.
  1. Lemma 1.3. For a closed convex cone K⊆QK \subseteq QK⊆Q and every 1≤i≤n1 \le i \le n1≤i≤n,
N(K)⊆(K∩Hi)+(K∩Gi).N(K) \subseteq (K \cap H_i) + (K \cap G_i).N(K)⊆(K∩Hi​)+(K∩Gi​).
  1. Claim (4) in the proof of Theorem 1.4. For every set TTT of t≥1t \ge 1t≥1 coordinates, with Fˉ\bar FFˉ the union of the faces of the unit cube that fix the coordinates in TTT to 000 or 111,
Nt(K)⊆cone⁡(K∩Fˉ).N^t(K) \subseteq \operatorname{cone}(K \cap \bar F).Nt(K)⊆cone(K∩Fˉ).
  1. The remark after Lemma 1.1. N(K1∩K2,K1∩K2)⊆N(K1,K2)⊆N(K1∩K2,Q)N(K_1 \cap K_2, K_1 \cap K_2) \subseteq N(K_1, K_2) \subseteq N(K_1 \cap K_2, Q)N(K1​∩K2​,K1​∩K2​)⊆N(K1​,K2​)⊆N(K1​∩K2​,Q).

Significance

Theorem 1.4 is what makes NNN a hierarchy rather than a single cut: the relaxations K⊇N(K)⊇N2(K)⊇…K \supseteq N(K) \supseteq N^2(K) \supseteq \dotsK⊇N(K)⊇N2(K)⊇… reach the 0–1 hull after at most nnn rounds, so the NNN-rank of a valid inequality (the least ttt with the inequality valid for Nt(K)N^t(K)Nt(K)) is a well-defined number between 000 and nnn. The rest of the paper measures combinatorial constraints by this rank: odd hole constraints have rank one on the stable set polytope, and the rank of a stable set inequality is bounded by its defect. Rank lower bounds for lift-and-project hierarchies, in the literature that followed, all presuppose this finite convergence.

The theorem is proved in the paper; to the best of available knowledge none of the Lovász–Schrijver operators has been formalized in a proof assistant. A formalization provides machine-checked definitions of the matrix cones and the cut operators that later missions in this series (odd holes, the defect bound, the N+N_+N+​ constraints) state their results against, and a checked proof of the column characterization (iii″) that all of those proofs use.

Difficulty

The inclusion K∘⊆Nn(K)K^\circ \subseteq N^n(K)K∘⊆Nn(K) follows from Lemma 1.1 once each Nt(K)N^t(K)Nt(K) is known to be a convex cone. The reverse inclusion is the content. A first attempt shows that one round of NNN forces one coordinate to be integral, and then iterates; but N(K)N(K)N(K) is not contained in the union of K∩HiK \cap H_iK∩Hi​ and K∩GiK \cap G_iK∩Gi​, only in their Minkowski sum (Lemma 1.3), so a point of N(K)N(K)N(K) is not itself integral in any coordinate. The induction must carry a statement about cones spanned by intersections with unions of cube faces, and it needs each iterate Nt(K)N^t(K)Nt(K) to again be a closed convex cone inside QQQ so that Lemma 1.3 can be reapplied. Closedness of the projection N(K)N(K)N(K) is not automatic: a linear image of a closed cone need not be closed.

Formalization scope

  • Coordinates of Rn+1\mathbb R^{n+1}Rn+1 are indexed by Option ι for a finite type ι; none is x0x_0x0​ and some i is xix_ixi​, and nnn is the cardinality of ι, which may be 000.
  • cone⁡(S)\operatorname{cone}(S)cone(S) is Mathlib's PointedCone.hull ℝ S; QQQ and K∘K^\circK∘ are defined as spans of 0–1 vectors, as on the page, not by the inequality description 0≤xi≤x00 \le x_i \le x_00≤xi​≤x0​.
  • M(K1,K2)M(K_1, K_2)M(K1​,K2​) is defined by condition (iii) through the polar cones; the column form (iii″) is a milestone, not the definition.
  • The operators NNN, N+N_+N+​ and the iterates are defined on arbitrary sets; the hypotheses (convex cone, contained in QQQ, closed) are carried by the theorems.
  • Closedness. The paper tacitly takes its cones closed (they are polyhedral in all its applications), and the rewriting (iii′) on p. 169 needs it. Every statement here assumes the cones closed. Without this the goal is false: for K={x:0<x1<x0}∪{0}K = \{x : 0 < x_1 < x_0\} \cup \{0\}K={x:0<x1​<x0​}∪{0} in R2\mathbb R^2R2, K∘={0}K^\circ = \{0\}K∘={0} while N(K)=QN(K) = QN(K)=Q.
  • In the proof of Theorem 1.4 the page places the cube Q′Q'Q′ in the hyperplane "x0=0x_0 = 0x0​=0"; this is a misprint for x0=1x_0 = 1x0​=1, and claim (4) is formalized with x0=1x_0 = 1x0​=1.
  • Not formalized in this mission: Lemma 1.2 (the dual description of N(K)∗N(K)^*N(K)∗), Lemma 1.5 (the N+N_+N+​ analogue of Lemma 1.3, part of a later mission), and the algorithmic results of Section 1.c.

Contributions welcome: proofs that N(K)N(K)N(K) is a closed convex cone contained in QQQ whenever KKK is, a proof of Q∗=cone⁡{ei,e0−ei}Q^* = \operatorname{cone}\{e_i, e_0 - e_i\}Q∗=cone{ei​,e0​−ei​}, and lemmas on cones spanned by the intersection of a generating set with a supporting hyperplane; these are reusable by the other missions of the series.

Selected references

  • L. Lovász and A. Schrijver, Cones of matrices and set-functions and 0–1 optimization, SIAM Journal on Optimization 1(2) (1991) 166–190. https://doi.org/10.1137/0801013
  • H. D. Sherali and W. P. Adams, A hierarchy of relaxations between the continuous and convex hull representations for zero-one programming problems, SIAM Journal on Discrete Mathematics 3(3) (1990) 411–430. https://doi.org/10.1137/0403036
  • J. B. Lasserre, Global optimization with polynomials and the problem of moments, SIAM Journal on Optimization 11(3) (2001) 796–817. https://doi.org/10.1137/S1052623400366802
  • M. Laurent, A comparison of the Sherali–Adams, Lovász–Schrijver, and Lasserre relaxations for 0–1 programming, Mathematics of Operations Research 28(3) (2003) 470–496. https://doi.org/10.1287/moor.28.3.470.16391
8 thms3 active usersReviewed
🏆Completed
Control TheoryTheoretical Computer Science·Captain: mikedeng1

Supervisory Control of a Class of Discrete Event Processes I: Minimally Restrictive Supervisors Exist iff the Supremal Controllable Legal Sublanguage Contains the Minimal Acceptable LanguageResearch Paper

Motivation

Manufacturing cells, communication protocols, traffic systems and database transaction managers are naturally described not by differential equations but by sequences of discrete events: a machine starts, a part arrives, a message is lost. Ramadge and Wonham's 1987 paper (SIAM J. Control Optim. 25(1)) set up a control theory for such systems in which the plant is an automaton, the controller is another automaton that may disable some events, and specifications are formal languages. The framework, now called supervisory control theory or the Ramadge–Wonham framework, is the standard model for the logical control of discrete event systems and underlies the textbook treatment in Cassandras and Lafortune (Introduction to Discrete Event Systems, 2008) and Wonham and Cai (Supervisory Control of Discrete-Event Systems, 2019).

The question the paper answers is the basic synthesis question of the theory: given a plant, a set of legal behaviours and a set of minimally acceptable behaviours, when does a controller exist that keeps the plant legal, achieves at least the acceptable behaviour, and never deadlocks, and what is the least restrictive such controller?

Setting

A generator is G=(Q,Σ,δ,q0,Qm)\mathcal G = (Q, \Sigma, \delta, q_0, Q_m)G=(Q,Σ,δ,q0​,Qm​) with a state set QQQ, a finite alphabet Σ\SigmaΣ of events, a partial transition function δ:Σ×Q→Q\delta : \Sigma \times Q \to Qδ:Σ×Q→Q, an initial state q0q_0q0​ and marker states Qm⊆QQ_m \subseteq QQm​⊆Q. Extending δ\deltaδ to strings, the generated language L(G)L(\mathcal G)L(G) is the set of strings www for which δ(w,q0)\delta(w, q_0)δ(w,q0​) is defined, and the marked language Lm(G)L_m(\mathcal G)Lm​(G) is the subset of those that end in QmQ_mQm​. The closure Kˉ\bar KKˉ of a language KKK is its set of prefixes; KKK is closed if K=KˉK = \bar KK=Kˉ. Throughout, G\mathcal GG is assumed trim in the sense L(G)=Lˉm(G)L(\mathcal G) = \bar L_m(\mathcal G)L(G)=Lˉm​(G): every generated string can be completed to a marked one.

The alphabet is split into controllable events Σc\Sigma_cΣc​ and uncontrollable events Σu=Σ−Σc\Sigma_u = \Sigma - \Sigma_cΣu​=Σ−Σc​. A supervisor S=(S,ϕ)\mathcal S = (S, \phi)S=(S,ϕ) consists of a deterministic, accessible automaton S=(X,Σ,ξ,x0,Xm)S = (X, \Sigma, \xi, x_0, X_m)S=(X,Σ,ξ,x0​,Xm​), whose state set XXX may be infinite, and a map ϕ\phiϕ assigning to each state xxx the set of controllable events it enables; uncontrollable events are always enabled. The closed loop S/G\mathcal S/\mathcal GS/G runs SSS and G\mathcal GG in lockstep: an event occurs when the plant can execute it, the supervisor enables it, and the supervisor's automaton can follow it. This defines the languages L(S/G)L(\mathcal S/\mathcal G)L(S/G), Lm(S/G)L_m(\mathcal S/\mathcal G)Lm​(S/G) and the controlled language Lc(S/G)=L(S/G)∩Lm(G)L_c(\mathcal S/\mathcal G) = L(\mathcal S/\mathcal G) \cap L_m(\mathcal G)Lc​(S/G)=L(S/G)∩Lm​(G).

S\mathcal SS is complete if its automaton never refuses an event that the plant can execute and ϕ\phiϕ enables; it is proper if it is complete and

Lˉm(S/G)=Lˉc(S/G)=L(S/G),\bar L_m(\mathcal S/\mathcal G) = \bar L_c(\mathcal S/\mathcal G) = L(\mathcal S/\mathcal G),Lˉm​(S/G)=Lˉc​(S/G)=L(S/G),

that is, every closed-loop string can be completed to a marked task. A language KKK is controllable if K⊆L(G)K \subseteq L(\mathcal G)K⊆L(G) and KˉΣu∩L(G)⊆Kˉ\bar K \Sigma_u \cap L(\mathcal G) \subseteq \bar KKˉΣu​∩L(G)⊆Kˉ. For L⊆L(G)L \subseteq L(\mathcal G)L⊆L(G), CG(L)\mathbf C_{\mathcal G}(L)CG​(L) is the class of controllable sublanguages of LLL and FG(L)\mathbf F_{\mathcal G}(L)FG​(L) the class of sublanguages KKK of LLL with K=Kˉ∩Lm(G)K = \bar K \cap L_m(\mathcal G)K=Kˉ∩Lm​(G).

Given ∅≠La⊆Lg⊆Lm(G)\emptyset \neq L_a \subseteq L_g \subseteq L_m(\mathcal G)∅=La​⊆Lg​⊆Lm​(G), the Supervisory Marking Problem (SMP) asks for a proper S\mathcal SS with La⊆Lm(S/G)⊆LgL_a \subseteq L_m(\mathcal S/\mathcal G) \subseteq L_gLa​⊆Lm​(S/G)⊆Lg​, and the Supervisory Control Problem (SCP) for a proper S\mathcal SS with La⊆Lc(S/G)⊆LgL_a \subseteq L_c(\mathcal S/\mathcal G) \subseteq L_gLa​⊆Lc​(S/G)⊆Lg​.

Formalization targets

Goal: Theorem 7.1 (pp. 218–219)

SMP solvable  ⟺  sup⁡CG(Lg)⊇La,SCP solvable  ⟺  sup⁡{CG(Lg)∩FG(Lg)}⊇La,\text{SMP solvable} \iff \sup \mathbf C_{\mathcal G}(L_g) \supseteq L_a, \qquad \text{SCP solvable} \iff \sup\{\mathbf C_{\mathcal G}(L_g) \cap \mathbf F_{\mathcal G}(L_g)\} \supseteq L_a,SMP solvable⟺supCG​(Lg​)⊇La​,SCP solvable⟺sup{CG​(Lg​)∩FG​(Lg​)}⊇La​,

and in each case the solving supervisor can be taken minimally restrictive: its marked (respectively controlled) language equals the supremal element and contains that of every proper supervisor whose language lies in LgL_gLg​.

Milestones

  1. Proposition 4.1 (i), (ii): marking is independent of control; every K⊆Lm(G)K \subseteq L_m(\mathcal G)K⊆Lm​(G), or K⊆L∩Lm(G)K \subseteq L \cap L_m(\mathcal G)K⊆L∩Lm​(G) for an achievable closed LLL, is the marked language of a complete supervisor.
  2. Proposition 5.1: a complete supervisor realizes (Lm,Lc,L)=(K1,K2,K3)(L_m, L_c, L) = (K_1, K_2, K_3)(Lm​,Lc​,L)=(K1​,K2​,K3​) iff K1⊆K2K_1 \subseteq K_2K1​⊆K2​, K2=K3∩Lm(G)K_2 = K_3 \cap L_m(\mathcal G)K2​=K3​∩Lm​(G) and K3K_3K3​ is closed and controllable.
  3. Theorem 6.1 (i), (ii): a proper supervisor with Lm(S/G)=KL_m(\mathcal S/\mathcal G) = KLm​(S/G)=K exists iff KKK is controllable; one with Lc(S/G)=KL_c(\mathcal S/\mathcal G) = KLc​(S/G)=K exists iff KKK is controllable and Lm(G)L_m(\mathcal G)Lm​(G)-closed.
  4. Proposition 7.1: CG(L)\mathbf C_{\mathcal G}(L)CG​(L) and FG(L)\mathbf F_{\mathcal G}(L)FG​(L) contain ∅\emptyset∅ and are closed under arbitrary unions.
  5. The supremal elements (p. 218): sup⁡CG(L)\sup \mathbf C_{\mathcal G}(L)supCG​(L), sup⁡FG(L)\sup \mathbf F_{\mathcal G}(L)supFG​(L) and sup⁡{CG(L)∩FG(L)}\sup\{\mathbf C_{\mathcal G}(L) \cap \mathbf F_{\mathcal G}(L)\}sup{CG​(L)∩FG​(L)} belong to their classes.

Significance

Theorem 7.1 reduces the existence of a correct, non-blocking controller to a single language inclusion, and identifies the supremal controllable sublanguage as the behaviour of the least restrictive solution. That object is the backbone of the later theory: modular and decentralized control, control under partial observation, and the computational results that sup⁡CG(L)\sup \mathbf C_{\mathcal G}(L)supCG​(L) is regular and computable when G\mathcal GG is finite and LLL regular all start from it.

The result is proved in the paper and has been taught for decades; it is not open. Mathlib has no model of generators with partial transitions, supervisors or controllability (its DFA has a total transition function and a single accepted language), and no formalization of this theory exists on the platform. This mission provides one: a reusable Lean model of generators with partial transitions, supervisors with possibly infinite state, closed loops and controllability, together with the paper's existence theorems stated against it. A second mission on the same paper (quotients of supervisors, Theorem 10.1) builds on the same objects.

Difficulty

The combinatorial core of Proposition 7.1 is a short prefix-closure computation. The work lies in the constructions: to show existence, a supervisor must be built for an arbitrary controllable language, which in general is not regular, so the supervisor needs an infinite state set (for example strings of the target language) together with a proof that the closed loop generates exactly the intended language, is complete, and is proper. The converse directions require relating the closed-loop run to separate runs of the plant and of the supervisor's automaton. The naive shortcut of reading the "sup" as an arbitrary member of CG(Lg)\mathbf C_{\mathcal G}(L_g)CG​(Lg​) containing LaL_aLa​ skips the content of the supremal-element milestone; the goal is stated with the actual union.

Formalization scope

  • The alphabet is a type α with [Fintype α]; strings are List α, the empty string is [], and sσs\sigmasσ is s ++ [σ]. Languages are Set (List α); the closure is pre K = {s | ∃ t, s ++ t ∈ K}.
  • A generator is a structure with a state type Q : Type, a partial transition δ : α → Q → Option Q, an initial state and a marker set. No finiteness is assumed on states, of the plant or of the supervisor. Supervisors and generators live in Type 1.
  • ϕ\phiϕ maps states to Ec → Bool; an event outside Σc\Sigma_cΣc​ is enabled by definition, so uncontrollable events cannot be disabled.
  • The closed loop is the product run from (x0,q0)(x_0, q_0)(x0​,q0​); the accessible part in the paper's display (2.1) changes no language and is not built.
  • Standing assumptions carried by every theorem: Σ\SigmaΣ finite, L(G)=Lˉm(G)L(\mathcal G) = \bar L_m(\mathcal G)L(G)=Lˉm​(G), supervisor automata accessible (as a hypothesis on every input supervisor and a conjunct of every "there exists a supervisor").
  • sup⁡\supsup is sSup in the complete lattice Set (List α).
  • A formalization in which the closed loop ignores ϕ\phiϕ or the plant, in which completeness is dropped from properness, or in which the supervisor is restricted to finitely many states, is not the paper's theorem and is ruled out by the definitions above.

Welcome contributions: the basic run lemmas (closed-loop runs project to plant and supervisor runs), the string-state supervisor construction, and proofs of the milestones in the given order.

Selected references

  • P. J. Ramadge and W. M. Wonham, Supervisory Control of a Class of Discrete Event Processes, SIAM J. Control Optim. 25(1):206–230, 1987. https://doi.org/10.1137/0325013
  • W. M. Wonham and P. J. Ramadge, On the Supremal Controllable Sublanguage of a Given Language, SIAM J. Control Optim. 25(3):637–659, 1987. https://doi.org/10.1137/0325036
  • C. G. Cassandras and S. Lafortune, Introduction to Discrete Event Systems, 2nd ed., Springer, 2008. https://doi.org/10.1007/978-0-387-68612-7
  • W. M. Wonham and K. Cai, Supervisory Control of Discrete-Event Systems, Springer, 2019. https://doi.org/10.1007/978-3-319-77452-7
12 thms3 active usersReviewed
🏆Completed
CombinatoricsOptimizationTheoretical Computer Science·Captain: mikedeng1

Approximation Algorithms for Combinatorial Problems V: The Overlap-Ratio Greedy C2 Is Within 1 + ln k of the Least-Overlap Cover on EC(k)Research Paper

Motivation

David S. Johnson's 1974 paper Approximation Algorithms for Combinatorial Problems (J. Comput. System Sci. 9 (1974) 256–278) was one of the first systematic worst-case analyses of polynomial-time heuristics for NP-complete optimization problems. Its Section 5 proves the harmonic bound ∑j=1k1/j\sum_{j=1}^k 1/j∑j=1k​1/j for the greedy algorithm on minimum-cardinality set cover, a result that still underlies the standard ln⁡n\ln nlnn approximation guarantee.

Section 6, the subject of this mission, asks what happens when the cost of a cover is its total size rather than its number of sets. This problem, SET COVERING II (EC), is the optimization version of the EXACT COVER recognition problem of Karp's list (Karp 1972): a family has a disjoint subcover exactly when the optimum equals the number of covered points. Johnson shows that the change of measure breaks the cardinality greedy but that a greedy rule based on an overlap ratio recovers essentially the same guarantee. The same accounting (paying for each newly covered point) later became the standard analysis of greedy weighted set cover (Chvátal 1979).

Setting

An input is a finite family F={S1,…,Sp}F = \{S_1, \dots, S_p\}F={S1​,…,Sp​} of finite sets. Its covered set is T=⋃S∈FST = \bigcup_{S \in F} ST=⋃S∈F​S. A subcover is a subfamily F′⊆FF' \subseteq FF′⊆F with ⋃S∈F′S=T\bigcup_{S\in F'} S = T⋃S∈F′​S=T, and its measure is

mEC(F′)=∑S∈F′∣S∣.m_{EC}(F') = \sum_{S \in F'} |S|.mEC​(F′)=S∈F′∑​∣S∣.

The optimum F∗F^*F∗ is the least measure of a subcover; since every subcover has measure at least ∣T∣|T|∣T∣, an optimal subcover is one with the least possible overlapping. The subproblem EC(k)(k)(k) admits only families in which every set has at most kkk points.

Algorithm C2 keeps a subfamily SUB (initially empty), the unused sets LEFT (initially FFF) and the uncovered points UNCOV (initially TTT). While UNCOV is nonempty it chooses S′∈S' \inS′∈ LEFT minimizing

Ratio(S)=∣S−UNCOV∣∣S∩UNCOV∣,\mathrm{Ratio}(S) = \frac{|S - \mathrm{UNCOV}|}{|S \cap \mathrm{UNCOV}|},Ratio(S)=∣S∩UNCOV∣∣S−UNCOV∣​,

the number of already-covered points of SSS per newly covered point, and moves S′S'S′ from LEFT to SUB, removing its points from UNCOV. When several sets tie, any of them may be chosen; a subcover is choosable by C2 if some sequence of admissible choices returns it.

The overlap of a chosen set is ∣S′−UNCOV∣|S' - \mathrm{UNCOV}|∣S′−UNCOV∣ at the moment it is chosen, and the cumulative overlap OV(F1)\mathrm{OV}(F_1)OV(F1​) of a run returning F1F_1F1​ is the sum of these overlaps.

Formalization targets

Goal: Theorem 6 (p. 271)

For all k≥1k \ge 1k≥1 and n>0n > 0n>0,

R[C2,EC(k)](n)≤1+ln⁡(k)≤∑j=1k1j+12,R[C2, EC(k)](n) \le 1 + \ln(k) \le \sum_{j=1}^k \frac1j + \frac12,R[C2,EC(k)](n)≤1+ln(k)≤j=1∑k​j1​+21​,

and for all sufficiently large nnn, R[C2,EC(k)](n)≥∑j=1k(1/j)R[C2, EC(k)](n) \ge \sum_{j=1}^k (1/j)R[C2,EC(k)](n)≥∑j=1k​(1/j). In the size-free form used here, for every k≥1k \ge 1k≥1:

  1. every subcover MMM choosable by C2 on an input of EC(k)(k)(k) satisfies mEC(M)≤(1+ln⁡k) F∗m_{EC}(M) \le (1 + \ln k)\,F^*mEC​(M)≤(1+lnk)F∗;
  2. 1+ln⁡k≤∑j=1k1/j+1/21 + \ln k \le \sum_{j=1}^k 1/j + 1/21+lnk≤∑j=1k​1/j+1/2;
  3. some input of EC(k)(k)(k) with F∗>0F^* > 0F∗>0 has a choosable subcover with mEC(M)≥(∑j=1k1/j)F∗m_{EC}(M) \ge \big(\sum_{j=1}^k 1/j\big) F^*mEC​(M)≥(∑j=1k​1/j)F∗.

Milestones (proof of Theorem 6, pp. 271–272)

  • the measure of the output is ∣T∣+OV(F1)|T| + \mathrm{OV}(F_1)∣T∣+OV(F1​);
  • if C2 may choose a set with Ratio(S′)≥y\mathrm{Ratio}(S') \ge yRatio(S′)≥y, then (y+1) ∣UNCOV∣≤F∗(y+1)\,|\mathrm{UNCOV}| \le F^*(y+1)∣UNCOV∣≤F∗;
  • with a=F∗/∣T∣a = F^*/|T|a=F∗/∣T∣ and x=∣T−UNCOV∣/∣T∣x = |T - \mathrm{UNCOV}|/|T|x=∣T−UNCOV∣/∣T∣, the next chosen set has Ratio(S′)≤a/(1−x)−1\mathrm{Ratio}(S') \le a/(1-x) - 1Ratio(S′)≤a/(1−x)−1;
  • on EC(k)(k)(k), OV(F1)≤∣T∣ (a[ln⁡(k)+1]−1)\mathrm{OV}(F_1) \le |T|\,(a[\ln(k) + 1] - 1)OV(F1​)≤∣T∣(a[ln(k)+1]−1);
  • the analytic inequality 1+ln⁡(k)≤∑j=1k1/j+1/21 + \ln(k) \le \sum_{j=1}^k 1/j + 1/21+ln(k)≤∑j=1k​1/j+1/2;
  • the lower-bound input (Fig. 1 of the paper with every set of F1F_1F1​ filled out to exactly kkk points) on which C2 may pay ∑j=1k1/j\sum_{j=1}^k 1/j∑j=1k​1/j times the optimum.

Significance

The result. The measure ∑∣S∣\sum|S|∑∣S∣ penalizes overlap, and the paper notes (without proof, p. 270) that an algorithm returning an optimal cover for the cardinality measure can be a factor kkk from optimal for this one. Theorem 6 shows that the ratio rule C2 is within 1+ln⁡k1 + \ln k1+lnk of the least-overlap cover, and the lower bound shows that no analysis of C2 can beat ∑j=1k1/j\sum_{j=1}^k 1/j∑j=1k​1/j. The two bounds differ by less than 1/21/21/2 for every kkk. The theorem was an early instance of a logarithmic guarantee for a weighted covering problem, where each set's cost is its size.

Formalizing it. The theorem has been proved since 1974; no machine-checked proof is known to exist. The mission produces a formal model of the EC problem and of C2 as a nondeterministic process, the overlap identity, and the discrete form of the paper's area-under-a-curve estimate. The last is the part the paper argues informally, through a step function and an integral.

Difficulty

The cardinality argument for C1 counts the sets chosen; here the sets have different sizes, so it does not apply. The overlap C2 pays per newly covered point is not bounded by a constant: early choices can be free and late ones cost up to k−1k-1k−1 per point, and the bound on the cumulative overlap must hold against the whole run, for every sequence of tie-breaks.

In a formal proof the integral must be replaced by a sum. Covered points arrive in blocks (one block per chosen set), the charge is constant on a block but the bound depends on the covered fraction at the start of the block, and the sum has to be compared with a logarithm. The terms aln⁡aa\ln aalna and a/ka/ka/k that the paper drops using 1≤a≤k1 \le a \le k1≤a≤k must be controlled as well, and the relation 1≤a≤k1 \le a \le k1≤a≤k must itself be proved from optimality. The lower bound needs an explicit run of C2 through ties on an input with k⋅k!k \cdot k!k⋅k! points, checking at every stage that the intended set is a ratio minimizer.

Formalization scope

  • Inputs. A family is p : ℕ with S : Fin p → Finset α (0-based, repetitions allowed; a repeated set counts twice in the measure if both copies are chosen, which C2 never does). Subcovers and SUB, LEFT are index sets. F∗F^*F∗ is a minimum over the finite, nonempty set of subcovers (Finset.inf'), never a junk value.
  • Algorithm. C2 is a step relation on states (SUB, LEFT, UNCOV). The choice at Step 3 is existential over all minimizers, so every result quantifies over every choosable output (the paper's WORST). Ratio(S)\mathrm{Ratio}(S)Ratio(S) is +∞+\infty+∞ when S∩UNCOV=∅S \cap \mathrm{UNCOV} = \emptysetS∩UNCOV=∅; the formal rule requires the chosen set to meet UNCOV and compares ratios by cross-multiplication, with no division.
  • Overlap. The cumulative overlap depends on the run, not on the output alone, so it is carried by an inductive run relation RunOV.
  • No problem size. The paper's R[A,P](n)R[A, P](n)R[A,P](n) maximizes over inputs of size at most nnn in an unspecified encoding. Upper bounds are stated for every input and every choosable output; the lower bound exhibits one input and one choosable output. Given monotonicity of RRR in nnn, these are equivalent to the paper's claims. Ratios are stated multiplicatively, so F∗=0F^* = 0F∗=0 does not create a vacuous bound.
  • Numbers. Measures are natural numbers cast to R\mathbb RR; ln⁡\lnln is Real.log; ∑j=1k1/j\sum_{j=1}^k 1/j∑j=1k​1/j is Mathlib's harmonic k.
  • Ruled out. A deterministic tie-break would prove a weaker upper bound and could not realize the lower-bound run, and a ratio with x/0=0x/0 = 0x/0=0 would make disjoint-from-UNCOV sets the most attractive choice. The formalization uses neither.

The overlap identity and the discrete integral comparison are reusable for any greedy covering analysis that charges cost per newly covered point. Contributions welcome include proofs of the milestones, the invariants of the C2 run relation (SUB and LEFT partition the indices; UNCOV =T−⋃= T - \bigcup=T−⋃ SUB), and the explicit lower-bound run.

Selected references

  • D. S. Johnson, Approximation algorithms for combinatorial problems, J. Comput. System Sci. 9 (1974), 256–278. https://doi.org/10.1016/S0022-0000(74)80044-9
  • R. M. Karp, Reducibility among combinatorial problems, in Complexity of Computer Computations, Plenum, 1972, 85–103. https://doi.org/10.1007/978-1-4684-2001-2_9
  • V. Chvátal, A greedy heuristic for the set-covering problem, Math. Oper. Res. 4 (1979), 233–235. https://doi.org/10.1287/moor.4.3.233
10 thms3 active usersReviewed
🏆Completed
CombinatoricsOptimization·Captain: mikedeng1

Scenario Reduction Algorithms in Stochastic Programming III: The Minimal Reduction Distance of a Regular Ternary Scenario TreeResearch Paper

Motivation

Multistage stochastic programs are solved on a finite scenario tree: a discrete probability distribution whose support points are paths of a random process. Realistic trees have far too many scenarios for the resulting optimization problem, so practitioners reduce the tree, keeping nnn of its NNN scenarios and redistributing the probability of the deleted ones. The reduction should keep the reduced distribution as close as possible to the original one in a probability metric that controls the optimal value of the stochastic program (Dupačová, Gröwe-Kuska, Römisch, Math. Program. 95 (2003)).

Choosing the best nnn scenarios is a set-covering problem and NP-hard, and the algorithms used in practice (backward reduction, fast forward selection) are heuristics without error guarantees. Heitsch and Römisch (2003) therefore derived test instances with an exactly known optimum: regular binary and ternary scenario trees, for which the minimal reduction distance has a closed form once nnn is not too small. This mission formalizes the ternary case, Proposition 3.2 of that paper. The binary case (Proposition 3.1) is a separate mission of the same series.

Setting

Fix a depth K∈NK \in \mathbb{N}K∈N and branch widths δ1,…,δK≥0\delta^1, \dots, \delta^K \ge 0δ1,…,δK≥0, with δ0=0\delta^0 = 0δ0=0. A regular ternary scenario tree has N=3KN = 3^KN=3K scenarios, one for each index tuple (i1,…,iK)∈{1,2,3}K(i_1, \dots, i_K) \in \{1, 2, 3\}^K(i1​,…,iK​)∈{1,2,3}K, where iki_kik​ is the successor chosen at level kkk. Choosing successor iki_kik​ adds the increment δikk=(ik−2) δk∈{−δk,0,δk}\delta^k_{i_k} = (i_k - 2)\,\delta^k \in \{-\delta^k, 0, \delta^k\}δik​k​=(ik​−2)δk∈{−δk,0,δk}, and scenario iii is the vector ωi=(ωi0,…,ωiK)∈RK+1\omega_i = (\omega_i^0, \dots, \omega_i^K) \in \mathbb{R}^{K+1}ωi​=(ωi0​,…,ωiK​)∈RK+1 with

ωik=∑j=0kδijj,k=0,…,K(eq. (19)).\omega_i^k = \sum_{j=0}^{k} \delta^j_{i_j}, \qquad k = 0, \dots, K \quad \text{(eq. (19))}.ωik​=j=0∑k​δij​j​,k=0,…,K(eq. (19)).

All scenarios have probability pi=1/Np_i = 1/Npi​=1/N. The distance between scenarios is the maximum norm c(ωi,ωj)=∥ωi−ωj∥∞=max⁡0≤k≤K∣ωik−ωjk∣c(\omega_i, \omega_j) = \|\omega_i - \omega_j\|_\infty = \max_{0 \le k \le K} |\omega_i^k - \omega_j^k|c(ωi​,ωj​)=∥ωi​−ωj​∥∞​=max0≤k≤K​∣ωik​−ωjk​∣.

Deleting the scenarios of an index set JJJ and moving each deleted scenario's probability to a nearest kept scenario costs the reduction distance

DJ=∑i∈Jpimin⁡j∉J∥ωi−ωj∥∞(eq. (8)),D_J = \sum_{i \in J} p_i \min_{j \notin J} \|\omega_i - \omega_j\|_\infty \quad \text{(eq. (8))},DJ​=i∈J∑​pi​j∈/Jmin​∥ωi​−ωj​∥∞​(eq. (8)),

which by Theorem 2.1 of the paper is the optimal transport-type distance between the original distribution and the best distribution supported on the kept scenarios. The minimal reduction distance to nnn scenarios is Dnmin=min⁡{DJ:#J=N−n}D^{min}_n = \min\{D_J : \#J = N - n\}Dnmin​=min{DJ​:#J=N−n}.

Formalization targets

Goal: Proposition 3.2 (7/9-solution)

Let K≥3K \ge 3K≥3 and let k0∈arg⁡min⁡1≤k≤Kδkk_0 \in \arg\min_{1 \le k \le K} \delta^kk0​∈argmin1≤k≤K​δk with k0≤K−2k_0 \le K - 2k0​≤K−2 and max⁡{δk0+1,δk0+2}≤2δk0\max\{\delta^{k_0+1}, \delta^{k_0+2}\} \le 2\delta^{k_0}max{δk0​+1,δk0​+2}≤2δk0​. Then any two distinct scenarios are at distance at least δk0\delta^{k_0}δk0​; there is a set of 79N\tfrac79 N97​N scenarios each paired with a scenario outside it at distance exactly δk0\delta^{k_0}δk0​; and for each n∈Nn \in \mathbb{N}n∈N with 29N≤n<N\tfrac29 N \le n < N92​N≤n<N,

Dnmin=min⁡{DJ:#J=N−n}=N−nN δk0(eq. (21)),D^{min}_n = \min\{D_J : \#J = N - n\} = \frac{N - n}{N}\,\delta^{k_0} \quad \text{(eq. (21))},Dnmin​=min{DJ​:#J=N−n}=NN−n​δk0​(eq. (21)),

with the minimum attained.

Milestones

  1. Distinct scenarios satisfy ∥ωi−ωj∥∞≥δk0\|\omega_i - \omega_j\|_\infty \ge \delta^{k_0}∥ωi​−ωj​∥∞​≥δk0​.
  2. Every JJJ with #J=N−n\#J = N - n#J=N−n has DJ≥N−nNδk0D_J \ge \frac{N-n}{N}\delta^{k_0}DJ​≥NN−n​δk0​.
  3. The index set I∗∗I_{**}I∗∗​ of the proof has #I∗∗=29N\#I_{**} = \tfrac29 N#I∗∗​=92​N, and its complement J∗∗J_{**}J∗∗​ has 79N\tfrac79 N97​N elements.
  4. Every j∈J∗∗j \in J_{**}j∈J∗∗​ has a partner i∈I∗∗i \in I_{**}i∈I∗∗​ with ∥ωi−ωj∥∞=δk0\|\omega_i - \omega_j\|_\infty = \delta^{k_0}∥ωi​−ωj​∥∞​=δk0​.
  5. Example 4.2: for K=6K = 6K=6 and (δ1,…,δ6)=(0.7,0.9,1.2,1.5,2.6,3.3)(\delta^1, \dots, \delta^6) = (0.7, 0.9, 1.2, 1.5, 2.6, 3.3)(δ1,…,δ6)=(0.7,0.9,1.2,1.5,2.6,3.3), Dnmin=0.7 N−nND^{min}_n = 0.7\,\frac{N-n}{N}Dnmin​=0.7NN−n​ for 162≤n<729162 \le n < 729162≤n<729.

Significance

The result gives an exact optimal value for an NP-hard reduction problem on an infinite family of instances. Heitsch and Römisch use it in their numerical section to measure how far the heuristics' reduced trees are from optimal (Examples 4.1 and 4.2 are the binary and ternary test trees of that study). A closed form of this kind is also the only way to certify that a heuristic is exactly optimal on some instances rather than only competitive with other heuristics.

The proposition is proved in the paper, but the published proof of its central step is one sentence: "Similarly as in Proposition 3.1 it can be shown that there exists an index i∈I∗∗i \in I_{**}i∈I∗∗​ for each j∈J∗∗j \in J_{**}j∈J∗∗​ …". A formal proof supplies that case analysis, which is absent from the literature. The formalization also settles two points the printed statement leaves loose (see Formalization scope): the count of pairs at distance δk0\delta^{k_0}δk0​, and the definition of I∗∗I_{**}I∗∗​ when some widths vanish. No machine-checked version of this result or of the reduction distance DJD_JDJ​ is known to exist.

Difficulty

The lower bound is routine: two distinct scenarios first differ at some level lll, where their coordinates differ by δl\delta^lδl or 2δl2\delta^l2δl. The substance is attainment: one must exhibit, for every n≥29Nn \ge \tfrac29 Nn≥92​N, a kept set of size nnn whose every deleted scenario lies at distance exactly δk0\delta^{k_0}δk0​ from some kept one. The obvious candidate, keeping the scenarios that take the middle branch at level k0k_0k0​, has every other scenario at distance exactly δk0\delta^{k_0}δk0​ from a kept one, but it keeps 13N\tfrac13 N31​N scenarios and so covers only n≥13Nn \ge \tfrac13 Nn≥31​N. Going down to 29N\tfrac29 N92​N kept scenarios forces a deleted scenario and its partner to differ at more than one level, and since coordinates are running sums the differences at levels k0+1k_0+1k0​+1 and k0+2k_0+2k0​+2 accumulate on top of the one at level k0k_0k0​. The paper's proof of this step is not written out, and it depends on the widths of the two levels below k0k_0k0​: the hypothesis max⁡{δk0+1,δk0+2}≤2δk0\max\{\delta^{k_0+1}, \delta^{k_0+2}\} \le 2\delta^{k_0}max{δk0​+1,δk0​+2}≤2δk0​ is essential, and the result is false without it (for K=3K = 3K=3 and (δ1,δ2,δ3)=(1,3,3)(\delta^1, \delta^2, \delta^3) = (1, 3, 3)(δ1,δ2,δ3)=(1,3,3) one has D6min=31/27D^{min}_6 = 31/27D6min​=31/27, not 7/97/97/9).

Formalization scope

  • A scenario is an index tuple σ:Fin K→Fin 3\sigma : \mathrm{Fin}\,K \to \mathrm{Fin}\,3σ:FinK→Fin3; σ(r)\sigma(r)σ(r) is the successor at paper level r+1r + 1r+1, with Fin 3\mathrm{Fin}\,3Fin3 values 0,1,20, 1, 20,1,2 standing for the paper's i=1,2,3i = 1, 2, 3i=1,2,3. The widths are δ:N→R\delta : \mathbb{N} \to \mathbb{R}δ:N→R, of which only δ(1),…,δ(K)\delta(1), \dots, \delta(K)δ(1),…,δ(K) are used; the standing assumption δk∈R+\delta^k \in \mathbb{R}_+δk∈R+​ (p. 196) is the hypothesis δ(k)≥0\delta(k) \ge 0δ(k)≥0 for 1≤k≤K1 \le k \le K1≤k≤K. Scenarios live in Fin(K+1)→R\mathrm{Fin}(K+1) \to \mathbb{R}Fin(K+1)→R, whose Mathlib norm is the maximum norm. Probabilities are uniform, 1/3K1/3^K1/3K.
  • DJD_JDJ​ is defined for a general finite index set, probabilities and cost, with the inner minimum a Finset.inf' over the complement of JJJ; the complement must be nonempty, so no default value arises. DnminD^{min}_nDnmin​ is stated as IsLeast of the set of all values DJD_JDJ​ with #J=N−n\#J = N - n#J=N−n: the goal asserts both the lower bound for every JJJ and attainment by some JJJ. A formalization that exhibits a single JJJ with DJ=N−nNδk0D_J = \frac{N-n}{N}\delta^{k_0}DJ​=NN−n​δk0​, or states an infimum without attainment, or drops any hypothesis on k0k_0k0​, is a different (and in the last case false) statement.
  • 29N≤n\tfrac29 N \le n92​N≤n is written 2⋅3K≤9n2 \cdot 3^K \le 9n2⋅3K≤9n, and 79N\tfrac79 N97​N as 7⋅3K−27 \cdot 3^{K-2}7⋅3K−2.
  • Pairs. As printed, "there are 79N\tfrac79 N97​N distinct pairs of scenarios such that the distance between the members of each pair is exactly δk0\delta^{k_0}δk0​" is false as an exact count (for K=3K = 3K=3 and δ=(1,1,1)\delta = (1,1,1)δ=(1,1,1) there are 130 such pairs, not 21). The goal states what the proof constructs: a set J∗∗J_{**}J∗∗​ of 79N\tfrac79 N97​N scenarios, each paired with a scenario outside J∗∗J_{**}J∗∗​ at distance exactly δk0\delta^{k_0}δk0​.
  • I∗∗I_{**}I∗∗​. The paper defines I∗∗I_{**}I∗∗​ by testing whether the increments δikk\delta^k_{i_k}δik​k​ vanish. When one of δk0,δk0+1,δk0+2\delta^{k_0}, \delta^{k_0+1}, \delta^{k_0+2}δk0​,δk0​+1,δk0​+2 is 000 this no longer identifies the middle branch and the count 29N\tfrac29 N92​N fails, although the proposition remains true. The formalization defines I∗∗I_{**}I∗∗​ by branch indices (middle branch versus outer branches), which agrees with the paper whenever these three widths are positive. No positivity hypothesis is added to the goal.
  • Welcome contributions: a reusable library for regular scenario trees (first differing level, distance of paths), and the case analysis of milestone 4. The binary mission of this series needs the same lower-bound argument with the constant 2δk02\delta^{k_0}2δk0​.

Selected references

  • H. Heitsch, W. Römisch, Scenario Reduction Algorithms in Stochastic Programming, Computational Optimization and Applications 24 (2003), 187–206. https://doi.org/10.1023/A:1021805924152
  • J. Dupačová, N. Gröwe-Kuska, W. Römisch, Scenario reduction in stochastic programming: An approach using probability metrics, Mathematical Programming 95 (2003), 493–511. https://doi.org/10.1007/s10107-002-0331-0
9 thms3 active usersReviewed
🏆Completed
CombinatoricsOptimization·Captain: mikedeng1

Scenario Reduction Algorithms in Stochastic Programming II: The Minimal Reduction Distance of a Regular Binary Scenario TreeResearch Paper

Why exact reduction distances matter

Multistage stochastic programs are solved on a finite scenario tree, a discrete probability measure whose atoms are paths of a stochastic process. The size of the deterministic equivalent grows with the number of scenarios, so practitioners replace the original measure P=∑i=1NpiδωiP=\sum_{i=1}^N p_i\delta_{\omega_i}P=∑i=1N​pi​δωi​​ by a measure supported on n<Nn<Nn<N of its scenarios. Stability theory for stochastic programs (Dupačová, Gröwe-Kuska and Römisch, Math. Program. 95 (2003), doi:10.1007/s10107-002-0331-0) bounds the change of the optimal value by a probability metric between the two measures, which leads to the optimal scenario reduction problem: choose which N−nN-nN−n scenarios to delete so that this distance is smallest.

That problem is a set-covering problem and is NP-hard, and the algorithms that Heitsch and Römisch study in the same paper (backward reduction, fast forward selection) are heuristics without error guarantees. To test them one needs original measures whose optimal reduction distance is known exactly. Section 3 of Heitsch and Römisch, Scenario Reduction Algorithms in Stochastic Programming, Comput. Optim. Appl. 24 (2003) (doi:10.1023/A:1021805924152) supplies such instances: regular binary and ternary scenario trees, for which the minimal distance to any reduced tree with at least a fixed fraction of the scenarios is an explicit formula. This mission formalizes the binary case, Proposition 3.1.

Setting

Fix a horizon K∈NK\in\mathbb NK∈N and level parameters δ1,…,δK≥0\delta^1,\dots,\delta^K\ge0δ1,…,δK≥0, with δ0=0\delta^0=0δ0=0. A regular binary scenario tree has N=2KN=2^KN=2K scenarios. A scenario is determined by a branch ik∈{1,2}i_k\in\{1,2\}ik​∈{1,2} at every level k=1,…,Kk=1,\dots,Kk=1,…,K, and is the vector ωi=(ωi0,…,ωiK)∈RK+1\omega_i=(\omega_i^0,\dots,\omega_i^K)\in\mathbb R^{K+1}ωi​=(ωi0​,…,ωiK​)∈RK+1 with

ωik=∑j=0kδijj,δijj=(2ij−3) δj∈{−δj,+δj}.(19)\omega_i^k=\sum_{j=0}^k\delta^j_{i_j},\qquad \delta^j_{i_j}=(2i_j-3)\,\delta^j\in\{-\delta^j,+\delta^j\}.\tag{19}ωik​=j=0∑k​δij​j​,δij​j​=(2ij​−3)δj∈{−δj,+δj}.(19)

All scenarios start at the root ωi0=0\omega_i^0=0ωi0​=0 and carry probability pi=1/Np_i=1/Npi​=1/N. Scenarios are compared in the maximum norm ∥ω−ω~∥∞=max⁡k=0,…,K∣ωk−ω~k∣\|\omega-\tilde\omega\|_\infty=\max_{k=0,\dots,K}|\omega^k-\tilde\omega^k|∥ω−ω~∥∞​=maxk=0,…,K​∣ωk−ω~k∣.

Deleting the scenarios with indices in J⊂{1,…,N}J\subset\{1,\dots,N\}J⊂{1,…,N} and moving each deleted scenario's probability to a nearest kept scenario costs the reduction cost

DJ=∑i∈Jpimin⁡j∉J∥ωi−ωj∥∞,(8)D_J=\sum_{i\in J}p_i\min_{j\notin J}\|\omega_i-\omega_j\|_\infty,\tag{8}DJ​=i∈J∑​pi​j∈/Jmin​∥ωi​−ωj​∥∞​,(8)

which by Theorem 2.1 of the paper is the minimal Kantorovich-type distance between PPP and a measure supported on the kept scenarios. The minimal reduction distance for nnn kept scenarios is Dnmin=min⁡{DJ:#J=N−n}D^{min}_n=\min\{D_J:\#J=N-n\}Dnmin​=min{DJ​:#J=N−n}.

In the Lean development, scenarios are indexed by σ : Fin K → Fin 2 (Fin-index rrr is tree level r+1r+1r+1, value 000 is the branch −δ-\delta−δ, value 111 is +δ+\delta+δ), lev σ k is the branch at level kkk, scenario δ σ : Fin (K+1) → ℝ is ωσ\omega_\sigmaωσ​, and redCost δ J hJ is DJD_JDJ​.

Formalization targets

Goal: Proposition 3.1 (3/4-solution)

Let K≥3K\ge3K≥3, k0∈arg⁡min⁡1≤k≤Kδkk_0\in\arg\min_{1\le k\le K}\delta^kk0​∈argmin1≤k≤K​δk, k0≤K−2k_0\le K-2k0​≤K−2 and max⁡{δk0+1,δk0+2}≤2δk0\max\{\delta^{k_0+1},\delta^{k_0+2}\}\le2\delta^{k_0}max{δk0​+1,δk0​+2}≤2δk0​. Then any two distinct scenarios are at distance at least 2δk02\delta^{k_0}2δk0​; there is a set J∗J_*J∗​ of 34N\frac34N43​N scenarios each of which has a partner outside J∗J_*J∗​ at distance exactly 2δk02\delta^{k_0}2δk0​; and for every n∈Nn\in\mathbb Nn∈N with N4≤n<N\frac N4\le n<N4N​≤n<N

Dnmin=min⁡{DJ:#J=N−n}=N−nN 2δk0.(20)D^{min}_n=\min\{D_J:\#J=N-n\}=\frac{N-n}{N}\,2\delta^{k_0}.\tag{20}Dnmin​=min{DJ​:#J=N−n}=NN−n​2δk0​.(20)

Milestones

  1. Two scenarios that first differ at level lll are at distance ≥2δl≥2δk0\ge2\delta^l\ge2\delta^{k_0}≥2δl≥2δk0​.
  2. DJ≥N−nN2δk0D_J\ge\frac{N-n}{N}2\delta^{k_0}DJ​≥NN−n​2δk0​ for every JJJ with #J=N−n\#J=N-n#J=N−n.
  3. The index set I∗I_*I∗​ (branch at k0k_0k0​ opposite to the common branch at k0+1,k0+2k_0+1,k_0+2k0​+1,k0​+2) has #I∗=N/4\#I_*=N/4#I∗​=N/4, so #J∗=34N\#J_*=\frac34N#J∗​=43​N.
  4. Every j∈J∗j\in J_*j∈J∗​ has a partner i∈I∗i\in I_*i∈I∗​ with ∥ωi−ωj∥∞=2δk0\|\omega_i-\omega_j\|_\infty=2\delta^{k_0}∥ωi​−ωj​∥∞​=2δk0​.
  5. Example 4.1: for K=10K=10K=10 and the paper's parameters, Proposition 3.1 applies with k0=1k_0=1k0​=1 and Dnmin=N−nND^{min}_n=\frac{N-n}{N}Dnmin​=NN−n​ for 256≤n<1024256\le n<1024256≤n<1024.

Significance

The result. Proposition 3.1 gives the exact optimum of an NP-hard combinatorial problem on an explicit, parametrized family of instances of every size N=2KN=2^KN=2K. Section 4 of the paper uses it (Example 4.1, N=1024N=1024N=1024) as ground truth for the relative accuracy of backward reduction and fast forward selection. Without it, the quality of a heuristic reduction on a large tree could only be compared with other heuristics or with lower bounds.

The formalization. The proposition is proved in the paper; to our knowledge no machine-checked version exists. A formal proof certifies the benchmark values, and the statement also corrects the printed text in two places. First, "there are 34N\frac34N43​N distinct pairs … at distance exactly 2δk02\delta^{k_0}2δk0​" is false as an exact count (for K=3K=3K=3, δ=(1,1,1)\delta=(1,1,1)δ=(1,1,1) there are twenty such pairs, not six), so the goal states "at least", in the form the proof exhibits. Second, the paper's sign-based definition of I∗I_*I∗​ degenerates when some δk=0\delta^k=0δk=0, although the proposition still holds; the mission defines I∗I_*I∗​ by branch indices.

Difficulty

The lower bound is a direct computation. The content is the matching upper bound: a set JJJ of the prescribed size for which every deleted scenario has a kept scenario at the minimal possible distance. A natural first attempt pairs scenarios that differ only at level k0k_0k0​. That handles only half of the scenarios with a single partner each, and it cannot reach 34N\frac34N43​N deleted scenarios. Once scenarios differ at more than one level, their maximum-norm distance is a maximum of several partial sums, and keeping all of them at most 2δk02\delta^{k_0}2δk0​ is exactly where the hypothesis max⁡{δk0+1,δk0+2}≤2δk0\max\{\delta^{k_0+1},\delta^{k_0+2}\}\le2\delta^{k_0}max{δk0​+1,δk0​+2}≤2δk0​ enters. Without it, eq. (20) fails: for K=3K=3K=3, δ=(1,3,3)\delta=(1,3,3)δ=(1,3,3) and n=2n=2n=2 the true minimum is 52\frac5225​, not 32\frac3223​. The passage from n=N/4n=N/4n=N/4 to general n≥N/4n\ge N/4n≥N/4 also needs care: the deleted set must shrink while each remaining deleted scenario keeps its partner among the kept ones.

Formalization scope

  • The index type is Fin K → Fin 2, which has exactly 2K2^K2K elements. The paper's (K+1)(K+1)(K+1)-tuple has a level-0 entry with no choice, so it is dropped, and the vector ω\omegaω keeps its K+1K+1K+1 coordinates with ω0=0\omega^0=0ω0=0.
  • The parameters are δ : ℕ → ℝ, with δk≥0\delta^k\ge0δk≥0 and the arg min stated for k=1,…,Kk=1,\dots,Kk=1,…,K only. δk>0\delta^k>0δk>0 is not assumed, because the paper allows δk∈R+\delta^k\in\mathbb R_+δk∈R+​ and the proposition holds with zeros.
  • The cost is Mathlib's norm on Fin (K+1) → ℝ, which is the maximum norm, and pi=1/2Kp_i=1/2^Kpi​=1/2K is written out.
  • DJD_JDJ​ requires a nonempty set of kept scenarios, and its inner minimum is a finite Finset.inf'.
  • DnminD^{min}_nDnmin​ is stated with IsLeast over the set of attained values DJD_JDJ​, #J=N−n\#J=N-n#J=N−n, so both the lower bound and attainment are part of the goal. A proof of DJ≤N−nN2δk0D_{J}\le\frac{N-n}{N}2\delta^{k_0}DJ​≤NN−n​2δk0​ for a single exhibited JJJ, or a real infimum without attainment, does not prove the goal.
  • "N4≤n\frac N4\le n4N​≤n" is written 2K≤4n2^K\le4n2K≤4n, and 34N\frac34N43​N is 3⋅2K−23\cdot2^{K-2}3⋅2K−2.
  • The pairs claim is "at least 34N\frac34N43​N pairs", expressed as a set J∗J_*J∗​ of that size with a partner outside J∗J_*J∗​ for every member.
  • All hypotheses on k0k_0k0​ appear in the goal; dropping any of them makes (20) false.

Useful infrastructure: sup-norm lemmas for Fin n → ℝ (pi_norm_le_iff_of_nonneg, norm_le_pi_norm), Finset.inf' lemmas, and counting functions Fin K → Fin 2 with prescribed values (Fintype.card_fun, Fintype.card_pi). The tree and reduction-cost definitions are shared in spirit with the ternary-tree mission of this series (Proposition 3.2), and a proof whose structure transfers to d=3d=3d=3 is welcome. Contributions of proofs of the milestones individually, in any order, are welcome.

Selected references

  • H. Heitsch, W. Römisch, Scenario Reduction Algorithms in Stochastic Programming, Computational Optimization and Applications 24 (2003), 187–206. doi:10.1023/A:1021805924152
  • J. Dupačová, N. Gröwe-Kuska, W. Römisch, Scenario reduction in stochastic programming: An approach using probability metrics, Mathematical Programming 95 (2003), 493–511. doi:10.1007/s10107-002-0331-0
9 thms3 active usersReviewed
🏆Completed
Optimal TransportOptimization·Captain: mikedeng1

Scenario Reduction Algorithms in Stochastic Programming I: Fast Forward Selection Realizes the Forward Selection PrincipleResearch Paper

Why reduce scenarios

Multistage and two-stage stochastic programs are solved numerically on a discrete probability distribution: a finite set of scenarios ω1,…,ωN\omega_1,\dots,\omega_Nω1​,…,ωN​ with probabilities p1,…,pNp_1,\dots,p_Np1​,…,pN​. The size of the resulting optimization problem grows with NNN, and scenario sets produced by sampling or by historical data are often far too large to be solved directly. Scenario reduction replaces the original distribution by one supported on a small subset of the scenarios, chosen so that the optimal value and solutions of the stochastic program change as little as possible.

Stability theory for stochastic programs (Rachev and Römisch, 2002) shows that this change is controlled by a probability distance of Fortet–Mourier type, which for discrete measures is bounded by the value of a transportation problem. Dupačová, Gröwe-Kuska and Römisch (2003) turned this into a combinatorial problem and proposed greedy backward and forward heuristics. Heitsch and Römisch (2003) gave faster versions of both heuristics; the forward version, fast forward selection, is the subject of this mission. Implementations of these reduction heuristics are distributed with the GAMS modelling system (SCENRED) and are used in energy and finance applications of stochastic programming.

Setting

Let EEE be a finite-dimensional real vector space with a norm ∥⋅∥\|\cdot\|∥⋅∥, let ω0∈E\omega_0\in Eω0​∈E, and let h:[0,∞)→[0,∞)h:[0,\infty)\to[0,\infty)h:[0,∞)→[0,∞) be continuous and nondecreasing with h(0)=0h(0)=0h(0)=0. The cost between two points of EEE is

c(ω,ω~)=max⁡{1, h(∥ω−ω0∥), h(∥ω~−ω0∥)} ∥ω−ω~∥.c(\omega,\tilde\omega)=\max\bigl\{1,\,h(\|\omega-\omega_0\|),\,h(\|\tilde\omega-\omega_0\|)\bigr\}\,\|\omega-\tilde\omega\| .c(ω,ω~)=max{1,h(∥ω−ω0​∥),h(∥ω~−ω0​∥)}∥ω−ω~∥.

It is nonnegative, symmetric, and zero on the diagonal.

The original distribution is P=∑i=1NpiδωiP=\sum_{i=1}^N p_i\delta_{\omega_i}P=∑i=1N​pi​δωi​​ with pi>0p_i>0pi​>0 and ∑ipi=1\sum_i p_i=1∑i​pi​=1. Deleting the scenarios in a set J⊂{1,…,N}J\subset\{1,\dots,N\}J⊂{1,…,N} and assigning new weights qj≥0q_j\ge 0qj​≥0, ∑j∉Jqj=1\sum_{j\notin J}q_j=1∑j∈/J​qj​=1, to the kept ones gives Q=∑j∉JqjδωjQ=\sum_{j\notin J}q_j\delta_{\omega_j}Q=∑j∈/J​qj​δωj​​. The distance D(J;q)D(J;q)D(J;q) between PPP and QQQ is the optimal value of the transportation problem

D(J;q)=min⁡{∑i=1N∑j∉Jc(ωi,ωj)ηij: ηij≥0, ∑iηij=qj, ∑j∉Jηij=pi}.D(J;q)=\min\Bigl\{\sum_{i=1}^N\sum_{j\notin J}c(\omega_i,\omega_j)\eta_{ij}:\ \eta_{ij}\ge 0,\ \sum_{i}\eta_{ij}=q_j,\ \sum_{j\notin J}\eta_{ij}=p_i\Bigr\}.D(J;q)=min{i=1∑N​j∈/J∑​c(ωi​,ωj​)ηij​: ηij​≥0, i∑​ηij​=qj​, j∈/J∑​ηij​=pi​}.

The reduction cost of deleting JJJ is

DJ=∑i∈Jpimin⁡j∉Jc(ωi,ωj),D_J=\sum_{i\in J}p_i\min_{j\notin J}c(\omega_i,\omega_j),DJ​=i∈J∑​pi​j∈/Jmin​c(ωi​,ωj​),

and the optimal reduction problem (8) minimizes DJD_JDJ​ over all JJJ with #J=N−n\#J=N-n#J=N−n, where nnn is the number of scenarios to keep.

Forward selection builds the kept set greedily. With J[0]={1,…,N}J^{[0]}=\{1,\dots,N\}J[0]={1,…,N} and J[i]={1,…,N}∖{u1,…,ui}J^{[i]}=\{1,\dots,N\}\setminus\{u_1,\dots,u_i\}J[i]={1,…,N}∖{u1​,…,ui​}, it chooses

ui∈arg⁡min⁡u∈J[i−1]DJ[i−1]∖{u},i=1,…,n.(16)u_i\in\arg\min_{u\in J^{[i-1]}}D_{J^{[i-1]}\setminus\{u\}},\qquad i=1,\dots,n. \tag{16}ui​∈argu∈J[i−1]min​DJ[i−1]∖{u}​,i=1,…,n.(16)

Fast forward selection (Algorithm 2.4) computes the same choices through an updated cost matrix: cku[1]=c(ωk,ωu)c^{[1]}_{ku}=c(\omega_k,\omega_u)cku[1]​=c(ωk​,ωu​), cku[i]=min⁡{cku[i−1],ckui−1[i−1]}c^{[i]}_{ku}=\min\{c^{[i-1]}_{ku},c^{[i-1]}_{ku_{i-1}}\}cku[i]​=min{cku[i−1]​,ckui−1​[i−1]​}, zu[i]=∑k∈J[i−1]∖{u}pkcku[i]z^{[i]}_u=\sum_{k\in J^{[i-1]}\setminus\{u\}}p_kc^{[i]}_{ku}zu[i]​=∑k∈J[i−1]∖{u}​pk​cku[i]​, and ui∈arg⁡min⁡u∈J[i−1]zu[i]u_i\in\arg\min_{u\in J^{[i-1]}}z^{[i]}_uui​∈argminu∈J[i−1]​zu[i]​.

Formalization targets

Goal: Theorem 2.5

For 1≤n≤N1\le n\le N1≤n≤N and every run u1,…,unu_1,\dots,u_nu1​,…,un​ of Algorithm 2.4, with any tie-breaking in the arg min,

ui satisfies (16)andzui[i]=DJ[i](i=1,…,n).u_i\ \text{satisfies (16)}\quad\text{and}\quad z^{[i]}_{u_i}=D_{J^{[i]}}\qquad(i=1,\dots,n).ui​ satisfies (16)andzui​[i]​=DJ[i]​(i=1,…,n).

Milestones

  1. Theorem 2.1 (redistribution). For JJJ with at least one kept scenario, DJ=min⁡qD(J;q)D_J=\min_q D(J;q)DJ​=minq​D(J;q), and the minimum is attained at qˉj=pj+∑i∈J, j(i)=jpi\bar q_j=p_j+\sum_{i\in J,\,j(i)=j}p_iqˉ​j​=pj​+∑i∈J,j(i)=j​pi​ for every choice of nearest kept scenarios j(i)j(i)j(i).
  2. Eq. (10). D{1,…,N}∖{u}=∑i=1Npic(ωi,ωu)D_{\{1,\dots,N\}\setminus\{u\}}=\sum_{i=1}^Np_ic(\omega_i,\omega_u)D{1,…,N}∖{u}​=∑i=1N​pi​c(ωi​,ωu​), so (8) with #J=N−1\#J=N-1#J=N−1 is problem (10).
  3. Eq. (12). The sum lblblb of the N−nN-nN−n smallest single-deletion costs plmin⁡j≠lc(ωl,ωj)p_l\min_{j\neq l}c(\omega_l,\omega_j)pl​minj=l​c(ωl​,ωj​), taken in the greedy order (11), is at most DJD_JDJ​ for every JJJ with #J=N−n\#J=N-n#J=N−n.
  4. Optimality condition (p. 191). If each lil_ili​ has a nearest other scenario outside {l1,…,lN−n}∖{li}\{l_1,\dots,l_{N-n}\}\setminus\{l_i\}{l1​,…,lN−n​}∖{li​}, then {l1,…,lN−n}\{l_1,\dots,l_{N-n}\}{l1​,…,lN−n​} solves (8).
  5. Eq. (17), unrolled recursion. For any index sequence, cku[i]=min⁡j∉J[i−1]∖{u}c(ωk,ωj)c^{[i]}_{ku}=\min_{j\notin J^{[i-1]}\setminus\{u\}}c(\omega_k,\omega_j)cku[i]​=minj∈/J[i−1]∖{u}​c(ωk​,ωj​) for u∈J[i−1]u\in J^{[i-1]}u∈J[i−1].
  6. Eq. (17), conclusion. For any index sequence, zu[i]=DJ[i−1]∖{u}z^{[i]}_u=D_{J^{[i-1]}\setminus\{u\}}zu[i]​=DJ[i−1]∖{u}​ for u∈J[i−1]u\in J^{[i-1]}u∈J[i−1].

Significance

Theorem 2.5 certifies that the cheap update of Algorithm 2.4 (one pairwise minimum per matrix entry and step) produces exactly the greedy forward selection defined through the reduction costs, and that the running objective zui[i]z^{[i]}_{u_i}zui​[i]​ is the reduction cost of the scenarios deleted so far. Combined with Theorem 2.1, zui[i]z^{[i]}_{u_i}zui​[i]​ is the optimal transportation distance between PPP and the best measure on the kept scenarios, which is the quantity practitioners monitor to decide how many scenarios to keep. The lower bound (12) and the optimality condition give a posteriori quality certificates for any reduced set.

All results of this mission are proved in the paper or in the works it cites (Dupačová et al., 2003); none is open. To the best of a platform search, none has been machine-checked. The mission provides a verified specification of a widely deployed algorithm, a formal link between a combinatorial set-covering objective and a finite transportation problem, and definitions (reduction cost, transportation plans with a partially free target marginal, greedy runs with arbitrary tie-breaking) reusable by the regular-tree missions of this series and by later scenario-tree construction papers.

Difficulty

The mathematics is elementary; the difficulty is bookkeeping. The recursion for c[i]c^{[i]}c[i] refers to the previous step's column ui−1u_{i-1}ui−1​, which itself was updated, so unrolling it to a minimum over {u,u1,…,ui−1}\{u,u_1,\dots,u_{i-1}\}{u,u1​,…,ui−1​} is an induction on iii in which the index sets J[i]J^{[i]}J[i], the 1-based step counter and the complement structure all move together. The natural first attempt, identifying cku[i]c^{[i]}_{ku}cku[i]​ with the minimum over the complement of J[i]J^{[i]}J[i], is off by one step: the correct set is the complement of J[i−1]∖{u}J^{[i-1]}\setminus\{u\}J[i−1]∖{u}, which contains uuu itself. For Theorem 2.1 the lower bound requires using that c(ωi,ωi)=0c(\omega_i,\omega_i)=0c(ωi​,ωi​)=0 for kept scenarios and that every plan ships all of pip_ipi​ somewhere outside JJJ; the attainment part requires constructing the plan explicitly from the choice j(⋅)j(\cdot)j(⋅), including scenarios for which several kept scenarios are equally near.

Formalization scope

  • Scenarios are ω : Fin N → E with E a finite-dimensional real normed space; the paper's closed set Ω⊂Rs\Omega\subset\mathbb R^sΩ⊂Rs plays no role beyond containing the scenarios and is omitted. Scenarios need not be distinct.
  • hhh is a function ℝ → ℝ with the paper's assumptions imposed on [0,∞)[0,\infty)[0,∞) (IsGrowthFunction); every theorem carries them, together with pi>0p_i>0pi​>0 and ∑ipi=1\sum_ip_i=1∑i​pi​=1.
  • The functions f0f_0f0​, ggg and the stochastic program (1)–(2) that motivate ccc appear in no statement.
  • D(J;q)D(J;q)D(J;q) is the paper's finite transportation problem (p. 188), not the Kantorovich functional on measures. Weights qqq and plans η\etaη are indexed by all of {1,…,N}\{1,\dots,N\}{1,…,N} with entries at deleted indices fixed to 000.
  • DJD_JDJ​ requires a proof that the complement of JJJ is nonempty; minima are Finset.inf', never a real infimum with a default value.
  • Algorithm 2.4 is a relation on sequences u : ℕ → Fin N with 1-based steps. c[i]c^{[i]}c[i] is the printed recursion, extended to all indices; runs are any sequences satisfying the arg-min conditions, so every tie-breaking rule is covered.
  • The paper's standing restriction n<Nn<Nn<N is relaxed to n≤Nn\le Nn≤N in Theorem 2.5; the statement remains true at n=Nn=Nn=N.
  • A trivializing formalization is ruled out: defining c[i]c^{[i]}c[i] or z[i]z^{[i]}z[i] directly as the minimum over the selected set or as DJ[i−1]∖{u}D_{J^{[i-1]}\setminus\{u\}}DJ[i−1]∖{u}​ would make Theorem 2.5 hold by definition, and proving it for one fixed tie-breaking rule would prove less than the paper; neither is done.
  • Proofs of the milestones, alternative proofs of Theorem 2.1 via LP duality, and a verified executable implementation of Algorithm 2.4 are all welcome.

Selected references

  • H. Heitsch, W. Römisch, Scenario Reduction Algorithms in Stochastic Programming, Computational Optimization and Applications 24 (2003), 187–206. https://doi.org/10.1023/A:1021805924152
  • J. Dupačová, N. Gröwe-Kuska, W. Römisch, Scenario reduction in stochastic programming: an approach using probability metrics, Mathematical Programming 95 (2003), 493–511. https://doi.org/10.1007/s10107-002-0331-0
  • S. T. Rachev, W. Römisch, Quantitative stability in stochastic programming: the method of probability metrics, Mathematics of Operations Research 27 (2002), 792–818. https://doi.org/10.1287/moor.27.4.792.304
12 thms3 active usersReviewed
🏆Completed
Convex OptimizationNumerical AnalysisOptimization·Captain: mikedeng1

Golden Ratio Algorithms for Variational Inequalities I: The Golden Ratio Algorithm with a Fixed Step Converges to a Solution of a Monotone Variational InequalityResearch Paper

Motivation

A monotone variational inequality asks for a point at which a monotone operator and a convex function are in equilibrium. It unifies convex minimization (where FFF is a gradient), convex–concave saddle-point problems (where FFF is the skew gradient of a Lagrangian), Nash equilibria of monotone games, and complementarity problems in economics and traffic assignment. In operations research, first-order methods for such problems are the workhorse behind large-scale saddle-point formulations of linear and conic programs, where only one operator evaluation and one projection or proximal step per iteration are affordable.

The classical method for Lipschitz monotone operators is Korpelevich's extragradient method (1976) and its proximal variant, Tseng's forward–backward–forward method (2000); both need two evaluations of FFF per iteration. The reflected projected gradient method of Malitsky (SIAM J. Optim., 2015) uses one evaluation of FFF but evaluates it at 2zk−zk−12z^k-z^{k-1}2zk−zk−1, a point that may lie outside the domain of ggg. Malitsky's Golden Ratio Algorithm (GRAAL), introduced in Golden Ratio Algorithms for Variational Inequalities (preprint 2018; published in Mathematical Programming, doi:10.1007/s10107-019-01416-w), uses one evaluation of FFF, always at a feasible point, and one proximal step per iteration. Its fixed-step version, Theorem 1 of that paper, is the subject of this mission; the explicit, adaptive-step version (Theorem 2) is a separate mission of this series.

Setting

Let E\mathcal EE be a finite-dimensional real inner product space with inner product ⟨⋅,⋅⟩\langle\cdot,\cdot\rangle⟨⋅,⋅⟩ and norm ∥⋅∥=⟨⋅,⋅⟩\|\cdot\| = \sqrt{\langle\cdot,\cdot\rangle}∥⋅∥=⟨⋅,⋅⟩​. Let g:E→(−∞,+∞]g:\mathcal E\to(-\infty,+\infty]g:E→(−∞,+∞] and write dom⁡g={x:g(x)<+∞}\operatorname{dom} g = \{x : g(x)<+\infty\}domg={x:g(x)<+∞}. Let F:dom⁡g→EF:\operatorname{dom} g\to\mathcal EF:domg→E. The variational inequality is

find z∗∈Esuch that⟨F(z∗),z−z∗⟩+g(z)−g(z∗) ≥ 0∀z∈E.(1)\text{find } z^*\in\mathcal E \quad\text{such that}\quad \langle F(z^*), z-z^*\rangle + g(z)-g(z^*)\ \ge\ 0\qquad \forall z\in\mathcal E. \tag{1}find z∗∈Esuch that⟨F(z∗),z−z∗⟩+g(z)−g(z∗) ≥ 0∀z∈E.(1)

The standing assumptions are:

  • (C1) the solution set SSS of (1) is nonempty;
  • (C2) ggg is proper (never −∞-\infty−∞, finite somewhere), convex, and lower semicontinuous;
  • (C3) FFF is monotone: ⟨F(u)−F(v),u−v⟩≥0\langle F(u)-F(v),u-v\rangle\ge0⟨F(u)−F(v),u−v⟩≥0 for all u,v∈dom⁡gu,v\in\operatorname{dom} gu,v∈domg.

The proximal operator of ggg is prox⁡g(z)=argmin⁡x{g(x)+12∥x−z∥2}\operatorname{prox}_g(z) = \operatorname{argmin}_x\{g(x)+\tfrac12\|x-z\|^2\}proxg​(z)=argminx​{g(x)+21​∥x−z∥2}. Let φ=5+12\varphi = \frac{\sqrt5+1}{2}φ=25​+1​ be the golden ratio, so that φ2=1+φ\varphi^2 = 1+\varphiφ2=1+φ. For a step λ>0\lambda>0λ>0 and arbitrary starting points z1,zˉ0∈Ez^1,\bar z^0\in\mathcal Ez1,zˉ0∈E, the Golden Ratio Algorithm generates, for k≥1k\ge1k≥1,

zˉk=(φ−1)zk+zˉk−1φ,zk+1=prox⁡λg(zˉk−λF(zk)).(6)\bar z^k = \frac{(\varphi-1)z^k + \bar z^{k-1}}{\varphi},\qquad z^{k+1} = \operatorname{prox}_{\lambda g}\big(\bar z^k - \lambda F(z^k)\big). \tag{6}zˉk=φ(φ−1)zk+zˉk−1​,zk+1=proxλg​(zˉk−λF(zk)).(6)

The first line is a convex combination of the newest iterate and the previous average; the second is a forward–backward step taken from the average rather than from zkz^kzk.

Formalization targets

Goal: Theorem 1

If FFF is LLL-Lipschitz on dom⁡g\operatorname{dom} gdomg (L>0L>0L>0), (C1)–(C3) hold, and λ∈(0,φ2L]\lambda\in\big(0,\frac{\varphi}{2L}\big]λ∈(0,2Lφ​], then there is z∗∈Sz^*\in Sz∗∈S with

zk→z∗andzˉk→z∗(k→∞).z^k\to z^*\qquad\text{and}\qquad \bar z^k\to z^*\qquad(k\to\infty).zk→z∗andzˉk→z∗(k→∞).

Both sequences converge, to one and the same solution. The goal is stated with the paper's exact step range; no rate is claimed, as the paper claims none.

Milestones

  1. Eq. (4), the prox-inequality: for proper convex lsc ggg,
xˉ=prox⁡gz  ⟺  ⟨xˉ−z,x−xˉ⟩≥g(xˉ)−g(x)∀x∈E.\bar x = \operatorname{prox}_g z \iff \langle\bar x - z, x-\bar x\rangle\ge g(\bar x)-g(x)\quad\forall x\in\mathcal E.xˉ=proxg​z⟺⟨xˉ−z,x−xˉ⟩≥g(xˉ)−g(x)∀x∈E.
  1. Eq. (12), an identity using only the averaging step of (6): for every point z∗z^*z∗,
∥zk+1−z∗∥2=(1+φ)∥zˉk+1−z∗∥2−φ∥zˉk−z∗∥2+1φ∥zk+1−zˉk∥2.\|z^{k+1}-z^*\|^2 = (1+\varphi)\|\bar z^{k+1}-z^*\|^2-\varphi\|\bar z^k-z^*\|^2+\tfrac1\varphi\|z^{k+1}-\bar z^k\|^2 .∥zk+1−z∗∥2=(1+φ)∥zˉk+1−z∗∥2−φ∥zˉk−z∗∥2+φ1​∥zk+1−zˉk∥2.
  1. Eq. (14), the energy inequality: for z∗∈Sz^*\in Sz∗∈S and k≥2k\ge2k≥2,
(1+φ)∥zˉk+1−z∗∥2+φ2∥zk+1−zk∥2≤(1+φ)∥zˉk−z∗∥2+φ2∥zk−zk−1∥2−φ∥zk−zˉk∥2.(1+\varphi)\|\bar z^{k+1}-z^*\|^2+\tfrac\varphi2\|z^{k+1}-z^k\|^2\le(1+\varphi)\|\bar z^k-z^*\|^2+\tfrac\varphi2\|z^k-z^{k-1}\|^2-\varphi\|z^k-\bar z^k\|^2 .(1+φ)∥zˉk+1−z∗∥2+2φ​∥zk+1−zk∥2≤(1+φ)∥zˉk−z∗∥2+2φ​∥zk−zk−1∥2−φ∥zk−zˉk∥2.
  1. Lemma 1 (Bauschke–Combettes, Theorem 5.5): a sequence that is Fejér monotone with respect to a nonempty set CCC and whose cluster points all lie in CCC converges to a point of CCC.

Significance

The result. Theorem 1 shows that monotone variational inequalities with a Lipschitz operator can be solved with one operator evaluation and one proximal step per iteration, with FFF evaluated only at points of dom⁡g\operatorname{dom} gdomg, where it is defined. This matters when FFF is expensive (a large matrix–vector product, a simulation) or undefined outside the feasible set (for instance an operator involving log⁡x\log xlogx on the positive orthant). The analysis also explains the constant: the averaging weight φ\varphiφ is the largest ccc with 1/c≥c−11/c\ge c-11/c≥c−1, and the step bound φ/(2L)\varphi/(2L)φ/(2L) follows from it. The fixed-step analysis is the template for the explicit, adaptive-step EGRAAL of the same paper (Theorem 2), which needs only local Lipschitz continuity of FFF.

The formalization. The theorem has a published proof, and no machine-checked version of it or of GRAAL is known. Mathlib contains the golden ratio, Lipschitz conditions, lower semicontinuity and cluster points, but no proximal operator of an extended-valued function, no prox-inequality and no Fejér-monotonicity convergence lemma. This mission produces those pieces and a complete convergence proof for a first-order VI method, which are reusable for projected gradient, forward–backward, extragradient and reflected-gradient analyses.

Difficulty

The naive approach, to show that ∥zk−z∗∥\|z^k-z^*\|∥zk−z∗∥ decreases, fails: GRAAL is not Fejér monotone in zkz^kzk, because the forward step is taken from the average zˉk\bar z^kzˉk and uses F(zk)F(z^k)F(zk) rather than FFF at the new point. The quantity that decreases is an energy mixing ∥zˉk−z∗∥2\|\bar z^k-z^*\|^2∥zˉk−z∗∥2 with the successive difference ∥zk−zk−1∥2\|z^k-z^{k-1}\|^2∥zk−zk−1∥2, and both the averaging identity and the Lipschitz estimate must produce matching coefficients for the cross terms to cancel. The energy inequality alone gives only boundedness and vanishing successive differences; convergence of the whole sequence, and the fact that the limit solves (1) when ggg is merely lower semicontinuous and extended-valued, is a separate step. On the formal side, ggg takes the value +∞+\infty+∞, so the prox-inequality and the variational inequality must be handled in extended arithmetic without letting ∞−∞\infty-\infty∞−∞ decide anything.

Formalization scope

  • E\mathcal EE is a type E with [NormedAddCommGroup E] [InnerProductSpace ℝ E] [FiniteDimensional ℝ E].
  • ggg is E → EReal. (C2) is IsProperConvexLSC g: never ⊥\bot⊥, somewhere finite, convex epigraph {(x,t)∈E×R:g(x)≤t}\{(x,t)\in E\times\mathbb R: g(x)\le t\}{(x,t)∈E×R:g(x)≤t}, and LowerSemicontinuous g on all of E. dom⁡g\operatorname{dom} gdomg is effDom g = {x | g x ≠ ⊤}.
  • FFF is a total function E → E; monotonicity and the Lipschitz bound ∥F(u)−F(v)∥≤L∥u−v∥\|F(u)-F(v)\|\le L\|u-v\|∥F(u)−F(v)∥≤L∥u−v∥ are required on effDom g only. The step range is 0 < λ, λ ≤ φ / (2 * L) with 0 < L and φ = Real.goldenRatio.
  • SSS is solutionSet g F: points of effDom g satisfying (1) for every z∈Ez\in Ez∈E, evaluated in EReal.
  • The proximal step is the argmin predicate IsProxPoint (fun x => λ * g x) w z⁺, not a choice function, so no junk value is involved. A run of (6) is IsGRAALRun g F λ z zbar on sequences ℕ → E indexed as in the paper: z1z^1z1 and zˉ0\bar z^0zˉ0 are free and the entry z0z^0z0 is unused.
  • The conclusion is ∃ zs ∈ solutionSet g F, Tendsto z atTop (𝓝 zs) ∧ Tendsto zbar atTop (𝓝 zs).

The hypotheses of the goal are jointly satisfiable, so the theorem is not vacuous: for g≡0g\equiv0g≡0 and F≡0F\equiv0F≡0 every point is a solution and constant sequences form a run of (6); a formalization under which IsGRAALRun has no instances, or in which SSS may be empty, is ruled out. Two hypotheses are added to printed statements and flagged in their notes: C≠∅C\neq\emptysetC=∅ in Lemma 1, which is false without it, and z1∈dom⁡gz^1\in\operatorname{dom} gz1∈domg in Eq. (14), needed at k=2k=2k=2 because the paper's FFF is only defined on dom⁡g\operatorname{dom} gdomg.

Welcome contributions: existence and uniqueness of the proximal point of a proper convex lsc function in finite dimensions; the prox-inequality; Fejér-monotonicity lemmas; the energy inequality; and the final convergence argument. The prox and Fejér infrastructure is independent of the golden ratio and is shared with the second mission of this series.

Selected references

  • Y. Malitsky, Golden Ratio Algorithms for Variational Inequalities, preprint, Optimization Online 6598, 2018. https://optimization-online.org/wp-content/uploads/2018/05/6598.pdf ; published in Mathematical Programming. https://doi.org/10.1007/s10107-019-01416-w
  • H. H. Bauschke, P. L. Combettes, Convex Analysis and Monotone Operator Theory in Hilbert Spaces, Springer, 2011 (2nd ed. 2017). https://doi.org/10.1007/978-3-319-48311-5
  • G. M. Korpelevich, The extragradient method for finding saddle points and other problems, Ekonomika i Matematicheskie Metody 12 (1976) 747–756.
  • P. Tseng, A modified forward–backward splitting method for maximal monotone mappings, SIAM J. Control Optim. 38 (2000) 431–446. https://doi.org/10.1137/S0363012998338806
  • Y. Malitsky, Projected reflected gradient methods for monotone variational inequalities, SIAM J. Optim. 25 (2015) 502–520. https://doi.org/10.1137/14097238X
8 thms3 active usersReviewed
🏆Completed
Graph TheoryOptimizationTheoretical Computer Science·Captain: mikedeng1

A New Approach to the Maximum-Flow Problem 2: The Nonsaturating-Push Bound for FIFO Push-RelabelResearch Paper

Motivation

The maximum-flow problem asks how much of a commodity can be sent from a source to a sink through a network whose edges carry capacities. It is a basic model of operations research. Transportation, scheduling, bipartite matching and image segmentation reduce to it, and it is the inner step of many combinatorial algorithms.

Goldberg and Tarjan introduced the push–relabel (preflow) method in A New Approach to the Maximum-Flow Problem (J. ACM 35(4), 1988). Ford–Fulkerson-type algorithms augment along whole source–sink paths. The push–relabel method instead moves excess flow across single edges, guided by integer distance labels on the vertices. Whatever order its local operations are applied in, it is correct and performs O(n2m)O(n^2 m)O(n2m) of them (§3 of the paper). Section 4 shows that one particular order, processing the active vertices first-in, first-out, cuts the dominant term, the number of nonsaturating pushes, to O(n3)O(n^3)O(n3). The method and its FIFO and highest-label variants are the standard practical maximum-flow codes.

Timeline:

  • 1956: Ford and Fulkerson, augmenting paths and max-flow min-cut.
  • 1970–72: Dinic, and Edmonds and Karp, give polynomial augmenting-path bounds.
  • 1974: Karzanov introduces preflows and obtains O(n3)O(n^3)O(n3).
  • 1982: Shiloach and Vishkin give a parallel O(n2log⁡n)O(n^2 \log n)O(n2logn) preflow algorithm with a first-in, first-out flavour.
  • 1988: Goldberg and Tarjan, the generic push–relabel method, the FIFO bound of this mission, and O(nmlog⁡(n2/m))O(nm \log(n^2/m))O(nmlog(n2/m)) with dynamic trees.

Setting

A flow network has a finite vertex set VVV with n=∣V∣n = |V|n=∣V∣, a capacity c(v,w)≥0c(v,w) \ge 0c(v,w)≥0 on every ordered pair, a source sss and a sink t≠st \neq st=s. The edges are the pairs with c(v,w)>0c(v,w) > 0c(v,w)>0, and there are no loops. A preflow is a function fff on vertex pairs with f(v,w)≤c(v,w)f(v,w) \le c(v,w)f(v,w)≤c(v,w) and f(v,w)=−f(w,v)f(v,w) = -f(w,v)f(v,w)=−f(w,v). Its excess e(v)=∑uf(u,v)e(v) = \sum_u f(u,v)e(v)=∑u​f(u,v) must be nonnegative at every v≠sv \neq sv=s. The residual capacity is rf(v,w)=c(v,w)−f(v,w)r_f(v,w) = c(v,w) - f(v,w)rf​(v,w)=c(v,w)−f(v,w). A labeling ddd assigns each vertex a value in N∪{∞}\mathbb{N} \cup \{\infty\}N∪{∞}. A vertex v∉{s,t}v \notin \{s,t\}v∈/{s,t} is active if d(v)<∞d(v) < \inftyd(v)<∞ and e(v)>0e(v) > 0e(v)>0.

The two basic operations (Fig. 1 of the paper) are:

  • push(v,w)(v,w)(v,w), applicable when vvv is active, rf(v,w)>0r_f(v,w) > 0rf​(v,w)>0 and d(v)=d(w)+1d(v) = d(w)+1d(v)=d(w)+1. It sends δ=min⁡(e(v),rf(v,w))\delta = \min(e(v), r_f(v,w))δ=min(e(v),rf​(v,w)) from vvv to www. The push is saturating if rf(v,w)=0r_f(v,w) = 0rf​(v,w)=0 afterwards and nonsaturating otherwise.
  • relabel(v)(v)(v), applicable when vvv is active and d(v)≤d(w)d(v) \le d(w)d(v)≤d(w) for every residual edge (v,w)(v,w)(v,w). It sets d(v)←min⁡{d(w)+1:rf(v,w)>0}d(v) \leftarrow \min\{d(w)+1 : r_f(v,w) > 0\}d(v)←min{d(w)+1:rf​(v,w)>0}.

The algorithm starts by saturating every edge leaving sss, with d(s)=nd(s) = nd(s)=n and d(v)=0d(v) = 0d(v)=0 for v≠sv \neq sv=s.

In the first-in, first-out algorithm (§4), each vertex vvv scans a fixed list L(v)L(v)L(v) of its neighbours through a current edge. The push/relabel(v)(v)(v) operation pushes through the current edge if possible. Otherwise it advances the current edge, or, at the end of the list, returns to the first edge and relabels vvv. Active vertices wait in a queue QQQ, initially {v∈V−{s,t}:c(s,v)>0}\{v \in V - \{s,t\} : c(s,v) > 0\}{v∈V−{s,t}:c(s,v)>0}. The discharge operation removes the front vertex vvv and repeats push/relabel(v)(v)(v) until e(v)=0e(v) = 0e(v)=0 or d(v)d(v)d(v) increases. Every vertex that becomes active meanwhile is appended to QQQ, and vvv is appended too if it is still active. Passes over the queue are defined inductively. Pass 1 consists of the discharges of the initially queued vertices. Pass i+1i+1i+1 consists of the discharges of vertices added during pass iii.

Formalization targets

Goal: Corollary 4.4 (p. 931)

For every network, every edge-list order, every initial queue order, and every run of the FIFO algorithm,

#{nonsaturating pushes}≤4n3.\#\{\text{nonsaturating pushes}\} \le 4n^3 .#{nonsaturating pushes}≤4n3.

The constant is the printed one.

Milestones

  • Lemma 4.1 (p. 929): the push/relabel operation relabels only when relabeling is applicable.
  • Lemma 3.5 (p. 926): from any vertex with positive excess, the source is reachable in the residual graph.
  • Lemma 3.7 (p. 927): at any time, d(v)≤2n−1d(v) \le 2n-1d(v)≤2n−1 for every vertex.
  • Lemma 3.8 (p. 927): at most 2n−12n-12n−1 relabelings per vertex and at most (2n−1)(n−2)<2n2(2n-1)(n-2) < 2n^2(2n−1)(n−2)<2n2 in total.
  • Lemma 4.3 (p. 930): at most 4n24n^24n2 passes over the queue.

Significance

Corollary 4.4 is the combinatorial core of Theorem 4.5, which states that the FIFO algorithm runs in O(n3)O(n^3)O(n3) time. Theorem 4.2 shows that the remaining work of the implementation is O(nm)O(nm)O(nm) plus constant time per nonsaturating push. The bound of Corollary 4.4 is therefore what separates the O(n3)O(n^3)O(n3) FIFO method from the O(n2m)O(n^2 m)O(n2m) bound of the generic method, which matters on dense networks. The same pass-counting argument is reused for the parallel algorithm of §6 and underlies later analyses of highest-label and wave variants.

The results are proved in the paper. Formalizing them adds an analysis of a push–relabel algorithm, which the platform does not yet have. Its existing network-flow material states max-flow min-cut and Ford–Fulkerson termination in an arc-based model with nonnegative flows (the Introduction to Linear Optimization missions). The mission builds a precise operational model of the FIFO implementation, with edge lists, current edges and a queue carrying pass numbers, and states an explicit operation count for it. A companion mission in this series treats the generic algorithm's correctness and its (2n−1)(n−2)+2nm+4n2m(2n-1)(n-2) + 2nm + 4n^2m(2n−1)(n−2)+2nm+4n2m operation bound.

Difficulty

The obvious argument is the potential-function count of §3, over the sum of the labels of active vertices. It yields only 4n2m4n^2 m4n2m and does not use the queue discipline at all. The 4n34n^34n3 bound has to charge nonsaturating pushes to passes over the queue, and then bound the number of passes by the total growth of the labels. Neither step is visible in the generic algorithm, because both depend on the order in which vertices are processed.

Making this rigorous requires invariants of the implementation that the paper uses silently:

  • a vertex is in the queue exactly when it is active, and at most once;
  • pass numbers are nondecreasing along the queue;
  • current edges only move forward between relabelings.

Lemma 4.1 in particular depends on the current-edge scan: an edge passed over earlier stays inadmissible until vvv is relabeled.

Formalization scope

The Lean development works in namespace GoldbergTarjan.FIFO. Vertices form a type V with [Fintype V] [DecidableEq V], and nnn is Fintype.card V. Capacities are c : V → V → ℝ with c ≥ 0 and c v v = 0. Flows are antisymmetric real functions on all ordered pairs, not nonnegative arc flows. Excess is computed from the flow. Labels are in ℕ∞, and the empty minimum in relabel is ⊤.

The state of the algorithm consists of the flow, the labels, the current-edge index cur v into the edge list L v, and the queue Q : List (V × ℕ), each entry tagged with its pass number. Push/relabel (Fig. 3) is a total function, and a discharge (Fig. 4) is a relation carrying the number of push/relabel operations it performs. A run consists of the states S 0, …, S K with S 0 the initial state and consecutive states related by one discharge. The printed variant of Fig. 4, which stops as soon as vvv is relabeled, is the one formalized. Counts are natural numbers over all push/relabel operations of all discharges. The number of passes is the largest pass tag of a discharged entry.

All constants are explicit, exactly as printed:

  • 2n−12n-12n−1 (Lemmas 3.7, 3.8);
  • (2n−1)(n−2)(2n-1)(n-2)(2n−1)(n−2) and 2n22n^22n2 (Lemma 3.8);
  • 4n24n^24n2 (Lemma 4.3);
  • 4n34n^34n3 (Corollary 4.4).

No asymptotic notation is used, and no m≥n−1m \ge n-1m≥n−1 assumption is made.

A model without current edges, where relabeling happens whenever no push applies, would make Lemma 4.1 vacuous and change the algorithm. Pass numbers that are not propagated by the "added during pass iii" rule would make the pass count arbitrary. Both are ruled out by the definitions. A sorry-free check, outside the proposal, exhibits a three-vertex network with two legal discharges, two passes and no nonsaturating push, so the run hypotheses are satisfiable.

Reusable beyond this mission are the network, preflow, push and relabel definitions and Lemma 3.5, which is about an arbitrary preflow. Contributions welcome: invariants of FIFO runs (preflow, valid labeling, queue = active set, cur within bounds), proofs of the milestones, and the reduction of Corollary 4.4 to Lemma 4.3.

Selected references

  • A. V. Goldberg, R. E. Tarjan, A New Approach to the Maximum-Flow Problem, Journal of the ACM 35(4):921–940, 1988. https://doi.org/10.1145/48014.61051
  • A. V. Karzanov, Determining the maximal flow in a network by the method of preflows, Soviet Math. Doklady 15:434–437, 1974.
  • Y. Shiloach, U. Vishkin, An O(n² log n) parallel max-flow algorithm, Journal of Algorithms 3(2):128–146, 1982. https://doi.org/10.1016/0196-6774(82)90013-X
  • L. R. Ford, D. R. Fulkerson, Maximal flow through a network, Canadian Journal of Mathematics 8:399–404, 1956. https://doi.org/10.4153/CJM-1956-045-5
  • J. Edmonds, R. M. Karp, Theoretical improvements in algorithmic efficiency for network flow problems, Journal of the ACM 19(2):248–264, 1972. https://doi.org/10.1145/321694.321699
10 thms3 active usersReviewed
🏆Completed
Graph TheoryOptimizationTheoretical Computer Science·Captain: mikedeng1

A New Approach to the Maximum-Flow Problem 1: The Generic Push-Relabel Algorithm and Its Operation BoundResearch Paper

Motivation

The maximum-flow problem asks how much of a commodity can be sent from a source to a sink through a network whose edges have capacities. It is a basic model in operations research (transportation, scheduling, bipartite matching) and a standard subroutine in combinatorial optimization.

Classical algorithms, from Ford and Fulkerson (1956) through Edmonds–Karp and Dinic (1970–1972) and Karzanov (1974), increase a feasible flow along augmenting paths or blocking flows. Goldberg and Tarjan, A New Approach to the Maximum-Flow Problem (J. ACM 35(4), 1988, doi:10.1145/48014.61051), replaced this global view by a local one: the push-relabel method maintains a preflow, which may violate conservation at intermediate vertices, and moves excess along edges toward vertices with smaller distance labels. The generic method, with the basic operations applied in any order, is the starting point of the FIFO, highest-label and dynamic-tree implementations analysed later in the same paper, and push-relabel codes remain among the fastest practical maximum-flow solvers.

This mission formalizes §2–§3 of the paper: the generic algorithm is correct, and it stops after a number of basic operations bounded by an explicit polynomial in the numbers of vertices and edges, whatever order of operations is chosen.

Setting

A flow network has a finite vertex set VVV with n=∣V∣n = |V|n=∣V∣, a source sss and a sink t≠st \ne st=s, and a capacity c(v,w)≥0c(v,w) \ge 0c(v,w)≥0 for every ordered pair of vertices, positive exactly on the edges E={(v,w):c(v,w)>0}E = \{(v,w) : c(v,w) > 0\}E={(v,w):c(v,w)>0}; m=∣E∣m = |E|m=∣E∣, and there are no loops, c(v,v)=0c(v,v) = 0c(v,v)=0.

Flows are real functions on all vertex pairs. A function fff satisfies the capacity constraint if f(v,w)≤c(v,w)f(v,w) \le c(v,w)f(v,w)≤c(v,w) and antisymmetry if f(v,w)=−f(w,v)f(v,w) = -f(w,v)f(v,w)=−f(w,v) for all pairs. The excess of vvv is e(v)=∑uf(u,v)e(v) = \sum_{u} f(u,v)e(v)=∑u​f(u,v). A flow also has e(v)=0e(v) = 0e(v)=0 for v∉{s,t}v \notin \{s,t\}v∈/{s,t}; a preflow only e(v)≥0e(v) \ge 0e(v)≥0 for v≠sv \ne sv=s. The value of a flow is ∣f∣=∑vf(v,t)|f| = \sum_v f(v,t)∣f∣=∑v​f(v,t), and a maximum flow is a flow of maximum value.

The residual capacity is rf(v,w)=c(v,w)−f(v,w)r_f(v,w) = c(v,w) - f(v,w)rf​(v,w)=c(v,w)−f(v,w); pairs with rf(v,w)>0r_f(v,w) > 0rf​(v,w)>0 are the edges of the residual graph GfG_fGf​. A valid labeling is d:V→N∪{∞}d : V \to \mathbb{N} \cup \{\infty\}d:V→N∪{∞} with d(s)=nd(s) = nd(s)=n, d(t)=0d(t) = 0d(t)=0 and d(v)≤d(w)+1d(v) \le d(w) + 1d(v)≤d(w)+1 on every residual edge. A vertex vvv is active if v∉{s,t}v \notin \{s,t\}v∈/{s,t}, d(v)<∞d(v) < \inftyd(v)<∞ and e(v)>0e(v) > 0e(v)>0.

The two basic operations (Fig. 1 of the paper) are:

  • Push(v,w)(v,w)(v,w), applicable when vvv is active, rf(v,w)>0r_f(v,w) > 0rf​(v,w)>0 and d(v)=d(w)+1d(v) = d(w)+1d(v)=d(w)+1: send δ=min⁡(e(v),rf(v,w))\delta = \min(e(v), r_f(v,w))δ=min(e(v),rf​(v,w)), i.e. f(v,w)+=δf(v,w) \mathrel{+}= \deltaf(v,w)+=δ, f(w,v)−=δf(w,v) \mathrel{-}= \deltaf(w,v)−=δ. It is saturating if rf(v,w)=0r_f(v,w) = 0rf​(v,w)=0 afterwards and nonsaturating otherwise.
  • Relabel(v)(v)(v), applicable when vvv is active and d(v)≤d(w)d(v) \le d(w)d(v)≤d(w) for every residual edge (v,w)(v,w)(v,w): set d(v)←min⁡{d(w)+1:(v,w)∈Ef}d(v) \leftarrow \min\{d(w)+1 : (v,w) \in E_f\}d(v)←min{d(w)+1:(v,w)∈Ef​} (∞\infty∞ if there is none).

The generic algorithm (Fig. 2) starts from the preflow that saturates every edge leaving sss and is zero elsewhere, with the simple labeling d(s)=nd(s) = nd(s)=n, d(v)=0d(v) = 0d(v)=0 otherwise, and applies applicable basic operations in any order while one exists. An execution with KKK basic operations is a sequence of states (f0,d0),…,(fK,dK)(f_0,d_0),\dots,(f_K,d_K)(f0​,d0​),…,(fK​,dK​) from the initial state, each obtained from the previous one by one applicable operation.

Formalization targets

Goal: Theorems 3.11 and 3.4

Assume the paper's standing assumption m≥n−1m \ge n-1m≥n−1. For every execution with KKK basic operations,

K≤(2n−1)(n−2)+2nm+4n2m,K \le (2n-1)(n-2) + 2nm + 4n^2 m,K≤(2n−1)(n−2)+2nm+4n2m,

and if no basic operation applies in the final state, then fKf_KfK​ is a maximum flow. The paper states the bound as O(n2m)O(n^2m)O(n2m) and proves it as "immediate from Lemmas 3.8, 3.9, and 3.10"; the goal states the sum of those three printed bounds. Since every execution is this short, no order of operations runs forever.

Milestones

In the order the proof uses them: Lemma 2.1 (at an active vertex a push or a relabel applies); Lemma 3.1 (the labeling stays valid); Theorem 3.2 (Ford–Fulkerson: a flow is maximum iff ttt is unreachable from sss in GfG_fGf​); Lemma 3.3 (under a valid labeling ttt is unreachable from sss); Lemma 3.5 (from any vertex with positive excess, sss is reachable); Lemma 3.6 (labels never decrease; a relabeling increases the label); Lemma 3.7 (d(v)≤2n−1d(v) \le 2n-1d(v)≤2n−1 throughout); Theorem 3.4 (termination with finite labels gives a maximum flow); Lemma 3.8 (≤2n−1\le 2n-1≤2n−1 relabelings per vertex, ≤(2n−1)(n−2)<2n2\le (2n-1)(n-2) < 2n^2≤(2n−1)(n−2)<2n2 in total); Lemma 3.9 (≤2nm\le 2nm≤2nm saturating pushes); Lemma 3.10 (≤4n2m\le 4n^2m≤4n2m nonsaturating pushes, under m≥n−1m \ge n-1m≥n−1). A further, non-milestone item states the unnumbered invariant that every fkf_kfk​ is a preflow.

Significance

The generic bound shows that push-relabel terminates in a polynomial number of steps without any rule for choosing the next operation; the specific orderings of §4–§5 of the paper (first-in first-out, O(n3)O(n^3)O(n3); dynamic trees, O(nmlog⁡(n2/m))O(nm\log(n^2/m))O(nmlog(n2/m))) refine only the count of nonsaturating pushes, and reuse Lemmas 3.1–3.9 unchanged. The correctness argument, a valid labeling excludes augmenting paths, is the template for the push-relabel minimum-cost flow and assignment algorithms that followed.

These results are proved in the paper and are textbook material. Their machine-checked counterparts are, as far as is known here, not on the Prove2Me platform: the platform's network-flow statements (from Introduction to Linear Optimization, e.g. LinearOptimization.max_flow_min_cut) use a different model, with arc-indexed nonnegative flows and extended-real capacities, and contain nothing about preflows, labels or operation counts. This mission produces a formal account of the antisymmetric-flow model, of Ford–Fulkerson in that model, and of the amortized counting arguments, with the constants the paper prints.

Difficulty

The correctness half is short once the invariants are in place; the difficulty is in the counting. The label bound (Lemma 3.7) is a statement about the whole execution, and it depends on a structural fact about preflows (Lemma 3.5) whose truth rests on antisymmetry and on the nonnegativity of excesses. The obvious first idea for the push counts, bounding pushes per edge or per vertex locally, fails for nonsaturating pushes: flow pushed across a pair can be pushed back later, and nothing local limits how often this happens, so Lemma 3.10 holds only as an amortized statement over the entire execution and depends on both earlier counts. Saturating pushes on a pair can also recur, in both directions, and Lemma 3.9 has to control the interaction between the two directions.

Formally, all of this is reasoning about arbitrary interleavings of operations, with labels in N∪{∞}\mathbb{N} \cup \{\infty\}N∪{∞} and real-valued flows.

Formalization scope

  • Vertices form a finite type with decidable equality; nnn is its cardinality, s≠ts \ne ts=t, so n≥2n \ge 2n≥2 and the natural-number subtractions 2n−12n-12n−1 and n−2n-2n−2 are exact. Capacities are a real function on all pairs, nonnegative, zero on the diagonal; EEE is its support and mmm its cardinality.
  • Flows and preflows are antisymmetric real functions on all pairs (not nonnegative arc flows); the excess is computed from fff, never stored. A maximum flow is a flow whose value is at least that of every flow.
  • Labels live in ℕ∞, with ∞+1=∞\infty + 1 = \infty∞+1=∞; the relabel value is an infimum, which is ∞\infty∞ on the empty set.
  • An execution is a sequence of states σ : ℕ → State V with a length KKK, starting at the Fig. 2 state with the simple labeling (the paper's own assumption for its proofs), each step an applicable push or relabel. "Terminates" means that no basic operation applies, the loop guard of Fig. 2. The three counts are cardinalities of the sets of step indices of each kind.
  • Explicit constants: 2n−12n-12n−1 per-vertex relabelings, (2n−1)(n−2)<2n2(2n-1)(n-2) < 2n^2(2n−1)(n−2)<2n2 total relabelings, 2nm2nm2nm saturating pushes, 4n2m4n^2m4n2m nonsaturating pushes, label bound 2n−12n-12n−1, and the total (2n−1)(n−2)+2nm+4n2m(2n-1)(n-2)+2nm+4n^2m(2n−1)(n−2)+2nm+4n2m. The standing assumption m≥n−1m \ge n-1m≥n−1 appears only on Lemma 3.10 and the goal.
  • A trivializing formalization is ruled out: the step relation fixes the pushed amount δ=min⁡(e(v),rf(v,w))\delta = \min(e(v), r_f(v,w))δ=min(e(v),rf​(v,w)) and the new label exactly as in Fig. 1, termination is the loop guard rather than "the result is a flow", and a sorry-free check exhibits a concrete network s→a→ts \to a \to ts→a→t with a two-step execution (relabel aaa, then push (a,t)(a,t)(a,t)), so the run hypotheses are satisfiable.

Welcome contributions: proofs of the invariants (preflow, valid labeling, label monotonicity), of Ford–Fulkerson for antisymmetric flows (reusable beyond this mission), and of the counting lemmas. The FIFO bound of §4 is the subject of a companion mission.

Selected references

  • A. V. Goldberg, R. E. Tarjan, A New Approach to the Maximum-Flow Problem, Journal of the ACM 35(4):921–940, 1988. doi:10.1145/48014.61051
  • L. R. Ford, D. R. Fulkerson, Flows in Networks, Princeton University Press, 1962.
  • J. Edmonds, R. M. Karp, Theoretical improvements in algorithmic efficiency for network flow problems, Journal of the ACM 19(2):248–264, 1972. doi:10.1145/321694.321699
  • R. K. Ahuja, T. L. Magnanti, J. B. Orlin, Network Flows: Theory, Algorithms, and Applications, Prentice Hall, 1993.
17 thms3 active usersReviewed
🏆Completed
ProbabilityStatistics·Captain: mikedeng1

Are Call Center and Hospital Arrivals Well Modeled by Nonhomogeneous Poisson Processes?: Combining k Equal Subintervals of a Linear Arrival Rate Bounds the Degree of Nonhomogeneity by C/kResearch Paper

Motivation

Arrival processes to call centers and hospital emergency departments are routinely modeled as nonhomogeneous Poisson processes (NHPPs): Poisson processes whose arrival rate varies over the day. Staffing and queueing models built on this assumption are only as good as the assumption itself, so practitioners test it on data. The standard test, going back to Brown et al. (2005, doi:10.1198/016214504000001808), divides the day into short subintervals, treats the rate as constant on each, rescales the arrival times within each subinterval to [0,1][0,1][0,1], combines all the rescaled data, and applies a Kolmogorov–Smirnov (KS) test of uniformity.

Kim and Whitt (2014, doi:10.1287/msom.2014.0490) ask when this piecewise-constant approximation is justified. If the true rate is not constant on a subinterval, the rescaled arrival times are not uniform, and with enough data the KS test rejects the Poisson hypothesis even when the process really is an NHPP. Section 3 of the paper quantifies this effect through a single number, the degree of nonhomogeneity, and shows how it behaves when the interval is cut into kkk equal pieces. This mission formalizes that section's exact computations for a linear arrival rate.

Setting

An arrival rate function λ\lambdaλ on an interval [0,T][0,T][0,T], T>0T > 0T>0, is nonnegative, integrable, and strictly positive except at finitely many points. Its cumulative arrival rate is

Λ(t)=∫0tλ(s) ds.\Lambda(t) = \int_0^t \lambda(s)\,ds .Λ(t)=∫0t​λ(s)ds.

Conditionally on nnn arrivals in [0,T][0,T][0,T], the arrival times of an NHPP with rate λ\lambdaλ, divided by TTT, are distributed as the order statistics of nnn independent random variables on [0,1][0,1][0,1] with the conditional cdf

F(t)=Λ(tT)Λ(T),0≤t≤1.F(t) = \frac{\Lambda(tT)}{\Lambda(T)}, \qquad 0 \le t \le 1 .F(t)=Λ(T)Λ(tT)​,0≤t≤1.

The degree of nonhomogeneity is the Kolmogorov distance of FFF from the uniform cdf,

D=sup⁡0≤t≤1∣F(t)−t∣.D = \sup_{0 \le t \le 1} |F(t) - t| .D=0≤t≤1sup​∣F(t)−t∣.

It is zero exactly when λ\lambdaλ is constant, and it is the limit of the KS test statistic as the amount of data grows.

For k≥1k \ge 1k≥1, divide [0,T][0,T][0,T] into kkk subintervals of length T/kT/kT/k. For 1≤j≤k1 \le j \le k1≤j≤k the jjj-th subinterval has cumulative rate Λj(t)=Λ((j−1)T/k+t)−Λ((j−1)T/k)\Lambda_j(t) = \Lambda((j-1)T/k + t) - \Lambda((j-1)T/k)Λj​(t)=Λ((j−1)T/k+t)−Λ((j−1)T/k), conditional cdf Fj(t)=Λj(tT/k)/Λj(T/k)F_j(t) = \Lambda_j(tT/k)/\Lambda_j(T/k)Fj​(t)=Λj​(tT/k)/Λj​(T/k), and share of arrivals pj=(Λ(jT/k)−Λ((j−1)T/k))/Λ(T)p_j = (\Lambda(jT/k) - \Lambda((j-1)T/k))/\Lambda(T)pj​=(Λ(jT/k)−Λ((j−1)T/k))/Λ(T). The data of all subintervals, each rescaled to [0,1][0,1][0,1] and combined, have the conditional cdf F=∑j=1kpjFjF = \sum_{j=1}^k p_j F_jF=∑j=1k​pj​Fj​ (LEMMA 1).

The linear arrival rate is λ(t)=a+bt\lambda(t) = a + btλ(t)=a+bt with b≥0b \ge 0b≥0 and a≥0a \ge 0a≥0, not identically zero. When a>0a > 0a>0 its relative slope is r=b/ar = b/ar=b/a; on the jjj-th subinterval the relative slope is rj=b/λ((j−1)T/k)r_j = b/\lambda((j-1)T/k)rj​=b/λ((j−1)T/k).

In the Lean development these are cumRate, condCdf, degree, subCum, subCdf, weight, mixCdf, linRate and subSlope, in the namespace NHPPArrivals.LinearRate.

Formalization targets

Goal: THEOREM 5, combining equally spaced subintervals

For the linear rate, there is a constant CCC such that for every k≥1k \ge 1k≥1

D=sup⁡0≤t≤1∣F(t)−t∣=∑j=1kpjDj=∑j=1kpjsup⁡0≤t≤1∣Fj(t)−t∣,(20)D = \sup_{0 \le t \le 1}|F(t) - t| = \sum_{j=1}^k p_j D_j = \sum_{j=1}^k p_j \sup_{0 \le t \le 1}|F_j(t) - t|, \tag{20}D=0≤t≤1sup​∣F(t)−t∣=j=1∑k​pj​Dj​=j=1∑k​pj​0≤t≤1sup​∣Fj​(t)−t∣,(20)

with, if a>0a > 0a>0,

D=∑j=1kpj rjT/k8+4rjT/k,(21)D = \sum_{j=1}^k \frac{p_j\, r_j T/k}{8 + 4 r_j T/k}, \tag{21}D=j=1∑k​8+4rj​T/kpj​rj​T/k​,(21)

and, if a=0a = 0a=0,

D=p14+∑j=2kpj/(j−1)8+4/(j−1),(22)D = \frac{p_1}{4} + \sum_{j=2}^k \frac{p_j/(j-1)}{8 + 4/(j-1)}, \tag{22}D=4p1​​+j=2∑k​8+4/(j−1)pj​/(j−1)​,(22)

and in both cases D≤C/kD \le C/kD≤C/k. The constant CCC may depend on aaa, bbb and TTT, but not on kkk; its value is left open, as in the paper.

Milestones

  1. LEMMA 1, (17): for a general rate, the rescaled combined data have cdf ∑jpjFj\sum_j p_j F_j∑j​pj​Fj​, and the pjp_jpj​ form a probability vector.
  2. THEOREM 4, a>0a > 0a>0, (14), (16): F(t)=(tT+r(tT)2/2)/(T+rT2/2)F(t) = (tT + r(tT)^2/2)/(T + rT^2/2)F(t)=(tT+r(tT)2/2)/(T+rT2/2) and D=∣F(1/2)−1/2∣=rT/(8+4rT)D = |F(1/2) - 1/2| = rT/(8 + 4rT)D=∣F(1/2)−1/2∣=rT/(8+4rT).
  3. THEOREM 4, a=0a = 0a=0, (15): F(t)=t2F(t) = t^2F(t)=t2 and D=1/4D = 1/4D=1/4.
  4. LEMMA 1, (18): closed forms of Λj\Lambda_jΛj​, FjF_jFj​, pjp_jpj​, rjr_jrj​ when a>0a > 0a>0.
  5. LEMMA 1, (19): closed forms of Λj\Lambda_jΛj​, FjF_jFj​, pjp_jpj​, rjr_jrj​ when a=0a = 0a=0.
  6. THEOREM 5, (20): D=∑jpjDjD = \sum_j p_j D_jD=∑j​pj​Dj​ for one fixed kkk.

Significance

The result gives a quantitative criterion for the piecewise-constant approximation: for a linear rate, cutting the interval into kkk equal pieces reduces the degree of nonhomogeneity of the combined data by a factor of order 1/k1/k1/k. Since the KS critical value at sample size nnn is of order 1/n1/\sqrt n1/n​, this tells a practitioner how fine the subintervals must be, relative to the amount of data, before a KS test of the Poisson hypothesis stops rejecting merely because the rate varies within subintervals. The paper's later THEOREM 6 and its practical guidelines (§3.4, §3.6) rest on these formulas.

The results are proved in the paper by direct calculation; none of them has a machine-checked proof. The mission produces a verified library of the conditional-cdf calculus for NHPPs on an interval (the conditional cdf, its degree of nonhomogeneity, the subinterval decomposition) and the exact linear-rate formulas that the testing literature cites.

Difficulty

The computations are elementary, but two steps are not immediate. First, the supremum of ∣F(t)−t∣|F(t) - t|∣F(t)−t∣ over [0,1][0,1][0,1] is a supremum of a nonsmooth function; showing that it is attained at t=1/2t = 1/2t=1/2 requires knowing the sign of F(t)−tF(t) - tF(t)−t on the whole interval, and for the combined cdf it requires that all the pieces FjF_jFj​ attain their maximal deviation at the same point, which is special to linear rates. For a general rate the naive identity D=∑jpjDjD = \sum_j p_j D_jD=∑j​pj​Dj​ fails: the sup of a sum is at most the sum of the sups, with equality only when the maximizers coincide. Second, LEMMA 1 is a statement about the law of a rescaled random variable (the fractional part of kX/TkX/TkX/T), which requires splitting a measure along the kkk subintervals and handling their boundary points.

Formalization scope

Rates are real functions λ:R→R\lambda : \mathbb R \to \mathbb Rλ:R→R; only their values on [0,T][0,T][0,T] enter. Λ\LambdaΛ is an interval integral, subintervals are indexed by j∈{1,…,k}j \in \{1, \dots, k\}j∈{1,…,k} with k,jk, jk,j natural numbers cast to reals, and (j−1)(j-1)(j−1) is computed in R\mathbb RR. All quotients are real divisions; the hypotheses of every statement (T>0T > 0T>0, k≥1k \ge 1k≥1, b≥0b \ge 0b≥0, and a>0a > 0a>0 or b>0b > 0b>0 for the linear rate; integrability, nonnegativity and a finite zero set for a general rate) make every denominator Λ(T)\Lambda(T)Λ(T) and Λj(T/k)\Lambda_j(T/k)Λj​(T/k) positive. b≥0b \ge 0b≥0 is the paper's standing assumption of §3.3; excluding a=b=0a = b = 0a=b=0 is §3.2's requirement that the rate be positive except at finitely many points. The degree of nonhomogeneity is sSup of the image of [0,1][0,1][0,1], and every statement that uses it also asserts that the supremum is attained, so no default value of sSup can make a statement true. The constant CCC of THEOREM 5 is quantified before kkk; choosing it after kkk would make the bound empty. The statements are about the general definitions of (17) applied to λ(t)=a+bt\lambda(t) = a + btλ(t)=a+bt, not about the closed forms (18)–(19), which are separate milestones. The formula for rjr_jrj​ in (19) is stated for 2≤j≤k2 \le j \le k2≤j≤k only: r1=b/λ(0)r_1 = b/\lambda(0)r1​=b/λ(0) is undefined when a=0a = 0a=0.

The Poisson process itself is not formalized. LEMMA 1's "i.i.d. random variables" is the paper's THEOREM 1 (the conditioning property) applied to each arrival; LEMMA 1 is stated for the law of one arrival time, the probability measure with density λ/Λ(T)\lambda/\Lambda(T)λ/Λ(T) on [0,T][0,T][0,T]. THEOREM 1, THEOREMS 2–3 and COROLLARY 1 (limits of the empirical cdf and of the KS statistic) are out of scope: they need a point-process layer, the Glivenko–Cantelli theorem and KS critical values, none of which exists in Mathlib. THEOREM 6 is out of scope because the paper gives only a sketch comparing DDD with the KS critical value.

Contributions welcome: proofs of the milestones, general lemmas on sups of ∣F(t)−t∣|F(t) - t|∣F(t)−t∣ for convex cdfs, and the measure-splitting argument of LEMMA 1, which is reusable for any subinterval-based test of the Poisson hypothesis.

Selected references

  • S.-H. Kim and W. Whitt, Are call center and hospital arrivals well modeled by nonhomogeneous Poisson processes?, Manufacturing & Service Operations Management 16(3):464–480, 2014. doi:10.1287/msom.2014.0490
  • L. Brown, N. Gans, A. Mandelbaum, A. Sakov, H. Shen, S. Zeltyn, L. Zhao, Statistical analysis of a telephone call center: a queueing-science perspective, Journal of the American Statistical Association 100(469):36–50, 2005. doi:10.1198/016214504000001808
  • F. J. Massey, The Kolmogorov–Smirnov test for goodness of fit, Journal of the American Statistical Association 46(253):68–78, 1951. doi:10.1080/01621459.1951.10500769
8 thms3 active usersReviewed
🏆Completed
Dynamic ProgrammingOptimizationTopology·Captain: mikedeng1

The Structure of Dynamic Programing Models: A Solution of the Principle of Optimality with Vanishing Tail Is the Optimal ReturnResearch Paper

Motivation

Dynamic programming, as introduced by Bellman in the early 1950s, solves sequential decision problems through a functional equation: the value of a problem started in a given state equals the best one-stage return plus the value of the problem started in the state that decision leads to. In practice the argument usually runs backwards. One writes down the functional equation, finds or characterizes a solution, and reads off the structure of optimal decisions from that solution. This is legitimate only if two things hold: an optimal policy exists at all, and the solution of the functional equation that was found is the optimal value, not some other solution of the same equation.

Samuel Karlin's 1955 paper The Structure of Dynamic Programing Models (Naval Research Logistics Quarterly 2(4):285–294) gives an abstract deterministic model in which both questions can be posed precisely. It proves existence of optimal strategies by a compactness argument (Theorem 1), derives the functional equation, which it calls the Principle of Optimality, and identifies the condition under which a solution of that equation is the optimal return: a tail term must vanish. Later treatments of dynamic programming on general state spaces, such as Blackwell's discounted and positive programming (1965–1967) and the monographs of Bertsekas and Shreve, state their verification theorems in the same form, with a solution of the optimality equation plus a condition at infinity.

Setting

The model has a state space Ω\OmegaΩ, a Hausdorff topological space, and a decision space DDD, a nonempty compact Hausdorff space. A strategy is a sequence s=(δ1,δ2,… )s = (\delta_1, \delta_2, \dots)s=(δ1​,δ2​,…) of decisions, one per stage. The strategy space S=D×D×⋯S = D \times D \times \cdotsS=D×D×⋯ carries the product topology and is compact by Tychonoff's theorem.

The data are:

  • a return function L:Ω×D→RL : \Omega \times D \to \mathbb{R}L:Ω×D→R, continuous and non-negative, where L(ω,δ)L(\omega, \delta)L(ω,δ) is the return for taking decision δ\deltaδ in state ω\omegaω;
  • a transition (δ,ω)↦Tδ ω∈Ω(\delta, \omega) \mapsto T_\delta\,\omega \in \Omega(δ,ω)↦Tδ​ω∈Ω, the state faced at the next stage after decision δ\deltaδ in state ω\omegaω;
  • a normalization factor P:D→RP : D \to \mathbb{R}P:D→R, continuous and positive.

From an initial state ω\omegaω, a strategy sss generates the trajectory ω1=ω\omega_1 = \omegaω1​=ω, ωn=Tδn−1 ωn−1\omega_n = T_{\delta_{n-1}}\,\omega_{n-1}ωn​=Tδn−1​​ωn−1​, and the weights Pn(s)=∏i=1n−1P(δi)P_n(s) = \prod_{i=1}^{n-1} P(\delta_i)Pn​(s)=∏i=1n−1​P(δi​) with P1(s)=1P_1(s) = 1P1​(s)=1. The total yield is

Φ(ω,s)=∑n=1∞L(ωn,δn) Pn(s),\Phi(\omega, s) = \sum_{n=1}^{\infty} L(\omega_n, \delta_n)\, P_n(s),Φ(ω,s)=n=1∑∞​L(ωn​,δn​)Pn​(s),

and the optimal return is K(ω)=max⁡s∈SΦ(ω,s)K(\omega) = \max_{s \in S} \Phi(\omega, s)K(ω)=maxs∈S​Φ(ω,s). The standing assumption of the paper, display (1), is that the partial sums ∑n=1kL(ωn,δn)Pn(s)\sum_{n=1}^{k} L(\omega_n, \delta_n) P_n(s)∑n=1k​L(ωn​,δn​)Pn​(s) converge uniformly in s∈Ss \in Ss∈S for each ω\omegaω.

Formalization targets

Goal: uniqueness of solutions with vanishing tail

Let M:Ω→RM : \Omega \to \mathbb{R}M:Ω→R solve the functional equation

M(ω)=max⁡δ∈D{L(ω,δ)+P(δ) M(Tδ ω)}for all ω,M(\omega) = \max_{\delta \in D} \bigl\{ L(\omega, \delta) + P(\delta)\, M(T_\delta\,\omega) \bigr\} \quad \text{for all } \omega,M(ω)=δ∈Dmax​{L(ω,δ)+P(δ)M(Tδ​ω)}for all ω,

with the maximum attained, and suppose that for every ω\omegaω

lim⁡n→∞ sup⁡δ1,…,δn∣M(ωn)∣∏i=1n−1P(δi)=0.\lim_{n \to \infty} \ \sup_{\delta_1, \dots, \delta_n} |M(\omega_n)| \prod_{i=1}^{n-1} P(\delta_i) = 0.n→∞lim​ δ1​,…,δn​sup​∣M(ωn​)∣i=1∏n−1​P(δi​)=0.

Then M(ω)=max⁡s∈SΦ(ω,s)M(\omega) = \max_{s \in S} \Phi(\omega, s)M(ω)=maxs∈S​Φ(ω,s) for every ω\omegaω, and the maximum is attained (pp. 290–291, §Uniqueness).

Milestones

  1. Theorem 1 (p. 287). If the series (1) converges uniformly in SSS, an optimal strategy s∗s^*s∗ exists: Φ(ω,s∗)=max⁡SΦ(ω,s)\Phi(\omega, s^*) = \max_S \Phi(\omega, s)Φ(ω,s∗)=maxS​Φ(ω,s).
  2. Shift identity (p. 290, first display). For a strategy sss with convergent yield series and the shift s′=(δ2,δ3,… )s' = (\delta_2, \delta_3, \dots)s′=(δ2​,δ3​,…),
Φ(ω,s)=L(ω,δ1)+P(δ1) Φ(Tδ1 ω,s′).\Phi(\omega, s) = L(\omega, \delta_1) + P(\delta_1)\, \Phi(T_{\delta_1}\,\omega, s').Φ(ω,s)=L(ω,δ1​)+P(δ1​)Φ(Tδ1​​ω,s′).
  1. Principle of Optimality, eq. (2) (p. 290). K(ω)=max⁡δ1{L(ω,δ1)+P(δ1)K(Tδ1 ω)}K(\omega) = \max_{\delta_1} \{ L(\omega, \delta_1) + P(\delta_1) K(T_{\delta_1}\,\omega) \}K(ω)=maxδ1​​{L(ω,δ1​)+P(δ1​)K(Tδ1​​ω)}.
  2. n-step expansion (p. 291, first display). A solution MMM of (2) satisfies, for every nnn,
M(ω)=max⁡δ1,…,δn{∑m=1nL(ωm,δm)Pm(s)+M(ωn+1)Pn+1(s)}.M(\omega) = \max_{\delta_1, \dots, \delta_n} \Bigl\{ \sum_{m=1}^{n} L(\omega_m, \delta_m) P_m(s) + M(\omega_{n+1}) P_{n+1}(s) \Bigr\}.M(ω)=δ1​,…,δn​max​{m=1∑n​L(ωm​,δm​)Pm​(s)+M(ωn+1​)Pn+1​(s)}.

Significance

Milestone 3 says that the optimal return solves the functional equation. The goal gives the converse on a class of candidate solutions: any solution with a vanishing tail is the optimal return. Together they justify solving a dynamic program by solving its functional equation. The paper's two examples, a two-operation allocation problem with discounting and a resource allocation model driving the state to the origin, obtain uniqueness among bounded solutions and among continuous solutions vanishing at the origin respectively, by checking the tail condition. Without the tail condition the conclusion fails; the paper notes that the limit term "need not be true in general for any solution to the functional equation".

All four milestones and the goal are classical results with published proofs. None of them has a machine-checked proof on this platform: its existing Bellman-equation theorems concern finite-state stochastic models with a constant discount factor, and this model has neither restriction. The mission produces a formal version of the general deterministic model on topological state spaces, with optimality characterized by a verification theorem, which later missions on the paper's examples can reuse.

Difficulty

Existence rests on continuity of s↦Φ(ω,s)s \mapsto \Phi(\omega, s)s↦Φ(ω,s) on the product space. Each term L(ωn,δn)Pn(s)L(\omega_n, \delta_n) P_n(s)L(ωn​,δn​)Pn​(s) depends on the first nnn decisions through the composite map ωn=Tδn−1∘⋯∘Tδ1 ω\omega_n = T_{\delta_{n-1}} \circ \cdots \circ T_{\delta_1}\,\omegaωn​=Tδn−1​​∘⋯∘Tδ1​​ω, and continuity of that composite in all decisions at once does not follow from separate continuity of Tδ ωT_\delta\,\omegaTδ​ω in δ\deltaδ and in ω\omegaω. The limit of the series is continuous only because the convergence is uniform.

For uniqueness, the paper's display "M(ω)=max⁡SΦ(ω,s)+lim⁡nmax⁡M(ωn)∏P(δi)M(\omega) = \max_S \Phi(\omega, s) + \lim_n \max M(\omega_n) \prod P(\delta_i)M(ω)=maxS​Φ(ω,s)+limn​maxM(ωn​)∏P(δi​)" is not an identity: a maximum of a sum is not the sum of the maxima. A proof has to bound MMM from above by the yield of every strategy and from below by the yield of one particular strategy, and the lower bound fails if the tail term is controlled only from above. Attainment of the maximum in the conclusion needs a strategy to be exhibited, not only a supremum computed.

Formalization scope

A strategy is a function s : ℕ → D, with the product topology. Lean's 0-based index kkk is the paper's stage k+1k+1k+1: s 0 is δ1\delta_1δ1​, trajectory T ω s 0 is ω1=ω\omega_1 = \omegaω1​=ω, and weight P s k is Pk+1(s)P_{k+1}(s)Pk+1​(s), so weight P s 0 = 1. The total yield is a tsum and the optimal return a supremum over all strategies. "Maximum" is encoded as IsGreatest of a range, so every stated maximum is attained. Uniform convergence of (1) is TendstoUniformly of the partial sums to Φ(ω,⋅)\Phi(\omega, \cdot)Φ(ω,⋅) along atTop.

The formalization commits to the following, relative to the page:

  • The model's assumptions (1)–(3) of p. 286, non-negativity of LLL, and positivity and continuity of PPP appear as hypotheses of every statement.
  • A single return function LLL is used, not stage-dependent LnL_nLn​, as in display (1) and as the functional equation (2) requires. PnP_nPn​ has the product form, which the paper adopts "unless stated to the contrary".
  • Assumption (4), separate continuity of Tδ ωT_\delta\,\omegaTδ​ω in δ\deltaδ and in ω\omegaω, is strengthened to joint continuity of (δ,ω)↦Tδ ω(\delta, \omega) \mapsto T_\delta\,\omega(δ,ω)↦Tδ​ω. This supports the paper's assertion (p. 287) that each term is a continuous function of sss, which separate continuity does not give.
  • DDD is assumed nonempty. With DDD empty there is no strategy and Theorem 1 is false.
  • The paper leaves the class of admissible solutions open ("an appropriate class of M's for which the lim = 0"). The goal fixes it as the two-sided condition: for every ω\omegaω and ε>0\varepsilon > 0ε>0 there is NNN with ∣M(ωn)∣ Pn(s)≤ε|M(\omega_n)|\,P_n(s) \le \varepsilon∣M(ωn​)∣Pn​(s)≤ε for all n≥Nn \ge Nn≥N and all sss. Both of the paper's examples verify this form.

Lean's tsum of a non-summable series is 000, and a supremum of an unbounded family is 000. Neither default can make a statement trivially true. The uniform-convergence hypothesis forces the series to converge, and under Theorem 1's hypotheses Φ(ω,⋅)\Phi(\omega, \cdot)Φ(ω,⋅) is continuous on a compact space, so the supremum is a maximum. The goal's conclusion is stated without a supremum. A sorry-free check confirms that all hypotheses of the goal hold on a concrete instance with non-zero return: two decisions, constant return 111, P≡1/2P \equiv 1/2P≡1/2, and M≡2M \equiv 2M≡2.

Needed infrastructure: Tychonoff's theorem, continuity of uniform limits, and attainment of maxima on compact spaces, all in Mathlib. The mission's own definitions are the trajectory, weights, partial and total yield, and the optimal return. Contributions of intermediate lemmas are welcome, for example continuity of s↦ωns \mapsto \omega_ns↦ωn​, summability from uniform convergence, and the upper and lower tail estimates for MMM. So are formalizations of the paper's Remarks 1 and 3 (Dini's theorem and convergence of the kkk-stage optimal returns).

Selected references

  • S. Karlin, The Structure of Dynamic Programing Models, Naval Research Logistics Quarterly 2(4):285–294, 1955. https://doi.org/10.1002/nav.3800020408
  • R. Bellman, Dynamic Programming, Princeton University Press, 1957. https://press.princeton.edu/books/paperback/9780691146683/dynamic-programming
  • D. Blackwell, Discounted Dynamic Programming, Annals of Mathematical Statistics 36(1):226–235, 1965. https://doi.org/10.1214/aoms/1177700285
  • D. P. Bertsekas and S. E. Shreve, Stochastic Optimal Control: The Discrete-Time Case, Academic Press, 1978. https://web.mit.edu/dimitrib/www/soc.html
6 thms3 active usersReviewed
🏆Completed
Convex OptimizationOptimization·Captain: mikedeng1

Robust Solutions to Uncertain Semidefinite Programs IV: Closed-Form Robust Counterparts under Unstructured PerturbationsResearch Paper

Motivation

A semidefinite program (SDP) minimizes a linear objective cTxc^TxcTx subject to a linear matrix inequality (LMI) F(x)=F0+∑i=1mxiFi⪰0F(x) = F_0 + \sum_{i=1}^m x_i F_i \succeq 0F(x)=F0​+∑i=1m​xi​Fi​⪰0. In applications the coefficient matrices FiF_iFi​ are measured, estimated or rounded. A solution that is feasible for the nominal data can become infeasible for data that differ from it by an arbitrarily small amount.

El Ghaoui, Oustry and Lebret (SIAM J. Optim. 9(1), 1998) introduced robust semidefinite programs (RSDPs): the constraint must hold for every admissible perturbation of the data, and the robust solution is the best point that survives all of them. Their §5 works out the examples in which the robust counterpart has a closed form. The simplest and most widely quoted is the case where every coefficient matrix is perturbed independently and without structure (§5.1): the robust LMI becomes the single convex constraint F(x)⪰2ρ∥x∥2+1 IF(x) \succeq 2\rho\sqrt{\|x\|^2+1}\,IF(x)⪰2ρ∥x∥2+1​I. The same computation gives closed-form robust versions of linear programs (§5.3), of largest-eigenvalue minimization (§5.4) and of matrix-norm minimization (§5.6), each of which is the nominal problem plus a Tikhonov-type term ρ∥x∥2+1\rho\sqrt{\|x\|^2+1}ρ∥x∥2+1​. Robust linear programming under ellipsoidal uncertainty was developed at the same time by Ben-Tal and Nemirovski (Math. Oper. Res., 1998); robust least squares, the prototype of §5.6, by El Ghaoui and Lebret (SIAM J. Matrix Anal. Appl., 1997).

Setting

Fix m,n∈Nm, n \in \mathbb{N}m,n∈N, a level ρ>0\rho > 0ρ>0, and symmetric matrices F0,…,Fm∈Rn×nF_0, \dots, F_m \in \mathbb{R}^{n\times n}F0​,…,Fm​∈Rn×n. For x∈Rmx \in \mathbb{R}^mx∈Rm write F(x)=F0+∑i=1mxiFiF(x) = F_0 + \sum_{i=1}^m x_i F_iF(x)=F0​+∑i=1m​xi​Fi​ and ∥x∥2=∑i=1mxi2\|x\|^2 = \sum_{i=1}^m x_i^2∥x∥2=∑i=1m​xi2​ (the Euclidean norm). For a matrix MMM, ∥M∥\|M\|∥M∥ is its spectral norm, the largest singular value, and X⪰0X \succeq 0X⪰0 means that XXX is symmetric positive semidefinite.

An unstructured perturbation is a block row Δ=[Δ0 ⋯ Δm]\Delta = [\Delta_0 \ \cdots \ \Delta_m]Δ=[Δ0​ ⋯ Δm​] of n×nn\times nn×n blocks, viewed as one n×n(m+1)n \times n(m+1)n×n(m+1) matrix. It perturbs each coefficient independently:

F(x,Δ)=F(x)+Δ0+Δ0T+∑i=1mxi(Δi+ΔiT).\mathbf{F}(x,\Delta) = F(x) + \Delta_0 + \Delta_0^T + \sum_{i=1}^m x_i(\Delta_i + \Delta_i^T).F(x,Δ)=F(x)+Δ0​+Δ0T​+i=1∑m​xi​(Δi​+ΔiT​).

The robust feasible set is

Xρ={x∈Rm:F(x,Δ)⪰0 for every Δ with ∥Δ∥≤ρ},\mathcal{X}_\rho = \{x \in \mathbb{R}^m : \mathbf{F}(x,\Delta) \succeq 0 \text{ for every } \Delta \text{ with } \|\Delta\| \le \rho\},Xρ​={x∈Rm:F(x,Δ)⪰0 for every Δ with ∥Δ∥≤ρ},

and the RSDP is: minimize cTxc^TxcTx over Xρ\mathcal{X}_\rhoXρ​. With R(x)=[1; x]⊗IR(x) = [1;\,x]\otimes IR(x)=[1;x]⊗I, the n(m+1)×nn(m+1)\times nn(m+1)×n matrix whose iii-th block is x~iI\tilde x_i Ix~i​I for x~=(1,x1,…,xm)\tilde x = (1, x_1, \dots, x_m)x~=(1,x1​,…,xm​), the perturbation reads F(x,Δ)=F(x)+ΔR(x)+R(x)TΔT\mathbf{F}(x,\Delta) = F(x) + \Delta R(x) + R(x)^T\Delta^TF(x,Δ)=F(x)+ΔR(x)+R(x)TΔT (the paper's (19)).

Three further models use the same pattern. In a robust LP, the data [aiT bi]T[a_i^T\ b_i]^T[aiT​ bi​]T of each constraint aiTx≥bia_i^Tx \ge b_iaiT​x≥bi​ are shifted by an independent δi∈Rm+1\delta_i \in \mathbb{R}^{m+1}δi​∈Rm+1 with ∥δi∥2≤ρ\|\delta_i\|_2 \le \rho∥δi​∥2​≤ρ. In robust eigenvalue minimization one minimizes the worst case over ∥Δ∥≤ρ\|\Delta\|\le\rho∥Δ∥≤ρ of λmax⁡(F(x,Δ))\lambda_{\max}(\mathbf{F}(x,\Delta))λmax​(F(x,Δ)). In robust maximum-norm minimization, H(x)=H0+∑ixiHiH(x) = H_0 + \sum_i x_i H_iH(x)=H0​+∑i​xi​Hi​ with Hi∈Rp×qH_i \in \mathbb{R}^{p\times q}Hi​∈Rp×q, H(x,Δ)=H0+Δ0+∑ixi(Hi+Δi)\mathbf{H}(x,\Delta) = H_0 + \Delta_0 + \sum_i x_i(H_i + \Delta_i)H(x,Δ)=H0​+Δ0​+∑i​xi​(Hi​+Δi​), and one minimizes max⁡∥Δ∥≤ρ∥H(x,Δ)∥\max_{\|\Delta\|\le\rho}\|\mathbf{H}(x,\Delta)\|max∥Δ∥≤ρ​∥H(x,Δ)∥.

Formalization targets

Goal: Theorem 5.1 (first sentence)

For every x∈Rmx \in \mathbb{R}^mx∈Rm,

x∈Xρ  ⟺  F(x)⪰2ρ∥x∥2+1  I.x \in \mathcal{X}_\rho \iff F(x) \succeq 2\rho\sqrt{\|x\|^2+1}\; I .x∈Xρ​⟺F(x)⪰2ρ∥x∥2+1​I.

The RSDP and problem (21), "minimize cTxc^TxcTx subject to F(x)⪰2ρ∥x∥2+1 IF(x) \succeq 2\rho\sqrt{\|x\|^2+1}\,IF(x)⪰2ρ∥x∥2+1​I", therefore have the same feasible set, optimal value and solutions. The goal fixes no numerical data: F0,…,FmF_0, \dots, F_mF0​,…,Fm​, mmm, nnn and ρ>0\rho > 0ρ>0 are arbitrary.

Milestones on the way (§5.1)

  1. (19)–(20): x∈Xρx \in \mathcal{X}_\rhox∈Xρ​ iff there is τ∈R\tau \in \mathbb{R}τ∈R with [F(x)−τIρR(x)TρR(x)τI]⪰0\begin{bmatrix} F(x) - \tau I & \rho R(x)^T \\ \rho R(x) & \tau I\end{bmatrix} \succeq 0[F(x)−τIρR(x)​ρR(x)TτI​]⪰0.
  2. Positivity of τ\tauτ and the Schur form (for n≥1n \ge 1n≥1): that block matrix is ⪰0\succeq 0⪰0 iff τ>0\tau > 0τ>0 and F(x)⪰(τ+ρ2(1+∥x∥2)/τ)IF(x) \succeq \bigl(\tau + \rho^2(1+\|x\|^2)/\tau\bigr) IF(x)⪰(τ+ρ2(1+∥x∥2)/τ)I.
  3. (21): some τ>0\tau > 0τ>0 satisfies the Schur form iff F(x)⪰2ρ∥x∥2+1 IF(x) \succeq 2\rho\sqrt{\|x\|^2+1}\, IF(x)⪰2ρ∥x∥2+1​I.

Further milestones: the value halves of Theorems 5.2–5.4

  • Theorem 5.2: the robust LP constraints hold iff aiTx−ρ∥x∥22+1≥bia_i^Tx - \rho\sqrt{\|x\|_2^2+1} \ge b_iaiT​x−ρ∥x∥22​+1​≥bi​ for all iii (problem (23)).
  • Theorem 5.3: for every ttt, tI⪰F(x,Δ)tI \succeq \mathbf{F}(x,\Delta)tI⪰F(x,Δ) for all ∥Δ∥≤ρ\|\Delta\| \le \rho∥Δ∥≤ρ iff (t−2ρ∥x∥2+1)I⪰F(x)\bigl(t - 2\rho\sqrt{\|x\|^2+1}\bigr) I \succeq F(x)(t−2ρ∥x∥2+1​)I⪰F(x); that is, the worst-case largest eigenvalue is λmax⁡(F(x))+2ρ∥x∥2+1\lambda_{\max}(F(x)) + 2\rho\sqrt{\|x\|^2+1}λmax​(F(x))+2ρ∥x∥2+1​ (problem (25)).
  • Theorem 5.4: for p,q≥1p, q \ge 1p,q≥1, max⁡∥Δ∥≤ρ∥H(x,Δ)∥=∥H(x)∥+ρ∥x∥2+1\max_{\|\Delta\|\le\rho}\|\mathbf{H}(x,\Delta)\| = \|H(x)\| + \rho\sqrt{\|x\|^2+1}max∥Δ∥≤ρ​∥H(x,Δ)∥=∥H(x)∥+ρ∥x∥2+1​, and the maximum is attained (problem (29)).

Significance

The goal shows that robustness against unstructured perturbations costs no more than the nominal problem: the robust counterpart is an LMI of the same size n×nn\times nn×n, with a right-hand side that is a convex function of xxx and grows like 2ρ∥x∥2\rho\|x\|2ρ∥x∥. The sets Xρ\mathcal{X}_\rhoXρ​ have no flat faces, which the paper's §5.2 uses to define the robust center of an LMI and which underlies the uniqueness and continuity of the robust solution (the second sentences of Theorems 5.1–5.4, from §4 under hypotheses H1–H3). Theorems 5.3 and 5.4 exhibit robustification as a Tikhonov regularization with parameter 2ρ2\rho2ρ or ρ\rhoρ, and Theorem 5.2 turns a robust LP into a second-order cone program.

All four closed forms are proved in the paper, partly by appeal to the general SDP reformulation of its §3. No machine-checked version of any of them exists, to our knowledge. The mission produces the robust counterparts as identities of feasible sets, stated for every xxx, together with the three intermediate steps of §5.1, so that later missions on the uniqueness and stability halves can import them.

Difficulty

The goal is an exchange of a universal quantifier over an infinite family of matrices with a single matrix inequality. The inequality F(x,Δ)⪰F(x)−2ρ∥x∥2+1 I\mathbf{F}(x,\Delta) \succeq F(x) - 2\rho\sqrt{\|x\|^2+1}\,IF(x,Δ)⪰F(x)−2ρ∥x∥2+1​I bounds each perturbation, but the converse needs, for each failing direction, one admissible perturbation that attains the bound; the constant 222 comes from the two copies ΔR(x)\Delta R(x)ΔR(x) and R(x)TΔTR(x)^T\Delta^TR(x)TΔT, and the constant ∥x∥2+1\sqrt{\|x\|^2+1}∥x∥2+1​ is the spectral norm of R(x)R(x)R(x), which holds only because Δ\DeltaΔ is normed as one block row. Normed block by block, the worst case and the constant change. In the milestone route, the positivity of τ\tauτ needs a separate argument before any Schur complement can be taken, since the Schur complement with respect to τI\tau IτI is undefined at τ=0\tau = 0τ=0, and the elimination of τ\tauτ needs the attainment of min⁡τ>0τ+a/τ\min_{\tau>0} \tau + a/\tauminτ>0​τ+a/τ. For Theorem 5.4 the difficulty is the attainment: an upper bound on the maximum is immediate, while the lower bound requires exhibiting an admissible perturbation that attains it.

Formalization scope

Matrices are Matrix (Fin r) (Fin c) ℝ. Coefficients are indexed by Fin (m + 1) with index 0 the constant term. A block row Δ\DeltaΔ is one matrix with columns indexed by pairs (i, b) : Fin (m + 1) × Fin n (or Fin q), and ∥Δ∥\|\Delta\|∥Δ∥ is Mathlib's ℓ2\ell^2ℓ2 operator norm (open scoped Matrix.Norms.L2Operator), the largest singular value, never the default entrywise norm. The vector norm ∥x∥2\|x\|^2∥x∥2 is written as ∑ixi2\sum_i x_i^2∑i​xi2​, never as Mathlib's sup norm on Fin m → ℝ. A⪰BA \succeq BA⪰B is (A - B).PosSemidef. Standing assumptions made explicit: F0,…,FmF_0, \dots, F_mF0​,…,Fm​ symmetric; ρ>0\rho > 0ρ>0 (§3, p. 36); n≥1n \ge 1n≥1 in milestone 2 (at n=0n = 0n=0 every τ\tauτ is feasible); p,q≥1p, q \ge 1p,q≥1 in Theorem 5.4 (empty matrices have norm 000).

Readings and corrections of the printed text:

  1. "The optimal value of the RSDP can be computed by solving (21)" is stated as the identity of the two feasible sets for every xxx, which implies equality of values and of solutions. Theorems 5.2 and 5.4 are stated the same way (5.4 through the pointwise worst-case value, with attainment), and Theorem 5.3 in epigraph form, λmax⁡(M)≤t  ⟺  tI−M⪰0\lambda_{\max}(M) \le t \iff tI - M \succeq 0λmax​(M)≤t⟺tI−M⪰0.
  2. Only the first sentence of each theorem is in scope. Uniqueness, regularity, Lipschitz stability and the limit ρ→0\rho \to 0ρ→0 rest on Theorem 4.3 and on external results ([31], [3]) and are not stated.
  3. In (19) the paper writes D=Rn×nm\mathcal D = \mathbb R^{n\times nm}D=Rn×nm and "the representation in section 5"; Δ\DeltaΔ has m+1m+1m+1 blocks, so D=Rn×n(m+1)\mathcal D = \mathbb R^{n\times n(m+1)}D=Rn×n(m+1), and the representation is that of §2.2.
  4. The paper derives (20) from Lemma 3.2 and (29) from Theorem 3.2, which give only sufficient conditions; the exact equivalences are the full-perturbation Lemma 3.1 / Theorem 3.1.
  5. Before (21) the paper says "the scalar in the left-hand side" (it is on the right) and "the RSDP (1)" (it means the RSDP (4)). Theorem 5.3's "min-max problem (24)" is the robust version of the nominal problem (24).

A formalization in which ∥Δ∥\|\Delta\|∥Δ∥ is an entrywise or blockwise norm, ∥x∥\|x\|∥x∥ is the sup norm, or the robust set quantifies over a single block, changes the constant 2ρ∥x∥2+12\rho\sqrt{\|x\|^2+1}2ρ∥x∥2+1​ and is not this theorem; the statements here rule these out by construction.

Useful, reusable infrastructure: the spectral norm of [1; x]⊗I[1;\,x] \otimes I[1;x]⊗I, Schur complements for positive semidefinite block matrices, and spectral norms of rank-one matrices. Proofs of the three §5.1 milestones and direct proofs of the goal are both welcome.

Selected references

  • L. El Ghaoui, F. Oustry, H. Lebret, Robust Solutions to Uncertain Semidefinite Programs, SIAM J. Optim. 9(1):33–52, 1998. https://doi.org/10.1137/S1052623496305717
  • L. El Ghaoui, H. Lebret, Robust Solutions to Least-Squares Problems with Uncertain Data, SIAM J. Matrix Anal. Appl. 18(4):1035–1064, 1997. https://doi.org/10.1137/S0895479896298130
  • A. Ben-Tal, A. Nemirovski, Robust Convex Optimization, Math. Oper. Res. 23(4):769–805, 1998. https://doi.org/10.1287/moor.23.4.769
8 thms3 active usersReviewed
🏆Completed
Control TheoryConvex OptimizationOptimization·Captain: mikedeng1

Robust Solutions to Uncertain Semidefinite Programs I: Exact SDP Reformulation of the Robust LMI under Full Linear-Fractional PerturbationsResearch Paper

Motivation

A semidefinite program (SDP) minimizes a linear objective cTxc^TxcTx subject to a linear matrix inequality (LMI) F(x)=F0+∑i=1mxiFi⪰0F(x) = F_0 + \sum_{i=1}^m x_iF_i \succeq 0F(x)=F0​+∑i=1m​xi​Fi​⪰0. SDPs model problems in control, combinatorial optimization, statistics and engineering design, and they are solved efficiently by interior-point methods. In applications the data F0,…,FmF_0,\dots,F_mF0​,…,Fm​ are rarely known exactly: they come from measurements, from linearized models, or from rounding. A solution that is optimal for the nominal data may violate the constraint for data that differ only slightly.

El Ghaoui, Oustry and Lebret (SIAM J. Optim. 9(1), 1998) asked for robust solutions: points xxx that satisfy the constraint for every admissible value of an unknown but bounded perturbation, and among them one that minimizes cTxc^TxcTx. Their paper, together with the contemporaneous work of Ben-Tal and Nemirovski on robust convex optimization (Math. Oper. Res. 23(4), 1998), founded robust semidefinite programming. The perturbation model they use, the linear-fractional representation (LFR), is the standard uncertainty model of robust control, where the same exact reformulation appears as the multiplier characterization of quadratic stability under norm-bounded uncertainty.

This mission formalizes the first main result of the paper: when the perturbation is full (an arbitrary matrix of bounded spectral norm), the robust problem is exactly an SDP with one extra scalar variable.

Setting

Fix natural numbers m,n,p,qm, n, p, qm,n,p,q and a decision vector x∈Rmx \in \mathbb{R}^mx∈Rm. The data are:

  • symmetric matrices F0,…,Fm∈Rn×nF_0,\dots,F_m \in \mathbb{R}^{n\times n}F0​,…,Fm​∈Rn×n, defining the affine map F(x)=F0+∑ixiFiF(x) = F_0 + \sum_i x_iF_iF(x)=F0​+∑i​xi​Fi​;
  • matrices R0,…,Rm∈Rq×nR_0,\dots,R_m \in \mathbb{R}^{q\times n}R0​,…,Rm​∈Rq×n, defining R(x)=R0+∑ixiRiR(x) = R_0 + \sum_i x_iR_iR(x)=R0​+∑i​xi​Ri​;
  • fixed matrices L∈Rn×pL \in \mathbb{R}^{n\times p}L∈Rn×p and D∈Rq×pD \in \mathbb{R}^{q\times p}D∈Rq×p;
  • a level ρ>0\rho > 0ρ>0.

For a matrix XXX, ∥X∥\|X\|∥X∥ denotes its largest singular value (the spectral norm), and X⪰0X \succeq 0X⪰0 means that XXX is symmetric positive semidefinite. A perturbation is a matrix Δ∈Rp×q\Delta \in \mathbb{R}^{p\times q}Δ∈Rp×q. The perturbed constraint matrix is the LFR (5)

F(x,Δ)=F(x)+LΔ(I−DΔ)−1R(x)+R(x)T(I−ΔTDT)−1ΔTLT,\mathbf{F}(x,\Delta) = F(x) + L\Delta(I - D\Delta)^{-1}R(x) + R(x)^T(I - \Delta^TD^T)^{-1}\Delta^TL^T,F(x,Δ)=F(x)+LΔ(I−DΔ)−1R(x)+R(x)T(I−ΔTDT)−1ΔTLT,

which is well defined exactly when det⁡(I−DΔ)≠0\det(I - D\Delta) \neq 0det(I−DΔ)=0. For a linear subspace D\mathcal{D}D of Rp×q\mathbb{R}^{p\times q}Rp×q, the robust feasible set (2) is

Xρ={x∈Rm:for every Δ∈D with ∥Δ∥≤ρ, F(x,Δ) is well defined and F(x,Δ)⪰0},\mathcal{X}_\rho = \bigl\{x \in \mathbb{R}^m : \text{for every } \Delta \in \mathcal{D} \text{ with } \|\Delta\| \le \rho,\ \mathbf{F}(x,\Delta) \text{ is well defined and } \mathbf{F}(x,\Delta) \succeq 0\bigr\},Xρ​={x∈Rm:for every Δ∈D with ∥Δ∥≤ρ, F(x,Δ) is well defined and F(x,Δ)⪰0},

and the robust SDP (4) is: minimize cTxc^TxcTx subject to x∈Xρx \in \mathcal{X}_\rhox∈Xρ​, for a given c∈Rm∖{0}c \in \mathbb{R}^m \setminus \{0\}c∈Rm∖{0}. In this mission D=Rp×q\mathcal{D} = \mathbb{R}^{p\times q}D=Rp×q, the full perturbation case, and the paper's standing assumption of §3.1 is ∥D∥<ρ−1\|D\| < \rho^{-1}∥D∥<ρ−1.

Formalization targets

Goal: Theorem 3.1 (p. 36), as a set identity

Under ρ>0\rho > 0ρ>0, ∥D∥<ρ−1\|D\| < \rho^{-1}∥D∥<ρ−1, q≥1q \ge 1q≥1 and L≠0L \ne 0L=0, for every x∈Rmx \in \mathbb{R}^mx∈Rm,

x∈Xρ  ⟺  ∃ τ∈R: [F(x)−τLLTR(x)T−τLDTR(x)−τDLTτ(ρ−2I−DDT)]⪰0.(10)x \in \mathcal{X}_\rho \iff \exists\,\tau \in \mathbb{R}:\ \begin{bmatrix} F(x) - \tau LL^T & R(x)^T - \tau LD^T \\ R(x) - \tau DL^T & \tau(\rho^{-2}I - DD^T)\end{bmatrix} \succeq 0. \qquad (10)x∈Xρ​⟺∃τ∈R: [F(x)−τLLTR(x)−τDLT​R(x)T−τLDTτ(ρ−2I−DDT)​]⪰0.(10)

The paper states that the robust SDP and a corresponding solution can be computed by solving the SDP "minimize cTxc^TxcTx subject to (10)" in the variables (x,τ)(x, \tau)(x,τ). Both problems have the objective cTxc^TxcTx, so the identity above, between Xρ\mathcal{X}_\rhoXρ​ and the xxx-projection of the feasible set of (10), is the content of that sentence. A companion item states the solution correspondence explicitly: xxx is optimal for the robust SDP if and only if (x,τ)(x,\tau)(x,τ) is optimal for (10) for some τ\tauτ.

Milestones

  1. Well-posedness (§3.1, p. 36). For ρ>0\rho > 0ρ>0: det⁡(I−DΔ)≠0\det(I - D\Delta) \ne 0det(I−DΔ)=0 for every Δ\DeltaΔ with ∥Δ∥≤ρ\|\Delta\| \le \rho∥Δ∥≤ρ if and only if ∥D∥<ρ−1\|D\| < \rho^{-1}∥D∥<ρ−1.
  2. Lemma 3.1 (p. 36). For F=FTF = F^TF=FT, q≥1q \ge 1q≥1 and L≠0L \ne 0L=0: det⁡(I−DΔ)≠0\det(I - D\Delta) \ne 0det(I−DΔ)=0 and F+LΔ(I−DΔ)−1R+RT(I−DΔ)−TΔTLT⪰0F + L\Delta(I - D\Delta)^{-1}R + R^T(I - D\Delta)^{-T}\Delta^TL^T \succeq 0F+LΔ(I−DΔ)−1R+RT(I−DΔ)−TΔTLT⪰0 for every ∥Δ∥≤1\|\Delta\| \le 1∥Δ∥≤1 if and only if ∥D∥<1\|D\| < 1∥D∥<1 and some scalar τ\tauτ satisfies
[F−τLLTRT−τLDTR−τDLTτ(I−DDT)]⪰0.\begin{bmatrix} F - \tau LL^T & R^T - \tau LD^T \\ R - \tau DL^T & \tau(I - DD^T)\end{bmatrix} \succeq 0.[F−τLLTR−τDLT​RT−τLDTτ(I−DDT)​]⪰0.

The paper cites the S-procedure as the classical result behind Lemma 3.1; it is already proved on the platform (ConvexOptimization.s_procedure) and is included as a reference item.

Significance

The robust feasible set is defined by infinitely many matrix inequalities, one per perturbation, each rational in Δ\DeltaΔ; in general such a set is convex but has no tractable description, and the paper notes that the structured version of the problem is NP-hard. Theorem 3.1 shows that for full perturbations nothing is lost by replacing that semi-infinite constraint with a single LMI of size n+qn + qn+q in one extra variable. Consequences: the robust problem is solved by a standard SDP solver; the largest admissible perturbation level is a generalized eigenvalue problem; and the exact result is the benchmark against which the paper's sufficient conditions for structured perturbations (Theorem 3.2) and its closed-form counterparts for unstructured perturbations (Theorem 5.1) are measured.

The result is proved in the paper (from the S-procedure, with the details deferred to a cited report). To the best of available knowledge it has no machine-checked proof. The mission produces a formal statement of the LFR model and of the robust feasible set that later missions on robust SDPs can reuse, a formal proof of the well-posedness condition, and a formal proof of the exact reformulation built on the platform's S-procedure. Formalizing it also records two points the printed statement leaves implicit: the result needs L≠0L \ne 0L=0 and a nonempty perturbation output dimension q≥1q \ge 1q≥1.

Difficulty

The direction from the LMI to robust feasibility is elementary. The converse is the substance: robust feasibility is a statement about a continuum of perturbations, each entering rationally, and testing the LMI against finitely many extreme perturbations does not produce a multiplier τ\tauτ. The exactness of the reformulation rests on a lossless certificate for an implication between quadratic inequalities, which holds only under a strict feasibility condition; that condition is where L≠0L \ne 0L=0 enters, and without it the lemma is false. The well-posedness milestone requires showing that ∥D∥<ρ−1\|D\| < \rho^{-1}∥D∥<ρ−1 is also necessary, which is not a norm estimate but needs a perturbation that makes I−DΔI - D\DeltaI−DΔ singular.

Formalization scope

Matrices are Mathlib Matrix (Fin a) (Fin b) ℝ. The affine maps are given by coefficient lists indexed by Fin (m + 1), the constant term first. The norm on matrices is the ℓ2\ell^2ℓ2 operator norm, opened with open scoped Matrix.Norms.L2Operator; it is the largest singular value, and no other matrix norm is used. X⪰0X \succeq 0X⪰0 is Matrix.PosSemidef, which includes symmetry. Block matrices are Matrix.fromBlocks over the index type Fin n ⊕ Fin q, with R(x)T−τLDTR(x)^T - \tau LD^TR(x)T−τLDT top-right and R(x)−τDLTR(x) - \tau DL^TR(x)−τDLT bottom-left. Mathlib's matrix inverse returns 000 at a singular matrix, so the condition det⁡(I−DΔ)≠0\det(I - D\Delta) \ne 0det(I−DΔ)=0 appears in the robust feasible set in the same universally quantified clause as positive semidefiniteness, as the paper's "well defined" requires; dropping it, or using an entrywise matrix norm, would change the set and is excluded.

Readings and corrections of the printed statements:

  • "The RSDP (4) and a corresponding solution xxx can be computed by solving the SDP" is read as the identity of Xρ\mathcal{X}_\rhoXρ​ with the xxx-projection of the feasible set of (10), for every xxx, together with the solution correspondence item. A statement of equal optimal values alone would be weaker and is not used.
  • Correction: L≠0L \ne 0L=0 is added to Lemma 3.1 and Theorem 3.1. The printed statements fail for L=0L = 0L=0: with n=p=q=1n = p = q = 1n=p=q=1, F=0F = 0F=0, L=0L = 0L=0, D=0D = 0D=0, R=1R = 1R=1, the perturbation does not enter, so the robust condition holds, while the LMI reads [011⋅]⪰0\begin{bmatrix}0 & 1\\1 & \cdot\end{bmatrix} \succeq 0[01​1⋅​]⪰0, which is infeasible.
  • q≥1q \ge 1q≥1 makes "matrices of appropriate size" explicit; for q=0q = 0q=0 the lower-right block is empty and the equivalence fails.
  • The standing assumptions ρ>0\rho > 0ρ>0 (§3) and ∥D∥<ρ−1\|D\| < \rho^{-1}∥D∥<ρ−1 (§3.1) are hypotheses of the goal. In Lemma 3.1, ∥D∥<1\|D\| < 1∥D∥<1 is part of the conclusion, as printed, and τ\tauτ carries no sign constraint, as printed.
  • The paper's standing assumption that the nominal problem is feasible (X0≠∅\mathcal{X}_0 \ne \emptysetX0​=∅) is not needed for the identity and is not added.

Welcome contributions: proofs of the well-posedness milestone (a spectral-norm and singular-vector argument, reusable wherever I−DΔI - D\DeltaI−DΔ must be invertible); of Lemma 3.1 from the S-procedure (the reachability lemma for norm-bounded perturbations is reusable in robust control); of the goal from Lemma 3.1 by rescaling; and general lemmas on the spectral norm of rank-one matrices and on Schur complements of block matrices.

Selected references

  • L. El Ghaoui, F. Oustry and H. Lebret, Robust Solutions to Uncertain Semidefinite Programs, SIAM J. Optim. 9(1), 33–52, 1998. https://doi.org/10.1137/S1052623496305717
  • A. Ben-Tal and A. Nemirovski, Robust Convex Optimization, Math. Oper. Res. 23(4), 769–805, 1998. https://doi.org/10.1287/moor.23.4.769
  • S. Boyd, L. El Ghaoui, E. Feron and V. Balakrishnan, Linear Matrix Inequalities in System and Control Theory, SIAM, 1994. https://doi.org/10.1137/1.9781611970777
  • S. Boyd and L. Vandenberghe, Convex Optimization, Cambridge University Press, 2004, Appendix B.2 (the S-procedure). https://web.stanford.edu/~boyd/cvxbook/
5 thms3 active usersReviewed
PreviousPage 8 of 21Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me