Prove2Me
Navigate
DiscoverFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Linear Optimization

122 missions · 83 completed

Missions

Open39Completed83All122
Algorithmic Game TheoryOperations ResearchProbability·Captain: mikedeng1

A General Framework for the Study of Decentralized Distribution Systems: A Core Allocation Rule Whose Nash Equilibrium Is First-BestResearch Paper

Pooling inventory among independent retailers

Retailers that sell the same product can raise their joint profit by pooling: stock left over at one location is shipped to meet unmet demand at another, and stock can be held in shared warehouses until demand is known (Eppen 1979; Eppen and Schrage 1981). When the retailers are independent firms, pooling creates two questions at once. After demand is realized, the extra profit from shipping must be split in a way no group of retailers would reject. Before demand is realized, each retailer chooses its own stock, and that choice depends on how the split will be made. A split that is fair ex post may lead to stocking decisions that are poor for the system as a whole.

Anupindi, Bassok and Zemel (MSOM 2001) model the ex-post split as a cooperative game, the ex-ante stocking as a non-cooperative game, and ask whether a single allocation rule can serve both. Their framework is a standard reference for "coopetition" models in supply chains, where firms compete on stocking decisions and cooperate on redistribution.

Setting

There are retailers N={1,…,N}\mathcal N=\{1,\dots,N\}N={1,…,N} and warehouses W={1,…,W}\mathcal W=\{1,\dots,W\}W={1,…,W}. Retailer nnn has unit cost cnc_ncn​, revenue rnr_nrn​ and salvage value vnv_nvn​; warehouse www has purchasing cost cwc_wcw​ and salvage value vwv_wvw​. Shipping from location iii to retailer nnn costs ti,nt_{i,n}ti,n​ per unit, and a fraction βi,n∈[0,1]\beta_{i,n}\in[0,1]βi,n​∈[0,1] of the customers at nnn accept service from iii.

Before demand, retailer nnn chooses a position Z⃗n=(Xn,Y1,n,…,YW,n)\vec Z_n=(X_n,Y_{1,n},\dots,Y_{W,n})Zn​=(Xn​,Y1,n​,…,YW,n​): local stock XnX_nXn​ and claims Yw,nY_{w,n}Yw,n​ on warehouse stock, so warehouse www holds Yw=∑nYw,nY_w=\sum_nY_{w,n}Yw​=∑n​Yw,n​. A profile is [Z]=(Z⃗1,…,Z⃗N)[Z]=(\vec Z_1,\dots,\vec Z_N)[Z]=(Z1​,…,ZN​). Demand D⃗\vec DD is random with law μ\muμ. After demand, retailer nnn has local sales Sn=min⁡{Xn,Dn}S_n=\min\{X_n,D_n\}Sn​=min{Xn​,Dn​}, residual inventory Hn=max⁡{Xn−Dn,0}H_n=\max\{X_n-D_n,0\}Hn​=max{Xn​−Dn​,0} and residual demand En=max⁡{Dn−Xn,0}E_n=\max\{D_n-X_n,0\}En​=max{Dn​−Xn​,0}.

The snapshot allocation game SAG([Z],D⃗)([Z],\vec D)([Z],D) gives each coalition S⊆N\mathcal S\subseteq\mathcal NS⊆N the value WS∗([Z],D⃗)W^*_{\mathcal S}([Z],\vec D)WS∗​([Z],D): the optimal value of the linear program (6), which ships qi,nq_{i,n}qi,n​ units from i∈S∪Wi\in\mathcal S\cup\mathcal Wi∈S∪W to n∈Sn\in\mathcal Sn∈S at profit rn−vi−ti,nr_n-v_i-t_{i,n}rn​−vi​−ti,n​ per unit, subject to ∑nqi,n≤Hi\sum_nq_{i,n}\le H_i∑n​qi,n​≤Hi​, ∑nqw,n≤∑n∈SYw,n\sum_nq_{w,n}\le\sum_{n\in\mathcal S}Y_{w,n}∑n​qw,n​≤∑n∈S​Yw,n​ and ∑iqi,n/βi,n≤En\sum_iq_{i,n}/\beta_{i,n}\le E_n∑i​qi,n​/βi,n​≤En​. Its core is the set of allocations α\alphaα with ∑j∈Sαj≥WS∗\sum_{j\in\mathcal S}\alpha_j\ge W^*_{\mathcal S}∑j∈S​αj​≥WS∗​ for every S\mathcal SS and ∑j∈Nαj=WN∗\sum_{j\in\mathcal N}\alpha_j=W^*_{\mathcal N}∑j∈N​αj​=WN∗​ (7).

An allocation rule AR-mmm assigns surplus αnm([Z],D⃗)\alpha^m_n([Z],\vec D)αnm​([Z],D); retailer nnn earns

Pnm([Z],D⃗)=rnSn+vnHn−cnXn−∑w(cw−vw)Yw,n+αnm([Z],D⃗)(9)P^m_n([Z],\vec D)=r_nS_n+v_nH_n-c_nX_n-\sum_w(c_w-v_w)Y_{w,n}+\alpha^m_n([Z],\vec D)\qquad(9)Pnm​([Z],D)=rn​Sn​+vn​Hn​−cn​Xn​−w∑​(cw​−vw​)Yw,n​+αnm​([Z],D)(9)

and expects Jnm([Z])=ED⃗PnmJ^m_n([Z])=E_{\vec D}P^m_nJnm​([Z])=ED​Pnm​. A Nash equilibrium (10) is a profile at which no retailer gains by changing its own position. The first-best profile [Z]c∗[Z]^{c*}[Z]c∗ maximizes the expected centralized profit JNc([Z])=ED⃗PNc([Z],D⃗)J^c_{\mathcal N}([Z])=E_{\vec D}P^c_{\mathcal N}([Z],\vec D)JNc​([Z])=ED​PNc​([Z],D), where PNc=∑n[rnSn+vnHn−cnXn]−∑w(cw−vw)Yw+WN∗P^c_{\mathcal N}=\sum_n[r_nS_n+v_nH_n-c_nX_n]-\sum_w(c_w-v_w)Y_w+W^*_{\mathcal N}PNc​=∑n​[rn​Sn​+vn​Hn​−cn​Xn​]−∑w​(cw​−vw​)Yw​+WN∗​.

The fractional rule AR-f (11) pays αnf=θnPNc−[ rnSn+vnHn−cnXn−∑w(cw−vw)Yw,n]\alpha^f_n=\theta_nP^c_{\mathcal N}-[\,r_nS_n+v_nH_n-c_nX_n-\sum_w(c_w-v_w)Y_{w,n}]αnf​=θn​PNc​−[rn​Sn​+vn​Hn​−cn​Xn​−∑w​(cw​−vw​)Yw,n​] with fixed shares θn∈(0,1)\theta_n\in(0,1)θn​∈(0,1), ∑nθn=1\sum_n\theta_n=1∑n​θn​=1. The dual allocation (8) is αnd=νnHn+∑wγwYw,n+δnEn\alpha^d_n=\nu_nH_n+\sum_w\gamma_wY_{w,n}+\delta_nE_nαnd​=νn​Hn​+∑w​γw​Yw,n​+δn​En​ for optimal dual prices (ν,γ,δ)(\nu,\gamma,\delta)(ν,γ,δ) of (6) for N\mathcal NN. The modified rule AR-c is αnc([Z],D⃗)=αnf([Z],D⃗)+wn([Z]c∗,D⃗)\alpha^c_n([Z],\vec D)=\alpha^f_n([Z],\vec D)+w_n([Z]^{c*},\vec D)αnc​([Z],D)=αnf​([Z],D)+wn​([Z]c∗,D) with wn=αnd([Z]c∗,⋅)−αnf([Z]c∗,⋅)w_n=\alpha^d_n([Z]^{c*},\cdot)-\alpha^f_n([Z]^{c*},\cdot)wn​=αnd​([Z]c∗,⋅)−αnf​([Z]c∗,⋅).

Formalization targets

Goal: Corollary 5.1 (p. 361)

For a first-best profile [Z]c∗[Z]^{c*}[Z]c∗ and a measurable choice of dual prices at [Z]c∗[Z]^{c*}[Z]c∗,

[Z]c∗ is a pure Nash equilibrium under AR-c, and  αc([Z]c∗,D⃗)∈Core⁡(SAG([Z]c∗,D⃗))  ∀D⃗,[Z]^{c*}\ \text{is a pure Nash equilibrium under AR-c, and}\ \ \alpha^c([Z]^{c*},\vec D)\in\operatorname{Core}\big(\mathrm{SAG}([Z]^{c*},\vec D)\big)\ \ \forall\vec D,[Z]c∗ is a pure Nash equilibrium under AR-c, and  αc([Z]c∗,D)∈Core(SAG([Z]c∗,D))  ∀D,

with integrable side payments.

Milestones

  • Examples 1 and 2 (pp. 358–359): a transfer-price allocation outside the core; the dual allocation (8,8,8,0)(8,8,8,0)(8,8,8,0) and the non-dual core allocation (0,0,0,24)(0,0,0,24)(0,0,0,24).
  • Theorem 4.1 (p. 358): if all inventory is claimed, the core of SAG([Z],D⃗)([Z],\vec D)([Z],D) is nonempty and contains the dual allocation (8) for every optimal dual.
  • Theorem 5.2 (p. 361): under AR-f every first-best profile is a Nash equilibrium.
  • Theorem 5.1 (p. 361): for any rule and any of its equilibria [Z]m∗[Z]^{m*}[Z]m∗ there are integrable demand-dependent side payments that leave the set of equilibria unchanged and put the allocations at [Z]m∗[Z]^{m*}[Z]m∗ in the core for every D⃗\vec DD.

Significance

The goal answers the paper's central question positively: there is an allocation mechanism under which the centrally optimal stock levels are an equilibrium of the decentralized stocking game, while every ex-post split of the pooling surplus is stable against all coalitions. Theorem 4.1 is the ex-post half: shadow prices of the shipping LP give a stable split for every realization, independently of who owns which units. The paper also shows (Proposition 5.1, not included here) that the dual allocation alone does not induce first-best stocking, which is why the side payments of Theorem 5.1 are needed.

The results are proved in the paper; Theorem 4.1 is proved there only by reference to the LP-game literature (Owen 1975; Samet and Zemel 1984). None of them has a machine-checked proof. The mission would produce the first formal treatment on Prove2Me of a linear-production (LP) game and its core, and of a model combining a cooperative second stage with a non-cooperative first stage.

Difficulty

Theorem 4.1 is an instance of Owen's theorem on LP games, but the instance is not a standard linear production game: coalition LPs have variables only on arcs inside the coalition, warehouse capacity is limited to the coalition's own claims, and the acceptance constraint divides by βi,n\beta_{i,n}βi,n​, which may be zero, so the general theorem cannot be quoted as it stands. The paper leaves the dual of (6) unwritten, and Mathlib has no ready-made LP duality in this form.

The stochastic layer is the other obstacle. Expected payoffs are integrals, and the side payment is built from a choice of dual prices for each demand realization. Its integrability requires measurability of that choice and of the LP value as a function of demand; neither is given by the paper, which treats the side payments as "constants".

Formalization scope

Retailers are Fin N, warehouses Fin W, locations Fin N ⊕ Fin W; quantities, prices and demands are real numbers; demand is a probability measure on Fin N → ℝ; expectations are Bochner integrals. WS∗W^*_{\mathcal S}WS∗​ is the real supremum of (6a) over the feasible set, and profiles are required to be nonnegative, which makes the feasible set nonempty and bounded. Arcs with βi,n=0\beta_{i,n}=0βi,n​=0 carry no shipment. The core is the platform definition Supermodularity.Cooperative.Core. The dual of (6) is written out explicitly (the paper does not state it). The paper's continuous-CDF assumption is not used and is dropped.

Pinned readings:

  1. "Dual prices" means any optimal solution of the dual of (6) for N\mathcal NN; Theorem 4.1 is stated for every such solution.
  2. "Induces the same equilibrium inventory levels as the first-best" (Theorem 5.2) and "the NE using αc\alpha^cαc is first-best" (Corollary 5.1) are stated as "every first-best profile is a Nash equilibrium", the direction the proofs give.
  3. "[Z]m~∗=[Z]m∗[Z]^{\tilde m*}=[Z]^{m*}[Z]m~∗=[Z]m∗" (Theorem 5.1) is stated as equality of the two sets of equilibria; the continuity and unimodality assumptions, which only guarantee existence of an equilibrium, are dropped because the equilibrium is a hypothesis.
  4. "An appropriate way of breaking ties" is a measurable choice of optimal dual prices; demand is almost surely nonnegative; the rule's payoffs in Theorem 5.1 are integrable.
  5. The shares γn\gamma_nγn​ of Theorem 5.2 are written θn\theta_nθn​, and Eq. (11) is used with +vnHn+v_nH_n+vn​Hn​ in the bracket (printed −vnHn-v_nH_n−vn​Hn​), as the proof on p. 367 requires.

Not acceptable: a core without the efficiency equation (7b); a feasible set that lets qi,n/0=0q_{i,n}/0=0qi,n​/0=0 sell to customers who balk; an arbitrary side payment instead of the constructed one; or a Nash equilibrium evaluated through non-integrable payoffs, whose Bochner integral is 000 and makes every profile an equilibrium.

Useful infrastructure: finite-dimensional LP duality in inequality form, measurable selection of LP optimal solutions, and continuity of LP values in the right-hand side. All of it can be reused in other LP-game and two-stage stochastic programming missions.

Selected references

  • R. Anupindi, Y. Bassok, E. Zemel, A General Framework for the Study of Decentralized Distribution Systems, Manufacturing & Service Operations Management 3(4):349–368, 2001. https://doi.org/10.1287/msom.3.4.349.9973
  • G. Owen, On the core of linear production games, Mathematical Programming 9:358–370, 1975. https://doi.org/10.1007/BF01681356
  • D. Samet, E. Zemel, On the core and dual set of linear programming games, Mathematics of Operations Research 9(2):309–316, 1984. https://doi.org/10.1287/moor.9.2.309
  • G. D. Eppen, Effects of centralization on expected costs in a multi-location newsboy problem, Management Science 25(5):498–501, 1979. https://doi.org/10.1287/mnsc.25.5.498
10 thms2 active usersReviewed
Algorithmic Game TheoryOperations Research·Captain: mikedeng1

Market Equilibrium under Separable, Piecewise-Linear, Concave Utilities I: Fisher Markets with an Equilibrium Have Rational Equilibrium Prices of Polynomial Bit SizeResearch Paper

Motivation

A Fisher market is the simplest model of a market in which prices are set by supply and demand: buyers bring money, sellers bring goods, and a price vector is an equilibrium when every buyer, spending her money optimally at those prices, leaves every good exactly sold out. Computing equilibria is one of the central questions of algorithmic game theory, because a polynomial-time algorithm is what would make the equilibrium concept usable as a prediction or as a pricing mechanism.

For linear utilities an equilibrium always exists, is rational, and can be computed in polynomial time (Eisenberg and Gale 1959; Devanur, Papadimitriou, Saberi and Vazirani, J. ACM 2008, https://doi.org/10.1145/1411509.1411512). The next natural class, additively separable, piecewise-linear, concave utilities, captures diminishing marginal utility and is the class studied by Vazirani and Yannakakis (J. ACM 58(3), Article 10, 2011, https://doi.org/10.1145/1970392.1970394). Their paper shows that equilibria in this class are hard to compute (PPAD-complete) and that deciding whether one exists is NP-complete. Both results rest on a structural fact proved first: whenever such a market has an equilibrium at all, it has one whose prices are rational numbers of polynomial bit length. That fact is the subject of this mission.

Timeline:

  • 1959, Eisenberg and Gale: a convex program whose optimal solutions are the equilibria of linear Fisher markets; equilibrium prices are rational.
  • 2008, Devanur, Papadimitriou, Saberi and Vazirani: a combinatorial polynomial-time algorithm for linear Fisher markets, based on a max-flow test of candidate prices.
  • 2009, Chen, Dai, Du and Teng, and Chen and Teng (FOCS 2009; ISAAC 2009): PPAD-hardness for additively separable piecewise-linear concave utilities in Arrow–Debreu and Fisher markets.
  • 2011, Vazirani and Yannakakis: rationality of equilibria with polynomial bit size (Theorem 4.1 for Fisher markets, Theorem 5.1 for Arrow–Debreu markets), PPAD membership, and NP-completeness of existence.

Setting

There are nnn buyers B={1,…,n}B=\{1,\dots,n\}B={1,…,n} and ggg divisible goods G={1,…,g}G=\{1,\dots,g\}G={1,…,g}, one unit of each good. Buyer iii has a rational budget e(i)>0e(i)>0e(i)>0. For each buyer iii and good jjj a function fji:R+→R+f^i_j:\mathbb R_+\to\mathbb R_+fji​:R+​→R+​ gives the utility that iii derives from an amount of good jjj. It is piecewise linear and concave: it is given by a finite list of bounded segments (c1,a1),…,(cm,am)(c_1,a_1),\dots,(c_m,a_m)(c1​,a1​),…,(cm​,am​) with rational amounts ak>0a_k>0ak​>0, followed by a last, unbounded segment, with rational slopes c1≥c2≥⋯≥cm≥c∞≥0c_1\ge c_2\ge\dots\ge c_m\ge c_\infty\ge 0c1​≥c2​≥⋯≥cm​≥c∞​≥0. The function has slope ckc_kck​ on [a1+⋯+ak−1, a1+⋯+ak][a_1+\dots+a_{k-1},\,a_1+\dots+a_k][a1​+⋯+ak−1​,a1​+⋯+ak​] and slope c∞c_\inftyc∞​ afterwards. Buyer iii's utility for a bundle x=(x1,…,xg)x=(x_1,\dots,x_g)x=(x1​,…,xg​) is additively separable:

ui(x)=∑j∈Gfji(xj).u_i(x)=\sum_{j\in G}f^i_j(x_j).ui​(x)=j∈G∑​fji​(xj​).

Given prices p∈R≥0gp\in\mathbb R^g_{\ge0}p∈R≥0g​, a bundle x≥0x\ge0x≥0 is optimal for buyer iii if ∑jpjxj≤e(i)\sum_jp_jx_j\le e(i)∑j​pj​xj​≤e(i) and no bundle y≥0y\ge0y≥0 with ∑jpjyj≤e(i)\sum_jp_jy_j\le e(i)∑j​pj​yj​≤e(i) has ui(y)>ui(x)u_i(y)>u_i(x)ui​(y)>ui​(x). The prices ppp are equilibrium prices if there is an allocation (xij)(x_{ij})(xij​) that gives each buyer an optimal bundle and sells every good exactly: ∑ixij=1\sum_ix_{ij}=1∑i​xij​=1 for every jjj.

The bit size of a rational number a/ba/ba/b in lowest terms is the binary length of ∣a∣|a|∣a∣ plus that of bbb. The encoding size ∥M∥\|M\|∥M∥ of a market MMM is n+gn+gn+g plus the bit sizes of all budgets, slopes and amounts, plus the number of bounded segments.

For the intermediate results, fix positive prices ppp. The bang per buck of a segment sss of good jjj is slope(s)/pj\mathrm{slope}(s)/p_jslope(s)/pj​ and its value is amount(s)⋅pj\mathrm{amount}(s)\cdot p_jamount(s)⋅pj​ (infinite for an unbounded segment). Sorting buyer iii's segments by decreasing bang per buck into classes of equal bang per buck, the first class at which the cumulative value exceeds e(i)e(i)e(i) is her flexible class. Segments of strictly larger bang per buck are forced, the others undesirable. From these the paper defines spent(i)\mathrm{spent}(i)spent(i) (value of the forced segments), unspent(i)=e(i)−spent(i)\mathrm{unspent}(i)=e(i)-\mathrm{spent}(i)unspent(i)=e(i)−spent(i), unsold(j)\mathrm{unsold}(j)unsold(j) (the part of good jjj not taken by forced segments), and a network N(p)N(p)N(p) from a source through goods and buyers to a sink.

Formalization targets

Goal: Theorem 4.1 (p. 10:9)

There is a polynomial PPP such that for every Fisher market MMM as above,

M has equilibrium prices p∈Rg ⟹ M has equilibrium prices q∈Qg with ∑jbits⁡(qj)≤P(∥M∥).M\text{ has equilibrium prices }p\in\mathbb R^g\ \Longrightarrow\ M\text{ has equilibrium prices }q\in\mathbb Q^g\text{ with }\sum_{j}\operatorname{bits}(q_j)\le P(\|M\|).M has equilibrium prices p∈Rg ⟹ M has equilibrium prices q∈Qg with j∑​bits(qj​)≤P(∥M∥).

The polynomial is fixed before the market. Nothing beyond the existence of some real equilibrium is assumed.

Milestones

  1. Lemma 3.1 (p. 10:8). For positive prices with ∑jpj=∑ie(i)\sum_jp_j=\sum_ie(i)∑j​pj​=∑i​e(i), unspent≥0\mathrm{unspent}\ge0unspent≥0 and unsold≥0\mathrm{unsold}\ge0unsold≥0: ppp are equilibrium prices iff the max-flow value of N(p)N(p)N(p) is ∑iunspent(i)\sum_i\mathrm{unspent}(i)∑i​unspent(i).
  2. Proof of Theorem 4.1, first sentence (p. 10:9). From a positive equilibrium p′p'p′ with ∑jpj′=∑ie(i)\sum_jp'_j=\sum_ie(i)∑j​pj′​=∑i​e(i), build the linear program of §4, whose variables are prices and flows and whose combinatorial data are fixed by p′p'p′. Then p′p'p′, with a suitable flow, is an optimal solution of value ∑ie(i)\sum_ie(i)∑i​e(i).
  3. §4, second paragraph (p. 10:8). Every optimal solution of that LP with positive prices gives equilibrium prices.

Significance

The result is what makes the existence problem for these markets a problem in NP: a rational equilibrium of polynomial size is a certificate that can be checked, with Lemma 3.1, by one max-flow computation. The same rationality statement underlies the paper's PPAD-membership proof and its NP-completeness result for existence. It also marks the boundary with markets whose equilibria can be irrational, as happens for some non-separable utilities. In that sense it shows that separable piecewise-linear concave utilities keep the "linear" character of the problem even though computing an equilibrium becomes hard.

All three statements are proved in the source, and none of them has a machine-checked proof on the platform or, as far as is known, anywhere else. The mission produces the first formal account of piecewise-linear Fisher markets: the model, the forced/flexible/undesirable classification of segments, the max-flow test for equilibrium, and the linear program of §4. It also forces precision where the paper is informal. The §4 bang-per-buck inequalities are printed with their directions reversed, and the claim about optimal LP solutions needs positive prices. The formal statements record each of these choices.

Difficulty

The obvious argument is: "equilibria are solutions of a linear system, so a rational one exists". It fails as stated, because the set of equilibrium prices is not a polyhedron. Which segments a buyer buys depends on the prices themselves, through the ordering of the ratios slope/pj\mathrm{slope}/p_jslope/pj​, so the equilibrium conditions are a finite union of polyhedral pieces glued along the price-dependent ordering. The work is to freeze the combinatorial structure of one given equilibrium and to show that the resulting fixed linear program still certifies equilibrium at every one of its optimal points. That second step is what Lemma 3.1 is for. The polynomial bit bound then needs a quantitative bound on the vertices of a rational LP, uniform in the market's encoding.

Formalization scope

Buyers and goods are Fin n and Fin g. Budgets, slopes and amounts are rationals (ℚ). Prices and allocations are reals (ℝ), so that "admits rational prices" is a real conclusion: the goal returns q : Fin g → ℚ whose cast is an equilibrium. The committed conventions are:

  • each good has unit supply;
  • budgets are positive;
  • each fjif^i_jfji​ is a list of (slope, amount) pairs of bounded segments together with the slope of its last, unbounded segment ("the last (infinite) segment", §6), with nonnegative slopes, positive amounts and nonincreasing slopes, stored inside the market structure;
  • the unbounded segment has infinite value and, when flexible, gives its network edge infinite capacity; this is encoded logically (no upper bound on that edge);
  • equilibrium requires exact clearing of every good, which by the paper's footnote 3 gives the same equilibrium prices as leaving zero-price goods partly unsold;
  • the classes QlQ_lQl​ are represented by the bang per buck of the flexible class, not by an index;
  • parallel network edges are merged;
  • max-flow is the supremum of the values of feasible flows on the good–buyer edges.

Hypotheses added relative to the page, each disclosed in its statement:

  • positivity of the LP solution's prices (milestone 3).

The §2 condition on p. 10:7 is a sufficient condition for existence and is deliberately not a hypothesis of the goal, which assumes only that an equilibrium exists. Complexity-class statements ("in NP", "PPAD-complete") are out of scope. What is formalized is the explicit polynomial bit bound, with a polynomial chosen before the market. A goal with the polynomial chosen after the market, an encoding size that ignores the bits of the data, or an equilibrium notion without utility-maximizing bundles would be trivially satisfiable. The statements rule all three out.

Beyond this mission, a complete development needs LP theory with rational data: existence of optimal basic solutions and determinant bounds on their bit size. Existing platform results that may serve as substrate include SmaleNinth.exists_square_subsystem and SmaleNinth.abs_det_le_factorial_mul_pow. Contributions welcome: proofs of the milestones, a reusable bit-size theory for rational LP vertices, and the Arrow–Debreu analogue (Theorem 5.1).

Selected references

  • V. V. Vazirani and M. Yannakakis, Market Equilibrium under Separable, Piecewise-Linear, Concave Utilities, J. ACM 58(3), Article 10, 2011. https://doi.org/10.1145/1970392.1970394
  • N. R. Devanur, C. H. Papadimitriou, A. Saberi and V. V. Vazirani, Market Equilibrium via a Primal–Dual Algorithm for a Convex Program, J. ACM 55(5), 2008. https://doi.org/10.1145/1411509.1411512
  • E. Eisenberg and D. Gale, Consensus of Subjective Probabilities: The Pari-Mutuel Method, Ann. Math. Statist. 30(1), 1959. https://doi.org/10.1214/aoms/1177706369
  • X. Chen, D. Dai, Y. Du and S.-H. Teng, Settling the Complexity of Arrow–Debreu Equilibria in Markets with Additively Separable Utilities, FOCS 2009. https://doi.org/10.1109/FOCS.2009.29
  • W. C. Brainard and H. E. Scarf, How to Compute Equilibrium Prices in 1891, Cowles Foundation Discussion Paper 1272, 2000. https://cowles.yale.edu/research/cfdp-1272
8 thms2 active usersReviewed
Convex OptimizationLinear algebraOperations Research+1·Captain: mikedeng1

Path-Finding Methods for Linear Programming II: Properties of the Regularized D-Optimal-Design Weight FunctionResearch Paper

Motivation

Interior point methods for a linear program min⁡{c⊤x:Ax≥b}\min\{c^\top x : Ax\ge b\}min{c⊤x:Ax≥b} with A∈Rm×nA\in\mathbb R^{m\times n}A∈Rm×n follow the central path of the logarithmic barrier −∑ilog⁡si-\sum_i\log s_i−∑i​logsi​, where s=Ax−bs=Ax-bs=Ax−b is the slack vector. Renegar's path-following analysis (1988) gives O(m L)O(\sqrt m\,L)O(m​L) iterations, and for decades this was the best bound for methods whose iterations cost a linear system solve. Vaidya's volumetric barrier −log⁡det⁡(A⊤S−2A)-\log\det(A^\top S^{-2}A)−logdet(A⊤S−2A) and the hybrid volumetric barriers of Vaidya and of Anstreicher (references [45] and [2] of the paper) reached O((m rank(A))1/4L)O((m\,\mathrm{rank}(A))^{1/4}L)O((mrank(A))1/4L) iterations at the price of more expensive linear algebra. Nesterov and Nemirovski showed that a universal barrier gives O(n L)O(\sqrt n\,L)O(n​L) iterations, but that barrier cannot be evaluated efficiently.

Lee and Sidford (FOCS 2014; full version arXiv:1312.6677) obtained O~(rank(A) L)\tilde O(\sqrt{\mathrm{rank}(A)}\,L)O~(rank(A)​L) iterations, each costing O~(1)\tilde O(1)O~(1) linear system solves, by following a weighted central path whose weights are recomputed from the slacks. The weights come from a weight function ggg, defined as the minimizer of a regularized D-optimal-design problem. This mission is about that weight function and the theorem (Theorem 1 of the paper) certifying its properties. The companion mission, Path-Finding Methods for Linear Programming I, formalizes the path-following framework (Theorem 5 of §IV.C) that consumes these properties.

Setting

Fix A∈Rm×nA\in\mathbb R^{m\times n}A∈Rm×n with full column rank, rank(A)=n\mathrm{rank}(A)=nrank(A)=n, and 1≤n<m1\le n<m1≤n<m. For vectors s,w∈R>0ms,w\in\mathbb R^m_{>0}s,w∈R>0m​ write S=diag(s)S=\mathrm{diag}(s)S=diag(s), W=diag(w)W=\mathrm{diag}(w)W=diag(w), Wα=diag(wiα)W^\alpha=\mathrm{diag}(w_i^\alpha)Wα=diag(wiα​), and As=S−1AA_s=S^{-1}AAs​=S−1A. For a matrix MMM let ∥v∥M=v⊤Mv\|v\|_M=\sqrt{v^\top Mv}∥v∥M​=v⊤Mv​.

Projection matrix and slack sensitivity (Definition 2, p. 428). The projection matrix is PS−1A(w)=W1/2S−1A (A⊤S−1WS−1A)−1A⊤S−1W1/2P_{S^{-1}A}(w)=W^{1/2}S^{-1}A\,(A^\top S^{-1}WS^{-1}A)^{-1}A^\top S^{-1}W^{1/2}PS−1A​(w)=W1/2S−1A(A⊤S−1WS−1A)−1A⊤S−1W1/2, and the slack sensitivity is

γ(s,w)=max⁡i∈[m]∥W−1/21i∥PS−1A(w).\gamma(s,w)=\max_{i\in[m]}\big\|W^{-1/2}\mathbb 1_i\big\|_{P_{S^{-1}A}(w)} .γ(s,w)=i∈[m]max​​W−1/21i​​PS−1A​(w)​.

Weight function (Definition 4, p. 428). A map g:R>0m→R>0mg:\mathbb R^m_{>0}\to\mathbb R^m_{>0}g:R>0m​→R>0m​ is a weight function with constants c1,cγ,crc_1,c_\gamma,c_rc1​,cγ​,cr​ if it is differentiable and, for every s>0s>0s>0, with G(s)=diag(g(s))G(s)=\mathrm{diag}(g(s))G(s)=diag(g(s)), G′(s)G'(s)G′(s) the Jacobian of ggg at sss, and ∥y∥G(s)=∑igi(s)yi2\|y\|_{G(s)}=\sqrt{\sum_ig_i(s)y_i^2}∥y∥G(s)​=∑i​gi​(s)yi2​​:

  1. Size: ∥g(s)∥1≤c1\|g(s)\|_1\le c_1∥g(s)∥1​≤c1​;
  2. Slack sensitivity: cγ≥1c_\gamma\ge1cγ​≥1 and γ(s,g(s))≤cγ\gamma(s,g(s))\le c_\gammaγ(s,g(s))≤cγ​;
  3. Step consistency: cr≥1c_r\ge1cr​≥1 and for all r≥crr\ge c_rr≥cr​, y∈Rmy\in\mathbb R^my∈Rm: ∥(I+r−1G−1G′S)y∥G(s)≤∥y∥G(s)\|(I+r^{-1}G^{-1}G'S)y\|_{G(s)}\le\|y\|_{G(s)}∥(I+r−1G−1G′S)y∥G(s)​≤∥y∥G(s)​ and ∥y+r−1G−1G′Sy∥∞≤∥y∥∞+cr∥y∥G(s)\|y+r^{-1}G^{-1}G'Sy\|_\infty\le\|y\|_\infty+c_r\|y\|_{G(s)}∥y+r−1G−1G′Sy∥∞​≤∥y∥∞​+cr​∥y∥G(s)​;
  4. Uniformity: ∥g(s)∥∞≤2\|g(s)\|_\infty\le2∥g(s)∥∞​≤2.

The regularized objective (6), p. 429. For α,β∈R\alpha,\beta\in\mathbb Rα,β∈R,

f^(s,w)=1⊤w−1αlog⁡det⁡(As⊤WαAs)−β∑i∈[m]log⁡wi,g(s)=arg⁡min⁡w∈R>0mf^(s,w).\hat f(s,w)=\mathbb 1^\top w-\frac1\alpha\log\det\big(A_s^\top W^\alpha A_s\big)-\beta\sum_{i\in[m]}\log w_i ,\qquad g(s)=\arg\min_{w\in\mathbb R^m_{>0}}\hat f(s,w).f^​(s,w)=1⊤w−α1​logdet(As⊤​WαAs​)−βi∈[m]∑​logwi​,g(s)=argw∈R>0m​min​f^​(s,w).

At α=1,β=0\alpha=1,\beta=0α=1,β=0 this is the D-optimal design problem, dual to computing the John ellipsoid of the polytope {y:∣[A(y−x)]i∣≤si}\{y:|[A(y-x)]_i|\le s_i\}{y:∣[A(y−x)]i​∣≤si​} (§V.B).

Formalization targets

Goal: Theorem 1 (Properties of Weight Function), §V.A, p. 429

With

α=1−(log⁡22mrank(A))−1,β=rank(A)2m,\alpha=1-\Big(\log_2\frac{2m}{\mathrm{rank}(A)}\Big)^{-1},\qquad \beta=\frac{\mathrm{rank}(A)}{2m},α=1−(log2​rank(A)2m​)−1,β=2mrank(A)​,

the objective f^(s,⋅)\hat f(s,\cdot)f^​(s,⋅) has a unique minimizer over R>0m\mathbb R^m_{>0}R>0m​ for every s>0s>0s>0, and the resulting ggg is a weight function with

c1(g)=2 rank(A),cγ(g)=2,cr(g)=2log⁡22mrank(A).c_1(g)=2\,\mathrm{rank}(A),\qquad c_\gamma(g)=2,\qquad c_r(g)=2\log_2\frac{2m}{\mathrm{rank}(A)} .c1​(g)=2rank(A),cγ​(g)=2,cr​(g)=2log2​rank(A)2m​.

Milestones: the three bullets of Theorem 1

  • Size: every minimizer www of f^(s,⋅)\hat f(s,\cdot)f^​(s,⋅) satisfies ∥w∥1≤2 rank(A)\|w\|_1\le2\,\mathrm{rank}(A)∥w∥1​≤2rank(A).
  • Slack sensitivity: every minimizer www satisfies γ(s,w)≤2\gamma(s,w)\le2γ(s,w)≤2.
  • Step consistency: any map ggg selecting a minimizer at every s>0s>0s>0 is differentiable on R>0m\mathbb R^m_{>0}R>0m​ and satisfies the two step-consistency inequalities for every r≥2log⁡22mrank(A)r\ge2\log_2\frac{2m}{\mathrm{rank}(A)}r≥2log2​rank(A)2m​.

A supporting (non-milestone) item states the existence and uniqueness of the minimizer on its own.

Significance

The result. Theorem 1 is the input that turns the weighted path-following framework into an O~(rank(A) L)\tilde O(\sqrt{\mathrm{rank}(A)}\,L)O~(rank(A)​L)-iteration method: the framework needs O(cγ−1cr−3c1−1/2)O(c_\gamma^{-1}c_r^{-3}c_1^{-1/2})O(cγ−1​cr−3​c1−1/2​)-sized steps in ttt (p. 428), and Theorem 1 makes that Ω~(1/rank(A))\tilde\Omega(1/\sqrt{\mathrm{rank}(A)})Ω~(1/rank(A)​). The step consistency bound is what allows the weights to be recomputed after each Newton step without losing centrality. The same construction underlies later work on Lewis-weight barriers and on fast approximate John ellipsoids and maximum flow (§VIII of the paper).

Formalizing it. The theorem is proved in the full version of the paper (arXiv:1312.6677); the FOCS extended abstract contains no proofs. No part of it has a machine-checked proof. A complete formalization would give a verified account of leverage-score calculus (sums of leverage scores equal the rank; derivatives of projection matrices), of the convexity of w↦−log⁡det⁡(A⊤WαA)w\mapsto-\log\det(A^\top W^\alpha A)w↦−logdet(A⊤WαA) for α∈(0,1)\alpha\in(0,1)α∈(0,1), and of differentiability of an argmin via the implicit function theorem, none of which is currently packaged in Mathlib in this form.

Difficulty

Size and slack sensitivity are statements about the minimizer, which is only characterized implicitly; they require precise matrix calculus for log⁡det⁡(As⊤WαAs)\log\det(A_s^\top W^\alpha A_s)logdet(As⊤​WαAs​) and a comparison between the matrices A⊤WAA^\top WAA⊤WA (which defines γ\gammaγ) and A⊤WαAA^\top W^\alpha AA⊤WαA (which defines ggg). The specific values of α\alphaα and β\betaβ matter here: the unregularized choice α=1\alpha=1α=1, β=0\beta=0β=0 makes the problem degenerate (p. 429).

The hard part is step consistency. The Jacobian G′G'G′ of an argmin is available only implicitly, as the solution of a linear system obtained by differentiating the optimality condition. A bound on ∥G′∥\|G'\|∥G′∥ that depends on mmm is easy to get and useless: the theorem needs the operator norm of I+r−1G−1G′SI+r^{-1}G^{-1}G'SI+r−1G−1G′S in the G(s)G(s)G(s)-norm to be at most 111 as soon as rrr exceeds 2log⁡2(2m/rank(A))2\log_2(2m/\mathrm{rank}(A))2log2​(2m/rank(A)), and an ℓ∞\ell_\inftyℓ∞​ bound with only an additive cr∥y∥G(s)c_r\|y\|_{G(s)}cr​∥y∥G(s)​ loss.

Existence and differentiability of the minimizer are conclusions, not hypotheses. The minimization is over an open orthant on which the objective is not obviously coercive or strictly convex for α<1\alpha<1α<1, and differentiability of ggg requires the Hessian of f^\hat ff^​ at the minimizer to be invertible.

Formalization scope

Vectors are Fin m → ℝ, matrices Matrix (Fin m) (Fin n) ℝ; inverses are Matrix.inv, log⁡det⁡\log\detlogdet is Real.log (Matrix.det …), wiαw_i^\alphawiα​ is Real.rpow, log⁡2\log_2log2​ is Real.logb 2, the Jacobian is fderiv ℝ g s, and ∥⋅∥∞\|\cdot\|_\infty∥⋅∥∞​ is Mathlib's sup norm on Fin m → ℝ.

Conventions and pinned hypotheses:

  • Full column rank A.rank = n is assumed in every theorem. The paper never states it, but without it As⊤WαAsA_s^\top W^\alpha A_sAs⊤​WαAs​ is singular and every formula is undefined (in Lean, Matrix.inv and Real.log would return junk 000).
  • 1≤n<m1\le n<m1≤n<m. β=rank(A)/(2m)\beta=\mathrm{rank}(A)/(2m)β=rank(A)/(2m) and log⁡2(2m/rank(A))\log_2(2m/\mathrm{rank}(A))log2​(2m/rank(A)) need rank(A)≥1\mathrm{rank}(A)\ge1rank(A)≥1; at m=rank(A)m=\mathrm{rank}(A)m=rank(A) the page's α\alphaα is 000 and 1/α1/\alpha1/α in (6) is undefined.
  • Reading of α\alphaα: the exponent −1-1−1 is the reciprocal of log⁡22mrank(A)\log_2\frac{2m}{\mathrm{rank}(A)}log2​rank(A)2m​, giving α∈(0,1)\alpha\in(0,1)α∈(0,1).
  • Size is an upper bound ∥g(s)∥1≤c1\|g(s)\|_1\le c_1∥g(s)∥1​≤c1​ (the paper's weight function has ∥g(s)∥1=32rank(A)\|g(s)\|_1=\tfrac32\mathrm{rank}(A)∥g(s)∥1​=23​rank(A), while Theorem 1 reports c1=2 rank(A)c_1=2\,\mathrm{rank}(A)c1​=2rank(A)).
  • The first step-consistency bullet (an operator-norm bound) is stated for every vector yyy.
  • ggg is any map Rm→Rm\mathbb R^m\to\mathbb R^mRm→Rm whose value at each positive sss minimizes f^(s,⋅)\hat f(s,\cdot)f^​(s,⋅) over R>0m\mathbb R^m_{>0}R>0m​. Only its values on the open orthant matter. The goal also asserts that such minimizers exist and are unique, so it is not vacuous.

Ruling out trivializations: the goal does not assume ggg to be a weight function or to be differentiable, and it does not replace ggg by an arbitrary weight function; differentiability is a conclusion (a predicate using fderiv without it would make step consistency hold vacuously wherever ggg fails to be differentiable).

Useful infrastructure, reusable beyond this mission: leverage scores and their sum; derivatives of w↦log⁡det⁡(A⊤WA)w\mapsto\log\det(A^\top WA)w↦logdet(A⊤WA) and of projection matrices; convexity of −log⁡det⁡(A⊤WαA)-\log\det(A^\top W^\alpha A)−logdet(A⊤WαA) in www (related to the published ConvexOptimization.log_det_concaveOn); differentiability of the argmin of a strictly convex smooth function. Contributions of these as separate theorems are welcome, as is a proof of any single bullet of Theorem 1.

Selected references

  • Y. T. Lee, A. Sidford, Path Finding Methods for Linear Programming: Solving Linear Programs in Õ(√rank) Iterations and Faster Algorithms for Maximum Flow, FOCS 2014, pp. 424–433. https://doi.org/10.1109/FOCS.2014.52
  • Y. T. Lee, A. Sidford, Path Finding I: Solving Linear Programs with Õ(√rank) Linear System Solves, arXiv, 2013. https://arxiv.org/abs/1312.6677
  • J. Renegar, A polynomial-time algorithm, based on Newton's method, for linear programming, Mathematical Programming 40 (1988). https://doi.org/10.1007/BF01580724
7 thms2 active usersReviewed
Graph TheoryOperations ResearchTheoretical Computer Science·Captain: mikedeng1

Finding Minimum-Cost Circulations by Canceling Negative Cycles: Polynomial Termination of Minimum-Mean Cycle CancelingResearch Paper

Motivation

The minimum-cost circulation problem is a central problem of network optimization: transportation, assignment, shortest-path and maximum-flow problems are all special cases, and it is one of the few classes of linear programs with fast combinatorial algorithms. The oldest algorithm for it, the cycle-canceling algorithm of Klein (1967), repeatedly finds a residual cycle of negative cost and pushes as much flow as possible around it. With an arbitrary choice of cycle it can take exponentially many iterations even on integer data, and it need not terminate at all when capacities are irrational.

Goldberg and Tarjan (J. ACM 36(4), 1989) showed that one simple selection rule repairs this: always cancel a residual cycle whose mean cost (cost divided by number of arcs) is as small as possible. The resulting algorithm is strongly polynomial: its number of iterations is bounded by a polynomial in the number of vertices and arcs alone, independent of the magnitudes of capacities and costs. This mission formalizes that bound.

Timeline:

  • 1967, Klein: the cycle-canceling algorithm, without an iteration bound.
  • 1972, Edmonds and Karp: the first polynomial algorithm for minimum-cost flow (capacity scaling), polynomial in the bit length of the capacities.
  • 1985, Tardos: the first strongly polynomial algorithm, introducing the arc-fixing idea that Theorem 3.8 generalizes.
  • 1987–1989, Goldberg and Tarjan: generalized cost scaling and ε-optimality; in this paper, minimum-mean cycle canceling terminates after O(nm² log n) iterations for real costs (Theorem 3.9) and O(nm log(nC)) for integer costs bounded by C (Theorem 3.7).

Setting

A circulation network is a finite directed graph G=(V,E)G=(V,E)G=(V,E) with n=∣V∣n=|V|n=∣V∣ vertices and m=∣E∣m=|E|m=∣E∣ arcs, which is symmetric ((v,w)∈E(v,w)\in E(v,w)∈E iff (w,v)∈E(w,v)\in E(w,v)∈E, so mmm counts both directions), together with real capacities u(v,w)u(v,w)u(v,w) and real costs c(v,w)c(v,w)c(v,w), the cost being antisymmetric: c(v,w)=−c(w,v)c(v,w)=-c(w,v)c(v,w)=−c(w,v).

A circulation is a real function fff on arcs satisfying f(v,w)≤u(v,w)f(v,w)\le u(v,w)f(v,w)≤u(v,w), f(v,w)=−f(w,v)f(v,w)=-f(w,v)f(v,w)=−f(w,v) on every arc, and conservation ∑v:(w,v)∈Ef(v,w)=0\sum_{v:(w,v)\in E} f(v,w)=0∑v:(w,v)∈E​f(v,w)=0 at every vertex www. Its cost is cost⁡(f)=12∑(v,w)∈Ec(v,w)f(v,w)\operatorname{cost}(f)=\tfrac12\sum_{(v,w)\in E}c(v,w)f(v,w)cost(f)=21​∑(v,w)∈E​c(v,w)f(v,w), and fff is minimum-cost (optimal) if no circulation has smaller cost.

The residual capacity of an arc is uf(v,w)=u(v,w)−f(v,w)u_f(v,w)=u(v,w)-f(v,w)uf​(v,w)=u(v,w)−f(v,w); arcs with uf>0u_f>0uf​>0 are residual arcs. A residual cycle is a simple cycle of residual arcs; its capacity is the minimum residual capacity along it, its cost c(Γ)c(\Gamma)c(Γ) is the sum of its arc costs, and its mean cost is c(Γ)/∣Γ∣c(\Gamma)/|\Gamma|c(Γ)/∣Γ∣. Canceling a residual cycle raises the flow on each of its arcs by its capacity (and lowers the flow on each reverse arc by the same amount).

The minimum-mean cycle-canceling algorithm starts from any circulation and, while some residual cycle has negative cost, cancels a residual cycle whose mean cost is minimum among all residual cycles. Ties are broken arbitrarily, so the algorithm is a nondeterministic process; a run of length KKK is any sequence f0,…,fKf_0,\dots,f_Kf0​,…,fK​ of circulations produced by KKK such iterations.

The analysis uses a price function p:V→Rp:V\to\mathbb Rp:V→R, the reduced cost cp(v,w)=c(v,w)+p(v)−p(w)c_p(v,w)=c(v,w)+p(v)-p(w)cp​(v,w)=c(v,w)+p(v)−p(w), and ε-optimality: for ε≥0\varepsilon\ge0ε≥0, fff is ε-optimal if some ppp gives cp(v,w)≥−εc_p(v,w)\ge-\varepsiloncp​(v,w)≥−ε on every residual arc. The quantity ε(f)\varepsilon(f)ε(f) is the least such ε\varepsilonε, and an arc is ε-fixed if all ε-optimal circulations carry the same flow on it.

Formalization targets

Goal: Theorem 3.9, with the proof's constant

For every circulation network with n≥2n\ge2n≥2 vertices, mmm arcs, arbitrary real capacities and arbitrary real antisymmetric costs, every run of the minimum-mean cycle-canceling algorithm has length

K ≤ n m2 ⌈ln⁡n+1⌉.K\ \le\ n\,m^2\,\lceil \ln n+1\rceil .K ≤ nm2⌈lnn+1⌉.

The statement quantifies over all starting circulations, all tie-breaking choices and all real data; it is the paper's O(nm2log⁡n)O(nm^2\log n)O(nm2logn) with the constant its proof establishes.

Milestones

In the order the proof uses them: Theorem 2.1 (optimal iff no negative residual cycle), Theorem 3.1 (optimal iff some price function has cp≥0c_p\ge0cp​≥0 on residual arcs), Theorem 3.3 (ε(f)=−μ(f)\varepsilon(f)=-\mu(f)ε(f)=−μ(f) for nonoptimal fff, where μ(f)\mu(f)μ(f) is the minimum cycle mean of the residual graph), Lemma 3.5 (a minimum-mean cancellation does not increase ε(f)\varepsilon(f)ε(f)), Lemma 3.6 (mmm cancellations shrink ε(f)\varepsilon(f)ε(f) by a factor 1−1/n1-1/n1−1/n), and Theorem 3.8 (an arc with ∣cp(v,w)∣≥2nε|c_p(v,w)|\ge2n\varepsilon∣cp​(v,w)∣≥2nε is ε-fixed).

Significance

Theorem 3.9 shows that a classical, natural algorithm is strongly polynomial: its iteration count depends only on the combinatorial size of the network. Combined with Karp's O(nm)O(nm)O(nm) minimum-mean cycle algorithm it yields an O(n2m3log⁡n)O(n^2m^3\log n)O(n2m3logn) strongly polynomial algorithm (Theorem 3.10), and its method, measuring progress by the minimum cycle mean and fixing arcs once ε(f)\varepsilon(f)ε(f) is small, underlies the faster cancel-and-tighten algorithm of Section 4 and later strongly polynomial analyses of network-flow and related algorithms.

The theorem has been proved since 1989; this mission's contribution is a machine-checked proof. To the best of the platform's catalogue, no cycle-canceling bound, minimum cycle mean or ε-optimality statement has been formalized. The platform does hold the negative-cycle optimality criterion in a different model (LinearOptimization.network_no_negative_cycle_optimal, Bertsimas–Tsitsiklis Theorem 7.6, with nonnegative flows and supplies) and a flow decomposition theorem (LinearOptimization.network_flow_decomposition); both are related to milestones here but are stated for a different network model.

Difficulty

The obvious potential function, the cost of the circulation, decreases at every iteration but by amounts that depend on the data, so it yields no bound independent of the capacities and costs. The analysis instead has to track ε(f)\varepsilon(f)ε(f), an infimum over price functions, and relate it to the minimum cycle mean of a residual graph that changes after each cancellation, including arcs that appear only because of earlier cancellations. The strongly polynomial part needs a second ingredient: showing that the flow on some arc never changes again, which requires comparing the current circulation with all other ε-optimal circulations of the network, not only those the algorithm visits.

Formalization scope

Vertices form a finite type V; the arc set is E : Finset (V × V); capacities, costs and flows are real functions V → V → ℝ read only on E. nnn is Fintype.card V and mmm is E.card, counting (v,w)(v,w)(v,w) and (w,v)(w,v)(w,v) separately, as in the paper. Cycles are nonempty duplicate-free vertex lists, whose arcs are the cyclically consecutive pairs; one- and two-vertex cycles are allowed and have cost 000. Minimum mean is taken over all residual simple cycles of the current circulation. ε(f)\varepsilon(f)ε(f) is an infimum (sInf) over a set that is nonempty and bounded below for every circulation; its attainment is to be proved, never assumed.

Explicit constants replacing the paper's O(⋅)O(\cdot)O(⋅):

  • Theorem 3.9: the paper prints O(nm2log⁡n)O(nm^2\log n)O(nm2logn); its proof uses groups of k=m n⌈ln⁡n+1⌉k=m\,n\lceil\ln n+1\rceilk=mn⌈lnn+1⌉ iterations, at most mmm of them, so the goal states K≤n m2⌈ln⁡n+1⌉K\le n\,m^2\lceil\ln n+1\rceilK≤nm2⌈lnn+1⌉ with the natural logarithm.
  • The standing assumption n≥2n\ge2n≥2 (p. 874) is kept on the goal; the standing assumption m≥nm\ge nm≥n is not used by the proof and is omitted.

"Terminates after at most BBB iterations" means that every run has length at most BBB. Asserting only that some run is short, or that the process eventually stops, does not formalize the theorem; nor does a step relation that drops negativity, simplicity of the cycle, minimality of the mean over all residual cycles, or the update by exactly the cycle's capacity.

A complete development needs cycle decomposition of the difference of two circulations, LP duality for circulations (Theorem 3.1), and bookkeeping for the residual graph under cancellation. These are reusable for any cycle-canceling or cost-scaling analysis, and contributions of that infrastructure as separate lemmas are welcome. Theorem 3.7 (the integer-cost bound) and Section 4 are outside this mission.

Selected references

  • A. V. Goldberg, R. E. Tarjan, Finding Minimum-Cost Circulations by Canceling Negative Cycles, J. ACM 36(4):873–886, 1989. https://doi.org/10.1145/76359.76368
  • M. Klein, A primal method for minimal cost flows with applications to the assignment and transportation problems, Management Science 14(3):205–220, 1967. https://doi.org/10.1287/mnsc.14.3.205
  • É. Tardos, A strongly polynomial minimum cost circulation algorithm, Combinatorica 5(3):247–255, 1985. https://doi.org/10.1007/BF02579369
  • A. V. Goldberg, R. E. Tarjan, Finding minimum-cost circulations by successive approximation, Mathematics of Operations Research 15(3):430–466, 1990. https://doi.org/10.1287/moor.15.3.430
  • R. M. Karp, A characterization of the minimum cycle mean in a digraph, Discrete Mathematics 23(3):309–311, 1978. https://doi.org/10.1016/0012-365X(78)90011-0
  • J. Edmonds, R. M. Karp, Theoretical improvements in algorithmic efficiency for network flow problems, J. ACM 19(2):248–264, 1972. https://doi.org/10.1145/321694.321699
10 thms2 active usersReviewed
CombinatoricsGraph TheoryOperations Research·Captain: mikedeng1

Optimum Branchings: The Vertices of the Branching Polyhedron Are Exactly the BranchingsResearch Paper

Motivation

A branching in a directed graph is a set of edges that contains no cycle (even ignoring directions) and in which no two edges point to the same node; a connected branching is an arborescence, a tree rooted at one node with all edges directed away from the root. The optimum branching problem asks, for real weights on the edges, for a branching of maximum total weight. It contains the minimum-cost spanning arborescence problem (the directed analogue of the minimum spanning tree), which appears in network design, in the analysis of broadcast and routing structures, in phylogenetics, and in dependency parsing in computational linguistics, where maximum spanning arborescences are the standard decoding step of graph-based parsers.

J. Edmonds solved the problem in Optimum branchings (J. Res. Nat. Bur. Standards 71B (1967) 233–240). The paper gives an algorithm (the shrinking algorithm usually attributed to Chu–Liu and Edmonds) and, proved together with it, a polyhedral theorem: the linear system that every branching obviously satisfies has no other vertices. This was one of the first integral polyhedron theorems beyond bipartite matching and network flows, and together with Edmonds' matching polytope (1965) it set the pattern of polyhedral combinatorics: describe the convex hull of the combinatorial objects by linear inequalities, and prove optimality by a linear programming dual.

Timeline:

  • 1965: Y. J. Chu and T. H. Liu describe the shrinking algorithm for the maximum arborescence.
  • 1965: Edmonds, Paths, trees, and flowers and Maximum matching and a polyhedron with 0,1-vertices: the matching polytope.
  • 1967: Edmonds, Optimum branchings: the algorithm, Theorem 2 (vertices of the branching polyhedron), and the dual certificate built along the algorithm.
  • 1970–1971: Edmonds' matroid intersection theorem, which contains the branching polyhedron theorem as the intersection of a graphic matroid and a partition matroid.
  • 1977–1986: faster implementations (Tarjan; Gabow, Galil, Spencer and Tarjan).

Setting

A graph GGG consists of a finite set VVV of nodes and a finite set EEE of edges. Each edge eee is directed toward a node front(e)\mathrm{front}(e)front(e), its front end, and away from a different node rear(e)\mathrm{rear}(e)rear(e), its rear end. Parallel edges are allowed; loops are not.

For F⊆EF\subseteq EF⊆E, a node vvv meets kkk edges of FFF if #{e∈F:front(e)=v}+#{e∈F:rear(e)=v}=k\#\{e\in F:\mathrm{front}(e)=v\}+\#\{e\in F:\mathrm{rear}(e)=v\}=k#{e∈F:front(e)=v}+#{e∈F:rear(e)=v}=k. A set B⊆EB\subseteq EB⊆E is a forest if it contains no polygon, i.e. no nonempty F⊆BF\subseteq BF⊆B in which every node meets zero or two edges of FFF; it is a branching if in addition distinct edges of BBB have distinct front ends. The incidence vector xB∈REx^B\in\mathbb R^ExB∈RE of BBB has xeB=1x^B_e=1xeB​=1 for e∈Be\in Be∈B and 000 otherwise.

The branching polyhedron PG⊆REP_G\subseteq\mathbb R^EPG​⊆RE is the set of xxx with

  • (L1)(L_1)(L1​) xe≥0x_e\ge0xe​≥0 for every edge eee;
  • (L2)(L_2)(L2​) ∑e: front(e)=vxe≤1\sum_{e:\,\mathrm{front}(e)=v}x_e\le1∑e:front(e)=v​xe​≤1 for every node vvv;
  • (L3)(L_3)(L3​) ∑e: front(e),rear(e)∈Sxe≤∣S∣−1\sum_{e:\,\mathrm{front}(e),\mathrm{rear}(e)\in S}x_e\le|S|-1∑e:front(e),rear(e)∈S​xe​≤∣S∣−1 for every set SSS of two or more nodes.

A vertex of a set P⊆REP\subseteq\mathbb R^EP⊆RE is a point of PPP that is the unique maximizer over PPP of some linear function x↦∑ecexex\mapsto\sum_e c_ex_ex↦∑e​ce​xe​.

For weights c∈REc\in\mathbb R^Ec∈RE, the dual variables are yhy_hyh​ for each node vhv_hvh​ and ySy_SyS​ for each SSS with ∣S∣≥2|S|\ge2∣S∣≥2; write we=∑S∋front(e),rear(e)ySw_e=\sum_{S\ni\mathrm{front}(e),\mathrm{rear}(e)}y_Swe​=∑S∋front(e),rear(e)​yS​ and (b,y)=∑hyh+∑S(∣S∣−1)yS(b,y)=\sum_hy_h+\sum_S(|S|-1)y_S(b,y)=∑h​yh​+∑S​(∣S∣−1)yS​. Edmonds' conditions are (15) yh≥0y_h\ge0yh​≥0, (16) yS≥0y_S\ge0yS​≥0, (17) yfront(e)+we≥cey_{\mathrm{front}(e)}+w_e\ge c_eyfront(e)​+we​≥ce​ for every edge, and, for a branching BBB, (18) yh≠0⇒y_h\ne0\Rightarrowyh​=0⇒ some edge of BBB enters vhv_hvh​, (19) yS≠0⇒y_S\ne0\RightarrowyS​=0⇒ exactly ∣S∣−1|S|-1∣S∣−1 edges of BBB lie inside SSS, (20) yfront(e)+we=cey_{\mathrm{front}(e)}+w_e=c_eyfront(e)​+we​=ce​ for e∈Be\in Be∈B.

Formalization targets

Goal: Theorem 2 (p. 235)

{x: x is a vertex of PG}  =  {xB: B is a branching of G}.\{x:\ x\text{ is a vertex of }P_G\}\;=\;\{x^B:\ B\text{ is a branching of }G\}.{x: x is a vertex of PG​}={xB: B is a branching of G}.

Both inclusions, for every finite loopless directed multigraph.

Milestones

  1. §5, p. 236: for every branching BBB, xB∈PGx^B\in P_GxB∈PG​.
  2. §5, p. 236: for every branching BBB, xBx^BxB is a vertex of PGP_GPG​.
  3. §6, (12)–(14): if BBB is a branching and yyy satisfies (15)–(20), then (c,xB)=(b,y)(c,x^B)=(b,y)(c,xB)=(b,y), xBx^BxB maximizes (c,x)(c,x)(c,x) over PGP_GPG​, and yyy minimizes (b,y)(b,y)(b,y) subject to (15)–(17).
  4. §7, p. 237: for every c∈REc\in\mathbb R^Ec∈RE there are a branching BBB and a yyy satisfying (15)–(20).
  5. Lemma 1, p. 236: for every c∈REc\in\mathbb R^Ec∈RE some branching vector lies in PGP_GPG​ and maximizes ∑ecexe\sum_ec_ex_e∑e​ce​xe​ over PGP_GPG​.

Significance

Theorem 2 says that the linear program max⁡{(c,x):x∈PG}\max\{(c,x):x\in P_G\}max{(c,x):x∈PG​} always has an optimal solution that is a branching, and that every vertex of PGP_GPG​ is one. Consequently optimum branchings, and after the reductions of the paper's §2 optimum spanning and rooted arborescences, can be computed by linear programming, and their optimality is certified by a dual vector satisfying (15)–(20). The same statement underlies the separation-based treatment of arborescence constraints in integer programming formulations of network design and of the asymmetric travelling salesman problem. The integrality of the dual for integer weights (the paper's §8) yields min–max theorems of König type for branchings.

The result is proved and classical; no machine-checked proof of it in a proof assistant is known. The mission asks for the paper's own proof chain: branching vectors are points and vertices of PGP_GPG​, linear programming optimality from complementary slackness, existence of a dual certificate for every weight vector, and the deduction of Theorem 2. Proofs through matroid intersection or total dual integrality would also establish the goal and are welcome as alternative routes.

Difficulty

The inclusion "branching vectors are vertices" and the certificate criterion are short. The substance is Milestone 4: for arbitrary real weights, a branching and a dual vector satisfying the complementary slackness conditions must exist simultaneously. Finiteness gives an optimum branching at once, but that says nothing about optimality over the fractional points of PGP_GPG​; the difficulty is the dual. The natural attempt, taking yS=0y_S=0yS​=0 for all sets and yhy_hyh​ the largest positive weight entering vhv_hvh​, violates (20) as soon as the greedy choice closes a circuit: the (L3)(L_3)(L3​) duals of nested node sets, arising from repeatedly shrinking circuits, are needed, and they must be kept nonnegative through weight changes of the form c3+c0−c4c_3+c_0-c_4c3​+c0​−c4​ on edges entering a shrunk circuit.

Formalization scope

A graph is a structure Graph V E with front rear : E → V and a proof that front e ≠ rear e; V and E carry Fintype and DecidableEq. Edge sets are Finset E; vectors are E → ℝ; the linear function with weights c is ∑ e, c e * x e. A branching is defined combinatorially (no nonempty edge subset in which every node meets zero or two edges, and distinct front ends), never by counting edges inside node sets, and PGP_GPG​ is the solution set of (L1)(L_1)(L1​)–(L3)(L_3)(L3​), never a convex hull; either shortcut would make half of Theorem 2 true by definition. A vertex is a unique maximizer of a linear function, as on p. 236 (Mathlib's Set.exposedPoints has the same content); the set variables of the dual are a function Finset V → ℝ whose values on sets of fewer than two nodes are ignored. The right side of (L3)(L_3)(L3​) is the real number ∣S∣−1|S|-1∣S∣−1.

Implicit conventions made explicit: the no-loop condition is part of the graph (with a loop eee, the vector of {e}\{e\}{e} is a vertex of PGP_GPG​ but not a branching); parallel edges are allowed; weights have arbitrary sign and the empty branching is allowed. The mission does not model the algorithm of §4 or Theorem 1's notion of a "good" algorithm; Milestone 4 states only the existence of a certificate, which is what Lemma 1 uses.

Useful reusable infrastructure: finite directed multigraphs with an edge type, forests via polygons, and a finite LP duality lemma for max⁡{c⊤x:x≥0, Ax≤b}\max\{c^\top x: x\ge0,\ Ax\le b\}max{c⊤x:x≥0, Ax≤b}; contributions of either are welcome.

Selected references

  • J. Edmonds, Optimum branchings, J. Res. Nat. Bur. Standards Sect. B 71B (1967), 233–240. https://doi.org/10.6028/jres.071b.032
  • Y. J. Chu and T. H. Liu, On the shortest arborescence of a directed graph, Scientia Sinica 14 (1965), 1396–1400.
  • J. Edmonds, Maximum matching and a polyhedron with 0,1-vertices, J. Res. Nat. Bur. Standards 69B (1965), 125–130. https://doi.org/10.6028/jres.069B.013
  • R. E. Tarjan, Finding optimum branchings, Networks 7 (1977), 25–35. https://doi.org/10.1002/net.3230070103
  • H. N. Gabow, Z. Galil, T. Spencer and R. E. Tarjan, Efficient algorithms for finding minimum spanning trees in undirected and directed graphs, Combinatorica 6 (1986), 109–122. https://doi.org/10.1007/BF02579168
  • A. Schrijver, Combinatorial Optimization: Polyhedra and Efficiency, Springer (2003), Chapter 52.
9 thms2 active usersReviewed
CombinatoricsGraph TheoryOperations Research·Captain: mikedeng1

On Certain Polytopes Associated with Graphs V: Zero-One Optima of the Odd-Cycle Relaxation on Series-Parallel GraphsResearch Paper

Motivation

The stable set problem asks for a largest set of pairwise non-adjacent vertices in a graph; its size is the stability number α(G)\alpha(G)α(G). It is NP-hard in general, and a standard way to attack it in integer programming is to write down linear inequalities valid for all stable sets and solve the resulting linear program. The weakest such relaxation uses only the edge inequalities xv+xw≤1x_v+x_w\le 1xv​+xw​≤1; its optimum can be as large as ∣V∣/2|V|/2∣V∣/2 on graphs with small α(G)\alpha(G)α(G). Adding, for every odd circuit CCC, the inequality ∑u∈Cxu≤12(∣C∣−1)\sum_{u\in C}x_u\le\frac12(|C|-1)∑u∈C​xu​≤21​(∣C∣−1) gives the odd-cycle relaxation, the first strengthening that cuts off the fractional point x≡12x\equiv\frac12x≡21​ on odd cycles.

Section 7 of V. Chvátal, On certain polytopes associated with graphs (J. Combin. Theory Ser. B 18 (1975) 138–154, doi:10.1016/0095-8956(75)90041-6) identifies a graph class on which this relaxation is exact for the all-ones objective, with an integral certificate on the dual side: the series-parallel networks. The paper conjectures (Conjecture 7.3) that for these graphs the odd-cycle inequalities describe the whole stable set polytope; graphs with that property were later called t-perfect.

Timeline:

  • 1960: G. A. Dirac, in "In abstrakten Graphen vorhandene vollständige 4-Graphen und ihre Unterteilungen" (Math. Nachr. 22), proves that graphs containing no subdivided K4K_4K4​ have at least two vertices of degree at most two.
  • 1975: Chvátal introduces the system (7.1) and proves Theorem 7.1 (this mission): on series-parallel networks, max⁡∑uxu\max\sum_u x_umax∑u​xu​ subject to (7.1) and its dual both have zero–one optima. He conjectures the full polyhedral statement.
  • 1979: M. Boulala and J.-P. Uhry, "Polytope des indépendants d'un graphe série-parallèle" (Discrete Math. 27), prove the conjecture: (7.1) defines the stable set polytope of every series-parallel graph.
  • 1986: A. M. H. Gerards and A. Schrijver, "Matrices with the Edmonds–Johnson property" (Combinatorica 6), extend this to graphs with no odd-K4K_4K4​ subdivision.

Setting

All graphs G=(V,E)G=(V,E)G=(V,E) are finite, undirected and loopless, with no parallel edges. A stable set is a set of vertices no two of which are adjacent. We write d(u)d(u)d(u) for the degree of uuu.

A set C⊆VC\subseteq VC⊆V induces an odd circuit if the induced subgraph G[C]G[C]G[C] is a cycle of length 2k+12k+12k+1 with k≥1k\ge1k≥1; triangles count, and such a cycle has no chords. Z(G)Z(G)Z(G) is the set of all such CCC. The odd-cycle system of GGG is

0≤xu≤1(u∈V),xv+xw≤1(vw∈E),∑u∈Cxu≤12(∣C∣−1)(C∈Z(G)).(7.1)\begin{aligned} 0\le x_u&\le 1 && (u\in V),\\ x_v+x_w&\le 1 && (vw\in E),\\ \textstyle\sum_{u\in C}x_u&\le \tfrac12(|C|-1) && (C\in Z(G)). \end{aligned}\tag{7.1}0≤xu​xv​+xw​∑u∈C​xu​​≤1≤1≤21​(∣C∣−1)​​(u∈V),(vw∈E),(C∈Z(G)).​(7.1)

Its linear programming dual for the objective ∑uxu\sum_u x_u∑u​xu​, with x≥0x\ge0x≥0 read as sign constraints, has variables yu≥0y_u\ge0yu​≥0, ze≥0z_e\ge0ze​≥0, wC≥0w_C\ge0wC​≥0 and reads

min⁡ ∑uyu+∑eze+∑C∈Z(G)12(∣C∣−1) wCs.t.yu+∑e∋uze+∑C∋uwC≥1  (u∈V).\min\ \sum_{u}y_u+\sum_{e}z_e+\sum_{C\in Z(G)}\tfrac12(|C|-1)\,w_C\quad\text{s.t.}\quad y_u+\sum_{e\ni u}z_e+\sum_{C\ni u}w_C\ge 1\ \ (u\in V).min u∑​yu​+e∑​ze​+C∈Z(G)∑​21​(∣C∣−1)wC​s.t.yu​+e∋u∑​ze​+C∋u∑​wC​≥1  (u∈V).

A homeomorph of K4K_4K4​ is a graph obtained from K4K_4K4​ by subdividing its edges into paths through new vertices of degree two. GGG is a series-parallel network if no subgraph of GGG is a homeomorph of K4K_4K4​.

Formalization targets

Goal: Theorem 7.1

For every series-parallel network GGG,

∃ x∈{0,1}V feasible for (7.1):  ∑uxu=max⁡{∑uxu′:x′∈RV satisfies (7.1)},\exists\,x\in\{0,1\}^V\ \text{feasible for (7.1)}:\ \ \sum_u x_u=\max\Big\{\sum_u x'_u : x'\in\mathbb R^V\text{ satisfies (7.1)}\Big\},∃x∈{0,1}V feasible for (7.1):  u∑​xu​=max{u∑​xu′​:x′∈RV satisfies (7.1)},

and there is a zero–one dual feasible (y,z,w)(y,z,w)(y,z,w) whose dual objective equals the minimum over all real dual feasible points. Both optimality claims are against real points. Chvátal's statement has no constants to improve; the formal goal is his theorem as printed.

Milestones

  1. Dirac's theorem (§7, p. 150): a series-parallel network with at least two vertices has two distinct vertices of degree at most two.
  2. Case 4 closure (p. 151): if d(u)=2d(u)=2d(u)=2 and the neighbours v,wv,wv,w of uuu are non-adjacent, deleting uuu and identifying vvv with www yields a series-parallel network.
  3. The combinatorial core (p. 151, (i)–(ii)): there are a stable set SSS and a spanning subgraph F≤GF\le GF≤G whose components are isolated vertices, isolated edges and odd circuits, such that with aaa isolated vertices, bbb isolated edges and ckc_kck​ circuits of length 2k+12k+12k+1,
a+b+∑kk ck=∣S∣.a+b+\sum_k k\,c_k=|S|.a+b+k∑​kck​=∣S∣.

Significance

The result. Theorem 7.1 says that on series-parallel networks the odd-cycle relaxation computes α(G)\alpha(G)α(G) exactly, and that the optimum is certified by a covering of the vertex set by single vertices, edges and chordless odd circuits whose total weight equals ∣S∣|S|∣S∣. This is a min–max theorem of König type for a non-bipartite, non-perfect class: odd cycles of length at least five are series-parallel and not perfect, so the clique inequalities of the perfect-graph theory (mission I of this series) do not suffice here. The statement is the unweighted case of the later polyhedral results of Boulala–Uhry and Gerards–Schrijver, and the combinatorial core (milestone 3) is the basis of a polynomial algorithm for α(G)\alpha(G)α(G) on this class, as the paper remarks.

Formalizing it. The theorem has been proved since 1975; neither Mathlib nor the Prove2Me library contains a formal proof of it. A formal proof needs a working notion of graph subdivision (topological minor), which Mathlib does not have, Dirac's degree theorem, the induction of the paper with its four cases, and the passage from the combinatorial core to a pair of LP optima through weak duality. Each of these is reusable: topological minors and the K4K_4K4​-subdivision-free class appear throughout structural graph theory.

Difficulty

The combinatorial core is proved by induction on ∣V∣|V|∣V∣ removing a vertex of degree at most two, and three of the four cases are routine. The obstacle is Case 4 (d(u)=2d(u)=2d(u)=2, neighbours non-adjacent): deleting uuu alone loses the information needed to recover SSS and FFF, so the proof identifies the two neighbours. That requires the class to be closed under this identification, a statement about subdivisions that is not a local edge count, and a lifting of (S′,F′)(S',F')(S′,F′) from the reduced graph with a case split on the component of F′F'F′ containing the merged vertex. A second gap is between FFF and the dual: an odd-circuit component of FFF may have chords in GGG and so need not lie in Z(G)Z(G)Z(G), and the zero–one dual solution must be extracted from it. Finally, Dirac's theorem itself is the one place where the absence of K4K_4K4​ subdivisions is used positively, and it is not a consequence of a degree-counting argument.

Formalization scope

Graphs are SimpleGraph V on a Fintype V with decidable equality and decidable adjacency. Z(G)Z(G)Z(G) is a Finset (Finset V) whose members induce a subgraph isomorphic to Mathlib's cycleGraph (2k+1), k≥1k\ge1k≥1. The dual variables are indexed by V, by the edge set G.edgeSet, and by the subtype of Z(G)Z(G)Z(G); x≥0x\ge0x≥0 is a sign constraint with no dual variable. "Contains a homeomorph of K4K_4K4​" is encoded by four distinct branch vertices and six paths (Walk.IsPath) that avoid other branch vertices and meet only at common endpoints; it is not the K4K_4K4​-minor notion and not the series–parallel composition notion, whose equivalence with it is not part of the paper.

Conventions and implicit hypotheses made explicit:

  • Dirac's theorem is stated with ∣V∣≥2|V|\ge 2∣V∣≥2; as printed it fails for graphs with fewer than two vertices.
  • In Case 4 the identified graph has vertex set V∖{u,w}V\setminus\{u,w\}V∖{u,w}, with vvv representing v≡wv\equiv wv≡w; parallel edges merge.
  • Optimality in the goal is against every real feasible point of each program. A statement comparing the zero–one points only with other zero–one points would reduce the primal half to α(G)≤α(G)\alpha(G)\le\alpha(G)α(G)≤α(G) and is ruled out.
  • In milestone 3 the sum a+b+∑kkcka+b+\sum_k k c_ka+b+∑k​kck​ is written as a sum over the connected components of FFF of 111 (one or two vertices) or (n−1)/2(n-1)/2(n−1)/2 (n≥3n\ge3n≥3 vertices).

Corollary 7.2 (stated without proof) and Conjecture 7.3 are not part of this mission. Contributions welcome: a general topological-minor library, Dirac's theorem, and a proof of the combinatorial core.

Selected references

  • V. Chvátal, On certain polytopes associated with graphs, J. Combin. Theory Ser. B 18 (1975) 138–154. https://doi.org/10.1016/0095-8956(75)90041-6
  • G. A. Dirac, In abstrakten Graphen vorhandene vollständige 4-Graphen und ihre Unterteilungen, Math. Nachr. 22 (1960) 61–85 (reference [6], Satz 5, of the paper).
  • R. J. Duffin, Topology of series-parallel networks, J. Math. Anal. Appl. 10 (1965) 303–318 (reference [7] of the paper).
  • M. Boulala, J.-P. Uhry, Polytope des indépendants d'un graphe série-parallèle, Discrete Math. 27 (1979) 225–243.
  • A. M. H. Gerards, A. Schrijver, Matrices with the Edmonds–Johnson property, Combinatorica 6 (1986) 365–379.
8 thms2 active usersReviewed
CombinatoricsDiscrete GeometryOperations Research·Captain: mikedeng1

On Sub-determinants and the Diameter of Polyhedra: A Polynomial Diameter Bound in the Largest SubdeterminantResearch Paper

Motivation

The combinatorial diameter of a polyhedron is the largest distance, in its vertex-edge graph, between two vertices. It is a lower bound on the number of pivots any edge-following method such as the simplex method needs in the worst case, which is why the polynomial Hirsch conjecture — the diameter of P={x∈Rn:Ax≤b}P = \{x \in \mathbb{R}^n : Ax \le b\}P={x∈Rn:Ax≤b} is bounded by a polynomial in mmm and nnn — is a central open question of linear optimization and discrete geometry. The best general upper bound is quasi-polynomial, m1+log⁡nm^{1+\log n}m1+logn (Kalai–Kleitman 1992); the original Hirsch bound m−nm - nm−n is false for polytopes (Santos 2012).

A different line of work bounds the diameter by the arithmetic of the constraint matrix instead of its size. For an integer matrix AAA let Δ\DeltaΔ be the largest absolute value of a sub-determinant of AAA. Dyer and Frieze (1994) showed that for totally unimodular AAA (Δ=1\Delta = 1Δ=1) the diameter is polynomial, O(m16n3(log⁡mn)3)O(m^{16} n^3 (\log mn)^3)O(m16n3(logmn)3). Bonifas, Di Summa, Eisenbrand, Hähnle and Niemeier (SoCG 2012; Discrete Comput Geom 52, 2014) improved and generalized this to O(Δ2n4log⁡nΔ)O(\Delta^2 n^4 \log n\Delta)O(Δ2n4lognΔ) for all polyhedra and O(Δ2n3.5log⁡nΔ)O(\Delta^2 n^{3.5} \log n\Delta)O(Δ2n3.5lognΔ) for polytopes, bounds that do not depend on the number mmm of inequalities. This mission formalizes the polytope case.

Setting

Let A∈Zm×nA \in \mathbb{Z}^{m\times n}A∈Zm×n with rows a1,…,ama_1,\dots,a_ma1​,…,am​, let b∈Rmb \in \mathbb{R}^mb∈Rm, and let P={x∈Rn:Ax≤b}P = \{x \in \mathbb{R}^n : Ax \le b\}P={x∈Rn:Ax≤b}. A vertex of PPP is an extreme point; for a polyhedron this is a point of PPP at which nnn linearly independent inequalities are tight. Two vertices u≠vu \ne vu=v are adjacent if the segment [u,v][u,v][u,v] is an edge (a one-dimensional face) of PPP. This gives the polyhedral graph GP=(V,E)G_P = (V, E)GP​=(V,E), and the diameter of PPP is at most BBB if every two vertices are joined by a walk of at most BBB edges.

AAA has sub-determinants bounded by Δ\DeltaΔ if every k×kk\times kk×k submatrix, for every k≥1k \ge 1k≥1, has determinant in [−Δ,Δ][-\Delta, \Delta][−Δ,Δ]. In particular every entry is at most Δ\DeltaΔ in absolute value.

For a vertex vvv the normal cone CvC_vCv​ is the set of objectives ccc for which vvv maximizes cTxc^T xcTx over PPP. With BnB_nBn​ the closed unit ball, the volume of a set U⊆VU \subseteq VU⊆V of vertices is

vol(U)=vol(⋃v∈UCv∩Bn),\mathrm{vol}(U) = \mathrm{vol}\Big(\bigcup_{v\in U} C_v \cap B_n\Big),vol(U)=vol(v∈U⋃​Cv​∩Bn​),

and the neighbourhood N(I)\mathcal N(I)N(I) of I⊆VI \subseteq VI⊆V is the set of vertices outside III adjacent to a vertex of III. A spherical cone is S=C∩BnS = C \cap B_nS=C∩Bn​ with CCC closed under non-negative scaling; its dockable surface D(S)D(S)D(S) is the (n−1)(n-1)(n−1)-dimensional measure of the part of its boundary inside the open ball. A cone of revolution of angle 0<θ≤π/20<\theta\le\pi/20<θ≤π/2 is {x∈Bn:vTx≥cos⁡θ ∥v∥ ∥x∥}\{x \in B_n : v^T x \ge \cos\theta\,\|v\|\,\|x\|\}{x∈Bn​:vTx≥cosθ∥v∥∥x∥}. PPP is non-degenerate if every vertex has exactly nnn tight inequalities.

Formalization targets

Goal: Theorem 2 (p. 105)

If A∈Zm×nA \in \mathbb{Z}^{m\times n}A∈Zm×n has all sub-determinants bounded by Δ\DeltaΔ and PPP is bounded, then

diam⁡(P)≤2⌊2π Δ2n5/2ln⁡ ⁣(2n n! nn/2 Δn)⌋+2  =  O(Δ2n3.5log⁡nΔ).\operatorname{diam}(P) \le 2\Big\lfloor \sqrt{2\pi}\,\Delta^2 n^{5/2}\ln\!\big(2^n\, n!\, n^{n/2}\,\Delta^n\big)\Big\rfloor + 2 \;=\; O(\Delta^2 n^{3.5}\log n\Delta).diam(P)≤2⌊2π​Δ2n5/2ln(2nn!nn/2Δn)⌋+2=O(Δ2n3.5lognΔ).

No non-degeneracy, full-dimensionality or rank condition is assumed, and the bound is uniform in mmm and bbb.

Milestones

  1. Lemma 3 (p. 108): for a vertex vvv of a non-degenerate polytope, D(Sv)≤Δ2n3 vol(Sv)D(S_v) \le \Delta^2 n^3\,\mathrm{vol}(S_v)D(Sv​)≤Δ2n3vol(Sv​), where Sv=Cv∩BnS_v = C_v \cap B_nSv​=Cv​∩Bn​.
  2. Lemma 4 (p. 109): among spherical cones of a given volume, a cone of revolution has minimum dockable surface.
  3. Lemma 5 (p. 110): for a cone of revolution, D(S)≥2n/π vol(S)D(S) \ge \sqrt{2n/\pi}\,\mathrm{vol}(S)D(S)≥2n/π​vol(S).
  4. Lemma 6 (p. 111): for every measurable spherical cone with vol(S)≤12vol(Bn)\mathrm{vol}(S) \le \frac12 \mathrm{vol}(B_n)vol(S)≤21​vol(Bn​), D(S)≥2n/π vol(S)D(S) \ge \sqrt{2n/\pi}\,\mathrm{vol}(S)D(S)≥2n/π​vol(S).
  5. Lemma 1 (p. 105): for a non-degenerate polytope and I⊆VI \subseteq VI⊆V with vol(I)≤12vol(Bn)\mathrm{vol}(I) \le \frac12\mathrm{vol}(B_n)vol(I)≤21​vol(Bn​),
vol(N(I))≥2π 1Δ2n2.5 vol(I).\mathrm{vol}(\mathcal N(I)) \ge \sqrt{\tfrac{2}{\pi}}\,\frac{1}{\Delta^2 n^{2.5}}\,\mathrm{vol}(I).vol(N(I))≥π2​​Δ2n2.51​vol(I).
  1. Eq. (1) (p. 105): if IjI_jIj​ is the set of vertices at graph distance at most jjj from a vertex vvv and vol(Ij)≤12vol(Bn)\mathrm{vol}(I_j) \le \frac12\mathrm{vol}(B_n)vol(Ij​)≤21​vol(Bn​), then j≤2π Δ2n2.5ln⁡(2n/vol(I0))j \le \sqrt{2\pi}\,\Delta^2 n^{2.5}\ln(2^n/\mathrm{vol}(I_0))j≤2π​Δ2n2.5ln(2n/vol(I0​)).

Significance

The result. Theorem 2 bounds the diameter of every integral polytope by a polynomial in the dimension and the largest sub-determinant, independently of the number of facets. For totally unimodular matrices, which cover network-flow, bipartite matching and transportation polytopes, it gives O(n3.5log⁡n)O(n^{3.5}\log n)O(n3.5logn), improving the Dyer–Frieze bound by a large polynomial factor. It shows that the obstruction to a polynomial Hirsch bound, if any, must come from matrices with large sub-determinants. The volume-expansion method — measuring breadth-first search by the volume of the normal fan it has covered — was later refined, for instance in the shadow-vertex analysis of Dadush–Hähnle, which improves the dependence on nnn.

Formalizing it. The theorem is proved (2012/2014); no machine-checked proof is known. A formal development needs, on top of Mathlib, the normal fan of a polytope and its relation to the vertex-edge graph, a Hausdorff-measure calculus for cones (surface of a cone in terms of its base), Lévy's isoperimetric inequality on the sphere in a measure-theoretic form, and explicit Gamma-function estimates. Each of these is reusable well beyond this paper.

Difficulty

The combinatorial side is short; the geometry is not. Lemma 4 is the spherical isoperimetric inequality of Lévy, which Mathlib does not have in any form, and which the paper cites rather than proves; the relations between the volume of a spherical cone, the area of its base, its lateral surface and the length of the base's boundary (Eq. (3), "basic integration") are also absent. Lemma 3 depends on the structure of the normal cone of a vertex of a non-degenerate polytope (full-dimensional, simplicial, generated by rows of AAA), none of which is available for Mathlib's extreme points. Lemma 1 depends on the normal fan of a polytope: the normal cones have pairwise disjoint interiors, cover Rn\mathbb{R}^nRn, and share a facet exactly when their vertices are adjacent. The step from non-degenerate to arbitrary polytopes perturbs bbb and needs the diameter not to decrease, a statement about the vertex-edge graph under perturbation. A shortcut through a finite graph abstraction is not available: the constant depends on the geometry of the normal cones, not only on the graph.

Formalization scope

The polyhedron is Hirsch.Hpoly (rowVec A) b, with rowVec A i the iii-th row of A∈A \inA∈ Matrix (Fin m) (Fin n) ℤ as a vector of EuclideanSpace ℝ (Fin n). Vertices are Set.extremePoints ℝ P, adjacency is Hirsch.Adj, "diameter at most BBB" is Hirsch.DiamLE P B, all from the published Hirsch_model. The normal cone is the published FirstOrderOpt.ConvexTheory.normalCone. Volumes are Lebesgue measure with values in [0,∞][0,\infty][0,∞]; the dockable surface uses μHE[n-1], the Hausdorff measure normalized to agree with Lebesgue measure on hyperplanes, applied to frontier S ∩ Metric.ball 0 1. Δ\DeltaΔ is a natural number and the sub-determinant bound ranges over all sizes k≥1k \ge 1k≥1.

Explicit constants. The paper writes O(Δ2n3.5log⁡nΔ)O(\Delta^2 n^{3.5}\log n\Delta)O(Δ2n3.5lognΔ) in Theorem 2; the proof on pp. 105–106 yields 2⌊K⌋+22\lfloor K\rfloor + 22⌊K⌋+2 with K=2π Δ2n5/2ln⁡(2nn! nn/2Δn)K = \sqrt{2\pi}\,\Delta^2 n^{5/2}\ln(2^n n!\, n^{n/2}\Delta^n)K=2π​Δ2n5/2ln(2nn!nn/2Δn), from Eq. (1), the bound vol(I0)≥1/(n! nn/2Δn)\mathrm{vol}(I_0) \ge 1/(n!\,n^{n/2}\Delta^n)vol(I0​)≥1/(n!nn/2Δn) and the fact that the diameter is at most twice the number of breadth-first-search iterations needed to cover more than half of BnB_nBn​. This explicit bound is the goal. The ratios D/volD/\mathrm{vol}D/vol of Lemmas 3, 5, 6 are stated in multiplicative form.

Non-degeneracy is a hypothesis of Lemma 3, Lemma 1 and Eq. (1) only, as in the paper's §1.1, and never of Theorem 2. The neighbourhood N(I)\mathcal N(I)N(I) excludes III; including it would make Lemma 1 trivial, since its constant is below 111. Lemma 4 is stated against every competitor: for every measurable spherical cone SSS and every cone of revolution S∗S^*S∗ of the same volume, D(S∗)≤D(S)D(S^*) \le D(S)D(S∗)≤D(S); it does not assert existence of a cone of a prescribed volume. The goal is Theorem 2 about the polytope and its graph, not an abstract statement about set families with a volume-expansion property; integrality of AAA and the bound on minors of every size are both essential (scaling a real matrix down makes Δ\DeltaΔ arbitrarily small), and the raw Hausdorff measure μH[n-1] would put Lemmas 3 and 6 on incompatible scales.

Contributions are welcome at every level: the normal fan and its adjacency structure, cone surface formulas, the Gamma estimate Γ(x+12)/Γ(x)≥x−14\Gamma(x+\frac12)/\Gamma(x) \ge \sqrt{x-\frac14}Γ(x+21​)/Γ(x)≥x−41​​, and a formal Lévy inequality.

Selected references

  • N. Bonifas, M. Di Summa, F. Eisenbrand, N. Hähnle, M. Niemeier, On Sub-determinants and the Diameter of Polyhedra, Discrete Comput Geom 52 (2014) 102–115. https://doi.org/10.1007/s00454-014-9601-x
  • M. Dyer, A. Frieze, Random walks, totally unimodular matrices, and a randomised dual simplex algorithm, Math. Program. 64 (1994) 1–16. https://doi.org/10.1007/BF01582563
  • G. Kalai, D. J. Kleitman, A quasi-polynomial bound for the diameter of graphs of polyhedra, Bull. Amer. Math. Soc. 26 (1992) 315–316. https://doi.org/10.1090/S0273-0979-1992-00285-9
  • F. Santos, A counterexample to the Hirsch conjecture, Annals of Math. 176 (2012) 383–412. https://doi.org/10.4007/annals.2012.176.1.7
  • T. Figiel, J. Lindenstrauss, V. Milman, The dimension of almost spherical sections of convex bodies, Acta Math. 139 (1977) 53–94 (Lévy's isoperimetric inequality, Theorem 2.1). https://doi.org/10.1007/BF02392234
  • D. Dadush, N. Hähnle, On the shadow simplex method for curved polyhedra, Discrete Comput Geom 56 (2016). https://arxiv.org/abs/1412.6705
11 thms2 active usersReviewed
Stochastic Systems·Captain: mikedeng1

Stochastic Linear Programming 02: Finiteness and Smoothness of Expected Fixed RecourseTextbook

Motivation

A two-stage stochastic linear program chooses a first-stage decision before uncertain coefficients are known and then uses recourse variables to repair the decision after the data are observed. The resulting expected recourse cost is central to existence, stability, and numerical methods: if it can be infinite, an apparently feasible model may still have no meaningful expected objective; if it is differentiable with a continuous gradient, deterministic smooth optimization methods become available on the feasible first-stage domain. Chapter III of Peter Kall's Stochastic Linear Programming develops these properties for fixed recourse. This mission packages two complete results from that development: Theorem 12 on continuous differentiability and Theorem 15 on the exact finiteness criterion under complete recourse.

Theorem 12 is the goal. Theorem 15 is retained as a separate source theorem from the same expected-recourse setting, not as a lemma asserted to prove Theorem 12. Keeping both statements makes the distinction between the general feasible-domain regime and the stronger complete-recourse regime explicit.

Setting

Fix a deterministic matrix (W\in\mathbb R^{m\times p}). A random data point is a triple (d=(A,b,q)), where (A\in\mathbb R^{m\times n}), (b\in\mathbb R^m), and (q\in\mathbb R^p), with arbitrary joint probability law μ. For a first-stage vector (x\in\mathbb R^n), the pointwise recourse value is the extended-real linear-program value

Q(x,d)=inf⁡{q⊤y:Wy=b−Ax, y≥0}.Q(x,d)=\inf\{q^\top y:Wy=b-Ax,\ y\ge 0\}.Q(x,d)=inf{q⊤y:Wy=b−Ax, y≥0}.

The extended-real convention records an infeasible recourse problem as (+\infty) and an unbounded-below problem as (-\infty). The recourse domain is

K={x:Q(x,d)<+∞ for μ-almost every d}.K=\{x:Q(x,d)<+\infty\text{ for μ-almost every }d\}.K={x:Q(x,d)<+∞ for μ-almost every d}.

Thus (K) requires almost-sure feasibility but does not assume complete recourse and does not exclude a value of (-\infty). The signed extended expectation follows Kall's equation III.(8): it is the integral of the positive part minus the integral of the negative part. A separate real-valued expected-recourse adapter integrates (Q(x,d).\mathrm{toReal}); the target uses that adapter only after explicitly concluding almost-sure finiteness and integrability, so totalization at infinities does not hide a divergent cost.

The shared moment condition is exactly the disjunction from Theorem 10 and Corollary 11: all coordinates of (A,b,q) are square integrable; or (q) is almost surely constant while (A,b) are integrable; or (A,b) are almost surely constant while (q) is integrable; or all three random coefficient ranges are bounded. No independence or finite-support hypothesis is imposed.

Finally, (W) has complete recourse when every right-hand side (z\in\mathbb R^m) admits a nonnegative (y) satisfying (Wy=z). This is stronger than membership of one decision in (K), but it does not by itself prevent an unbounded-below recourse cost.

Formalization targets

Theorem 12: continuous gradient of expected fixed recourse

Assume one of the four moment alternatives, assume the signed expected recourse is strictly above (-\infty) at every (x\in K), and assume the joint law μ is absolutely continuous with respect to Lebesgue measure on the full finite-dimensional coefficient space. Then the pointwise recourse value is finite almost everywhere and its real projection is integrable for each (x\in K). Moreover, there is a continuous field of linear functionals (g(x)) such that

g(x)=DQμ(x)within K,g(x)=D Q_\mu(x)\quad\text{within }K,g(x)=DQμ​(x)within K,

including boundary points of (K). In Lean this is stated by ContinuousOn g K together with HasFDerivWithinAt for the expected-recourse function at every point of (K). It is not weakened to differentiability only on the interior, and it does not add complete recourse.

Theorem 15: finiteness iff almost-sure dual feasibility

Under complete recourse and one of the same four moment alternatives, for an arbitrary fixed (x\in\mathbb R^n),

E[Q(x,d)]∈R⟺{z∈Rm:W⊤z≤q(d)}≠∅ almost surely.\mathbb E[Q(x,d)]\in\mathbb R \quad\Longleftrightarrow\quad \{z\in\mathbb R^m:W^\top z\le q(d)\}\ne\varnothing \text{ almost surely}.E[Q(x,d)]∈R⟺{z∈Rm:W⊤z≤q(d)}=∅ almost surely.

The left side means that the signed extended expectation equals a real number, not merely that a totalized real integral returns a value. The right side requires feasibility of the dual inequalities almost surely; it does not require attainment or optimality. This full equivalence is the mission's supporting milestone.

Significance

Theorem 12 supplies a smooth expected objective on the entire source feasible domain under an absolutely continuous data law. That conclusion is stronger than convexity or local Lipschitz continuity: it provides a continuously varying derivative while retaining boundary points and the random dependence of all coefficient blocks. The explicit finiteness and integrability clauses make clear when the real expected objective faithfully represents the extended-real model.

Theorem 15 separates two different well-posedness questions. Complete recourse guarantees primal feasibility for every residual, while almost-sure feasibility of the dual inequalities is exactly what prevents the expected value from escaping the real line under the stated moment conditions. Omitting either direction would lose the source's characterization.

Both results are established in the 1976 book; the staged Lean theorem declarations contain proof placeholders. Completing them would give machine-checked versions of the source statements using reusable definitions for equality-constrained nonnegative linear-program values, pointwise recourse, expected recourse, complete recourse, the signed expectation, and the four moment regimes.

Difficulty

For differentiability, a pointwise optimal solution or dual vector need not vary continuously when the active basis changes. Absolute continuity removes coefficient configurations lying on relevant exceptional hyperplanes only after a measure-theoretic argument, and the conclusion must hold relative to a possibly closed feasible domain rather than only on an open set. One must also prove finiteness and integrability before using the real-valued expectation; simply differentiating the totalized toReal expression would not establish the source theorem.

For finiteness, complete recourse handles feasibility but not unbounded negative cost. The dual system is random through (q), and the equivalence concerns almost-sure existence of a dual-feasible vector together with a signed extended expectation. Assuming dual feasibility or integrability of the recourse value at the outset would make one direction circular.

Formalization scope

All coefficient spaces use finite Fin indices and real scalars. The law is an arbitrary probability measure on the joint product (A,b,q). The density premise for Theorem 12 is ambient absolute continuity with respect to the product Lebesgue volume; it is not a density on an unspecified lower-dimensional support. Consequently, some constant-coordinate moment branches may be incompatible with that density premise, matching the reviewed ambient interpretation rather than silently changing the measure space.

The feasible domain uses (Q(x,d)<+\infty) almost surely and includes its boundary. The signed expectation preserves positive and negative infinities. Theorem 12 assumes it is above (-\infty) on (K) and concludes the conditions needed for the separate real integral. Theorem 15 adds complete recourse but no density, independence, finite support, pre-assumed dual feasibility, or pre-assumed value integrability. Its decision (x) remains arbitrary.

The mission reuses the platform definitions of LPValue, PointwiseRecourse, ExpectedRecourse, and CompleteRecourse. The book-local Kall1976 namespace contains only the expression-essential data type, feasible domain, signed expectation, moment disjunction, and the two reviewed theorem statements. Contributions may add analytical, measure-theoretic, or linear-programming lemmas needed for proofs, but may not replace the signed expectation by a totalized real value, restrict Theorem 12 to the interior, or weaken Theorem 15 to one implication.

Selected references

  • Peter Kall, Stochastic Linear Programming, Springer, 1976, Chapter III: equations (4)-(5), printed p. 41 / PDF47; equation (8), printed p. 44 / PDF50; Theorem 10 and Corollary 11, printed pp. 46-48 / PDF52-54; Theorem 12, printed p. 48 / PDF54; complete recourse, printed p. 51 / PDF57; Theorem 15, printed p. 54 / PDF60. DOI.
7 thms2 active usersReviewed
Convex OptimizationStatistics·Captain: mikedeng1

Conditional Logit Analysis of Qualitative Choice Behavior 4: Existence of the Maximum Likelihood Estimate Is Decided by a Quadratic ProgramResearch Paper

Why a likelihood maximum needs a diagnostic

The conditional logit model assigns probabilities to choices among alternatives whose observable attributes differ from trial to trial. A fitted parameter vector is usually obtained by maximizing a log-likelihood. For a finite data set, however, maximization need not produce a finite vector: some directions in parameter space can keep improving the likelihood while their length grows without bound. McFadden identifies a condition that rules out these directions and then gives a quadratic program that can test the condition. This mission formalizes that test, Lemma 4 of the published 1974 chapter Conditional Logit Analysis of Qualitative Choice Behavior.

The chapter develops a statistical model from observable choice data and addresses the existence of a maximum likelihood estimate in Lemma 3. Lemma 4 turns its existence condition into a finite optimization problem. The diagnostic matters because an optimization routine returning increasingly large parameter estimates is not, by itself, evidence that a finite maximizer exists. The result specifies a mathematical test tied to the observed choice counts and the attributes of the alternatives.

Choice experiments and weighted differences

There are N≥1N\geq1N≥1 trials. Trial nnn offers JnJ_nJn​ alternatives, indexed by iii and jjj. Alternative iii has an attribute vector zin∈RKz_{in}\in\mathbb R^Kzin​∈RK, and SinS_{in}Sin​ counts how many times it was selected in that trial. Each trial has at least two alternatives and Rn=∑iSin>0R_n=\sum_iS_{in}>0Rn​=∑i​Sin​>0 observations. The vector θ∈RK\theta\in\mathbb R^Kθ∈RK is the unknown parameter of the underlying conditional logit model. Equation (16) assigns alternative iii a probability proportional to exp⁡(zin⋅θ)\exp(z_{in}\cdot\theta)exp(zin​⋅θ), with the probabilities normalized over the alternatives in the same trial McFadden, pp. 113–114, equation (16).

For the test, define the weighted difference

wnij=Sin(zjn−zin)∈RK.w_{nij}=S_{in}(z_{jn}-z_{in})\in\mathbb R^K.wnij​=Sin​(zjn​−zin​)∈RK.

It is indexed by every trial and every ordered pair of alternatives, including i=ji=ji=j and alternatives whose observed count is zero. Such terms simply produce zero vectors. Keeping them in the index set makes the formal statement agree with the chapter's quantifiers and its quadratic program.

Axiom 5, called full rank in the chapter, says that the rows obtained by subtracting each trial's probability weighted mean attribute vector from its alternative attributes have rank KKK. Equivalently, the vectors zjn−zinz_{jn}-z_{in}zjn​−zin​ span RK\mathbb R^KRK; the probability weights in that mean are strictly positive and sum to one. Axiom 6 says that no nonzero direction γ∈RK\gamma\in\mathbb R^Kγ∈RK satisfies wnij⋅γ≤0w_{nij}\cdot\gamma\leq0wnij​⋅γ≤0 for every ordered index triple. These are conditions on the same observed experiment, but they serve different roles: full rank concerns the attribute geometry, while Axiom 6 also uses the choice counts McFadden, p. 116, Axioms 5–6.

Formalization targets

Lemma 4: a quadratic-programming test

Let QQQ be the set of feasible vectors

Q={y=∑n=1N∑i,j=1Jnαijnwnij:αijn≥1 for all n,i,j}.Q=\left\{y=\sum_{n=1}^{N}\sum_{i,j=1}^{J_n}\alpha_{ijn}w_{nij}: \alpha_{ijn}\geq1\text{ for all }n,i,j\right\}.Q={y=n=1∑N​i,j=1∑Jn​​αijn​wnij​:αijn​≥1 for all n,i,j}.

The mission's goal is the equivalence in Lemma 4:

Axiom 6 holds⟺min⁡y∈Qy⋅y=0.\text{Axiom 6 holds} \quad\Longleftrightarrow\quad \min_{y\in Q}y\cdot y=0.Axiom 6 holds⟺y∈Qmin​y⋅y=0.

The right side means that the program attains a value of zero. An infimum of zero without an attained feasible point would be a weaker statement and would not express the lemma. The three milestones follow the three assertions in the printed proof: a zero minimum implies Axiom 6; an interior origin in the cone generated by the wnijw_{nij}wnij​ gives positive coefficients and a zero minimum; and a noninterior origin gives a separating direction that violates Axiom 6 McFadden, p. 117, Lemma 4 and equation (22).

What the result provides

Lemma 3 of the chapter states that Axiom 6 characterizes the existence of a vector maximizing the conditional-logit log-likelihood under the preceding axioms. Lemma 4 gives a finite quadratic-programming criterion for that same condition. It therefore allows the model's existence question to be checked from data before treating a numerical optimizer's output as an estimate McFadden, pp. 116–117, Lemmas 3–4.

The paper proves these results. The work here is to produce machine-checkable statements for the finite-dimensional data, the two axioms, the feasible set, and the equivalence, followed by proofs in the solver stage. The cone and separation milestones can support later formalizations of existence conditions in other finite exponential-family models, provided their hypotheses and signs are checked anew. This mission does not claim a general theorem for all such models.

Why the equivalence is delicate

The tempting diagnostic is to ask whether a numerical solve returns a small objective value. That does not settle the mathematical question: the objective's infimum could approach zero without the feasible set containing a zero vector. The paper's conclusion is about a minimum, so attainment must remain visible in the formal statement. There is also a distinction between positive coefficients in a cone representation and the printed constraints αijn≥1\alpha_{ijn}\geq1αijn​≥1 in equation (22). Both conditions must appear in their proper places.

The full-rank condition alone does not ensure that the vectors wnijw_{nij}wnij​ span the attribute space if a trial has no observed choices. The section describes RnR_nRn​ repetitions of each trial, and the formal data require Rn>0R_n>0Rn​>0. This convention is needed for the strict-inequality claim in the first paragraph of Lemma 4's proof. The geometry also has to account for every ordered pair, even when its vector is zero; dropping these indices would alter the program stated in the chapter.

Formalization scope

Lean represents a nonempty set of trials by Fin N, alternatives in trial nnn by Fin (J n), counts by natural numbers, and attributes by EuclideanSpace ℝ (Fin K). The count RnR_nRn​ is the sum of observed choice counts. The model requires Jn≥2J_n\geq2Jn​≥2 and Rn>0R_n>0Rn​>0 for each trial. There is no extra assumption that K>0K>0K>0: the zero-dimensional case is included and the equivalence has its ordinary degenerate meaning there.

Axiom 5 is encoded through the equivalent span of within-trial attribute differences. This removes the parameter dependent logit probabilities from a theorem that only uses rank. Axiom 6 retains exactly the nonpositive sign and every n,i,jn,i,jn,i,j from the page. The feasible set uses coefficients at least one, while the auxiliary generated cone uses nonnegative coefficients. The quadratic objective is the square of the Euclidean norm. IsLeast on its image over the feasible set expresses an attained minimum, so the statement cannot be satisfied by a vacuous or unattained infimum.

The definition bundle and the three proof-step theorems are the mission's direct scope. A complete development needs finite-dimensional inner-product geometry, finite sums, a cone interior argument, and separation. The definitions of weighted differences and the feasible set are reusable for studying nearby existence tests. Contributions that prove the stated milestones or supply faithful finite-dimensional geometry for them are welcome; substitutions that weaken the coefficient constraint or the attainment claim do not establish Lemma 4.

Selected references

  • Daniel McFadden, “Conditional Logit Analysis of Qualitative Choice Behavior,” in P. Zarembka (ed.), Frontiers in Econometrics, Academic Press, 1974, pp. 105–142; especially pp. 113–117, Axioms 5–6, Lemmas 3–4, and equation (22). Book catalog search.
5 thms1 active userReviewed
Discrete GeometryOperations ResearchOptimization+1·Captain: mikedeng1

Smoothed Analysis of Algorithms: Why the Simplex Algorithm Usually Takes Polynomial Time 1: The Expected Shadow of a Gaussian-Perturbed Polytope Has Polynomially Many VerticesResearch Paper

Why the shadow of a perturbed polytope matters

The simplex method solves linear programs very fast in practice, yet for most pivot rules there are inputs on which it takes exponentially many steps (Klee and Minty, 1972, for Dantzig's rule; Goldfarb, 1983, for the shadow-vertex rule). Average-case analyses (Borgwardt, 1980s; Smale, 1983) explained good behaviour on random inputs, but random inputs look nothing like real ones. Spielman and Teng introduced smoothed analysis to close this gap: the input is chosen by an adversary and then perturbed by a small Gaussian, and the running time is measured in expectation over the perturbation. They proved that the shadow-vertex simplex method has smoothed complexity polynomial in the number of constraints nnn, the dimension ddd and 1/σ1/\sigma1/σ (Spielman–Teng, J. ACM 2004; this mission follows the preprint arXiv:cs/0111050v7). The work received the Gödel Prize (2008) and the Fulkerson Prize (2009).

Timeline. Borgwardt (1977–1987) bounded the expected number of shadow-vertex pivots for rotationally symmetric random data. Spielman and Teng (2001, STOC; journal 2004) proved the first smoothed bound, with a shadow bound of order nd3/σ6nd^3/\sigma^6nd3/σ6 — the theorem of this mission. Deshpande and Spielman (FOCS 2005) improved the shadow bound, Vershynin (2009) reduced the dependence on nnn to polylogarithmic, and Dadush and Huiberts (STOC 2018) obtained O(d2log⁡n σ−2)O(d^2\sqrt{\log n}\,\sigma^{-2})O(d2logn​σ−2) for small σ\sigmaσ.

Setting

Fix d≥3d\ge3d≥3 and n>dn>dn>d. The data are vectors a1,…,an∈Rda_1,\dots,a_n\in\mathbb R^da1​,…,an​∈Rd, the constraint vectors of the linear program max⁡⟨z∣x⟩\max\langle z|x\ranglemax⟨z∣x⟩ subject to ⟨ai∣x⟩≤1\langle a_i|x\rangle\le1⟨ai​∣x⟩≤1 for all iii. Each aia_iai​ is a Gaussian of standard deviation σ\sigmaσ centered at a point aˉi\bar a_iaˉi​ with ∥aˉi∥≤1\|\bar a_i\|\le1∥aˉi​∥≤1: it has density

μi(a)=(12π σ)de−∥a−aˉi∥2/2σ2,\mu_i(a)=\Big(\tfrac{1}{\sqrt{2\pi}\,\sigma}\Big)^d e^{-\|a-\bar a_i\|^2/2\sigma^2},μi​(a)=(2π​σ1​)de−∥a−aˉi​∥2/2σ2,

and the aia_iai​ are independent (joint density ∏iμi(ai)\prod_i\mu_i(a_i)∏i​μi​(ai​)).

For a direction q∈Rdq\in\mathbb R^dq∈Rd, optSimpq(a1,…,an)\mathrm{optSimp}_q(a_1,\dots,a_n)optSimpq​(a1​,…,an​) is the set of index sets I⊆{1,…,n}I\subseteq\{1,\dots,n\}I⊆{1,…,n} with ∣I∣=d|I|=d∣I∣=d such that (ai)i∈I(a_i)_{i\in I}(ai​)i∈I​ is linearly independent, the simplex △(AI)=ConvHull(ai:i∈I)\triangle(A_I)=\mathrm{ConvHull}(a_i:i\in I)△(AI​)=ConvHull(ai​:i∈I) is a facet of ConvHull(0,a1,…,an)\mathrm{ConvHull}(0,a_1,\dots,a_n)ConvHull(0,a1​,…,an​), and qqq lies in the cone {∑i∈Iαiai:αi≥0}\{\sum_{i\in I}\alpha_ia_i:\alpha_i\ge0\}{∑i∈I​αi​ai​:αi​≥0}. In polar terms, III is the set of tight constraints at the vertex of the feasible polyhedron that maximizes ⟨q∣x⟩\langle q|x\rangle⟨q∣x⟩.

For linearly independent t,zt,zt,z, the shadow Shadowt,z(a1,…,an)\mathrm{Shadow}_{t,z}(a_1,\dots,a_n)Shadowt,z​(a1​,…,an​) is the set of index sets III that belong to optSimpq\mathrm{optSimp}_qoptSimpq​ for some nonzero q∈Span(t,z)q\in\mathrm{Span}(t,z)q∈Span(t,z). Its size is the number of vertices of the projection of the feasible polyhedron onto the plane Span(t,z)\mathrm{Span}(t,z)Span(t,z); the shadow-vertex method walks along this polygon, one pivot per vertex. Finally

D(n,d,σ)=58,888,678 nd3min⁡(σ, 1/(3dln⁡n))6.\mathcal D(n,d,\sigma)=\frac{58{,}888{,}678\,nd^3}{\min\big(\sigma,\,1/(3\sqrt{d\ln n})\big)^6}.D(n,d,σ)=min(σ,1/(3dlnn​))658,888,678nd3​.

Formalization targets

Goal: Theorem 4.0.1 (Shadow Size)

Ea1,…,an[ ∣Shadowt,z(a1,…,an)∣ ]≤D(n,d,σ)\mathbb E_{a_1,\dots,a_n}\big[\,|\mathrm{Shadow}_{t,z}(a_1,\dots,a_n)|\,\big]\le\mathcal D(n,d,\sigma)Ea1​,…,an​​[∣Shadowt,z​(a1​,…,an​)∣]≤D(n,d,σ)

for every d≥3d\ge3d≥3, n>dn>dn>d, every pair of linearly independent t,zt,zt,z, every σ>0\sigma>0σ>0 and all centers of norm at most 111.

Milestones

The milestones follow the paper's proof, leaves first.

  • Probability tools: the chi-square bound (Corollary 2.4.6), the combination lemma (Lemma 2.3.5), almost polynomial densities (Lemma 2.3.7), and comparing Gaussian tails (Lemma 2.4.11).
  • Reduction: the measure of the event P={∥ai∥≤2 ∀i}P=\{\|a_i\|\le2\ \forall i\}P={∥ai​∥≤2 ∀i} (Proposition 4.0.5), and the discretization of the shadow into mmm equally spaced directions (Lemma 4.0.6).
  • Angle bound: the probability, conditioned on PPP, that the ray through a fixed unit vector qqq passes within angle ε\varepsilonε of the boundary of its optimal facet is O(nd3ε/σ6)O(nd^3\varepsilon/\sigma^6)O(nd3ε/σ6) (Lemma 4.0.7, from Lemma 4.0.11).
  • Distance and incidence: in Blaschke coordinates ai=Rωbi+sqa_i=R_\omega b_i+sqai​=Rω​bi​+sq, a deterministic split (Lemma 4.0.12), a distance bound (Lemmas 4.1.1–4.1.3) and an angle-of-incidence bound (Lemmas 4.2.1–4.2.3).

Significance

The result. Theorem 4.0.1 is the geometric heart of the smoothed analysis of the simplex method. Section 4.3 of the paper extends it to arbitrary centers, covariances and right-hand sides, and Section 5 combines these extensions with a two-phase method to show that the simplex method has polynomial smoothed complexity. The same shadow bound underlies later analyses of the simplex method, of perturbed polytopes' diameters, and of condition numbers of random linear programs.

Formalizing it. The theorem has been proved, and improved constants are known, but none of this is machine-checked. A formal proof would verify a long and delicate argument: a change of variables of integral geometry (Blaschke's formula), several conditional-density estimates, and explicit constants in the millions. The mission also produces reusable statements about Gaussian vectors and convex hulls of random points.

Difficulty

The obvious approach is to count, for each candidate facet III, the probability that III appears in the shadow; there are (nd)\binom nd(dn​) candidates, so a union bound is exponential in ddd. The paper avoids this by discretizing the angle of qqq (Lemma 4.0.6) and bounding, for each fixed direction, the probability that the optimal facet changes within a small angular step. That needs a lower bound on the angle between qqq and the boundary of its optimal facet, conditioned on the facet being optimal. The conditioning changes the distribution of a1,…,ada_1,\dots,a_da1​,…,ad​, so the bound cannot come from the Gaussian density alone. The proof changes variables to the facet's normal ω\omegaω, offset sss and in-plane coordinates bib_ibi​ (Corollary 2.5.3), whose Jacobian contributes the factors ⟨ω∣q⟩\langle\omega|q\rangle⟨ω∣q⟩ and Vol(△(b))\mathrm{Vol}(\triangle(b))Vol(△(b)). It then shows that both the distance of the origin to a face of the in-plane simplex and the angle of incidence ⟨ω∣q⟩\langle\omega|q\rangle⟨ω∣q⟩ are unlikely to be small. Measure-theoretic bookkeeping is as hard as the geometry: densities known only up to normalization, conditioning on events of positive measure, and the measure-zero degeneracies the paper sets aside.

Formalization scope

Points live in EuclideanSpace ℝ (Fin d). Constraint vectors are indexed by Fin n (0-based), so the paper's {1,…,d}\{1,\dots,d\}{1,…,d} is {i:i<d}\{i:i<d\}{i:i<d}. The Gaussian of standard deviation σ\sigmaσ centered at ccc is Lebesgue measure with the density above, and the joint law is the product measure. Lemma 4.0.6 also uses Mathlib's multivariateGaussian with a positive definite covariance. Expectations of shadow sizes are lower Lebesgue integrals of [0,∞][0,\infty][0,∞]-valued counts, and their measurability is part of each conclusion. "Density proportional to ν\nuν" and conditional probabilities are stated cross-multiplied, ∫Eν≤bound⋅∫ν\int_{E}\nu\le\text{bound}\cdot\int\nu∫E​ν≤bound⋅∫ν, so no 0/00/00/0 appears.

The shadow is the set of index sets III, and the direction q=0q=0q=0 is excluded. Including it would add every facet of ConvHull(0,a1,…,an)\mathrm{ConvHull}(0,a_1,\dots,a_n)ConvHull(0,a1​,…,an​) to the shadow, since 000 lies in every cone, and make the goal false. ang(q,∅)=∞\mathrm{ang}(q,\emptyset)=\inftyang(q,∅)=∞ is represented exactly in [0,∞][0,\infty][0,∞], never by a real infimum. Where the paper omits a hypothesis it uses, it is added and recorded in the item: the standing assumptions d≥3d\ge3d≥3, n>dn>dn>d and σ≤1/(3dln⁡n)\sigma\le1/(3\sqrt{d\ln n})σ≤1/(3dlnn​) (Lemma 4.2.3 is false without a bound on σ\sigmaσ), unit length of the reference vector qqq, s≥0s\ge0s≥0, and ε>0\varepsilon>0ε>0 for strict inequalities. Lemma 2.3.7 is stated with ≤\le≤ rather than the page's <<<, which fails in an edge case.

Infrastructure a complete development needs: Gaussian tail and chi-square estimates; faces and facets of convex hulls; the Blaschke change of variables and the latitude–longitude change of variables on the sphere (not in Mathlib); surface measure on Sd−1S^{d-1}Sd−1 (Mathlib's Measure.toSphere); and the disintegration of the joint law used in the combination lemma. The Gaussian estimates, the combination lemma and the Blaschke formula are useful beyond this mission. Proofs of any milestone, and of supporting lemmas such as the change-of-variables formulas, are welcome.

Selected references

  • D. A. Spielman, S.-H. Teng, Smoothed Analysis of Algorithms: Why the Simplex Algorithm Usually Takes Polynomial Time, arXiv:cs/0111050v7, 2003. https://arxiv.org/abs/cs/0111050v7
  • D. A. Spielman, S.-H. Teng, Smoothed analysis of algorithms: Why the simplex algorithm usually takes polynomial time, J. ACM 51(3):385–463, 2004. https://doi.org/10.1145/990308.990310
  • K. H. Borgwardt, The Simplex Method: A Probabilistic Analysis, Springer, 1987.
  • V. Klee, G. J. Minty, How good is the simplex algorithm?, in Inequalities III, Academic Press, 1972, 159–175.
  • A. Deshpande, D. A. Spielman, Improved smoothed analysis of the shadow vertex simplex method, FOCS 2005, 387–396.
  • R. Vershynin, Beyond Hirsch conjecture: walks on random polytopes and smoothed complexity of the simplex method, SIAM J. Comput. 39(2):646–678, 2009. https://doi.org/10.1137/070683386
  • D. Dadush, S. Huiberts, A friendly smoothed analysis of the simplex method, STOC 2018; arXiv:1711.05667. https://arxiv.org/abs/1711.05667
29 thms1 active userReviewed
Discrete GeometryOperations ResearchOptimization·Captain: mikedeng1

Sensitivity Theorems in Integer Linear Programming: Every Integral m×n Matrix Has Chvátal Rank at Most 2^(n³+1)·n^(5n)·Δ(A)^(n+1)Research Paper

Motivation

An integer linear program max⁡{wx:Ax≤b, x integral}\max\{wx : Ax \le b,\ x \text{ integral}\}max{wx:Ax≤b, x integral} is usually attacked through its linear programming relaxation max⁡{wx:Ax≤b}\max\{wx : Ax \le b\}max{wx:Ax≤b}, which drops the integrality constraint. Two questions follow at once. How far can an optimal solution of the relaxation be from an optimal integer solution? And how many rounds of rounding-based cutting planes are needed before the relaxation describes the integer points exactly? Branch-and-bound, cutting-plane methods and the parametric analysis of integer programs all depend on the answers.

W. Cook, A.M.H. Gerards, A. Schrijver and É. Tardos, Sensitivity theorems in integer linear programming (Math. Programming 34 (1986) 251–264), answer both in terms of the number of variables nnn and the largest subdeterminant Δ(A)\Delta(A)Δ(A) of the constraint matrix, independently of the right-hand side.

Timeline.

  • 1958–1963: Gomory introduces integer rounding cuts. In 1973 Chvátal (Discrete Math. 4) shows that finitely many rounds reach the integer hull of a bounded polyhedron.
  • 1977–1979: Blair and Jeroslow prove that for a fixed matrix AAA the distance between LP and IP optima, and the gap between their values, are bounded by constants depending on AAA.
  • 1980: Schrijver (Ann. Discrete Math. 9) proves that the Chvátal closure of a rational polyhedron is a polyhedron, and that every rational polyhedron, bounded or not, reaches its integer hull after finitely many rounds.
  • 1986: Cook, Gerards, Schrijver and Tardos prove the explicit bounds of this mission, nΔ(A)n\Delta(A)nΔ(A) for proximity, and show that every integral matrix has finite Chvátal rank.
  • Later work, for example Eisenbrand and Weismantel (2018), replaces the ℓ∞\ell_\inftyℓ∞​ proximity bound by ℓ1\ell_1ℓ1​ bounds for programs in standard form.

Setting

All matrices, vectors and polyhedra are rational. Let AAA be an integral m×nm\times nm×n matrix. A square submatrix of order kkk, where 1≤k≤min⁡(m,n)1\le k\le\min(m,n)1≤k≤min(m,n), keeps kkk rows and kkk columns of AAA. The quantity Δ(A)\Delta(A)Δ(A) is the largest ∣det⁡B∣|\det B|∣detB∣ over all such submatrices BBB. So Δ(0)=0\Delta(0)=0Δ(0)=0, and Δ(A)≥1\Delta(A)\ge 1Δ(A)≥1 whenever A≠0A\ne 0A=0. Norms are ∥x∥∞=max⁡i∣xi∣\|x\|_\infty=\max_i|x_i|∥x∥∞​=maxi​∣xi​∣ and ∥x∥1=∑i∣xi∣\|x\|_1=\sum_i|x_i|∥x∥1​=∑i​∣xi​∣.

For b∈Qmb\in\mathbb{Q}^mb∈Qm write P={x∈Qn:Ax≤b}P=\{x\in\mathbb{Q}^n : Ax\le b\}P={x∈Qn:Ax≤b}. An optimal solution of max⁡{wx:Ax≤b}\max\{wx : Ax\le b\}max{wx:Ax≤b} is a point of PPP maximizing wxwxwx. For max⁡{wx:Ax≤b, x integral}\max\{wx : Ax\le b,\ x\text{ integral}\}max{wx:Ax≤b, x integral} it is an integral point of PPP maximizing wxwxwx among the integral points of PPP. A rational polyhedron is a set {x:Dx≤d}\{x : Dx\le d\}{x:Dx≤d} with DDD, ddd rational. The integer hull PIP_IPI​ is the convex hull of the integral points of PPP.

If ay≤βay\le\betaay≤β for all y∈Py\in Py∈P, with aaa integral and β\betaβ rational, then every integral point of PPP satisfies the Chvátal cut ax≤⌊β⌋ax\le\lfloor\beta\rfloorax≤⌊β⌋. The Chvátal closure P′P'P′ is the set of points satisfying all Chvátal cuts. Set P(0)=PP^{(0)}=PP(0)=P and P(i)=(P(i−1))′P^{(i)}=(P^{(i-1)})'P(i)=(P(i−1))′. Then PI⊆P(i)P_I\subseteq P^{(i)}PI​⊆P(i) for all iii. The Chvátal rank of PPP is the least ttt with P(t)=PIP^{(t)}=P_IP(t)=PI​. The Chvátal rank of the matrix AAA is the supremum of the Chvátal ranks of {x:Ax≤b}\{x : Ax\le b\}{x:Ax≤b} over all integral vectors bbb.

Formalization targets

Goal: Theorem 10 (p. 260)

sup⁡b∈Zm rank⁡{x:Ax≤b} ≤ 2n3+1 n5n Δ(A)n+1.\sup_{b\in\mathbb{Z}^m}\ \operatorname{rank}\{x : Ax\le b\}\ \le\ 2^{n^3+1}\,n^{5n}\,\Delta(A)^{n+1}.b∈Zmsup​ rank{x:Ax≤b} ≤ 2n3+1n5nΔ(A)n+1.

In particular, every integral matrix has finite Chvátal rank, and the bound does not depend on mmm or on bbb.

Milestones, in attack order

  1. Theorem 1 (p. 252). Suppose Ax≤bAx\le bAx≤b has an integral solution and the LP maximum exists. Then every LP optimum has an IP optimum within ℓ∞\ell_\inftyℓ∞​-distance nΔ(A)n\Delta(A)nΔ(A), and every IP optimum has an LP optimum within the same distance.
  2. Corollary 2 (p. 253). Under the same hypotheses, max⁡{wx:Ax≤b}−max⁡{wx:Ax≤b, x integral}≤nΔ(A)∥w∥1\max\{wx: Ax\le b\}-\max\{wx : Ax\le b,\ x\text{ integral}\}\le n\Delta(A)\|w\|_1max{wx:Ax≤b}−max{wx:Ax≤b, x integral}≤nΔ(A)∥w∥1​.
  3. Theorem 5 (p. 255). Changing bbb to b′b'b′ moves LP optima by at most nΔ(A)∥b−b′∥∞n\Delta(A)\|b-b'\|_\inftynΔ(A)∥b−b′∥∞​ and IP optima by at most nΔ(A)(∥b−b′∥∞+2)n\Delta(A)(\|b-b'\|_\infty+2)nΔ(A)(∥b−b′∥∞​+2). This result is off the goal's path.
  4. Theorem 6 (p. 256). A non-optimal integral solution can be improved by an integral solution within ℓ∞\ell_\inftyℓ∞​-distance nΔ(A)n\Delta(A)nΔ(A).
  5. Theorem 7 (p. 257). A single integral matrix MMM, with entries at most n2nΔ(A)nn^{2n}\Delta(A)^nn2nΔ(A)n in absolute value, gives {x:Ax≤b}I={x:Mx≤db}\{x: Ax\le b\}_I=\{x : Mx\le d_b\}{x:Ax≤b}I​={x:Mx≤db​} for every bbb for which Ax≤bAx\le bAx≤b has an integral solution.
  6. Theorem 8, printed "Theorem 9" (p. 259). If a rational polyhedron P⊆QnP\subseteq\mathbb{Q}^nP⊆Qn has no integral point, then P(n2n2n3)=∅P^{(n^{2n}2^{n^3})}=\emptysetP(n2n2n3)=∅.
  7. Corollary 9 (p. 260). Let q=max⁡{wx:x∈PI}q=\max\{wx : x\in P_I\}q=max{wx:x∈PI​} with www integral. Then P(r)⊆{x:wx≤q}P^{(r)}\subseteq\{x : wx\le q\}P(r)⊆{x:wx≤q} for r=(n2n2n3+1)(⌊max⁡{wx:x∈P}⌋−q)+1r=(n^{2n}2^{n^3}+1)(\lfloor\max\{wx : x\in P\}\rfloor-q)+1r=(n2n2n3+1)(⌊max{wx:x∈P}⌋−q)+1.

Significance

The result. Theorem 10 shows that the number of Gomory–Chvátal rounding rounds needed for {x:Ax≤b}\{x : Ax\le b\}{x:Ax≤b} is controlled by AAA alone. It is the first general finite bound on the Chvátal rank of a matrix. Earlier, the matrices of Chvátal rank 0 had been characterized by Hoffman and Kruskal: they are the matrices whose transpose is unimodular. Some classes of rank 1 had also been characterized (Edmonds–Johnson, Gerards–Schrijver). The proximity results of §2 are used on their own. They bound the work needed to solve an integer program from an LP optimum, and they show that the optimal value of an integer program changes at most affinely with bbb. They are also the standard starting point for the later proximity literature.

Formalizing it. All results are proved in the paper. As far as is known, none of them has a machine-checked proof: the Prove2Me corpus holds no Chvátal rank bound, and its existing proximity theorems concern a different bound, the ℓ1\ell_1ℓ1​ bound with Δ\DeltaΔ the largest entry. This mission asks for Lean proofs of the paper's statements with the constants exactly as printed. It also builds a reusable layer over Q\mathbb{Q}Q: polyhedra, LP and IP optimality, integer hulls, the Chvátal closure and the Chvátal rank.

Difficulty

The proximity theorems need a conic decomposition xˉ−zˉ=∑λigi\bar x-\bar z=\sum\lambda_i g^ixˉ−zˉ=∑λi​gi into integral generators with entries bounded by Δ(A)\Delta(A)Δ(A). That requires Cramer's rule bounds on cone generators and Carathéodory's theorem, and neither is in Mathlib in this form for rational polyhedral cones.

Theorem 7 needs finite generation of integral cones with explicit coefficient bounds, together with LP duality.

The Chvátal-rank part is harder. The obvious induction on the value of a valid inequality fails, because the value gap ⌊max⁡Pwx⌋−q\lfloor\max_P wx\rfloor-q⌊maxP​wx⌋−q is not bounded independently of bbb until Theorem 7 and Corollary 2 bound it by n2n+2Δ(A)n+1n^{2n+2}\Delta(A)^{n+1}n2n+2Δ(A)n+1. Theorem 8 itself rests on a flatness theorem for lattice-free polyhedra (Lenstra; Grötschel–Lovász–Schrijver), which the paper cites without proof. It also needs Schrijver's lemma that P(k)∩F⊆F(k)P^{(k)}\cap F\subseteq F^{(k)}P(k)∩F⊆F(k) for faces FFF, and invariance under unimodular affine maps. None of these is in Mathlib.

Formalization scope

  • Rationality. Everything is over Q\mathbb{Q}Q, following the paper's standing assumption on p. 252. Points are Fin n → ℚ, AAA is Matrix (Fin m) (Fin n) ℤ cast to Q\mathbb{Q}Q, and a polyhedron is a finite system of rational inequalities.
  • Δ(A)\Delta(A)Δ(A). Only nonempty submatrices count, so Δ(0)=0\Delta(0)=0Δ(0)=0.
  • Optimality. "The maximum exists" means an optimal solution exists. Existence claims that the paper proves are part of the conclusions: the IP optimum in Theorem 1 and Corollary 2, and max⁡{wx:x∈P}\max\{wx : x\in P\}max{wx:x∈P} in Corollary 9.
  • Chvátal closure. It is defined for every subset of Qn\mathbb{Q}^nQn, using all integral aaa and rational β\betaβ. The rank is valued in N∪{∞}\mathbb{N}\cup\{\infty\}N∪{∞}, with ∞\infty∞ if no iterate equals PIP_IPI​. A version with junk value 000 would make the goal trivial and is not used. The matrix rank is a supremum over integral bbb, as printed.
  • Added hypotheses. Theorems 1 and 6 carry the hypothesis A≠0A\ne0A=0. For A=0A=0A=0 the bound nΔ(A)=0n\Delta(A)=0nΔ(A)=0 makes both statements false, and the proof on p. 257 assumes A≠0A\ne0A=0 as well. In Corollary 9 the value qqq is taken to be an integer. This loses nothing, because a maximum of an integral www over PIP_IPI​ is attained at an integral point.
  • Constants. All constants are exactly as printed, written in N\mathbb{N}N with 00=10^0=100=1.

A complete development needs the following:

  • cone generation with Cramer bounds and Carathéodory's theorem;
  • LP duality and Farkas' lemma over Q\mathbb{Q}Q;
  • the polyhedrality of P′P'P′ for rational polyhedra (Schrijver 1980);
  • Schrijver's face lemma and unimodular invariance;
  • a flatness theorem.

The LP, cone and Chvátal-closure layers are reusable beyond this mission. Proofs of any milestone are welcome, and so is groundwork such as polyhedrality of the Chvátal closure or the flatness theorem, submitted as separate theorems.

Selected references

  • W. Cook, A.M.H. Gerards, A. Schrijver, É. Tardos, Sensitivity theorems in integer linear programming, Mathematical Programming 34 (1986) 251–264. https://doi.org/10.1007/BF01582230
  • V. Chvátal, Edmonds polytopes and a hierarchy of combinatorial problems, Discrete Mathematics 4 (1973) 305–337. https://doi.org/10.1016/0012-365X(73)90167-2
  • A. Schrijver, On cutting planes, Annals of Discrete Mathematics 9 (1980) 291–296. https://doi.org/10.1016/S0167-5060(08)70085-2
  • W. Cook, C.R. Coullard, Gy. Turán, On the complexity of cutting-plane proofs, Discrete Applied Mathematics 18 (1987) 25–38. https://doi.org/10.1016/0166-218X(87)90039-4
  • F. Eisenbrand, R. Weismantel, Proximity results and faster algorithms for integer programming using the Steinitz lemma, ACM Transactions on Algorithms 16 (2020), Art. 5. https://doi.org/10.1145/3340322
11 thms1 active userReviewed
Operations ResearchOptimization·Captain: mikedeng1

A Multicut Algorithm for Two-Stage Stochastic Linear Programs 1: Worst-Case Bound on Multicut Major IterationsResearch Paper

Motivation

Two-stage stochastic linear programs with recourse are a standard model for planning under uncertainty: a first-stage decision xxx is taken before a random outcome ξ\xiξ is observed, and a second-stage (recourse) decision yyy corrects for it afterwards at a cost. When ξ\xiξ has finitely many realizations, the problem is a large but structured linear program, and the classical way to solve it is the L-shaped method of Van Slyke and Wets (1969), a Benders-type outer linearization of the expected recourse cost.

Birge and Louveaux (1988) proposed the multicut L-shaped algorithm: instead of one cut on the expected recourse function per iteration, it adds one cut per realization. They compared the two methods by worst-case counts of major iterations (the operations between two returns to the master problem), and showed that the multicut count grows linearly in the number KKK of realizations, while their bound for the single-cut method grows like Km2K^{m_2}Km2​. The multicut idea is now part of every textbook treatment of decomposition for stochastic programming (Birge and Louveaux, Introduction to Stochastic Programming, Ch. 5) and of most production implementations of Benders decomposition.

Setting

The data are a matrix A∈Rm1×n1A\in\mathbb R^{m_1\times n_1}A∈Rm1​×n1​, vectors bbb, ccc, a fixed recourse matrix W∈Rm2×n2W\in\mathbb R^{m_2\times n_2}W∈Rm2​×n2​, and KKK realizations k=1,…,Kk=1,\dots,Kk=1,…,K, each with a cost qk∈Rn2q_k\in\mathbb R^{n_2}qk​∈Rn2​, a right-hand side hk∈Rm2h_k\in\mathbb R^{m_2}hk​∈Rm2​, a technology matrix Tk∈Rm2×n1T_k\in\mathbb R^{m_2\times n_1}Tk​∈Rm2​×n1​ and a probability pkp_kpk​. Row vectors are written without transposes, as in the paper. The second-stage value of realization kkk is

Qk(x)=min⁡{ qky∣Wy=hk−Tkx, y≥0 }∈R∪{±∞},Q_k(x)=\min\{\,q_k y\mid Wy=h_k-T_kx,\ y\ge 0\,\}\in\mathbb R\cup\{\pm\infty\},Qk​(x)=min{qk​y∣Wy=hk​−Tk​x, y≥0}∈R∪{±∞},

the expected recourse is Ω(x)=∑kpkQk(x)\Omega(x)=\sum_k p_kQ_k(x)Ω(x)=∑k​pk​Qk​(x), and the deterministic equivalent (2) minimizes cx+Ω(x)cx+\Omega(x)cx+Ω(x) over K1∩K2K_1\cap K_2K1​∩K2​, where K1={x∣Ax=b, x≥0}K_1=\{x\mid Ax=b,\ x\ge 0\}K1​={x∣Ax=b, x≥0} and K2K_2K2​ is the set of xxx for which every second-stage problem is feasible.

The multicut algorithm keeps feasibility cuts (Dl,dl)(D_l,d_l)(Dl​,dl​) and, for each kkk, optimality cuts (El(k),el(k))(E_{l(k)},e_{l(k)})(El(k)​,el(k)​). Step 1 solves the master

min⁡ cx+∑kθks.t. Ax=b, x≥0, Dlx≥dl, El(k)x+θk≥el(k),\min\ cx+\sum_{k}\theta_k\quad\text{s.t. } Ax=b,\ x\ge0,\ D_lx\ge d_l,\ E_{l(k)}x+\theta_k\ge e_{l(k)},min cx+k∑​θk​s.t. Ax=b, x≥0, Dl​x≥dl​, El(k)​x+θk​≥el(k)​,

ignoring θk\theta_kθk​ when scenario kkk has no cut. Step 2 tests feasibility of each scenario at the master solution xνx^\nuxν and, at the first infeasible one, adds a feasibility cut (σTk,σhk)(\sigma T_k,\sigma h_k)(σTk​,σhk​) from the simplex multiplier σ\sigmaσ of a phase-one LP. Step 3 solves each second-stage problem at xνx^\nuxν with simplex multiplier πk\pi_kπk​; for every kkk with θk<pkπk(hk−Tkxν)\theta_k<p_k\pi_k(h_k-T_kx^\nu)θk​<pk​πk​(hk​−Tk​xν) (condition (14)) it adds the optimality cut (pkπkTk, pkπkhk)(p_k\pi_kT_k,\ p_k\pi_kh_k)(pk​πk​Tk​, pk​πk​hk​). If no kkk satisfies (14) the algorithm stops.

The cut set Ck\mathcal C_kCk​ is the finite set of all optimality cuts that Step 3 can produce for scenario kkk: the cuts of simplex-optimal bases of the scenario-kkk problem at points of K1K_1K1​.

Formalization targets

Goal: the iteration bound (17)

The paper states (Theorem, p. 388):

Let b be the slope number of the second stage of (2). Then, the maximum number of iterations for the multicut algorithm is 1 + K(b^{m₂} − 1) (17) while the maximum number of iterations for the L-shaped algorithm is [1 + K(b − 1)]^{m₂} (18) where K is the number of the different realizations of ξ.

The goal is (17) with the number of facets replaced by the number of distinct cuts: if ∣Ck∣≤M|\mathcal C_k|\le M∣Ck​∣≤M for every kkk and M≥1M\ge1M≥1, then in every run of the algorithm, for every choice of optimal master solutions and optimal bases,

#{returns to Step 1 from Step 3} ≤ 1+K(M−1).\#\{\text{returns to Step 1 from Step 3}\}\ \le\ 1+K(M-1).#{returns to Step 1 from Step 3} ≤ 1+K(M−1).

Milestones

  1. The feasibility cuts determine K2K_2K2​ (a point lies in K2K_2K2​ exactly when it satisfies every feasibility cut, §2, p. 385), and each optimality cut is an affine minorant of pkQkp_kQ_kpk​Qk​ touching it where it was generated (the multicut algorithm outer-linearizes each QkQ_kQk​, p. 387).
  2. Aggregating one cut per scenario gives a valid L-shaped cut, and z(multi)≥z(L-shaped)z(\text{multi})\ge z(\text{L-shaped})z(multi)≥z(L-shaped) (proof of the Proposition, p. 387).
  3. When (14) holds for no kkk, xνx^\nuxν is optimal for (2) (stopping rule, p. 387).
  4. The first return from Step 3 records one cut for each scenario, and every return records at least one cut not recorded before (proof of the Theorem, p. 388).

Significance

The bound explains why the multicut method needs few major iterations: the information sent to the master grows additively over scenarios, while the facets of Ω\OmegaΩ are combinations of facets of the QkQ_kQk​ and their number can grow multiplicatively. The paper itself notes the trade-off this creates against master size (m1+Km_1+Km1​+K rows instead of m1+1m_1+1m1​+1), which is the basis of later work on partial aggregation of cuts.

The mission produces a formal model of the multicut algorithm as a transition system over all admissible choices, valid-cut lemmas for both cut types with dual feasibility made explicit, the correctness of the stopping rule, and the counting argument. These results are proved on paper but, to our knowledge, no machine-checked version of the multicut L-shaped algorithm or its iteration bound exists. The model is reusable for other results on Benders-type methods for stochastic programs.

Difficulty

The counting argument is short once the right invariants are in place; the difficulty is the invariants. A cut recorded earlier must still be satisfied by the current master solution, while the cut added for a scenario satisfying (14) is violated by it, so the new cut differs from every recorded one. This uses that every recorded cut comes from a basis whose multiplier is dual feasible: a basis that merely attains the optimal value under degeneracy can produce a cut that is not valid. The stopping rule needs strong duality at the final bases and weak duality at all earlier ones, together with extended-real bookkeeping of QkQ_kQk​ on points where a scenario is infeasible.

Formalization scope

The model is the published StochasticProg_Recourse_Instance (QkQ_kQk​ in EReal, +∞+\infty+∞ when infeasible) with simplex bases and multipliers from StochasticProg_LShaped_Bases. Vectors are Fin n → ℝ, scenarios Fin K. A simplex-optimal basis is defined locally: invertible basic submatrix, nonnegative basic solution, and dual-feasible multiplier (πW≤qk\pi W\le q_kπW≤qk​; for the phase-one LP, σW≤0\sigma W\le 0σW≤0 and ∣σi∣≤1|\sigma_i|\le 1∣σi​∣≤1). The algorithm is an inductive step relation on states (feasibility cuts, per-scenario cut lists, return counter); a run is any finite sequence of steps from the empty state. Master optima are attained optimal solutions, not infima.

Pinned-down readings:

  • The paper writes the bound with bm2b^{m_2}bm2​, from its slope number bbb, and asserts without derivation that each QkQ_kQk​ has at most bm2b^{m_2}bm2​ facets. We state the bound for any MMM bounding the number of distinct cuts of each scenario, which is what the paper's proof counts. The L-shaped bound (18) is not stated.
  • "Iterations" are returns to Step 1 from Step 3. The final, stopping solve is not counted, consistent with Appendix A (four facets of Ω\OmegaΩ, five L-shaped solves; two multicut returns), and Step-2 (feasibility) returns are not counted, as in the paper's bound.
  • Positive probabilities pk>0p_k>0pk​>0 are assumed where K2K_2K2​ or optimality appears (the paper's realizations form the support of ξ\xiξ).
  • A scenario with no optimality cut has θk\theta_kθk​ omitted from the objective and always satisfies (14).

The transition relation allows every choice the paper allows; a relation that fixed, say, a particular basis or a particular master solution would prove a bound for fewer runs, and one that required the cut set to be smaller than the paper's would make the bound easy. Neither is done here.

Contributions welcome: proofs of the milestones, a sorry-free proof of the goal from them, and a worked check that the definitions admit the run of Appendix A.

Selected references

  • J. R. Birge and F. V. Louveaux, A multicut algorithm for two-stage stochastic linear programs, European Journal of Operational Research 34 (1988) 384–392. https://doi.org/10.1016/0377-2217(88)90159-2
  • R. M. Van Slyke and R. J.-B. Wets, L-shaped linear programs with applications to optimal control and stochastic programming, SIAM Journal on Applied Mathematics 17 (1969) 638–663. https://doi.org/10.1137/0117061
  • J. F. Benders, Partitioning procedures for solving mixed-variables programming problems, Numerische Mathematik 4 (1962) 238–252. https://doi.org/10.1007/BF01386316
  • J. R. Birge and F. Louveaux, Introduction to Stochastic Programming, 2nd ed., Springer, 2011. https://doi.org/10.1007/978-1-4614-0237-4
12 thms1 active userReviewed
CombinatoricsOperations ResearchOptimization·Captain: Shuze Chen

Disjunctive Programming VI: Extended Formulations for Perfectly Matchable Subgraph PolytopesTextbook

Motivation

Many polytopes that arise from combinatorial optimization problems have no small facet description in their natural variable space, yet become describable by a compact linear system once lifted to a higher-dimensional space of auxiliary variables and projected back down — Chapter 2's own extended formulation of the convex hull of a disjunctive set is one instance of this phenomenon. This chapter turns the idea around: rather than using projection to build a compact formulation, it uses projection to prove integrality of a formulation that is already compact but whose integrality is not obvious from any standard sufficient condition (total unimodularity, balancedness, etc.). The technique is illustrated on three closely related combinatorial polytopes built from perfectly matchable, assignable, and path-decomposable vertex subsets of a graph or digraph — each proved integral by lifting to an edge- or arc-variable space where total unimodularity is easy to check, then projecting.

Setting

For a finite vertex set VVV, the incidence vector of W⊆VW \subseteq VW⊆V is 111 on WWW, 000 elsewhere, and x(S):=∑i∈Sxix(S) := \sum_{i \in S} x_ix(S):=∑i∈S​xi​. A graph G(W)G(W)G(W) has a perfect matching if there is a fixed-point-free involution on WWW respecting adjacency. The PMS (Perfectly Matchable Subgraph) polytope of GGG is conv(X)\mathrm{conv}(X)conv(X) where XXX is the set of incidence vectors of such WWW; N(S):={j∉S:(i,j)∈E for some i∈S}N(S) := \{j \notin S : (i,j) \in E \text{ for some } i \in S\}N(S):={j∈/S:(i,j)∈E for some i∈S}.

For a digraph (V,A)(V,A)(V,A): G(W)G(W)G(W) is assignable if it admits a cycle decomposition (a permutation of WWW respecting arcs), giving the Assignable Subgraph Polytope. For an acyclic digraph with distinguished nodes s,ts,ts,t: G(W∪{s,t})G(W \cup \{s,t\})G(W∪{s,t}) admits an sss-ttt path decomposition if a collection of interior-node-disjoint sss-ttt paths covers it, giving the sss-ttt Path Decomposable Subgraph Polytope over W⊆V∖{s,t}W \subseteq V \setminus \{s,t\}W⊆V∖{s,t}. Γ(S)\Gamma(S)Γ(S) and Γ∗(S)\Gamma^*(S)Γ∗(S) are the corresponding out-neighborhood operators. For an arbitrary graph, c(S)c(S)c(S) counts the connected components of the induced subgraph G(S)G(S)G(S).

Formalization targets

Theorem 5.1 (goal) — the PMS polytope of a bipartite graph

0≤xi≤1 (i∈V),x(V1)−x(V2)=0,x(S)−x(N(S))≤0  (S⊆V1).0 \le x_i \le 1\ (i \in V), \qquad x(V_1) - x(V_2) = 0, \qquad x(S) - x(N(S)) \le 0\ \ (S \subseteq V_1).0≤xi​≤1 (i∈V),x(V1​)−x(V2​)=0,x(S)−x(N(S))≤0  (S⊆V1​).

Theorem 5.2 — the Assignable Subgraph Polytope

0≤xi≤1 (i∈V),x(S∖Γ(S))−x(Γ(S)∖S)≤0(S⊆V).0 \le x_i \le 1\ (i \in V), \qquad x(S \setminus \Gamma(S)) - x(\Gamma(S) \setminus S) \le 0 \quad (S \subseteq V).0≤xi​≤1 (i∈V),x(S∖Γ(S))−x(Γ(S)∖S)≤0(S⊆V).

Theorem 5.3 — the sss-ttt Path Decomposable Subgraph Polytope

0≤xi≤1 (i∈V),x(S∖Γ∗(S))−x(Γ∗(S)∖S)≤0(S⊆V∖{s,t}).0 \le x_i \le 1\ (i \in V), \qquad x(S \setminus \Gamma^*(S)) - x(\Gamma^*(S) \setminus S) \le 0 \quad (S \subseteq V \setminus \{s,t\}).0≤xi​≤1 (i∈V),x(S∖Γ∗(S))−x(Γ∗(S)∖S)≤0(S⊆V∖{s,t}).

Theorem 5.4 — the PMS polytope of an arbitrary graph

0≤xi≤1 (i∈V),x(S)−x(N(S))≤∣S∣−c(S)0 \le x_i \le 1\ (i \in V), \qquad x(S) - x(N(S)) \le |S| - c(S)0≤xi​≤1 (i∈V),x(S)−x(N(S))≤∣S∣−c(S)

for every SSS all of whose components are single nodes or nonbipartite with odd order — the weakest faithful statement, since dropping the side condition would assert the inequality for subsets it does not hold for.

Significance

The results themselves. Each theorem gives an explicit, checkable linear system defining a polytope that arises naturally from a combinatorial covering/decomposition property, turning "does G(W)G(W)G(W) have property XXX" into a linear-programming feasibility question. Theorem 5.1 is the one the book proves in full and the template for the other three: bipartite matching, digraph assignment, and acyclic-digraph path decomposition are structurally parallel problems (all reduce to checking a König–Hall-type combinatorial condition), and the same lift-and-project technique handles all three uniformly. Theorem 5.4 extends the idea to arbitrary (non-bipartite) graphs at the cost of a sharper right-hand side and a component-based side condition, connecting to Edmonds' classical matching-polytope theory while remaining a genuinely different object (a polytope of coverable vertex sets, not of matchings themselves).

Formalizing it. No object in this mission — the PMS, Assignable, or Path Decomposable Subgraph polytopes, or their defining neighbor operators — exists on the platform prior to this mission. The closest platform result, MetricTSP.pm_polytope_decomposition (Edmonds' perfect matching polytope theorem, in edge-variable space over a fixed vertex set requiring every vertex matched), is a genuinely different object from Theorem 5.4's PMS polytope (vertex-variable space, vertices may be left unmatched by design) and is not reused as a kind: reference item; it is noted here as related, not equivalent.

Difficulty

The natural first attempt tries to verify each polytope's integrality directly, by checking a known sufficient condition (total unimodularity, balancedness) on the displayed vertex-space system itself. This fails: the book states explicitly that (5.5)'s coefficient matrix is not totally unimodular, which is exactly why the lift-to-edge-variables step is necessary at all. The real content of each theorem is the two-part argument: (1) the lifted system in edge/arc variables is totally unimodular (checkable directly), so its polyhedron is integral; and (2) the vertex- space system is exactly the projection of the lifted one — a nontrivial fact requiring Chapter 2's projection machinery, not merely an unfolding of definitions. Theorem 5.4's extra difficulty, flagged explicitly in the text, is that its projection cone is not pointed, so the proof must work with a finite generating set rather than extreme rays, and it suffices to find a subset of generators producing every facet rather than a complete generating set — a genuinely harder argument the book itself outsources to a citation.

Formalization scope

Undirected graphs use Mathlib's SimpleGraph; digraphs use a bare relation A : V → V → Prop (not required symmetric or irreflexive, matching the book's unrestricted notion). Bipartition is recorded via part : V → Bool (decidable by construction) rather than two Set V halves, keeping the sums x(V_1), x(V_2) computable over Finsets throughout. IsAssignable uses Equiv.Perm on the vertex-set subtype, since a cycle decomposition is exactly a permutation. IsComponentOf and IsBipartiteOn (Theorem 5.4) are built directly from reachability and 2-colorability rather than Mathlib's induced-subgraph/ConnectedComponent API, matching the "maximal connected subset" reading of "component" the book's own prose intends.

IsPathDecomposable (Theorem 5.3) encodes "admits an sss-ttt path decomposition" via a degree-constrained arc set (every interior node has exactly one incoming and one outgoing chosen arc, none entering sss or leaving ttt, at least one leaving sss) rather than an explicit list of vertex-disjoint paths — provably equivalent by the standard fact that an acyclic arc set with this degree pattern always decomposes into such a path family, and considerably lighter to state and reason about than constructing Path objects directly.

A trivializing formalization is ruled out explicitly: every theorem keeps the fractional box constraint 0≤xi≤10 \le x_i \le 10≤xi​≤1 rather than the integral xi∈{0,1}x_i \in \{0,1\}xi​∈{0,1} (per BRIEF.md's own warning, dropping the relaxation collapses the claim to a restatement of the combinatorial definition), and Theorem 5.1 is stated only for bipartite graphs — never generalized to subsume Theorem 5.4's genuinely different inequality system and side condition.

Selected references

  • E. Balas, Disjunctive Programming, Springer, 2018. DOI: 10.1007/978-3-030-00148-3, Chapter 5, §5.2.
  • M. O. Ball, U. Derigs, An analysis of alternate strategies for implementing matching algorithms, Networks 13 (1983) (cited in the text as [13], the origin of Theorems 5.2 and 5.3).
  • W. R. Pulleyblank, J. Edmonds, Facets of 1-matching polyhedra, in Hypergraph Seminar, Springer Lecture Notes in Mathematics 411 (1974) — the origin of the perfectly matchable subgraph polytope literature (cited in the text as [34], the origin of Theorem 5.1).
  • L. Lovász, M. D. Plummer, Matching Theory, Elsevier, 1986 (cited in the text as [35], the origin of Theorem 5.4).
6 thms1 active userReviewed
Stochastic Systems·Captain: mikedeng1

Stochastic Linear Programming 01: Distribution of Random LP Optimal ValuesTextbook

Motivation

A stochastic linear program is a linear optimization problem whose coefficients depend on a random parameter. Even when the model is feasible and bounded almost surely, its optimal value is itself a random quantity. Knowing only its expectation can hide the probability of unusually favorable or unfavorable outcomes; its full distribution supports threshold probabilities, quantiles, and later risk-sensitive decisions. Chapter II of Peter Kall's Stochastic Linear Programming develops a finite-dimensional method for determining that distribution when the constraint matrix, right-hand side, and objective coefficients depend affinely on the same random vector. Theorem 8, printed p. 29 / PDF35, is the chapter's general distribution formula. This mission asks for that known theorem to be proved in Lean from its reviewed statement.

Setting

Fix a finite parameter vector t∈Rrt\in\mathbb R^rt∈Rr. An affine random linear program supplies a matrix A(t)∈Rm×nA(t)\in\mathbb R^{m\times n}A(t)∈Rm×n, a right-hand side b(t)∈Rmb(t)\in\mathbb R^mb(t)∈Rm, and costs c(t)∈Rnc(t)\in\mathbb R^nc(t)∈Rn, each affine in ttt. Its optimal value is the extended-real infimum

γ(t)=inf⁡{c(t)⊤x:A(t)x=b(t), x≥0}.\gamma(t)=\inf\{c(t)^\top x:A(t)x=b(t),\ x\ge 0\}.γ(t)=inf{c(t)⊤x:A(t)x=b(t), x≥0}.

The parameter has a probability law μ\muμ, supported almost surely on a measurable set TTT, with a nonnegative extended-real density fff relative to Lebesgue measure. The extended-real value records infeasibility as +∞+\infty+∞ and unboundedness as −∞-\infty−∞; the target distribution deliberately restricts to the finite-value event −∞<γ(t)≤ξ-\infty<\gamma(t)\le\xi−∞<γ(t)≤ξ.

A candidate basis is an increasing selection σ:Fin⁡(m)→Fin⁡(n)\sigma:\operatorname{Fin}(m)\to\operatorname{Fin}(n)σ:Fin(m)→Fin(n). Its basis matrix Bσ(t)B_\sigma(t)Bσ​(t) consists of the selected columns of A(t)A(t)A(t). Kall enumerates exactly those candidate bases whose determinant is nonzero at some point of TTT. For each one, its raw optimality region consists of the parameters for which Bσ(t)−1b(t)≥0B_\sigma(t)^{-1}b(t)\ge0Bσ​(t)−1b(t)≥0 and the reduced costs c(t)⊤−cB(t)⊤Bσ(t)−1A(t)c(t)^\top-c_B(t)^\top B_\sigma(t)^{-1}A(t)c(t)⊤−cB​(t)⊤Bσ​(t)−1A(t) are nonnegative. Matrix inversion is totalized to zero at singular matrices, matching the source convention. The ordered basis regions remove every earlier raw region, so overlapping optimal bases are assigned to the first enumerated basis. On a basis region the associated value is

γσ(t)=cB(t)⊤Bσ(t)−1b(t).\gamma_\sigma(t)=c_B(t)^\top B_\sigma(t)^{-1}b(t).γσ​(t)=cB​(t)⊤Bσ​(t)−1b(t).

Assumption A1 is explicit in Lean: the density and support clauses above, both almost-sure feasibility/boundedness implications from Theorem 4, and the existence of one full-row-rank column minor at a point of TTT. The basis enumeration is injective and exhaustive for the almost nonsingular increasing selections.

Formalization targets

Theorem 8: distribution by basis regions

For the ordered regions BiB_iBi​, the theorem states

μ ⁣(⋃iBi)=∑iμ(Bi)=1.\mu\!\left(\bigcup_i B_i\right)=\sum_i\mu(B_i)=1.μ(i⋃​Bi​)=i∑​μ(Bi​)=1.

For every real threshold ξ\xiξ, it further identifies the finite optimal-value distribution by

μ{t∈T:−∞<γ(t)≤ξ}=∑i∫{t∈Bi:γi(t)≤ξ}f(t) dt.\mu\{t\in T:-\infty<\gamma(t)\le\xi\} =\sum_i\int_{\{t\in B_i:\gamma_i(t)\le\xi\}} f(t)\,dt.μ{t∈T:−∞<γ(t)≤ξ}=i∑​∫{t∈Bi​:γi​(t)≤ξ}​f(t)dt.

The normalization and distribution identity are the two clauses of the same source theorem and remain one goal. Determinant facts, special stochastic models, and examples elsewhere in the chapter are context rather than additional mission targets.

Significance

The result turns the distribution of a random optimization value into a finite sum of ordinary density integrals over explicitly described parameter regions. It connects parametric linear programming geometry with probabilistic questions about the optimum and provides the chapter's foundation for studying particular stochastic models and derived distributional quantities. Without the coverage and normalization clauses, the integral expression could omit positive-probability parameter regimes; without the finite-value event, extended-real exceptional outcomes would be conflated with a real-valued distribution function.

The theorem is established in the 1976 source, but the staged Lean declaration contains a proof placeholder. Completing it would produce a machine-checked account of the basis-region decomposition under the source's full hypotheses. The reusable content includes the affine model, basis matrix, raw-region inequalities, ordered disjointification, basis value, and the referenced extended-real linear-program value.

Difficulty

The natural pointwise argument chooses an optimal basis and substitutes its basic solution. That alone does not prove a measurable probability decomposition: several bases may be optimal at the same parameter, bases may become singular on exceptional sets, and the optimal value may be infinite. The ordered subtraction of earlier regions resolves overlap only after one proves exhaustive coverage under A1. The final equality must also connect the extended-real infimum to the real basis value on each region and justify the density integrals on the threshold sets. Treating the raw regions as automatically disjoint or silently assuming every parameter has a unique nonsingular optimizer would bypass the central issues.

Formalization scope

All dimensions and basis lists are finite. The law is a probability measure on Fin⁡(r)→R\operatorname{Fin}(r)\to\mathbb RFin(r)→R, represented as volume.withDensity f; TTT is measurable and carries the law almost surely. The density is ENNReal-valued and the displayed integrals are nonnegative lintegrals. No integrability or finite-moment hypothesis is imposed on the optimal value. LPValue is an existing referenced platform definition using EReal.sInf; the book-local declarations remain in the shared Kall1976 namespace. Mathlib's nonsingular inverse supplies the source's zero value at singular matrices.

The formal target must retain both almost-sure implications, the one-point full-rank condition, increasing and exhaustive basis enumeration, region ordering, probability-one normalization, the strict lower bound by −∞-\infty−∞, and the weak upper threshold ≤ξ\le\xi≤ξ. Removing any of these clauses would change the reviewed theorem rather than simplify its proof. Contributions may develop measurable-region, finite-basis coverage, LP optimality, and density-integration lemmas, provided they preserve these conventions.

Selected references

  • Peter Kall, Stochastic Linear Programming, Springer, 1976, Chapter II §1: Theorem 4 printed p. 25 / PDF31; model (5) printed p. 27 / PDF33; Assumption A1 printed p. 28 / PDF34; Theorem 8 printed p. 29 / PDF35. DOI.
3 thms1 active userReviewed
PreviousPage 2 of 2Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me