Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in
← Collections

The OR Formalization Drive

Help us formalize the operations research literature in Lean.

696 completed missions

Missions

401–420 of 696
OpenCompletedAll
🏆Completed
Bandit AlgorithmsMachine LearningOperations Research+2·Captain: mikedeng1

Optimal Best Arm Identification with Fixed Confidence IV: Asymptotic Optimality of the Track-and-Stop StrategyResearch Paper

Motivation

In best arm identification with fixed confidence, a learner samples KKK unknown distributions (arms) sequentially and must, as early as possible, name the arm with the largest mean, while being wrong with probability at most a prescribed risk δ\deltaδ. The problem models adaptive A/B/n testing, clinical and simulation-based selection among alternatives, and the "ranking and selection" problem of operations research and simulation optimization. The quantity of interest is the sample complexity Eμ[τδ]\mathbb E_{\boldsymbol\mu}[\tau_\delta]Eμ​[τδ​], the expected number of samples a strategy takes before stopping.

Timeline of the question this mission formalizes:

  • Chernoff (1959) introduced sequential tests based on generalized likelihood ratios for adaptive design of experiments, with a finite set of hypotheses (doi:10.1214/aoms/1177706205).
  • Kaufmann, Cappé and Garivier (2016, JMLR) proved a change-of-measure lower bound on the sample complexity of every δ\deltaδ-PAC strategy (arXiv:1407.4443).
  • Garivier and Kaufmann (COLT 2016) identified the exact constant T∗(μ)T^*(\boldsymbol\mu)T∗(μ) in that lower bound and gave the first strategy, Track-and-Stop, whose sample complexity matches it asymptotically as δ→0\delta\to0δ→0 (arXiv:1602.04589). This mission covers the upper-bound half of that paper.

Setting

A canonical one-parameter exponential family is a family of laws νθ\nu_\thetaνθ​, θ∈Θ\theta\in\Thetaθ∈Θ, on R\mathbb RR with density exp⁡(θx−b(θ))\exp(\theta x-b(\theta))exp(θx−b(θ)) with respect to a reference measure ξ\xiξ; bbb is twice differentiable and strictly convex, and νθ\nu_\thetaνθ​ has mean b˙(θ)\dot b(\theta)b˙(θ). Bernoulli, Poisson and Gaussian laws with known variance are examples. The divergence d(μ,μ′)d(\mu,\mu')d(μ,μ′) is the Kullback–Leibler divergence between the members with means μ\muμ and μ′\mu'μ′.

A bandit model μ=(μ1,…,μK)\boldsymbol\mu=(\mu_1,\dots,\mu_K)μ=(μ1​,…,μK​) assigns a member of the family to each arm. The class S\mathcal SS consists of models with a unique optimal arm a∗(μ)a^*(\boldsymbol\mu)a∗(μ). At each round t=1,2,…t=1,2,\dotst=1,2,… the learner picks an arm AtA_tAt​ as a function of past observations, observes a reward drawn from that arm's law, and at a stopping time τδ\tau_\deltaτδ​ recommends an arm. Na(t)N_a(t)Na​(t) is the number of draws of arm aaa in the first ttt rounds and μ^a(t)\hat\mu_a(t)μ^​a​(t) its empirical mean.

With Alt(μ)={λ∈S:a∗(λ)≠a∗(μ)}\mathrm{Alt}(\boldsymbol\mu)=\{\boldsymbol\lambda\in\mathcal S: a^*(\boldsymbol\lambda)\ne a^*(\boldsymbol\mu)\}Alt(μ)={λ∈S:a∗(λ)=a∗(μ)} and ΣK\Sigma_KΣK​ the probability simplex, the characteristic time is

T∗(μ)−1=sup⁡w∈ΣK inf⁡λ∈Alt(μ) ∑a=1Kwa d(μa,λa),T^*(\boldsymbol\mu)^{-1}=\sup_{w\in\Sigma_K}\ \inf_{\boldsymbol\lambda\in\mathrm{Alt}(\boldsymbol\mu)}\ \sum_{a=1}^K w_a\,d(\mu_a,\lambda_a),T∗(μ)−1=w∈ΣK​sup​ λ∈Alt(μ)inf​ a=1∑K​wa​d(μa​,λa​),

and the maximizer w∗(μ)w^*(\boldsymbol\mu)w∗(μ) are the optimal proportions of arm draws.

Track-and-Stop combines two ingredients:

  • a sampling rule that tracks the plug-in proportions w∗(μ^(t))w^*(\hat{\boldsymbol\mu}(t))w∗(μ^​(t)) while forcing each arm to be drawn about t\sqrt tt​ times: C-Tracking tracks the cumulated sum of projections of w∗(μ^(s))w^*(\hat{\boldsymbol\mu}(s))w∗(μ^​(s)) onto ΣKϵs={w∈ΣK:wa≥ϵs}\Sigma^{\epsilon_s}_K=\{w\in\Sigma_K: w_a\ge\epsilon_s\}ΣKϵs​​={w∈ΣK​:wa​≥ϵs​}, ϵs=(K2+s)−1/2/2\epsilon_s=(K^2+s)^{-1/2}/2ϵs​=(K2+s)−1/2/2; D-Tracking draws an under-sampled arm when some Na(t)<t−K/2N_a(t)<\sqrt t-K/2Na​(t)<t​−K/2, and otherwise the arm maximizing t wa∗(μ^(t))−Na(t)t\,w^*_a(\hat{\boldsymbol\mu}(t))-N_a(t)twa∗​(μ^​(t))−Na​(t);
  • Chernoff's stopping rule, which stops at the first ttt at which some arm aaa beats every other arm bbb in a generalized likelihood ratio test, Za,b(t)>β(t,δ)Z_{a,b}(t)>\beta(t,\delta)Za,b​(t)>β(t,δ), here with β(t,δ)=log⁡(r(t)/δ)\beta(t,\delta)=\log(r(t)/\delta)β(t,δ)=log(r(t)/δ).

Formalization targets

Goal: Theorem 14 (p. 13)

For α∈[1,e/2]\alpha\in[1,e/2]α∈[1,e/2] and r(t)=O(tα)r(t)=O(t^\alpha)r(t)=O(tα), Chernoff's stopping rule with β(t,δ)=log⁡(r(t)/δ)\beta(t,\delta)=\log(r(t)/\delta)β(t,δ)=log(r(t)/δ) combined with C-Tracking or D-Tracking satisfies

lim sup⁡δ→0Eμ[τδ]log⁡(1/δ)≤α T∗(μ)\limsup_{\delta\to0}\frac{\mathbb E_{\boldsymbol\mu}[\tau_\delta]}{\log(1/\delta)}\le\alpha\,T^*(\boldsymbol\mu)δ→0limsup​log(1/δ)Eμ​[τδ​]​≤αT∗(μ)

for every μ∈S\boldsymbol\mu\in\mathcal Sμ∈S.

Milestones

  • Lemma 15 (p. 20): greedy tracking of cumulated proportions P(k)P(k)P(k) keeps max⁡i∣Ni(n)−Pi(n)∣≤K−1\max_i|N_i(n)-P_i(n)|\le K-1maxi​∣Ni​(n)−Pi​(n)∣≤K−1.
  • Lemma 7 (p. 7): C-Tracking ensures Na(t)≥t+K2−2KN_a(t)\ge\sqrt{t+K^2}-2KNa​(t)≥t+K2​−2K and max⁡a∣Na(t)−∑s<twa∗(μ^(s))∣≤K(1+t)\max_a|N_a(t)-\sum_{s<t}w^*_a(\hat{\boldsymbol\mu}(s))|\le K(1+\sqrt t)maxa​∣Na​(t)−∑s<t​wa∗​(μ^​(s))∣≤K(1+t​).
  • Lemma 8 (p. 7): D-Tracking ensures Na(t)≥(t−K/2)+−1N_a(t)\ge(\sqrt t-K/2)_+-1Na​(t)≥(t​−K/2)+​−1, and proportions within 3(K−1)ϵ3(K-1)\epsilon3(K−1)ϵ of w∗(μ)w^*(\boldsymbol\mu)w∗(μ) after a time tϵt_\epsilontϵ​ that does not depend on the trajectory, once the plug-in targets are within ϵ\epsilonϵ.
  • Proposition 9 (p. 8): under either rule, Na(t)/t→wa∗(μ)N_a(t)/t\to w^*_a(\boldsymbol\mu)Na​(t)/t→wa∗​(μ) almost surely.
  • Lemma 18 (p. 27): an explicit xxx with c1x≥log⁡(c2xα)c_1x\ge\log(c_2x^\alpha)c1​x≥log(c2​xα) for α∈[1,e/2]\alpha\in[1,e/2]α∈[1,e/2].
  • Proposition 13 (p. 11): with any sampling rule whose proportions converge almost surely to w∗w^*w∗, τδ<∞\tau_\delta<\inftyτδ​<∞ almost surely and lim sup⁡δ→0τδ/log⁡(1/δ)≤αT∗(μ)\limsup_{\delta\to0}\tau_\delta/\log(1/\delta)\le\alpha T^*(\boldsymbol\mu)limsupδ→0​τδ​/log(1/δ)≤αT∗(μ) almost surely.

Significance

Theorem 1 of the same paper shows Eμ[τδ]≥T∗(μ) kl(δ,1−δ)\mathbb E_{\boldsymbol\mu}[\tau_\delta]\ge T^*(\boldsymbol\mu)\,\mathrm{kl}(\delta,1-\delta)Eμ​[τδ​]≥T∗(μ)kl(δ,1−δ) for every δ\deltaδ-PAC strategy, and kl(δ,1−δ)∼log⁡(1/δ)\mathrm{kl}(\delta,1-\delta)\sim\log(1/\delta)kl(δ,1−δ)∼log(1/δ). Theorem 14 with α=1\alpha=1α=1 therefore shows that the lower bound is attained: T∗(μ)T^*(\boldsymbol\mu)T∗(μ) is the exact asymptotic sample complexity of best arm identification in exponential family models, and Track-and-Stop is asymptotically optimal.

The result is proved in the paper. What is not available is a machine-checked proof for exponential families. The platform already holds a Lean development of the Gaussian case following Lattimore and Szepesvári, Bandit Algorithms, Ch. 33, stated for one existentially chosen policy with a different threshold. This mission asks for the universal statement: every run of either tracking rule, for every exponential family, with the paper's thresholds. The tracking lemmas (Lemmas 15, 7, 8) are deterministic combinatorics and reusable by any tracking-based algorithm.

Difficulty

The obvious argument plugs the almost-sure behaviour of Proposition 13 into an expectation. That step fails: almost-sure convergence of τδ/log⁡(1/δ)\tau_\delta/\log(1/\delta)τδ​/log(1/δ) does not control E[τδ]\mathbb E[\tau_\delta]E[τδ​], because on the rare events where the empirical means are far from μ\boldsymbol\muμ the stopping time may be very large. Theorem 14 needs a quantitative concentration of μ^(t)\hat{\boldsymbol\mu}(t)μ^​(t) on events whose complements have summable probability, which in turn relies on the forced exploration guaranteed by the t\sqrt tt​ lower bounds on Na(t)N_a(t)Na​(t) (the concentration step of App. D, Lemmas 19–20).

A second obstacle is the regularity of w∗w^*w∗: the tracking lemmas only transfer convergence of μ^(t)\hat{\boldsymbol\mu}(t)μ^​(t) to convergence of Na(t)/tN_a(t)/tNa​(t)/t through the continuity of μ↦w∗(μ)\boldsymbol\mu\mapsto w^*(\boldsymbol\mu)μ↦w∗(μ) on S\mathcal SS, proved from the characterization of w∗w^*w∗ in §2.2 (Proposition 6). The GLR statistic also needs its closed form (7) near μ\boldsymbol\muμ, which requires the empirical means to lie in the interior of the mean space.

Formalization scope

  • Model. The exponential family is a structure (ξ,Θ,b)(\xi,\Theta,b)(ξ,Θ,b) with Θ\ThetaΘ a nonempty open interval, each νθ\nu_\thetaνθ​ normalized, bbb twice continuously differentiable and b¨>0\ddot b>0b¨>0 on Θ\ThetaΘ. Openness and b¨>0\ddot b>0b¨>0 are added to the paper's "convex, twice differentiable"; strict convexity is what makes νμ\nu^\muνμ unique. Bandit models are parameter vectors θ∈ΘK\theta\in\Theta^Kθ∈ΘK with K≥2K\ge2K≥2; arms are indexed 0,…,K−10,\dots,K-10,…,K−1. S\mathcal SS is the set of parameter vectors with a unique arm of largest mean b˙(θa)\dot b(\theta_a)b˙(θa​).
  • Protocol. Policies, the trajectory law Pμ\mathbb P_{\boldsymbol\mu}Pμ​, pull counts, empirical means and T∗(μ)T^*(\boldsymbol\mu)T∗(μ) are the platform's published definitions (BanditPolicy, BanditTrajectory, TrackAndStop). T∗T^*T∗ uses Kullback–Leibler divergences of the arm laws over the class S\mathcal SS and takes values in [0,∞][0,\infty][0,∞]. Trajectory coordinate ttt is round t+1t+1t+1. An arm never drawn has empirical mean 000.
  • Target map. w∗(μ^(t))w^*(\hat{\boldsymbol\mu}(t))w∗(μ^​(t)) is undefined in the paper when μ^(t)∉S\hat{\boldsymbol\mu}(t)\notin\mathcal Sμ^​(t)∈/S (an unsampled arm, ties, a mean outside b˙(Θ)\dot b(\Theta)b˙(Θ)). Every tracking statement quantifies over every target map with values in ΣK\Sigma_KΣK​ that returns optimal proportions on S\mathcal SS, over every choice of L∞L^\inftyL∞ projections, and over every tie-breaking, including randomized ones.
  • Stopping rule. The two maxima in Za,b(t)Z_{a,b}(t)Za,b​(t) are suprema over Θ\ThetaΘ in the extended reals. Za,b(t)>βZ_{a,b}(t)>\betaZa,b​(t)>β is written without subtracting infinities. The stopping time is the first t≥1t\ge1t≥1 at which the test succeeds, +∞+\infty+∞ if none. "r(t)=O(tα)r(t)=O(t^\alpha)r(t)=O(tα)" is r(t)≤Dtαr(t)\le Dt^\alphar(t)≤Dtα for t≥1t\ge1t≥1; r>0r>0r>0 is added so that log⁡(r(t)/δ)\log(r(t)/\delta)log(r(t)/δ) is defined.
  • Values in [0,∞][0,\infty][0,∞]. Expectations of τδ\tau_\deltaτδ​, the ratios and T∗T^*T∗ live in [0,∞][0,\infty][0,∞]. No statement converts them to reals, so an infinite expected stopping time is never read as 000.
  • Corrections, disclosed. Proposition 9's printed Pw\mathbb P_wPw​ is Pμ\mathbb P_{\boldsymbol\mu}Pμ​. Lemma 18 adds c2/c1α>1c_2/c_1^\alpha>1c2​/c1α​>1 and x>0x>0x>0, without which its expressions are undefined.
  • Ruled out. Specializing to Gaussian arms, or asserting that some sampling policy achieves the bound, would restate existing platform results and is not this theorem: the goal is about every C-Tracking or D-Tracking run in every exponential family.
  • Welcome contributions. Exponential-family facts (b˙\dot bb˙ is the mean, the KL formula, concentration of empirical means); the continuity of w∗w^*w∗ (Proposition 6, App. A.3); Lemma 17 (App. B.2), from which Lemma 8 follows; the closed form (7) of the GLR statistic.

Selected references

  • A. Garivier, E. Kaufmann, Optimal Best Arm Identification with Fixed Confidence, COLT 2016, JMLR W&CP 49. arXiv:1602.04589v2
  • E. Kaufmann, O. Cappé, A. Garivier, On the Complexity of Best-Arm Identification in Multi-Armed Bandit Models, JMLR 17, 2016. arXiv:1407.4443
  • H. Chernoff, Sequential Design of Experiments, Ann. Math. Statist. 30(3), 1959. doi:10.1214/aoms/1177706205
  • T. Lattimore, C. Szepesvári, Bandit Algorithms, Cambridge University Press, 2020, Ch. 33. doi:10.1017/9781108571401
15 thms5 active usersReviewed
🏆Completed
CombinatoricsOperations ResearchOptimization+1·Captain: mikedeng1

The Distributionally Robust Chance-Constrained Vehicle Routing Problem I: With a Subadditive Demand Estimator the Two-Index Vehicle Flow Formulation Is ExactResearch Paper

Motivation

The capacitated vehicle routing problem (CVRP) asks for delivery routes of minimum cost. Each route starts and ends at a depot, every customer is visited exactly once, and the demand served on a route does not exceed the vehicle capacity. The problem is central in logistics and one of the most studied problems in combinatorial optimization. Its standard exact methods are branch-and-cut algorithms built on the two-index vehicle flow formulation, a 0/1 program over arcs whose capacity constraints are the rounded capacity inequalities (RCIs); see Laporte, Nobert and Desrochers (1985) and Semet, Toth and Vigo (2014).

In practice customer demands are uncertain. A chance-constrained CVRP requires each route to respect its capacity with probability at least 1−ϵ1-\epsilon1−ϵ under a known distribution. That distribution is rarely known. Most solution methods also need independent demands. Ghosal and Wiesemann (Oper. Res. 68(3), 2020) study the distributionally robust chance-constrained CVRP. There the chance constraint must hold for every distribution in an ambiguity set P\mathcal PP of plausible distributions. The ambiguity set may contain dependent distributions and uncountably many of them, so it is not clear a priori that the problem can be solved by the usual branch-and-cut machinery. This mission formalizes the paper's answer to that question: its Theorem 1 and the counterexample that precedes it.

Setting

The graph is complete and directed. Its nodes are V={0,…,n}V=\{0,\dots,n\}V={0,…,n} and its arcs are A={(i,j)∈V×V:i≠j}A=\{(i,j)\in V\times V:i\neq j\}A={(i,j)∈V×V:i=j}. Node 000 is the depot and VC={1,…,n}V_C=\{1,\dots,n\}VC​={1,…,n} are the customers. There are mmm vehicles, indexed by K={1,…,m}K=\{1,\dots,m\}K={1,…,m}, each of capacity Q>0Q>0Q>0. Traversing the arc (i,j)(i,j)(i,j) costs c(i,j)≥0c(i,j)\ge 0c(i,j)≥0; costs may be asymmetric.

A route Rk=(Rk,1,…,Rk,nk)\mathbf R_k=(R_{k,1},\dots,R_{k,n_k})Rk​=(Rk,1​,…,Rk,nk​​) is an ordered list of customers, with Rk,0=Rk,nk+1=0R_{k,0}=R_{k,n_k+1}=0Rk,0​=Rk,nk​+1​=0. A route set R=(R1,…,Rm)∈P(VC,m)\mathbf R=(\mathbf R_1,\dots,\mathbf R_m)\in\mathfrak P(V_C,m)R=(R1​,…,Rm​)∈P(VC​,m) partitions VCV_CVC​ into mmm nonempty ordered routes. Its cost is c(R)=∑k∑l=0nkc(Rk,l,Rk,l+1)c(\mathbf R)=\sum_{k}\sum_{l=0}^{n_k}c(R_{k,l},R_{k,l+1})c(R)=∑k​∑l=0nk​​c(Rk,l​,Rk,l+1​).

The demand vector q~∈Rn\tilde{\boldsymbol q}\in\mathbb R^nq~​∈Rn is random. The ambiguity set P\mathcal PP is a set of probability distributions of q~\tilde{\boldsymbol q}q~​ and ϵ∈(0,1)\epsilon\in(0,1)ϵ∈(0,1) is the risk level. The problem RVRP(P\mathcal PP) minimizes c(R)c(\mathbf R)c(R) over route sets such that

P[∑i∈Rkq~i≤Q]≥1−ϵ∀ P∈P, ∀ k∈K.\mathbb P\Big[\textstyle\sum_{i\in\mathbf R_k}\tilde q_i\le Q\Big]\ge 1-\epsilon\qquad\forall\,\mathbb P\in\mathcal P,\ \forall\,k\in K .P[∑i∈Rk​​q~​i​≤Q]≥1−ϵ∀P∈P, ∀k∈K.

With Q-VaR1−ϵ[X~]=inf⁡{x:Q[X~≤x]≥1−ϵ}\mathbb Q\text{-VaR}_{1-\epsilon}[\tilde X]=\inf\{x:\mathbb Q[\tilde X\le x]\ge1-\epsilon\}Q-VaR1−ϵ​[X~]=inf{x:Q[X~≤x]≥1−ϵ}, the demand estimator of the paper's Eq. (2) is

dP(S)=max⁡{⌈1Qsup⁡P∈PP-VaR1−ϵ[∑i∈Sq~i]⌉,1}(S≠∅),dP(∅)=0.d_{\mathcal P}(S)=\max\left\{\left\lceil\frac1Q\sup_{\mathbb P\in\mathcal P}\mathbb P\text{-VaR}_{1-\epsilon}\Big[\sum_{i\in S}\tilde q_i\Big]\right\rceil,1\right\}\quad(S\neq\emptyset),\qquad d_{\mathcal P}(\emptyset)=0 .dP​(S)=max{⌈Q1​P∈Psup​P-VaR1−ϵ​[i∈S∑​q~​i​]⌉,1}(S=∅),dP​(∅)=0.

The problem 2VF(P\mathcal PP) minimizes ∑(i,j)∈Ac(i,j)xij\sum_{(i,j)\in A}c(i,j)x_{ij}∑(i,j)∈A​c(i,j)xij​ over x∈{0,1}Ax\in\{0,1\}^Ax∈{0,1}A with in- and out-degree 111 at every customer and mmm at the depot, and with the RCIs

∑i∈V∖S∑j∈Sxij≥dP(S)∀ S⊆VC, S≠∅.\sum_{i\in V\setminus S}\sum_{j\in S}x_{ij}\ge d_{\mathcal P}(S)\qquad\forall\,S\subseteq V_C,\ S\neq\emptyset .i∈V∖S∑​j∈S∑​xij​≥dP​(S)∀S⊆VC​, S=∅.

A route set induces the arc vector with xij=1x_{ij}=1xij​=1 exactly when (i,j)=(Rk,l,Rk,l+1)(i,j)=(R_{k,l},R_{k,l+1})(i,j)=(Rk,l​,Rk,l+1​) for some k,lk,lk,l (the paper's Eq. (3)). The estimator satisfies the subadditivity condition (S) if dP(S∪T)≤dP(S)+dP(T)d_{\mathcal P}(S\cup T)\le d_{\mathcal P}(S)+d_{\mathcal P}(T)dP​(S∪T)≤dP​(S)+dP​(T) for all S,T⊆VCS,T\subseteq V_CS,T⊆VC​.

Formalization targets

Goal: Theorem 1

Assume q~≥0\tilde{\boldsymbol q}\ge\mathbf 0q~​≥0 P\mathbb PP-a.s. for all P∈P\mathbb P\in\mathcal PP∈P, and assume dPd_{\mathcal P}dP​ is real valued and satisfies (S). Then:

(i)  R feasible in RVRP(P) ⟹ x(R) feasible in 2VF(P),  c(x(R))=c(R);(ii)  x feasible in 2VF(P) ⟹ x=x(R) for an RVRP(P)-feasible R, unique up to reordering routes, c(x)=c(R).\begin{aligned} &\text{(i)}\ \ \mathbf R \text{ feasible in RVRP}(\mathcal P)\ \Longrightarrow\ x(\mathbf R)\text{ feasible in 2VF}(\mathcal P),\ \ c(x(\mathbf R))=c(\mathbf R);\\ &\text{(ii)}\ \ x\text{ feasible in 2VF}(\mathcal P)\ \Longrightarrow\ x=x(\mathbf R)\text{ for an RVRP}(\mathcal P)\text{-feasible }\mathbf R,\text{ unique up to reordering routes},\ c(x)=c(\mathbf R). \end{aligned}​(i)  R feasible in RVRP(P) ⟹ x(R) feasible in 2VF(P),  c(x(R))=c(R);(ii)  x feasible in 2VF(P) ⟹ x=x(R) for an RVRP(P)-feasible R, unique up to reordering routes, c(x)=c(R).​

Milestones

  1. The chance constraint Q[X~≤τ]≥1−ϵ\mathbb Q[\tilde X\le\tau]\ge1-\epsilonQ[X~≤τ]≥1−ϵ is equivalent to Q-VaR1−ϵ[X~]≤τ\mathbb Q\text{-VaR}_{1-\epsilon}[\tilde X]\le\tauQ-VaR1−ϵ​[X~]≤τ (p. 720).
  2. Eq. (1): a route satisfies its robust chance constraint if and only if the worst-case VaR of its cumulative demand is at most QQQ.
  3. Example 1: an instance with two customers where a route set is RVRP(P\mathcal PP)-feasible, yet its induced flow violates the RCI for S={1,2}S=\{1,2\}S={1,2}, since dP({1,2})≥3d_{\mathcal P}(\{1,2\})\ge3dP​({1,2})≥3.
  4. Example 1 (continued): on that instance dPd_{\mathcal P}dP​ violates (S).
  5. Theorem 1 (i) and 6. Theorem 1 (ii), stated separately.

Significance

Theorem 1 separates the modeling question from the algorithmic one. Whenever the ambiguity set yields a subadditive estimator, the distributionally robust CVRP is solved exactly by a two-index flow branch-and-cut. The only change from the deterministic case is the right-hand side dP(S)d_{\mathcal P}(S)dP​(S) of the RCIs, however many distributions P\mathcal PP contains. The companion missions of this series show that (S) holds for every moment ambiguity set (Theorem 2 of the paper) and compute dPd_{\mathcal P}dP​ for several classes of such sets. Example 1 shows that the hypothesis cannot be dropped: ambiguity sets that pin down each customer's marginal distribution break the equivalence.

The paper's proofs are in its online supplement; no machine-checked version of these statements exists. Formalizing them produces a checked reduction between a stochastic routing model and an integer program. It also produces reusable definitions of route sets, induced arc flows and RCIs over directed graphs with a depot.

Difficulty

Direction (ii) is a graph decomposition. A 0/1 vector with the prescribed degrees splits into mmm depot cycles plus possibly depot-free subtours. The RCIs, through the max⁡{⋅,1}\max\{\cdot,1\}max{⋅,1} in dPd_{\mathcal P}dP​, must exclude the subtours, and the RCI on the customers of a single route must enforce that route's chance constraint. Uniqueness up to reordering requires that directed routes are recovered from arcs.

Direction (i) is where (S) enters. The naive argument bounds the number of vehicles entering SSS by dP(S)d_{\mathcal P}(S)dP​(S) directly from the chance constraints. It fails because the chance constraints control each route separately, while dP(S)d_{\mathcal P}(S)dP​(S) looks at the joint worst case of the demands in SSS; Example 1 is exactly this failure. A set SSS is typically visited by several routes, each covering only part of it. Relating the per-route guarantees to the joint quantity dP(S)d_{\mathcal P}(S)dP​(S) needs both hypotheses of the theorem: nonnegative demands and (S).

Formalization scope

Customers are Fin n (0-based; the paper's customer iii is i - 1). Nodes are Fin (n+1) with the depot 0 and customer i at i.succ, and vehicles are Fin m. A route set is R : Fin m → List (Fin n): every route is nonempty and the concatenated routes are a permutation of all customers. Arc vectors are ℕ-valued functions on ordered node pairs, with values in {0,1}\{0,1\}{0,1} and the non-arcs (i,i)(i,i)(i,i) fixed to 000.

Distributions are measures on Fin n → ℝ, and the ambiguity set is a set of probability measures. Chance constraints are written ENNReal.ofReal (1 - ε) ≤ P {q | …}. Value-at-risk is the published MultistageStochastic.valueAtRisk at level 1 - ε. The worst-case VaR is a real sSup and dPd_{\mathcal P}dP​ is integer valued.

Two conventions implicit on the page are explicit hypotheses:

  • Q>0Q>0Q>0, because (2) divides by QQQ;
  • boundedness of the VaR values for every customer set, which encodes the paper's declaration dP:2VC→R+d_{\mathcal P}:2^{V_C}\to\mathbb R_+dP​:2VC​→R+​.

A real sSup of an unbounded set is 000 in Lean. Without the boundedness hypothesis every such estimator would silently equal 111 and (ii) would fail. For an empty ambiguity set the Lean estimator equals 111 on nonempty sets, as the paper's does.

The RCIs range over all nonempty customer sets with the depot on the outside. The estimator keeps the ceiling and the max⁡{⋅,1}\max\{\cdot,1\}max{⋅,1}. 2VF feasibility mentions neither routes nor chance constraints. RVRP feasibility does not mention dPd_{\mathcal P}dP​. A formalization in which either side refers to the other, or in which dPd_{\mathcal P}dP​ drops the max⁡{⋅,1}\max\{\cdot,1\}max{⋅,1}, is not this theorem.

Useful contributions include lemmas on the decomposition of degree-constrained 0/1 arc vectors into depot cycles, monotonicity of VaR under almost-sure ordering, and the CDF right-continuity behind milestone 1.

Related platform work: SupplyChainTheory_vrp formalizes a different, symmetric, unit-demand VRP and is not reused.

Selected references

  • S. Ghosal, W. Wiesemann, The Distributionally Robust Chance-Constrained Vehicle Routing Problem, Operations Research 68(3):716–732, 2020. https://doi.org/10.1287/opre.2019.1924
  • G. Laporte, Y. Nobert, M. Desrochers, Optimal routing under capacity and distance restrictions, Operations Research 33(5):1050–1073, 1985. https://doi.org/10.1287/opre.33.5.1050
  • F. Semet, P. Toth, D. Vigo, Classical exact algorithms for the capacitated vehicle routing problem, in P. Toth, D. Vigo (eds.), Vehicle Routing: Problems, Methods, and Applications, 2nd ed., SIAM, 2014, 37–57. https://doi.org/10.1137/1.9781611973594.ch2
  • J. Lysgaard, A. N. Letchford, R. W. Eglese, A new branch-and-cut algorithm for the capacitated vehicle routing problem, Mathematical Programming 100(2):423–445, 2004. https://doi.org/10.1007/s10107-003-0481-8
12 thms4 active usersReviewed
🏆Completed
Convex OptimizationOperations ResearchOptimization+1·Captain: mikedeng1

The Distributionally Robust Chance-Constrained Vehicle Routing Problem II: Moment Ambiguity Sets Give Subadditive Demand EstimatorsResearch Paper

Motivation

The capacitated vehicle routing problem (CVRP) asks for a set of minimum-cost routes by which a fleet of identical vehicles of capacity QQQ, based at a depot, serves every customer exactly once without any vehicle carrying more than its capacity. In practice customer demands are not known when routes are planned. Ghosal and Wiesemann (Oper. Res. 68(3), 2020) study the distributionally robust CVRP: the demand vector q~\tilde{\boldsymbol q}q~​ is random, its distribution is known only to lie in an ambiguity set P\mathcal PP, and every route must respect its capacity with probability at least 1−ϵ1-\epsilon1−ϵ under every distribution in P\mathcal PP.

Exact CVRP solvers rely on compact two-index vehicle flow formulations strengthened by rounded capacity inequalities, which bound from below the number of vehicles entering any customer subset SSS by a demand estimator d(S)d(S)d(S). The paper shows (its Theorem 1) that the robust two-index formulation is exact whenever the demand estimator is subadditive and demands are nonnegative, and that this fails for some natural ambiguity sets: sets that fix the marginal distribution of each customer's demand violate it (Example 1). This mission formalizes the paper's positive result for the most widely used class of ambiguity sets, the moment ambiguity sets of distributionally robust optimization (see El Ghaoui et al. 2003, Delage and Ye 2010, Wiesemann et al. 2014).

Setting

There are nnn customers, indexed i=1,…,ni=1,\dots,ni=1,…,n; the demand vector is q~∈Rn\tilde{\boldsymbol q}\in\mathbb R^nq~​∈Rn. Fix

  • a rectangular support Q=[q‾,q‾]\mathcal Q=[\underline{\boldsymbol q},\overline{\boldsymbol q}]Q=[q​,q​] with q‾≥0\underline{\boldsymbol q}\ge\mathbf 0q​≥0;
  • a mean vector μ∈Rn\boldsymbol\mu\in\mathbb R^nμ∈Rn;
  • a dispersion measure φ=(φ1,…,φp):Rn→Rp\boldsymbol\varphi=(\varphi_1,\dots,\varphi_p):\mathbb R^n\to\mathbb R^pφ=(φ1​,…,φp​):Rn→Rp (for example mean absolute deviations ∣qi−μi∣|q_i-\mu_i|∣qi​−μi​∣, variances (qi−μi)2(q_i-\mu_i)^2(qi​−μi​)2 or Huber losses) and bounds σ∈Rp\boldsymbol\sigma\in\mathbb R^pσ∈Rp.

The moment ambiguity set is

P={P∈P0(Rn): P(q~∈Q)=1,  EP[q~]=μ,  EP[φ(q~)]≤σ},\mathcal P=\Big\{\mathbb P\in\mathcal P_0(\mathbb R^n):\ \mathbb P(\tilde{\boldsymbol q}\in\mathcal Q)=1,\ \ \mathbb E_{\mathbb P}[\tilde{\boldsymbol q}]=\boldsymbol\mu,\ \ \mathbb E_{\mathbb P}[\boldsymbol\varphi(\tilde{\boldsymbol q})]\le\boldsymbol\sigma\Big\},P={P∈P0​(Rn): P(q~​∈Q)=1,  EP​[q~​]=μ,  EP​[φ(q~​)]≤σ},

where P0(Rn)\mathcal P_0(\mathbb R^n)P0​(Rn) denotes all probability distributions on Rn\mathbb R^nRn. The paper's standing assumptions are μ∈int⁡Q\boldsymbol\mu\in\operatorname{int}\mathcal Qμ∈intQ, each φl\varphi_lφl​ closed and convex, and φ(μ)<σ\boldsymbol\varphi(\boldsymbol\mu)<\boldsymbol\sigmaφ(μ)<σ.

For a distribution P\mathbb PP the value-at-risk of a random variable is P-VaR1−ϵ[X~]=inf⁡{x∈R:P[X~≤x]≥1−ϵ}\mathbb P\text{-VaR}_{1-\epsilon}[\tilde X]=\inf\{x\in\mathbb R:\mathbb P[\tilde X\le x]\ge1-\epsilon\}P-VaR1−ϵ​[X~]=inf{x∈R:P[X~≤x]≥1−ϵ}, with risk level ϵ∈(0,1)\epsilon\in(0,1)ϵ∈(0,1). The worst-case value-at-risk of a customer subset SSS is sup⁡P∈PP-VaR1−ϵ[∑i∈Sq~i]\sup_{\mathbb P\in\mathcal P}\mathbb P\text{-VaR}_{1-\epsilon}[\sum_{i\in S}\tilde q_i]supP∈P​P-VaR1−ϵ​[∑i∈S​q~​i​], and the demand estimator (2) is

dP(S)=max⁡{⌈1Qsup⁡P∈PP-VaR1−ϵ[∑i∈Sq~i]⌉,1}(S≠∅),dP(∅)=0.d_{\mathcal P}(S)=\max\left\{\left\lceil\frac1Q\sup_{\mathbb P\in\mathcal P}\mathbb P\text{-VaR}_{1-\epsilon}\Big[\sum_{i\in S}\tilde q_i\Big]\right\rceil,1\right\}\quad(S\neq\emptyset),\qquad d_{\mathcal P}(\emptyset)=0 .dP​(S)=max{⌈Q1​P∈Psup​P-VaR1−ϵ​[i∈S∑​q~​i​]⌉,1}(S=∅),dP​(∅)=0.

The Lean development names these momentAmbiguitySet qlo qhi μ φ σ, worstCaseVaR, demandEstimator and twoPointMeasure in the namespace DRCVRP.Moment.

Formalization targets

Goal: Theorem 2 (p. 723)

For every moment ambiguity set satisfying the standing assumptions, every ϵ∈(0,1)\epsilon\in(0,1)ϵ∈(0,1) and every Q>0Q>0Q>0,

dP(S∪T)≤dP(S)+dP(T)for all customer subsets S,T.d_{\mathcal P}(S\cup T)\le d_{\mathcal P}(S)+d_{\mathcal P}(T)\qquad\text{for all customer subsets } S,T .dP​(S∪T)≤dP​(S)+dP​(T)for all customer subsets S,T.

This is condition (S) of the paper, stated for the rounded estimator (2) and for all pairs of subsets, overlapping or empty ones included.

Milestone: Proposition 1 (p. 723)

For every customer subset SSS there are two-point distributions Pt=p1tδq1t+p2tδq2t∈P\mathbb P^t=p_1^t\delta_{\boldsymbol q_1^t}+p_2^t\delta_{\boldsymbol q_2^t}\in\mathcal PPt=p1t​δq1t​​+p2t​δq2t​​∈P with p1t,p2t≥0p_1^t,p_2^t\ge0p1t​,p2t​≥0 and q1t,q2t∈Q\boldsymbol q_1^t,\boldsymbol q_2^t\in\mathcal Qq1t​,q2t​∈Q such that

Pt-VaR1−ϵ[∑i∈Sq~i]⟶sup⁡P∈PP-VaR1−ϵ[∑i∈Sq~i](t→∞).\mathbb P^t\text{-VaR}_{1-\epsilon}\Big[\sum_{i\in S}\tilde q_i\Big]\longrightarrow\sup_{\mathbb P\in\mathcal P}\mathbb P\text{-VaR}_{1-\epsilon}\Big[\sum_{i\in S}\tilde q_i\Big]\qquad(t\to\infty).Pt-VaR1−ϵ​[i∈S∑​q~​i​]⟶P∈Psup​P-VaR1−ϵ​[i∈S∑​q~​i​](t→∞).

Significance

Combined with the paper's Theorem 1, Theorem 2 says that for every moment ambiguity set with nonnegative demands the robust CVRP can be solved through the compact two-index formulation with robust rounded capacity inequalities, i.e. by the branch-and-cut machinery of the deterministic CVRP. It also separates moment ambiguity sets from ambiguity sets built from marginal histograms, hypothesis tests, ϕ\phiϕ-divergences or Wasserstein balls, whose estimators can violate subadditivity. Proposition 1 describes the worst case: however many moment constraints the set contains, two demand scenarios suffice to approach the worst-case value-at-risk, strengthening the Richter–Rogosinski theorem for this functional.

Both results are proved in the paper's online supplement. They have not, to the best of current knowledge, been machine checked. This mission produces a checked statement and proof of both, together with a reusable encoding of moment ambiguity sets and of the worst-case value-at-risk over them. The companion missions of the series formalize the equivalence theorem (I) and the explicit worst-case VaR formulas for marginalized (III), first-order (IV) and covariance (V) ambiguity sets.

Difficulty

Value-at-risk is not subadditive for a single distribution, so the obvious route, subadditivity of the worst-case VaR followed by ⌈a+b⌉≤⌈a⌉+⌈b⌉\lceil a+b\rceil\le\lceil a\rceil+\lceil b\rceil⌈a+b⌉≤⌈a⌉+⌈b⌉, needs an argument specific to the moment set; for the marginal-histogram set of Example 1 the worst-case VaR itself fails to be subadditive. The supremum over P\mathcal PP ranges over an infinite-dimensional set of distributions and is in general not attained, so an argument that picks a maximizer does not apply, and the classical finite-support reduction (Richter–Rogosinski) yields a number of support points that grows with the number of moment constraints, not two. The integer rounding and the max⁡{⋅,1}\max\{\cdot,1\}max{⋅,1} must also be handled for all pairs of subsets, including overlapping ones.

Formalization scope

Customers are Fin n (0-based) and customer subsets are Finset (Fin n). Distributions are measures on Fin n → ℝ; membership in the moment set requires a probability measure giving mass one to the closed box Set.Icc qlo qhi, integrable coordinates with ∫ q, q i ∂P = μ i (an equality), and integrable φ l with ∫ q, φ l q ∂P ≤ σ l. The integrability clauses hold automatically under the standing assumptions and do not shrink the set. The dispersion measure is an arbitrary real-valued function whose components are convex (convex real functions on Rn\mathbb R^nRn are continuous, which covers "closed"); p=0p=0p=0 is allowed. The value-at-risk is the published platform definition MultistageStochastic.valueAtRisk at level 1−ϵ1-\epsilon1−ϵ. The worst-case VaR is a real sSup; over a moment set satisfying the standing assumptions the set of VaRs is nonempty (the Dirac measure at μ\boldsymbol\muμ belongs to P\mathcal PP) and bounded by the box, so this is the true supremum. The estimator is integer valued. Every standing assumption is a hypothesis of both theorems.

Neither statement can be satisfied trivially: the goal is about the rounded estimator of the true supremum over a nonempty set, not about subadditivity of an arbitrary set function, and the milestone requires the two-point laws to lie in P\mathcal PP and their VaRs to converge to the supremum, not to be attained. Extended-valued dispersion measures, such as the one expressing the covariance set of §5.2 as an instance of (4), are outside the scope of the real-valued encoding.

A complete development needs basic facts about quantiles of finitely supported measures, the structure of the moment set, and a duality or construction argument for the worst-case VaR. Lemmas about value-at-risk of two-point laws and about moment sets are reusable across the series. Proofs of the milestone, of the goal, and of intermediate lemmas are welcome.

Selected references

  • S. Ghosal, W. Wiesemann, The Distributionally Robust Chance-Constrained Vehicle Routing Problem, Operations Research 68(3):716–732, 2020. https://doi.org/10.1287/opre.2019.1924
  • L. El Ghaoui, M. Oks, F. Oustry, Worst-case value-at-risk and robust portfolio optimization: A conic programming approach, Operations Research 51(4):543–556, 2003. https://doi.org/10.1287/opre.51.4.543.16101
  • E. Delage, Y. Ye, Distributionally robust optimization under moment uncertainty with application to data-driven problems, Operations Research 58(3):595–612, 2010. https://doi.org/10.1287/opre.1090.0741
  • W. Wiesemann, D. Kuhn, M. Sim, Distributionally robust convex optimization, Operations Research 62(6):1358–1376, 2014. https://doi.org/10.1287/opre.2014.1314
  • A. Shapiro, D. Dentcheva, A. Ruszczyński, Lectures on Stochastic Programming: Modeling and Theory, 2nd ed., SIAM, 2014. https://doi.org/10.1137/1.9781611973433
4 thms3 active usersReviewed
🏆Completed
Convex OptimizationDiscrete GeometryOperations Research+1·Captain: Shuze Chen

Discrete Convex Analysis XXXI: The Potential Criterion for Network FlowsTextbook

Motivation

Chapter 9 is where discrete convex analysis meets classical network flow theory: the minimum cost flow problem's three hallmark properties — an optimality criterion by potentials, an optimality criterion by negative cycles, and integrality of optimal solutions — are shown to survive, in a precise and increasingly general form, first for arbitrary polyhedral convex costs (MCFP3), then for the M-convex submodular flow problem (MSFP2/MSFP3), the chapter's own combinatorial generalization of the classical problem. This mission places the potential criterion (Theorem 9.4) and its cascade of six corollaries and generalizations, the block of results this book's own text uses to carry every other result in the chapter.

Setting

A digraph G = (V,A) with tail/head maps ∂⁺,∂⁻ : A → V. A flow ξ : A → R has boundary ∂ξ(v) = Σ{ξ(a) : ∂⁺a=v} − Σ{ξ(a) : ∂⁻a=v}. A potential p : V → R has coboundary δp(a) = p(∂⁺a) − p(∂⁻a). The minimum cost flow problem MCFP3 minimizes Γ₃(ξ) = Σₐ fₐ(ξ(a)) + f(∂ξ) over flows, for polyhedral convex arc costs fₐ : R → R∪{+∞} and boundary cost f : Rⱽ → R∪{+∞}; MCFP0 is its linear-cost, fixed-supply special case. The M-convex submodular flow problem MSFP3 is MCFP3 with f additionally M-convex; MSFP2 is its linear-arc-cost special case.

Formalization targets

Goal: The potential criterion for MCFP3 (Theorem 9.4)

For a feasible flow ξ, ξ is optimal for MCFP3 iff there is a potential p with ξ(a) a minimizer of the reduced arc cost fₐ[δp(a)] for every arc and ∂ξ a minimizer of the reduced boundary cost f[−p]; and any such optimal potential characterizes optimality of every feasible flow. This is the hub result of the whole chunk: the book states Theorem 9.14 is "immediate" from it, and every other placed result either specializes it directly or builds on that specialization.

Supporting structural targets

Theorem 9.5 reformulates MCFP0's optimality as the absence of a negative cycle in an auxiliary network; Theorem 9.6 gives MCFP0's primal and dual integrality, the latter identifying the optimal-potential set as an L-convex polyhedron. Theorem 9.14 specializes the goal to MSFP3; Theorem 9.15 upgrades this to a full polyhedral and integrality structure theorem for MSFP3's optimal-flow-boundary and optimal-potential sets (M2-convex and L-convex polyhedra respectively); Theorem 9.16 is the integer-flow analogue, with the boundary set now literally M2-convex and the integer-optimal-potential set literally L-convex. Theorems 9.18 and 9.20 give the negative-cycle reformulation for MSFP2, real and integer flows respectively, generalizing Theorem 9.5 by admitting a third class of auxiliary arcs governed by the M-convex boundary cost's directional derivative (or its discrete difference, in the integer case).

Significance

This is the chapter's demonstration that M-convexity is not merely an abstract combinatorial axiom but the exact structural hypothesis under which classical network-flow duality survives intact: every one of the four "nice properties" the book opens the chapter with (potentials, negative cycles, integrality, efficient algorithms) is preserved verbatim in the M-convex generalization, and this mission's eight results are the proof of that claim for the first three. The chunk's own internal dependency structure — one foundational theorem (9.4) from which every other placed result descends by specialization or direct generalization — is itself characteristic of how this book organizes its combinatorial machinery around a single convex- analytic core.

None of these results are open — they are Murota's own account of network flow duality under M-convexity (sections 9.1, 9.4, and 9.5). What this mission contributes is a faithful, machine-checked formal statement of each, extending the platform's coverage of chapter 9 begun in mission 12-network-flows (which covered §9.1.1-9.1.2 and §9.3, the feasibility and max-flow min-cut results, deliberately leaving this block for later apparatus); no comparable formalization exists on the platform (see Formalization scope).

Difficulty

The eight results span real- and integer-flow versions of two nested problem hierarchies (MCFP0 ⊂ MCFP3, MSFP2 ⊂ MSFP3) and two distinct optimality certificates (potentials, negative cycles), which this mission handles by building one shared apparatus — FeasibleFlowMCFP3, Gamma3, OptimalFlowMCFP3, IsOptimalPotential — that MCFP0 and MSFP3 both instantiate (MCFP0 literally as the linear-cost/singleton-boundary special case of Eq. (9.11)), and one shared generic cycle/negative-cycle apparatus (IsCycle, CycleLength, HasNegativeCycle) instantiated three times with different auxiliary-arc types (A⊕A for MCFP0, A⊕A⊕(V×V) for MSFP2's extra Cξ arcs governed by the boundary cost's directional derivative). "Primal integral" and "dual integral" polyhedral convex functions (the book's own C[Z|R→R]/C[R→R|Z] notation, used in Theorem 9.15) needed a modeling decision, since the book's own definition of these classes lies outside this chunk's page range; see Formalization scope.

Formalization scope

Ground-set vertices V and arcs A are Fintype with DecidableEq. All base M-/L-convexity vocabulary is redeclared from prior missions in this series. "Primal integral" (C[Z|R→R], M[Z|R→R]) is formalized as integer effective domain (IsDomainIntegerArc/IsDomainIntegerR); "dual integral" (C[R→R|Z], M[R→R|Z]) is formalized as the existence of an integer subgradient at every domain point (IsDualIntegralArc/IsDualIntegralR) — a standard equivalent characterization for polyhedral convex functions, and a deliberate modeling choice recorded in MODERATION_NOTES.md rather than a literal transcription of the book's own (out-of-range) definition of these two notation classes. All eight numbered results found in this chunk's page range are placed in full, with no partial-coverage scope reduction. Contributions completing any of the eight sorrys are welcome; the goal and Theorem 9.15 carry the most independent proof content.

Selected references

  • K. Murota, Discrete Convex Analysis, SIAM, 2003. DOI: 10.1137/1.9780898718508.
  • R. T. Rockafellar, Network Flows and Monotropic Optimization, Wiley, 1984 [178] (the classical potential/Fenchel-duality framework this mission's Theorem 9.4 adapts).
  • K. Murota, "Discrete convex analysis," Mathematical Programming, 83 (1998), pp. 313-371 [140] (the Lagrange duality and negative-cycle theory of section 9.5 this mission's Theorems 9.18 and 9.20 draw from).
88 thms2 active usersReviewed
🏆Completed
Convex OptimizationOperations ResearchOptimization+1·Captain: mikedeng1

The Distributionally Robust Chance-Constrained Vehicle Routing Problem III: Worst-Case Value-at-Risk Is Additive over Marginalized Moment Ambiguity SetsResearch Paper

Motivation

The capacitated vehicle routing problem (CVRP) assigns customers to a fleet of mmm identical vehicles of capacity QQQ and orders each vehicle's visits so as to minimize transportation cost, subject to each vehicle's total load not exceeding QQQ. In practice the customers' demands are not known when the routes are planned. Two classical responses are the robust CVRP, which requires feasibility for every demand vector in an uncertainty set, and the chance-constrained CVRP, which requires each capacity constraint to hold with probability at least 1−ϵ1-\epsilon1−ϵ under a known demand distribution. The first ignores all distributional information; the second assumes a distribution that is rarely known and usually requires independent demands.

Ghosal and Wiesemann (Oper. Res. 68(3), 2020) study the distributionally robust chance-constrained CVRP, RVRP(P\mathcal PP), in which each capacity constraint must hold with probability at least 1−ϵ1-\epsilon1−ϵ under every distribution of an ambiguity set P\mathcal PP. Whether this problem can be solved with existing CVRP technology depends on how the worst-case value-at-risk of a customer set's total demand behaves as a set function. This mission formalizes §4 of the paper, which treats ambiguity sets that only constrain each customer's demand separately.

Setting

There are nnn customers VC={1,…,n}V_C=\{1,\dots,n\}VC​={1,…,n} with random demand vector q~∈Rn\tilde{\boldsymbol q}\in\mathbb R^nq~​∈Rn and a risk level ϵ∈(0,1)\epsilon\in(0,1)ϵ∈(0,1). For a probability distribution P\mathbb PP and a real random variable X~\tilde XX~, the value-at-risk is

P-VaR1−ϵ[X~]=inf⁡{x∈R: P[X~≤x]≥1−ϵ}.\mathbb P\text{-VaR}_{1-\epsilon}[\tilde X]=\inf\{x\in\mathbb R:\ \mathbb P[\tilde X\le x]\ge1-\epsilon\}.P-VaR1−ϵ​[X~]=inf{x∈R: P[X~≤x]≥1−ϵ}.

For an ambiguity set P\mathcal PP and a customer subset SSS, the worst-case value-at-risk of SSS is sup⁡P∈PP-VaR1−ϵ[∑i∈Sq~i]\sup_{\mathbb P\in\mathcal P}\mathbb P\text{-VaR}_{1-\epsilon}[\sum_{i\in S}\tilde q_i]supP∈P​P-VaR1−ϵ​[∑i∈S​q~​i​].

Fix a support box Q=[q‾,q‾]\mathcal Q=[\underline{\boldsymbol q},\overline{\boldsymbol q}]Q=[q​,q​] with q‾≥0\underline{\boldsymbol q}\ge\mathbf 0q​≥0, a mean vector μ\boldsymbol\muμ in the interior of Q\mathcal QQ, and for each customer iii a componentwise convex dispersion measure φi:R→Rpi\boldsymbol\varphi_i:\mathbb R\to\mathbb R^{p_i}φi​:R→Rpi​ with bound σi>φi(μi)\boldsymbol\sigma_i>\boldsymbol\varphi_i(\mu_i)σi​>φi​(μi​). The marginalized moment ambiguity set (5) is

P={P∈P0(Rn): P(q~∈Q)=1, EP[q~]=μ, EP[φi(q~i)]≤σi ∀i∈VC}.\mathcal P=\Big\{\mathbb P\in\mathcal P_0(\mathbb R^n):\ \mathbb P(\tilde{\boldsymbol q}\in\mathcal Q)=1,\ \mathbb E_{\mathbb P}[\tilde{\boldsymbol q}]=\boldsymbol\mu,\ \mathbb E_{\mathbb P}[\boldsymbol\varphi_i(\tilde q_i)]\le\boldsymbol\sigma_i\ \forall i\in V_C\Big\}.P={P∈P0​(Rn): P(q~​∈Q)=1, EP​[q~​]=μ, EP​[φi​(q~​i​)]≤σi​ ∀i∈VC​}.

It constrains marginal moments only, and so contains joint distributions of every dependence structure, from independent to perfectly correlated demands. Three special cases have their own closed forms: the first-order set (6), where σi>0\sigma_i>0σi​>0 bounds the mean absolute deviation E∣q~i−μi∣\mathbb E|\tilde q_i-\mu_i|E∣q~​i​−μi​∣; the variance set (8), where σi>0\sigma_i>0σi​>0 bounds E(q~i−μi)2\mathbb E(\tilde q_i-\mu_i)^2E(q~​i​−μi​)2; and the semivariance set (10), where σi+,σi−>0\sigma_i^+,\sigma_i^->0σi+​,σi−​>0 bound E[q~i−μi]+2\mathbb E[\tilde q_i-\mu_i]_+^2E[q~​i​−μi​]+2​ and E[μi−q~i]+2\mathbb E[\mu_i-\tilde q_i]_+^2E[μi​−q~​i​]+2​.

A route set R=(R1,…,Rm)∈P(VC,m)\mathbf R=(R_1,\dots,R_m)\in\mathfrak P(V_C,m)R=(R1​,…,Rm​)∈P(VC​,m) partitions the customers into mmm nonempty ordered routes. It is feasible in RVRP(P\mathcal PP) if P[∑i∈Rkq~i≤Q]≥1−ϵ\mathbb P[\sum_{i\in R_k}\tilde q_i\le Q]\ge1-\epsilonP[∑i∈Rk​​q~​i​≤Q]≥1−ϵ for all P∈P\mathbb P\in\mathcal PP∈P and all kkk, and feasible in the deterministic CVRP with demands q\boldsymbol qq if ∑i∈Rkqi≤Q\sum_{i\in R_k}q_i\le Q∑i∈Rk​​qi​≤Q for all kkk.

Formalization targets

Goal: Theorem 3 (p. 723)

For every marginalized moment ambiguity set (5) and every nonempty S⊆VCS\subseteq V_CS⊆VC​,

sup⁡P∈PP-VaR1−ϵ[∑i∈Sq~i]=∑i∈Ssup⁡P∈PP-VaR1−ϵ[q~i].\sup_{\mathbb P\in\mathcal P}\mathbb P\text{-VaR}_{1-\epsilon}\Big[\sum_{i\in S}\tilde q_i\Big]=\sum_{i\in S}\sup_{\mathbb P\in\mathcal P}\mathbb P\text{-VaR}_{1-\epsilon}[\tilde q_i].P∈Psup​P-VaR1−ϵ​[i∈S∑​q~​i​]=i∈S∑​P∈Psup​P-VaR1−ϵ​[q~​i​].

The dispersion measures are left arbitrary (convex, componentwise, any number of components), so the goal covers every set of the form (5).

Milestones

  • Proposition 2 (p. 724, Eq. (7)), first-order sets: sup⁡PP-VaR1−ϵ[q~i]=μi+min⁡{q‾i−μi,1−ϵϵ(μi−q‾i),12ϵσi}\sup_{\mathbb P}\mathbb P\text{-VaR}_{1-\epsilon}[\tilde q_i]=\mu_i+\min\{\overline q_i-\mu_i,\frac{1-\epsilon}{\epsilon}(\mu_i-\underline q_i),\frac1{2\epsilon}\sigma_i\}supP​P-VaR1−ϵ​[q~​i​]=μi​+min{q​i​−μi​,ϵ1−ϵ​(μi​−q​i​),2ϵ1​σi​}.
  • Proposition 3 (p. 725, Eq. (9)), variance sets: the same with last term 1−ϵϵσi\sqrt{\frac{1-\epsilon}{\epsilon}\sigma_i}ϵ1−ϵ​σi​​.
  • Proposition 4 (p. 725, Eq. (11)), semivariance sets: the four-term minimum with σi+/ϵ\sqrt{\sigma_i^+/\epsilon}σi+​/ϵ​ and (1−ϵ)σi−/ϵ\sqrt{(1-\epsilon)\sigma_i^-}/\epsilon(1−ϵ)σi−​​/ϵ.
  • Corollary 1 (p. 723): a route set is feasible in RVRP(P\mathcal PP) over (5) if and only if it is feasible in the deterministic CVRP with demands qi=sup⁡P∈PP-VaR1−ϵ[q~i]q_i=\sup_{\mathbb P\in\mathcal P}\mathbb P\text{-VaR}_{1-\epsilon}[\tilde q_i]qi​=supP∈P​P-VaR1−ϵ​[q~​i​].

Significance

Theorem 3 says that over (5) the worst case of a sum is the sum of the worst cases. Because the value-at-risk is not additive for a fixed distribution, and the online supplement exhibits distributions in such a set for which the individual values-at-risk are not additive, the statement is about the ambiguity set, not about any of its members. Its consequence, Corollary 1, is that RVRP(P\mathcal PP) over (5) is a deterministic CVRP with inflated demands, so existing branch-and-cut and branch-and-cut-and-price codes solve it unchanged. Propositions 2–4 make those inflated demands explicit for three standard dispersion measures, so that the whole reduction is in closed form. The corollary also exposes a limitation: under (5) the worst-case distribution does not depend on the route set, and the model cannot represent known dependencies between customers.

The results are proved in the paper's online supplement; none has a machine-checked proof. A formalization produces a checked worst-case value-at-risk calculus over moment sets with support constraints, including sharp one-sided Chebyshev-type bounds under mean-absolute-deviation, variance and semivariance constraints, which are reusable in distributionally robust optimization beyond vehicle routing.

Difficulty

The value-at-risk is neither subadditive nor superadditive in general, so neither inequality of Theorem 3 follows from properties of a single distribution. The inequality "≥\ge≥" requires combining near-worst-case distributions of the individual customers into one joint distribution in P\mathcal PP that is simultaneously near-worst for the sum; the inequality "≤\le≤" requires bounding the value-at-risk of the sum for an arbitrary joint law using only marginal information. In Propositions 2–4 the supremum is typically not attained: the distribution concentrating mass at the claimed worst-case value violates the mean constraint, and the value is reached only as a limit of distributions in P\mathcal PP. An argument that exhibits a single maximizer therefore fails, and the statements must be proved as equalities of suprema.

Formalization scope

Customers are Fin n (0-based) and demand vectors are Fin n → ℝ. An ambiguity set is a set of measures on Fin n → ℝ, each required to be a probability measure; the support condition is P (Set.Icc qlo qhi) = 1 and expectations are Bochner integrals. The sets are sets of joint laws on Rn\mathbb R^nRn, never products of marginals. In (5) each expectation EP[φi,l(q~i)]\mathbb E_{\mathbb P}[\varphi_{i,l}(\tilde q_i)]EP​[φi,l​(q~​i​)] is required to exist; this is automatic for convex φi,l\varphi_{i,l}φi,l​ on the bounded support. The value-at-risk is the published definition MultistageStochastic.valueAtRisk P Y (1 - ε), and the worst-case value-at-risk is the real supremum of its values over the ambiguity set; under the standing assumptions that set of values is nonempty (the Dirac law at μ\boldsymbol\muμ belongs to P\mathcal PP) and bounded (by the support), so the supremum is not a default value. The single-customer quantity is the case S={i}S=\{i\}S={i}. The standing assumptions (q‾≥0\underline{\boldsymbol q}\ge\mathbf 0q​≥0, q‾<μ<q‾\underline{\boldsymbol q}<\boldsymbol\mu<\overline{\boldsymbol q}q​<μ<q​, convexity of φi,l\varphi_{i,l}φi,l​, φi,l(μi)<σi,l\varphi_{i,l}(\mu_i)<\sigma_{i,l}φi,l​(μi​)<σi,l​, σ,σ±>0\boldsymbol\sigma,\boldsymbol\sigma^\pm>\mathbf 0σ,σ±>0, 0<ϵ<10<\epsilon<10<ϵ<1) are explicit hypotheses. Routes are lists of customers; a route set has nonempty routes whose concatenation is a permutation of all customers. Costs are not formalized, since both routing problems minimize the same cost over their feasible route sets.

All targets are equalities or equivalences; a one-sided inequality, a statement asserting that some distribution attains the value, or a formulation over product measures is a different theorem and does not count.

Contributions welcome: the reduction of the chance constraint to a value-at-risk bound, the right-continuity lemmas for the value-at-risk of a measure on Rn\mathbb R^nRn, two-point constructions in the ambiguity sets, and one-sided Chebyshev-type bounds with support constraints.

Selected references

  • S. Ghosal and W. Wiesemann, The Distributionally Robust Chance-Constrained Vehicle Routing Problem, Operations Research 68(3):716–732, 2020. https://doi.org/10.1287/opre.2019.1924
  • G. Laporte, Y. Nobert and M. Desrochers, Optimal routing under capacity and distance restrictions, Operations Research 33(5):1050–1073, 1985. https://doi.org/10.1287/opre.33.5.1050
  • G. Casella and R. L. Berger, Statistical Inference, 2nd ed., Duxbury, 2002.
9 thms3 active usersReviewed
🏆Completed
Convex OptimizationDiscrete GeometryOperations Research+1·Captain: Shuze Chen

Discrete Convex Analysis XXXII: Network DualityTextbook

Motivation

Mission 32-ch09b-networkflows established the potential and negative-cycle optimality criteria for M-convex submodular flow problems. This mission finishes chapter 9 with the two topics that close it out: the constructive engine behind the negative-cycle criterion — cycle cancellation, which actually improves a nonoptimal flow rather than merely detecting suboptimality, resting on a delicate "unique-min condition" for bipartite matchings — and network duality, the chapter's capstone structural theorem showing that M-convexity and L-convexity are preserved (and their conjugacy is preserved) under transformation by an arbitrary network.

Setting

For a feasible integer flow ξ in the M-convex submodular flow problem MSFP2, a negative cycle in the auxiliary network (Gξ,ℓξ) witnesses suboptimality (mission 32's Theorem 9.20); cycle cancellation modifies ξ along a smallest such cycle to produce a strictly better flow ξ̄ (Eq. (9.75)). The unique-min condition for a pair (x,y) of integer vectors with ‖x-y‖∞=1 asks whether the bipartite graph G(x,y) — vertices the positive/negative supports of x-y, weights the M-convex exchange values Δf(x;v,u) — has a unique minimum-weight perfect matching; when it does, the M-convex exchange inequality of Proposition 6.25 becomes an equality. Separately, a network G=(V,A;S,T) with entrance set S and exit set T transforms a pair of functions f,g on Zˢ into induced functions f̃,g̃ on Zᵀ (Eqs. (9.81)-(9.82)), the minimum cost to meet a boundary specification at the exit given a production cost at the entrance and a transportation cost along arcs.

Formalization targets

Goal: Network duality for Z→Z functions (Theorem 9.26)

M-(resp. M♮^\natural♮-)convexity and integer-valuedness of f transfer to the induced f̃; L-(resp. L♮^\natural♮-)convexity and integer-valuedness of g transfer to g̃; and if f is M♮^\natural♮-convex, g is its L♮^\natural♮-conjugate, and each arc cost ga is the conjugate of fa, then g̃ is the conjugate of f̃. Chosen as goal: the book calls this "the harmonious relationship between network flow and M-/L-convexity", its own proof runs roughly six pages (the longest argument in this chunk), and it is the general fact from which Theorems 9.27-9.28 (analogues for other type combinations) and Notes 9.29-9.30 (the aggregation and infimal- convolution closure properties of M-convex functions, already placed in mission 22-ch06b-mconvexfunctions's own Theorem 6.13) all descend.

Supporting structural targets

Theorem 9.22 shows cycle cancellation strictly improves the objective; Propositions 9.23-9.25 are "the key ingredient" behind it: Proposition 9.23 shows the unique-min condition upgrades the M-convex exchange inequality to an equality, Proposition 9.24 gives a checkable characterization of when a bipartite weighted graph has a unique minimum-weight perfect matching, and Proposition 9.25 is the fact that makes the machine run — the specific pair (∂ξ,∂ξ̄) arising from cycle cancellation always satisfies the unique-min condition. Theorems 9.27 and 9.28 are the network duality theorem's own analogues for Z→R and R→R functions, the second restoring the conjugacy assertion (missing for Z→R) via the ordinary real Legendre-Fenchel transform.

Significance

Cycle cancellation is this book's constructive answer to the negative-cycle criterion: not just a certificate of suboptimality, but an actual improvement step, the combinatorial core of the cycle-canceling algorithm explained in section 10.4.3 (mission 35-ch10c-algorithms). Its correctness proof is one of the most intricate combinatorial arguments in the entire book — a proof by contradiction using a multiset-union identity (Eq. (9.80)) to derive a smaller negative cycle from an assumed non-uniqueness, itself resting on Proposition 9.24's Monge-like characterization of unique bipartite matchings. Network duality, meanwhile, is the theorem that explains why discrete convex analysis and network flow theory are so tightly intertwined throughout this book: it is the general mechanism (matroid induction, min-max relations, the M-convex aggregation and infimal-convolution closure properties) underlying nearly every construction chapter 2 introduced informally and chapter 6 proved piecemeal.

None of these results are open — they are Murota's own account of cycle cancellation (section 9.5.2) and network duality (section 9.6). What this mission contributes is a faithful, machine-checked formal statement of each, completing the platform's coverage of chapter 9 begun in missions 12-network-flows and 32-ch09b-networkflows; no comparable formalization exists on the platform (see Formalization scope).

Difficulty

Theorem 9.26's own proof needs the full weight of everything chapter 9 has built (Theorem 9.16's potential criterion for integer flows, the conjugacy theorem of chapter 8), which this mission does not re-prove (proofs are sorry throughout, per this pass's scope) but whose statement still needs the induced-function machinery built faithfully: since the general framework's optimal-value-type quantities can genuinely be -∞ (the book's own blanket hypothesis f̃ > -∞ acknowledges this), InducedFTilde/InducedGTilde are EReal-valued, following the same soundness discipline established in mission 31-ch08d-conjugacyduality for Lagrangian duality's derived quantities.

Formalization scope

Ground-set vertices V and arcs A are Fintype with DecidableEq. All base M-/L-convexity vocabulary is redeclared from prior missions. Functions "on Zˢ" for S a proper subset of the ground set are represented as ordinary V→Z functions required to vanish outside S (SupportedOn), rather than as functions on a dependent subset type — a padding-with-zero encoding consistent with this whole series' preference for a single ambient ground-set domain. C[R→R] (univariate real polyhedral convex functions, needed only for Theorem 9.28's arc costs) is formalized as ordinary midpoint-style convexity (IsConvexUnivariateR) rather than the book's own polyhedral characterization, since polyhedrality plays no role in Theorem 9.28's conclusion beyond ensuring the induced functions are well-behaved. All seven numbered results found in this chunk's page range are placed in full, with no partial-coverage scope reduction. Contributions completing any of the seven sorrys are welcome; the goal and Proposition 9.25 carry the most independent proof content.

Selected references

  • K. Murota, Discrete Convex Analysis, SIAM, 2003. DOI: 10.1137/1.9780898718508.
  • K. Murota, "Valuated matroid intersection," SIAM Journal on Discrete Mathematics, 9 (1996), pp. 545-561 [135] (the unique-max lemma Proposition 9.23 reformulates, and the proof technique behind Proposition 9.25).
  • K. Murota, "Discrete convex analysis," Mathematical Programming, 83 (1998), pp. 313-371 [140] (network duality and cycle cancellation for the M-convex submodular flow problem).
74 thms2 active usersReviewed
🏆Completed
Convex OptimizationOperations ResearchOptimization+1·Captain: mikedeng1

The Distributionally Robust Chance-Constrained Vehicle Routing Problem IV: Worst-Case Value-at-Risk over First-Order Generic Moment Ambiguity Sets as a Convex ProgramResearch Paper

Motivation

In the capacitated vehicle routing problem (CVRP) a depot serves customers VC={1,…,n}V_C=\{1,\dots,n\}VC​={1,…,n} with mmm vehicles of capacity QQQ, and every route must respect the capacity. When customer demands are uncertain, the distributionally robust chance-constrained CVRP of Ghosal and Wiesemann (Oper. Res. 68(3), 2020) requires every route to meet its capacity with probability at least 1−ϵ1-\epsilon1−ϵ under every distribution in an ambiguity set P\mathcal PP, a family of distributions consistent with what is known about the demands. Such constraints are handled in a branch-and-cut scheme through rounded capacity inequalities, whose right-hand sides require one quantity for each customer subset SSS: the worst-case value-at-risk of the cumulative demand of SSS.

For ambiguity sets that describe each customer separately (marginal moment sets), this quantity is additive over customers and the problem reduces to a deterministic CVRP. Such sets cannot express that the demands of customers in the same municipality, county or state vary jointly within limits. The first-order generic moment ambiguity set does express this: it bounds the mean absolute deviation of the cumulative demand of prescribed customer groups. The mean absolute deviation is a standard robust dispersion measure, less sensitive to outliers than the standard deviation (see Casella and Berger, Statistical Inference, 2002). This mission formalizes the paper's description of the worst-case value-at-risk over such sets.

Setting

Demands form a random vector q~\tilde{\boldsymbol q}q~​ on Rn\mathbb R^nRn. The data are a support box Q=[q‾,q‾]\mathcal Q=[\underline{\boldsymbol q},\overline{\boldsymbol q}]Q=[q​,q​] with q‾≥0\underline{\boldsymbol q}\ge\mathbf 0q​≥0, a mean vector μ\boldsymbol\muμ in the interior of Q\mathcal QQ, customer subsets S1,…,Sp⊆VCS_1,\dots,S_p\subseteq V_CS1​,…,Sp​⊆VC​ and bounds ν>0\boldsymbol\nu>\mathbf 0ν>0. For A⊆VCA\subseteq V_CA⊆VC​, 1A∈{0,1}n\mathbf 1_A\in\{0,1\}^n1A​∈{0,1}n is its indicator vector. The first-order generic moment ambiguity set, Eq. (12) of the paper, is

P={P∈P0(Rn): P[q~∈Q]=1, EP[q~]=μ, EP[1Si⊤∣q~−μ∣]≤νi  ∀i=1,…,p},\mathcal P=\Bigl\{\mathbb P\in\mathcal P_0(\mathbb R^n):\ \mathbb P[\tilde{\boldsymbol q}\in\mathcal Q]=1,\ \mathbb E_{\mathbb P}[\tilde{\boldsymbol q}]=\boldsymbol\mu,\ \mathbb E_{\mathbb P}\bigl[\mathbf 1_{S_i}^\top|\tilde{\boldsymbol q}-\boldsymbol\mu|\bigr]\le\nu_i\ \ \forall i=1,\dots,p\Bigr\},P={P∈P0​(Rn): P[q~​∈Q]=1, EP​[q~​]=μ, EP​[1Si​⊤​∣q~​−μ∣]≤νi​  ∀i=1,…,p},

where P0(Rn)\mathcal P_0(\mathbb R^n)P0​(Rn) is the set of probability distributions on Rn\mathbb R^nRn and ∣⋅∣|\cdot|∣⋅∣ acts componentwise. The subsets are arbitrary: they may overlap and need not cover VCV_CVC​.

For a risk level ϵ∈(0,1)\epsilon\in(0,1)ϵ∈(0,1) and a random variable X~\tilde XX~, the value-at-risk is P-VaR1−ϵ[X~]=inf⁡{x∈R:P[X~≤x]≥1−ϵ}\mathbb P\text{-VaR}_{1-\epsilon}[\tilde X]=\inf\{x\in\mathbb R:\mathbb P[\tilde X\le x]\ge1-\epsilon\}P-VaR1−ϵ​[X~]=inf{x∈R:P[X~≤x]≥1−ϵ}. For a customer subset SSS the quantity of interest is

sup⁡P∈P P-VaR1−ϵ[∑i∈Sq~i].\sup_{\mathbb P\in\mathcal P}\ \mathbb P\text{-VaR}_{1-\epsilon}\Bigl[\sum_{i\in S}\tilde q_i\Bigr].P∈Psup​ P-VaR1−ϵ​[i∈S∑​q~​i​].

Write q^=min⁡{q‾−μ, 1−ϵϵ(μ−q‾)}\hat{\boldsymbol q}=\min\{\overline{\boldsymbol q}-\boldsymbol\mu,\ \frac{1-\epsilon}{\epsilon}(\boldsymbol\mu-\underline{\boldsymbol q})\}q^​=min{q​−μ, ϵ1−ϵ​(μ−q​)} (componentwise) and [⋅]+[\cdot]_+[⋅]+​ for the componentwise positive part. A route set R=(R1,…,Rm)\mathbf R=(\mathbf R_1,\dots,\mathbf R_m)R=(R1​,…,Rm​) partitions VCV_CVC​ into mmm nonempty ordered routes. It is feasible in the deterministic CVRP with demands q\boldsymbol qq if ∑i∈Rkqi≤Q\sum_{i\in\mathbf R_k}q_i\le Q∑i∈Rk​​qi​≤Q for all kkk, and feasible in the distributionally robust CVRP if P[∑i∈Rkq~i≤Q]≥1−ϵ\mathbb P[\sum_{i\in\mathbf R_k}\tilde q_i\le Q]\ge1-\epsilonP[∑i∈Rk​​q~​i​≤Q]≥1−ϵ for all P∈P\mathbb P\in\mathcal PP∈P and all kkk.

Formalization targets

Goal: Theorem 5 (p. 726)

For every customer subset SSS,

sup⁡P∈PP-VaR1−ϵ[∑i∈Sq~i]=inf⁡γ∈R+p 1S⊤μ+q^⊤[1S−2∑i=1pγi1Si]++1ϵν⊤γ.\sup_{\mathbb P\in\mathcal P}\mathbb P\text{-VaR}_{1-\epsilon}\Bigl[\sum_{i\in S}\tilde q_i\Bigr]=\inf_{\boldsymbol\gamma\in\mathbb R^p_+}\ \mathbf 1_S^\top\boldsymbol\mu+\hat{\boldsymbol q}^\top\Bigl[\mathbf 1_S-2\sum_{i=1}^p\gamma_i\mathbf 1_{S_i}\Bigr]_+ +\frac1\epsilon\boldsymbol\nu^\top\boldsymbol\gamma .P∈Psup​P-VaR1−ϵ​[i∈S∑​q~​i​]=γ∈R+p​inf​ 1S⊤​μ+q^​⊤[1S​−2i=1∑p​γi​1Si​​]+​+ϵ1​ν⊤γ.

The right-hand side is the optimal value of the paper's problem (13). The statement holds for every family of subsets and all data satisfying the standing assumptions, so it is the general form of which the milestones are special cases.

Corollary 2 (p. 726, Eq. (14))

If S1,…,Sp−1S_1,\dots,S_{p-1}S1​,…,Sp−1​ are pairwise disjoint and cover VCV_CVC​ and Sp=VCS_p=V_CSp​=VC​, then

sup⁡P∈PP-VaR1−ϵ[∑i∈Sq~i]=1S⊤μ+min⁡{νp2ϵ, ∑i=1p−1min⁡{1S∩Si⊤q^, νi2ϵ}}.\sup_{\mathbb P\in\mathcal P}\mathbb P\text{-VaR}_{1-\epsilon}\Bigl[\sum_{i\in S}\tilde q_i\Bigr]=\mathbf 1_S^\top\boldsymbol\mu+\min\Bigl\{\frac{\nu_p}{2\epsilon},\ \sum_{i=1}^{p-1}\min\Bigl\{\mathbf 1_{S\cap S_i}^\top\hat{\boldsymbol q},\ \frac{\nu_i}{2\epsilon}\Bigr\}\Bigr\}.P∈Psup​P-VaR1−ϵ​[i∈S∑​q~​i​]=1S⊤​μ+min{2ϵνp​​, i=1∑p−1​min{1S∩Si​⊤​q^​, 2ϵνi​​}}.

Corollary 3 (pp. 726–727, Eq. (15))

If p=n+1p=n+1p=n+1, Si={i}S_i=\{i\}Si​={i} for i≤ni\le ni≤n and Sn+1=VCS_{n+1}=V_CSn+1​=VC​, then

sup⁡P∈PP-VaR1−ϵ[∑i∈Sq~i]=1S⊤μ+min⁡{νn+12ϵ, ∑i∈Smin⁡{q^i, νi2ϵ}}.\sup_{\mathbb P\in\mathcal P}\mathbb P\text{-VaR}_{1-\epsilon}\Bigl[\sum_{i\in S}\tilde q_i\Bigr]=\mathbf 1_S^\top\boldsymbol\mu+\min\Bigl\{\frac{\nu_{n+1}}{2\epsilon},\ \sum_{i\in S}\min\Bigl\{\hat q_i,\ \frac{\nu_i}{2\epsilon}\Bigr\}\Bigr\}.P∈Psup​P-VaR1−ϵ​[i∈S∑​q~​i​]=1S⊤​μ+min{2ϵνn+1​​, i∈S∑​min{q^​i​, 2ϵνi​​}}.

Theorem 4 (p. 726)

For some instance with an ambiguity set of the form (12), no deterministic CVRP instance on the same customers and vehicles (capacity Q′≥0Q'\ge0Q′≥0, demands q′≥0\boldsymbol q'\ge\mathbf 0q′≥0) has the same set of feasible route sets.

Significance

Theorem 5 makes the worst-case value-at-risk over (12) computable in polynomial time as the value of a nonsmooth convex problem over the nonnegative orthant, which the paper notes can be written as a linear program. This gives the right-hand sides of the rounded capacity inequalities in a branch-and-cut scheme for the distributionally robust CVRP. Corollaries 2 and 3 give closed forms for two structured families of groups, evaluable in time linear in ∣S∣|S|∣S∣. Theorem 4 shows the gain in modelling power has a cost: unlike the marginal case, the problem cannot in general be replaced by a deterministic CVRP with altered demands. With a single customer and S1={1}S_1=\{1\}S1​={1}, Theorem 5 reduces to the closed form μ+min⁡{q^,ν/(2ϵ)}\mu+\min\{\hat q,\nu/(2\epsilon)\}μ+min{q^​,ν/(2ϵ)} for marginalized first-order sets, so it extends that single-customer formula to joint dispersion constraints.

All four results are proved in the paper's online supplement. As far as a platform search shows, none has been machine-checked. The mission produces checked proofs of the equality in Theorem 5, the two closed forms, and an explicit instance for Theorem 4.

Difficulty

The supremum ranges over an infinite-dimensional set of joint distributions, and the value-at-risk is neither convex nor concave in the distribution. Bounding the value-at-risk of each group separately and adding the bounds does not work when groups overlap, and it ignores the total-dispersion constraint. It gives only an upper bound, and in the setting of Corollary 2 that bound is strict whenever the total bound νp/(2ϵ)\nu_p/(2\epsilon)νp​/(2ϵ) is the binding term. Showing that the infimum in (13) is attained in the limit needs distributions that saturate several overlapping dispersion constraints at once while keeping the mean fixed and the support inside the box. For Theorem 4, the witness must separate the feasible-route-set family of the robust instance from every family defined by a single linear capacity inequality with nonnegative weights.

Formalization scope

Customers are Fin n (0-based), subsets are Sfam : Fin p → Finset (Fin n), and a distribution is a Measure (Fin n → ℝ) that is required to be a probability measure. Support is P (Set.Icc qlo qhi) = 1, the mean condition is ∫ q, q j ∂P = μ j, and the dispersion condition is ∫ q, ∑ j ∈ Sfam l, |q j - μ j| ∂P ≤ ν l. The integrability clauses stated alongside are automatic for measures carried by the box. The value-at-risk is the published MultistageStochastic.valueAtRisk P Y (1 - ε). The worst-case value-at-risk is the real sSup of its image over the set; under the standing assumptions this image is nonempty (the Dirac at μ\boldsymbol\muμ lies in the set) and bounded (bounded support), so the real supremum is the paper's. The optimal value of (13) is the real sInf of the objective over {γ≥0}\{\boldsymbol\gamma\ge\mathbf 0\}{γ≥0}, a nonempty set on which the objective is bounded below by 1S⊤μ\mathbf 1_S^\top\boldsymbol\mu1S⊤​μ. Attainment is not claimed. All statements carry the standing assumptions q‾≥0\underline{\boldsymbol q}\ge\mathbf 0q​≥0, q‾<μ<q‾\underline{\boldsymbol q}<\boldsymbol\mu<\overline{\boldsymbol q}q​<μ<q​, ν>0\boldsymbol\nu>\mathbf 0ν>0 and 0<ϵ<10<\epsilon<10<ϵ<1. Corollary 2 writes p=r+1p=r+1p=r+1 with the last subset Sfam (Fin.last r). Corollary 3 indexes the singleton of customer iii by Fin.castSucc i. In Theorem 4 route sets are Fin m → List (Fin n) and only feasibility is modelled; costs play no role.

The theorems are not trivialized by an empty ambiguity set or a junk supremum: membership of the Dirac distribution at μ\boldsymbol\muμ is checked locally with a sorry-free proof. Theorem 4 needs a genuinely separating instance: an instance in which no route set is robustly feasible, for example, is matched by a deterministic instance in which none is feasible either.

Needed infrastructure: two-point and finitely supported distributions on Rn\mathbb R^nRn and their value-at-risk; weak duality for moment problems over the box; the positive-part calculus of (13). The value-at-risk lemmas for finitely supported measures are reusable in the sibling missions on this paper. Contributions of any of the milestones, of lemmas for these building blocks, or of either inequality of Theorem 5 on its own are welcome.

Selected references

  • S. Ghosal and W. Wiesemann, The Distributionally Robust Chance-Constrained Vehicle Routing Problem, Operations Research 68(3):716–732, 2020. https://doi.org/10.1287/opre.2019.1924
  • G. Casella and R. L. Berger, Statistical Inference, 2nd ed., Duxbury, 2002.
  • S. Boyd and L. Vandenberghe, Convex Optimization, Cambridge University Press, 2004. https://doi.org/10.1017/CBO9780511804441
  • G. Laporte, Y. Nobert and M. Desrochers, Optimal routing under capacity and distance restrictions, Operations Research 33(5):1050–1073, 1985. https://doi.org/10.1287/opre.33.5.1050
8 thms3 active usersReviewed
🏆Completed
CombinatoricsOperations ResearchOptimization·Captain: Shuze Chen

Discrete Convex Analysis XII: Steepest Descent for M-Convex Function MinimizationTextbook

Motivation

Chapters 6 through 9 characterized minimality for M-convex functions structurally (the M-optimality criterion, Theorem 6.26: a point is a global minimizer iff no local swap improves it) without saying how to find one. Chapter 10 turns that structural fact into an algorithm: the local characterization is the termination test of the simplest possible minimization procedure, steepest descent by coordinate swaps. This mission formalizes that algorithm and its two complexity bounds, plus a structural min-max identity for submodular base polyhedra that the chapter's heavier submodular-minimization algorithms build on. It is the first mission in this series whose goal names a method, not just a property of a class of functions — formalizing it faithfully means giving the algorithm itself a Lean representation that the complexity theorem then quantifies over, not just describing its output.

Setting

Let f:ZV→R∪{+∞}f : \mathbb Z^V \to \mathbb R \cup \{+\infty\}f:ZV→R∪{+∞} be an M-convex function (MExchangeAxiom, chunk 06), n=∣V∣n = |V|n=∣V∣. The steepest descent algorithm repeatedly replaces the current point xxx by x−χu+χvx - \chi_u + \chi_vx−χu​+χv​ for a pair u≠vu \ne vu=v minimizing f(x−χu+χv)f(x - \chi_u + \chi_v)f(x−χu​+χv​), stopping when no such swap improves on f(x)f(x)f(x) — at which point, by the M-optimality criterion, xxx is a global minimizer. This mission represents a run of the algorithm as a sequence x:N→ZVx : \mathbb N \to \mathbb Z^Vx:N→ZV satisfying these step and termination relations directly, so that "the number of iterations" is a genuine property of any such run, not an informal gloss. Separately, for a submodular set function ρ:2V→R\rho : 2^V \to \mathbb Rρ:2V→R (chunk 04's SubmodularSetFunction), the base polyhedron B(ρ)B(\rho)B(ρ) (chunk 04's BasePolyhedron) is the polytope {x∈RV:x(X)≤ρ(X) ∀X, x(V)=ρ(V)}\{x \in \mathbb R^V : x(X) \le \rho(X)\ \forall X,\ x(V) = \rho(V)\}{x∈RV:x(X)≤ρ(X) ∀X, x(V)=ρ(V)}.

Formalization targets

Goal: Proposition 10.2 (iteration bound with tie-breaking)

For an M-convex function fff with finite ℓ1\ell^1ℓ1-diameter K1=max⁡{∥x−y∥1:x,y∈dom⁡f}K_1 = \max\{\|x-y\|_1 : x,y \in \operatorname{dom} f\}K1​=max{∥x−y∥1​:x,y∈domf} (Eq. (10.1)), the number of iterations in the steepest descent algorithm using the tie-breaking rule (10.2) — a fixed lexicographic rule for choosing among tied steepest pairs, based on an arbitrary but fixed ordering φ\varphiφ of VVV — is bounded by K1/2K_1/2K1​/2.

Milestones: Proposition 10.1, Proposition 10.8

Proposition 10.1: an unconditional warm-up — if fff has a unique minimizer x∗x^*x∗, any run of the plain (untied) algorithm from x0x^0x0 terminates within ∥x0−x∗∥1/2\|x^0 - x^*\|_1/2∥x0−x∗∥1​/2 iterations, with no tie-breaking rule needed. Proposition 10.8: a structural min-max identity, max⁡{x−(V):x∈B(ρ)}=min⁡{ρ(X):X⊆V}\max\{x^-(V) : x \in B(\rho)\} = \min\{\rho(X) : X \subseteq V\}max{x−(V):x∈B(ρ)}=min{ρ(X):X⊆V}, for a submodular set function ρ\rhoρ — chosen deliberately as a milestone that names no algorithm at all, in contrast to this mission's other two items.

Significance

The result itself. Proposition 10.2 is the complexity backbone of §10.1: it is what turns "steepest descent terminates" (an easy monotonicity observation) into a genuine polynomial bound, and it is the base case the chapter's more elaborate scaling and domain-reduction algorithms (not drafted here) improve on. Proposition 10.8, though algorithm-free, is the structural fact ("verifying membership in B(ρ)B(\rho)B(ρ) seems to need a submodular minimization procedure — but demonstrating optimality of a cut XXX only needs a base with x−(V)=ρ(X)x^-(V) = \rho(X)x−(V)=ρ(X)") that makes Schrijver's and the IFF algorithms' correctness proofs possible, and specializes chunk 04's Edmonds's intersection theorem to the two-function case ρ1=ρ,ρ2=0\rho_1 = \rho, \rho_2 = 0ρ1​=ρ,ρ2​=0.

Formalizing it. A prior-art search (q=steepest descent, q=submodular minimization, q=base polyhedron) found no existing platform items for any of this chapter's results. This mission gives the first formal statement of an M-convex minimization algorithm's complexity, and directly reuses chunk 06's MExchangeAxiom/ArgMin/CharVec/DomZ and chunk 04's SubmodularSetFunction/BasePolyhedron — genuine cross-chunk substrate reuse spanning two different chapters' worth of prior missions.

Difficulty

The chapter's own framing (quoted in BRIEF.md) is that every other chapter's theorems state a property of a class of functions or sets, while this chapter's theorems state properties of a named algorithm run on such an object. Formalizing "the number of iterations in the steepest descent algorithm is bounded by ..." faithfully means giving the algorithm's steps (S0-S3) and termination test a Lean representation that the bound then quantifies over — stating the bound about "the minimizer" alone, with the algorithm silently dropped, would misrepresent the theorem as a fact about minimizers rather than about a procedure that finds one. This mission represents a run of the algorithm as an abstract sequence satisfying the book's own step-transition relations (documented in full in MODERATION_NOTES.md), letting the complexity theorems quantify over any valid run rather than committing to one executable implementation.

A second difficulty is scope: the chapter's recommended primary goal, Proposition 10.18 (Schrijver's algorithm's complexity), needs a scaling procedure with several auxiliary data structures — a materially larger definitional undertaking than steepest descent's simple greedy-swap loop. Per BRIEF.md's own explicit fallback authorization, this mission takes Proposition 10.2 as its goal instead; see HARD.md and MODERATION_NOTES.md for the full reasoning.

Formalization scope

Runs of the algorithm are represented as x : ℕ → V → ℤ satisfying IsSteepestDescentRun (plain) or IsSteepestDescentRunTieBreak (with the tie-breaking rule) — a step relation plus a termination test, with an explicit iteration count N the theorems bound. The tie-breaking key Φ(u,v)\Phi(u,v)Φ(u,v) (Eq. (10.2)) and its lexicographic order are formalized directly (a manual three-way comparison, not Mathlib's default componentwise Prod order). Both iteration bounds are stated as 2 * N ≤ k rather than N ≤ k / 2, avoiding natural-number division. Not drafted: the derived "hence ... in O(F⋅n2K1)O(F \cdot n^2 K_1)O(F⋅n2K1​) time" corollary of Proposition 10.2 (needs a cost-model primitive for "time" and "FFF" this mission does not otherwise use — the iteration-count bound itself, this proposition's genuine combinatorial content, is drafted in full); Schrijver's algorithm and everything in §10.2.2 onward; the steepest descent scaling algorithm, the domain reduction algorithm and its scaling variant (§10.1.2-10.1.3, structurally different algorithms); the quasi-M-convex extension mentioned immediately after Proposition 10.2. A trivializing formalization would state the iteration bound as an unconditional fact about "a" minimizer-finding procedure, or would drop the tie-breaking rule from Proposition 10.2 and thereby understate what the bound actually requires; neither is done.

Selected references

  • K. Murota, Discrete Convex Analysis, SIAM, 2003. DOI: 10.1137/1.9780898718508.
16 thms2 active usersReviewed
🏆Completed
Convex OptimizationOperations ResearchOptimization+1·Captain: mikedeng1

The Distributionally Robust Chance-Constrained Vehicle Routing Problem V: Worst-Case Value-at-Risk over Covariance Ambiguity Sets as a Quadratically Constrained ProgramResearch Paper

Motivation

In the capacitated vehicle routing problem (CVRP) a fleet of mmm vehicles of capacity QQQ leaves a depot and serves nnn customers; every customer is visited once, and the load of each route must not exceed QQQ. In practice customer demands are uncertain at planning time. The chance-constrained CVRP asks that each route respect the capacity with probability at least 1−ϵ1-\epsilon1−ϵ, but this presupposes a known demand distribution, which is rarely available. Ghosal and Wiesemann (Oper. Res. 68(3), 2020) require the chance constraints to hold for every distribution in an ambiguity set P\mathcal PP built from the information that can actually be estimated: support, means and dispersion bounds.

Their branch-and-cut method separates rounded capacity inequalities whose right-hand side is the worst-case value-at-risk of the total demand of a customer set SSS. This quantity is evaluated thousands of times during the search, so it matters whether it has a closed form or a small convex reformulation. This mission concerns the paper's covariance ambiguity sets (§5.2), which bound the whole covariance matrix of the demands and can therefore express that demands of nearby customers are correlated, as happens with geographically clustered demand. The covariance bound can be derived from data, for example analytically through McDiarmid's inequality (Delage and Ye, 2010) or by bootstrapping.

Setting

Customers are indexed by i∈{1,…,n}i\in\{1,\dots,n\}i∈{1,…,n} and their random demand vector is q~∈Rn\tilde{\boldsymbol q}\in\mathbb R^nq~​∈Rn. Fix a box Q=[q‾,q‾]\mathcal Q=[\underline{\boldsymbol q},\overline{\boldsymbol q}]Q=[q​,q​] with q‾≥0\underline{\boldsymbol q}\ge\mathbf 0q​≥0, a mean vector μ\boldsymbol\muμ in the interior of Q\mathcal QQ, and a symmetric positive definite matrix Σ≻0\Sigma\succ0Σ≻0. The covariance ambiguity set is

P={P∈P0(Rn): P[q~∈Q]=1, EP[q~]=μ, EP[(q~−μ)(q~−μ)⊤]⪯Σ},(16)\mathcal P=\Big\{\mathbb P\in\mathcal P_0(\mathbb R^n):\ \mathbb P[\tilde{\boldsymbol q}\in\mathcal Q]=1,\ \mathbb E_{\mathbb P}[\tilde{\boldsymbol q}]=\boldsymbol\mu,\ \mathbb E_{\mathbb P}\big[(\tilde{\boldsymbol q}-\boldsymbol\mu)(\tilde{\boldsymbol q}-\boldsymbol\mu)^\top\big]\preceq\Sigma\Big\},\tag{16}P={P∈P0​(Rn): P[q~​∈Q]=1, EP​[q~​]=μ, EP​[(q~​−μ)(q~​−μ)⊤]⪯Σ},(16)

where P0(Rn)\mathcal P_0(\mathbb R^n)P0​(Rn) is the set of all probability distributions on Rn\mathbb R^nRn and A⪯ΣA\preceq\SigmaA⪯Σ means that Σ−A\Sigma-AΣ−A is positive semidefinite.

For a distribution P\mathbb PP and a real random variable X~\tilde XX~, the value-at-risk at level 1−ϵ1-\epsilon1−ϵ, ϵ∈(0,1)\epsilon\in(0,1)ϵ∈(0,1), is P-VaR1−ϵ[X~]=inf⁡{x∈R:P[X~≤x]≥1−ϵ}\mathbb P\text{-VaR}_{1-\epsilon}[\tilde X]=\inf\{x\in\mathbb R:\mathbb P[\tilde X\le x]\ge1-\epsilon\}P-VaR1−ϵ​[X~]=inf{x∈R:P[X~≤x]≥1−ϵ}. For a customer set SSS, the worst-case value-at-risk is sup⁡P∈PP-VaR1−ϵ[∑i∈Sq~i]\sup_{\mathbb P\in\mathcal P}\mathbb P\text{-VaR}_{1-\epsilon}[\sum_{i\in S}\tilde q_i]supP∈P​P-VaR1−ϵ​[∑i∈S​q~​i​]. A route serving SSS satisfies the chance constraint for every P∈P\mathbb P\in\mathcal PP∈P exactly when this number is at most QQQ.

Two componentwise bounds appear in the answer:

qℓ=max⁡{−1−ϵϵ(q‾−μ), q‾−μ},qu=min⁡{1−ϵϵ(μ−q‾), q‾−μ}.\boldsymbol q^\ell=\max\Big\{-\tfrac{1-\epsilon}{\epsilon}(\overline{\boldsymbol q}-\boldsymbol\mu),\ \underline{\boldsymbol q}-\boldsymbol\mu\Big\},\qquad\boldsymbol q^u=\min\Big\{\tfrac{1-\epsilon}{\epsilon}(\boldsymbol\mu-\underline{\boldsymbol q}),\ \overline{\boldsymbol q}-\boldsymbol\mu\Big\}.qℓ=max{−ϵ1−ϵ​(q​−μ), q​−μ},qu=min{ϵ1−ϵ​(μ−q​), q​−μ}.

A route set is an ordered partition of the customers into mmm nonempty ordered routes. It is feasible in the distributionally robust problem RVRP(P\mathcal PP) if every route satisfies the chance constraint for every P∈P\mathbb P\in\mathcal PP∈P, and feasible in a deterministic instance with capacity Q′Q'Q′ and demands q\boldsymbol qq if every route's total demand is at most Q′Q'Q′.

Formalization targets

Goal: Theorem 7

For every customer set SSS,

sup⁡P∈PP-VaR1−ϵ[∑i∈Sq~i]=max⁡{1S⊤μ+1S⊤q: q⊤Σ−1q≤1−ϵϵ, q∈[qℓ,qu]}.(17)\sup_{\mathbb P\in\mathcal P}\mathbb P\text{-VaR}_{1-\epsilon}\Big[\sum_{i\in S}\tilde q_i\Big]=\max\Big\{\mathbf 1_S^\top\boldsymbol\mu+\mathbf 1_S^\top\boldsymbol q:\ \boldsymbol q^\top\Sigma^{-1}\boldsymbol q\le\tfrac{1-\epsilon}{\epsilon},\ \boldsymbol q\in[\boldsymbol q^\ell,\boldsymbol q^u]\Big\}.\tag{17}P∈Psup​P-VaR1−ϵ​[i∈S∑​q~​i​]=max{1S⊤​μ+1S⊤​q: q⊤Σ−1q≤ϵ1−ϵ​, q∈[qℓ,qu]}.(17)

The right-hand side maximizes an affine function over the intersection of an ellipsoid and a box.

Milestone: Corollary 4 (corrected)

For a diagonal bound Σ=diag⁡(σ12,…,σn2)\Sigma=\operatorname{diag}(\sigma_1^2,\dots,\sigma_n^2)Σ=diag(σ12​,…,σn2​), program (17) collapses to a search over one parameter θ≥0\theta\ge0θ≥0 with S(θ)={i∈S:σi2>θqiu}S(\theta)=\{i\in S:\sigma_i^2>\theta q^u_i\}S(θ)={i∈S:σi2​>θqiu​}:

sup⁡θ 1S⊤μ+∑i∈S(θ)qiu+[1−ϵϵ−∑i∈S(θ)(qiuσi)2][∑i∈S∖S(θ)σi2],(18)\sup_{\theta}\ \mathbf 1_S^\top\boldsymbol\mu+\sum_{i\in S(\theta)}q^u_i+\sqrt{\Big[\tfrac{1-\epsilon}{\epsilon}-\sum_{i\in S(\theta)}\big(\tfrac{q^u_i}{\sigma_i}\big)^2\Big]\Big[\sum_{i\in S\setminus S(\theta)}\sigma_i^2\Big]},\tag{18}θsup​ 1S⊤​μ+i∈S(θ)∑​qiu​+[ϵ1−ϵ​−i∈S(θ)∑​(σi​qiu​​)2][i∈S∖S(θ)∑​σi2​]​,(18)

over the θ\thetaθ for which the first bracket is nonnegative and the point of (17) that θ\thetaθ induces respects qu\boldsymbol q^uqu (see Formalization scope).

Milestone: Theorem 6

For some instance with the ambiguity set (16), no deterministic CVRP instance on the same customers and fleet has the same set of feasible route sets.

Significance

Theorem 7 makes the worst-case value-at-risk over (16) computable in polynomial time as a convex quadratically constrained program. With it, the rounded capacity inequalities of the two-index vehicle flow formulation can be separated for covariance information. Theorem 2 of the same paper shows that the resulting demand estimator is subadditive, so this formulation is exact. Corollary 4 gives a closed form for the diagonal case, which the paper uses to evaluate the estimator in time linear in ∣S∣|S|∣S∣ after sorting. Theorem 6 explains why the paper needs this machinery: the robust feasible region cannot be reproduced by any deterministic demand vector and capacity.

The results are proved in the paper's online supplement. No part of them is formalized anywhere to our knowledge; the platform has no worst-case value-at-risk and no moment-based ambiguity set. A complete development would give machine-checked worst-case VaR bounds over moment sets with second-order information. These are used well beyond routing, in distributionally robust portfolio and inventory models.

Difficulty

The supremum ranges over an infinite-dimensional set of distributions, while (17) ranges over vectors. The inequality "≥\ge≥" requires, for every feasible q\boldsymbol qq of (17), a sequence of distributions in (16) whose value-at-risk approaches 1S⊤(μ+q)\mathbf 1_S^\top(\boldsymbol\mu+\boldsymbol q)1S⊤​(μ+q). The value-at-risk is a lower quantile, so a distribution placing mass exactly ϵ\epsilonϵ on a high point does not attain the value: the construction has to be a limit. The inequality "≤\le≤" is harder. It must rule out every distribution, not only two-point ones, and a bound through the one-dimensional Chebyshev–Cantelli inequality for ∑i∈Sq~i\sum_{i\in S}\tilde q_i∑i∈S​q~​i​ alone ignores the box: it yields 1−ϵϵ1S⊤Σ1S\sqrt{\frac{1-\epsilon}{\epsilon}\mathbf 1_S^\top\Sigma\mathbf 1_S}ϵ1−ϵ​1S⊤​Σ1S​​, which is too large whenever the support bounds bind. The interaction between the Loewner constraint and the componentwise support bounds, which produces the unusual bound qℓ\boldsymbol q^\ellqℓ, is where the work lies. For Theorem 6 the difficulty is to exhibit the instance and to evaluate enough chance constraints exactly.

Formalization scope

Customers are Fin n (0-based) and demand vectors are Fin n → ℝ. Distributions are measures on Fin n → ℝ. The set (16) is covarianceSet qlo qhi μ Sig: a probability measure with P (Set.Icc qlo qhi) = 1, coordinate means μ, and Sig - M positive semidefinite, where M is the matrix of integrals ∫(qi−μi)(qj−μj) dP\int(q_i-\mu_i)(q_j-\mu_j)\,d\mathbb P∫(qi​−μi​)(qj​−μj​)dP. The covariance bound is called Sig because Σ is Lean syntax. The side conditions q‾≥0\underline{\boldsymbol q}\ge\mathbf 0q​≥0, μ∈int⁡Q\boldsymbol\mu\in\operatorname{int}\mathcal Qμ∈intQ, Σ≻0\Sigma\succ0Σ≻0 (Sig.PosDef) and 0<ϵ<10<\epsilon<10<ϵ<1 are hypotheses of every theorem. The value-at-risk is the published MultistageStochastic.valueAtRisk P Y (1 - ε). The worst-case value-at-risk is a real sSup over the image of the set. That image is nonempty (the Dirac measure at μ\boldsymbol\muμ lies in (16)) and bounded (the box), so the supremum is genuine. "The optimal objective value" of a maximization is stated as a supremum; attainment is not part of any claim. Σ−1\Sigma^{-1}Σ−1 is Mathlib's matrix inverse.

The paper states Theorem 7 and Corollary 4 with "P\mathbb PP-VaR" without a level; the level 1−ϵ1-\epsilon1−ϵ, used in the sentence introducing Theorem 7 and everywhere else, is read in. Corollary 4 as printed is false. It maximizes over every θ≥0\theta\ge0θ≥0 with a nonnegative bracket. For n=1n=1n=1, every large θ\thetaθ then gives the value μ1+σ1(1−ϵ)/ϵ\mu_1+\sigma_1\sqrt{(1-\epsilon)/\epsilon}μ1​+σ1​(1−ϵ)/ϵ​, which can exceed q‾1\overline q_1q​1​ and hence every value-at-risk. The formal statement adds the condition that makes each θ\thetaθ a feasible point of (17): σi2s(θ)≤qiu∑k∈S∖S(θ)σk2\sigma_i^2\sqrt{s(\theta)}\le q^u_i\sqrt{\sum_{k\in S\setminus S(\theta)}\sigma_k^2}σi2​s(θ)​≤qiu​∑k∈S∖S(θ)​σk2​​ for i∈S∖S(θ)i\in S\setminus S(\theta)i∈S∖S(θ), where s(θ)s(\theta)s(θ) is the first bracket. With this condition the statement is the diagonal case of Theorem 7.

A theorem about the Lean set is trivial if the set is empty or the supremum is a junk value. Neither happens here, and replacing the Loewner constraint by a scalar variance bound on ∑i∈Sq~i\sum_{i\in S}\tilde q_i∑i∈S​q~​i​ would state a different theorem. The dual second-order cone program printed after Theorem 7 is not a target: as printed it has the all-ones vector where Lagrangian duality gives 1S\mathbf 1_S1S​, and it has no multiplier for q≥qℓ\boldsymbol q\ge\boldsymbol q^\ellq≥qℓ.

Needed infrastructure: quantiles of pushforward measures, the Loewner order on moment matrices, and finite-support (two-point) distributions. The value-at-risk lemmas and the moment-matrix lemmas are reusable beyond this mission, and contributions of either kind are welcome. Theorem 6 needs only the route-set layer defined here and one explicit instance.

Selected references

  • S. Ghosal and W. Wiesemann, The Distributionally Robust Chance-Constrained Vehicle Routing Problem, Operations Research 68(3):716–732, 2020. https://doi.org/10.1287/opre.2019.1924
  • E. Delage and Y. Ye, Distributionally Robust Optimization Under Moment Uncertainty with Application to Data-Driven Problems, Operations Research 58(3):595–612, 2010. https://doi.org/10.1287/opre.1090.0741
  • S. Boyd and L. Vandenberghe, Convex Optimization, Cambridge University Press, 2004. https://doi.org/10.1017/CBO9780511804441
  • G. Laporte, Y. Nobert and M. Desrochers, Optimal Routing under Capacity and Distance Restrictions, Operations Research 33(5):1050–1073, 1985. https://doi.org/10.1287/opre.33.5.1050
7 thms3 active usersReviewed
🏆Completed
Convex OptimizationDiscrete GeometryOperations Research+1·Captain: Shuze Chen

Discrete Convex Analysis XXXIII: Near-Optimality for Submodular MinimizationTextbook

Motivation

Chapter 10 turns from structure theory to algorithms: efficient methods for minimizing M-convex functions (via domain reduction) and submodular set functions (via Schrijver's and the Iwata-Fleischer-Fujishige scaling algorithms). Most of chapter 10's numbered results are asymptotic running-time bounds for specific procedural algorithms — a genuinely different kind of claim from the rest of this book (see Formalization scope). This mission places the results of this block that ARE ordinary mathematical propositions: correctness certificates, min-max theorems, and structural facts the algorithms rely on and produce.

Setting

For an M-convex set B ⊆ Z^V, the central part B° (the vectors of B lying away from its boundary, defined via per-coordinate bounds ℓ°_B, u°_B) is what the domain reduction algorithm searches from. For a submodular set function ρ : 2^V → R, the base polyhedron B(ρ) and its extreme bases (one per linear ordering of V, via Eq. (10.12)) let any base be written as a convex combination of finitely many extreme bases (Eq. (10.13)); a candidate minimizer W is certified via the linear orderings representing an optimal base. The Iwata-Fleischer-Fujishige (IFF) scaling algorithm relaxes this problem with a flow-augmentation parameter δ, maintaining a δ-feasible flow φ and vector z = x + ∂φ; near the end of a scaling phase, no augmenting path and no "active triple" together certify near-optimality.

Formalization targets

Goal: Near-optimality from the absence of augmenting paths (Proposition 10.20)

If S ⊆ W ⊆ V∖T, no arc of the auxiliary network leaves W, and no active triple exists, then z⁻(V) ≥ ρ(W)-nδ and x⁻(V) ≥ ρ(W)-n²δ; moreover W exactly minimizes ρ once δ is small enough relative to the smallest positive gap between two values of ρ. Chosen as goal: the book calls this "a key property of the scaling algorithm" and "a relaxation version of the min-max relation in Proposition 10.8", its own proof is the most substantial argument among this chunk's placed results, and Proposition 10.23 is a direct corollary of it.

Supporting structural targets

Proposition 10.8 is the min-max relation underlying the whole of section 10.2 (an Edmonds- intersection-theorem consequence, found by direct reading — the extractor's table missed it). Proposition 10.9 gives the three-part sufficient condition for optimality, in terms of the linear orderings representing an optimal base, that both Schrijver's algorithm and the IFF algorithm use as their termination criterion (also found by direct reading). Propositions 10.5-10.6 establish that the domain reduction algorithm's central part B° is always nonempty, via an explicit vector-extension step (Proposition 10.5 likewise missing from the extractor's table). Proposition 10.23 fixes individual coordinates once a scaling phase ends, and Proposition 10.24 gives the termination certificate for the IFF fixing algorithm's own separate graph-contraction procedure.

Significance

Chapter 10 is where this book cashes out its structure theory as algorithms with provable running times, and this mission places every result of that chapter's first two sections that is a mathematical proposition rather than a runtime bound: two min-max/optimality-certificate theorems (10.8-10.9) that are the combinatorial core making the following two strongly polynomial algorithms (Schrijver's, and Iwata-Fleischer-Fujishige's) correct, one central-part nonemptiness fact (10.5-10.6) underlying the domain reduction algorithm, and the two fixing/termination certificates (10.23-10.24) that let the scaling algorithms actually output a minimizer with a proof of optimality attached, not just a numerical answer.

None of these results are open — they are Murota's own account of submodular-function- minimization algorithms (sections 10.1-10.2). What this mission contributes is a faithful, machine-checked formal statement of each, including two results (Propositions 10.5 and 10.8) the platform's own automated extractor missed; no comparable formalization exists on the platform (see Formalization scope).

Difficulty

Six numbered results in this block (Propositions 10.4, 10.7, 10.17, 10.18, 10.21, 10.22) are excluded as hard: each states a Big-O asymptotic bound on the running time, function-evaluation count, or internal-procedure-call count of a specific iterative algorithm (the domain reduction algorithm, its scaling variant, Schrijver's algorithm, the IFF scaling algorithm). Faithfully stating "this algorithm runs in O(g(n)) time" requires a cost-tracked operational semantics for that specific algorithm — a well-founded recursive procedure with an oracle for evaluating the input function, threading a step/evaluation counter, instantiated over an unbounded family of ground-set sizes n and numeric parameters (K∞, M) — which is a fundamentally different kind of formalization task (computational complexity theory) from every one of the roughly 280 other numbered results in this book, none of which require modeling the cost of computing them. See HARD.md.

Formalization scope

Ground-set elements are a Fintype V with DecidableEq. Base M-convex-set vocabulary is redeclared from prior missions. Linear orderings of V are represented as bijections V ≃ Fin (Fintype.card V) rather than as lists, matching this series' established preference for order-indexed families over sequential data structures. Proposition 10.5's witness vector is stated as an existence claim (the mathematical content of the proposition), rather than by reconstructing the specific recursive modification procedure the book uses to produce it — a choice consistent with how this series has always formalized "the algorithm produces X" claims where X is a mathematical property, by asserting X's existence rather than executing the algorithm (see, e.g., mission 33-ch09c-networkflows's cycle-cancellation theorem). Six numbered results (Propositions 10.4, 10.7, 10.17, 10.18, 10.21, 10.22) are hard; see HARD.md. Contributions completing any of the seven sorrys are welcome; the goal and Proposition 10.9 carry the most independent proof content.

Selected references

  • K. Murota, Discrete Convex Analysis, SIAM, 2003. DOI: 10.1137/1.9780898718508.
  • S. Iwata, L. Fleischer, and S. Fujishige, "A combinatorial strongly polynomial algorithm for minimizing submodular functions," Journal of the ACM, 48 (2001), pp. 761-777 [102] (the IFF scaling algorithm this mission's Proposition 10.20 certifies).
  • A. Schrijver, "A combinatorial algorithm minimizing submodular functions in strongly polynomial time," Journal of Combinatorial Theory, Series B, 80 (2000), pp. 346-355 [182] (Schrijver's algorithm, whose termination criterion is Proposition 10.9).
41 thms2 active usersReviewed
🏆Completed
Linear OptimizationOperations ResearchOptimization+1·Captain: mikedeng1

Single Machine Scheduling with Release Dates I: The Preemptive Time-Indexed and Mean Busy Time LP Relaxations Have the Same Optimal ValueResearch Paper

Motivation

Minimizing the total weighted completion time ∑jwjCj\sum_j w_j C_j∑j​wj​Cj​ of jobs with release dates on a single machine, written 1 ∣ rj ∣ ∑wjCj1\,|\,r_j\,|\,\sum w_j C_j1∣rj​∣∑wj​Cj​ in scheduling notation, is strongly NP-hard. Most constant-factor approximation algorithms for it, and for many related scheduling problems, follow one pattern: solve a linear programming relaxation, which gives a lower bound on the optimum, and round its solution into a schedule whose cost is compared with that bound. The quality of the algorithm is therefore limited by the quality of the relaxation, and the question of which relaxations are equivalent is a basic one for the method.

Two relaxations of 1 ∣ rj ∣ ∑wjCj1\,|\,r_j\,|\,\sum w_j C_j1∣rj​∣∑wj​Cj​ are central. The time-indexed relaxation of Dyer and Wolsey (doi:10.1016/0166-218X(90)90104-K) has one variable per job and unit time slot, a pseudopolynomial number of variables. The mean busy time relaxation has one variable per job but one constraint per subset of jobs, the shifted parallel inequalities studied by Queyranne and others. Goemans, Queyranne, Schulz, Skutella and Wang (doi:10.1137/S089548019936223X, Section 2) show that both have the same optimal value, and that both are solved by one simple preemptive schedule. This mission formalizes that result, Corollary 2.6, together with the lemmas and theorems its proof uses.

Timeline:

  • 1990: Dyer and Wolsey formulate several time-indexed relaxations of 1 ∣ rj ∣ ∑wjCj1\,|\,r_j\,|\,\sum w_j C_j1∣rj​∣∑wj​Cj​, among them the formulation (D) used here.
  • 1993: Queyranne (doi:10.1007/BF01581271) describes the polyhedron of completion-time vectors on one machine without release dates by the parallel inequalities.
  • 1994–1995: Queyranne and Schulz use shifted parallel inequalities in polyhedral approaches to machine scheduling with release dates.
  • 1996: Goemans (IPCO, LNCS 1084) gives a supermodular relaxation for scheduling with release dates, the source of the canonical decompositions used for (R).
  • 2002: Goemans, Queyranne, Schulz, Skutella and Wang prove that (D) and the mean busy time relaxation (R) have equal value, attained by the preemptive "LP schedule", and use this common bound for randomized approximation algorithms with ratios 1.74511.74511.7451 and 1.68531.68531.6853.

Setting

There are nnn jobs N={1,…,n}N = \{1, \dots, n\}N={1,…,n}. Job jjj has an integral processing time pj>0p_j > 0pj​>0, an integral release date rj≥0r_j \ge 0rj​≥0 and a weight wj≥0w_j \ge 0wj​≥0. For a nonempty set SSS of jobs, p(S)=∑j∈Spjp(S) = \sum_{j\in S} p_jp(S)=∑j∈S​pj​ and rmin⁡(S)=min⁡j∈Srjr_{\min}(S) = \min_{j \in S} r_jrmin​(S)=minj∈S​rj​.

A preemptive schedule gives each job a bounded measurable set Aj⊆[rj,∞)A_j \subseteq [r_j, \infty)Aj​⊆[rj​,∞) of processing times of Lebesgue measure pjp_jpj​, the sets pairwise disjoint. The mean busy time of jjj is Mj=1pj∫Ajt dtM_j = \frac{1}{p_j}\int_{A_j} t\,dtMj​=pj​1​∫Aj​​tdt.

The LP schedule processes, at every moment, the available (released, unfinished) job of largest ratio wj/pjw_j/p_jwj​/pj​, ties broken by index. With the jobs indexed so that w1/p1≥⋯≥wn/pnw_1/p_1 \ge \cdots \ge w_n/p_nw1​/p1​≥⋯≥wn​/pn​, this is the available job of smallest index. As the data are integral, it runs one job or none in each unit slot [τ,τ+1)[\tau, \tau+1)[τ,τ+1); yjτLP∈{0,1}y^{LP}_{j\tau} \in \{0,1\}yjτLP​∈{0,1} records whether it runs jjj there, and MjLPM^{LP}_jMjLP​ is its mean busy time of jjj.

The preemptive time-indexed relaxation (D) with horizon TTT has real variables yjτ≥0y_{j\tau} \ge 0yjτ​≥0 for τ=rj,…,T−1\tau = r_j, \dots, T-1τ=rj​,…,T−1 and reads

ZD=min⁡∑jwjCjs.t.∑j:rj≤τyjτ≤1 (τ<T),∑τ=rjT−1yjτ=pj,Cj=12pj+1pj∑τ=rjT−1(τ+12)yjτ.Z_D = \min \sum_j w_j C_j \quad\text{s.t.}\quad \sum_{j : r_j \le \tau} y_{j\tau} \le 1\ (\tau < T), \qquad \sum_{\tau=r_j}^{T-1} y_{j\tau} = p_j, \qquad C_j = \tfrac12 p_j + \tfrac{1}{p_j}\sum_{\tau=r_j}^{T-1}\big(\tau + \tfrac12\big) y_{j\tau}.ZD​=minj∑​wj​Cj​s.t.j:rj​≤τ∑​yjτ​≤1 (τ<T),τ=rj​∑T−1​yjτ​=pj​,Cj​=21​pj​+pj​1​τ=rj​∑T−1​(τ+21​)yjτ​.

The mean busy time relaxation (R) reads

ZR=min⁡∑jwj(Mj+12pj)s.t.∑j∈SpjMj≥p(S)(rmin⁡(S)+12p(S))(∅≠S⊆N).Z_R = \min \sum_j w_j\big(M_j + \tfrac12 p_j\big) \quad\text{s.t.}\quad \sum_{j\in S} p_j M_j \ge p(S)\big(r_{\min}(S) + \tfrac12 p(S)\big) \quad (\emptyset \ne S \subseteq N).ZR​=minj∑​wj​(Mj​+21​pj​)s.t.j∈S∑​pj​Mj​≥p(S)(rmin​(S)+21​p(S))(∅=S⊆N).

The horizon TTT is required to bound the makespan of some feasible nonpreemptive schedule, for instance T=max⁡jrj+∑jpjT = \max_j r_j + \sum_j p_jT=maxj​rj​+∑j​pj​.

Formalization targets

Goal: Corollary 2.6

For every instance, every weight vector w≥0w \ge 0w≥0 and every admissible horizon TTT,

ZD=ZR.Z_D = Z_R .ZD​=ZR​.

No ordering of the jobs and no reference to the LP schedule appear in the goal.

Milestones

  1. Lemma 2.1. (D) has an optimal solution with yjτ∈{0,1}y_{j\tau} \in \{0,1\}yjτ​∈{0,1}.
  2. Theorem 2.2. With the jobs sorted by wj/pjw_j/p_jwj​/pj​, yLPy^{LP}yLP is an optimal solution to (D).
  3. Lemma 2.4. For every preemptive schedule and nonempty SSS, ∑j∈SpjMj≥p(S)(rmin⁡(S)+12p(S))\sum_{j\in S} p_j M_j \ge p(S)\big(r_{\min}(S)+\tfrac12 p(S)\big)∑j∈S​pj​Mj​≥p(S)(rmin​(S)+21​p(S)), with equality if and only if SSS occupies [rmin⁡(S),rmin⁡(S)+p(S))[r_{\min}(S), r_{\min}(S)+p(S))[rmin​(S),rmin​(S)+p(S)) without interruption.
  4. Theorem 2.5. With the jobs sorted by wj/pjw_j/p_jwj​/pj​, MLPM^{LP}MLP is an optimal solution to (R).
  5. Eq. (2.6). MjLP=1pj∑τ=rjT−1yjτLP(τ+12)M^{LP}_j = \frac{1}{p_j}\sum_{\tau=r_j}^{T-1} y^{LP}_{j\tau}\big(\tau + \frac12\big)MjLP​=pj​1​∑τ=rj​T−1​yjτLP​(τ+21​).

Significance

The equality ZD=ZRZ_D = Z_RZD​=ZR​ lets one choose, for each purpose, the more convenient of the two relaxations. (D) is intuitive and a transportation problem, but has pseudopolynomially many variables; (R) has nnn variables and a supermodular right-hand side, which the paper uses to describe its polyhedron. Theorems 2.2 and 2.5 show that the common optimum is attained by the LP schedule, which is computable greedily; the approximation guarantees of Section 3 of the paper, and of later work on α\alphaα-point scheduling, are all measured against this value.

A formal development adds three things. First, a machine-checked model of preemptive single-machine schedules with release dates, of mean busy times, and of the LP schedule as a concrete recursive object, reusable by any formalization of α\alphaα-point methods (two companion missions of this series use the same objects). Second, a formal statement of the two relaxations with honest optimal values. Third, verified proofs of results that are proved in the paper by short interchange and averaging arguments, whose measure-theoretic details (integrals over processing sets, null sets in the equality case) the paper leaves implicit. The results are proved in the literature; to our knowledge none of them has been machine-checked.

Difficulty

The paper's arguments are short, and each rests on a step that is informal on the page. Lemma 2.1 cites the integrality of transportation problems, a statement about the vertices of a polytope rather than a one-line fact. Theorem 2.2 ends with the claim that a 0/1 solution admitting no improving exchange "must correspond to the LP schedule", which is a property of the greedy rule that has to be derived from its definition. Theorem 2.5 depends on how the LP schedule arranges the jobs of each prefix {1,…,i}\{1, \dots, i\}{1,…,i} of the sorted order in time; this is the only place sortedness enters, and it is again a property of the concrete schedule. Lemma 2.4 is an extremal statement about integrals over sets of prescribed measure, and its equality case holds only up to null sets. Finally, the goal concerns arbitrary, unsorted weights, while the two theorems it combines are about sorted indices, so the goal is not a direct conjunction of the milestones.

Formalization scope

Jobs are Fin n, numbered from 000; pjp_jpj​, rjr_jrj​ and the horizon TTT are natural numbers and weights are real. A preemptive schedule is a family of processing sets Aj⊆RA_j \subseteq \mathbb RAj​⊆R, not indicator functions. The LP schedule is defined by recursion on unit slots with the smallest-index rule; the sortedness of wj/pjw_j/p_jwj​/pj​ is a hypothesis of Theorems 2.2 and 2.5, not part of the definition. Variables of (D) are functions y:jobs×N→Ry : \text{jobs} \times \mathbb N \to \mathbb Ry:jobs×N→R required to vanish outside rj≤τ<Tr_j \le \tau < Trj​≤τ<T. ZDZ_DZD​ and ZRZ_RZR​ are infima of the objective over the feasible sets; under the stated hypotheses the feasible sets are nonempty and the objectives bounded below, so these are the LP values. Optimality in the milestones is stated as attaining the minimum, not through these infima.

The horizon hypothesis rules out the trivializing case in which (D) is infeasible and its infimum takes the junk value 000; (D) is kept a linear program over real yyy, since restricting to {0,1}\{0,1\}{0,1} would make Lemma 2.1 vacuous. The running-time claim of Corollary 2.6 (O(nlog⁡n)O(n\log n)O(nlogn)) is not formalized.

A complete development needs: integrals of the identity over finite unions of intervals; a rearrangement lemma for sets of given measure; basic properties of the LP schedule (it is a preemptive schedule, it is work-conserving and finishes by any admissible TTT, its blocks are canonical); and a relabelling argument. The schedule model and the LP-schedule lemmas are reusable for the companion missions on α\alphaα-point scheduling. Contributions of any of these lemmas as separate theorems are welcome.

Selected references

  • M. X. Goemans, M. Queyranne, A. S. Schulz, M. Skutella, Y. Wang, Single machine scheduling with release dates, SIAM Journal on Discrete Mathematics 15(2):165–192, 2002. doi:10.1137/S089548019936223X
  • M. E. Dyer, L. A. Wolsey, Formulating the single machine sequencing problem with release dates as a mixed integer program, Discrete Applied Mathematics 26(2–3):255–270, 1990. doi:10.1016/0166-218X(90)90104-K
  • M. Queyranne, Structure of a simple scheduling polyhedron, Mathematical Programming 58:263–285, 1993. doi:10.1007/BF01581271
  • M. X. Goemans, Improved approximation algorithms for scheduling with release dates, Proceedings of the 8th ACM-SIAM Symposium on Discrete Algorithms (SODA), 591–598, 1997.
10 thms2 active usersReviewed
🏆Completed
Convex OptimizationDiscrete GeometryOperations Research+1·Captain: Shuze Chen

Discrete Convex Analysis XXXIV: Conjugate ScalingTextbook

Motivation

This mission continues chapter 10's algorithmic account across its remaining two sections: finishing the Iwata-Fleischer-Fujishige fixing algorithm for submodular minimization (§10.2.3's tail), the steepest descent algorithm for L-convex function minimization (§10.3), and — the capstone of chapter 10's account of the M-convex submodular flow problem (§10.4) — conjugate scaling, the operation that finally makes the primal-dual algorithm run in polynomial time. As in mission 34-ch10b-algorithms, most of this block's numbered results are asymptotic complexity bounds; this mission places the results that are ordinary mathematical propositions.

Setting

The IFF fixing algorithm (mission 34-ch10b-algorithms) builds an acyclic graph D=(U,F) and partition Z,H,Γ certifying the maximal minimizer of a submodular ρ once η≤0 (Eq. (10.26)); this mission places the case-independent inequality its own legitimacy rests on, and restates its correctness conclusion. The steepest descent algorithm for an L-convex function g repeatedly minimizes the submodular set function ρ_p(X)=g(p+χ_X)-g(p) and moves to p+χ_X for its minimal minimizer X (the tie-breaking rule (10.33)); this mission places the resulting monotonicity fact and a domain-size bound for the L♮^\natural♮-convex adaptation. Conjugate scaling replaces a dual-integral M-convex function's conjugate g with g_α(p)=g(αp)/α, defining f⟨α⟩ via the resulting sup-formula (Eq. (10.77)) — a scaling operation compatible with M-convexity where the naive ⌈f(·)/α⌉ is not.

Formalization targets

Goal: Conjugate scaling preserves M-convexity (Proposition 10.41)

For a dual-integral polyhedral M-convex function f (represented as the mixed real-primal/ integer-dual conjugate of an L♮^\natural♮-convex g), the conjugate scaling f⟨α⟩ is again dual-integral M-convex, witnessed by g_α itself being L♮^\natural♮-convex, provided f⟨α⟩>-∞. Chosen as goal: this is the fact the whole conjugate scaling algorithm — chapter 10's final and most refined algorithm for the M-convex submodular flow problem — depends on, and the book's own text singles it out as the "compatible scaling operation" that makes M-convex cost scaling work where a naive approach provably does not.

Supporting structural targets

Proposition 10.26 (the case-independent inequality underlying the IFF fixing algorithm's own legitimacy) and Proposition 10.28 (that algorithm's correctness conclusion) close out mission 34-ch10b-algorithms's coverage of §10.2.3. Proposition 10.30 gives the steepest descent algorithm's monotonicity property under its tie-breaking rule; Proposition 10.32 (found by direct reading) bounds the L♮^\natural♮-convex adaptation's domain-size parameter in terms of the original function's.

Significance

Conjugate scaling is chapter 10's demonstration that M-convexity, while a combinatorial rather than a numeric-magnitude notion, still admits a genuine scaling technique compatible with its own structure — completing the book's account of the M-convex submodular flow problem with an algorithm whose polynomial running time depends on exactly this compatibility. Propositions 10.26/10.28 complete the correctness/legitimacy argument for the strongly polynomial submodular- minimization algorithm mission 34-ch10b-algorithms began placing, and Propositions 10.30/10.32 are the analogous structural facts for L-convex function minimization, chapter 10's third major algorithmic thread.

None of these results are open — they are Murota's own account of submodular-function- minimization (§10.2 continued), L-convex minimization (§10.3), and conjugate scaling (§10.4.5). What this mission contributes is a faithful, machine-checked formal statement of each, including one result (Proposition 10.32) the platform's own automated extractor missed; no comparable formalization exists on the platform (see Formalization scope).

Difficulty

As in mission 34-ch10b-algorithms, several numbered results in this block are excluded as hard for being pure algorithmic-complexity bounds (Propositions 10.25, 10.27, 10.31); see HARD.md. A further three (Propositions 10.37-10.39, on the primal-dual algorithm's maximum submodular flow subproblem) are excluded for a distinct reason: the source text's own OCR extraction demonstrably cannot distinguish the two visually different capacity-bound symbols (c* overlined vs. underlined) central to their shared defining formula, confirmed directly against the raw extracted bytes, making faithful reconstruction of that formula impossible from the available text; see HARD.md.

Formalization scope

Ground-set elements are a Fintype V with DecidableEq. All apparatus needed for Propositions 10.26/10.28 (Submodular, GammaSet, RhoTilde, ReachSet, Eta, IsMaximalMinimizer) is redeclared fresh from mission 34-ch10b-algorithms, genericized over an arbitrary ground type where the original was V-specific, since this draft cannot import that sibling. Proposition 10.26 is placed as the case-independent core inequality its own proof establishes, rather than by replicating the three-case verification against Proposition 10.24's own internal proof objects (Cases (i)-(iii)); see HARD.md. Proposition 10.30 omits its own trailing iteration-count corollary (a pure complexity bound); see HARD.md. Six numbered results (Propositions 10.25, 10.27, 10.31, 10.37, 10.38, 10.39) are hard. Contributions completing any of the five sorrys are welcome; the goal carries the most independent proof content (via the conjugacy theorem and Theorem 7.10(2), both established elsewhere in this series).

Selected references

  • K. Murota, Discrete Convex Analysis, SIAM, 2003. DOI: 10.1137/1.9780898718508.
  • S. Iwata, "A faster scaling algorithm for minimizing submodular functions," SIAM Journal on Computing, 32 (2003), pp. 833-840 [99] (conjugate scaling's origin).
  • A. Frank, "A weighted matroid intersection algorithm," Journal of Algorithms, 2 (1981), pp. 328-336 [55] (the primal-dual framework this mission's Proposition 10.28 continues, via mission 34-ch10b-algorithms's own Proposition 10.24).
38 thms3 active usersReviewed
🏆Completed
CombinatoricsOperations ResearchOptimization·Captain: Shuze Chen

Discrete Convex Analysis XIII: Existence of Equilibrium with Indivisible GoodsTextbook

Motivation

Competitive-equilibrium theory for economies of divisible commodities — where consumption and production are real vectors — has rested on a rigorous mathematical foundation since around 1960, built from convexity, compactness, and fixed-point theorems (Debreu 1959; Arrow–Hahn 1971; McKenzie 2002). A large share of real markets, however, trade goods that cannot be split: houses, cars, aircraft, job assignments, radio spectrum licenses. For such economies, no comparably general existence theory existed before the framework this mission formalizes. Kelso and Crawford (1982) and Gul and Stacchetti (1999) had identified the gross substitutes property as the right condition on preferences for equilibrium to exist in labor-market and assignment models; Danilov, Koshevoy, and Murota (1998, 2001) showed that gross substitutes, and several other conditions proposed independently in the economics literature, all coincide with a single combinatorial notion from discrete convex analysis: M-natural-concavity. This mission formalizes the resulting existence theorem for economies with indivisible goods, together with the definitional results that pin down exactly what M-natural-concavity of a utility function means and how it connects to the classical demand-set language of general equilibrium theory.

Setting

Fix a finite set KKK of indivisible commodity types and a finite set HHH of consumers ("she"). A consumption bundle is an integer vector x∈ZKx \in \mathbb Z^Kx∈ZK, one coordinate per commodity. Consumer hhh's preferences over bundles, net of a perfectly divisible numeraire ("money"), are summarized by a utility function Uh:ZK→R∪{−∞}U_h : \mathbb Z^K \to \mathbb R \cup \{-\infty\}Uh​:ZK→R∪{−∞}, where −∞-\infty−∞ marks bundles outside her feasible range (her effective domain, dom⁡Uh={x:Uh(x)≠−∞}\operatorname{dom} U_h = \{x : U_h(x) \ne -\infty\}domUh​={x:Uh​(x)=−∞}). Given a price vector p∈RKp \in \mathbb R^Kp∈RK (one real price per commodity), consumer hhh chooses a bundle from her demand set

Dh(p)=arg⁡max⁡x∈ZK(Uh(x)−⟨p,x⟩),D_h(p) = \arg\max_{x \in \mathbb Z^K} \big(U_h(x) - \langle p, x\rangle\big),Dh​(p)=argx∈ZKmax​(Uh​(x)−⟨p,x⟩),

the bundles that maximize utility net of expenditure; the shorthand Uh[−p](x):=Uh(x)−⟨p,x⟩U_h[-p](x) := U_h(x) - \langle p,x\rangleUh​[−p](x):=Uh​(x)−⟨p,x⟩ is used throughout. For the notion this mission is built around, write χi∈ZK\chi_i \in \mathbb Z^Kχi​∈ZK for the iii-th unit vector, and for x,y∈ZKx, y \in \mathbb Z^Kx,y∈ZK let supp⁡+(x−y)={k:x(k)>y(k)}\operatorname{supp}^+(x-y) = \{k : x(k) > y(k)\}supp+(x−y)={k:x(k)>y(k)} and supp⁡−(x−y)={k:x(k)<y(k)}\operatorname{supp}^-(x-y) = \{k : x(k) < y(k)\}supp−(x−y)={k:x(k)<y(k)}. A function UUU with nonempty effective domain is M-natural-concave if it satisfies the exchange axiom: for x,y∈dom⁡Ux, y \in \operatorname{dom} Ux,y∈domU and i∈supp⁡+(x−y)i \in \operatorname{supp}^+(x-y)i∈supp+(x−y),

U(x)+U(y)≤max⁡(U(x−χi)+U(y+χi), max⁡j∈supp⁡−(x−y)[U(x−χi+χj)+U(y+χi−χj)]),U(x) + U(y) \le \max\Big(U(x-\chi_i)+U(y+\chi_i),\ \max_{j \in \operatorname{supp}^-(x-y)} \big[U(x-\chi_i+\chi_j) + U(y+\chi_i-\chi_j)\big]\Big),U(x)+U(y)≤max(U(x−χi​)+U(y+χi​), j∈supp−(x−y)max​[U(x−χi​+χj​)+U(y+χi​−χj​)]),

with the convention that a maximum over the empty set is −∞-\infty−∞. A producer lll from a finite set LLL is symmetric, described by a cost function Cl:ZK→R∪{+∞}C_l : \mathbb Z^K \to \mathbb R \cup \{+\infty\}Cl​:ZK→R∪{+∞} that is M-natural-convex — the mirror-image exchange axiom with min⁡\minmin in place of max⁡\maxmax and the inequality reversed — and a supply set Sl(p)=arg⁡max⁡y(⟨p,y⟩−Cl(y))S_l(p) = \arg\max_y(\langle p,y \rangle - C_l(y))Sl​(p)=argmaxy​(⟨p,y⟩−Cl​(y)). An equilibrium for a total initial endowment x∘∈ZKx^\circ \in \mathbb Z^Kx∘∈ZK is a tuple ((xh∣h∈H),(yl∣l∈L),p)((x_h \mid h \in H), (y_l \mid l \in L), p)((xh​∣h∈H),(yl​∣l∈L),p) with xh∈Dh(p)x_h \in D_h(p)xh​∈Dh​(p), yl∈Sl(p)y_l \in S_l(p)yl​∈Sl​(p), market clearing ∑hxh=x∘+∑lyl\sum_h x_h = x^\circ + \sum_l y_l∑h​xh​=x∘+∑l​yl​, and p≥0p \ge 0p≥0.

Formalization targets

Theorem 11.13 (goal).If every Uh is nondecreasing and M-natural-concave with bounded domain, an equilibrium exists for every x∘∈⋂hdom⁡Uh in the exchange economy (L=∅).\textbf{Theorem 11.13 (goal).}\quad \text{If every } U_h \text{ is nondecreasing and M-natural-concave with bounded domain, an equilibrium exists for every } x^\circ \in \bigcap_h \operatorname{dom} U_h \text{ in the exchange economy } (L = \emptyset).Theorem 11.13 (goal).If every Uh​ is nondecreasing and M-natural-concave with bounded domain, an equilibrium exists for every x∘∈h⋂​domUh​ in the exchange economy (L=∅).

This is the weakest form of the existence claim the mission proves in full — no producers, so no interaction between two different M-natural-convexity classes is needed — and is the natural target because it isolates exactly what M-natural-concavity buys on the consumer side alone. Two companion results sharpen the picture: Theorem 11.4 pins down M-natural-concavity through an equivalent single-step ascent property, and Theorem 11.7 restates it through the combinatorial structure (M-natural-convexity) of the demand sets themselves, connecting the definition to the gross-substitutes literature. Proposition 11.12 supplies the structural fact the existence proof turns on (the aggregate excess-cost function inherits M-natural-convexity and has a nonempty subdifferential), Theorem 11.14 extends existence to the general economy with producers by transporting an equilibrium down from a continuous relaxation, and Theorem 11.16 establishes that the set of all equilibrium prices is not merely nonempty but a lattice-structured polyhedron.

Significance

The result itself. Theorem 11.13 is a genuine existence theorem for a discrete general- equilibrium model — not an approximation or a relaxation of the continuous theory, but a free-standing result about the integer lattice. Its consequence set is also constructive by consequence: Theorem 11.16's lattice structure and section 11.5's reduction to submodular-flow computation (not part of this mission) together show that finding an extreme equilibrium price is a polynomial-time problem, not merely a nonempty-existence claim. Before this line of work, economists working with indivisible goods either restricted to special two-sided matching structures or worked with sufficient conditions (such as gross substitutes) whose relationship to each other and to any unifying combinatorial property was not understood; Fujishige–Yang (2003) and Murota–Tamura independently identified the M-natural-concavity connection cited here.

Formalizing it. All of the results in this mission are proved in the source text; nothing here is open. What formalization adds is a machine-checked confirmation that the demand/supply-set and equilibrium definitions, and the exchange-axiom characterization of M-natural-concavity, compose exactly as the informal statements claim — a nontrivial check, since the definitions involve several layers of arg-max/arg-min over integer lattices and price-shifted objectives that are easy to state slightly wrong (e.g. conflating arg⁡max⁡\arg\maxargmax and arg⁡min⁡\arg\minargmin, or omitting the extended index 000 in the single-improvement axiom).

Difficulty

The obvious approach to existence — relax the discrete problem to RK\mathbb R^KRK, apply a classical fixed-point argument, and round the resulting continuous equilibrium to the nearest integer point — fails outright, and the book devotes section 11.2 to a two-agent, two-good example that demonstrates this concretely: at certain initial endowments, every candidate integer allocation leaves an unclaimed unit of surplus, so no equilibrium price exists at all, even though the continuous relaxation of the same economy has one. The gap is a failure of convexity in the Minkowski sum D1(p)+D2(p)D_1(p) + D_2(p)D1​(p)+D2​(p): ordinary discrete demand sets can be "hole-free" individually and still sum to a set with a hole. M-natural-concavity is precisely the condition under which Minkowski sums of demand sets stay hole-free (a consequence of the parallel discrete-convex-set theory this book develops earlier), which is what makes the round-down argument valid after all — but only under this specific hypothesis, not under plain concavity or submodularity.

Formalization scope

Commodities and prices live on a general finite type KKK (Fintype, DecidableEq), not a fixed Fin n\mathrm{Fin}\ nFin n; consumers and producers are indexed by general finite types HHH, LLL, with the pure exchange economy realized as the special case L=PEmptyL = \mathrm{PEmpty}L=PEmpty. Utility values lie in WithBot ℝ (R∪{−∞}\mathbb R \cup \{-\infty\}R∪{−∞}) and cost values in WithTop ℝ (R∪{+∞}\mathbb R \cup \{+\infty\}R∪{+∞}), matching the book's asymmetric conventions for the two families exactly; no constant appears anywhere in this mission's statements (all hypotheses and conclusions are qualitative), so there is no explicit-constant obligation to record. The one hypothesis that must never be silently dropped is "nondecreasing" in Theorem 11.13: it is a real, separate condition from M-natural-concavity (more of a good is always weakly preferred), stated as its own conjunct rather than folded into the concavity predicate. A formalization that replaced M-natural-concavity with ordinary real-valued concavity, or dropped the boundedness hypothesis on the domains, would be a different — and for indivisible goods, false — statement; section 11.2's example is a concrete witness that discreteness together with a weaker structural hypothesis than M-natural-concavity is not enough. This mission's "M-natural-convex set" (used in Theorem 11.7) and "L-natural-convex polyhedron" (used in Theorem 11.16) are each formalized via one of the book's own stated equivalent characterizations (projection of an M-convex set on an extended ground set, and the (SBS-natural[R]) lattice-translation property respectively) rather than reintroduced as new primitives. Reusable beyond this mission: the general subdifferential SubdiffR and the EReal-valued concave/convex closure constructions apply to any discrete convex/concave function, not only to the aggregate cost function of this chapter. Contributions welcome on the sorry'd proofs, and on formalizing section 11.5's computational reduction to the M-convex submodular flow problem (deferred here — see HARD.md — pending chunk 12's flow vocabulary).

Selected references

  • Murota, K. Discrete Convex Analysis. SIAM, 2003. DOI: 10.1137/1.9780898718508. (Chapter 11.)
  • Kelso, A. S., Crawford, V. P. "Job Matching, Coalition Formation, and Gross Substitutes." Econometrica 50(6), 1982, 1483–1504.
  • Gul, F., Stacchetti, E. "Walrasian Equilibrium with Gross Substitutes." Journal of Economic Theory 87(1), 1999, 95–124.
  • Danilov, V., Koshevoy, G., Murota, K. "Discrete Convexity and Equilibria in Economies with Indivisible Goods and Money." Mathematical Social Sciences 41(3), 2001, 251–273.
  • Fujishige, S., Yang, Z. "A Note on Kelso and Crawford's Gross Substitutes Condition." Mathematics of Operations Research 28(3), 2003, 463–469.
  • Debreu, G. Theory of Value: An Axiomatic Analysis of Economic Equilibrium. Yale University Press, 1959.
29 thms2 active usersReviewed
🏆Completed
Convex OptimizationDiscrete GeometryOperations Research+1·Captain: Shuze Chen

Discrete Convex Analysis XXXV: Gross Substitutes and Equilibrium PricesTextbook

Motivation

This mission continues chapter 11's account of the M♮-concave/M♮-convex exchange-economy model begun in mission 14-economic-equilibrium, placing seven of that chunk's own results that were previously left out-of-cone: the two gross-substitutes-style characterizations of M♮-concavity (§11.3), the transfer theorem that lifts an equilibrium of the continuous relaxation to one for indivisible commodities (§11.4), and the explicit polyhedral description of the equilibrium price set together with its feasibility criterion (§11.5).

Setting

Mission 14-economic-equilibrium built the exchange-economy vocabulary this mission redeclares in full (UDom, ArgMaxBot/ArgMinTop, PriceShift/PriceShiftConvex, DemandSet/SupplySet, IsEquilibrium, MNaturalConcave, IsMNaturalConvexSet, the concave/convex closures ConcaveClosureR/ConvexClosureR and their continuous analogues ContDemandSet/ContSupplySet/ IsContEquilibrium) and placed the qualitative structural theorems (Theorems 11.1-11.3, 11.4, 11.16-11.18, 11.23-11.24). This mission adds the gross-substitutes axioms (−M♮-GS[Z], the price-monotonicity property NegGS, and −M♮-SWGS[Z], its one-price-at-a-time refinement NegSWGS), the M♮-convex-set transfer machinery connecting a continuous equilibrium to a discrete one, and the equilibrium price polyhedron built from the three bound families ℓ(j), u(j), u(i,j) (Eqs. (11.40)-(11.42)) that make Theorem 11.16's qualitative L♮-convex-polyhedron fact concrete and linear-programming-checkable.

Formalization targets

Goal: The equilibrium price set is the explicit L♮-convex polyhedron (11.43) (Theorem 11.21)

For a fixed allocation (x,y), the set P* of all equilibrium price vectors is an L♮-convex polyhedron and equals the polyhedron cut out by max{0,ℓ(j)} ≤ p(j) ≤ u(j) and p(j)-p(i) ≤ u(i,j). Chosen as goal: it is the sharpest structural result of chapter 11's computation section, upgrading Theorem 11.16's qualitative fact to a concrete description, and is what Theorem 11.22 (also placed) builds on directly.

Supporting structural targets

Theorem 11.5 and Theorem 11.6 characterize M♮-concavity via the gross-substitutes and stepwise gross-substitutes properties, completing chapter 11's suite of M♮-concavity characterizations begun with Theorem 11.4 (mission 14). Theorem 11.15 is the general transfer theorem (continuous equilibrium ⟹ discrete equilibrium) that mission 14's own Theorem 11.14 invokes as a special case. Theorem 11.22 gives the feasibility criterion for the existence of an equilibrium price vector, the mission's second theorem built on the equilibrium price polyhedron.

Significance

Together with mission 14-economic-equilibrium, this mission completes the book's account of how M♮-concavity/convexity — a purely combinatorial exchange condition — reproduces, and sharpens, the classical gross-substitutes theory of competitive equilibrium for economies with indivisible goods: existence transfers from the continuous relaxation, and the equilibrium price set itself has a description exact enough to reduce to a linear feasibility question. None of these results are open — they are Murota's own account (attributed in the book's own notes to Danilov-Koshevoy- Lang and Murota-Tamura for the gross-substitutes theorems, and to Murota-Tamura for the equilibrium price polyhedron); this mission contributes a faithful, machine-checked formal statement of each (see Formalization scope).

Difficulty

Two of this chunk's seven BRIEF.md results are not drafted this pass, for a disclosed time- budget reason rather than any faithfulness failure: Proposition 11.19 and Theorem 11.20 require the H,L-indexed bipartite MSFP2 flow-network vocabulary (separate vertex sets V+_e, V+_l, V-_h, an M-convex/M-concave-combining flow objective) that neither this mission nor mission 14 builds, and building it in proportion to placing exactly these two results was judged disproportionate to the remaining time in this pass; see HARD.md and STATUS.md. This is explicitly not a hard exclusion — both results are well-posed and provable from the book's own complete proofs — and is recorded as an honest scope limitation for a future pass. Theorem 11.22's own trailing algorithmic remark (that equilibrium prices can be found via a shortest-path computation, yielding a polynomial-time equilibrium-checking algorithm) is a computational/ complexity claim outside this series' propositional-formalization methodology and is omitted; the mathematical "iff feasibility" content is placed in full. See HARD.md.

Formalization scope

Ground set K is a Fintype with DecidableEq; consumer/producer index sets H, L are Fintypes (Nonempty where the price-bound formulas (11.40)-(11.42) need a nonempty sup'/inf' range). All base vocabulary is redeclared fresh from mission 14-economic-equilibrium's own definitions, since this draft cannot import that sibling mission. The gross-substitutes axioms are formalized directly from their defining inequalities (Eqs. preceding (11.19) and following, and p.331); the equilibrium price polyhedron's bound families ℓ(j)/u(j)/u(i,j) are formalized literally from Eqs. (11.40)-(11.42), extracting each WithBot ℝ/WithTop ℝ operand to ℝ before subtracting (since WithBot ℝ carries no subtraction instance). Two results (Proposition 11.19, Theorem 11.20) are not drafted this pass for the disclosed time-budget reason above; one result (Theorem 11.22's trailing algorithmic remark) is scoped out as computational content. Contributions completing any of the five sorrys, or building the MSFP2 vocabulary to place Proposition 11.19/Theorem 11.20 in a follow-up mission, are welcome.

Selected references

  • K. Murota, Discrete Convex Analysis, SIAM, 2003. DOI: 10.1137/1.9780898718508.
  • V. Danilov, G. Koshevoy, K. Murota, "Discrete convexity and equilibria in economies with indivisible goods and money," Mathematical Social Sciences, 41 (2001), pp. 251-273 [33] (origin of the gross-substitutes characterization, Theorem 11.6).
  • K. Murota, A. Tamura, "Application of M-convex submodular flow problem to mathematical economics," Japan Journal of Industrial and Applied Mathematics, 20 (2003), pp. 257-277 [160] (origin of the equilibrium price polyhedron, Theorems 11.20-11.22).
41 thms2 active usersReviewed
🏆Completed
CombinatoricsDiscrete GeometryOperations Research+1·Captain: Shuze Chen

Discrete Convex Analysis XIV: The König-Egerváry Theorem for Mixed MatricesTextbook

Motivation

Every physical or engineering model built from linear relations mixes two kinds of numbers. Some coefficients are exact — the ±1\pm 1±1 entries recording Kirchhoff's current and voltage laws in an electrical network, or the incidence structure of a mechanical linkage — because they come from a topological or combinatorial fact, not a measurement. Others are physical parameters: resistances, masses, spring constants, reaction rates. These are known only approximately, and different parameters are, for modeling purposes, independent of one another. Classical linear algebra treats every entry of a coefficient matrix alike, so it cannot express this distinction, and a numerical computation on a matrix with noisy parameter entries can accidentally hit a non-generic coincidence — a determinant that would vanish only for a measure-zero set of parameter values, but that plain Gaussian elimination has no way to certify is not actually structurally forced to vanish. Murota and collaborators (see the bibliographical notes to chapter 12; the underlying theory is developed at length in Murota's Matrices and Matroids for Systems Analysis, 2000) formalized this distinction through mixed matrices, and showed that their key structural questions — is the matrix nonsingular, and what is its rank — reduce to a combinatorial optimization problem solvable by the discrete convex analysis this book develops. This mission formalizes that reduction and its capstone consequence, a generalization of the classical König–Egerváry theorem.

Setting

Fix two fields K⊆FK \subseteq FK⊆F: typically K=QK = \mathbb{Q}K=Q and FFF a field large enough to hold every number in the problem. A family t1,…,tm∈Ft_1, \dots, t_m \in Ft1​,…,tm​∈F is algebraically independent over KKK if no nonzero polynomial with coefficients in KKK vanishes at (t1,…,tm)(t_1, \dots, t_m)(t1​,…,tm​) — informally, the tit_iti​ behave as free, unconstrained parameters relative to KKK. Fix finite row and column index sets RRR and CCC. A matrix A=(Aij)i∈R,j∈CA = (A_{ij})_{i \in R, j \in C}A=(Aij​)i∈R,j∈C​ over FFF is a mixed matrix with respect to (K,F)(K, F)(K,F) if it decomposes as

A=Q+TA = Q + TA=Q+T

where Q=(Qij)Q = (Q_{ij})Q=(Qij​) has every entry in KKK, and T=(Tij)T = (T_{ij})T=(Tij​) has entries in FFF whose nonzero values, taken together as one family, are algebraically independent over KKK. QQQ models the exact, structural part of the system; TTT models the independent physical parameters. For I⊆RI \subseteq RI⊆R and J⊆CJ \subseteq CJ⊆C, write A[I,J]A[I,J]A[I,J] for the submatrix with rows III and columns JJJ. The rank of AAA is its rank over FFF — equivalently, the size of the largest nonvanishing-determinant square submatrix. Write ρ(I,J)=rank⁡Q[I,J]\rho(I,J) = \operatorname{rank} Q[I,J]ρ(I,J)=rankQ[I,J], τ(I,J)=rank⁡T[I,J]\tau(I,J) = \operatorname{rank} T[I,J]τ(I,J)=rankT[I,J], and γ(I,J)\gamma(I,J)γ(I,J) for the number of rows of III that contain a nonzero entry of TTT in some column of JJJ. A mixed polynomial matrix A(s)=Q(s)+T(s)A(s) = Q(s) + T(s)A(s)=Q(s)+T(s) is the same decomposition applied entrywise to matrices whose entries are polynomials in an indeterminate sss (used to model the Laplace- or zzz-transform variable of a linear time-invariant system): Q(s)Q(s)Q(s) has every coefficient of every entry in KKK, and the coefficients of T(s)T(s)T(s)'s entries, taken together, are algebraically independent over KKK.

Formalization targets

Theorem 12.9 (goal).For a mixed matrix A=Q+T, ∃ I⊆R, J⊆C:∣I∣+∣J∣−rank⁡Q[I,J]=∣R∣+∣C∣−rank⁡A  and  rank⁡T[I,J]=0.\textbf{Theorem 12.9 (goal).}\quad \text{For a mixed matrix } A=Q+T,\ \exists\, I \subseteq R,\ J \subseteq C:\quad |I|+|J|-\operatorname{rank} Q[I,J] = |R|+|C|-\operatorname{rank} A \ \ \text{and}\ \ \operatorname{rank} T[I,J] = 0.Theorem 12.9 (goal).For a mixed matrix A=Q+T, ∃I⊆R, J⊆C:∣I∣+∣J∣−rankQ[I,J]=∣R∣+∣C∣−rankA  and  rankT[I,J]=0.

This is the König–Egerváry theorem for mixed matrices: a combinatorial certificate of AAA's rank deficiency, generalizing the classical theorem relating the maximum matching size of a bipartite graph (equivalently, the rank of a 0-1 matrix) to a minimum vertex cover. It is reached via three supporting results, each a genuine theorem in its own right: Proposition 12.6 (nonsingularity of AAA reduces to nonsingularity of a QQQ-part and a TTT-part on complementary index splits), Theorem 12.7 (the resulting rank max-formula), and Theorem 12.8 (the three dual min-formulas Theorem 12.9 is extracted from). Theorem 12.13 extends the max-formula to the degree of the determinant of a mixed polynomial matrix.

Significance

The result itself. Theorem 12.9 gives a certificate, not just a number: a pair (I,J)(I,J)(I,J) that simultaneously proves the exact numeric rank contribution of QQQ and exhibits a submatrix of TTT that vanishes identically. Because ρ\rhoρ (via Gaussian elimination on QQQ) and γ\gammaγ, τ\tauτ (via maximum bipartite matching on TTT's nonzero pattern) are each individually cheap to evaluate, and the min-max structure of Theorem 12.8 is exactly the kind of problem Edmonds's matroid intersection theorem (a special case of this book's Theorem 4.18) and this book's discrete convexity machinery solve efficiently, the whole rank computation for a mixed matrix — and hence the generic solvability test for a physical system modeled by one — is polynomial-time, despite Theorem 12.7's formula naively ranging over exponentially many index-set pairs.

Formalizing it. All five results in this mission are proved in the source text (this is textbook, not open, mathematics). What formalization adds is a machine-checked confirmation that the genericity hypothesis — "the nonzero entries of TTT are algebraically independent" — is precisely what the printed proofs use, expressed through Mathlib's own AlgebraicIndependent rather than an informal paraphrase such as "generic" or "random" values, which would be either meaningless or a different (probabilistic) condition.

Difficulty

The naive approach to testing whether A=Q+TA = Q+TA=Q+T is nonsingular is to expand det⁡A\det AdetA directly and check whether the resulting expression, as a polynomial in TTT's free parameters, is the zero polynomial. This is exactly what genericity is supposed to let you avoid: Proposition 12.6's proof observes that the Laplace-type expansion det⁡A=∑∣I∣=∣J∣±det⁡Q[I,J]⋅det⁡T[R∖I,C∖J]\det A = \sum_{|I|=|J|} \pm \det Q[I,J] \cdot \det T[R\setminus I, C\setminus J]detA=∑∣I∣=∣J∣​±detQ[I,J]⋅detT[R∖I,C∖J] has no cancellation between distinct terms, precisely because the nonzero entries of TTT are algebraically independent — a coincidental cancellation would be a nontrivial polynomial relation among free parameters, which cannot happen. This turns a determinant computation with symbolic entries into a purely combinatorial search over row/column splits, each of whose two pieces is checked in the "easy" arithmetic appropriate to it (numeric determinant for QQQ, a nonzero-pattern-only matching argument for TTT). Missing this point — e.g. by treating TTT's entries as merely "distinct" or "typically nonzero" rather than algebraically independent — reintroduces exactly the cancellation risk the theorem is built to rule out.

Formalization scope

Row and column index sets RRR, CCC are general finite types (Fintype, with DecidableEq where needed for Finset operations), not fixed to Fin n\mathrm{Fin}\ nFin n. No constant appears in any statement in this mission — every quantity (ranks, cardinalities, γ\gammaγ) is instance-dependent, so rule 7's explicit-constant obligation does not apply here. "Nonsingular" for a (possibly rectangular, cross-type-indexed) submatrix M[I,J]M[I,J]M[I,J] is formalized as I.card = J.card together with rank M[I,J] = I.card (full rank) rather than via Matrix.det, because Mathlib's determinant requires both index sets to be the same Lean type, which I : Finset R and J : Finset C are not in general even when equinumerous; this coincides with ordinary nonsingularity whenever the ambient matrix is genuinely square. The degree of the determinant of a submatrix in Theorem 12.13 is computed the same way, via an arbitrary reindexing bijection between the row- and column-index subtypes — a choice that changes the determinant by at most a sign and hence never changes its degree. A formalization that replaced the genericity hypothesis on TTT with mere distinctness of its nonzero entries would admit spurious cancellations in the determinant expansion and would not prove Proposition 12.6 or any of its consequences; AlgebraicIndependent K is the precise, non-trivializing condition the book's proofs use. This chapter is self-contained: no definitions from any other mission in this series are imported. Reusable beyond this mission: MatrixSubRank, IsNonsingularSub, and SubDegDet apply to any pair of matrices over any field, not only to mixed-matrix decompositions.

Selected references

  • Murota, K. Discrete Convex Analysis. SIAM, 2003. DOI: 10.1137/1.9780898718508. (Chapter 12.)
  • Murota, K. Matrices and Matroids for Systems Analysis. Springer, 2000.
  • Murota, K. "Systems Analysis by Graphs and Matroids: Structural Solvability and Controllability." Springer, 1987.
  • König, D. "Gráfok és mátrixok" (Graphs and matrices). Matematikai és Fizikai Lapok 38, 1931, 116–119.
  • Egerváry, J. "Matrixok kombinatorius tulajdonságairól" (On combinatorial properties of matrices). Matematikai és Fizikai Lapok 38, 1931, 16–28.
16 thms3 active usersReviewed
🏆Completed
Convex OptimizationGraph TheoryOperations Research+1·Captain: mikedeng1

The Traveling-Salesman Problem and Minimum Spanning Trees, Part II: Convergence of the Constant-Step Ascent to the 1-Tree BoundResearch Paper

Motivation

The traveling-salesman problem (TSP) asks for a cheapest cycle through all vertices of a weighted complete graph. Exact algorithms for it are branch-and-bound searches, and their size depends almost entirely on the quality of the lower bounds used to prune the search. In 1970 Held and Karp introduced the 1-tree bound: a Lagrangian relaxation of the degree-2 constraints of a tour, whose value can be evaluated by one minimum-spanning-tree computation (Held & Karp, Part I, 1970). Part II (Held & Karp, 1971) replaces the ascent procedure of Part I by an iterative method related to the relaxation method for linear inequalities of Agmon and of Motzkin and Schoenberg (1954), and with it solved to proven optimality every instance presented to it, up to 64 cities. The iteration is the prototype of what is now called the subgradient method with Polyak-type step sizes, and the 1-tree bound remains a standard lower bound in exact TSP codes.

Timeline:

  • 1954 — Agmon; Motzkin and Schoenberg: the relaxation method for systems of linear inequalities, and convergence of Féjer-monotone sequences relative to full-dimensional sets.
  • 1970 — Held and Karp (Part I): the 1-tree bound max⁡πw(π)\max_\pi w(\pi)maxπ​w(π) and a column-generation / ascent method for it.
  • 1971 — Held and Karp (Part II): the iteration πm+1=πm+tmvk(πm)\pi^{m+1} = \pi^m + t_m v_{k(\pi^m)}πm+1=πm+tm​vk(πm)​, its relaxation-method analysis (Lemmas 1–3) and the constant-step guarantee (Theorem 1).
  • 1974 — Held, Wolfe and Crowder validate the method as general subgradient optimization.

Setting

Let n≥3n \ge 3n≥3 and let (cij)(c_{ij})(cij​) be a symmetric real n×nn\times nn×n matrix of weights on the edges of the complete graph KnK_nKn​ with vertex set {1,…,n}\{1,\dots,n\}{1,…,n}; weights may be negative and need not satisfy the triangle inequality. A subgraph has weight equal to the sum of its edge weights. A tour is a cycle through every vertex exactly once; C∗C^*C∗ is the weight of a minimum tour.

A 1-tree is a tree on the vertex set {2,…,n}\{2,\dots,n\}{2,…,n} together with two distinct edges at vertex 111. Index the 1-trees by kkk; let ckc_kck​ be the weight of the kkk-th 1-tree, dikd_{ik}dik​ the degree of vertex iii in it, and vk∈Rnv_k \in \mathbb R^nvk​∈Rn the degree-excess vector with components dik−2d_{ik}-2dik​−2. For π∈Rn\pi \in \mathbb R^nπ∈Rn define

w(π)=min⁡k [ck+π⋅vk].w(\pi) = \min_k\,[c_k + \pi\cdot v_k].w(π)=kmin​[ck​+π⋅vk​].

A tour is a 1-tree with vk=0v_k = 0vk​=0, so C∗≥w(π)C^* \ge w(\pi)C∗≥w(π) for every π\piπ (Eq. (2)); the best bound is max⁡πw(π)\max_\pi w(\pi)maxπ​w(π). For a point π\piπ, k(π)k(\pi)k(π) denotes a minimum-weight 1-tree at π\piπ, a 1-tree attaining the minimum defining w(π)w(\pi)w(π). The ascent iteration (3) is

πm+1=πm+tm vk(πm).\pi^{m+1} = \pi^m + t_m\,v_{k(\pi^m)}.πm+1=πm+tm​vk(πm)​.

For a target value wˉ\bar wwˉ, PwˉP_{\bar w}Pwˉ​ is the polyhedron of solutions of wˉ≤ck+π⋅vk\bar w \le c_k + \pi\cdot v_kwˉ≤ck​+π⋅vk​ for all kkk (system (5)). All norms ∥⋅∥\|\cdot\|∥⋅∥ are Euclidean.

Formalization targets

Goal: Theorem 1

With constant step tm=tˉ>0t_m = \bar t > 0tm​=tˉ>0, any starting point and any choice of minimum-weight 1-trees,

sup⁡mw(πm)  ≥  max⁡πw(π)−12 tˉ lim sup⁡m→∞∥vk(πm)∥2.\sup_m w(\pi^m) \;\ge\; \max_\pi w(\pi) - \tfrac12\,\bar t\,\limsup_{m\to\infty}\|v_{k(\pi^m)}\|^2 .msup​w(πm)≥πmax​w(π)−21​tˉm→∞limsup​∥vk(πm)​∥2.

Milestones

  1. Eq. (2): C∗≥w(π)C^* \ge w(\pi)C∗≥w(π) for every π\piπ.
  2. Lemma 1: if w(πˉ)≥w(π)w(\bar\pi) \ge w(\pi)w(πˉ)≥w(π) then (πˉ−π)⋅vk(π)≥w(πˉ)−w(π)≥0(\bar\pi-\pi)\cdot v_{k(\pi)} \ge w(\bar\pi) - w(\pi) \ge 0(πˉ−π)⋅vk(π)​≥w(πˉ)−w(π)≥0.
  3. Lemma 2: if 0<t<2(w(πˉ)−w(π))/∥vk(π)∥20 < t < 2(w(\bar\pi)-w(\pi))/\|v_{k(\pi)}\|^20<t<2(w(πˉ)−w(π))/∥vk(π)​∥2 then ∥πˉ−(π+tvk(π))∥<∥πˉ−π∥\|\bar\pi - (\pi + t v_{k(\pi)})\| < \|\bar\pi-\pi\|∥πˉ−(π+tvk(π)​)∥<∥πˉ−π∥.
  4. Féjer-monotone convergence (Motzkin–Schoenberg, quoted in the proof of Lemma 3): a sequence whose distance to every point of a set with nonempty interior is nonincreasing converges.
  5. Lemma 3, Case 1: for wˉ<max⁡πw\bar w < \max_\pi wwˉ<maxπ​w and the relaxation iteration
πm+1=πm+λm wˉ−w(πm)∥vk(πm)∥2 vk(πm)(6)\pi^{m+1} = \pi^m + \lambda_m\,\frac{\bar w - w(\pi^m)}{\|v_{k(\pi^m)}\|^2}\,v_{k(\pi^m)} \qquad (6)πm+1=πm+λm​∥vk(πm)​∥2wˉ−w(πm)​vk(πm)​(6)

with 0<ε<λm≤20<\varepsilon<\lambda_m\le 20<ε<λm​≤2, the iterates enter PwˉP_{\bar w}Pwˉ​ or converge to a boundary point of PwˉP_{\bar w}Pwˉ​. 6. Lemma 3, Case 2: with λm=2\lambda_m = 2λm​=2 the iterates enter PwˉP_{\bar w}Pwˉ​. 7. §3 bound: the restricted minimum wX,Y(π)w_{X,Y}(\pi)wX,Y​(π) over 1-trees containing the edges XXX and avoiding the edges YYY is a lower bound on every tour of the derived problem.

Milestones 1–5 are the steps of the paper's proof of Theorem 1; 6 and 7 are further results of the paper on the same objects.

Significance

Theorem 1 is the paper's justification of the step rule actually used in its computations: a fixed step tˉ\bar ttˉ loses at most 12tˉ\tfrac12\bar t21​tˉ times the asymptotic squared deviation of the generated 1-trees from being tours. Since ∥vk∥2\|v_k\|^2∥vk​∥2 is an even integer that vanishes exactly on tours, and the paper observes it is typically small in practice, the bound explains why the constant-step ascent reaches bounds sharp enough for branch-and-bound. Lemmas 1–3 are the first analysis of a subgradient-type method for a nonsmooth concave function, cast as the relaxation method for the (exponentially large) system (5).

All results are proved in the paper (except the Féjer-monotone convergence and Case 2 of Lemma 3, which it cites from Motzkin and Schoenberg). None is formalized: the platform has the 1-tree lower bound only under a metric assumption on the weights (SupplyChainTheory.held_karp_bound, SupplyChainTheory.one_tree_lower_bound), and the subtour-LP bound MetricTSP.held_karp_le_opt, a different object. This mission produces the bound for arbitrary real weights, the supergradient property of vk(π)v_{k(\pi)}vk(π)​, and a machine-checked convergence analysis of the relaxation iteration.

Difficulty

Lemmas 1 and 2 and Eq. (2) are short once the finite minimum defining www is handled. The difficulty is in Lemma 3 and Theorem 1. The iteration is not monotone in www, so no descent argument applies; progress is measured by the Euclidean distance to the target polyhedron PwˉP_{\bar w}Pwˉ​, and turning distance decrease into convergence requires the Féjer-monotonicity theorem, which in turn needs PwˉP_{\bar w}Pwˉ​ to have nonempty interior (from wˉ<max⁡πw\bar w < \max_\pi wwˉ<maxπ​w). In Theorem 1 the step is constant rather than of the relaxation form (6), and the target polyhedron is not given in advance: the relevant relaxation parameters are admissible only eventually and must be kept away from zero, which requires controlling degenerate directions vk(πm)=0v_{k(\pi^m)} = 0vk(πm)​=0 and the behaviour of www along an iteration that is not known a priori to stay bounded. A direct argument that w(πm)w(\pi^m)w(πm) increases fails, since single steps can decrease www.

Formalization scope

Vertices are Fin n, the paper's vertex 1 is 0 : Fin n, and graphs are SimpleGraph (Fin n). Weights are c : Sym2 (Fin n) → ℝ, arbitrary reals. A 1-tree is a graph whose restriction to the vertices other than 0 is a tree and in which 0 has degree 2; a tour is a connected graph with all degrees 2. w(π) is the minimum of weight c G + ∑ i, π i * (deg G i − 2) over 1-trees, written as an sInf over a finite set that is nonempty for n ≥ 3; every theorem assumes 3 ≤ n. Euclidean norms and inner products are written as coordinate sums of squares and products, never Mathlib's sup norm on Fin n → ℝ. The minimum-weight 1-tree k(πm)k(\pi^m)k(πm) is a hypothesis at every step, and ties may be broken arbitrarily. The goal is stated as "for every π∗\pi^*π∗ and δ>0\delta>0δ>0 some iterate has w(πm)>w(π∗)−12tˉL−δw(\pi^m) > w(\pi^*) - \tfrac12\bar t L - \deltaw(πm)>w(π∗)−21​tˉL−δ", which is equivalent to the printed inequality; LLL is the limsup of a sequence with finitely many values, a genuine real.

The statements exclude trivializing readings: the 1-tree predicate rejects graphs without exactly two edges at vertex 1; w is never a minimum over an empty set under the standing hypothesis 3 ≤ n; no ⨆ of a possibly unbounded family is used; the step size tˉ\bar ttˉ and the parameter ε\varepsilonε are strictly positive.

A complete development needs finite minima of affine functions (concavity, attainment), 1-tree and tour combinatorics on simple graphs, and Féjer-monotone sequences in Rn\mathbb R^nRn; the last two are reusable beyond this mission. Proofs of any milestone, and alternative arguments for Lemma 3, are welcome.

Selected references

  • M. Held and R. M. Karp, The traveling-salesman problem and minimum spanning trees: Part II, Mathematical Programming 1 (1971) 6–25. https://doi.org/10.1007/BF01584070
  • M. Held and R. M. Karp, The traveling-salesman problem and minimum spanning trees, Operations Research 18 (1970) 1138–1162. https://doi.org/10.1287/opre.18.6.1138
  • T. S. Motzkin and I. J. Schoenberg, The relaxation method for linear inequalities, Canadian Journal of Mathematics 6 (1954) 393–404. https://doi.org/10.4153/CJM-1954-038-x
  • S. Agmon, The relaxation method for linear inequalities, Canadian Journal of Mathematics 6 (1954) 382–392. https://doi.org/10.4153/CJM-1954-037-2
  • M. Held, P. Wolfe and H. P. Crowder, Validation of subgradient optimization, Mathematical Programming 6 (1974) 62–88. https://doi.org/10.1007/BF01580223
10 thms2 active usersReviewed
🏆Completed
Convex OptimizationOperations ResearchOptimization+1·Captain: mikedeng1

Random Gradient-Free Minimization of Convex Functions I: Random Search for Nonsmooth Convex ProblemsResearch Paper

Motivation

Many optimization problems in engineering, simulation-based design and machine learning give access to the values of an objective function but not to its gradient: the function is computed by a black-box program, by a simulator, or by a model whose derivatives are unavailable or too expensive. Zeroth-order (or derivative-free) methods use only function values. Classical direct-search methods of this kind usually come without complexity bounds.

Nesterov and Spokoiny (Found. Comput. Math. 17 (2017) 527–566) showed that a very simple randomized scheme has explicit, dimension-dependent worst-case complexity bounds. The idea is to replace the gradient by a finite difference of fff along a random Gaussian direction. The resulting oracle is an unbiased estimate of the gradient of a smoothed version of fff. Their analysis is the reference point for the later literature on zeroth-order stochastic optimization, bandit convex optimization and gradient-free training.

This mission covers the paper's result for nonsmooth convex problems over a closed convex set: the projected random search method RSμ\mathcal{RS}_\muRSμ​ and its convergence bound, Theorem 6.

Setting

Let EEE be a real inner product space of finite dimension nnn, with norm ∥⋅∥\|\cdot\|∥⋅∥. (The paper works with a space carrying a positive definite operator BBB and the norm ⟨Bx,x⟩1/2\langle Bx, x\rangle^{1/2}⟨Bx,x⟩1/2. This is the same thing as an arbitrary finite-dimensional inner product space, with BBB encoding the inner product, and the development is written in that generality.)

A function f:E→Rf : E \to \mathbb Rf:E→R is Lipschitz continuous with constant L0≥0L_0 \ge 0L0​≥0 if ∣f(x)−f(y)∣≤L0∥x−y∥|f(x) - f(y)| \le L_0 \|x - y\|∣f(x)−f(y)∣≤L0​∥x−y∥ for all x,yx, yx,y. The paper calls this class C0,0(E)C^{0,0}(E)C0,0(E) and writes L0(f)L_0(f)L0​(f) for the constant.

Let uuu be a standard Gaussian vector in EEE: its coordinates in any orthonormal basis are independent N(0,1)N(0,1)N(0,1) variables. For μ≥0\mu \ge 0μ≥0 the Gaussian smoothing of fff is

fμ(x)=Eu f(x+μu),f_\mu(x) = \mathbb E_u\, f(x + \mu u),fμ​(x)=Eu​f(x+μu),

and the Gaussian moments are Mp=Eu∥u∥pM_p = \mathbb E_u \|u\|^pMp​=Eu​∥u∥p.

For μ>0\mu > 0μ>0 the random gradient-free oracle at xxx draws uuu and returns the vector

gμ(x)=f(x+μu)−f(x)μ u.g_\mu(x) = \frac{f(x+\mu u) - f(x)}{\mu}\, u .gμ​(x)=μf(x+μu)−f(x)​u.

It costs two function values.

The problem is

f∗=min⁡x∈Qf(x),f^* = \min_{x \in Q} f(x),f∗=x∈Qmin​f(x),

where Q⊆EQ \subseteq EQ⊆E is closed and convex, fff is convex and Lipschitz, and x∗∈Qx^* \in Qx∗∈Q is a minimizer. With πQ\pi_QπQ​ the Euclidean projection onto QQQ, positive steps h0,h1,…h_0, h_1, \ldotsh0​,h1​,… and a starting point x0∈Qx_0 \in Qx0​∈Q, the random search method RSμ\mathcal{RS}_\muRSμ​ iterates

xk+1=πQ(xk−hk gμ(xk)),x_{k+1} = \pi_Q\big(x_k - h_k\, g_\mu(x_k)\big),xk+1​=πQ​(xk​−hk​gμ​(xk​)),

drawing a fresh independent Gaussian direction uku_kuk​ at every iteration. The iterates are random. Write ϕk=Ef(xk)\phi_k = \mathbb E f(x_k)ϕk​=Ef(xk​) and SN=∑k=0NhkS_N = \sum_{k=0}^N h_kSN​=∑k=0N​hk​.

Formalization targets

Goal: Theorem 6

For every N≥0N \ge 0N≥0,

1SN∑k=0Nhk(ϕk−f∗)≤μL0 n1/2+1SN[12∥x0−x∗∥2+(n+4)22L02∑k=0Nhk2].\frac{1}{S_N}\sum_{k=0}^{N} h_k(\phi_k - f^*) \le \mu L_0\, n^{1/2} + \frac{1}{S_N}\left[\frac12\|x_0 - x^*\|^2 + \frac{(n+4)^2}{2} L_0^2 \sum_{k=0}^{N} h_k^2\right].SN​1​k=0∑N​hk​(ϕk​−f∗)≤μL0​n1/2+SN​1​[21​∥x0​−x∗∥2+2(n+4)2​L02​k=0∑N​hk2​].

The step sizes, the smoothing parameter and the horizon are left free, so every step-size rule in the paper follows from this one inequality. The constants are the paper's.

Milestones

The facts about smoothing and the oracle on which the goal rests, in the paper's order:

  1. Lemma 1: Mp≤np/2M_p \le n^{p/2}Mp​≤np/2 for p∈[0,2]p \in [0,2]p∈[0,2] and np/2≤Mp≤(p+n)p/2n^{p/2} \le M_p \le (p+n)^{p/2}np/2≤Mp​≤(p+n)p/2 for p≥2p \ge 2p≥2.
  2. Theorem 1 (18): ∣fμ(x)−f(x)∣≤μL0n1/2|f_\mu(x) - f(x)| \le \mu L_0 n^{1/2}∣fμ​(x)−f(x)∣≤μL0​n1/2.
  3. Convexity of fμf_\mufμ​ for convex fff.
  4. Eq. (11): fμ≥ff_\mu \ge ffμ​≥f for convex fff.
  5. Eq. (21): ∇fμ(x)=Eu gμ(x)\nabla f_\mu(x) = \mathbb E_u\, g_\mu(x)∇fμ​(x)=Eu​gμ​(x) for μ>0\mu > 0μ>0.
  6. Theorem 4.1 (34): Eu∥gμ(x)∥2≤L02(n+4)2\mathbb E_u \|g_\mu(x)\|^2 \le L_0^2 (n+4)^2Eu​∥gμ​(x)∥2≤L02​(n+4)2.
  7. Theorem 2 (μ≥0\mu \ge 0μ≥0): f(y)≥f(x)−μL0n1/2+⟨∇fμ(x),y−x⟩f(y) \ge f(x) - \mu L_0 n^{1/2} + \langle \nabla f_\mu(x), y - x\ranglef(y)≥f(x)−μL0​n1/2+⟨∇fμ​(x),y−x⟩ for all yyy, where at μ=0\mu = 0μ=0 the vector is the limiting ∇f0(x)=Eu[f′(x,u) u]\nabla f_0(x) = \mathbb E_u[f'(x,u)\,u]∇f0​(x)=Eu​[f′(x,u)u] of Eq. (24).

Significance

Theorem 6 shows that a method using only function values, with no subgradient, solves nonsmooth convex problems with the classical projected-subgradient guarantee. Two things change: L02L_0^2L02​ is multiplied by (n+4)2(n+4)^2(n+4)2, and a bias μL0n1/2\mu L_0 n^{1/2}μL0​n1/2 appears, which can be made as small as desired. With suitable μ\muμ, hkh_khk​ and NNN an ϵ\epsilonϵ-accurate expected value is reached in O(n2L02R2/ϵ2)O(n^2 L_0^2 R^2/\epsilon^2)O(n2L02​R2/ϵ2) oracle calls. The factor n2n^2n2 quantifies the cost of not having gradients. The same analysis carries over to stochastic objectives (the paper's Theorem 7).

The results are proved in the paper. As far as is known, none of them has a machine-checked proof. The mission produces a Lean development of Gaussian smoothing on an arbitrary finite-dimensional inner product space: the moment bounds, the approximation, convexity and gradient identities, and the oracle variance bound. On top of it sits the full convergence theorem for a randomized projected method, stated for the actual random process rather than for an idealized expectation recursion. The smoothing layer is reusable: the same facts underlie the smooth and accelerated random methods of the same paper and most Gaussian-smoothing analyses in zeroth-order optimization.

Difficulty

A plain subgradient analysis does not apply. The vector gμ(xk)g_\mu(x_k)gμ​(xk​) is not a subgradient of fff, nor an unbiased estimate of one. It is an unbiased estimate of the gradient of a different function, fμf_\mufμ​, and its second moment grows with the dimension. The argument therefore has to move between fff and fμf_\mufμ​ at exactly the right places, using properties of fμf_\mufμ​ that hold for every nonsmooth Lipschitz fff.

Those properties are genuinely analytic. Differentiating fμf_\mufμ​ requires differentiating a Gaussian integral of a function that need not be differentiable. The moment bounds need estimates of E∥u∥p\mathbb E\|u\|^pE∥u∥p for real ppp. In the probabilistic part, xkx_kxk​ depends on u0,…,uk−1u_0, \ldots, u_{k-1}u0​,…,uk−1​, and each one-step estimate has to be integrated using the independence of uku_kuk​ from the past. Mathlib provides the standard Gaussian measure and independence, but no Gaussian smoothing, no projection onto convex sets and no conditional-expectation argument for this kind of recursion.

Formalization scope

The space is E with [NormedAddCommGroup E] [InnerProductSpace ℝ E] [FiniteDimensional ℝ E] [MeasurableSpace E] [BorelSpace E], and nnn is Module.finrank ℝ E. No lower bound on nnn is assumed. The Gaussian is ProbabilityTheory.stdGaussian E, and expectations are Bochner integrals against it. fμf_\mufμ​ is the definition smoothing, MpM_pMp​ is moment (with real exponent Real.rpow), and gμg_\mugμ​ is oracle.

The projection is the relation IsMetricProjection Q y z (z∈Qz \in Qz∈Q and zzz is a nearest point of QQQ to yyy). The run is the predicate IsRandomSearchRun: directions uk:Ω→Eu_k : \Omega \to Euk​:Ω→E on a probability space (Ω,P)(\Omega, P)(Ω,P), measurable, mutually independent (iIndepFun) and each with law stdGaussian E; a deterministic x0∈Qx_0 \in Qx0​∈Q; and the update above for every kkk and every outcome.

ϕk\phi_kϕk​ is ∫f(xk) dP\int f(x_k)\,dP∫f(xk​)dP. The Lipschitz constant L0≥0L_0 \ge 0L0​≥0 is any constant satisfying the Lipschitz inequality. It is an explicit hypothesis, because the paper's bound uses L0(f)L_0(f)L0​(f), which presupposes f∈C0,0(E)f \in C^{0,0}(E)f∈C0,0(E). The smoothing parameter satisfies μ>0\mu > 0μ>0 and every step satisfies hk>0h_k > 0hk​>0.

Two trivializing formalizations are ruled out. First, an expectation of a non-integrable function would be 000 as a Bochner integral; Lipschitz continuity of fff makes every expectation in the mission integrable, and no statement relies on the junk value. Second, a run whose directions are not independent standard Gaussians, or whose update uses a subgradient instead of the finite difference, is a different theorem (the projected subgradient method). The run predicate fixes the paper's process exactly. A run exists for every closed QQQ containing x0x_0x0​ (on the countable product of Gaussians), so the goal is not vacuous.

A complete development needs:

  • Gaussian integration by parts, or differentiation under the integral, for Lipschitz integrands;
  • moment estimates for the standard Gaussian norm;
  • existence and nonexpansiveness of projections onto closed convex sets;
  • an expectation argument for the random recursion.

The smoothing lemmas, the moment bounds and the projection facts are reusable beyond this mission. Contributions are welcome at every level: proofs of the milestones, general lemmas about stdGaussian and projections, and alternative proofs of Lemma 1 (for example through the chi distribution).

Selected references

  • Yu. Nesterov, V. Spokoiny, Random Gradient-Free Minimization of Convex Functions, Foundations of Computational Mathematics 17(2):527–566, 2017. https://doi.org/10.1007/s10208-015-9296-2
  • Yu. Nesterov, Introductory Lectures on Convex Optimization: A Basic Course, Kluwer, 2004. https://doi.org/10.1007/978-1-4419-8853-9
  • A. D. Flaxman, A. T. Kalai, H. B. McMahan, Online convex optimization in the bandit setting: gradient descent without a gradient, SODA 2005. https://arxiv.org/abs/cs/0408007
  • J. C. Duchi, M. I. Jordan, M. J. Wainwright, A. Wibisono, Optimal rates for zero-order convex optimization: the power of two function evaluations, IEEE Trans. Inf. Theory 61(5):2788–2806, 2015. https://arxiv.org/abs/1312.2139
14 thms4 active usersReviewed
🏆Completed
Algorithmic Game TheoryMechanism DesignOperations Research+1·Captain: mikedeng1

Bargaining under Incomplete Information III: Trade Probability and Expected Profits in the Uniform Linear EquilibriumResearch Paper

Motivation

A buyer and a seller negotiate over a single indivisible good. Each knows what the good is worth to them but not what it is worth to the other side, and each shades their offer to exploit the other's uncertainty. Chatterjee and Samuelson (Bargaining under Incomplete Information, Operations Research 31(5), 1983) modelled this as a one-shot game in which both parties submit sealed offers simultaneously and a sale takes place at a weighted average of the two offers whenever the buyer's offer is at least the seller's.

The weight kkk is a design parameter: k=1k = 1k=1 lets the buyer set the price, k=0k = 0k=0 the seller, and k=1/2k = 1/2k=1/2 splits the difference. For values uniform on a common interval the paper computes an explicit equilibrium for every kkk (its Example 1) and then asks the questions a designer of the rule cares about: how often does trade happen, who gains when kkk moves, and which kkk maximises the expected gains of the two parties together. The answers are the subject of this mission.

The example became a benchmark for bilateral trade. Myerson and Satterthwaite (J. Econ. Theory 29, 1983) proved that no mechanism can guarantee efficient trade with two-sided private information, and that for uniform values the split-the-difference equilibrium of this game attains the largest expected gains from trade of any mechanism. The numbers 9/329/329/32 and 964vˉ\tfrac{9}{64}\bar v649​vˉ below are therefore the second-best benchmarks against which later work on the kkk-double auction (Satterthwaite and Williams, J. Econ. Theory 48, 1989; Leininger, Linhart and Radner, J. Econ. Theory 48, 1989) measures inefficiency.

Setting

A seller with reservation price vsv_svs​ and a buyer with reservation price vbv_bvb​ each know their own value. The two values are drawn independently and uniformly on [0,vˉ][0, \bar v][0,vˉ], with vˉ>0\bar v > 0vˉ>0; this law, written unif(vˉ)\mathrm{unif}(\bar v)unif(vˉ), is also each player's belief about the other's value (Fs(v)=Fb(v)=v/vˉF_s(v) = F_b(v) = v/\bar vFs​(v)=Fb​(v)=v/vˉ in the paper).

Under the Bargaining Rule with parameter k∈[0,1]k \in [0,1]k∈[0,1], the seller asks sss and the buyer offers bbb. If b≥sb \ge sb≥s the good is sold at price P=kb+(1−k)sP = kb + (1-k)sP=kb+(1−k)s, the seller earns P−vsP - v_sP−vs​ and the buyer earns vb−Pv_b - Pvb​−P; otherwise both earn zero. Ties trade.

An offer strategy maps a value to an offer. The strategies of Example 1(a) are

S(vs)=vs2−k+1−k2vˉfor 0≤vs≤2−k2vˉ,S(vs)≥the same expression for 2−k2vˉ<vs≤vˉ,S(v_s) = \frac{v_s}{2-k} + \frac{1-k}{2}\bar v \quad\text{for } 0 \le v_s \le \tfrac{2-k}{2}\bar v, \qquad S(v_s) \ge \text{the same expression for } \tfrac{2-k}{2}\bar v < v_s \le \bar v,S(vs​)=2−kvs​​+21−k​vˉfor 0≤vs​≤22−k​vˉ,S(vs​)≥the same expression for 22−k​vˉ<vs​≤vˉ, B(vb)=vb1+k+k(1−k)2(1+k)vˉfor 1−k2vˉ≤vb≤vˉ,B(vb)≤the same expression for 0≤vb<1−k2vˉ.B(v_b) = \frac{v_b}{1+k} + \frac{k(1-k)}{2(1+k)}\bar v \quad\text{for } \tfrac{1-k}{2}\bar v \le v_b \le \bar v, \qquad B(v_b) \le \text{the same expression for } 0 \le v_b < \tfrac{1-k}{2}\bar v.B(vb​)=1+kvb​​+2(1+k)k(1−k)​vˉfor 21−k​vˉ≤vb​≤vˉ,B(vb​)≤the same expression for 0≤vb​<21−k​vˉ.

A pair (S,B)(S, B)(S,B) with these four properties is said to have the shape of Example 1(a) (IsExample1Pair k v̄ S B). On the two inequality ranges a seller asks too much, or a buyer bids too little, for any trade to occur, so the strategy there is free apart from the bound.

For such a pair, with (vs,vb)∼unif(vˉ)⊗unif(vˉ)(v_s, v_b) \sim \mathrm{unif}(\bar v) \otimes \mathrm{unif}(\bar v)(vs​,vb​)∼unif(vˉ)⊗unif(vˉ), the trade probability is Pr⁡[S(vs)≤B(vb)]\Pr[S(v_s) \le B(v_b)]Pr[S(vs​)≤B(vb​)] (tradeProb), and the ex ante expected profits — taken before either value is drawn, as the paper specifies on p. 843 — are

πs=E[1{S(vs)≤B(vb)} (kB(vb)+(1−k)S(vs)−vs)],πb=E[1{S(vs)≤B(vb)} (vb−kB(vb)−(1−k)S(vs))]\pi_s = \mathbb E\bigl[\mathbf 1\{S(v_s) \le B(v_b)\}\,(kB(v_b) + (1-k)S(v_s) - v_s)\bigr],\qquad \pi_b = \mathbb E\bigl[\mathbf 1\{S(v_s) \le B(v_b)\}\,(v_b - kB(v_b) - (1-k)S(v_s))\bigr]πs​=E[1{S(vs​)≤B(vb​)}(kB(vb​)+(1−k)S(vs​)−vs​)],πb​=E[1{S(vs​)≤B(vb​)}(vb​−kB(vb​)−(1−k)S(vs​))]

(sellerExAnte, buyerExAnte).

Formalization targets

Goal: Example 1(c)(iii), total expected profit

For 0≤k≤10 \le k \le 10≤k≤1, vˉ>0\bar v > 0vˉ>0 and every pair of the shape of Example 1(a),

πs+πb=vˉ16(1+k)(2−k),\pi_s + \pi_b = \frac{\bar v}{16}(1+k)(2-k),πs​+πb​=16vˉ​(1+k)(2−k),

and as a function of k∈[0,1]k \in [0,1]k∈[0,1] this total attains its maximum 964vˉ\tfrac{9}{64}\bar v649​vˉ at k=1/2k = 1/2k=1/2. The goal is the paper's efficiency statement: among these equilibria, splitting the difference maximises expected group profit.

Milestones

  1. Example 1(b). Pr⁡[S(vs)≤B(vb)]=−k2+k+28\Pr[S(v_s) \le B(v_b)] = \dfrac{-k^2 + k + 2}{8}Pr[S(vs​)≤B(vb​)]=8−k2+k+2​, with maximum 9/329/329/32 at k=1/2k = 1/2k=1/2.
  2. Example 1(c)(i). πs(k)=vˉ48(2−k)2(1+k)\pi_s(k) = \dfrac{\bar v}{48}(2-k)^2(1+k)πs​(k)=48vˉ​(2−k)2(1+k), strictly decreasing in kkk on [0,1][0,1][0,1].
  3. Example 1(c)(ii). πb(k)=vˉ48(1+k)2(2−k)\pi_b(k) = \dfrac{\bar v}{48}(1+k)^2(2-k)πb​(k)=48vˉ​(1+k)2(2−k), strictly increasing in kkk on [0,1][0,1][0,1].

The goal is the sum of milestones 2 and 3 together with a one-variable maximisation; milestone 1 describes the trade region over which both profits are integrated.

Significance

The formulas answer the design question for the rule. Moving kkk toward the buyer's offer makes the price rule look more favourable to the seller, yet milestone 2 shows the seller's equilibrium profit falls and milestone 3 shows the buyer's rises: the paper (p. 844) uses this to show that an intuition which ignores the players' strategic response is mistaken. The comparison with truthful offers, which would trade with probability 1/21/21/2 and earn expected group profit vˉ/6\bar v/6vˉ/6, quantifies the cost of strategic misrepresentation: at best 9/329/329/32 and 964vˉ\tfrac{9}{64}\bar v649​vˉ.

The paper states these results as "straightforward computations" and prints no derivation. As far as is known, none of them has a machine-checked proof. A formalization settles the constants against the exact strategies of Example 1(a), including the non-linear no-trade branches the paper allows, and provides a worked example of computing trade probabilities and expected payoffs under a product of uniform laws, reusable for other double-auction and bilateral-trade examples.

Difficulty

The computation is elementary on paper, but the equilibrium strategies are only partly specified: on the seller's high range and the buyer's low range the offers are arbitrary functions subject to a bound, and need not be measurable. The obvious approach — substitute the linear formulas and integrate — is valid only after showing that these free branches never trade, so that the trade event and both integrands agree almost everywhere with their linear versions. The resulting integrals are over a product of two conditioned Lebesgue measures, not over Lebesgue measure on the plane, and the trade region depends on kkk through both strategies. The monotonicity claims hold only on [0,1][0,1][0,1] (the seller's cubic is not monotone on R\mathbb RR), and the derivative of each profit vanishes at an endpoint of the interval.

Formalization scope

Values are real numbers; the uniform law on [0,vˉ][0, \bar v][0,vˉ] is Lebesgue measure conditioned on the interval (volume[|Icc 0 v̄]), and the joint law of (vs,vb)(v_s, v_b)(vs​,vb​) is the product measure, with pairs ordered (vs,vb)(v_s, v_b)(vs​,vb​). The trade probability is the real number (P {p | S p.1 ≤ B p.2}).toReal; the profits are Bochner integrals over the product. Ties trade. The results are ex ante, not conditional on a player's own value. Every theorem assumes 0≤k≤10 \le k \le 10≤k≤1 and vˉ>0\bar v > 0vˉ>0. Maxima are stated with IsMaxOn on [0,1][0,1][0,1] plus the value at k=1/2k = 1/2k=1/2; monotonicity with StrictAntiOn/StrictMonoOn on [0,1][0,1][0,1].

The statements do not assume that (S,B)(S, B)(S,B) is an equilibrium; they are computations about any pair of the shape of Example 1(a). That this pair is an equilibrium is Example 1(a) itself, the goal of a companion mission. No measurability of SSS or BBB is assumed: the free branches never trade, so each integrand agrees almost everywhere with a bounded measurable function and the integrals are the paper's expectations. A formalization that assumes SSS and BBB linear everywhere, or that integrates over a single uniform variable, proves a different statement.

A complete development needs: the reduction of the trade event and the integrands to their linear versions on [0,vˉ]2[0,\bar v]^2[0,vˉ]2; Fubini for the product of conditioned measures; evaluation of polynomial integrals over a triangle; and elementary calculus on cubics. Lemmas on integrating over products of uniform laws are reusable. Contributions of intermediate lemmas, such as the explicit trade region, are welcome.

Selected references

  • K. Chatterjee and W. Samuelson, Bargaining under Incomplete Information, Operations Research 31(5):835–851, 1983. https://doi.org/10.1287/opre.31.5.835
  • R. B. Myerson and M. A. Satterthwaite, Efficient Mechanisms for Bilateral Trading, Journal of Economic Theory 29(2):265–281, 1983. https://doi.org/10.1016/0022-0531(83)90048-0
  • M. A. Satterthwaite and S. R. Williams, Bilateral Trade with the Sealed Bid k-Double Auction: Existence and Efficiency, Journal of Economic Theory 48(1):107–133, 1989. https://doi.org/10.1016/0022-0531(89)90120-8
  • W. Leininger, P. B. Linhart and R. Radner, Equilibria of the Sealed-Bid Mechanism for Bargaining with Incomplete Information, Journal of Economic Theory 48(1):63–106, 1989. https://doi.org/10.1016/0022-0531(89)90121-X
11 thms2 active usersReviewed
🏆Completed
Convex OptimizationOperations ResearchOptimization+1·Captain: mikedeng1

Random Gradient-Free Minimization of Convex Functions II: Random Gradient Descent for Smooth and Strongly Convex ProblemsResearch Paper

Motivation

Many optimization problems in engineering, simulation-based design and machine learning give access to the objective only through its values: the function is computed by a black-box code, and derivatives are unavailable or too expensive to program. Zeroth-order (derivative-free) methods address this setting. Classical derivative-free methods (pattern search, Nelder–Mead, model-based trust regions) come with weak or no global complexity guarantees for convex problems.

Nesterov and Spokoiny (Found. Comput. Math. 17 (2017) 527–566) showed that replacing the gradient by a finite difference along a random Gaussian direction yields methods whose expected complexity is that of the corresponding gradient method multiplied by a factor proportional to the dimension. Their paper is a standard reference for zeroth-order convex optimization and for Gaussian smoothing, and its oracle and analysis are reused in bandit convex optimization, zeroth-order stochastic optimization (e.g. Ghadimi–Lan 2013) and derivative-free reinforcement learning.

This mission concerns Section 5 of the paper: the random gradient method RGμ\mathcal{RG}_\muRGμ​ for smooth convex functions and its linear rate for strongly convex ones.

Setting

Let EEE be a real inner product space of finite dimension nnn, with norm ∥⋅∥\|\cdot\|∥⋅∥. (The paper works with a space carrying an operator B=B∗≻0B = B^* \succ 0B=B∗≻0 and norm ∥x∥=⟨Bx,x⟩1/2\|x\| = \langle Bx, x\rangle^{1/2}∥x∥=⟨Bx,x⟩1/2; choosing ⟨B⋅,⋅⟩\langle B\cdot,\cdot\rangle⟨B⋅,⋅⟩ as the inner product gives exactly this setting, and the dual norm ∥⋅∥∗\|\cdot\|_*∥⋅∥∗​ becomes the norm of the Riesz representative.)

A function f:E→Rf : E \to \mathbb Rf:E→R belongs to C1,1(E)C^{1,1}(E)C1,1(E) with constant L1L_1L1​ if it is differentiable and ∥∇f(x)−∇f(y)∥≤L1∥x−y∥\|\nabla f(x) - \nabla f(y)\| \le L_1\|x - y\|∥∇f(x)−∇f(y)∥≤L1​∥x−y∥ for all x,yx, yx,y. It is strongly convex with parameter τ>0\tau > 0τ>0 if f(y)≥f(x)+⟨∇f(x),y−x⟩+τ2∥y−x∥2f(y) \ge f(x) + \langle \nabla f(x), y - x\rangle + \frac{\tau}{2}\|y-x\|^2f(y)≥f(x)+⟨∇f(x),y−x⟩+2τ​∥y−x∥2 for all x,yx, yx,y.

Let uuu be a standard Gaussian vector of EEE (coordinates in any orthonormal basis are independent N(0,1)N(0,1)N(0,1)). The Gaussian approximation of fff with parameter μ≥0\mu \ge 0μ≥0 is fμ(x)=Euf(x+μu)f_\mu(x) = \mathbb E_u f(x + \mu u)fμ​(x)=Eu​f(x+μu), and the moments are Mp=Eu∥u∥pM_p = \mathbb E_u\|u\|^pMp​=Eu​∥u∥p. The random gradient-free oracle returns, for a sampled direction uuu,

B−1gμ(x)=f(x+μu)−f(x)μ u(μ>0),B−1g0(x)=f′(x,u) u,B^{-1}g_\mu(x) = \frac{f(x+\mu u) - f(x)}{\mu}\, u \quad (\mu > 0), \qquad B^{-1}g_0(x) = f'(x,u)\, u,B−1gμ​(x)=μf(x+μu)−f(x)​u(μ>0),B−1g0​(x)=f′(x,u)u,

and the symmetric oracle is B−1g^μ(x)=f(x+μu)−f(x−μu)2μuB^{-1}\hat g_\mu(x) = \frac{f(x+\mu u) - f(x - \mu u)}{2\mu}uB−1g^​μ​(x)=2μf(x+μu)−f(x−μu)​u.

Consider f∗=min⁡x∈Ef(x)f^* = \min_{x\in E} f(x)f∗=minx∈E​f(x) for a convex f∈C1,1(E)f \in C^{1,1}(E)f∈C1,1(E), assumed solvable with a minimizer x∗x^*x∗, and n≥2n \ge 2n≥2. The random gradient method RGμ\mathcal{RG}_\muRGμ​ (Eq. (54), p. 546) is:

Method RGμ\mathcal{RG}_\muRGμ​: Choose x0∈Ex_0 \in Ex0​∈E. Iteration k≥0k \ge 0k≥0. a). Generate uku_kuk​ and corresponding gμ(xk)g_\mu(x_k)gμ​(xk​). b). Compute xk+1=xk−hB−1gμ(xk)x_{k+1} = x_k - hB^{-1}g_\mu(x_k)xk+1​=xk​−hB−1gμ​(xk​).

The directions u0,u1,…u_0, u_1, \dotsu0​,u1​,… are independent standard Gaussian vectors, and ϕk=Ef(xk)\phi_k = \mathbb E f(x_k)ϕk​=Ef(xk​) (with ϕ0=f(x0)\phi_0 = f(x_0)ϕ0​=f(x0​)).

Formalization targets

Goal: Theorem 8 (p. 546)

With step size h=14(n+4)L1h = \frac{1}{4(n+4)L_1}h=4(n+4)L1​1​ and any μ≥0\mu \ge 0μ≥0, for every N≥0N \ge 0N≥0,

1N+1∑k=0N(ϕk−f∗)≤4(n+4)L1∥x0−x∗∥2N+1+9μ2(n+4)2L125,\frac{1}{N+1}\sum_{k=0}^{N}(\phi_k - f^*) \le \frac{4(n+4)L_1\|x_0-x^*\|^2}{N+1} + \frac{9\mu^2(n+4)^2L_1}{25},N+11​k=0∑N​(ϕk​−f∗)≤N+14(n+4)L1​∥x0​−x∗∥2​+259μ2(n+4)2L1​​,

and, if fff is strongly convex with parameter τ>0\tau > 0τ>0, then with δμ=18μ2(n+4)225τL1\delta_\mu = \frac{18\mu^2(n+4)^2}{25\tau}L_1δμ​=25τ18μ2(n+4)2​L1​,

ϕN−f∗≤12L1[δμ+(1−τ8(n+4)L1)N(∥x0−x∗∥2−δμ)].\phi_N - f^* \le \frac12 L_1\left[\delta_\mu + \left(1 - \frac{\tau}{8(n+4)L_1}\right)^{N}\big(\|x_0-x^*\|^2 - \delta_\mu\big)\right].ϕN​−f∗≤21​L1​[δμ​+(1−8(n+4)L1​τ​)N(∥x0​−x∗∥2−δμ​)].

Both bounds are one theorem with one proof in the paper, so the goal states their conjunction, with every constant as printed.

Milestones

The milestones are the results the paper's proof of Theorem 8 rests on, in attack order:

  1. Lemma 1 (p. 534): Mp≤np/2M_p \le n^{p/2}Mp​≤np/2 for p∈[0,2]p \in [0,2]p∈[0,2] and np/2≤Mp≤(p+n)p/2n^{p/2} \le M_p \le (p+n)^{p/2}np/2≤Mp​≤(p+n)p/2 for p≥2p \ge 2p≥2.
  2. Theorem 3.1, (32) (p. 537): Eu∥g0(x)∥∗2≤(n+4)∥∇f(x)∥∗2\mathbb E_u\|g_0(x)\|_*^2 \le (n+4)\|\nabla f(x)\|_*^2Eu​∥g0​(x)∥∗2​≤(n+4)∥∇f(x)∥∗2​ at a point of differentiability.
  3. Theorem 4.2, (35) (p. 538): Eu∥gμ(x)∥∗2≤μ22L12(n+6)3+2(n+4)∥∇f(x)∥∗2\mathbb E_u\|g_\mu(x)\|_*^2 \le \frac{\mu^2}{2}L_1^2(n+6)^3 + 2(n+4)\|\nabla f(x)\|_*^2Eu​∥gμ​(x)∥∗2​≤2μ2​L12​(n+6)3+2(n+4)∥∇f(x)∥∗2​, and the same with μ28\frac{\mu^2}{8}8μ2​ for g^μ\hat g_\mug^​μ​.
  4. Eq. (21) (pp. 534–535): for μ>0\mu > 0μ>0, fμf_\mufμ​ is differentiable with ∇fμ(x)=EuB−1gμ(x)\nabla f_\mu(x) = \mathbb E_u B^{-1}g_\mu(x)∇fμ​(x)=Eu​B−1gμ​(x).
  5. Eq. (25) (p. 535): Eu⟨∇f(x),u⟩u=∇f(x)\mathbb E_u \langle\nabla f(x), u\rangle u = \nabla f(x)Eu​⟨∇f(x),u⟩u=∇f(x), the μ=0\mu = 0μ=0 counterpart.
  6. Convexity of fμf_\mufμ​ (p. 533) and Eq. (11): f≤fμf \le f_\muf≤fμ​ for convex fff.
  7. Theorem 1, (19) (p. 534): ∣fμ(x)−f(x)∣≤μ22L1n|f_\mu(x) - f(x)| \le \frac{\mu^2}{2}L_1 n∣fμ​(x)−f(x)∣≤2μ2​L1​n.

Significance

The result. Theorem 8 shows that a method using two function values per iteration reaches accuracy ϵ\epsilonϵ on a smooth convex problem in O(nϵL1∥x0−x∗∥2)O(\frac{n}{\epsilon}L_1\|x_0 - x^*\|^2)O(ϵn​L1​∥x0​−x∗∥2) iterations, and in O(nL1τln⁡L1∥x0−x∗∥2ϵ)O(\frac{nL_1}{\tau}\ln\frac{L_1\|x_0-x^*\|^2}{\epsilon})O(τnL1​​lnϵL1​∥x0​−x∗∥2​) iterations under strong convexity, provided μ\muμ is small enough. This is nnn times the complexity of the deterministic gradient method, which is the natural price for replacing an nnn-dimensional gradient by one directional estimate. The strongly convex bound makes explicit the bias floor 12L1δμ\frac12 L_1\delta_\mu21​L1​δμ​ caused by the finite-difference step, and shows that it vanishes for the limiting method RG0\mathcal{RG}_0RG0​.

Formalizing it. The result is proved in the paper; nothing here is open. To our knowledge none of it has a machine-checked proof. A formalization produces a reusable Gaussian-smoothing layer on Mathlib's stdGaussian (moments of the Gaussian norm, differentiation of fμf_\mufμ​ under the integral, variance bounds of random oracles) and a complete expected-complexity proof of a randomized first-order method, in which the probabilistic structure (independent directions, iterates depending only on past directions, tower property) has to be handled explicitly.

Difficulty

The deterministic part of the argument is the textbook analysis of gradient descent. The difficulty is in the Gaussian facts it uses. The obvious bound on the oracle's second moment, E⟨∇f(x),u⟩2∥u∥2≤∥∇f(x)∥2M4≤(n+4)2∥∇f(x)∥2\mathbb E\langle\nabla f(x),u\rangle^2\|u\|^2 \le \|\nabla f(x)\|^2 M_4 \le (n+4)^2\|\nabla f(x)\|^2E⟨∇f(x),u⟩2∥u∥2≤∥∇f(x)∥2M4​≤(n+4)2∥∇f(x)∥2, loses a factor of nnn and would give a quadratic dependence on dimension; the (n+4)(n+4)(n+4) of (32) needs a sharper computation. The moment bounds of Lemma 1 for non-integer ppp and the differentiation under the integral in (21) are measure-theoretic steps that Mathlib does not package. Finally, the step from per-iteration inequalities to bounds on ϕk\phi_kϕk​ requires conditioning on the past directions, which must be set up on a probability space carrying the whole sequence u0,u1,…u_0, u_1, \dotsu0​,u1​,….

Formalization scope

EEE is an arbitrary finite-dimensional real inner product space with MeasurableSpace and BorelSpace, nnn is Module.finrank ℝ E, and ∇f\nabla f∇f is Mathlib's gradient. Expectations over uuu are Bochner integrals against ProbabilityTheory.stdGaussian E. A run of RGμ\mathcal{RG}_\muRGμ​ lives on a probability space (Ω,P)(\Omega, P)(Ω,P): measurable directions uku_kuk​, jointly independent (iIndepFun) with law stdGaussian E, iterates with x0x_0x0​ deterministic and the update holding for every kkk and outcome. ϕk\phi_kϕk​ is ∫ ω, f (x k ω) ∂P. The oracle is defined by cases, with f′(x,u)uf'(x,u)uf′(x,u)u at μ=0\mu = 0μ=0 (f′(x,u)f'(x,u)f′(x,u) the one-sided directional derivative of Eq. (23), a Filter.limUnder, which equals fderiv ℝ f x u for differentiable fff), so the goal covers every μ≥0\mu \ge 0μ≥0 as the paper claims. L1L_1L1​ and τ\tauτ are any constants satisfying the defining inequalities. The standing assumptions of Section 5 (convexity, a global minimizer x∗x^*x∗, n≥2n \ge 2n≥2) and L1>0L_1 > 0L1​>0 are explicit hypotheses; n≥2n \ge 2n≥2 is needed for the constant 9/259/259/25.

A trivializing formalization is ruled out: the oracle is the random finite difference along i.i.d. standard Gaussian directions, not the true gradient (which would be deterministic gradient descent), and every expectation in the statements is of a quantity that is integrable under the stated hypotheses, so no bound holds through a junk value of a non-integrable integral.

A complete development needs Gaussian moment computations in finite dimension, differentiation under the integral sign for fμf_\mufμ​, the variance bounds of the oracles, and a conditional-expectation argument for the iteration. The smoothing layer is reusable for the companion missions on random search for nonsmooth problems and on the accelerated random method, and for other zeroth-order methods. Contributions of any of the milestones, of general Gaussian-integrability lemmas, or of alternative proofs are welcome.

Selected references

  • Yu. Nesterov, V. Spokoiny, Random Gradient-Free Minimization of Convex Functions, Foundations of Computational Mathematics 17(2):527–566, 2017. https://doi.org/10.1007/s10208-015-9296-2
  • S. Ghadimi, G. Lan, Stochastic First- and Zeroth-Order Methods for Nonconvex Stochastic Programming, SIAM Journal on Optimization 23(4):2341–2368, 2013. https://doi.org/10.1137/120880811
  • Yu. Nesterov, Introductory Lectures on Convex Optimization: A Basic Course, Kluwer, 2004. https://doi.org/10.1007/978-1-4419-8853-9
14 thms4 active usersReviewed
🏆Completed
Linear OptimizationOperations ResearchOptimization·Captain: mikedeng1

Revenue Management Under the Markov Chain Choice Model IV: Dimension Reduction Recovers a Choice-Based Solution with at Most n+1 Nested Offer SetsResearch Paper

Motivation

In network revenue management a firm sells nnn products that consume mmm capacitated resources over TTT periods, and in each period it chooses which offer set of products to make available. When customers choose among the offered products according to a choice model, the standard planning tool is the choice-based linear program, which assigns a frequency uS≥0u_S\ge 0uS​≥0 to every offer set S⊆NS\subseteq NS⊆N (Liu and van Ryzin 2008). It has 2n2^n2n variables. Its optimal solution is what the firm actually implements: a randomization over offer sets.

For the Markov chain choice model of Blanchet, Gallego and Goyal (2016), Feldman and Topaloglu (2017) show that the choice-based program is equivalent to a reduced linear program with only 2n2n2n variables. The reduced program can be solved directly, but its solution is a pair of vectors (x^,z^)(\hat x,\hat z)(x^,z^), not a randomization over offer sets. This mission formalizes the paper's Section 7, which converts the reduced solution back into a randomization over offer sets: the Dimension Reduction algorithm, and Theorem 9, which says that the algorithm produces at most n+1n+1n+1 offer sets and that these sets are nested.

Setting

Products are indexed by N={1,…,n}N=\{1,\dots,n\}N={1,…,n}. A customer arrives wanting product jjj with probability λj\lambda_jλj​. If the product she visits is offered, she buys it. Otherwise she moves to product iii with probability ρj,i\rho_{j,i}ρj,i​, and leaves without buying with probability 1−∑i∈Nρj,i1-\sum_{i\in N}\rho_{j,i}1−∑i∈N​ρj,i​. Throughout, λj>0\lambda_j>0λj​>0, ρj,i≥0\rho_{j,i}\ge0ρj,i​≥0 and ∑i∈Nρj,i<1\sum_{i\in N}\rho_{j,i}<1∑i∈N​ρj,i​<1 for all j,ij,ij,i.

For an offer set S⊆NS\subseteq NS⊆N, the (Balance) equations

Pj,S+Rj,S=λj+∑i∈Nρi,jRi,S  ∀j∈N,Pj,S=0  ∀j∉S,Rj,S=0  ∀j∈SP_{j,S}+R_{j,S}=\lambda_j+\sum_{i\in N}\rho_{i,j}R_{i,S}\ \ \forall j\in N,\qquad P_{j,S}=0\ \ \forall j\notin S,\qquad R_{j,S}=0\ \ \forall j\in SPj,S​+Rj,S​=λj​+i∈N∑​ρi,j​Ri,S​  ∀j∈N,Pj,S​=0  ∀j∈/S,Rj,S​=0  ∀j∈S

have a unique solution. Pj,SP_{j,S}Pj,S​ is the probability that product jjj is purchased, and Rj,SR_{j,S}Rj,S​ is the expected number of visits to jjj while it is not offered. Write PS=(Pj,S)jP_S=(P_{j,S})_jPS​=(Pj,S​)j​ and RS=(Rj,S)jR_S=(R_{j,S})_jRS​=(Rj,S​)j​.

The set H\mathcal HH consists of all pairs (x,z)∈Rn×Rn(x,z)\in\mathbb R^n\times\mathbb R^n(x,z)∈Rn×Rn with x,z≥0x,z\ge0x,z≥0 and xj+zj=λj+∑iρi,jzix_j+z_j=\lambda_j+\sum_{i}\rho_{i,j}z_ixj​+zj​=λj​+∑i​ρi,j​zi​ for all jjj. The (Reduced) linear program maximizes ∑jTrjxj\sum_j T r_j x_j∑j​Trj​xj​ over (x,z)∈H(x,z)\in\mathcal H(x,z)∈H subject to the capacity rows ∑jTaq,jxj≤cq\sum_j T a_{q,j}x_j\le c_q∑j​Taq,j​xj​≤cq​ for each resource qqq.

The Dimension Reduction algorithm starts from the optimal solution (x^,z^)(\hat x,\hat z)(x^,z^) of (Reduced) and sets (x1,z1)=(x^,z^)(x^1,z^1)=(\hat x,\hat z)(x1,z1)=(x^,z^). At iteration kkk it forms Sk={j:xjk>0}S^k=\{j: x^k_j>0\}Sk={j:xjk​>0}. It stops with αk=1\alpha^k=1αk=1 if Sk=∅S^k=\emptysetSk=∅. Otherwise it sets αk=min⁡{xjk/Pj,Sk:j∈Sk}\alpha^k=\min\{x^k_j/P_{j,S^k}: j\in S^k\}αk=min{xjk​/Pj,Sk​:j∈Sk}, stops if αk=1\alpha^k=1αk=1, and if not updates

xjk+1=xjk−αkPj,Sk1−αk,zjk+1=zjk−αkRj,Sk1−αk.x^{k+1}_j=\frac{x^k_j-\alpha^kP_{j,S^k}}{1-\alpha^k},\qquad z^{k+1}_j=\frac{z^k_j-\alpha^kR_{j,S^k}}{1-\alpha^k}.xjk+1​=1−αkxjk​−αkPj,Sk​​,zjk+1​=1−αkzjk​−αkRj,Sk​​.

The weights are γk=(1−α1)⋯(1−αk−1)αk\gamma^k=(1-\alpha^1)\cdots(1-\alpha^{k-1})\alpha^kγk=(1−α1)⋯(1−αk−1)αk.

Formalization targets

Goal: Theorem 9

Let (x^,z^)(\hat x,\hat z)(x^,z^) be optimal for (Reduced). The algorithm stops at some first iteration KKK with 1≤K≤n+11\le K\le n+11≤K≤n+1. At that KKK,

x^=∑k=1KγkPSk,z^=∑k=1KγkRSk,∑k=1Kγk=1,S1⊇S2⊇⋯⊇SK.\hat x=\sum_{k=1}^K\gamma^kP_{S^k},\qquad \hat z=\sum_{k=1}^K\gamma^kR_{S^k},\qquad \sum_{k=1}^K\gamma^k=1,\qquad S^1\supseteq S^2\supseteq\cdots\supseteq S^K .x^=k=1∑K​γkPSk​,z^=k=1∑K​γkRSk​,k=1∑K​γk=1,S1⊇S2⊇⋯⊇SK.

Milestones

In the order the proof uses them:

  1. (Balance) has a unique, nonnegative solution for every SSS (p. 1325).
  2. Pj,S>0P_{j,S}>0Pj,S​>0 for j∈Sj\in Sj∈S (p. 1325).
  3. For (x^,z^)∈H(\hat x,\hat z)\in\mathcal H(x^,z^)∈H: z^j≥Rj,Sx^\hat z_j\ge R_{j,S_{\hat x}}z^j​≥Rj,Sx^​​. This is Lemma 11 of the online appendix, as quoted on p. 1332.
  4. For (x^,z^)∈H(\hat x,\hat z)\in\mathcal H(x^,z^)∈H with nonempty support: αx^≤1\alpha_{\hat x}\le1αx^​≤1 (p. 1332).
  5. The two stopping configurations are (Balance) solutions: Sx^=∅S_{\hat x}=\emptysetSx^​=∅ gives (P∅,R∅)(P_\emptyset,R_\emptyset)(P∅​,R∅​), and αx^=1\alpha_{\hat x}=1αx^​=1 gives (PSx^,RSx^)(P_{S_{\hat x}},R_{S_{\hat x}})(PSx^​​,RSx^​​) (p. 1332).
  6. Lemma 8: one step of the algorithm maps H\mathcal HH into H\mathcal HH and removes a minimizing index from the support (p. 1333).
  7. The iterates stay in H\mathcal HH, and Sk+1⊆Sk∖{jk}S^{k+1}\subseteq S^k\setminus\{j^k\}Sk+1⊆Sk∖{jk} (pp. 1333–1334).

Significance

Theorem 9 makes the reduced program usable. Together with the equivalence of (Reduced) and the choice-based program, it produces an optimal choice-based solution that offers at most n+1n+1n+1 sets. By a basic-solution count the choice-based program has an optimal solution with at most m+1m+1m+1 nonzero offer sets. Theorem 9 bounds the number by the number of products instead, and adds a structural property: the offered sets form a chain. Each set is contained in the previous one, so the implemented policy offers a single nested sequence of assortments. The algorithm needs at most n+1n+1n+1 solutions of linear systems of size nnn. It never enumerates offer sets.

The result is proved in the paper. As far as a search of the platform and of Mathlib shows, it has not been formalized. Mathlib's Carathéodory theorem (Analysis/Convex/Caratheodory) bounds the number of points in a convex combination. It does not construct this decomposition, and it does not give nestedness. Formalizing Theorem 9 therefore requires the paper's argument: a verified, terminating peeling procedure on the polyhedron H\mathcal HH whose output is a convex combination of (Balance) solutions indexed by a chain of sets.

Difficulty

The algorithm divides twice. Step 2 divides by Pj,SkP_{j,S^k}Pj,Sk​, which must be positive on SkS^kSk. Step 3 divides by 1−αk1-\alpha^k1−αk, which must be nonzero whenever the algorithm continues. Both rest on nontrivial facts: the positivity of purchase probabilities, and the bound α≤1\alpha\le1α≤1 on H\mathcal HH. That bound in turn requires the comparison z^≥RSx^\hat z\ge R_{S_{\hat x}}z^≥RSx^​​. The paper proves this comparison only in its online appendix; it is a monotonicity property of the inverse of I−ρ⊤I-\rho^\topI−ρ⊤ restricted to the unoffered products. The update of Step 3 can make coordinates of zzz negative unless this comparison holds, so the naive observation that "(xk,zk)(x^k,z^k)(xk,zk) is a combination of points of H\mathcal HH" does not by itself keep the iterates in H\mathcal HH.

Termination is not a consequence of αk<1\alpha^k<1αk<1 alone. It needs the strict decrease of the support, which comes from choosing a minimizing index. The weights γk\gamma^kγk are defined by products of the (1−αl)(1-\alpha^l)(1−αl). Their sum telescopes to 111 only because the last step has αK=1\alpha^K=1αK=1.

Formalization scope

Everything lives in the namespace MarkovChainChoice.DimReduction. Products are Fin n and offer sets are Finset (Fin n). The model is a structure carrying λj>0\lambda_j>0λj​>0, ∑iρj,i<1\sum_i\rho_{j,i}<1∑i​ρj,i​<1 and, as a disclosed implicit hypothesis, ρj,i≥0\rho_{j,i}\ge0ρj,i​≥0. The pair (PS,RS)(P_S,R_S)(PS​,RS​) is chosen by Classical.epsilon among the solutions of (Balance); milestone 1 is what identifies it with the paper's unique solution. Revenues, capacities and consumptions carry no sign conditions. "Optimal for (Reduced)" means feasible and at least as good as every feasible point.

The iterates are indexed from k=1k=1k=1 as in the paper. The value at index 000 is an unused copy of the input. "The algorithm stops at iteration KKK" is the first K≥1K\ge1K≥1 with SK=∅S^K=\emptysetSK=∅ or αK=1\alpha^K=1αK=1. Iterates after the first stop involve a division by zero, which Lean evaluates to 000, and no statement refers to them. The termination bound K≤n+1K\le n+1K≤n+1 is a conclusion of the goal, not a hypothesis. The goal is about the algorithm's actual iterates, not about an arbitrary sequence that satisfies the invariants. The paper's ⊂\subset⊂ and ⊃\supset⊃ denote non-strict inclusion and are rendered as ⊆\subseteq⊆ and ⊇\supseteq⊇.

Two milestones are stated more generally than the page. The paper states the iteration invariants for the (Reduced) optimum; the Lean requires only (x^,z^)∈H(\hat x,\hat z)\in\mathcal H(x^,z^)∈H, which every feasible (Reduced) solution satisfies. Lemma 8's arg⁡min⁡\arg\minargmin may be a set; the statement holds for every minimizer. The page contains printed slips: on p. 1332, v^j\hat v_jv^j​ has numerator x^j−αRj,S\hat x_j-\alpha R_{j,S}x^j​−αRj,S​, and the paper writes Rx^R_{\hat x}Rx^​ for RSx^R_{S_{\hat x}}RSx^​​. The Lean uses the correct forms, as in Lemma 8 and Step 3. None of these slips appears in a milestone quotation.

A complete development needs a small theory of M-matrices, in the form of nonnegativity of (I−Q)−1(I-Q)^{-1}(I−Q)−1 for substochastic QQQ, together with finite induction on supports. The comparison lemma (milestone 3) and the (Balance) existence and uniqueness result (milestone 1) are reusable across the other missions on this paper. Proofs of any milestone are welcome, as are alternative proofs of the goal.

Selected references

  • J. B. Feldman, H. Topaloglu, Revenue Management Under the Markov Chain Choice Model, Operations Research 65(5):1322–1342, 2017. https://doi.org/10.1287/opre.2017.1628
  • J. Blanchet, G. Gallego, V. Goyal, A Markov Chain Approximation to Choice Modeling, Operations Research 64(4):886–905, 2016. https://doi.org/10.1287/opre.2016.1505
  • Q. Liu, G. van Ryzin, On the Choice-Based Linear Programming Model for Network Revenue Management, Manufacturing & Service Operations Management 10(2):288–310, 2008. https://doi.org/10.1287/msom.1070.0169
14 thms2 active usersReviewed
PreviousNext

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me