Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in
← Collections

The OR Formalization Drive

Help us formalize the operations research literature in Lean.

1094 missions

Missions

1001–1020 of 1094
OpenCompletedAll
Operations ResearchOptimizationProbability+1·Captain: mikedeng1

Optimal Starting Times for End-of-Season Sales and Optimal Stopping Times for Promotional Fares 1: Markdown Is Optimal Once Time-to-Go Falls Below a Strictly Increasing Threshold x_nResearch Paper

Why the timing of a markdown matters

A seller with limited stock can charge a high price while demand is strong and lower the price before the selling season ends. The timing depends on how many units remain: a markdown that is sensible with ample stock may be premature when only one unit is left. Feng and Gallego studied this decision when each price generates a Poisson demand stream and only one price change is allowed. Their 1995 paper proves that the optimal decision has a threshold in remaining time for every inventory level. This mission formalizes their markdown theorem, including its value-function representation, rather than just the existence of a switching rule.

The model is a finite-inventory revenue problem, relevant when an unsold unit loses its value at the end of a season. It is also a continuous-time stopping problem: the seller observes actual sales and may react to them. A fixed calendar date for the markdown cannot describe all of those decisions. The paper treats the markdown case separately from the markup case, because the order of prices, arrival rates and revenue rates reverses the behavior of the switching boundary. The present mission concerns the markdown case alone.

Prices, demand, and admissible switches

Let n≥1n\ge1n≥1 be the initial stock and t≥0t\ge0t≥0 the time to go. The seller first charges price p1p_1p1​ and may change once to a lower price p2p_2p2​. Demands at the two prices are independent Poisson counts with positive rates λ1\lambda_1λ1​ and λ2\lambda_2λ2​. A lower price produces more arrivals, so p2<p1p_2<p_1p2​<p1​ and λ1<λ2\lambda_1<\lambda_2λ1​<λ2​. Feng and Gallego also assume that lowering the price increases the revenue rate: p1λ1<p2λ2p_1\lambda_1<p_2\lambda_2p1​λ1​<p2​λ2​. There is no salvage payment for inventory left when time expires. These conventions come from §2 and the case split on pp. 1375–1376.

Write N1(s)N_1(s)N1​(s) for the observed sales count at the initial price by time sss. If the price changes at deterministic time s∈[0,t]s\in[0,t]s∈[0,t], let J(n,t;s)J(n,t;s)J(n,t;s) be the expected total revenue. The count after the change is independent of N1(s)N_1(s)N1​(s), and their sum has Poisson mean λ1s+λ2(t−s)\lambda_1s+\lambda_2(t-s)λ1​s+λ2​(t−s). The optimal value J(n,t)J(n,t)J(n,t) allows the switch time τ\tauτ to depend on the counts observed so far. An admissible τ\tauτ lies between zero and ttt, is a stopping time for the history of N1N_1N1​, and occurs before stock is exhausted almost surely. At s=0s=0s=0, J(n,t;0)J(n,t;0)J(n,t;0) is the revenue from charging p2p_2p2​ immediately. The paper defines these quantities in §3, pp. 1377–1379.

Formalization targets

The goal is Theorem 1, p. 1380. It asserts a strictly increasing sequence x1<x2<⋯x_1<x_2<\cdotsx1​<x2​<⋯ of inventory-dependent thresholds. When t≤xnt\le x_nt≤xn​, switching immediately earns the optimal value; when t>xnt>x_nt>xn​, a correction F(n,t)F(n,t)F(n,t) is added:

J(n,t)={J(n,t;0),t≤xn,J(n,t;0)+F(n,t),t>xn.J(n,t)=\begin{cases} J(n,t;0),&t\le x_n,\\ J(n,t;0)+F(n,t),&t>x_n. \end{cases}J(n,t)={J(n,t;0),J(n,t;0)+F(n,t),​t≤xn​,t>xn​.​

The theorem specifies the correction, rather than leaving it as an arbitrary difference of values. It starts with F(0,t)=0F(0,t)=0F(0,t)=0. For n≥1n\ge1n≥1, set L(n,t)=G(n,t)+λ1F(n−1,t)L(n,t)=G(n,t)+\lambda_1F(n-1,t)L(n,t)=G(n,t)+λ1​F(n−1,t), where GGG is the Poisson-tail expression from §4.1. The threshold xnx_nxn​ is the first nonnegative zero of L(n,⋅)L(n,\cdot)L(n,⋅). A function H(n,⋅)H(n,\cdot)H(n,⋅) satisfies ∂tH=−λ1H+L\partial_tH=-\lambda_1H+L∂t​H=−λ1​H+L for positive time and H(n,xn)=0H(n,x_n)=0H(n,xn​)=0; FFF is zero below xnx_nxn​ and equals HHH at and above it. If yny_nyn​ is the first zero of G(n,⋅)G(n,\cdot)G(n,⋅), the theorem also gives x1=y1x_1=y_1x1​=y1​ and xn<ynx_n<y_nxn​<yn​ for n>1n>1n>1.

Three supporting targets match the source's attack path. Equation (17) differentiates immediate-switch revenue. Lemma 2 gives the zeros and one sign change of GGG in the markdown case. Lemma 1 identifies a value function through differential inequalities and its stopping payoff. Each is recorded with its page-level statement in the milestone list.

What the result provides

The threshold sequence turns an adaptive stopping problem into a state rule: inspect remaining inventory and time to go, then compare time with the corresponding threshold. The value representation supplies the expected-revenue quantity on both sides of that comparison. Strict increase means a larger stock requires a larger remaining-time threshold before charging the higher initial price is worthwhile. These are the conclusions of Theorem 1, already proved in the paper.

The work here is a Lean statement and eventual machine-checked proof of that known result. The current theorem items are open proof targets. Formalizing the model gives reusable Poisson-tail revenue expressions and a continuous-time stopping-value interface; Lemma 1 can also serve other Poisson-driven stopping problems once proved. A checked proof would establish that the threshold representation and the optimal stopping value agree under the stated assumptions, including boundary cases that informal notation leaves implicit.

Where the mathematics is difficult

The obvious comparison of two fixed switching times misses the information contained in the sales path. The switch decision can change after each observed arrival, while the threshold for inventory nnn depends on the correction at stock n−1n-1n−1. Showing that every such comparison is organized by one increasing threshold requires more than differentiating the fixed-switch revenue. The paper's appendix handles the interaction between the sign of GGG, the recursive correction, and the stopping-value verification; these are distinct formal targets pp. 1387–1388.

The printed verification lemma and one word of Lemma 2 require care. Lemma 1 omits boundary and regularity conditions needed by its proof. Lemma 2 calls the zero sequence “bounded,” although its thresholds tend to infinity; the usable claim is that they stay above a positive lower bound. The formal statements expose these corrections and retain the rest of the source's conclusions.

Formalization scope

Lean represents the first demand stream by a counting process built from independent exponential interarrival times. The terminal revenue after a switch is expressed using the Poisson law of the sum of the two independent counts. The stopping class records the count-generated history, bounds the stopping time by the horizon, and requires stock to remain at stopping almost surely. Its expected payoff uses the number sold before stopping and the immediate-switch value for the unsold stock. Prices and rates are positive, the markdown ordering and revenue-rate inequality are explicit, and the probability measure is named explicitly even though the exponential-interarrival law already entails it.

The paper uses nonnegative real time, inventories indexed by positive integers, and zero salvage. Lean uses a real supremum for the value and a real infimum for each threshold; the admissible payoff is bounded and measurable, and every threshold-defining zero set is asserted nonempty. The ODE is expressed with an actual derivative at positive time. The auxiliary Poisson-tail definition maps a negative mean to zero, but all model applications have nonnegative means. The threshold construction, its ODE, and the equality with the stopping value are all conclusions of the goal, so none is an assumed solution.

For Lemma 1, the formal target adds the initial-time and zero-stock boundary values, domination of terminal revenue, and local Lipschitz regularity in time. The first three conditions are used in the source's own proof or reformulation; local Lipschitz regularity makes its integral calculation valid. Contributions may establish the Poisson-tail calculus, the sign and threshold results, the verification theorem, or the complete markdown theorem. The referenced arrival-process definition is shared infrastructure; the two-price revenue and stopping model are specific to this paper.

Selected references

  • Y. Feng and G. Gallego, Optimal Starting Times for End-of-Season Sales and Optimal Stopping Times for Promotional Fares, Management Science 41(8), 1995, pp. 1371–1391. DOI: 10.1287/mnsc.41.8.1371.
6 thms2 active usersReviewed
🏆Completed
CombinatoricsOperations ResearchTheoretical Computer Science·Captain: mikedeng1

Fibonacci Heaps and Their Uses in Improved Network Optimization Algorithms: O(log n) Amortized Time for Delete Min and Delete, O(1) for Every Other F-Heap OperationResearch Paper

Why priority queues with cheap decrease key matter

Many network optimization algorithms spend most of their time in a heap (priority queue): a set of items with real keys that supports inserting an item, finding and deleting an item of minimum key, melding two heaps, decreasing the key of an item, and deleting an arbitrary item. Dijkstra's shortest-path algorithm performs at most one delete min per vertex and may perform a decrease key for each edge, so on a graph with nnn vertices and mmm edges its running time is governed by how cheap decrease key is. Binomial queues support the heap operations in O(log⁡n)O(\log n)O(logn) worst-case time.

Fredman and Tarjan (J. ACM 34 (1987)) introduced Fibonacci heaps (F-heaps), in which delete min and delete take O(log⁡n)O(\log n)O(logn) amortized time and every other operation, decrease key included, takes O(1)O(1)O(1) amortized time. This brings Dijkstra's algorithm to O(nlog⁡n+m)O(n \log n + m)O(nlogn+m) and improves the best bounds then known for all-pairs shortest paths, weighted bipartite matching (the assignment problem) and minimum spanning trees. F-heaps descend from the binomial queues of Vuillemin (1978) and use the potential technique of amortized analysis of Sleator and Tarjan. This mission formalizes the paper's §2 analysis, culminating in THEOREM 1 on p. 604.

Setting

An F-heap is a list of heap-ordered rooted trees: every child's key is at least its parent's key. Each node holds an item, the item's real key and a mark bit; the children of a node are kept in the order in which they were linked to it, earliest first. The rank r(x)r(x)r(x) of a node is its number of children. A collection is a list of heaps, named by position; a run starts with no heaps.

Linking two trees with roots xxx and yyy makes yyy the last child of xxx if the key of xxx is smaller, and otherwise makes xxx the last child of yyy; the root that becomes a child is unmarked. The operations act as follows:

  • make heap adds an empty heap; find min acts on a nonempty heap and returns a root of minimum key; insert adds a one-node tree for a new item; meld concatenates two root lists.
  • delete min removes a root xxx of minimum key, adds the children of xxx to the roots, then repeats the linking step, "find any two trees whose roots have the same rank, and link them", in any order, until all root ranks are distinct.
  • decrease key (Δ,i,h)(\Delta, i, h)(Δ,i,h), Δ≥0\Delta \ge 0Δ≥0, lowers the key of iii and, if the node xxx of iii is not a root, cuts xxx from its parent, making its subtree a new tree. delete (i,h)(i, h)(i,h) cuts xxx the same way, destroys it and adds its children to the roots; a minimum root is deleted as in delete min.
  • After every cut of a child of ppp, if ppp is not a root it is marked if unmarked and cut from its own parent if marked: a cascading cut, which may repeat upwards.

The actual time of an operation is one unit, plus one per linking step, plus one per cut, plus for delete min the scan of the rank array (the largest rank involved). The potential Φ\PhiΦ of a collection is the number of trees plus twice the number of marked nonroot nodes, and the amortized time of an operation is its actual time plus the increase of Φ\PhiΦ.

Formalization targets

Goal: THEOREM 1 (p. 604)

There is an absolute constant C>0C > 0C>0 such that for every sequence of TTT operations started from no heaps, with ntn_tnt​ the number of items in the heap that operation ttt acts on, just before it acts,

∑t<Tcostt  ≤  ∑t<Tbt,bt={C(log⁡2nt+1)delete min or delete,Cotherwise.\sum_{t<T} \mathrm{cost}_t \;\le\; \sum_{t<T} b_t, \qquad b_t = \begin{cases} C(\log_2 n_t + 1) & \text{delete min or delete},\\ C & \text{otherwise.}\end{cases}t<T∑​costt​≤t<T∑​bt​,bt​={C(log2​nt​+1)C​delete min or delete,otherwise.​

The paper's wording is "the total time is at most the total amortized time, where the amortized time is O(log⁡n)O(\log n)O(logn) for each delete min or delete operation and O(1)O(1)O(1) for each of the other operations"; the goal pins the O(⋅)O(\cdot)O(⋅) to one constant and does not name the potential.

Milestones

  1. LEMMA 1: the iiith child of a node, in linking order, has rank at least i−2i - 2i−2.
  2. Fk+2≥φkF_{k+2} \ge \varphi^kFk+2​≥φk, with FkF_kFk​ the Fibonacci numbers and φ=(1+5)/2\varphi = (1+\sqrt5)/2φ=(1+5​)/2.
  3. COROLLARY 1: a node of rank kkk has at least Fk+2≥φkF_{k+2} \ge \varphi^kFk+2​≥φk descendants, itself included.
  4. A node of rank kkk in an nnn-item heap has φk≤n\varphi^k \le nφk≤n, hence k≤log⁡n/log⁡φk \le \log n / \log\varphik≤logn/logφ.
  5. make heap, find min and meld leave Φ\PhiΦ unchanged; insert raises it by one.
  6. delete min raises Φ\PhiΦ by at most log⁡n/log⁡φ\log n / \log \varphilogn/logφ minus the number of linking steps.
  7. decrease key raises Φ\PhiΦ by at most three minus the number of cascading cuts.
  8. From no heaps, the total amortized time bounds the total actual time.

Significance

THEOREM 1 is the data-structure fact behind the paper's algorithmic results: Dijkstra's algorithm in O(nlog⁡n+m)O(n\log n + m)O(nlogn+m), all-pairs shortest paths and the assignment problem in O(n2log⁡n+nm)O(n^2 \log n + nm)O(n2logn+nm), and minimum spanning trees in O(m β(m,n))O(m\,\beta(m,n))O(mβ(m,n)).

The result has been proved since 1987. What the mission adds is a machine-checked version of the paper's own analysis on an operational model with arbitrary linking order, unmarking on link, marking or cascading on every cut, and the paper's unit costs. The proposal states the theorem and its supporting claims; their proofs remain to be formalized.

Difficulty

The obvious argument, that every tree is a binomial tree and so every rank is at most log⁡2n\log_2 nlog2​n, fails as soon as cuts are allowed: decrease key and delete remove subtrees arbitrarily, and the trees of an F-heap need not be binomial. The rank bound has to come from an invariant of the whole history (LEMMA 1), which only holds because a node loses at most one child before it is cut itself; without cascading cuts a node of rank kkk can be left with only k+1k+1k+1 descendants, and no logarithmic rank bound holds. A second difficulty is that the actual cost of one decrease key is unbounded, since a single operation may trigger arbitrarily many cascading cuts; a per-operation worst-case argument cannot give THEOREM 1, and the bound holds only for whole sequences started from no heaps.

Formalization scope

All declarations sit in the namespace FibHeap.Amort. Trees are a nested inductive FTree with item ℕ, key ℝ, a mark bit and a list of children in linking order; a heap is List FTree (its roots) and a collection is List Heap. Operations are a step relation Step s op s' d whose data d records linking steps, cuts, cascading cuts and the scan, so that cost d = 1 + links + cuts + scan is determined by what the operation did. The linking loop allows every order of linking; a link tie makes the first root a child of the second, while delete min may choose any minimum-key root. Runs start from no heaps; reachable collections consist of heap-ordered trees with each item in at most one heap. LEMMA 1, COROLLARY 1 and the delete-min bound are stated for reachable collections only, as the paper's "a node in an F-heap" intends. The paper's standing assumption that an item is in only one heap at a time is enforced by the precondition of insert and is not a hypothesis. The minimum pointer and returned items are not stored in the step relation; find min is a state-preserving step charged one unit. A heap destroyed by meld remains as an empty heap at its index.

Logarithms in the goal are base 2 (footnote 1, p. 600), with a +1+1+1 so that one-item heaps have positive budget. The paper's constant "≤1.4404log⁡n\le 1.4404 \log n≤1.4404logn" on p. 604 is a rounding slip (1/log⁡2φ=1.44042…1/\log_2 \varphi = 1.44042\ldots1/log2​φ=1.44042…); milestones use the exact log⁡φn\log_\varphi nlogφ​n.

The goal is not trivialized: the cost counts every linking step and every cut as fixed by the step relation, CCC is quantified before the run, and a companion theorem (step_exists) shows that every valid operation can be performed, so runs containing delete min, decrease key and cascading cuts exist. A further supporting statement gives an explicit form of the delete potential bound. A complete development needs facts about the nested inductive (sizes, subtree lists, marked counts under list edits), an invariant for LEMMA 1 recording when each child was linked, and the Fibonacci inequality; contributions of any of these as separate lemmas are welcome.

Selected references

  • M. L. Fredman and R. E. Tarjan, Fibonacci heaps and their uses in improved network optimization algorithms, J. ACM 34(3):596–615, 1987. https://doi.org/10.1145/28869.28874
  • J. Vuillemin, A data structure for manipulating priority queues, Comm. ACM 21(4):309–315, 1978. https://doi.org/10.1145/359460.359478
  • R. E. Tarjan, Amortized computational complexity, SIAM J. Algebraic Discrete Methods 6(2):306–318, 1985. https://doi.org/10.1137/0606031
  • E. W. Dijkstra, A note on two problems in connexion with graphs, Numer. Math. 1:269–271, 1959. https://doi.org/10.1007/BF01386390
10 thms2 active usersReviewed
Algorithmic Game TheoryFunctional AnalysisOperations Research+1·Captain: mikedeng1

A Variational Inequality Formulation of the Dynamic Network User Equilibrium Problem I: Route-Departure Equilibria Are Exactly the Solutions of the Path-Integral Variational InequalityResearch Paper

Motivation

Commuters choose not only a route but also a departure time, trading travel delay against the penalty of arriving early or late. Static traffic assignment, in the tradition of Wardrop's user-equilibrium principle, ignores the time dimension; dynamic traffic assignment adds it, and its central modelling question is what "equilibrium" means when flows, delays and costs all vary over a time horizon. Friesz, Bernstein, Smith, Tobin and Wie (Oper. Res. 41(1), 1993) proposed the simultaneous route-departure (SRD) equilibrium of a path-based dynamic model and showed that it is equivalent to an infinite-dimensional variational inequality. That equivalence is the starting point of a large literature on dynamic user equilibrium: existence theory, solution algorithms and differential-variational formulations all take the variational inequality as their definition of the problem.

Timeline, as far as this mission is concerned:

  • 1952: Wardrop states the static user-equilibrium criterion (equal and minimal travel times on used routes).
  • 1979–1980: Smith and Dafermos formulate static user equilibrium as a finite-dimensional variational inequality.
  • 1989: Friesz, Luque, Tobin and Wie treat dynamic route choice with a fixed departure schedule as an optimal-control problem.
  • 1993: Friesz et al. (this paper) formulate simultaneous route and departure-time equilibrium and prove its equivalence with a variational inequality on (L2[0,T])∣P∣(L^2[0,T])^{|P|}(L2[0,T])∣P∣ (Theorem 2, p. 187).

Setting

A traffic network has a finite set PPP of paths. Each path ppp connects exactly one origin–destination (OD) pair klklkl; PklP_{kl}Pkl​ denotes the paths of pair klklkl. Travellers depart during the horizon [0,T][0,T][0,T], T>0T>0T>0, which carries Lebesgue measure ν\nuν; "∀ν(t)\forall_\nu(t)∀ν​(t)" means "for ν\nuν-almost every t∈[0,T]t\in[0,T]t∈[0,T]".

A vector of departure-time densities h=(hp)p∈Ph=(h_p)_{p\in P}h=(hp​)p∈P​ assigns to each path a square-integrable, almost everywhere nonnegative function hph_php​ on [0,T][0,T][0,T]: hp(t)h_p(t)hp​(t) is the rate at which travellers depart at time ttt on path ppp. The set of such vectors is H+H_+H+​. Each OD pair has a fixed travel demand QklQ_{kl}Qkl​, and the feasible set is

Λ={h∈H+:∑p∈Pkl∫0Thp(t) dν(t)=Qkl for every OD pair kl}.(38)\Lambda=\Big\{h\in H_+ : \sum_{p\in P_{kl}}\int_0^T h_p(t)\,d\nu(t)=Q_{kl}\ \text{for every OD pair } kl\Big\}.\qquad(38)Λ={h∈H+​:p∈Pkl​∑​∫0T​hp​(t)dν(t)=Qkl​ for every OD pair kl}.(38)

A cost operator gives the effective delay Cp(t,h)≥0C_p(t,h)\ge 0Cp​(t,h)≥0 of departing at time ttt on path ppp when the densities are hhh: travel time plus a penalty for early or late arrival (13). Because densities are defined only up to null sets, the relevant lowest achievable cost on a path is an essential infimum,

μp(h)=ess inf⁡{Cp(t,h):t∈[0,T]}=sup⁡{x∈R: ν{t:Cp(t,h)<x}=0},\mu_p(h)=\operatorname{ess\,inf}\{C_p(t,h):t\in[0,T]\}=\sup\{x\in\mathbb R:\ \nu\{t: C_p(t,h)<x\}=0\},μp​(h)=essinf{Cp​(t,h):t∈[0,T]}=sup{x∈R: ν{t:Cp​(t,h)<x}=0},

and the lowest achievable cost for pair klklkl is μkl(h)=min⁡p∈Pklμp(h)\mu_{kl}(h)=\min_{p\in P_{kl}}\mu_p(h)μkl​(h)=minp∈Pkl​​μp​(h).

Definition 3. For h∈Λh\in\Lambdah∈Λ and a nonnegative vector μ=(μkl)\mu=(\mu_{kl})μ=(μkl​), the pair (h,μ)(h,\mu)(h,μ) is an SRD equilibrium if for every OD pair klklkl and every p∈Pklp\in P_{kl}p∈Pkl​:

hp(t)>0 ⇒ Cp(t,h)=μkl∀ν(t),Cp(t,h)≥μkl∀ν(t).h_p(t)>0\ \Rightarrow\ C_p(t,h)=\mu_{kl}\quad\forall_\nu(t),\qquad C_p(t,h)\ge\mu_{kl}\quad\forall_\nu(t).hp​(t)>0 ⇒ Cp​(t,h)=μkl​∀ν​(t),Cp​(t,h)≥μkl​∀ν​(t).

No positive-measure set of travellers can lower its cost by switching route or departure time.

Formalization targets

Goal: Theorem 2 (PIE VIP)

For h∗h^*h∗ with nonnegative, square-integrable costs Cp(⋅,h∗)C_p(\cdot,h^*)Cp​(⋅,h∗):

(∃ μ∗: (h∗,μ∗) SRD equilibrium) ⟹ h∗∈Λ and ∑p∈P∫0TCp(t,h∗) [hp(t)−hp∗(t)] dν(t)≥0  ∀h∈Λ,(39)\big(\exists\,\mu^*:\ (h^*,\mu^*)\ \text{SRD equilibrium}\big)\ \Longrightarrow\ h^*\in\Lambda\ \text{and}\ \sum_{p\in P}\int_0^T C_p(t,h^*)\,[h_p(t)-h^*_p(t)]\,d\nu(t)\ge 0\ \ \forall h\in\Lambda,\qquad(39)(∃μ∗: (h∗,μ∗) SRD equilibrium) ⟹ h∗∈Λ and p∈P∑​∫0T​Cp​(t,h∗)[hp​(t)−hp∗​(t)]dν(t)≥0  ∀h∈Λ,(39)

and conversely, if h∗∈Λh^*\in\Lambdah∗∈Λ solves (39), then (h∗,μ(h∗))(h^*,\mu(h^*))(h∗,μ(h∗)) with μkl∗=μkl(h∗)\mu^*_{kl}=\mu_{kl}(h^*)μkl∗​=μkl​(h∗) is an SRD equilibrium. The formal goal states the two directions as two conjuncts; the second names the equilibrium cost vector explicitly, which is stronger than an equivalence with an existential μ∗\mu^*μ∗.

Milestones

  1. Lemma 2: a measurable function positive on a set of positive measure exceeds some ε0>0\varepsilon_0>0ε0​>0 on a set of positive measure.
  2. The pointwise inequality (42) at an equilibrium, and the necessity half of Theorem 2.
  3. Condition (17) holds by construction for μ∗=μ(h∗)\mu^*=\mu(h^*)μ∗=μ(h∗).
  4. The positive-measure sets (44)–(46) and (47) produced by a failure of (16).
  5. Feasibility (50) of the mass-shifted vector (48)–(49), the value bound (54), and the sufficiency half of Theorem 2.

Significance

The result. Theorem 2 converts an equilibrium defined by almost-everywhere complementarity conditions into a single variational inequality over a convex subset of a Hilbert space. This is what makes dynamic user equilibrium accessible to the general theory of variational inequalities: existence via monotonicity or compactness arguments, and projection-type algorithms in function space or after time discretization. The sufficiency half also identifies the equilibrium cost levels: they are the essential infima μkl(h∗)\mu_{kl}(h^*)μkl​(h∗), so the multiplier μ∗\mu^*μ∗ need not be found separately.

Formalizing it. The theorem is proved in the paper; no machine-checked version is known. A formal proof requires essential infima, the shifting of mass between paths on sets of prescribed measure (the paper cites Halmos, Proposition 41.2, for the nonatomicity of Lebesgue measure), and careful integrability bookkeeping. The development is a self-contained template for "complementarity conditions a.e. ⇔ variational inequality in L2L^2L2" arguments, which recur in continuous-time equilibrium models.

Difficulty

Necessity is routine once integrability is in place, though the paper's text asserts the per-path identity ∫0T[hp−hp∗] dν=0\int_0^T[h_p-h^*_p]\,d\nu=0∫0T​[hp​−hp∗​]dν=0, which is false; only the sum over PklP_{kl}Pkl​ vanishes, and that suffices. Sufficiency is the substantive half. The obvious approach, testing (39) against a perturbation that moves flow from an expensive to a cheap route, has to be carried out with sets rather than points: the costs are only defined almost everywhere, the minimal cost is an essential infimum that need not be attained at any time, and the perturbation must keep the demand constraints exact. This forces the choice of sets of exactly equal positive measure inside the positive-measure sets Sp(ε,δ)S_p(\varepsilon,\delta)Sp​(ε,δ) and Tq(ε)T_q(\varepsilon)Tq​(ε), a nonatomicity argument that a pointwise proof would miss.

Formalization scope

Densities are plain functions R→R\mathbb R\to\mathbb RR→R with a square-integrability condition with respect to ν=\nu=ν= Lebesgue measure restricted to [0,T][0,T][0,T], not L2L^2L2 equivalence classes; every pointwise condition is ν\nuν-almost everywhere, and values outside [0,T][0,T][0,T] are unconstrained. Paths and OD pairs are finite types, with a map sending each path to its OD pair. The essential infimum is the literal formula (12), a real supremum; it is not the pointwise infimum, which changes when CCC is altered on a null set and makes sufficiency false. μkl\mu_{kl}μkl​ is a real infimum over PklP_{kl}Pkl​; for a pair with no paths it is an unused default value.

The cost operator C is abstract, with the paper's measurability assumption strengthened to square-integrability so that every integral in (39) is a genuine Lebesgue integral. The network dynamics (3)–(11) that produce C in the paper are not formalized. Nonnegativity (the codomain R+\mathbb R_+R+​ of (13)) and square-integrability are assumed only at h∗h^*h∗, which makes the formal statements stronger than the paper's. Without integrability, Lean's integral of a non-integrable function is 000, so (39) could hold vacuously; the added hypothesis excludes that trivialization. The goal quantifies over every cost operator satisfying these hypotheses and never fixes one. In the milestones, the reduction from p=qp=qp=q to p≠qp\ne qp=q (p. 188) is taken as the hypothesis p≠qp\ne qp=q.

A complete development needs: properties of the real essential infimum (12) on a finite measure space; Lemma 2 (continuity of measure from below); the existence of measurable subsets of prescribed measure in Lebesgue measure (nonatomicity, available in Mathlib in some form); and integral bookkeeping for products of L2L^2L2 functions on a finite measure. The essential-infimum and mass-shift lemmas are reusable for other continuous-time equilibrium models. Proofs of any milestone, and cleaner restatements of the essential-infimum API, are welcome.

Selected references

  • T. L. Friesz, D. Bernstein, T. E. Smith, R. L. Tobin and B. W. Wie, A variational inequality formulation of the dynamic network user equilibrium problem, Operations Research 41(1):179–191, 1993. https://doi.org/10.1287/opre.41.1.179
  • J. G. Wardrop, Some theoretical aspects of road traffic research, Proceedings of the Institution of Civil Engineers 1(3):325–362, 1952. https://doi.org/10.1680/ipeds.1952.11259
  • M. J. Smith, The existence, uniqueness and stability of traffic equilibria, Transportation Research B 13(4):295–304, 1979. https://doi.org/10.1016/0191-2615(79)90022-5
  • S. Dafermos, Traffic equilibrium and variational inequalities, Transportation Science 14(1):42–54, 1980. https://doi.org/10.1287/trsc.14.1.42
  • T. L. Friesz, J. Luque, R. L. Tobin and B. W. Wie, Dynamic network traffic assignment considered as a continuous time optimal control problem, Operations Research 37(6):893–901, 1989. https://doi.org/10.1287/opre.37.6.893
  • P. R. Halmos, Measure Theory, Van Nostrand, 1950 (Proposition 41.2, nonatomicity of Lebesgue measure).
11 thms2 active usersReviewed
AnalysisOperations Research·Captain: mikedeng1

A Variational Inequality Formulation of the Dynamic Network User Equilibrium Problem II: Under Linear Arc Delay αx(t) + β the Arc Exit Time Is Strictly Increasing (FIFO Holds)Research Paper

Motivation

Dynamic traffic assignment models how commuters choose routes and departure times when travel times change over the day. In the model of Friesz, Bernstein, Smith, Tobin and Wie (Oper. Res. 41 (1993)), the time to traverse a path is built recursively from arc exit-time functions: a vehicle that enters an arc at time ttt leaves it at time τ(t)\tau(t)τ(t). The equilibrium conditions of that model refer to the inverses of these functions, so the model is only well defined when every arc exit-time function is invertible.

Invertibility has a direct traffic meaning. A strictly increasing exit time is the first-in-first-out (FIFO) property: a vehicle that enters later cannot leave earlier, so no overtaking occurs on the arc. Whether a given delay model respects FIFO was an active question in the early 1990s, because several delay functions used in practice violate it for some inflow patterns.

Timeline:

  • 1969. Vickrey's bottleneck model introduces deterministic queueing at a single bottleneck (Vickrey 1969).
  • 1986. Ben-Akiva and De Palma show (Trans. Sci. 20 (1986)), for uniform entry rates and deterministic queueing delays, that it is not possible to "arrive earlier by departing later".
  • 1993. Friesz et al. prove (Theorem 1, p. 185) that for every linear arc delay D=αx+βD = \alpha x + \betaD=αx+β the exit time is strictly increasing, extending the 1986 result to all continuous entry-rate patterns (remark, p. 186).

Setting

Consider one arc. Vehicles enter it at the entry rate u(t)≥0u(t) \ge 0u(t)≥0, a continuous function of time t≥0t \ge 0t≥0; the first vehicle enters at time 000. For an exit-time function τ\tauτ, the arc volume at time t≥0t \ge 0t≥0 is the inflow mass of the vehicles that entered during [0,t][0,t][0,t] and have not left by time ttt:

x(t)=∫{s∈[0,t] : τ(s)>t}u(s) ds.x(t) = \int_{\{s \in [0,t]\,:\,\tau(s) > t\}} u(s)\,ds .x(t)=∫{s∈[0,t]:τ(s)>t}​u(s)ds.

The linear delay function (18) of the paper is

D(t)=α x(t)+β,α,β>0,D(t) = \alpha\, x(t) + \beta, \qquad \alpha, \beta > 0,D(t)=αx(t)+β,α,β>0,

a fixed free-flow travel time β\betaβ plus a queueing time determined by the service rate 1/α1/\alpha1/α. The exit time is entry time plus delay, so τ\tauτ is pinned by the exit-time equation

τ(t)=t+α x(t)+β(t≥0).\tau(t) = t + \alpha\, x(t) + \beta \qquad (t \ge 0).τ(t)=t+αx(t)+β(t≥0).

The equation is implicit: τ\tauτ appears on the right through the volume. The proof partitions time at t0=0t_0 = 0t0​=0, tn+1=τ(tn)t_{n+1} = \tau(t_n)tn+1​=τ(tn​); in particular t1=τ(0)=βt_1 = \tau(0) = \betat1​=τ(0)=β is the exit time of the first vehicle. In Lean these objects are linearDelay, arcVolume, IsLinearExitTime and tSeq in FrieszDUE.FIFO.

Formalization targets

Goal: Theorem 1 (p. 185)

For α,β>0\alpha, \beta > 0α,β>0 and a nonnegative continuous entry rate uuu, every τ\tauτ satisfying the exit-time equation is strictly increasing on [0,∞)[0, \infty)[0,∞):

0≤s<t  ⟹  τ(s)<τ(t),0 \le s < t \implies \tau(s) < \tau(t),0≤s<t⟹τ(s)<τ(t),

and hence injective there, so τ−1\tau^{-1}τ−1 exists.

Milestones

  1. Lemma 1 (19): for a differentiable invertible fff, [f−1]′(z)=1/f′[f−1(z)][f^{-1}]'(z) = 1/f'[f^{-1}(z)][f−1]′(z)=1/f′[f−1(z)].
  2. First interval (21)–(24): t1=βt_1 = \betat1​=β; on [0,t1][0, t_1][0,t1​], x(t)=∫0tux(t) = \int_0^t ux(t)=∫0t​u, τ(t)=t+α∫0tu+β\tau(t) = t + \alpha\int_0^t u + \betaτ(t)=t+α∫0t​u+β, and τ′=1+αu>0\tau' = 1 + \alpha u > 0τ′=1+αu>0.
  3. Second interval (25)–(28): on [t1,t2][t_1, t_2][t1​,t2​], τ(t)=t+α∫τ−1(t)tu+β\tau(t) = t + \alpha\int_{\tau^{-1}(t)}^t u + \betaτ(t)=t+α∫τ−1(t)t​u+β and τ′(t)=αu(t)+1/(1+αu[τ−1(t)])>αu(t)\tau'(t) = \alpha u(t) + 1/(1 + \alpha u[\tau^{-1}(t)]) > \alpha u(t)τ′(t)=αu(t)+1/(1+αu[τ−1(t)])>αu(t).
  4. Induction (29)–(34): the same representation and τ′(t)>αu(t)\tau'(t) > \alpha u(t)τ′(t)>αu(t) on every [tn+1,tn+2][t_{n+1}, t_{n+2}][tn+1​,tn+2​], with τ\tauτ strictly increasing there.
  5. Covering: tn+1−tn≥βt_{n+1} - t_n \ge \betatn+1​−tn​≥β and R+=⋃n≥0[tn,tn+1]\mathbb R_+ = \bigcup_{n \ge 0}[t_n, t_{n+1}]R+​=⋃n≥0​[tn​,tn+1​].

A supporting, non-milestone item states that the exit-time equation has a solution for every admissible uuu.

Significance

The result makes the path exit-time functions of the dynamic network model invertible whenever the arc delays are linear in volume. That invertibility is what allows the path costs, and through them the variational inequality of Theorem 2 of the same paper, to be written down. In traffic terms it certifies that linear volume-based delays never let a later entrant overtake an earlier one, whatever the continuous inflow profile.

The theorem is proved in the paper. As far as is known it has no machine-checked proof. The mission produces one, together with a formal model of a single arc whose exit time is defined implicitly through the volume, which is reusable for other delay functions and for FIFO questions in dynamic traffic assignment.

Difficulty

The obvious argument differentiates τ(t)=t+αx(t)+β\tau(t) = t + \alpha x(t) + \betaτ(t)=t+αx(t)+β and bounds the outflow rate. But the volume can only be written as ∫τ−1(t)tu\int_{\tau^{-1}(t)}^t u∫τ−1(t)t​u once τ\tauτ is known to be invertible, which is the conclusion. The paper breaks the circularity by working forward in time: on [tn,tn+1][t_n, t_{n+1}][tn​,tn+1​] the volume depends only on τ\tauτ restricted to the earlier interval, whose invertibility is already established. A formal proof must make this forward dependence rigorous for an exit time given only by the implicit equation, handle one-sided derivatives at the junctions tnt_ntn​, where τ\tauτ is generally not differentiable, and show that the junctions do not accumulate.

Formalization scope

Time is real; the entry rate is a function u:R→Ru : \mathbb R \to \mathbb Ru:R→R with u(t)≥0u(t) \ge 0u(t)≥0 and uuu continuous on [0,∞)[0, \infty)[0,∞). Both are added hypotheses: Theorem 1 names none, nonnegativity is implicit in "entry rate", and the remark after the proof covers "all continuous entry rate patterns". Integrals are Lebesgue integrals. Monotonicity is claimed on [0,∞)[0,\infty)[0,∞) only, the entry times that the equation constrains. Derivative claims in the milestones are taken within the closed interval [tn,tn+1][t_n, t_{n+1}][tn​,tn+1​]. The paper's separate pieces τk\tau_kτk​ are one global function here, so the junction identities (27), (30), (33) are automatic. Lemma 1 adds the hypothesis f′[f−1(z)]≠0f'[f^{-1}(z)] \ne 0f′[f−1(z)]=0, without which it is false.

The exit time τ is pinned by the implicit equation τ(t) = t + αx(t) + β, where x(t) is the inflow mass of vehicles that entered by time t and have not exited by time t; no monotonicity or invertibility of τ is assumed. A formalization that defined the volume through τ−1\tau^{-1}τ−1 or assumed τ\tauτ monotone would assume the conclusion and is ruled out.

The development needs one-sided derivatives of parametric integrals, the inverse-function derivative on an interval, and a forward induction over the partition. Contributions of proofs for any milestone, of the existence item, and of a uniqueness result for the exit-time equation are welcome.

Selected references

  • T. L. Friesz, D. Bernstein, T. E. Smith, R. L. Tobin and B. W. Wie, A variational inequality formulation of the dynamic network user equilibrium problem, Operations Research 41(1):179–191, 1993. https://doi.org/10.1287/opre.41.1.179
  • M. Ben-Akiva and A. de Palma, Some circumstances in which vehicles will reach their destinations earlier by starting later: revisited, Transportation Science 20(1):52–55, 1986. https://doi.org/10.1287/trsc.20.1.52
  • M. Ben-Akiva, A. de Palma and P. Kanaroglou, Dynamic model of peak period traffic congestion with elastic arrival rates, Transportation Science 20(3):164–181, 1986. https://doi.org/10.1287/trsc.20.3.164
  • W. S. Vickrey, Congestion theory and transport investment, American Economic Review 59(2):251–261, 1969. https://www.jstor.org/stable/1823678
7 thms1 active userReviewed
CombinatoricsOperations ResearchOptimization·Captain: mikedeng1

One-Processor Scheduling with Symmetric Earliness and Tardiness Penalties 2: For a Fixed Task Order, the Block-Shifting Algorithm Minimizes the Total DiscrepancyResearch Paper

Motivation

A task may have a preferred execution time because a material delivery, external event, or downstream operation is timed to it. Starting early can be as costly as starting late. Garey, Tarjan, and Wilfong study this situation on one processor, where tasks cannot overlap but idle time between tasks is permitted. Their total-discrepancy problem is hard when the execution order is free; fixing the order leaves a substantial timing problem because each start can still move and can force changes to earlier starts. The paper gives an explicit scheduling procedure for that case and proves that it minimizes the sum of deviations from preferred starts (Garey, Tarjan, and Wilfong, 1988, §§1–2).

This mission targets that procedure and its correctness theorem. It also records the paper's equal-length result: when task lengths are identical, a minimum-cost schedule exists in preferred-start order, so the fixed-order procedure applies after sorting. These are two precise claims about total discrepancy, distinct from the paper's separate maximum-discrepancy problem.

Setting

There are nnn tasks, indexed i=0,…,n−1i=0,\ldots,n-1i=0,…,n−1. Task iii has a nonnegative length lil_ili​, a nonnegative preferred starting time aia_iai​, and an actual starting time sis_isi​. Once started, it occupies the one processor until si+lis_i+l_isi​+li​. Each start must be nonnegative. For the fixed-order problem, task iii must finish before task i+1i+1i+1 starts, so si+li≤si+1s_i+l_i\le s_{i+1}si​+li​≤si+1​. This permits idle time when the inequality is strict. The task's discrepancy is ∣si−ai∣|s_i-a_i|∣si​−ai​∣; because its preferred completion is ai+lia_i+l_iai​+li​, this is also its absolute completion-time discrepancy. The total discrepancy is

cost⁡n(s)=∑i=0n−1∣si−ai∣.\operatorname{cost}_n(s)=\sum_{i=0}^{n-1}|s_i-a_i|.costn​(s)=i=0∑n−1​∣si​−ai​∣.

A block is a maximal consecutive set of tasks with no idle time between neighboring tasks. Within a block, Decrease counts tasks whose actual starts are later than preferred, and Increase counts tasks whose actual starts are no later than preferred. These names describe the effect of moving the entire block earlier: the discrepancy of a Decrease task falls initially, whereas that of an Increase task rises. The algorithm's state is a schedule SnS_nSn​ for the first nnn tasks. It inserts the next task at its preferred start when the previous task has finished, and at that finish time otherwise. In the latter case it may move the final block earlier until one of the paper's stopping events occurs: the block reaches time zero, a late task reaches its preferred start, or the block meets its predecessor (§2.2, p. 337).

For the equal-length result, schedules may execute tasks in any order. Two distinct tasks are feasible together when one completes before the other starts; meeting at endpoints is allowed. The objective remains the same sum of absolute discrepancies.

Formalization targets

Fixed-order optimality

The main target is the paper's Theorem 2. For all nonnegative task data and every nnn, the actual schedule SnS_nSn​ produced by the block-shifting algorithm is feasible and satisfies

cost⁡n(Sn)≤cost⁡n(s)for every feasible fixed-order schedule s.\operatorname{cost}_n(S_n)\le\operatorname{cost}_n(s) \qquad\text{for every feasible fixed-order schedule }s.costn​(Sn​)≤costn​(s)for every feasible fixed-order schedule s.

This includes the empty schedule and schedules with idle time. The milestone list follows the paper's own assertions: a balanced final block can move earlier without changing cost; every block of SnS_nSn​ has more Increase tasks than Decrease tasks or begins at zero (Lemma 7); and the two claims in Case 2 of the proof record the cost of adding a late task and the comparison with schedules that place it earlier (Theorem 2 and Lemma 7, p. 338).

Equal-length schedules

The companion target is Theorem 3. If every task has a common length L≥0L\ge0L≥0 and the preferred starts are indexed so that ai≤ai+1a_i\le a_{i+1}ai​≤ai+1​, then among all feasible schedules, including those with another task order, at least one minimum-cost schedule starts the tasks in index order:

∃s  [cost⁡n(s)≤cost⁡n(t) for every feasible t]with si≤si+1 whenever i+1<n.\exists s\;\bigl[ \operatorname{cost}_n(s)\le\operatorname{cost}_n(t) \text{ for every feasible }t \bigr] \quad\text{with }s_i\le s_{i+1}\text{ whenever }i+1<n.∃s[costn​(s)≤costn​(t) for every feasible t]with si​≤si+1​ whenever i+1<n.

The paper uses this statement to connect free-order equal-length scheduling to its fixed-order procedure (Theorem 3, p. 340).

Significance

Theorem 2 certifies an explicit schedule, not just the existence of an optimum. It fixes the objective value for a prescribed execution order and gives a baseline against which any other legal timing of the same tasks can be compared. Theorem 3 supplies the ordering fact needed to use that result when all lengths agree. Together they explain why a problem that is difficult for unrestricted task lengths still has these structured solvable cases (Garey, Tarjan, and Wilfong, 1988, abstract and §2.5).

The paper proves both theorems on paper. The work here is to formalize its schedule construction, cost, block boundaries, and comparison classes in Lean, then obtain machine-checked proofs of the stated targets. The draft theorem declarations compile with proof placeholders; this proposal does not claim that they are already machine-checked results. A completed development would make the model and the algorithm available for later formal work on scheduling with idle time and symmetric earliness and tardiness penalties.

Difficulty

Moving a task closer to its preferred start can move neighboring tasks farther from theirs. A simple task-by-task choice therefore does not establish global optimality. Nor does a count of late and early tasks in one block, by itself, justify arbitrary earlier movements of individual tasks. The difficult comparison in the paper is between the algorithm's schedule and a competing feasible schedule whose new task starts earlier: the whole final block and its constrained relative movements matter. The proof also has to account for the boundary at time zero and for blocks that merge when shifted. These are the reasons the explicit procedure and its block invariant need careful statements (§§2.2–2.3, pp. 337–338).

Formalization scope

The Lean development represents task data and starts as functions from natural-number indices to real numbers; only indices below nnn count. Task iii in Lean is the paper's Ti+1T_{i+1}Ti+1​. Preferred times, lengths, and legal starting times are nonnegative. The start-time condition is a standing convention used by the paper's algorithm, especially its zero-boundary stopping rule. Fixed-order feasibility requires successive tasks to be separated by at least the earlier task's length; unrestricted feasibility uses pairwise nonoverlap. An empty schedule is legal and has cost zero. The representation allows zero-length tasks, as does the paper's li≥0l_i\ge0li​≥0 model.

The algorithm is defined by its stated insertion and single-block-shift operations. Defining SnS_nSn​ as a chosen minimizer would erase the content of Theorem 2; the goal also explicitly asserts feasibility so that an illegal low-cost function cannot qualify. Theorem 3 compares with every feasible unrestricted-order schedule, not just schedules already in preferred-start order. The core definitions, the block invariant, and the cost comparisons are useful beyond this particular proof. Formalizing the paper's running-time bounds and heap implementation is outside this mission.

Selected references

  • Michael R. Garey, Robert E. Tarjan, and Gordon T. Wilfong, One-Processor Scheduling with Symmetric Earliness and Tardiness Penalties, Mathematics of Operations Research 13(2), 330–348, 1988. DOI: 10.1287/moor.13.2.330.
6 thms1 active userReviewed
🏆Completed
Graph TheoryOperations ResearchProbability·Captain: mikedeng1

Expected Critical Path Lengths in PERT Networks: With Bundle-Independent Arc Lengths, the Mean-Length Estimate g, Fulkerson's Recursion f and the Expected Critical Path Length e Satisfy g ≤ f ≤ eResearch Paper

Motivation

PERT (Program Evaluation and Review Technique) and the critical path method model a project as a directed acyclic network whose arcs are jobs and whose nodes are events; the duration of the project is the length of a longest path from the origin to the terminal. When job durations are random, the quantity a planner wants is the expected duration. Computing it exactly requires solving one longest-path problem for every joint outcome of the job durations: with mmm jobs each taking two values, 2m2^m2m deterministic problems. Classical PERT practice replaced every random duration by its mean and reported the longest path for the mean durations. That figure is known to be optimistically biased.

D. R. Fulkerson, Expected Critical Path Lengths in PERT Networks (RAND Memorandum RM-3075-PR, 1962; Operations Research 10(6):808–817, 1962, doi:10.1287/opre.10.6.808), proposed a second estimate, computed node by node with work exponential only in the size of a single node's bundle of incoming arcs, and proved that it lies between the classical mean-length figure and the true expectation.

Setting

A project network has events 0,1,…,n0,1,\dots,n0,1,…,n with n≥1n\ge1n≥1, origin 000 and terminal nnn. Its arcs are ordered pairs (i,j)(i,j)(i,j) with i<ji<ji<j, at most one per pair, and every event lies on a directed path from the origin to the terminal. Fulkerson numbers his nodes 1,…,n1,\dots,n1,…,n; his node iii is event i−1i-1i−1 here. The bundle BjB_jBj​ of an event jjj is the set of arcs entering jjj, and pred⁡(j)\operatorname{pred}(j)pred(j) the set of their tails; the origin's bundle is empty.

For arc lengths ttt, let ℓi(t)\ell_i(t)ℓi​(t) be the length of a longest (critical) path from the origin to iii; equivalently ℓ0=0\ell_0=0ℓ0​=0 and ℓj=max⁡i∈pred⁡(j)(ℓi+tij)\ell_j=\max_{i\in\operatorname{pred}(j)}(\ell_i+t_{ij})ℓj​=maxi∈pred(j)​(ℓi​+tij​).

The lengths of the arcs of each bundle BjB_jBj​ form a random vector with a finite distribution: a finite set SjS_jSj​ of bundle vectors vvv, where viv_ivi​ is the length of arc (i,j)(i,j)(i,j), with probabilities pj(v)≥0p_j(v)\ge 0pj​(v)≥0 summing to 111. Arcs within a bundle may be correlated; distinct bundles are independent, so an assignment ω=(ωj)j\omega=(\omega_j)_jω=(ωj​)j​ of one bundle vector per event has probability p(ω)=∏jpj(ωj)p(\omega)=\prod_j p_j(\omega_j)p(ω)=∏j​pj​(ωj​). Three numbers are attached to each event iii:

  1. the expected critical path length ei=∑ωp(ω) ℓi(t(ω))e_i=\sum_\omega p(\omega)\,\ell_i(t(\omega))ei​=∑ω​p(ω)ℓi​(t(ω));
  2. the mean-length estimate gi=ℓi(tˉ)g_i=\ell_i(\bar t)gi​=ℓi​(tˉ), where tˉij=∑v∈Sjpj(v) vi\bar t_{ij}=\sum_{v\in S_j}p_j(v)\,v_itˉij​=∑v∈Sj​​pj​(v)vi​ is the expected length of arc (i,j)(i,j)(i,j);
  3. Fulkerson's numbers f0=0f_0=0f0​=0 and, for j≠0j\neq0j=0,
fj=∑v∈Sjpj(v) max⁡i∈pred⁡(j)(fi+vi).f_j=\sum_{v\in S_j}p_j(v)\,\max_{i\in\operatorname{pred}(j)}\bigl(f_i+v_i\bigr).fj​=v∈Sj​∑​pj​(v)i∈pred(j)max​(fi​+vi​).

Formalization targets

Goal: (4.4)

gi  ≤  fi  ≤  eifor every event i.g_i\;\le\;f_i\;\le\;e_i\qquad\text{for every event } i .gi​≤fi​≤ei​for every event i.

Milestones

In the order of Fulkerson's induction (pp. 10–12):

  1. the recursion for ℓ\ellℓ computes the greatest path length (§3, (3.6), and the display on p. 11);
  2. ℓi(t)\ell_i(t)ℓi​(t) depends only on the arcs of the bundles B0,…,BiB_0,\dots,B_iB0​,…,Bi​ (p. 6);
  3. (4.8): max⁡i∈pred⁡(j)(fi+tˉij)≤fj\max_{i\in\operatorname{pred}(j)}(f_i+\bar t_{ij})\le f_jmaxi∈pred(j)​(fi​+tˉij​)≤fj​;
  4. (4.5)/(4.9): if gk≤fkg_k\le f_kgk​≤fk​ for all k<jk<jk<j, then gj≤fjg_j\le f_jgj​≤fj​;
  5. (4.13): ∑v∈Sjpj(v)max⁡i∈pred⁡(j)(ei+vi)≤ej\sum_{v\in S_j}p_j(v)\max_{i\in\operatorname{pred}(j)}(e_i+v_i)\le e_j∑v∈Sj​​pj​(v)maxi∈pred(j)​(ei​+vi​)≤ej​;
  6. (4.10)/(4.14): if fk≤ekf_k\le e_kfk​≤ek​ for all k<jk<jk<j, then fj≤ejf_j\le e_jfj​≤ej​.

Companion statements

  • gi≤eig_i\le e_igi​≤ei​ under an arbitrary joint distribution of all arc lengths (remark, p. 12).
  • Fig. 4.2: with correlated bundles, e3=g3=1e_3=g_3=1e3​=g3​=1 but f3=5/4f_3=5/4f3​=5/4, so (4.4) fails without bundle independence.
  • (4.17): an independent example with g3=f3=1<e3=5/4g_3=f_3=1<e_3=5/4g3​=f3​=1<e3​=5/4.
  • Fig. 4.1: explicit values g4=3/2g_4=3/2g4​=3/2, f2=1/2f_2=1/2f2​=1/2, f3=9/8f_3=9/8f3​=9/8, f4=55/32f_4=55/32f4​=55/32, and fi=eif_i=e_ifi​=ei​.

Significance

The chain (4.4) says that the classical PERT estimate ggg never overstates the expected project duration, and that the numbers fff are a lower bound at least as tight. The fff computation visits each node once and sums over the support of that node's bundle only, so its cost grows exponentially with bundle size rather than with network size, while the exact expectation eee requires the whole product space. The Fig. 4.2 example shows that the bundle-independence hypothesis cannot be dropped for the upper inequality, while the lower inequality g≤eg\le eg≤e survives arbitrary dependence.

The result has a complete published proof. This mission seeks a machine-checked proof of (4.4) for finite distributions, with the longest-path characterisation of the earliest-event-time recursion and the locality of critical path lengths as reusable lemmas, and machine-checkable versions of the paper's numerical examples, including the counterexample showing the role of independence.

Difficulty

The left inequality compares an average of maxima with a maximum of averages. The right inequality requires more: fjf_jfj​ averages over the bundle entering jjj, while eje_jej​ averages over assignments to every bundle. Taking expectations in ℓj=max⁡i(ℓi+tij)\ell_j=\max_i(\ell_i+t_{ij})ℓj​=maxi​(ℓi​+tij​) yields ej≥max⁡i(ei+tˉij)e_j\ge\max_i(e_i+\bar t_{ij})ej​≥maxi​(ei​+tˉij​), which gives the weaker bound g≤eg\le eg≤e. Fig. 4.2 shows that f≤ef\le ef≤e can fail when the bundles are dependent. In Lean, eee is a sum over a dependent product of finite supports (Fintype.piFinset); its interaction with the local recurrence for fff is the central technical difficulty.

Formalization scope

  • Network: the published CriticalPath.Events.ProjectNetwork (Kelley–Walker 1959): events Fin (n + 1), arcs a Finset of ordered pairs with strictly increasing labels, origin preceding and terminal following every event. This requires n≥1n\ge1n≥1. Fulkerson's numbering condition "i≤ji\le ji≤j" on p. 3 is read as the strict i<ji<ji<j (arcs join distinct nodes of an acyclic network). There is one arc per ordered pair, Fulkerson's own convention in (3.13).
  • Critical path length: the published CriticalPath.Events.earliest, a recursion with Finset.sup' over the nonempty set of incoming arcs. This is the paper's convention that terms of missing arcs are ignored. Nothing uses a default value of 000 or −∞-\infty−∞.
  • Distributions: finite, given as data (a support Finset and a weight function per bundle) plus a predicate IsProb (nonnegative weights on the support, summing to 111, for every event including the origin). Bundle vectors are functions on all events, and coordinates outside pred⁡(j)\operatorname{pred}(j)pred(j) are never read.
  • Arc lengths are arbitrary reals. §3 assumes nonnegative lengths, but its footnote on p. 4 states that nonnegativity "is not essential in this or the following section"; the statements are given in this more general form.
  • No trivialization: eie_iei​ is the sum over every assignment of bundle vectors, weighted by the product probability (3.5). It is not defined by a recursion, and the goal assumes none of the milestones. fff at node jjj uses only the distribution of the bundle of jjj.

Infrastructure that a full development needs, and that is reusable elsewhere, includes the longest-path characterisation of the earliest-event-time recursion, the locality lemma, and the factorisation of sums over Fintype.piFinset along one coordinate. Proofs of any milestone or companion are welcome. Out of scope here: §5 (computational examples) and the general-network analogues of §6.

Selected references

  • D. R. Fulkerson, Expected Critical Path Lengths in PERT Networks, RAND Memorandum RM-3075-PR, March 1962; published in Operations Research 10(6):808–817, 1962. doi:10.1287/opre.10.6.808
  • J. E. Kelley Jr. and M. R. Walker, Critical-Path Planning and Scheduling, Proceedings of the Eastern Joint Computer Conference, 1959, pp. 160–173. doi:10.1145/1460299.1460318
  • D. G. Malcolm, J. H. Roseboom, C. E. Clark and W. Fazar, Application of a Technique for Research and Development Program Evaluation, Operations Research 7(5):646–669, 1959. doi:10.1287/opre.7.5.646
11 thms2 active usersReviewed
🏆Completed
Graph TheoryLinear OptimizationOperations Research·Captain: mikedeng1

A Suggested Computation for Maximal Multi-Commodity Network Flows: With Nonnegative Simplex Multipliers, Shortest-Chain Labels Prove the Arc-Chain Basis Optimal or Find an Entering ChainResearch Paper

Motivation

The maximal multi-commodity flow problem asks how much total flow several commodities, each travelling from its own sources to its own sinks, can send through a network whose arcs have shared capacities. It arises in communication and transportation planning: Kalaba and Juncosa's 1956 study of communication networks (Management Science 3(1)) leads to linear programs of this form. For a single commodity the problem has a clean combinatorial theory: the max-flow min-cut theorem of Ford and Fulkerson (1956, doi:10.4153/CJM-1956-045-5) and the labeling algorithm. With several commodities both fail: the min-cut equality is false, and simplex bases are no longer triangular.

In a short note received in October 1957 and published in Management Science in 1958, L. R. Ford Jr. and D. R. Fulkerson proposed a way to solve the multi-commodity problem with the simplex method anyway (doi:10.1287/mnsc.1040.0269, reprinted 2004). They use the arc-chain formulation, which has one variable per chain from a source to a sink of a commodity. That formulation has far too many variables to write down. The note's point is that the simplex method never needs them explicitly. The "pricing" step (finding a variable to enter the basis, or recognizing that none exists) can be carried out by one shortest-chain computation per commodity, with the simplex multipliers as arc lengths.

Timeline. Ford (1956, RAND P-923) gave the label-correcting shortest-chain procedure the note uses. Ford and Fulkerson (1958) applied it to price the columns of the arc-chain program. Dantzig and Wolfe (1960) generalized the idea into the decomposition principle. Gilmore and Gomory (1961) applied the same pattern to the cutting-stock problem, and it is now called column generation.

Setting

A network has finitely many nodes P1,…,PNP_1,\dots,P_NP1​,…,PN​ and arcs A1,…,AmA_1,\dots,A_mA1​,…,Am​. Each arc ArA_rAr​ joins two nodes, has a capacity brb_rbr​, and is either directed (traversable one way only) or undirected (traversable both ways). There are finitely many commodities; commodity kkk has a set of sources SkS_kSk​ and a set of sinks TkT_kTk​.

A chain from uuu to www is the arc set of a path u=v0,v1,…,vp=wu = v_0, v_1, \dots, v_p = wu=v0​,v1​,…,vp​=w with distinct nodes, each arc traversable from vi−1v_{i-1}vi−1​ to viv_ivi​. A commodity chain of kkk is a chain from a node of SkS_kSk​ to a node of TkT_kTk​. List the commodity chains, for all commodities, as C1,…,CnC_1,\dots,C_nC1​,…,Cn​, and let A=(ars)A = (a_{rs})A=(ars​) be the incidence matrix: ars=1a_{rs} = 1ars​=1 if CsC_sCs​ contains ArA_rAr​ and 000 otherwise. With xsx_sxs​ the flow along CsC_sCs​ and xn+rx_{n+r}xn+r​ the slack of arc ArA_rAr​, the problem is the linear program

maximize ∑s=1nxssubject to∑s=1narsxs+xn+r=br,x1,…,xn+m≥0.(2–3)\text{maximize } \sum_{s=1}^{n} x_s \quad\text{subject to}\quad \sum_{s=1}^{n} a_{rs}x_s + x_{n+r} = b_r,\qquad x_1,\dots,x_{n+m} \ge 0. \tag{2–3}maximize s=1∑n​xs​subject tos=1∑n​ars​xs​+xn+r​=br​,x1​,…,xn+m​≥0.(2–3)

A basis is a set of mmm columns of [A∣I][A \mid I][A∣I] forming an invertible matrix B=(brj)B = (b_{rj})B=(brj​). Its simplex multipliers α1,…,αm\alpha_1,\dots,\alpha_mα1​,…,αm​ satisfy, for every basic column jjj,

∑r=1mαrbrj={1j≤n,0j>n.(4)\sum_{r=1}^{m} \alpha_r b_{rj} = \begin{cases} 1 & j \le n,\\ 0 & j > n.\end{cases} \tag{4}r=1∑m​αr​brj​={10​j≤n,j>n.​(4)

Read as arc lengths, the αr\alpha_rαr​ give each chain CsC_sCs​ the length ∑rαrars\sum_r \alpha_r a_{rs}∑r​αr​ars​. The labeling process for a source set SSS starts with labels πi=0\pi_i = 0πi​=0 on SSS and πi=∞\pi_i = \inftyπi​=∞ elsewhere. It repeatedly finds an arc traversable from PiP_iPi​ to PjP_jPj​ with πi+lij<πj\pi_i + l_{ij} < \pi_jπi​+lij​<πj​ and replaces πj\pi_jπj​ by πi+lij\pi_i + l_{ij}πi​+lij​. In Lean the labels are lab : V → WithTop ℝ, the multipliers are α : E → ℝ, and all objects live in the namespace FordFulkerson58.ArcChain.

Formalization targets

Goal: the shortest-chain pricing test (§3, pp. 1779–1780)

Let BBB be a basis with basic feasible solution zzz and multipliers α≥0\alpha \ge 0α≥0. Then:

(a) for every commodity, every run of the labeling process with lengths α is finite;(b) if all final sink labels are ≥1, then ∑sxs≤∑szs for every feasible x;(c) if a final sink label πt<1, some non-basic chain column to t has length πt and 1−∑rαrars>0.\begin{aligned} &\text{(a) for every commodity, every run of the labeling process with lengths } \alpha \text{ is finite;}\\ &\text{(b) if all final sink labels are } \ge 1, \text{ then } \textstyle\sum_s x_s \le \sum_s z_s \text{ for every feasible } x;\\ &\text{(c) if a final sink label } \pi_t < 1, \text{ some non-basic chain column to } t \text{ has length } \pi_t \text{ and } 1 - \textstyle\sum_r \alpha_r a_{rs} > 0. \end{aligned}​(a) for every commodity, every run of the labeling process with lengths α is finite;(b) if all final sink labels are ≥1, then ∑s​xs​≤∑s​zs​ for every feasible x;(c) if a final sink label πt​<1, some non-basic chain column to t has length πt​ and 1−∑r​αr​ars​>0.​

Milestones (§3, the labeling process and the test)

  1. Termination of the labeling process for non-negative lengths (p. 1780).
  2. Final labels are shortest-chain lengths from SSS; the smallest label on TTT is the SSS-to-TTT distance (p. 1780).
  3. The trace-back: a chain of tight arcs from SSS to every labeled node, of length its label (p. 1780).
  4. If α≥0\alpha \ge 0α≥0 and every commodity chain has length ≥1\ge 1≥1, the basis is optimal (p. 1779).

Further items state the remarks of §3–§4: a negative multiplier lets a slack enter; the slack basis is a feasible start; dominated chains can be ignored; limited supplies reduce to the same problem by adding new directed source arcs; Figure 2 is the incidence matrix of Figure 1; with negative lengths the labeling process may not terminate.

Significance

The result. The test turns a linear program with exponentially many columns into one whose pricing step costs one shortest-path computation per commodity. Only the m×mm \times mm×m basis is ever stored. This is the first instance of column generation, which now underlies solvers for multi-commodity flow, cutting stock, vehicle routing, crew scheduling and many other set-partitioning models, typically inside branch-and-price. Part (a) together with milestones 2–3 also gives the correctness of Ford's label-correcting algorithm with non-negative lengths, started from a source set and with any order of arc scans.

Formalizing it. The results are classical and proved in the paper's informal style. None of them is formalized: the platform has no arc-chain LP, no column pricing, and no formal statement of Ford's label-correcting process. The general LP facts are on the platform (the simplex optimality criterion and weak duality, both proved) and are included as references. This mission adds the network-specific layer: chains as arc sets of simple paths, the labeling process as a relation on labelings, and the link from final labels to reduced costs. One sentence of the paper is corrected. The trace-back "eventually" reaches SSS only along some backward path, because zero-length cycles can trap a naive backward search, and milestone 3 states the true version.

Difficulty

The obvious argument for termination says each step lowers a label and there are finitely many chains. It fails: labels are lengths of walks, not chains, and with zero-length arcs (multipliers are often 000) there are infinitely many walks. Termination needs the finiteness of the set of walk lengths below a bound, not positivity. The correctness of the final labels needs both properties of the labeling: it is produced by the process (so every label is the length of a walk from SSS), and it is terminal. A terminal labeling alone, such as all labels 000, is not a distance labeling. Finally, the optimality claim is an LP statement about the full, never-enumerated column set. It must be derived from (4), α≥0\alpha \ge 0α≥0 and the shortest-chain lengths, with the chain columns indexed abstractly.

Formalization scope

Nodes, arcs and commodities are finite types V, E, ι. Each arc has tail, head, a per-arc directed flag and a capacity b : E → ℝ; commodities have src snk : ι → Finset V. Parallel arcs and mixed directed/undirected networks are allowed. No sign of the capacities and no disjointness of sources and sinks is assumed, except 0 ≤ b in the zero-flow item, where it is disclosed. Chains are arc sets of simple paths. The null chain at a source is a chain, so sources have distance 000. Columns are pairs (commodity, chain), so one arc set used by two commodities gives two columns. The columns of [A∣I][A \mid I][A∣I] are indexed by Col N ⊕ E. A basis is β : E → Col N ⊕ E with IsUnit (basisMatrix N β).det; its basic feasible solution and multipliers (4) are hypotheses about this β. Labels are in WithTop ℝ with ⊤ for ∞\infty∞. Shortest-chain lengths are finite infima (Finset.inf), equal to ⊤ when there is no chain. The process scans arcs, not node pairs, which handles parallel arcs and the undirected case lij=ljil_{ij} = l_{ji}lij​=lji​.

The standing assumption of §3 ("a stage has been reached in the computation where all αr\alpha_rαr​ are non-negative", p. 1779) is a hypothesis of the goal and of milestones 1–4. Milestones 1–3 are stated for any non-negative length function. The paper has no numbered theorems; every milestone is an unnumbered sentence of §3, cited by page and position.

A trivializing formalization is ruled out: the goal does not assume shortest-chain lengths, the trace-back, or any reduced-cost fact beyond (4). Statements about final labels require labelings that are both reachable from the initial labels and terminal, and part (a) shows such labelings exist.

Reusable beyond this mission: the chain and labeling layer (a label-correcting shortest-path algorithm from a source set over mixed networks) and the arc-chain LP. Contributions to the LP layer, which can import the referenced Matoušek–Gärtner results after reindexing, are particularly welcome.

Selected references

  • L. R. Ford Jr., D. R. Fulkerson, A suggested computation for maximal multi-commodity network flows, Management Science 5(1):97–101, 1958; reprinted Management Science 50(12S):1778–1780, 2004. https://doi.org/10.1287/mnsc.1040.0269
  • L. R. Ford Jr., D. R. Fulkerson, Maximal flow through a network, Canadian Journal of Mathematics 8:399–404, 1956. https://doi.org/10.4153/CJM-1956-045-5
  • L. R. Ford Jr., Network Flow Theory, RAND Corporation Paper P-923, 1956. https://www.rand.org/pubs/papers/P923.html
  • G. B. Dantzig, P. Wolfe, Decomposition principle for linear programs, Operations Research 8(1):101–111, 1960. https://doi.org/10.1287/opre.8.1.101
  • P. C. Gilmore, R. E. Gomory, A linear programming approach to the cutting-stock problem, Operations Research 9(6):849–859, 1961. https://doi.org/10.1287/opre.9.6.849
  • J. Matoušek, B. Gärtner, Understanding and Using Linear Programming, Springer, 2007. https://doi.org/10.1007/978-3-540-30717-4
12 thms3 active usersReviewed
CombinatoricsOperations ResearchTheoretical Computer Science·Captain: mikedeng1

One-Processor Scheduling with Symmetric Earliness and Tardiness Penalties 1: Minimizing the Total Discrepancy from Preferred Times Is NP-CompleteResearch Paper

Motivation

Scheduling with earliness and tardiness penalties asks for schedules in which a job finishing early is as undesirable as a job finishing late. The model fits production planned for just-in-time delivery, where finished goods held before their due date cost money, and sequences of experiments tied to fixed external events. It departs from classical scheduling, in which finishing early is never penalized.

Garey, Tarjan and Wilfong (Math. Oper. Res. 13 (1988) 330–348) study the symmetric version on one processor: each task has a preferred starting time, and the penalty is the absolute deviation from it. Their §2.1 settles the complexity of the most natural objective, the sum of these deviations, by proving it NP-complete. The result explains why the rest of their paper, and much of the later literature, turns to special cases that can be solved efficiently: a fixed task order, equal task lengths, or the maximum deviation instead of the sum.

A short history of the model:

  • Kanet (1981) minimized total absolute deviation from a common due date that is large enough not to constrain the schedule, by a sorting rule. The special case in the middle of §2.1 is the midtime version of this problem.
  • Garey, Tarjan and Wilfong (1988) proved the problem with arbitrary preferred times NP-complete (THEOREM 1, this mission), and gave an O(Nlog⁡N)O(N\log N)O(NlogN) algorithm for a fixed task order.
  • Hall, Kubiak and Sethi (1991) proved that the common-due-date problem becomes NP-hard when the due date is restrictive. The reduction of THEOREM 1 already uses a common preferred midtime that is not large, together with one extra task that pins the right end.

Setting

There are NNN tasks T1,…,TNT_1,\dots,T_NT1​,…,TN​. Task TiT_iTi​ has a length lil_ili​ and a preferred midtime MiM_iMi​. A schedule SSS assigns every task a starting time si≥0s_i\ge0si​≥0 such that no two tasks overlap on the single processor: for i≠ji\ne ji=j, either si+li≤sjs_i+l_i\le s_jsi​+li​≤sj​ or sj+lj≤sis_j+l_j\le s_isj​+lj​≤si​. Idle time is allowed. The actual midtime of TiT_iTi​ is mi(S)=si+li/2m_i(S)=s_i+l_i/2mi​(S)=si​+li​/2, and the total discrepancy of SSS is

cost(S)=∑i=1N∣mi(S)−Mi∣.\mathrm{cost}(S)=\sum_{i=1}^N |m_i(S)-M_i| .cost(S)=i=1∑N​∣mi​(S)−Mi​∣.

The paper works with midtimes because the special case below is then symmetric. Preferred midtimes and preferred starting times aia_iai​ are interchangeable through ai=Mi−li/2a_i=M_i-l_i/2ai​=Mi​−li​/2.

Total discrepancy (the decision problem). Given N,k∈Z+N,k\in\mathbb Z^+N,k∈Z+ and Mi,li∈Z+M_i,l_i\in\mathbb Z^+Mi​,li​∈Z+, is there a schedule with cost(S)≤k\mathrm{cost}(S)\le kcost(S)≤k?

Even-odd partition. Given positive integers x1<x2<⋯<x2nx_1<x_2<\dots<x_{2n}x1​<x2​<⋯<x2n​, can they be split into two sets of equal sum so that each set contains exactly one of x2i−1,x2ix_{2i-1},x_{2i}x2i−1​,x2i​ for every iii?

The special case. For tasks T0,…,T2nT_0,\dots,T_{2n}T0​,…,T2n​ with 0<l0<l1<⋯<l2n0<l_0<l_1<\dots<l_{2n}0<l0​<l1​<⋯<l2n​ and one common preferred midtime M>∑iliM>\sum_i l_iM>∑i​li​, write A(S)={Ti:mi(S)<M}A(S)=\{T_i: m_i(S)<M\}A(S)={Ti​:mi​(S)<M} and B(S)={Ti:mi(S)>M}B(S)=\{T_i:m_i(S)>M\}B(S)={Ti​:mi​(S)>M}. A schedule is ordered if, on each side of MMM, shorter tasks lie nearer to MMM. The bracket [An,…,A1,T0@M,B1,…,Bn][A_n,\dots,A_1,T_0@M,B_1,\dots,B_n][An​,…,A1​,T0​@M,B1​,…,Bn​] is the schedule that puts T0T_0T0​ at midtime MMM and packs the listed tasks against it in the listed order.

Formalization targets

Goal: THEOREM 1

Partition is NP-complete ⟹ Total discrepancy is NP-complete.\text{Partition is NP-complete}\ \Longrightarrow\ \text{Total discrepancy is NP-complete.}Partition is NP-complete ⟹ Total discrepancy is NP-complete.

The hypothesis is the one result the paper imports (Garey and Johnson, 1979). The conclusion includes membership in NP and polynomial-time many-one reductions from every NP language, with Turing machines as the model of computation.

Milestones, in attack order

  1. Even-odd partition is in NP; the instance x1=1x_1=1x1​=1, x2i=x2i−1+yix_{2i}=x_{2i-1}+y_ix2i​=x2i−1​+yi​, x2i+1=x2i+1x_{2i+1}=x_{2i}+1x2i+1​=x2i​+1 built from a Partition instance YYY is a yes-instance if and only if YYY is; and LEMMA 1, even-odd partition is NP-complete.
  2. The special case: a minimum cost schedule has no gaps and is ordered; LEMMA 2 (some mi(S)=Mm_i(S)=Mmi​(S)=M), LEMMA 3 (∣A(S)∣=∣B(S)∣|A(S)|=|B(S)|∣A(S)∣=∣B(S)∣), LEMMA 4 (m0(S)=Mm_0(S)=Mm0​(S)=M), LEMMA 5 (swapping AiA_iAi​ and BiB_iBi​ in a bracket keeps the cost), LEMMA 6 ({Ai,Bi}={T2i,T2i−1}\{A_i,B_i\}=\{T_{2i},T_{2i-1}\}{Ai​,Bi​}={T2i​,T2i−1​} in a minimum cost bracket), and the minimum cost
k=∑i=1n(l2i+l2i−1)(n−i+12)+l0 n.k=\sum_{i=1}^n(l_{2i}+l_{2i-1})\left(n-i+\tfrac12\right)+l_0\,n .k=i=1∑n​(l2i​+l2i−1​)(n−i+21​)+l0​n.
  1. At the midtime M=12∑i=02nliM=\frac12\sum_{i=0}^{2n}l_iM=21​∑i=02n​li​ used in the reduction, every schedule of T0,…,T2nT_0,\dots,T_{2n}T0​,…,T2n​ costs at least kkk; equality forces the ordered, gap-free form in item 2.
  2. The reduction: the instance D with l0=x1−1l_0=x_1-1l0​=x1​−1, li=xil_i=x_ili​=xi​, l2n+1=2l_{2n+1}=2l2n+1​=2, Mj=M=∑i≤2nli/2M_j=M=\sum_{i\le 2n}l_i/2Mj​=M=∑i≤2n​li​/2, M2n+1=2M+1M_{2n+1}=2M+1M2n+1​=2M+1 has a schedule of cost at most kkk if and only if XXX has an even-odd partition. Total discrepancy is in NP.

Significance

THEOREM 1 is the hardness boundary for one-processor scheduling with symmetric earliness–tardiness penalties and arbitrary preferred times. It is the reason exact algorithms for this objective are enumerative, and the reason polynomial results are sought under extra structure, such as the fixed-order algorithm of the same paper. The special-case lemmas characterize every optimal schedule for a common, unrestrictive midtime, not just one of them: shortest task centered at MMM, the iii-th pair of lengths in the iii-th positions on either side, either member on either side. This characterization holds independently of the reduction.

The result has been proved since 1988, and no machine-checked version of it is known to us. A formalization adds three things. First, the parts the paper calls "straightforward" or "a simple exercise", membership of both problems in NP. Second, the two places where the published argument is imprecise. The instance D has half-integer midtimes and threshold although the decision problem asks for integers, so a correct reduction must rescale. And the special-case lemmas are proved for a large midtime but applied with M=∑ili/2M=\sum_i l_i/2M=∑i​li​/2, so they must be restated for every MMM. Third, a reusable formal treatment of absolute-deviation scheduling objectives and of reductions between number problems written in binary.

Difficulty

The obvious argument fails at the step from the special case to the instance D. The lemmas on pp. 333–336 assume the common midtime is large, so that the constraint si≥0s_i\ge0si​≥0 never binds. In D the midtime is M=∑i=02nli/2M=\sum_{i=0}^{2n}l_i/2M=∑i=02n​li​/2, exactly half the total length, and the reduction works because the constraint binds. The tasks before MMM must fit in [0,M−l0/2][0,M-l_0/2][0,M−l0​/2], and the extra task T2n+1T_{2n+1}T2n+1​ must sit at [2M,2M+2][2M,2M+2][2M,2M+2]. Together these force the two sides to have equal total length. A proof that only cites the large-MMM lemmas proves nothing about D. Conversely, dropping si≥0s_i\ge 0si​≥0 makes the reduction false: put the shorter element of every pair after MMM.

The other obstacle is the complexity bookkeeping. NP-completeness here means Turing machines, binary codes, and polynomial bounds, and a full proof must compute D from the code of XXX, double the times to clear the half-integers, and certify membership in NP for a problem whose schedules have real starting times. The certificate cannot be the real starting times themselves.

Formalization scope

  • Everything is real-valued except the instance codes. Schedules have real starting times si≥0s_i\ge0si​≥0, and integer data are cast to R\mathbb RR. Restricting to integer starting times would be a different problem and is not what is stated.
  • Nonnegative starting times are a standing assumption. The paper uses them ("scheduled between 0 and M−l0/2M-l_0/2M−l0​/2", p. 336) without writing them into the model. Nonoverlap is "one task finishes before the other starts", the reading of "intersect only at their endpoints".
  • Tasks are indexed by Fin N from 000. In the special case TiT_iTi​ is index iii, and the paper's T2i−1,T2iT_{2i-1},T_{2i}T2i−1​,T2i​ (1≤i≤n1\le i\le n1≤i≤n) are the indices 2k+1,2k+22k+1,2k+22k+1,2k+2 for k=i−1k=i-1k=i−1.
  • Languages use the published CookPvsNP_defs (Cook's one-tape Turing machines, NP, NPComplete) and the published ProjSchedTW.Complexity.Encoding (four-letter alphabet and binary codes). This mission defines positivePartitionLang by restricting the imported equal-sum predicate to nonempty lists of positive integers, as on p. 333. Only codes of well-formed instances belong to the even-odd and total discrepancy languages.
  • The goal is not the combinatorial equivalence of milestone 4. It states NP-completeness, so it contains the polynomial-time computation of the reduction and membership in NP. Taking NPComplete evenOddLang as the hypothesis instead would drop LEMMA 1 and is not what is asked.
  • Running times of the algorithms of §2.2–§2.4 are out of scope for this mission, as are all results after §2.1.

Contributions welcome: proofs of any milestone, and reusable lemmas on Turing-machine computability of arithmetic on binary codes, which the two membership results and both reductions need.

Selected references

  • M. R. Garey, R. E. Tarjan, G. T. Wilfong, One-Processor Scheduling with Symmetric Earliness and Tardiness Penalties, Mathematics of Operations Research 13(2):330–348, 1988. https://doi.org/10.1287/moor.13.2.330
  • M. R. Garey, D. S. Johnson, Computers and Intractability: A Guide to the Theory of NP-Completeness, W. H. Freeman, 1979.
  • J. J. Kanet, Minimizing the average deviation of job completion times about a common due date, Naval Research Logistics Quarterly 28(4):643–651, 1981. https://doi.org/10.1002/nav.3800280411
  • N. G. Hall, W. Kubiak, S. P. Sethi, Earliness–tardiness scheduling problems, II: Deviation of completion times about a restrictive common due date, Operations Research 39(5):847–856, 1991. https://doi.org/10.1287/opre.39.5.847
  • S. Cook, The P versus NP problem, Clay Mathematics Institute Millennium Problems, 2000. https://www.claymath.org/wp-content/uploads/2022/06/pvsnp.pdf
19 thms2 active usersReviewed
🏆Completed
Operations ResearchProbabilityStatistics·Captain: mikedeng1

Residual Life Time at Great Age 4: α₁ ≤ tF′(t)/(1 − F(t)) ≤ α₂ for t ≥ t₀ Sandwiches P{(X − t)/t ≤ x | X > t} Between Γ_{α₁}(x) and Γ_{α₂}(x)Research Paper

Motivation

The residual life time of a lifetime XXX at age ttt is the remaining life X−tX - tX−t given survival past ttt. Its distribution at great age is a basic object in reliability, insurance and the statistics of extremes: excess-of-loss reinsurance prices the part of a claim above a retention level, and peaks-over-threshold methods fit a model to the observations exceeding a high level. Balkema and de Haan (Residual Life Time at Great Age, Ann. Probab. 2 (1974), 792–804, doi:10.1214/aop/1176996548) determined every possible limit law of the suitably normed residual life time as t→∞t \to \inftyt→∞ and the domains of attraction of these laws; Pickands (1975) obtained the continuous part of the same picture, which is the probabilistic basis of the generalized Pareto approximation used in practice.

Limit theorems describe the behaviour only as t→∞t \to \inftyt→∞. Section 4 of the paper gives approximation results for finite ttt. In extreme-value theory, von Mises (1936) gave a sufficient condition for attraction to the Fréchet law Φα\Phi_\alphaΦα​: tF′(t)/(1−F(t))→αtF'(t)/(1 - F(t)) \to \alphatF′(t)/(1−F(t))→α. Theorem 6 of the paper is a non-asymptotic, two-sided counterpart for the residual life time: two-sided bounds on the scaled hazard rate give two-sided bounds on the residual life distribution at every age past a threshold. This mission formalizes Theorem 6 (p. 801).

Setting

Let XXX be a real random variable with law μ\muμ and distribution function F(x)=P{X≤x}F(x) = P\{X \le x\}F(x)=P{X≤x}. For an age ttt with P{X>t}>0P\{X > t\} > 0P{X>t}>0, the residual life distribution function is

Ft(x)=P{X−t≤x∣X>t}=μ((t,t+x])μ((t,∞)),x∈R,F_t(x) = P\{X - t \le x \mid X > t\} = \frac{\mu((t, t + x])}{\mu((t, \infty))}, \qquad x \in \mathbb R,Ft​(x)=P{X−t≤x∣X>t}=μ((t,∞))μ((t,t+x])​,x∈R,

which is 000 for x<0x < 0x<0. For t>0t > 0t>0 the residual life scaled by the age has distribution function P{(X−t)/t≤x∣X>t}=Ft(xt)P\{(X - t)/t \le x \mid X > t\} = F_t(xt)P{(X−t)/t≤x∣X>t}=Ft​(xt).

For α>0\alpha > 0α>0 the Pareto-type law Γα\Gamma_\alphaΓα​ is

Γα(x)=1−(1+x)−α(x≥0),Γα(x)=0(x<0).\Gamma_\alpha(x) = 1 - (1 + x)^{-\alpha} \quad (x \ge 0), \qquad \Gamma_\alpha(x) = 0 \quad (x < 0).Γα​(x)=1−(1+x)−α(x≥0),Γα​(x)=0(x<0).

It is the law of Y−1Y - 1Y−1 when P{Y>y}=y−αP\{Y > y\} = y^{-\alpha}P{Y>y}=y−α for y≥1y \ge 1y≥1. FFF has a positive density F′F'F′ for t≥t0t \ge t_0t≥t0​ if FFF is differentiable at every t≥t0t \ge t_0t≥t0​ with derivative F′(t)>0F'(t) > 0F′(t)>0. The quantity F′(t)/(1−F(t))F'(t)/(1 - F(t))F′(t)/(1−F(t)) is the hazard rate of XXX at ttt, and tF′(t)/(1−F(t))tF'(t)/(1 - F(t))tF′(t)/(1−F(t)) is the hazard rate scaled by the age.

Formalization targets

Goal: Theorem 6 (p. 801)

Let FFF have a positive density F′F'F′ for t≥t0t \ge t_0t≥t0​, and let α1,α2>0\alpha_1, \alpha_2 > 0α1​,α2​>0 satisfy α1≤tF′(t)/(1−F(t))≤α2\alpha_1 \le tF'(t)/(1 - F(t)) \le \alpha_2α1​≤tF′(t)/(1−F(t))≤α2​ for t≥t0t \ge t_0t≥t0​. Then for all t≥t0t \ge t_0t≥t0​ and all real xxx,

Γα1(x)  ≤  P{X−tt≤x  ∣  X>t}  ≤  Γα2(x).\Gamma_{\alpha_1}(x) \;\le\; P\Big\{\frac{X - t}{t} \le x \;\Big|\; X > t\Big\} \;\le\; \Gamma_{\alpha_2}(x).Γα1​​(x)≤P{tX−t​≤x​X>t}≤Γα2​​(x).

The smaller constant gives the lower bound: a smaller scaled hazard rate means a heavier tail and hence a larger chance that the remaining life is long. For a Pareto tail 1−F(t)=Ct−α1 - F(t) = Ct^{-\alpha}1−F(t)=Ct−α one may take α1=α2=α\alpha_1 = \alpha_2 = \alphaα1​=α2​=α, and both inequalities are equalities.

Milestone: the integrated hazard bounds (proof of Theorem 6, p. 801)

For t≥t0t \ge t_0t≥t0​ and x>0x > 0x>0,

α1∫t(1+x)tduu≤∫t(1+x)tF′(u)1−F(u) du≤α2∫t(1+x)tduu.\alpha_1 \int_t^{(1+x)t} \frac{du}{u} \le \int_t^{(1+x)t} \frac{F'(u)}{1 - F(u)}\,du \le \alpha_2 \int_t^{(1+x)t} \frac{du}{u}.α1​∫t(1+x)t​udu​≤∫t(1+x)t​1−F(u)F′(u)​du≤α2​∫t(1+x)t​udu​.

Significance

The theorem turns a pointwise condition on the hazard rate, which can be checked on a density, into a bound on the whole conditional distribution of the residual life, valid at every age t≥t0t \ge t_0t≥t0​ rather than only in the limit. If moreover tF′(t)/(1−F(t))→αtF'(t)/(1 - F(t)) \to \alphatF′(t)/(1−F(t))→α, then α1,α2\alpha_1, \alpha_2α1​,α2​ can be taken arbitrarily close to α\alphaα for large t0t_0t0​, which recovers the convergence P{(X−t)/t≤x∣X>t}→Γα(x)P\{(X - t)/t \le x \mid X > t\} \to \Gamma_\alpha(x)P{(X−t)/t≤x∣X>t}→Γα​(x) with an explicit error at finite ages. Such bounds are what a practitioner fitting a Pareto tail above a threshold needs to quantify the approximation.

The result is classical and its proof is short; it is not open. As far as is known, no machine-checked version exists, and Mathlib has no theory of residual life distributions or of the limit laws of Balkema and de Haan. A formal proof would provide reusable pieces: the identity between the integrated hazard rate and −log⁡(1−F)-\log(1 - F)−log(1−F) for a distribution function with a density, and the comparison of a residual life distribution with a Pareto law. The other missions of this series formalize the paper's limit theorems, for which this mission's objects (the residual life distribution and Γα\Gamma_\alphaΓα​) are shared.

Difficulty

The mathematics is elementary; the work lies in the regularity bookkeeping that the printed proof leaves implicit. The density is only assumed to exist pointwise, so the fundamental theorem of calculus must be applied to −log⁡(1−F)-\log(1 - F)−log(1−F) with a derivative that is not assumed continuous, and its integrability on [t,(1+x)t][t, (1+x)t][t,(1+x)t] has to come from the hazard bounds themselves. That 1−F1 - F1−F stays positive, that t0>0t_0 > 0t0​>0, and that the case x≤0x \le 0x≤0 is trivial all have to be derived from the hypotheses rather than assumed. Finally, the conditional probability must be identified with 1−R((1+x)t)/R(t)1 - R((1+x)t)/R(t)1−R((1+x)t)/R(t), where R=1−FR = 1 - FR=1−F, through the measure of intervals.

Formalization scope

The law of XXX is a probability measure μ\muμ on R\mathbb RR, and FFF is Mathlib's ProbabilityTheory.cdf μ. The probability P{(X−t)/t≤x∣X>t}P\{(X - t)/t \le x \mid X > t\}P{(X−t)/t≤x∣X>t} is residualLife μ t (x * t) =μ((t,t+xt])/μ((t,∞))= \mu((t, t + xt])/\mu((t, \infty))=μ((t,t+xt])/μ((t,∞)). Γα\Gamma_\alphaΓα​ is a real function defined by cases, with Real.rpow for the power. The density is an explicit function fff with FFF having derivative f(t)>0f(t) > 0f(t)>0 at every t≥t0t \ge t_0t≥t0​, the derivative taken within [t0,∞)[t_0, \infty)[t0​,∞). This is a right derivative at t0t_0t0​ and the ordinary derivative for t>t0t > t_0t>t0​. It is the weakest reading of "positive density F′F'F′ for t≥t0t \ge t_0t≥t0​", and it admits the exact Pareto law with t0=1t_0 = 1t0​=1, whose distribution function has no two-sided derivative at 111. The bounds are stated for t⋅f(t)/(1−F(t))t \cdot f(t)/(1 - F(t))t⋅f(t)/(1−F(t)) with Lean's real division.

No hypothesis is added to the printed theorem, and no printed slip was found. The conditions t0>0t_0 > 0t0​>0 and F(t)<1F(t) < 1F(t)<1 follow from the hypotheses: for t≤0t \le 0t≤0 the ratio is not ≥α1>0\ge \alpha_1 > 0≥α1​>0, and a positive derivative on [t0,∞)[t_0, \infty)[t0​,∞) makes FFF strictly increasing there. Lean's convention a/0=0a/0 = 0a/0=0 therefore never acts at the ages concerned. The conclusion is stated for all real xxx, as printed; for x≤0x \le 0x≤0 all three quantities are 000. The milestone does not assume the hazard rate integrable: it is bounded and measurable on [t,(1+x)t][t, (1+x)t][t,(1+x)t], and a non-integrable integrand would make the inequality false rather than trivially true. A formalization that dropped the density hypothesis, replaced F′F'F′ by deriv without differentiability, or let the bounds hold only on a set not containing every t≥t0t \ge t_0t≥t0​ would not be this theorem; all three are excluded by the statement.

A proof needs the fundamental theorem of calculus for derivatives within a half-line (in Mathlib), the identity ∫t(1+x)tdu/u=log⁡(1+x)\int_t^{(1+x)t} du/u = \log(1+x)∫t(1+x)t​du/u=log(1+x), and the chain rule for log⁡(1−F)\log(1 - F)log(1−F). Proofs of the milestone and the goal are welcome, as are sorry-free lemmas showing that Γα\Gamma_\alphaΓα​ is a distribution function and that the Pareto law satisfies the hypotheses with α1=α2\alpha_1 = \alpha_2α1​=α2​.

Selected references

  • A. A. Balkema, L. de Haan, Residual Life Time at Great Age, The Annals of Probability 2 (1974), no. 5, 792–804. https://doi.org/10.1214/aop/1176996548
  • J. Pickands III, Statistical Inference Using Extreme Order Statistics, The Annals of Statistics 3 (1975), no. 1, 119–131. https://doi.org/10.1214/aos/1176343003
  • R. von Mises, La distribution de la plus grande de n valeurs, Revue Mathématique de l'Union Interbalkanique 1 (1936), 141–160.
  • L. de Haan, A. Ferreira, Extreme Value Theory: An Introduction, Springer, 2006. https://doi.org/10.1007/0-387-34471-3
4 thms2 active usersReviewed
Algorithmic Game TheoryConvex OptimizationOperations Research+1·Captain: mikedeng1

Cooperative Fuzzy Games 1: A Balanced Game without Side Payments Has a Nonempty Core Containing the Core of Its Fuzzy ExtensionResearch Paper

Motivation

A game without side payments (an NTU game) describes cooperation in which utility cannot be transferred between players: each coalition AAA of players is assigned the set V(A)V(A)V(A) of payoff vectors it can secure on its own. The core is the set of payoffs to the grand coalition that no coalition can improve upon. Whether the core is nonempty is the basic stability question of cooperative game theory. For games with side payments the answer is the Bondareva–Shapley theorem. For NTU games it is Scarf's theorem (Scarf 1967): a balanced game has a nonempty core. Billera (1970) gave a convex version, in which the payoff sets are convex and balancedness is stated with weighted Minkowski sums.

Aubin's paper (Aubin 1981) obtains Billera's version of the theorem by a different route. Players may join coalitions at fractional rates of participation, and the paper first proves a core existence theorem for these fuzzy games. The game on ordinary coalitions is then embedded into a fuzzy game whose core lies inside the core of the original game.

Setting

The players are N={1,…,n}N = \{1,\dots,n\}N={1,…,n}. A coalition A⊆NA \subseteq NA⊆N is identified with its characteristic vector τA∈{0,1}n\tau^A \in \{0,1\}^nτA∈{0,1}n, and τN=(1,…,1)\tau^N = (1,\dots,1)τN=(1,…,1). A fuzzy coalition is a vector τ∈[0,1]n\tau \in [0,1]^nτ∈[0,1]n of participation rates with support Aτ={i:τi>0}A_\tau = \{i : \tau_i > 0\}Aτ​={i:τi​>0}. Write (τ⋅c)i=τici(\tau\cdot c)_i = \tau_i c_i(τ⋅c)i​=τi​ci​, Rτ=τ⋅Rn\mathbb{R}^\tau = \tau\cdot\mathbb{R}^nRτ=τ⋅Rn for the vectors vanishing off AτA_\tauAτ​, R+τ\mathbb{R}^\tau_+R+τ​ for its nonnegative part, and R˚+τ\mathring{\mathbb{R}}^\tau_+R˚+τ​ for the vectors strictly positive on AτA_\tauAτ​.

A fuzzy game without side payments assigns to each τ≥0\tau \ge 0τ≥0 a nonempty, closed, convex set V(τ)⊆RτV(\tau)\subseteq\mathbb{R}^\tauV(τ)⊆Rτ. Each V(τ)V(\tau)V(τ) is comprehensive, meaning V(τ)=V(τ)−R+τV(\tau) = V(\tau)-\mathbb{R}^\tau_+V(τ)=V(τ)−R+τ​, and bounded above, meaning V(τ)⊆C−R+τV(\tau)\subseteq C-\mathbb{R}^\tau_+V(τ)⊆C−R+τ​ for some CCC. The map is positively homogeneous: V(tτ)=tV(τ)V(t\tau) = tV(\tau)V(tτ)=tV(τ) for every t>0t>0t>0. Its core is the set of c∈V(τN)c\in V(\tau^N)c∈V(τN) such that τ⋅c∉V(τ)−R˚+τ\tau\cdot c\notin V(\tau)-\mathring{\mathbb{R}}^\tau_+τ⋅c∈/V(τ)−R˚+τ​ for every fuzzy coalition τ≠0\tau\neq 0τ=0. With the support function v(τ,λ)=sup⁡c∈V(τ)∑iλiciv(\tau,\lambda)=\sup_{c\in V(\tau)}\sum_i\lambda_i c_iv(τ,λ)=supc∈V(τ)​∑i​λi​ci​ and the simplex MnM^nMn, a weak (resp. strong) canonical cooperative equilibrium is a c∈V(τN)c\in V(\tau^N)c∈V(τN) together with a λˉ∈Mn\bar\lambda\in M^nλˉ∈Mn (resp. λˉ\bar\lambdaλˉ with all coordinates positive) satisfying ∑iλˉiτici≥v(τ,λˉ)\sum_i\bar\lambda^i\tau_ic_i\ge v(\tau,\bar\lambda)∑i​λˉiτi​ci​≥v(τ,λˉ) for every τ∈[0,1]n\tau\in[0,1]^nτ∈[0,1]n.

A usual NTU game lives on a family C\mathcal{C}C of coalitions that contains NNN and every singleton. For each A∈CA\in\mathcal{C}A∈C, the set V(A)⊆RAV(A)\subseteq\mathbb{R}^AV(A)⊆RA is nonempty, closed, convex, comprehensive and bounded above. A balance of τ\tauτ is a vector of weights m≥0m\ge 0m≥0 on C\mathcal{C}C with ∑A∋im(A)=τi\sum_{A\ni i}m(A)=\tau_i∑A∋i​m(A)=τi​ for every iii, and C(τ)\mathcal{C}(\tau)C(τ) is the set of balances of τ\tauτ. The fuzzy extension of the game is

πV(τ)=⋃m∈C(τ) ∑A∈Cm(A) V(A),\pi V(\tau)=\bigcup_{m\in\mathcal{C}(\tau)}\ \sum_{A\in\mathcal{C}} m(A)\,V(A),πV(τ)=m∈C(τ)⋃​ A∈C∑​m(A)V(A),

and the game is balanced if V(N)=πV(τN)V(N)=\pi V(\tau^N)V(N)=πV(τN).

Formalization targets

Goal: Theorem 7.1

For a balanced game without side payments,

∅≠core⁡(πV)⊆core⁡(V),CCEstrong(V)⊆core⁡(πV)⊆CCEweak(V),\emptyset\neq\operatorname{core}(\pi V)\subseteq\operatorname{core}(V),\qquad \mathrm{CCE}_{\rm strong}(V)\subseteq\operatorname{core}(\pi V)\subseteq\mathrm{CCE}_{\rm weak}(V),∅=core(πV)⊆core(V),CCEstrong​(V)⊆core(πV)⊆CCEweak​(V),

and in particular core⁡(V)≠∅\operatorname{core}(V)\neq\emptysetcore(V)=∅.

Milestones

  • Proposition 3.1: c∈V(τN)c\in V(\tau^N)c∈V(τN) is in the core iff the maximum complaint α(c)=sup⁡τ≠0inf⁡λ∈Mτ[v(τ,λ)−∑iλiτici]\alpha(c)=\sup_{\tau\neq0}\inf_{\lambda\in M^\tau}[v(\tau,\lambda)-\sum_i\lambda^i\tau_ic_i]α(c)=supτ=0​infλ∈Mτ​[v(τ,λ)−∑i​λiτi​ci​] is ≤0\le 0≤0.
  • Proof of Theorem 3.1(b): if VVV is superadditive, V(τ)+V(σ)⊆V(τ+σ)V(\tau)+V(\sigma)\subseteq V(\tau+\sigma)V(τ)+V(σ)⊆V(τ+σ), then τ↦v(τ,λ)\tau\mapsto v(\tau,\lambda)τ↦v(τ,λ) is concave on R+n\mathbb{R}^n_+R+n​.
  • Theorem 3.1: strong equilibria lie in the core, and for a superadditive game the core lies in the set of weak equilibria.
  • Theorem 5.1: a superadditive fuzzy game has a nonempty core.
  • §7, (6), (7), (11): πV\pi VπV is a superadditive fuzzy game that extends VVV, and its support function is πv(τ,λ)=sup⁡m∈C(τ)∑Am(A)v(A,λ)\pi v(\tau,\lambda)=\sup_{m\in\mathcal{C}(\tau)}\sum_A m(A)v(A,\lambda)πv(τ,λ)=supm∈C(τ)​∑A​m(A)v(A,λ).
  • §7 and the proof of Theorem 7.1: under balancedness, core⁡(πV)⊆core⁡(V)\operatorname{core}(\pi V)\subseteq\operatorname{core}(V)core(πV)⊆core(V), and the equilibria of VVV coincide with those of πV\pi VπV.

Significance

Theorem 7.1 gives the core existence result for convex NTU games under Billera's balancedness condition. Its proof goes through a statement about fuzzy coalitions, Theorem 5.1, which uses no combinatorial pivoting. That theorem also has independent uses. Its fuzzy core is the solution concept that §4 of the paper identifies with Walras equilibria of exchange economies. The canonical cooperative equilibria give a price-like certificate, a common rate of transfer λˉ\bar\lambdaλˉ, that sandwiches the core.

The results are classical and proved. Prove2Me holds no statement of Scarf's or Billera's theorem, of NTU cores, or of balancedness for games without side payments, and Mathlib has none of these notions. The mission produces faithful statements of the paper's chain of results, and their proofs once solvers close them. It also builds reusable infrastructure: support functions of comprehensive sets, Minkowski combinations indexed by balances, and positively homogeneous set-valued maps.

Difficulty

Most of §7 is bookkeeping with Minkowski sums. The hard part is Theorem 5.1, the existence of a point in the fuzzy core. The core is defined by infinitely many exclusion conditions, one for each τ∈[0,1]n\tau\in[0,1]^nτ∈[0,1]n, so a finite intersection argument does not apply directly. The paper's route works with prices: it uses the superdifferential of the concave map τ↦v(τ,λ)\tau\mapsto v(\tau,\lambda)τ↦v(τ,λ) at τN\tau^NτN, Ky Fan's inequality on a truncated simplex where all λi≥ε\lambda_i\ge\varepsilonλi​≥ε, and a limit as ε→0\varepsilon\to0ε→0. That limit requires compactness of the approximating payoffs, and at the boundary of the simplex the superdifferential map is not upper semicontinuous. Theorem 3.1(b) needs a minisup theorem for a function that is concave in τ\tauτ and convex and lower semicontinuous in λ\lambdaλ. Mathlib has neither Ky Fan's inequality nor this minimax theorem in that form.

Formalization scope

All statements import one definitions file, FuzzyGames.NTUCore.Basic. The formalization commits to the following conventions.

  • Players are Fin n, and payoffs, fuzzy coalitions and rates of transfer are Fin n → ℝ, ordered coordinatewise. Rτ\mathbb{R}^\tauRτ is encoded as "vanishes where τi=0\tau_i=0τi​=0", which equals τ⋅Rn\tau\cdot\mathbb{R}^nτ⋅Rn for τ≥0\tau\ge0τ≥0.
  • Fuzzy games are defined directly on the orthant τ≥0\tau\ge0τ≥0, the paper's extension of VVV from [0,1]n[0,1]^n[0,1]n by homogeneity. Homogeneity holds for every t>0t>0t>0, and superadditivity holds on R+n\mathbb{R}^n_+R+n​.
  • Support functions, α\alphaα and πv\pi vπv take values in EReal, so an unbounded supremum is +∞+\infty+∞ and never a junk 000.
  • The supremum defining α(c)\alpha(c)α(c) ranges over τ≠0\tau\neq0τ=0. Since M0=∅M^0=\emptysetM0=∅, including τ=0\tau=0τ=0 would make α≡+∞\alpha\equiv+\inftyα≡+∞ and Proposition 3.1 false. Blocking coalitions are likewise τ≠0\tau\neq0τ=0, as in §3 (4).
  • C\mathcal{C}C is a finite family of nonempty coalitions that contains NNN and every singleton. "∀A≠∅\forall A\neq\emptyset∀A=∅" in §7 ranges over C\mathcal{C}C.
  • The paper leaves n≥1n\ge1n≥1 implicit. Theorem 3.1(b) and Theorem 5.1 carry 0<n0<n0<n: for n=0n=0n=0 the simplex is empty while the core is not.
  • In §7 (11), πv(τ,λ)\pi v(\tau,\lambda)πv(τ,λ), which the paper uses without defining it, is taken to be the extension §6 (2) applied to A↦v(A,λ)A\mapsto v(A,\lambda)A↦v(A,λ), for λ≥0\lambda\ge0λ≥0.
  • The §7 sentence after (5) is stated with two extra conclusions: πV(τ)\pi V(\tau)πV(τ) is nonempty and contained in Rτ\mathbb{R}^\tauRτ. These are the remaining requirements of §3 (3) that are needed to apply Theorem 5.1.
  • Sums and scalings of sets are Mathlib's pointwise operations.

The fuzzy-game axioms are a Prop-valued structure and are hypotheses of every theorem. The core and the equilibria are defined for an arbitrary set-valued map, so the theorems about πV\pi VπV do not presuppose that it is a fuzzy game. That fact is the content of the §7 milestones and is not assumed. Non-vacuity has been checked locally on a concrete instance: V(τ)={c∈Rτ:c≤τ}V(\tau)=\{c\in\mathbb{R}^\tau: c\le\tau\}V(τ)={c∈Rτ:c≤τ} is a superadditive fuzzy game, and V(A)={c∈RA:c≤τA}V(A)=\{c\in\mathbb{R}^A:c\le\tau^A\}V(A)={c∈RA:c≤τA} is a balanced game on every admissible C\mathcal{C}C, with (1,…,1)(1,\dots,1)(1,…,1) in both cores.

Contributions are welcome at every level: the §7 Minkowski-sum lemmas, the support-function identities, and a minisup or Ky Fan theorem in the form the proofs need. Reusable pieces include support functions of comprehensive sets and Sion-type minimax.

Selected references

  • J.-P. Aubin, Cooperative Fuzzy Games, Mathematics of Operations Research 6(1) (1981) 1–13. https://doi.org/10.1287/moor.6.1.1
  • H. E. Scarf, The Core of an N Person Game, Econometrica 35(1) (1967) 50–69. https://doi.org/10.2307/1909888
  • L. J. Billera, Some Theorems on the Core of an n-Person Game without Side-Payments, SIAM Journal on Applied Mathematics 18(3) (1970) 567–579. https://doi.org/10.1137/0118053
  • K. Fan, A Minimax Inequality and Applications, in O. Shisha (ed.), Inequalities III, Academic Press (1972) 103–113.
12 thms1 active userReviewed
CombinatoricsOperations ResearchOptimization·Captain: mikedeng1

One-Processor Scheduling with Symmetric Earliness and Tardiness Penalties 3: For Maximum Discrepancy, Some Optimum Schedule Is in Standard Form and Has the Release Time PropertyResearch Paper

Motivation

In just-in-time scheduling each job has a preferred time, and finishing it early is as undesirable as finishing it late. Garey, Tarjan and Wilfong (Math. Oper. Res. 13 (1988), 330–348) study the one-processor version in which task TiT_iTi​ has a length li≥0l_i \ge 0li​≥0 and a preferred starting time ai≥0a_i \ge 0ai​≥0, and the discrepancy of a task started at time sis_isi​ is ∣si−ai∣|s_i - a_i|∣si​−ai​∣. The penalty is symmetric: earliness and tardiness cost the same. The paper shows that minimizing the total discrepancy is NP-complete, gives an O(Nlog⁡N)O(N \log N)O(NlogN) algorithm for a fixed task order, and, in §3, gives an efficient algorithm for minimizing the maximum discrepancy max⁡i∣si−ai∣\max_i |s_i - a_i|maxi​∣si​−ai​∣: a linear-time test for a given bound γ\gammaγ after an O(Nlog⁡N)O(N \log N)O(NlogN) sort, combined with a search over γ\gammaγ.

This mission formalizes the structural core of §3: the normal-form theorems (Theorem 4, Corollaries 1 and 2) on which the paper's algorithm for maximum discrepancy is built. The two companion missions of the series cover the NP-completeness result (THEOREM 1) and the fixed-order algorithm (THEOREMS 2 and 3).

Setting

Fix a bound γ≥0\gamma \ge 0γ≥0. A schedule has maximum discrepancy at most γ\gammaγ exactly when every task starts no earlier than its release time ri=max⁡{0,ai−γ}r_i = \max\{0, a_i - \gamma\}ri​=max{0,ai​−γ} and finishes no later than its deadline di=ai+li+γd_i = a_i + l_i + \gammadi​=ai​+li​+γ (p. 342). These release times and deadlines are in special form: with α=2γ\alpha = 2\gammaα=2γ, for every task

di−ri=li+αor(ri=0 and di<li+α).d_i - r_i = l_i + \alpha \quad\text{or}\quad \big(r_i = 0 \text{ and } d_i < l_i + \alpha\big).di​−ri​=li​+αor(ri​=0 and di​<li​+α).

From here on the data are arbitrary reals li≥0l_i \ge 0li​≥0, ri≥0r_i \ge 0ri​≥0, did_idi​ in special form for some α≥0\alpha \ge 0α≥0.

A schedule is an execution order σ\sigmaσ (σ(p)\sigma(p)σ(p) is the task in position ppp) with starting times sis_isi​, such that a task finishes no later than any later-positioned task starts: sσ(p)+lσ(p)≤sσ(q)s_{\sigma(p)} + l_{\sigma(p)} \le s_{\sigma(q)}sσ(p)​+lσ(p)​≤sσ(q)​ for p<qp < qp<q. It is feasible if ri≤sir_i \le s_iri​≤si​ and si+li≤dis_i + l_i \le d_isi​+li​≤di​ for every iii. Its makespan is max⁡i(si+li)\max_i (s_i + l_i)maxi​(si​+li​), and it is optimum if it is feasible and no feasible schedule has a smaller makespan.

Let TNT_NTN​ be a task of largest deadline. A schedule has the release time property if every task executed after TNT_NTN​ has release time strictly later than the starting time of TNT_NTN​. When the tasks are indexed with d1≤⋯≤dNd_1 \le \dots \le d_Nd1​≤⋯≤dN​, a schedule is in standard form with split index jjj, 0≤j≤N−10 \le j \le N-10≤j≤N−1, if it begins with an optimum schedule of T1,…,TjT_1, \dots, T_jT1​,…,Tj​, followed by TNT_NTN​ started at the maximum of rNr_NrN​ and the completion time of that first part, followed by Tj+1,…,TN−1T_{j+1}, \dots, T_{N-1}Tj+1​,…,TN−1​ in this order without idle time.

Formalization targets

Goal: Corollary 2 (p. 344)

∃ a feasible schedule  ⟹  ∃ an optimum schedule that is in standard form and has the release time property.\exists\ \text{a feasible schedule} \;\Longrightarrow\; \exists\ \text{an optimum schedule that is in standard form and has the release time property.}∃ a feasible schedule⟹∃ an optimum schedule that is in standard form and has the release time property.

Milestones

  1. Theorem 4 (pp. 342–343): if a feasible schedule exists, some optimum schedule has the release time property with respect to any task of largest deadline.
  2. The deadline split (proof of Corollary 1, p. 344): in every feasible schedule with the release time property, a task Ti≠TNT_i \neq T_NTi​=TN​ precedes TNT_NTN​ if and only if di≤sN+αd_i \le s_N + \alphadi​≤sN​+α.
  3. Corollary 1 (p. 344): some optimum schedule executes before TNT_NTN​ exactly the tasks of deadline at most β\betaβ, for some β≥0\beta \ge 0β≥0.
  4. Release before finish (p. 344): every task executed after TNT_NTN​ has ri≤sN+lNr_i \le s_N + l_Nri​≤sN​+lN​.
  5. Normalization after TNT_NTN​ (p. 344): an optimum schedule with the release time property can be changed, without moving TNT_NTN​ later and without touching the tasks before it, so that there is no idle time from the start of TNT_NTN​ on and the later tasks run in deadline order.

Two companion items state the reformulation of the maximum-discrepancy bound as release times and deadlines, and the special form with α=2γ\alpha = 2\gammaα=2γ.

Significance

Corollary 2 reduces the search for an optimum schedule of T1,…,TnT_1, \dots, T_nT1​,…,Tn​ to nnn candidates, one per split index, each assembled from an optimum schedule of a shorter prefix. This is the dynamic program of §3.2, which the paper implements in O(N)O(N)O(N) time after an O(Nlog⁡N)O(N \log N)O(NlogN) sort; combined with a search over γ\gammaγ it minimizes the maximum discrepancy. Without the special form, deciding whether one processor can meet arbitrary release times and deadlines is NP-complete (reference [4] of the paper, Garey and Johnson 1979), so the normal form is what separates the tractable case from the general one.

The results are proved in the paper; no machine-checked proof of them is known on Prove2Me. A formal proof of Corollary 2 would certify the correctness of the split-index recursion and, together with the companions, of the reduction from maximum discrepancy to this release-time/deadline problem.

Difficulty

The obvious argument fails in Theorem 4. Exchanging a straggler (a task after TNT_NTN​ released no later than TNT_NTN​ starts) with TNT_NTN​ shifts the tasks between them, and for general release times and deadlines those tasks can become infeasible. The paper's argument uses the special form at every step: a task released after TNT_NTN​ starts has ri>0r_i > 0ri​>0, hence di−ri=li+αd_i - r_i = l_i + \alphadi​−ri​=li​+α exactly, and this equality is what bounds how far tasks may move. It also needs an extremal choice of the optimum schedule (fewest tasks after TNT_NTN​, then fewest tasks between TNT_NTN​ and the first straggler), which requires showing that optimum schedules exist over the reals. The passage to standard form then combines this with an earliest-deadline exchange for the tasks after TNT_NTN​ and the replacement of the first part by an optimum sub-schedule without losing feasibility of the later tasks.

Formalization scope

Tasks are indexed by Fin N (0-based: the paper's T1,…,TNT_1, \dots, T_NT1​,…,TN​ are 0,…,N−10, \dots, N-10,…,N−1; the paper's TNT_NTN​ in Corollary 2 is the index N−1N-1N−1). All data are real. A schedule is a permutation σ : Fin N ≃ Fin N with starting times s : Fin N → ℝ; "executed before/after" refers to σ, not to a comparison of starting times, because zero-length tasks may share a starting time. Execution intervals meet at most at endpoints. The makespan is a supremum over Fin N; "optimum" quantifies over all feasible schedules, not only standard-form ones.

The standing hypotheses on every structural item are α≥0\alpha \ge 0α≥0, ri≥0r_i \ge 0ri​≥0, li≥0l_i \ge 0li​≥0 (from γ≥0\gamma \ge 0γ≥0, the max⁡{0,⋅}\max\{0, \cdot\}max{0,⋅} in rir_iri​, and nonnegative lengths); since si≥ris_i \ge r_isi​≥ri​, start times are nonnegative, as the paper assumes throughout. The special form is a hypothesis of every structural item and cannot be dropped. The paper's dummy task T0T_0T0​ (r0=d0=l0=0r_0 = d_0 = l_0 = 0r0​=d0​=l0​=0) is not a task; an empty first part completes at time 000. Corollary 1's "the set of all tasks with deadline β\betaβ or less" is read as excluding TNT_NTN​, the only reading under which it is true. The page's "(which can be assumed optimum)" is part of the standard form. The deadline-split and release-before-finish milestones are stated for every feasible schedule, as their arguments allow.

A trivializing formalization is excluded: the standard form pins TNT_NTN​'s start to max⁡(rN,C)\max(r_N, C)max(rN​,C) and the later tasks to consecutive positions in index order, so the goal is not Corollary 1 restated with an unconstrained split.

Running times (O(Nlog⁡N)O(N \log N)O(NlogN), O(N)O(N)O(N)) and the algorithm of §3.2 are out of scope. The development needs only finite permutations, finite suprema and the exchange arguments of §3.1; the existence of an optimum schedule (minimum makespan over finitely many orders, earliest-start schedules) is reusable for other single-machine problems with release times and deadlines. Proofs of any milestone, and a sorry-free proof of the existence of optimum schedules, are welcome.

Selected references

  • M. R. Garey, R. E. Tarjan, G. T. Wilfong, One-Processor Scheduling with Symmetric Earliness and Tardiness Penalties, Mathematics of Operations Research 13(2):330–348, 1988. https://doi.org/10.1287/moor.13.2.330
  • M. R. Garey, D. S. Johnson, Computers and Intractability: A Guide to the Theory of NP-Completeness, W. H. Freeman, 1979 (reference [4] of the paper, cited on p. 342 for the NP-completeness of one-processor scheduling with release times and deadlines). ISBN 0-7167-1045-5
7 thms1 active userReviewed
🏆Completed
Linear OptimizationOperations ResearchOptimization·Captain: mikedeng1

On the Power of Robust Solutions in Two-Stage Stochastic and Adaptive Optimization Problems 5: For Hypercube Uncertainty, Even in the Constraints, the Robust and Adaptive Optima CoincideResearch Paper

Motivation

In two-stage optimization under uncertainty, a first-stage decision xxx is taken before the data are known, and a second-stage decision yyy is taken after a scenario ω\omegaω is revealed. The fully adaptive formulation lets yyy depend on ω\omegaω and minimizes the worst-case cost. It is the natural model of recourse, but it optimizes over policies, one decision per scenario, and is computationally hard in general. The static robust formulation fixes one yyy in advance that must be feasible in every scenario. It is a single deterministic mixed integer program and is the standard tractable surrogate (Ben-Tal, Goryashko, Guslitzer, Nemirovski 2004; Bertsimas & Sim 2004).

The question is how much is lost by the surrogate. Bertsimas and Goyal (2010) bound the gap by 222 against the stochastic problem and by 444 against the adaptive problem when the uncertainty set is symmetric. Their §5.3 identifies a case with no gap at all: when the uncertainty set is a hypercube (a box), the static robust optimum equals the adaptive optimum, and this holds even when the constraint matrices themselves are uncertain. Box uncertainty is the simplest and most common uncertainty model in practice (interval data on every coefficient), so the result says that for it, adaptivity buys nothing.

This mission formalizes that theorem, Theorem 5.4, together with Theorem 2.4, which shows that under right-hand-side uncertainty the robust problem is a single deterministic problem with the coordinatewise worst right-hand side.

Setting

Fix dimensions m,n1,n2m,n_1,n_2m,n1​,n2​ and sets I1,I2I_1,I_2I1​,I2​ of integer coordinates. The decision domains are

DI={x∈Rn:x≥0, xi∈Z for i∈I},D_{I}=\{x\in\mathbb R^n : x\ge0,\ x_i\in\mathbb Z\ \text{for } i\in I\},DI​={x∈Rn:x≥0, xi​∈Z for i∈I},

which is R+n−p×Z+p\mathbb R_+^{n-p}\times\mathbb Z_+^{p}R+n−p​×Z+p​ up to relabelling coordinates, p=∣I∣p=|I|p=∣I∣.

A scenario set Ω\OmegaΩ is given. In scenario ω\omegaω the data are a constraint matrix A(ω)∈Rm×n1A(\omega)\in\mathbb R^{m\times n_1}A(ω)∈Rm×n1​, a recourse matrix B(ω)∈Rm×n2B(\omega)\in\mathbb R^{m\times n_2}B(ω)∈Rm×n2​, a right-hand side b(ω)∈Rmb(\omega)\in\mathbb R^mb(ω)∈Rm and a second-stage cost d(ω)∈R+n2d(\omega)\in\mathbb R^{n_2}_+d(ω)∈R+n2​​. The first-stage cost c∈R+n1c\in\mathbb R^{n_1}_+c∈R+n1​​ is fixed.

  • The adaptive problem ΠAdapt(A,B,b,d)\Pi_{\mathrm{Adapt}}(A,B,b,d)ΠAdapt​(A,B,b,d) (5.6) chooses x∈DI1x\in D_{I_1}x∈DI1​​ and y(ω)∈DI2y(\omega)\in D_{I_2}y(ω)∈DI2​​ for every ω\omegaω with A(ω)x+B(ω)y(ω)≥b(ω)A(\omega)x+B(\omega)y(\omega)\ge b(\omega)A(ω)x+B(ω)y(ω)≥b(ω) for all ω\omegaω, and has value
zAdapt=inf⁡ cTx+sup⁡ω∈Ωd(ω)Ty(ω).z_{\mathrm{Adapt}}=\inf\ c^Tx+\sup_{\omega\in\Omega}d(\omega)^Ty(\omega).zAdapt​=inf cTx+ω∈Ωsup​d(ω)Ty(ω).
  • The robust problem ΠRob(A,B,b,d)\Pi_{\mathrm{Rob}}(A,B,b,d)ΠRob​(A,B,b,d) (5.7) chooses one x∈DI1x\in D_{I_1}x∈DI1​​, y∈DI2y\in D_{I_2}y∈DI2​​ with A(ω)x+B(ω)y≥b(ω)A(\omega)x+B(\omega)y\ge b(\omega)A(ω)x+B(ω)y≥b(ω) for all ω\omegaω, and has value
zRob=inf⁡ cTx+sup⁡ω∈Ωd(ω)Ty.z_{\mathrm{Rob}}=\inf\ c^Tx+\sup_{\omega\in\Omega}d(\omega)^Ty.zRob​=inf cTx+ω∈Ωsup​d(ω)Ty.

The uncertainty set is U={(A(ω),B(ω),b(ω),d(ω)):ω∈Ω}\mathcal U=\{(A(\omega),B(\omega),b(\omega),d(\omega)) : \omega\in\Omega\}U={(A(ω),B(ω),b(ω),d(ω)):ω∈Ω}, a subset of RN\mathbb R^NRN with N=mn1+mn2+m+n2N=mn_1+mn_2+m+n_2N=mn1​+mn2​+m+n2​. Following Definition 1.1, U\mathcal UU is a hypercube if U=[l1,u1]×⋯×[lN,uN]\mathcal U=[l_1,u_1]\times\cdots\times[l_N,u_N]U=[l1​,u1​]×⋯×[lN​,uN​] for some li≤uil_i\le u_ili​≤ui​.

For Theorem 2.4, AAA, BBB and ddd are fixed and only b(ω)∈R+mb(\omega)\in\mathbb R^m_+b(ω)∈R+m​ varies; ΠRob(b)\Pi_{\mathrm{Rob}}(b)ΠRob​(b) (1.2) is the robust problem above, and Π\PiΠ is the deterministic problem with right-hand side bjh=max⁡ωbj(ω)b^h_j=\max_\omega b_j(\omega)bjh​=maxω​bj​(ω).

Formalization targets

Goal: Theorem 5.4 (p. 31)

If U\mathcal UU is a hypercube, then

zRob(A,B,b,d)=zAdapt(A,B,b,d).z_{\mathrm{Rob}}(A,B,b,d)=z_{\mathrm{Adapt}}(A,B,b,d).zRob​(A,B,b,d)=zAdapt​(A,B,b,d).

The integer coordinates I1,I2I_1,I_2I1​,I2​ are arbitrary, and nothing is assumed about the signs of AAA, BBB, bbb.

Milestones

  1. Theorem 2.4 (p. 17). Under right-hand-side uncertainty, (x,y)(x,y)(x,y) is feasible for ΠRob(b)\Pi_{\mathrm{Rob}}(b)ΠRob​(b) if and only if Ax+By≥bhAx+By\ge b^hAx+By≥bh; hence zRob(b)=z(Π)z_{\mathrm{Rob}}(b)=z(\Pi)zRob​(b)=z(Π).
  2. p. 31 display. zAdapt(A,B,b,d)≤zRob(A,B,b,d)z_{\mathrm{Adapt}}(A,B,b,d)\le z_{\mathrm{Rob}}(A,B,b,d)zAdapt​(A,B,b,d)≤zRob​(A,B,b,d) for every uncertainty set.
  3. Eqs. (5.8)–(5.10). If U\mathcal UU is a hypercube, some scenario ωˉ\bar\omegaωˉ has A(ωˉ)A(\bar\omega)A(ωˉ), B(ωˉ)B(\bar\omega)B(ωˉ) entrywise minimal and b(ωˉ)b(\bar\omega)b(ωˉ), d(ωˉ)d(\bar\omega)d(ωˉ) entrywise maximal over Ω\OmegaΩ.
  4. Eqs. (5.11)–(5.13). For such ωˉ\bar\omegaωˉ, if (x,y(⋅))(x,y(\cdot))(x,y(⋅)) is adaptive feasible, then (x,y(ωˉ))(x,y(\bar\omega))(x,y(ωˉ)) is robust feasible.
  5. Eq. (5.14). For such ωˉ\bar\omegaωˉ, the robust worst-case cost of (x,y(ωˉ))(x,y(\bar\omega))(x,y(ωˉ)) is at most the adaptive worst-case cost of (x,y(⋅))(x,y(\cdot))(x,y(⋅)).

Significance

The result. Theorem 5.4 says that for interval uncertainty on every coefficient, the static robust program, whose size does not grow with the number of scenarios, solves the adaptive problem exactly. Combined with Theorem 2.4 for right-hand-side uncertainty, the adaptive problem collapses to one deterministic mixed integer program with worst-case data. It marks the boundary case of the paper's adaptability-gap bounds: the gap is at most 444 for symmetric sets, and exactly 111 for boxes.

Formalizing it. The result is proved in the paper; to our knowledge it has no machine-checked proof. The mission produces a Lean model of two-stage robust and adaptive mixed integer programs with uncertain constraint matrices, with values as extended-real infima, which other formalizations of adjustable robust optimization can build on.

Difficulty

The mathematics is elementary; the care is in the statement. The step that fails for a general uncertainty set is the existence of a single worst scenario ωˉ\bar\omegaωˉ that is simultaneously entrywise smallest in AAA, BBB and entrywise largest in bbb, ddd. For a set that is only contained in a box, the box's worst corner need not be realized. With two scenarios b=(1,0)b=(1,0)b=(1,0) and b=(0,1)b=(0,1)b=(0,1), B=IB=IB=I, d=(1,1)d=(1,1)d=(1,1), the adaptive value is 111 and the robust value is 222. A formalization therefore has to state the hypercube hypothesis as an equality of sets. A second point is the arithmetic of extended reals: the paper argues from optimal solutions, which need not exist, so the inequalities must be transported through infima over feasible sets that may be empty and through suprema that may be infinite.

Formalization scope

  • Decisions are vectors Fin n → ℝ; matrices are Matrix (Fin m) (Fin n) ℝ; constraints use Mathlib's componentwise order and mulVec.
  • Mixed-integer domains are "nonnegative, integer on a designated coordinate set III", the paper's R+n−p×Z+p\mathbb R_+^{n-p}\times\mathbb Z_+^pR+n−p​×Z+p​ up to relabelling.
  • Optimal values are EReal infima over the feasible set, +∞+\infty+∞ when infeasible; worst-case costs are EReal suprema over Ω\OmegaΩ. No optimal solution is assumed.
  • A scenario datum is a structure with the four blocks (A,B,b,d)(A,B,b,d)(A,B,b,d); the box and the hypercube predicate are written entrywise on these blocks, which is Definition 1.1 in RN\mathbb R^NRN.
  • The hypercube hypothesis is IsHypercube (uncertaintySet A B b d), i.e. the realized data are exactly a box. Assuming only that the data lie inside a box would make the statement false (example above); assuming fixed AAA, BBB would state Corollary 5.1 instead of Theorem 5.4.
  • Typos corrected in the Lean: (5.6)–(5.7) print Z+n2\mathbb Z^{n_2}_+Z+n2​​ for the second-stage integer block, read as Z+p2\mathbb Z^{p_2}_+Z+p2​​; §5.3's opening sentence names ΠAdapt(b,d)\Pi_{\mathrm{Adapt}}(b,d)ΠAdapt​(b,d) twice where the first is ΠRob(b,d)\Pi_{\mathrm{Rob}}(b,d)ΠRob​(b,d).
  • In Theorem 2.4 the paper's max⁡ωbj(ω)\max_\omega b_j(\omega)maxω​bj​(ω) is a real supremum under the hypothesis that the right-hand sides are bounded above, and the second stage is continuous (p2=0p_2=0p2​=0), as in the problem Π\PiΠ on the page.

Contributions welcome: proofs of the milestones and of the goal, and lemmas on monotonicity of mulVec for nonnegative vectors and on EReal infima over feasible sets, which are reusable across the other missions of this series.

Selected references

  • D. Bertsimas, V. Goyal, On the power of robust solutions in two-stage stochastic and adaptive optimization problems, Mathematics of Operations Research 35(2), 2010. https://doi.org/10.1287/moor.1090.0440 (cited from the authors' manuscript, MIT DSpace).
  • A. Ben-Tal, A. Goryashko, E. Guslitzer, A. Nemirovski, Adjustable robust solutions of uncertain linear programs, Mathematical Programming 99, 2004. https://doi.org/10.1007/s10107-003-0454-y
  • D. Bertsimas, M. Sim, The price of robustness, Operations Research 52(1), 2004. https://doi.org/10.1287/opre.1030.0065
11 thms2 active usersReviewed
🏆Completed
Convex OptimizationOperations ResearchOptimization·Captain: mikedeng1

Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers V: Sharing ADMM — the z-Update Reduces to One n-Variable Problem and the Dual Variables AgreeTextbook

Why consensus and sharing

Many large optimization problems arising in statistics, machine learning, signal processing and resource allocation have an objective that is a sum of terms, each depending on data held by a different processor, or a coupling term that depends on the sum of the agents' decisions. Chapter 7 of Boyd, Parikh, Chu, Peleato and Eckstein's monograph on the alternating direction method of multipliers (ADMM) (Found. Trends Mach. Learn. 3(1), 2011) introduces two templates that turn such problems into distributed algorithms: consensus and sharing. Nearly every distributed application in the rest of the monograph (distributed lasso, distributed logistic regression, splitting across examples and across features in Chapter 8) is an instance of one of the two. Consensus problems in the context of ADMM go back to Bertsekas and Tsitsiklis (Parallel and Distributed Computation, 1989).

The value of the templates lies in a handful of exact algebraic facts about the ADMM subproblems: the global update is an average, the dual variables average to zero, and the sharing update, which looks like a problem in NnNnNn variables, is really a problem in nnn variables. These facts are what this mission formalizes.

Setting

There are N≥1N\ge1N≥1 agents. Vectors live in Rn\mathbb R^nRn with the Euclidean inner product, and an overline denotes an average over agents, vˉ=1N∑i=1Nvi\bar v=\frac1N\sum_{i=1}^N v_ivˉ=N1​∑i=1N​vi​. Each local cost fif_ifi​ and the shared cost ggg are functions into R∪{+∞}\mathbb R\cup\{+\infty\}R∪{+∞}. The penalty parameter is ρ>0\rho>0ρ>0.

Global variable consensus (§7.1) is the problem

minimize ∑i=1Nfi(xi)subject to xi−z=0, i=1,…,N,\text{minimize }\sum_{i=1}^N f_i(x_i)\quad\text{subject to } x_i-z=0,\ i=1,\dots,N,minimize i=1∑N​fi​(xi​)subject to xi​−z=0, i=1,…,N,

with local variables xi∈Rnx_i\in\mathbb R^nxi​∈Rn and a global variable zzz. ADMM alternates a parallel xix_ixi​-update, an averaging zzz-update and a dual update of the multipliers yiy_iyi​. With a regularizer g(z)g(z)g(z) added (7.2), the zzz-update (7.4) becomes a minimization involving ggg.

General form consensus (§7.2) lets local variable xi∈Rnix_i\in\mathbb R^{n_i}xi​∈Rni​ copy only some entries of zzz: entry jjj of xix_ixi​ corresponds to entry zG(i,j)z_{\mathcal G(i,j)}zG(i,j)​, and z~i∈Rni\tilde z_i\in\mathbb R^{n_i}z~i​∈Rni​ is defined by (z~i)j=zG(i,j)(\tilde z_i)_j=z_{\mathcal G(i,j)}(z~i​)j​=zG(i,j)​. The number of local entries copying zgz_gzg​ is kgk_gkg​.

Sharing (§7.3) is the problem

minimize ∑i=1Nfi(xi)+g(∑i=1Nxi),(7.11)\text{minimize }\sum_{i=1}^N f_i(x_i)+g\Big(\sum_{i=1}^N x_i\Big),\tag{7.11}minimize i=1∑N​fi​(xi​)+g(i=1∑N​xi​),(7.11)

written for ADMM with copies ziz_izi​ of the xix_ixi​ (7.12). In scaled form, with ai=uik+xik+1a_i=u_i^k+x_i^{k+1}ai​=uik​+xik+1​, its zzz-update is

(z1k+1,…,zNk+1)∈argmin⁡z1,…,zN g(∑i=1Nzi)+(ρ/2)∑i=1N∥zi−ai∥22,(z_1^{k+1},\dots,z_N^{k+1})\in\operatorname*{argmin}_{z_1,\dots,z_N}\ g\Big(\sum_{i=1}^N z_i\Big)+(\rho/2)\sum_{i=1}^N\|z_i-a_i\|_2^2,(z1k+1​,…,zNk+1​)∈z1​,…,zN​argmin​ g(i=1∑N​zi​)+(ρ/2)i=1∑N​∥zi​−ai​∥22​,

followed by uik+1=uik+xik+1−zik+1u_i^{k+1}=u_i^k+x_i^{k+1}-z_i^{k+1}uik+1​=uik​+xik+1​−zik+1​.

Formalization targets

Goal: the sharing zzz-update reduction (§7.3, p. 57)

For every a1,…,aNa_1,\dots,a_Na1​,…,aN​: (z1,…,zN)(z_1,\dots,z_N)(z1​,…,zN​) solves the NnNnNn-variable zzz-update iff zˉ\bar zzˉ solves

minimize⁡zˉ∈Rn g(Nzˉ)+(ρ/2)∑i=1N∥zˉ−aˉ∥22\operatorname*{minimize}_{\bar z\in\mathbb R^n}\ g(N\bar z)+(\rho/2)\sum_{i=1}^N\|\bar z-\bar a\|_2^2zˉ∈Rnminimize​ g(Nzˉ)+(ρ/2)i=1∑N​∥zˉ−aˉ∥22​

and

zi=ai+zˉ−aˉ(7.13);z_i=a_i+\bar z-\bar a\quad (7.13);zi​=ai​+zˉ−aˉ(7.13);

and along every run of sharing ADMM,

uik+1=uˉk+xˉk+1−zˉk+1(7.14),u_i^{k+1}=\bar u^k+\bar x^{k+1}-\bar z^{k+1}\quad(7.14),uik+1​=uˉk+xˉk+1−zˉk+1(7.14),

so all scaled dual variables agree after one step.

Milestones

  • §7.1: the consensus zzz-update is zk+1=xˉk+1+(1/ρ)yˉkz^{k+1}=\bar x^{k+1}+(1/\rho)\bar y^kzk+1=xˉk+1+(1/ρ)yˉ​k; then yˉk+1=0\bar y^{k+1}=0yˉ​k+1=0, zk=xˉkz^k=\bar x^kzk=xˉk and the simplified iteration.
  • (7.4), §7.1.1: with a regularizer, the zzz-update is averaging followed by a proximal step with weight NρN\rhoNρ; the soft-threshold (g=λ∥⋅∥1g=\lambda\|\cdot\|_1g=λ∥⋅∥1​) and positive-part (ggg the indicator of R+n\mathbb R^n_+R+n​) examples.
  • §7.2: the general form zzz-update is local averaging, and the dual entries attached to each global index sum to zero after the first iteration.
  • (7.13): with zˉ\bar zzˉ fixed, zi=ai+zˉ−aˉz_i=a_i+\bar z-\bar azi​=ai​+zˉ−aˉ is the unique minimizer.

Significance

The reduction is what makes sharing ADMM scale: the central step needs only the averages xˉk+1\bar x^{k+1}xˉk+1, uˉk\bar u^kuˉk and one nnn-dimensional proximal problem, regardless of the number of agents, and the dual state collapses to a single vector. The same reduction underlies exchange ADMM (§7.3.2) and the splitting-across-features algorithms of §8.3. The consensus facts explain why the fusion center only averages and why the dual variables can be dropped from its update.

All results of the chapter are proved, informally, in the monograph; they are elementary. To our knowledge none has a machine-checked proof. The mission produces checked statements of the update formulas that later chapters of the series and distributed-optimization developments can cite instead of re-deriving.

Difficulty

The statements are exact identities between minimizer sets of nonsmooth problems in which ggg may be any extended-real-valued function: there is no first-order condition to use, so each step must be argued by comparing objective values, and the iff requires producing, for an arbitrary competitor, a competitor of the reduced problem with no larger value. The index bookkeeping is the other half: averages of sums of sequences indexed by agents and by iterations, the off-by-one in "after the first iteration", and in §7.2 sums over the fibres {(i,j):G(i,j)=g}\{(i,j):\mathcal G(i,j)=g\}{(i,j):G(i,j)=g} of an index map between local vectors of different dimensions.

Formalization scope

  • Vectors are EuclideanSpace ℝ (Fin n); agents are indexed by Fin N, so the book's i=1,…,Ni=1,\dots,Ni=1,…,N is Lean's i−1i-1i−1; components are 0-based as well.
  • An extended-real-valued function is encoded by its effective domain (a set) and its finite values; every minimization is over the domain. Convexity is not assumed: none of the stated identities needs it, so the statements are slightly more general than the chapter's standing assumption that each fif_ifi​ is convex.
  • Iterates are hypotheses: a run is any sequence satisfying the update rules (argmin properties, not chosen minimizers). The consensus run uses the averaging formula exactly as printed on p. 49; the general form and sharing runs use the argmin form printed on pp. 55–56.
  • Explicit hypotheses that the book leaves implicit: N≥1N\ge1N≥1, ρ>0\rho>0ρ>0, λ>0\lambda>0λ>0 (named lam), kg≥1k_g\ge1kg​≥1 for every global index ggg in §7.2, and the index ranges k≥1k\ge1k≥1 for yˉk=0\bar y^{k}=0yˉ​k=0 and k≥2k\ge2k≥2 for zk=xˉkz^k=\bar x^kzk=xˉk (the starting y0y^0y0 is arbitrary).
  • Corrected misprints: p. 52 prints xˉk+1−(1/ρ)yˉk\bar x^{k+1}-(1/\rho)\bar y^kxˉk+1−(1/ρ)yˉ​k in the soft-threshold and positive-part examples, while the proximal form gives xˉk+1+(1/ρ)yˉk\bar x^{k+1}+(1/\rho)\bar y^kxˉk+1+(1/ρ)yˉ​k; p. 55 prints ∑i=1m\sum_{i=1}^m∑i=1m​ for ∑i=1N\sum_{i=1}^N∑i=1N​; p. 57 writes u∈Rmu\in\mathbf R^mu∈Rm for a vector of Rn\mathbb R^nRn.
  • The goal is about minimizers of the NnNnNn-variable zzz-subproblem, not the algebraic identity (7.13) alone, and (7.14) is derived for every run rather than built into a single-dual-variable definition; either shortcut would make the goal trivial.
  • Not included: the consensus residual norms (p. 51), the duality discussion of §7.3.1 and exchange ADMM (§7.3.2). Contributions formalizing them on top of these definitions are welcome.

Selected references

  • S. Boyd, N. Parikh, E. Chu, B. Peleato, J. Eckstein, Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers, Foundations and Trends in Machine Learning 3(1), 1–122, 2011. https://doi.org/10.1561/2200000016
  • D. P. Bertsekas, J. N. Tsitsiklis, Parallel and Distributed Computation: Numerical Methods, Prentice Hall, 1989. https://web.mit.edu/dimitrib/www/pdc.html
11 thms2 active usersReviewed
🏆Completed
Linear OptimizationOperations ResearchOptimization·Captain: mikedeng1

A Linear Programming Approach to the Cutting-Stock Problem: If No Slack and No Knapsack Pattern Prices Out, the Current Basic Solution Is a Minimum of the Cutting-Stock LPResearch Paper

Motivation

A cutting-stock shop receives orders for pieces of several lengths and cuts them from a limited menu of longer stock lengths. Each stock length has a cost. The shop can repeat any cutting pattern, so the central optimization question is which patterns meet the demand at least cost. The direct linear program has a variable for every possible pattern. Even a modest menu of piece lengths can yield too many columns to list before optimization begins. Gilmore and Gomory's 1961 article addresses this large-column obstacle by testing whether an as-yet-unlisted pattern could lower the cost of a current basic solution.

The article studies the linear programming relaxation: cutting activities may have nonnegative real weights rather than integer repetition counts. It does not claim that the resulting fractional optimum is always an integer cutting plan. Its worked example happens to have an integer optimum of cost 170; the authors explicitly note that this integrality is fortuitous (Gilmore and Gomory 1961, p. 858). The target here is the exact stopping condition for the relaxation.

Setting

An instance has mmm ordered piece lengths ℓi\ell_iℓi​, demand Ni∈NN_i\in\mathbb NNi​∈N for each piece length, and kkk stock lengths LjL_jLj​ with real costs cjc_jcj​. A cutting pattern for stock jjj is a vector of nonnegative integer counts aia_iai​ with ∑iℓiai≤Lj\sum_i\ell_i a_i\le L_j∑i​ℓi​ai​≤Lj​. An activity consists of that stock choice and its fitting pattern. Its demand column is a=(ai)a=(a_i)a=(ai​) and its cost is cjc_jcj​. A surplus column for demand row iii has coefficient −1-1−1 in that row, zero elsewhere, and zero cost. The paper uses such columns to turn its demand inequalities into equations (Gilmore and Gomory 1961, p. 850, (1)–(3)).

A feasible solution assigns nonnegative real weights to finitely many activities and surplus columns so that activity output minus surplus equals NiN_iNi​ in every row. Its cost is the weighted sum of stock costs. A basis β\betaβ lists mmm columns with invertible coefficient matrix AAA and cost row CCC. The associated bordered matrix, demand column, tableau column, and multipliers are

B=(1−C0A),N′=(0,N1,…,Nm)T,Nˉ=B−1N′,bi=(B−1)0,i+1.B=\begin{pmatrix}1&-C\\0&A\end{pmatrix},\qquad N'=(0,N_1,\ldots,N_m)^T,\qquad \bar N=B^{-1}N',\qquad b_i=(B^{-1})_{0,i+1}.B=(10​−CA​),N′=(0,N1​,…,Nm​)T,Nˉ=B−1N′,bi​=(B−1)0,i+1​.

A feasible basis has nonnegative basic values, the last mmm entries of Nˉ\bar NNˉ. Those values on the basic columns, with zero on every other column, form the current basic solution. The first entry of Nˉ\bar NNˉ is its cost. These definitions follow the matrix and tableau of routine steps (2)–(4) (Gilmore and Gomory 1961, pp. 854–855).

Formalization targets

The goal is the stopping statement of step (4). If no nonbasic surplus column has a negative multiplier, and no available stock jjj has a fitting pattern satisfying ∑ibiai>cj\sum_i b_i a_i>c_j∑i​bi​ai​>cj​, then the current solution is feasible and minimizes cost across all feasible activity and surplus assignments:

(∀i with surplus i∉β, bi≥0)∧(∀j,a, ∑iℓiai≤Lj⇒∑ibiai≤cj)⟹cost⁡(zβ)=Nˉ0≤cost⁡(z)for every feasible z.\bigl(\forall i\text{ with surplus }i\notin\beta,\ b_i\ge0\bigr) \quad\land\quad \bigl(\forall j,a,\ \sum_i\ell_i a_i\le L_j\Rightarrow\sum_i b_i a_i\le c_j\bigr) \quad\Longrightarrow\quad \operatorname{cost}(z_\beta)=\bar N_0\le\operatorname{cost}(z) \quad\text{for every feasible }z.(∀i with surplus i∈/β, bi​≥0)∧(∀j,a, i∑​ℓi​ai​≤Lj​⇒i∑​bi​ai​≤cj​)⟹cost(zβ​)=Nˉ0​≤cost(z)for every feasible z.

The six milestones record the paper's ingredients: the first row of B−1B^{-1}B−1 and the meaning of Nˉ\bar NNˉ; the entering-column price test (4)–(5); the surplus-column test of step (3); the integer-pattern form (6)–(7); the maximum-pattern test; and the dynamic programming recurrence for Fs(x)F_s(x)Fs​(x) (Gilmore and Gomory 1961, pp. 852–855). The paper has no numbered theorems or lemmas; each milestone is drawn from a sentence or display on those pages.

Significance

The result makes a finite tableau a certificate for an optimization problem whose set of potential cutting activities is much larger than the current basis. A failed pricing search is meaningful only when it covers every fitting pattern for every stock length; the goal makes that full scope explicit. In the example, the final multipliers are (2,3,5)(2,3,5)(2,3,5) and the relevant knapsack maxima for stock lengths 555, 666, and 999 are 555, 777, and 101010, matching their stopping prices and the cost 170 (Gilmore and Gomory 1961, p. 858).

The mathematical argument is known from the 1961 article. This mission asks for a machine-checked Lean proof of its particular cutting-stock formulation, including the bounded-pattern search, bordered tableau, surplus columns, and global optimality conclusion. The proposal statements compile with proof placeholders; they are not already proved by those placeholders. Published general LP results are listed as references, but their finite-indexed formulations do not directly state the cutting-stock theorem.

Difficulty

Checking only the columns already in a tableau cannot establish optimality: an unlisted pattern might still fit a stock length and have a price greater than its cost. The article reduces this large search to an integer knapsack maximum for each stock length (Gilmore and Gomory 1961, pp. 852–853). Formalization must retain the distinction between a basis of mmm columns and the full collection of possible columns. Strict improvement also needs care at a degenerate basic solution. The paper directs zero-ratio pivots to a separate degeneracy procedure (Gilmore and Gomory 1961, p. 855); the sufficient directions of the pricing milestones therefore require positive basic values, while the goal's optimality direction does not.

Formalization scope

Lean indexes piece types from zero and uses a separate initial cost coordinate followed by the mmm demand coordinates for BBB. Thus the paper's (i+1)(i+1)(i+1)st bordered row corresponds to Lean demand index iii. Patterns are vectors in Nm\mathbb N^mNm; the zero pattern is included. A solution is a finitely supported real weighting of all activity and surplus columns. Global minimality quantifies over every such feasible weighting, including activities not in the current basis. No sign condition is imposed on stock costs or stock lengths in the goal; the goal is a conditional optimality statement and remains valid whenever its hypotheses hold.

The knapsack value Fs(x)F_s(x)Fs​(x) uses extended real numbers, giving −∞-\infty−∞ when no pattern fits, rather than an accidental real value from an empty supremum. The maximum-pattern milestone assumes positive piece lengths and nonnegative stock length, so the feasible set is finite and nonempty. The recursion milestone assumes positive lengths for all types through the newly added one; without the earlier positivity, a negative earlier length could let the new piece count exceed the displayed upper bound. The nondegeneracy hypotheses are confined to the sufficient directions of the three improvement milestones.

Reusable contributions include lemmas connecting the bordered inverse with CA−1C A^{-1}CA−1, finite-support linear program identities, and the integer knapsack recurrence. The source's rounding discussion, heuristic search, and under-specified anti-cycling device are outside this mission. An encoding that compares the current solution only with basis columns or generated columns would miss the paper's stopping claim.

Selected references

  • P. C. Gilmore and R. E. Gomory, A linear programming approach to the cutting-stock problem, Operations Research 9(6):849–859, 1961. DOI: 10.1287/opre.9.6.849.
13 thms5 active usersReviewed
Linear OptimizationOperations ResearchOptimization·Captain: mikedeng1

A Linear Programming Approach to the Cutting Stock Problem—Part II 2: For a Linear-Fractional Objective, a Basic Feasible Solution with No Improving Edge Is a Global MinimumResearch Paper

Motivation

In the cutting stock problem, stock rolls of length LLL are cut into pieces of lengths l1,…,lml_1,\dots,l_ml1​,…,lm​ to fill orders. Part I of Gilmore and Gomory's work (Opns. Res. 9 (1961)) solved its linear programming relaxation by the simplex method with column generation: the columns (cutting patterns) are too many to list, so each simplex iteration finds an improving column by solving a knapsack problem. Part II (Opns. Res. 11 (1963)) extends the method in several directions. One of them, customer tolerances, lets the amount produced of each length lie in a range [Ni′,Ni′′][N_i',N_i''][Ni′​,Ni′′​] instead of matching a fixed demand. Total roll usage then stops being a good measure of quality, because overproducing within the tolerance is free. The natural objective becomes the fraction of waste: total waste divided by total material cut. This objective is a ratio of two linear functions, not a linear one.

The paper's answer, on p. 882, is that the ordinary simplex method still works for such an objective. It moves from vertex to vertex, at each vertex asks whether some edge improves the objective, and stops when none does. Ratio objectives of this kind, called linear-fractional programs, were studied in the same years by Isbell and Marlow (1956), Martos (1960–61, in Hungarian; in English in 1964), Charnes and Cooper (1962) and Dinkelbach (1962; see also 1967). Gilmore and Gomory say that their method is closest to Martos's. They derive the edge test for the ratio and show that, for cutting stock, choosing the entering column is again a knapsack problem.

Setting

Let AAA be a real m×nm\times nm×n matrix, b∈Rmb\in\mathbb R^mb∈Rm and c,d∈Rnc,d\in\mathbb R^nc,d∈Rn. The linear-fractional program is

minimizeζ(x)=z1(x)z2(x)=∑icixi∑idixisubject toAx=b, x≥0.\text{minimize}\quad \zeta(x)=\frac{z_1(x)}{z_2(x)}=\frac{\sum_i c_ix_i}{\sum_i d_ix_i}\qquad\text{subject to}\quad Ax=b,\ x\ge 0 .minimizeζ(x)=z2​(x)z1​(x)​=∑i​di​xi​∑i​ci​xi​​subject toAx=b, x≥0.

In the cutting stock instance (p. 881), column jjj is either a cutting pattern aj∈Z≥0ma_j\in\mathbb Z^m_{\ge0}aj​∈Z≥0m​ with ∑iaijli≤L\sum_ia_{ij}l_i\le L∑i​aij​li​≤L or a slack column −ei-e_i−ei​. The right-hand side is bi=Ni′b_i=N_i'bi​=Ni′​. The numerator coefficient of a pattern is its waste wj=L−∑iaijliw_j=L-\sum_ia_{ij}l_iwj​=L−∑i​aij​li​ (eq. (4)), and dj=1d_j=1dj​=1 on patterns and 000 on slacks, so ζ\zetaζ is waste per roll cut. The paper drops the upper bounds si≤Ni′′−Ni′s_i\le N_i''-N_i'si​≤Ni′′​−Ni′​ on the slacks from the discussion (p. 882), and so does this mission.

A basis is a set BBB of mmm column indices whose columns of AAA are linearly independent. A basic feasible solution xˉ\bar xxˉ with basis BBB is a feasible point with xˉk=0\bar x_k=0xˉk​=0 for every k∉Bk\notin Bk∈/B. For a nonbasic j∉Bj\notin Bj∈/B, the edge direction of xjx_jxj​ is the vector vvv with Av=0Av=0Av=0, vj=1v_j=1vj​=1 and vk=0v_k=0vk​=0 for the other nonbasic kkk. This is "the edge that would be traced out if xjx_jxj​ were increased, but all other nonbasic variables kept zero" (p. 883). The quantity the simplex test inspects is the rate of change along the edge,

dζdxj=ddτ ζ(xˉ+τv)∣τ=0.\frac{d\zeta}{dx_j}=\frac{d}{d\tau}\,\zeta(\bar x+\tau v)\Big|_{\tau=0}.dxj​dζ​=dτd​ζ(xˉ+τv)​τ=0​.

Formalization targets

Goal: the edge criterion (p. 882)

Assume ∑idixi>0\sum_id_ix_i>0∑i​di​xi​>0 for every feasible xxx. Let xˉ\bar xxˉ be a basic feasible solution with basis BBB, and suppose dζ/dxj≥0d\zeta/dx_j\ge0dζ/dxj​≥0 for every j∉Bj\notin Bj∈/B and every edge direction of xjx_jxj​. Then

ζ(xˉ)≤ζ(x)for every x≥0 with Ax=b.\zeta(\bar x)\le\zeta(x)\qquad\text{for every } x\ge0 \text{ with } Ax=b .ζ(xˉ)≤ζ(x)for every x≥0 with Ax=b.

Milestones (p. 882–883)

  1. Monotonicity along lines. On an interval where the denominator does not vanish, τ↦ζ(x+τv)\tau\mapsto\zeta(x+\tau v)τ↦ζ(x+τv) is strictly increasing, strictly decreasing or constant. Moreover f′(τ) D(τ)2f'(\tau)\,D(\tau)^2f′(τ)D(τ)2 is constant, where DDD is the denominator.
  2. Equation (5), first line.
dζdxj=z2 (dz1/dxj)−z1 (dz2/dxj)z22.\frac{d\zeta}{dx_j}=\frac{z_2\,(dz_1/dx_j)-z_1\,(dz_2/dx_j)}{z_2^2}.dxj​dζ​=z22​z2​(dz1​/dxj​)−z1​(dz2​/dxj​)​.
  1. The edge test. If dζ/dxj<0d\zeta/dx_j<0dζ/dxj​<0, increasing xjx_jxj​ strictly decreases ζ\zetaζ along any segment where the denominator does not vanish. Otherwise ζ\zetaζ does not decrease anywhere on that segment.
  2. Column choice is a knapsack problem. With k=Lz2−z1k=Lz_2-z_1k=Lz2​−z1​ and Πˉi=−(z1Πi2−z2Πi1−z2li)\bar\Pi_i=-(z_1\Pi^2_i-z_2\Pi^1_i-z_2l_i)Πˉi​=−(z1​Πi2​−z2​Πi1​−z2​li​), the numerator of dζ/dxjd\zeta/dx_jdζ/dxj​ for pattern aaa equals k−∑iΠˉiaik-\sum_i\bar\Pi_ia_ik−∑i​Πˉi​ai​. Hence, for z2≠0z_2\ne0z2​=0, the most negative dζ/dxjd\zeta/dx_jdζ/dxj​ is attained exactly by the patterns maximizing ∑iΠˉiai\sum_i\bar\Pi_ia_i∑i​Πˉi​ai​ subject to ∑iaili≤L\sum_ia_il_i\le L∑i​ai​li​≤L.

Significance

The result. The edge criterion turns a nonconvex problem into one the simplex method solves. A ratio of linear functions is neither convex nor concave, so a point where no feasible direction improves the objective locally is not obviously a global minimum. The criterion says that, on a polyhedron where the denominator keeps its sign, this local test at a vertex certifies global optimality, exactly as for a linear objective. It underlies the convergence of Martos's method and of every simplex-type algorithm for linear-fractional programming. Together with milestone 4, it is what makes column generation with a knapsack pricing step applicable to the waste-fraction objective of cutting stock.

Formalizing it. The result is classical and proved; no machine-checked version is known to exist. The published platform items closest to it are Derman's Charnes–Cooper transformation of a linear-fractional program into a linear program and Matoušek's reduced-cost optimality criterion for a linear objective. Neither states an edge criterion for a ratio. A formal proof here also settles the paper's own imprecisions (see below), and yields reusable lemmas about ratios of affine functions along lines.

Difficulty

The obvious argument does not reach the goal. Along any single segment the objective is monotone (milestone 1), so a nonnegative derivative at xˉ\bar xxˉ in the direction of the segment would settle it. But the test at xˉ\bar xxˉ inspects only the n−mn-mn−m edge directions, while a feasible point xxx lies in the direction x−xˉx-\bar xx−xˉ, which is in general not an edge. Monotonicity along each edge says nothing directly about other directions, and ζ\zetaζ is neither convex nor concave, so local optimality along a few lines does not by itself transfer to the whole polyhedron. The step that has to be supplied is the passage from the edges to all feasible directions at a basic solution. It fails without the basis: at a feasible point that is not basic, or with linearly dependent columns, the edge directions need not reach every feasible point. At a degenerate vertex some edge directions leave the feasible set at once, and a test restricted to the feasible edges does not certify optimality.

Formalization scope

The feasible set and the objective are the published definitions DermanSeqDecisions.LinProg.IsFeasible11 (x≥0x\ge0x≥0, Ax=bAx=bAx=b) and DermanSeqDecisions.LinProg.fracObj ((∑cixi)/(∑dixi)(\sum c_ix_i)/(\sum d_ix_i)(∑ci​xi​)/(∑di​xi​)). The basis is the published MatousekLP.BFS.IsBasis. Indices are 0-based. A mission definition adds the basic feasible solution and the relational edge direction. The edge direction is given by its defining equations, not through a basis inverse, and is not required to be feasible.

Committed conventions and disclosed choices:

  • The goal is stated for minimization, the paper's problem; the paper's sentence says "maximize", which is the same statement for −c-c−c.
  • "In a domain where the denominator does not vanish" is the hypothesis ∑idixi>0\sum_id_ix_i>0∑i​di​xi​>0 for every feasible xxx (the paper's footnote: ∑jxj>0\sum_jx_j>0∑j​xj​>0). It is not required on all of Rn\mathbb R^nRn, where it would be unsatisfiable for the cutting stock ddd.
  • The derivative in the test is Mathlib's deriv of τ↦ζ(xˉ+τv)\tau\mapsto\zeta(\bar x+\tau v)τ↦ζ(xˉ+τv) at 000: the actual rate of change, not a formula assumed to equal it.
  • The page says that along a line the derivative "will have the same value". This is false when the denominator varies along the line. Milestone 1 states the correct version: the derivative times the squared denominator is constant, so the sign is constant.
  • In the formula after substituting (4), the page prints the coefficient −li-l_i−li​ where −z2li-z_2l_i−z2​li​ is meant. Milestone 4 uses the corrected coefficient.
  • The slack upper bounds are dropped, as on p. 882.

The following would trivialize the goal and are excluded: an edge hypothesis over all directions vvv instead of the edge directions, which turns the goal into quasi-convexity along segments; an edge hypothesis stated as the global inequality; a positivity hypothesis on the denominator over all of Rn\mathbb R^nRn; and dropping the basis, under which the goal is false.

The development needs elementary real calculus (derivatives of quotients, monotonicity from the sign of the derivative) and the linear algebra of a basis (existence, uniqueness and spanning of the edge directions). The lemmas about ratios of affine functions along lines and about edge directions of a basis are reusable for any simplex-type method. Contributions of proofs of the milestones, and of auxiliary lemmas on edge directions, are welcome.

Selected references

  • P. C. Gilmore and R. E. Gomory, A linear programming approach to the cutting stock problem—Part II, Operations Research 11(6), 863–888, 1963. https://doi.org/10.1287/opre.11.6.863
  • P. C. Gilmore and R. E. Gomory, A linear programming approach to the cutting stock problem, Operations Research 9(6), 849–859, 1961. https://doi.org/10.1287/opre.9.6.849
  • B. Martos, Hyperbolic programming, Naval Research Logistics Quarterly 11(2), 135–155, 1964. https://doi.org/10.1002/nav.3800110204
  • A. Charnes and W. W. Cooper, Programming with linear fractional functionals, Naval Research Logistics Quarterly 9(3–4), 181–186, 1962. https://doi.org/10.1002/nav.3800090303
  • W. Dinkelbach, Die Maximierung eines Quotienten zweier linearer Funktionen unter linearen Nebenbedingungen, Zeitschrift für Wahrscheinlichkeitstheorie 1, 141–145, 1962 (cited by the paper as [11]).
  • W. Dinkelbach, On nonlinear fractional programming, Management Science 13(7), 492–498, 1967. https://doi.org/10.1287/mnsc.13.7.492
  • J. R. Isbell and W. H. Marlow, Attrition games, Naval Research Logistics Quarterly 3, 71–94, 1956 (cited by the paper as [9]).
8 thms2 active usersReviewed
🏆Completed
CombinatoricsLinear OptimizationOperations Research·Captain: mikedeng1

A Linear Programming Approach to the Cutting Stock Problem—Part II 1: The Lexicographic Knapsack Method Terminates, and M_1 Equals max(c_1, the Knapsack Optimum for the Longest Stock Length L_1)Research Paper

Motivation

The cutting stock problem asks how to cut standard stock rolls of length LLL into pieces of demanded lengths l1,…,lml_1,\dots,l_ml1​,…,lm​ so that the demands are met at least cost. Gilmore and Gomory solved its linear programming relaxation by column generation (Part I, Opns. Res. 9 (1961)): every cutting pattern is a column, and the column to bring into the basis is found by solving an integer knapsack problem whose objective is given by the current dual prices. In Part II (Opns. Res. 11 (1963)) they replaced the dynamic-programming knapsack solver of Part I by a lexicographic enumeration with a bound test, the Knapsack Method, and reported it to be about five times as fast as dynamic programming on their problem set (p. 866). The method is an early enumeration-with-bounds (branch-and-bound type) procedure for the integer knapsack, and the same pricing problem remains the inner loop of column generation for cutting stock, bin packing and their many variants.

Setting

There are mmm demanded lengths l1,…,lm>0l_1,\dots,l_m>0l1​,…,lm​>0 with linear programming prices b1,…,bm≥0b_1,\dots,b_m\ge0b1​,…,bm​≥0, and kkk standard stock lengths L1,…,LkL_1,\dots,L_kL1​,…,Lk​ with costs c1,…,ckc_1,\dots,c_kc1​,…,ck​. A column for LjL_jLj​ is a vector (α)m=(a1,…,am)(\alpha)_m=(a_1,\dots,a_m)(α)m​=(a1​,…,am​) of nonnegative integers with ∑iliai≤Lj\sum_i l_ia_i\le L_j∑i​li​ai​≤Lj​. The knapsack problem (1) for LjL_jLj​ is

Mˉj=max⁡{∑i=1mbiai:ai∈Z≥0, ∑i=1mliai≤Lj},\bar M_j=\max\Big\{\sum_{i=1}^m b_ia_i : a_i\in\mathbb Z_{\ge0},\ \sum_{i=1}^m l_ia_i\le L_j\Big\},Mˉj​=max{i=1∑m​bi​ai​:ai​∈Z≥0​, i=1∑m​li​ai​≤Lj​},

and the quantity to compute is Mj=max⁡(cj,Mˉj)M_j=\max(c_j,\bar M_j)Mj​=max(cj​,Mˉj​): a column improves the linear program exactly when Mˉj>cj\bar M_j>c_jMˉj​>cj​.

For a prefix (α)s=(a1,…,as)(\alpha)_s=(a_1,\dots,a_s)(α)s​=(a1​,…,as​) write λ⋅(α)s=∑i≤sliai\lambda\cdot(\alpha)_s=\sum_{i\le s}l_ia_iλ⋅(α)s​=∑i≤s​li​ai​ and β⋅(α)s=∑i≤sbiai\beta\cdot(\alpha)_s=\sum_{i\le s}b_ia_iβ⋅(α)s​=∑i≤s​bi​ai​. Step (1) sorts the data, b1/l1≥⋯≥bm/lmb_1/l_1\ge\dots\ge b_m/l_mb1​/l1​≥⋯≥bm​/lm​ and L1>⋯>LkL_1>\dots>L_kL1​>⋯>Lk​, and appends a slack item am+1a_{m+1}am+1​ with bm+1=0b_{m+1}=0bm+1​=0, lm+1=1l_{m+1}=1lm+1​=1. The method then generates vectors in decreasing lexicographic order:

  • Steps (2) and (7) fill the coefficients after a prefix greedily, ai=[(L−used)/li]a_i=[(L-\text{used})/l_i]ai​=[(L−used)/li​], for L=L1L=L_1L=L1​ at the start and L=LtL=L_tL=Lt​ later.
  • Step (3) records β⋅(α)m\beta\cdot(\alpha)_mβ⋅(α)m​ as the new MjM_jMj​ for each j≥tj\ge tj≥t with Lj≥λ⋅(α)mL_j\ge\lambda\cdot(\alpha)_mLj​≥λ⋅(α)m​ and β⋅(α)m>Mj\beta\cdot(\alpha)_m>M_jβ⋅(α)m​>Mj​.
  • Step (4) finds the last nonzero coefficient asa_sas​.
  • Step (5) lowers asa_sas​ by one and looks for the smallest jjj with Lj≥λ⋅(α)sL_j\ge\lambda\cdot(\alpha)_sLj​≥λ⋅(α)s​ and (Lj−λ⋅(α)s)bs+1>(Mj−β⋅(α)s)ls+1(L_j-\lambda\cdot(\alpha)_s)b_{s+1}>(M_j-\beta\cdot(\alpha)_s)l_{s+1}(Lj​−λ⋅(α)s​)bs+1​>(Mj​−β⋅(α)s​)ls+1​. This is the bound obtained by relaxing the integrality of as+1a_{s+1}as+1​.
  • Step (6) backs up to the previous nonzero coefficient when no such jjj exists, and stops when there is none.

In Lean the method is a transition system Step on states (a, s, t, M, phase). Reachable means reachable from the start state of Step (2).

Formalization targets

Goal: the method terminates and computes M1M_1M1​

Under Step (1)'s ordering, with li>0l_i>0li​>0 and bi≥0b_i\ge0bi​≥0:

every run is finite,a non-final state has a successor,M1final=max⁡(c1,Mˉ1),\text{every run is finite},\quad \text{a non-final state has a successor},\quad M_1^{\text{final}}=\max\big(c_1,\bar M_1\big),every run is finite,a non-final state has a successor,M1final​=max(c1​,Mˉ1​),

and at the end every MjM_jMj​ is cjc_jcj​ or the price of a column for LjL_jLj​, with cj≤Mjc_j\le M_jcj​≤Mj​. With one stock length (k=1k=1k=1) this is the paper's correctness claim in full: the method solves the knapsack problem (1).

Milestones

  1. Steps (2)/(7): the greedy completion is the lexicographically largest extension of a prefix that fits the capacity.
  2. Step (4): the lexicographic predecessor of a fitting vector extends (α1)s(\alpha^1)_s(α1)s​.
  3. The relaxation bound β⋅(α′)m≤β⋅(α)s+bs+1(L−λ⋅(α)s)/ls+1\beta\cdot(\alpha')_m\le\beta\cdot(\alpha)_s+b_{s+1}(L-\lambda\cdot(\alpha)_s)/l_{s+1}β⋅(α′)m​≤β⋅(α)s​+bs+1​(L−λ⋅(α)s​)/ls+1​ for every fitting extension.
  4. After the inequality of Step (5)'s test fails, no vector between (α)s(\alpha)_s(α)s​ and the successor of Step (6) improves MMM.
  5. The vectors tested in Step (3) strictly decrease lexicographically.
  6. The invariant on entry to Step (3).
  7. Identical prices: among lengths with equal prices only the shortest is needed (p. 869).

Significance

The goal certifies the pricing oracle of the Gilmore–Gomory column-generation method: the knapsack solver it calls returns the true optimum. The pricing step is exact only if that holds, and so is the conclusion "no improving column exists, the LP is solved". Milestones 1–4 are reusable on their own. They are the textbook ingredients of lexicographic and depth-first branch-and-bound for the integer knapsack: the greedy completion, the density-ordered LP bound, and the pruning rule.

The paper's argument is a short paragraph, "clear from the order in which the mmm-vectors are generated". Writing it out shows that the claim is false for several stock lengths as the steps are printed. With m=1m=1m=1, l1=b1=1l_1=b_1=1l1​=b1​=1, L=(5,2)L=(5,2)L=(5,2) and c=(0,0)c=(0,0)c=(0,0), the method tests (5)(5)(5). The test of Step (5) at (4)(4)(4) then fails for j=2j=2j=2 only because 4>L24>L_24>L2​, Step (6) stops, and the run ends with M2=0M_2=0M2​=0 while the column (2)(2)(2) has price 2. This mission therefore states what the printed algorithm does achieve. The result is the full claim for k=1k=1k=1 and for the longest stock length in general. A sorry-free Lean proof of the counterexample run accompanies the mission. No part of the method or its correctness has been formalized before, as far as a search of the platform shows.

Difficulty

The method skips large parts of the lexicographic order in three ways:

  • Step (7) jumps to the greedy completion for LtL_tLt​ rather than L1L_1L1​.
  • Step (6) jumps past every smaller value of asa_sas​ once one test fails.
  • Step (3) updates only j≥tj\ge tj≥t.

Each skip has to be justified by a bound that holds for every vector skipped, and the justifications interact. A skipped vector may fit a longer stock length but not LtL_tLt​, and the bound for L1L_1L1​ must cover exactly those vectors. The invariant that survives all three moves is not the naive "every vector above the current one has been examined": the vectors are not examined, only bounded. Termination needs the lexicographic decrease together with finiteness of the fitting vectors, and progress needs the reachability invariants 1≤s≤m1\le s\le m1≤s≤m and as≠0a_s\ne0as​=0 that make Step (5) meaningful.

Formalization scope

  • Items are Fin m from 0. The paper's level sss is a natural number, and the prefix (α)s(\alpha)_s(α)s​ is the coordinates with index < s. Stock lengths are Fin k, and L1L_1L1​ is index 0. The slack item enters only through bs+1b_{s+1}bs+1​ and ls+1l_{s+1}ls+1​ at s=ms=ms=m. The lexicographic order is Mathlib's Pi.Lex, and [x][x][x] is Nat.floor.

  • Mj=max⁡(cj,Mˉj)M_j=\max(c_j,\bar M_j)Mj​=max(cj​,Mˉj​) is the predicate IsKnapsackMax, never a real supremum, which would be 0 on an empty set. The algorithm's output is never defined as the maximum. The goal includes termination and progress, so its correctness clause is not vacuous. Every invariant is stated for reachable states only.

  • The goal adds two disclosed hypotheses:

    • li>0l_i>0li​>0: demanded lengths.
    • bi≥0b_i\ge0bi​≥0: with a negative price the method is wrong, and the paper applies it to cutting-stock prices, which are nonnegative.

    Step (1) is a hypothesis on the data, not a step.

  • The goal also makes these corrections:

    • The claim is narrowed. For every jjj it states cj≤Mjc_j\le M_jcj​≤Mj​ and attainment, and the upper bound for L1L_1L1​ only (see Significance).
    • The lexicographic order is repaired. The page's definition misses vectors that differ in their first coefficient.
    • Step (7) reads λ·(α)_m. The page's "satisfies Lt≥λ⋅(α)sL_t\ge\lambda\cdot(\alpha)_sLt​≥λ⋅(α)s​" is read as λ⋅(α)m\lambda\cdot(\alpha)_mλ⋅(α)m​.
    • Step (4) gets a stopping case. On the zero vector, where the page has no case, the method stops.
    • Milestone 4 is stated for the failed inequality, not for a failed test, because the failed test is what makes the page's successor claim false.
  • Not formalized:

    • Step (3′), the variant computing max⁡j(Mj−cj)\max_j(M_j-c_j)maxj​(Mj​−cj​).
    • The record of patterns.
    • The dynamic-programming recursion and the timing estimates.

Contributions welcome: proofs of the milestones, and a corrected multi-length variant of the method with a proof that it computes every MjM_jMj​.

Selected references

  • P. C. Gilmore, R. E. Gomory, A linear programming approach to the cutting stock problem—Part II, Operations Research 11(6) (1963), 863–888. https://doi.org/10.1287/opre.11.6.863
  • P. C. Gilmore, R. E. Gomory, A linear programming approach to the cutting-stock problem, Operations Research 9(6) (1961), 849–859. https://doi.org/10.1287/opre.9.6.849
  • G. B. Dantzig, Discrete-variable extremum problems, Operations Research 5(2) (1957), 266–288. https://doi.org/10.1287/opre.5.2.266
10 thms2 active usersReviewed
Operations ResearchProbabilityStatistics·Captain: mikedeng1

Simulation Output Analysis Using Standardized Time Series 1: For Every g in the Class 𝓜, (Ȳₙ(1) − μ)/g(Ȳₙ) ⇒ B(1)/g(B) Under the FCLT (2.1)Research Paper

Motivation

A discrete-event simulation of a queue, an inventory system or a communication network produces an output process Y={Y(t):t≥0}Y = \{Y(t) : t \ge 0\}Y={Y(t):t≥0}, and the quantity of interest is usually its steady-state mean μ\muμ, the long-run average of YYY. The natural estimator is the time average Yˉn(1)=1n∫0nY(s) ds\bar Y_n(1) = \frac1n\int_0^n Y(s)\,dsYˉn​(1)=n1​∫0n​Y(s)ds of a run of length nnn. A confidence interval for μ\muμ needs the scale of the fluctuations of Yˉn(1)\bar Y_n(1)Yˉn​(1), the variance constant σ2\sigma^2σ2 of the central limit theorem n1/2(Yˉn(1)−μ)⇒σN(0,1)n^{1/2}(\bar Y_n(1) - \mu) \Rightarrow \sigma N(0,1)n1/2(Yˉn​(1)−μ)⇒σN(0,1). For correlated simulation output, σ2\sigma^2σ2 is a sum of autocovariances at all lags and is hard to estimate consistently.

The method of standardized time series (STS), introduced by Schruben (Schruben 1983), avoids estimating σ\sigmaσ: it divides the centred time average by a functional of the whole observed path that scales like σ\sigmaσ, so that σ\sigmaσ cancels. Batch means, the standardized sum, and the standardized maximum are all of this form.

Glynn and Iglehart (Glynn & Iglehart 1990) put the method on a general footing. They require only a functional central limit theorem (FCLT) for YYY, and they identify an abstract class M\mathcal MM of standardizing functionals for which the cancellation works. This mission formalizes their basic limit theorem, Theorem 2.4, and the four claims of its proof. Two companion results of §2, display (2.2) and the weak law Yˉn(1)⇒μ\bar Y_n(1) \Rightarrow \muYˉn​(1)⇒μ, are included as further targets.

Setting

C[0,1]C[0,1]C[0,1] is the space of continuous real functions on [0,1][0,1][0,1] with the uniform norm and its Borel σ\sigmaσ-algebra; k∈C[0,1]k \in C[0,1]k∈C[0,1] is the identity path k(t)=tk(t) = tk(t)=t. For g:C[0,1]→Rg : C[0,1] \to \mathbb Rg:C[0,1]→R, D(g)D(g)D(g) is the discontinuity set of ggg, the set of xxx at which ggg is not continuous. A standard Brownian motion BBB on a probability space (Ω,F,P)(\Omega, \mathcal F, P)(Ω,F,P) is a random element of C[0,1]C[0,1]C[0,1] with Gaussian finite-dimensional laws, B(0)=0B(0) = 0B(0)=0 and Cov⁡(B(s),B(t))=min⁡(s,t)\operatorname{Cov}(B(s), B(t)) = \min(s,t)Cov(B(s),B(t))=min(s,t).

The output YYY is a real-valued measurable process. Its scaled partial-integral process and its centred, rescaled version are

Yˉn(t)=1n∫0ntY(s) ds,Xn(t)=n1/2(Yˉn(t)−μt),0≤t≤1.\bar Y_n(t) = \frac1n\int_0^{nt} Y(s)\,ds, \qquad X_n(t) = n^{1/2}\bigl(\bar Y_n(t) - \mu t\bigr), \qquad 0 \le t \le 1 .Yˉn​(t)=n1​∫0nt​Y(s)ds,Xn​(t)=n1/2(Yˉn​(t)−μt),0≤t≤1.

Assumption (2.1) asks for finite constants μ\muμ and σ>0\sigma > 0σ>0 such that Xn⇒σBX_n \Rightarrow \sigma BXn​⇒σB as n→∞n \to \inftyn→∞, weak convergence of random elements of C[0,1]C[0,1]C[0,1]. It holds for ϕ\phiϕ-mixing, strongly mixing, associated and regenerative output processes, among others.

The class M\mathcal MM of (2.3) consists of the measurable g:C[0,1]→Rg : C[0,1] \to \mathbb Rg:C[0,1]→R with

  1. g(αx)=αg(x)g(\alpha x) = \alpha g(x)g(αx)=αg(x) for α>0\alpha > 0α>0 (positive homogeneity);
  2. g(x−βk)=g(x)g(x - \beta k) = g(x)g(x−βk)=g(x) for β∈R\beta \in \mathbb Rβ∈R (invariance under subtracting a linear drift);
  3. P{g(B)>0}=1P\{g(B) > 0\} = 1P{g(B)>0}=1;
  4. P{B∈D(g)}=0P\{B \in D(g)\} = 0P{B∈D(g)}=0.

The proof uses the auxiliary map h(x)=x(1)/g(x)h(x) = x(1)/g(x)h(x)=x(1)/g(x) for g(x)≠0g(x) \ne 0g(x)=0 and h(x)=0h(x) = 0h(x)=0 otherwise.

Formalization targets

Goal: Theorem 2.4

For every g∈Mg \in \mathcal Mg∈M, under Assumption (2.1),

Yˉn(1)−μg(Yˉn)⇒B(1)g(B)(n→∞).(2.5)\frac{\bar Y_n(1) - \mu}{g(\bar Y_n)} \Rightarrow \frac{B(1)}{g(B)} \qquad (n \to \infty). \tag{2.5}g(Yˉn​)Yˉn​(1)−μ​⇒g(B)B(1)​(n→∞).(2.5)

Milestones: the four claims of the proof (p. 3)

  1. P{σB∈D(h)}=0P\{\sigma B \in D(h)\} = 0P{σB∈D(h)}=0.
  2. h(Xn)⇒h(σB)h(X_n) \Rightarrow h(\sigma B)h(Xn​)⇒h(σB).
  3. h(σB)=B(1)/g(B)h(\sigma B) = B(1)/g(B)h(σB)=B(1)/g(B), by (2.3i).
  4. h(Xn)=(Yˉn(1)−μ)/g(Yˉn)h(X_n) = (\bar Y_n(1) - \mu)/g(\bar Y_n)h(Xn​)=(Yˉn​(1)−μ)/g(Yˉn​) for n≥1n \ge 1n≥1, by (2.3i) and (2.3ii).

Companions

n1/2(Yˉn(1)−μ)⇒σB(1)(2.2)n^{1/2}\bigl(\bar Y_n(1) - \mu\bigr) \Rightarrow \sigma B(1) \tag{2.2}n1/2(Yˉn​(1)−μ)⇒σB(1)(2.2)

and Yˉn(1)⇒μ\bar Y_n(1) \Rightarrow \muYˉn​(1)⇒μ.

Significance

Theorem 2.4 is the limit theorem behind every STS confidence interval. The limit B(1)/g(B)B(1)/g(B)B(1)/g(B) is free of σ\sigmaσ and of the output process, so with zzz chosen so that P{−z≤B(1)/g(B)≤z}P\{-z \le B(1)/g(B) \le z\}P{−z≤B(1)/g(B)≤z} equals a prescribed level, the interval Yˉn(1)±z g(Yˉn)\bar Y_n(1) \pm z\,g(\bar Y_n)Yˉn​(1)±zg(Yˉn​) has asymptotically exact coverage for μ\muμ. Each choice of g∈Mg \in \mathcal Mg∈M gives a method: batch means with a fixed number of batches, Schruben's standardized sum, the standardized maximum. The later sections of the paper compare the lengths of these intervals with those of consistent-estimation intervals, and those comparisons start from Theorem 2.4.

The theorem is classical and its proof is short on paper. What is missing is a machine-checked version. The formal proof needs a continuous mapping theorem for maps that are continuous only almost surely at the limit, on the non-locally-compact space C[0,1]C[0,1]C[0,1]; Mathlib has the version for continuous maps only. A formal Theorem 2.4 also makes the class M\mathcal MM and the C[0,1]-valued FCLT available for the other results of the paper, the expected-length lower bound and its non-attainment, which are formalized in sibling missions.

Difficulty

The algebra (milestones 3 and 4) is elementary. The difficulty is the continuous-mapping step. The map hhh is in general not continuous: it can be discontinuous wherever ggg is and wherever ggg vanishes, and ggg itself may be discontinuous on a large set (the standardized maximum is). The continuous mapping theorem for continuous maps does not apply. One needs its almost-sure form: if Xn⇒XX_n \Rightarrow XXn​⇒X and P{X∈D(h)}=0P\{X \in D(h)\} = 0P{X∈D(h)}=0, then h(Xn)⇒h(X)h(X_n) \Rightarrow h(X)h(Xn​)⇒h(X). The class M\mathcal MM controls D(g)D(g)D(g) only along the law of BBB, and the hypothesis of the almost-sure theorem is about D(h)D(h)D(h) at the scaled limit σB\sigma BσB, so the conditions (2.3iii) and (2.3iv) have to be transported from BBB to σB\sigma BσB and from ggg to hhh.

Formalization scope

C[0,1]C[0,1]C[0,1] is C(unitInterval, ℝ) with its sup-norm topology; the Borel MeasurableSpace instance is declared in the mission's definition file, since Mathlib has none at this commit. Weak convergence is Mathlib's TendstoInDistribution, for the C[0,1]C[0,1]C[0,1]-valued FCLT and for the real-valued conclusions. The standard Brownian motion is a measurable C[0,1]C[0,1]C[0,1]-valued map whose coordinates agree, for every ω\omegaω, with a process satisfying Mathlib's IsBrownianReal. D(g)D(g)D(g) is the set of points where ContinuousAt g fails, and P{B∈D(g)}P\{B \in D(g)\}P{B∈D(g)} is an outer measure, so no measurability of D(g)D(g)D(g) is assumed.

Yˉn\bar Y_nYˉn​ is a C[0,1]C[0,1]C[0,1]-valued parameter pinned pointwise by Yˉn(t)=1n∫0ntY(s) ds\bar Y_n(t) = \frac1n\int_0^{nt}Y(s)\,dsYˉn​(t)=n1​∫0nt​Y(s)ds, so it is determined by YYY. Assumption (2.1) carries joint measurability of YYY and local integrability of each path; the second is implicit in the paper and makes Yˉn\bar Y_nYˉn​ defined. The index nnn runs over N\mathbb NN, and milestone 4 assumes n≥1n \ge 1n≥1 because (2.3i) is applied with α=n1/2\alpha = n^{1/2}α=n1/2. Real division by zero returns 000 in Lean, which agrees with the paper's convention for hhh; it matters only on events of probability zero in the limit. Condition (2.3iii) is printed "P{g(b)>0}=1P\{g(b) > 0\} = 1P{g(b)>0}=1" and is read as P{g(B)>0}=1P\{g(B) > 0\} = 1P{g(B)>0}=1.

Condition (2.3iv) is stated with the discontinuity set, not as continuity of ggg: requiring ggg continuous everywhere would exclude the standardized maximum of Example 3.10 and would make the continuous-mapping step trivial. The goal assumes nothing about hhh, D(h)D(h)D(h) or any mapping theorem; these appear only in the milestones.

Contributions welcome: the almost-sure continuous mapping theorem for TendstoInDistribution on a metric space (reusable well beyond this mission), the cone property of D(g)D(g)D(g) under positive homogeneity, and evaluation at a point as a continuous map on C[0,1]C[0,1]C[0,1]. Mathlib does not yet construct a Brownian motion with continuous paths as a C[0,1]C[0,1]C[0,1]-valued random element, so the hypotheses cannot be instantiated inside Lean; this is a hypothesis on BBB, not a vacuity.

Selected references

  • P. W. Glynn and D. L. Iglehart, Simulation output analysis using standardized time series, Mathematics of Operations Research 15(1):1–16, 1990. https://doi.org/10.1287/moor.15.1.1
  • L. Schruben, Confidence interval estimation using standardized time series, Operations Research 31(6):1090–1108, 1983. https://doi.org/10.1287/opre.31.6.1090
  • P. Billingsley, Convergence of Probability Measures, Wiley, 1968 (Theorem 5.1, the continuous mapping theorem).
  • K. L. Chung, A Course in Probability Theory, 2nd ed., Academic Press, 1974 (p. 93, converging-together lemma).
6 thms1 active userReviewed
Operations ResearchProbabilityStatistics·Captain: mikedeng1

Residual Life Time at Great Age 1: Every Nondegenerate Limit Law of the Normed Residual Life Time Is of Type Π, Π_γ, Γ_α or Γ_{γ,α}Research Paper

Motivation

A component with a random lifetime XXX that has survived to age ttt still has a random residual life time X−tX - tX−t. Reliability engineering, actuarial science and the statistics of exceedances over high thresholds all ask how the conditional law of X−tX - tX−t given X>tX > tX>t behaves when the age ttt is large. If XXX is exponential, the residual life has the same law at every age (lack of memory). In general it changes with ttt, and the natural question, as in the limit theory of sample maxima, is which laws can arise as limits once the residual life is suitably rescaled and shifted.

A. A. Balkema and L. de Haan answered this question in Residual Life Time at Great Age (The Annals of Probability 2, 1974). The answer — a short list of limit types — later underlies the peaks-over-threshold method of extreme value statistics, where the continuous limit laws reappear as the generalized Pareto family (Pickands, 1975). This mission formalizes the classification theorem of the paper, Theorem 1, together with the steps of its proof in §1.

Setting

Let XXX be a real random variable with distribution function FFF and distribution tail R(x)=1−F(x)=P{X>x}R(x) = 1 - F(x) = P\{X > x\}R(x)=1−F(x)=P{X>x}. Throughout, R(x)>0R(x) > 0R(x)>0 for every xxx (equivalently F(x)<1F(x) < 1F(x)<1 for all xxx), so that the conditioning event {X>t}\{X > t\}{X>t} never has probability zero. The residual life distribution function at age ttt is

Ft(x)=P{X−t≤x∣X>t},(1)F_t(x) = P\{X - t \le x \mid X > t\}, \tag{1}Ft​(x)=P{X−t≤x∣X>t},(1)

which vanishes for x<0x < 0x<0.

A family of distribution functions HtH_tHt​ converges weakly to GGG as t→∞t \to \inftyt→∞ if Ht(x)→G(x)H_t(x) \to G(x)Ht​(x)→G(x) at every continuity point xxx of GGG. A distribution function GGG is nondegenerate if it is not the distribution function of a point mass. GGG is of type KKK if G(x)=K(ax+b)G(x) = K(ax + b)G(x)=K(ax+b) for all xxx, with a>0a > 0a>0 and bbb real.

The limit laws are the following distribution functions, all equal to 000 for x<0x < 0x<0; for x≥0x \ge 0x≥0,

Π(x)=1−e−x,Γα(x)=1−(1+x)−α,\Pi(x) = 1 - e^{-x}, \qquad \Gamma_\alpha(x) = 1 - (1+x)^{-\alpha},Π(x)=1−e−x,Γα​(x)=1−(1+x)−α, Πγ(x)=1−exp⁡(−γ [1+x]),Γγ,α(x)=1−exp⁡(−γ [1+αlog⁡(1+x)]),\Pi_\gamma(x) = 1 - \exp\big(-\gamma\,[1 + x]\big), \qquad \Gamma_{\gamma,\alpha}(x) = 1 - \exp\big(-\gamma\,[1 + \alpha\log(1+x)]\big),Πγ​(x)=1−exp(−γ[1+x]),Γγ,α​(x)=1−exp(−γ[1+αlog(1+x)]),

with α,γ>0\alpha, \gamma > 0α,γ>0 and [a][a][a] the integer part of aaa. The first two are continuous; the last two are discrete, with jumps where 1+x1 + x1+x, respectively 1+αlog⁡(1+x)1 + \alpha\log(1+x)1+αlog(1+x), crosses an integer.

The lemmas of §1 use a second normalization, which shifts XXX instead of X−tX - tX−t:

P(X−b(t)a(t)>x  ∣  X>t)=min⁡(1,R(b(t)+xa(t))R(t))→S(x)weakly,(2–3)P\Big(\frac{X - b(t)}{a(t)} > x \;\Big|\; X > t\Big) = \min\Big(1, \frac{R(b(t) + x a(t))}{R(t)}\Big) \to S(x) \quad \text{weakly}, \tag{2–3}P(a(t)X−b(t)​>x​X>t)=min(1,R(t)R(b(t)+xa(t))​)→S(x)weakly,(2–3)

where 1−S1 - S1−S is a nondegenerate distribution function. The two normalizations differ by b(t)↦b(t)+tb(t) \mapsto b(t) + tb(t)↦b(t)+t.

Formalization targets

Goal: Theorem 1 (p. 796)

If F(x)<1F(x) < 1F(x)<1 for all xxx, a(t)>0a(t) > 0a(t)>0, and

Ft(b(t)+xa(t))→G(x)weakly as t→∞F_t\big(b(t) + x a(t)\big) \to G(x) \quad \text{weakly as } t \to \inftyFt​(b(t)+xa(t))→G(x)weakly as t→∞

for a nondegenerate distribution function GGG, then GGG is of type Π\PiΠ, Πγ\Pi_\gammaΠγ​, Γα\Gamma_\alphaΓα​ or Γγ,α\Gamma_{\gamma,\alpha}Γγ,α​ for some α,γ>0\alpha, \gamma > 0α,γ>0.

Milestones (§1, pp. 794–797)

  1. Lemma 1. Under (2), for each continuity point yyy of SSS with 0<S(y)<10 < S(y) < 10<S(y)<1 there are A(y)≥1A(y) \ge 1A(y)≥1 and B(y)B(y)B(y) with
S(x) S(y)=S(B(y)+xA(y))whenever S(x)<1.(4)S(x)\,S(y) = S\big(B(y) + xA(y)\big) \quad \text{whenever } S(x) < 1. \tag{4}S(x)S(y)=S(B(y)+xA(y))whenever S(x)<1.(4)
  1. Corollary. S(x)>0S(x) > 0S(x)>0 for all xxx.
  2. Lemma 2. An unbounded non-increasing HHH on (x0,∞)(x_0, \infty)(x0​,∞) that agrees with SSS where S<1S < 1S<1 and solves H(x)H(y)=H(B(y)+xA(y))H(x)H(y) = H(B(y) + xA(y))H(x)H(y)=H(B(y)+xA(y)) agrees with SSS where H<1H < 1H<1.
  3. Case 1 of the proof: if A(y)=1A(y) = 1A(y)=1 for every yyy in the set YYY of continuity points with S(y)<1S(y) < 1S(y)<1, then 1−S1 - S1−S is of type Π\PiΠ or Πγ\Pi_\gammaΠγ​.
  4. The commutation identity of Case 2: B(y1)+A(y1)B(y2)=B(y2)+A(y2)B(y1)B(y_1) + A(y_1)B(y_2) = B(y_2) + A(y_2)B(y_1)B(y1​)+A(y1​)B(y2​)=B(y2​)+A(y2​)B(y1​) for y1,y2∈Yy_1, y_2 \in Yy1​,y2​∈Y.
  5. Case 2 of the proof: if A(y)>1A(y) > 1A(y)>1 for some y∈Yy \in Yy∈Y, then 1−S1 - S1−S is of type Γα\Gamma_\alphaΓα​ or Γγ,α\Gamma_{\gamma,\alpha}Γγ,α​.
  6. The closing display: each of the four laws G=1−SG = 1 - SG=1−S reproduces itself, min⁡(1,S(B(t)+xA(t))/S(t))=S(x)\min\big(1, S(B(t) + xA(t))/S(t)\big) = S(x)min(1,S(B(t)+xA(t))/S(t))=S(x) for every t>0t > 0t>0 and suitable A(t)>0A(t) > 0A(t)>0, B(t)B(t)B(t); so all four types occur as limits.

Significance

Theorem 1 is to residual lives what the extremal types theorem of Fisher–Tippett and Gnedenko is to maxima: it reduces the asymptotic analysis of the residual life to a four-type list, and with it the question of domains of attraction (§§2–3 of the paper) becomes well posed. The continuous types Π\PiΠ and Γα\Gamma_\alphaΓα​ are, after a change of parameters, the exponential and Pareto members of the generalized Pareto family used to model exceedances over high thresholds; the discrete types Πγ\Pi_\gammaΠγ​ and Γγ,α\Gamma_{\gamma,\alpha}Γγ,α​ show that once a shift is allowed, lattice-like tails produce limits with atoms, a phenomenon that the scale-only Theorem 2 excludes.

The theorem has been proved since 1974. It is not formalized in any proof assistant known to us, and Mathlib has neither weak convergence of distribution functions in the form used here, nor types, nor the residual-life limit laws. A formal development provides these objects, the functional equation (4) and its solution on a half line, and a checked proof that the four-type list is exactly right — including the discrete types, which are easy to lose in an informal treatment.

Difficulty

The obvious approach is to pass to the limit in the identity relating the residual lives at ages ttt and b(t)b(t)b(t), obtaining a Cauchy-type functional equation for SSS, and to solve it. Two features block a direct application of the classical solution. First, the limit is a minimum with 111, so convergence carries no information on the half line where S=1S = 1S=1: equation (4) holds only where S(x)<1S(x) < 1S(x)<1, and it does not determine SSS by itself (the paper exhibits S0(x)=e−xS_0(x) = e^{-x}S0​(x)=e−x for x≥1x \ge 1x≥1, S0=1S_0 = 1S0​=1 for x<1x < 1x<1, which satisfies (4) with A=1A = 1A=1, B(y)=yB(y) = yB(y)=y, yet 1−S01 - S_01−S0​ is of no limit type); Lemma 2 is needed to recover SSS where S=1S = 1S=1. Second, the solutions of the shifted equation φ(x)+φ(y)=φ(B(y)+x)\varphi(x) + \varphi(y) = \varphi(B(y) + x)φ(x)+φ(y)=φ(B(y)+x) for a monotone φ\varphiφ are not only linear: a periodic perturbation is possible, and its analysis produces the discrete laws through the integer part. A proof that assumes continuity of SSS misses Πγ\Pi_\gammaΠγ​ and Γγ,α\Gamma_{\gamma,\alpha}Γγ,α​.

Formalization scope

The law of XXX is a probability measure μ\muμ on R\mathbb RR; R(x)=μ((x,∞))R(x) = \mu((x,\infty))R(x)=μ((x,∞)) and Ft(x)=μ((t,t+x])/μ((t,∞))F_t(x) = \mu((t, t+x])/\mu((t,\infty))Ft​(x)=μ((t,t+x])/μ((t,∞)), with probabilities taken as real numbers. Every statement assumes μ((x,∞))>0\mu((x,\infty)) > 0μ((x,∞))>0 for all xxx, the paper's standing assumption; Lean's division by zero would otherwise make the conditional laws meaningless. The normalizations satisfy a(t)>0a(t) > 0a(t)>0 for all ttt (only large ttt matter). A limit distribution function is the distribution function of a probability measure ν\nuν on R\mathbb RR, so no mass escapes to ±∞\pm\infty±∞; nondegenerate means ν\nuν is not a point mass; the limit tail is S(x)=ν((x,∞))S(x) = \nu((x,\infty))S(x)=ν((x,∞)), which is right-continuous. Weak convergence is convergence at the continuity points of the limit and nowhere else. The integer part is Int.floor. Each limit law is defined to be 000 for x<0x < 0x<0.

Theorem 1 is stated in the normalization (1) of the theorem, the lemmas and cases in the normalization (2) of §1, as printed. Theorem 1 names its fourth family Γα,γ\Gamma_{\alpha,\gamma}Γα,γ​; it is the introduction's Γγ,α\Gamma_{\gamma,\alpha}Γγ,α​. In Lemma 2 the left endpoint x0x_0x0​ may be −∞-\infty−∞ (Case 1 applies the lemma on the whole line), and the condition that B(y)+xA(y)B(y) + xA(y)B(y)+xA(y) lies in (x0,∞)(x_0, \infty)(x0​,∞) for x>x0x > x_0x>x0​ is written out, since (8) presupposes it. "A pair (A(y),B(y))(A(y), B(y))(A(y),B(y)) in Lemma 1" and "A(y)=1A(y) = 1A(y)=1", "A(y)>1A(y) > 1A(y)>1" are stated through pairs satisfying (4); the proof of Lemma 1 shows the pair is unique. The commutation identity is posed without the Case 2 assumption, which its derivation does not use. No hypothesis of the paper is dropped and none is added beyond these readings.

The statement is not trivialized by dropping nondegeneracy (a point-mass limit is always attainable), by requiring convergence at every xxx (which would exclude the discrete types), or by defining the limit laws without the integer part (which would turn the discrete types into continuous ones); the formalization does none of these.

A complete development needs: the residual-life distribution function and the normed tail, weak convergence of distribution functions, types, the four limit laws; then monotone solutions of Cauchy-type functional equations on half lines, with their periodic perturbations. The functional-equation results and the closing-display computations are reusable beyond this mission, for instance for the scale-only Theorem 2 and for the domain-of-attraction results of §§2–3. Proofs of any milestone, of alternative routes to Theorem 1, and of the closing display for each family separately are welcome.

Selected references

  • A. A. Balkema, L. de Haan, Residual Life Time at Great Age, The Annals of Probability 2 (1974), no. 5, 792–804. https://doi.org/10.1214/aop/1176996548 (the source of every statement of this mission: the published article).
  • B. Gnedenko, Sur la distribution limite du terme maximum d'une série aléatoire, Annals of Mathematics 44 (1943), 423–453. https://doi.org/10.2307/1968974
  • J. Pickands III, Statistical Inference Using Extreme Order Statistics, The Annals of Statistics 3 (1975), 119–131. https://doi.org/10.1214/aos/1176343003
  • W. Feller, An Introduction to Probability Theory and Its Applications, Vol. II, Wiley, 1966.
10 thms2 active usersReviewed
🏆Completed
Linear OptimizationOperations ResearchOptimization·Captain: mikedeng1

On the Relation Between Integer and Noninteger Solutions to Linear Programs: Deep in the Optimal-Basis Cone, z₂(b) = z₁(b) + φ(b) and the Group Problem Gives an Integer OptimumResearch Paper

Motivation

An integer program is a linear program whose variables must take integer values. Its linear relaxation can be solved efficiently, while the integer program itself is NP-hard in general, so a recurring question in integer programming is how much the optimal solution of the relaxation says about the integer optimum. Simple rounding of the fractional optimum does not answer it: examples show that the integer optimum need not lie within distance one of the LP optimum, even when the right-hand side is large.

R. E. Gomory's 1965 note in the Proceedings of the National Academy of Sciences (doi:10.1073/pnas.53.2.260) showed that, for right-hand sides lying deep inside the cone of an optimal LP basis, the integer program is solved exactly by the LP solution plus a correction computed in a finite abelian group. The resulting group relaxation (the "corner polyhedron" of Gomory's later work, Gomory 1969) underlies a large body of work on cutting planes, the master group problem, Gomory–Johnson functions and asymptotic integer programming.

Timeline. Gomory's fractional cutting-plane algorithm (Gomory 1958) introduced the "fractional rows" of the simplex tableau; the 1965 note identifies the group they generate with M(I)/M(B)M(I)/M(B)M(I)/M(B) and proves the asymptotic theorem formalized here. Gomory 1969 develops the corner polyhedron; Gomory and Johnson (1972) study the continuous valid functions of the corner polyhedron.

Setting

Let AAA be an integer m×(m+n)m\times(m+n)m×(m+n) matrix of the form (A′,I)(A',I)(A′,I), let b∈Zmb\in\mathbb Z^mb∈Zm and c∈Rm+nc\in\mathbb R^{m+n}c∈Rm+n. Problem P1 is

max⁡ z1=cxs.t.Ax=b, x≥0,\max\ z_1=cx\quad\text{s.t.}\quad Ax=b,\ x\ge0,max z1​=cxs.t.Ax=b, x≥0,

and P2 is P1 with xxx integer. A basis is a nonsingular m×mm\times mm×m submatrix BBB of AAA; after rearranging, A=(B,N)A=(B,N)A=(B,N) with B=(α1,…,αm)B=(\alpha_1,\dots,\alpha_m)B=(α1​,…,αm​) and N=(αm+1,…,αm+n)N=(\alpha_{m+1},\dots,\alpha_{m+n})N=(αm+1​,…,αm+n​), and c=(cB,cN)c=(c_B,c_N)c=(cB​,cN​). The relative cost of a nonbasic column is ci∗=ci−cBB−1αic^*_i=c_i-c_BB^{-1}\alpha_ici∗​=ci​−cB​B−1αi​, and BBB is an optimal basis when all ci∗≤0c^*_i\le0ci∗​≤0. The cone of the basis is KB={β∈Rm:B−1β≥0}K^B=\{\beta\in\mathbb R^m: B^{-1}\beta\ge0\}KB={β∈Rm:B−1β≥0}; removing from it all points within Euclidean distance ddd of its boundary gives the reduced cone KB(d)K^B(d)KB(d).

Let M(I)=ZmM(I)=\mathbb Z^mM(I)=Zm and M(B)=LBM(B)=\mathfrak L_BM(B)=LB​ the lattice of integer combinations of α1,…,αm\alpha_1,\dots,\alpha_mα1​,…,αm​. The factor module M(I)/M(B)M(I)/M(B)M(I)/M(B) is a finite abelian group with D=∣det⁡B∣D=|\det B|D=∣detB∣ elements; write αˉi\bar\alpha_iαˉi​, bˉ\bar bbˉ for the classes of αi\alpha_iαi​, bbb. The group problem (4) is

max⁡ ∑i=1nci+m∗yis.t.∑i=1nαˉi+myi=bˉ,yi≥0 integer,\max\ \sum_{i=1}^n c^*_{i+m}y_i\quad\text{s.t.}\quad\sum_{i=1}^n\bar\alpha_{i+m}y_i=\bar b,\quad y_i\ge0\text{ integer},max i=1∑n​ci+m∗​yi​s.t.i=1∑n​αˉi+m​yi​=bˉ,yi​≥0 integer,

with optimal value φB(b)\varphi^B(b)φB(b). Finally l=max⁡i>m∥αi∥l=\max_{i>m}\|\alpha_i\|l=maxi>m​∥αi​∥.

Formalization targets

Goal: THEOREM 1 (p. 261)

If b∈KB(l(D−1))b\in K^B(l(D-1))b∈KB(l(D−1)), then P1, P2 and (4) attain their optima, the value z2(b)z_2(b)z2​(b) of P2 is

z2(b)=z1(b)+φB(b),z_2(b)=z_1(b)+\varphi^B(b),z2​(b)=z1​(b)+φB(b),

an optimal solution of P2 is

x(b)=(B−1(b−NyB(b)), yB(b))x(b)=\big(B^{-1}(b-Ny^B(b)),\ y^B(b)\big)x(b)=(B−1(b−NyB(b)), yB(b))

for an optimal solution yB(b)y^B(b)yB(b) of (4) with ∑iyiB(b)≤D−1\sum_iy^B_i(b)\le D-1∑i​yiB​(b)≤D−1, and φB\varphi^BφB, yBy^ByB are mmm-periodic: φB(b+αi)=φB(b)\varphi^B(b+\alpha_i)=\varphi^B(b)φB(b+αi​)=φB(b).

Milestones

In the order of the paper's proof: ∣M(I)/M(B)∣=D|M(I)/M(B)|=D∣M(I)/M(B)∣=D (p. 262); periodicity of (4) (p. 263); the cost identity (5)–(6); "cBB−1bc_BB^{-1}bcB​B−1b is z1(b)z_1(b)z1​(b)", the simplex optimality criterion (a published, proved theorem); the projection of a solution of P2 to a solution of (4); the bound (7), z2(b)≤z1(b)+φ(b)z_2(b)\le z_1(b)+\varphi(b)z2​(b)≤z1​(b)+φ(b); the extension of a solution of (4) to an integer solution; the LEMMA (an optimal solution of (4) with ∑yi≤D−1\sum y_i\le D-1∑yi​≤D−1); and the bound ∥Ny∥≤(D−1)l\|Ny\|\le(D-1)l∥Ny∥≤(D−1)l that places b−Nyb-Nyb−Ny in KBK^BKB.

Companions

THEOREM 2: the optimal x(b)x(b)x(b) satisfies ∑i>mxi=∑iyi≤D−1\sum_{i>m}x_i=\sum_iy_i\le D-1∑i>m​xi​=∑i​yi​≤D−1. THEOREM 4 (with the bound corrected, see below): if an optimal yyy of (4) has ∏i(yi+1)>D\prod_i(y_i+1)>D∏i​(yi​+1)>D, the optimum of (4) is not unique.

Significance

THEOREM 1 reduces integer programming, for right-hand sides far from the boundary of an optimal cone, to a shortest-path-type problem over a group of order DDD: the integer optimum is determined by the LP optimum and a periodic correction, and it can be computed in time polynomial in nnn and DDD (THEOREM 3, not formalized here). It explains why rounding fails while a structured correction succeeds, and it is the starting point of the corner-polyhedron and cutting-plane theory built on the group relaxation. THEOREM 2 bounds how far the integer optimum lies from a lattice point of LB\mathfrak L_BLB​, an early proximity result.

The results are classical and proved in the paper; none of them has a machine-checked proof that this mission is aware of. The mission produces a Lean statement and proof of the asymptotic theorem, together with reusable statements about the group Zm/BZm\mathbb Z^m/B\mathbb Z^mZm/BZm and the zero-sum shortening argument of the LEMMA.

Difficulty

The decomposition z2≤z1+φz_2\le z_1+\varphiz2​≤z1​+φ is a direct computation. The difficulty is the converse: an optimal solution yyy of the group problem extends to an integer point xB=B−1(b−Ny)x_B=B^{-1}(b-Ny)xB​=B−1(b−Ny), but nothing in (4) forces xB≥0x_B\ge0xB​≥0. Optimality of yyy alone does not bound yyy: an optimal solution may carry zero-cost cycles of arbitrary length, and then b−Nyb-Nyb−Ny can leave the cone KBK^BKB. The theorem therefore depends on choosing the right optimal solution of (4), one whose total size is bounded by the group order, and on relating that combinatorial bound to the Euclidean geometry of the cone.

Formalization scope

  • The basis is fixed: BBB is an integer m×mm\times mm×m matrix and NNN an integer m×nm\times nm×n matrix; column jjj of NNN (000-based) is the paper's αm+1+j\alpha_{m+1+j}αm+1+j​. The costs cBc_BcB​, cNc_NcN​ are real.
  • The standing assumptions of pp. 260–262 are hypotheses of the goal: det⁡B≠0\det B\neq0detB=0; every unit vector of Zm\mathbb Z^mZm is a column of BBB or of NNN (the paper's A=(A′,I)A=(A',I)A=(A′,I), without which P2 can be infeasible); all relative costs ci∗≤0c^*_i\le0ci∗​≤0 (BBB is optimal, without which (4) is unbounded).
  • P2's variables are natural numbers (integer and nonnegative). The group problem is written as "b−Ny∈BZmb-Ny\in B\mathbb Z^mb−Ny∈BZm", which is equivalent to ∑αˉi+myi=bˉ\sum\bar\alpha_{i+m}y_i=\bar b∑αˉi+m​yi​=bˉ.
  • Optimal values are greatest elements of the sets of objective values, never suprema; the goal asserts that they are attained.
  • The norm in lll and in KB(d)K^B(d)KB(d) is Euclidean. KB(d)K^B(d)KB(d) is the set of points whose closed ball of radius ddd lies in KBK^BKB. l=0l=0l=0 when n=0n=0n=0.
  • In part (3) of the goal, yB(b)y^B(b)yB(b) ranges over optimal solutions of (4) with ∑iyi≤D−1\sum_iy_i\le D-1∑i​yi​≤D−1, the solutions the paper's LEMMA and dynamic program produce.
  • THEOREM 4 is stated with the hypothesis ∏(yi+1)>D\prod(y_i+1)>D∏(yi​+1)>D: the printed >D−1>D-1>D−1 is false (m=n=1m=n=1m=n=1, B=(2)B=(2)B=(2), N=(1)N=(1)N=(1), c=(2,0)c=(2,0)c=(2,0), b=1b=1b=1 has the unique optimum y=1y=1y=1 with ∏(yi+1)=2\prod(y_i+1)=2∏(yi​+1)=2).
  • A trivializing formalization is ruled out: the goal assumes none of the LEMMA, the inequality (7), integrality of B−1(b−Ny)B^{-1}(b-Ny)B−1(b−Ny) or the norm bound, and it states the existence of the optima instead of assuming them.
  • Not in scope: the operation counts of THEOREM 3 and the recursion (8), which need a machine model the paper does not define.

Needed infrastructure: the cardinality of Zm/BZm\mathbb Z^m/B\mathbb Z^mZm/BZm (available in Mathlib through determinants of basis changes), a zero-sum/pigeonhole argument in a finite abelian group, the simplex optimality criterion (published), and elementary Euclidean estimates. The group-theoretic lemmas are reusable for other group-relaxation and proximity missions. Proofs of the milestones, alternative arguments and the extension to the open-ball reading of KB(d)K^B(d)KB(d) are welcome.

Selected references

  • R. E. Gomory, On the relation between integer and noninteger solutions to linear programs, Proc. Natl. Acad. Sci. USA 53(2):260–265, 1965. https://doi.org/10.1073/pnas.53.2.260
  • R. E. Gomory, Outline of an algorithm for integer solutions to linear programs, Bull. Amer. Math. Soc. 64:275–278, 1958. https://doi.org/10.1090/S0002-9904-1958-10224-4
  • R. E. Gomory, Some polyhedra related to combinatorial problems, Linear Algebra Appl. 2:451–558, 1969. https://doi.org/10.1016/0024-3795(69)90017-2
  • R. E. Gomory and E. L. Johnson, Some continuous functions related to corner polyhedra, Math. Programming 3:23–85, 1972.
  • J. Matoušek and B. Gärtner, Understanding and Using Linear Programming, Springer, 2007 (simplex optimality criterion). https://doi.org/10.1007/978-3-540-30717-4
11 thms3 active usersReviewed
CombinatoricsLinear OptimizationOperations Research+1·Captain: mikedeng1

An Additive Algorithm for Solving Linear Programs with Zero-One Variables: In Finitely Many Iterations the Additive Algorithm Yields an Optimal Solution or Proves InfeasibilityResearch Paper

Motivation

Binary decisions arise when a variable records whether a project is selected, a facility is opened, or an action is taken. Linear constraints then describe the resources or conditions those choices must satisfy. Egon Balas's 1965 paper gives a direct algorithm for a finite linear program with zero-one variables: it begins with all variables at zero, adds variables with value one, and uses explicit tests to discard assignments that cannot improve the best feasible assignment found so far. The paper states that the procedure eventually produces an optimal feasible solution or a conclusion that none exists. Its numbered convergence theorem is the target of this mission. Balas (1965)

The result is historically distinct from algorithms that solve a continuous relaxation and then enforce integrality. Balas describes his method as a direct combinatorial search over binary assignments, with additions and subtractions used to update costs and slacks. The theorem concerns the correctness and finite termination of the particular steps printed in the paper, including their backward scan and cancellation rules. The local catalog contains work on branch and bound for a biconvex program, but no existing platform item about a zero-one programming algorithm with these steps; the biconvex result concerns a different model and algorithm. Balas (1965)

Setting

Let NNN be a finite set of binary coordinates and MMM a finite set of constraints. The data are a real matrix A=(aij)i∈M,j∈NA=(a_{ij})_{i\in M,j\in N}A=(aij​)i∈M,j∈N​, a real vector b=(bi)i∈Mb=(b_i)_{i\in M}b=(bi​)i∈M​, and nonnegative objective coefficients cj≥0c_j\ge0cj​≥0. A binary assignment is represented by the set J⊆NJ\subseteq NJ⊆N of coordinates assigned one; all other coordinates are zero. Its slack and cost are

yi(J)=bi−∑j∈Jaij,z(J)=∑j∈Jcj.y_i(J)=b_i-\sum_{j\in J}a_{ij},\qquad z(J)=\sum_{j\in J}c_j.yi​(J)=bi​−j∈J∑​aij​,z(J)=j∈J∑​cj​.

The assignment is feasible when yi(J)≥0y_i(J)\ge0yi​(J)≥0 for every i∈Mi\in Mi∈M. It is optimal when it is feasible and has no greater cost than any other feasible assignment. These are Balas's problem PPP and solutions (1)–(8). The coefficients of AAA and bbb may have either sign; NNN and MMM may be empty. Balas (1965), pp. 519, 523

The algorithm generates assignments J0,J1,…,JsJ_0,J_1,\ldots,J_sJ0​,J1​,…,Js​, starting at J0=∅J_0=\varnothingJ0​=∅. Among the generated feasible assignments, their least cost is the ceiling z∗(s)z^{*(s)}z∗(s); if there are none, z∗(s)=+∞z^{*(s)}=+\inftyz∗(s)=+∞. Each generated assignment has an improving set NpN_pNp​ formed when it first appears. Later steps cancel candidate indices and keep records CksC_k^sCks​ of which values attached to an earlier assignment have been cancelled by the time JsJ_sJs​ is generated. The algorithm either processes the latest assignment, scans earlier strict subsets in descending order, or stops. Its value-based choice rule permits several choices when both value and cost tie. Balas (1965), pp. 523–528

Formalization targets

The paper's two lemmas and Theorem 1 establish the cancellation claims used by its convergence theorem. Lemma 1 says a feasible completion Jt⊃JsJ_t\supset J_sJt​⊃Js​ below the current ceiling adds no index in CsC^sCs; Lemma 2 makes the corresponding assertion for an earlier assignment under its stated complete-cancellation hypothesis. Theorem 1 says that an abandoned assignment has no better feasible completion. The two numbered parts of the convergence proof assert that a single iteration cannot continue indefinitely and that no assignment is generated twice. A remark after (16) records that a feasible generated assignment has an empty improving set. Balas (1965), pp. 529–533

The mission's goal is Convergence Theorem 2:

every run from J0=∅ stops after finitely many steps, with either an optimal feasible assignment or a valid infeasibility verdict.\text{every run from }J_0=\varnothing\text{ stops after finitely many steps, with either an optimal feasible assignment or a valid infeasibility verdict.}every run from J0​=∅ stops after finitely many steps, with either an optimal feasible assignment or a valid infeasibility verdict.

The finite-step assertion includes progress: every reachable state before a stopping situation has a successor. At a stop, z∗(s)=+∞z^{*(s)}=+\inftyz∗(s)=+∞ means no feasible binary assignment exists; if the ceiling is finite, a generated assignment attaining it exists and every generated assignment at that cost is optimal for PPP. These clauses make the paper's two possible outcomes explicit. Balas (1965), Convergence Theorem 2 and step 5a

Significance

The theorem certifies the algorithm as a complete decision and optimization procedure for the stated finite binary program. The infeasibility outcome concerns every possible binary assignment, not only the assignments the algorithm happened to visit. The optimality outcome similarly compares the reported assignment against all feasible assignments. Without these global claims, reaching a stopping situation would only show that the current search path has no remaining candidates. Balas (1965), pp. 526, 533

The result was proved in the 1965 paper. The work here is to state its algorithm and correctness claims in Lean and provide a target for a machine-checked proof; the submitted theorem files are open statements. The finite binary-program model, cost and slack functions, ceiling with infinity, and state-transition vocabulary can also support formal analyses of other exact enumeration procedures. The particular cancellation and backward-scan rules belong to Balas's algorithm. Balas (1965)

Difficulty

It is immediate that there are finitely many binary assignments. That alone does not show finite termination: the paper's step 5 may revisit earlier generated assignments, and the rules must prevent repeated work within one iteration as well as repeated generated assignments across iterations. It also does not justify pruning. When an improving set becomes empty, the remaining challenge is to show that no feasible assignment omitted by the search improves the ceiling. These are the separate claims recorded in parts (a) and (b), Lemmas 1–2, and Theorem 1. Balas (1965), pp. 529–533

Formalization scope

Lean uses Fin n and Fin m for the paper's one-based index sets. A binary assignment is a Finset (Fin n). A general finite zero-one linear program is its own definition; problem PPP adds the paper's standing assumption cj≥0c_j\ge0cj​≥0. There is no positive-size assumption on either index set. The algorithm stores generated assignments, each improving set as formed, cancellation snapshots, current cancellations, and its program point. Slack and cost are recomputed from the assignment by (6) and (21). Reachability is the reflexive transitive closure of the printed steps, and all milestone claims about states are restricted to reachable ones. The strict symbol ⊂\subset⊂ means proper inclusion as the paper's footnote specifies. Balas (1965), pp. 523–525

The ceiling is represented in WithTop ℝ, with ⊤\top⊤ for +∞+\infty+∞. The cost tests (14), (17), (24), and (29) are written additively so they retain the paper's meaning when no feasible assignment has yet been generated. The improving set NpN_pNp​ remains fixed after generation; the step-5 scan uses Nks=Nk−(Cks∪Dks)N_k^s=N_k-(C_k^s\cup D_k^s)Nks​=Nk​−(Cks​∪Dks​) with the stored snapshot CksC_k^sCks​, as in (18). Step 1a cancels the cost-bound indices for every earlier assignment, and steps 6a and 7b resume the scan below the index just checked. The final tie break permits any index still tied after minimizing its cost. “In a finite number of iterations” is encoded as no infinite run plus a next step at each reachable non-stopped state. “No feasible solution” quantifies over all binary assignments. “Abandoned” is the predicate specified before Theorem 1: uku^kuk is abandoned when the algorithm is instructed to stop, or to check some NpsN_p^sNps​ with p<k≤sp<k\le sp<k≤s, including the indices step 5 passes over because their remaining improving set is empty. Lemma 2 reads Cps+1C_p^{s+1}Cps+1​ either as the cancellations accumulated so far during iteration s+1s+1s+1 or as the cancellation records at the transition that obtains us+1u^{s+1}us+1. Balas (1965), pp. 525–533

The paper prints z∗(k)z^{*(k)}z∗(k) in Theorem 1, but its algorithm and proof use the ceiling at the abandonment iteration, z∗(s)z^{*(s)}z∗(s); the Lean theorem states that corrected version and retains the original wording in the milestone record. A transition system that is stuck before a declared stopping situation, a ceiling encoded as a finite real sentinel, or a verdict quantified only over generated assignments would make the goal weaker than the paper's claim. Contributions toward the milestone proofs, state invariants, and reusable finite-search lemmas are in scope. The preliminary reduction of a general binary program to PPP, the efficiency remarks, numerical examples, and the modified algorithm of Remark II are outside this mission. Balas (1965), pp. 519, 528–533

Selected references

  • Egon Balas, An Additive Algorithm for Solving Linear Programs with Zero-One Variables, Operations Research 13(4), 517–546, 1965. DOI: 10.1287/opre.13.4.517
10 thms2 active usersReviewed
PreviousNext

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me