Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in
← Collections

The OR Formalization Drive

Help us formalize the operations research literature in Lean.

1094 missions

Missions

1021–1040 of 1094
OpenCompletedAll
🏆Completed
Operations ResearchOptimizationProbability·Captain: mikedeng1

Scheduling Deteriorating Jobs on a Single Processor II: If E(X_j)/α_j and α_j/[c_j(1+α_j)] Both Increase in j, the Order 1, …, N Minimizes the Weighted Expected Completion Time (Proposition 2)Research Paper

Why deteriorating jobs need a scheduling rule

On one processor, the completion time of a job normally depends on how much work precedes it. In the model of Browne and Yechiali (1990), waiting also changes the job's own processing requirement: a job that starts later takes longer. The sequence therefore changes both when each job starts and how long subsequent jobs must wait. This matters when the goal is a weighted completion cost, because a delay to one job can raise the completion costs of many others.

The paper gives an expected-makespan ordering for this linear deterioration model and, in Proposition 2, a sufficient condition under which the original job order minimizes weighted expected completion cost. The latter is the target of this mission. Related platform work on Delayed SWPT and the AvgCompletionSched family treats weighted completion scheduling without this job-specific linear deterioration. Their additive processing-time models do not supply the completion-time object used here.

Jobs, schedules, and cost

There are NNN jobs, all available at time zero, processed one at a time on a single machine without idle time or preemption. A schedule π\piπ is a permutation of the jobs: π(k)\pi(k)π(k) is the job processed in position kkk. The paper labels positions and jobs from 111 to NNN; the Lean development labels them from 000 to N−1N-1N−1. The identity schedule π0\pi_0π0​ processes jobs in label order.

For job iii, XiX_iXi​ is its random initial processing requirement, αi\alpha_iαi​ its deterministic growth rate, and cic_ici​ its waiting cost rate. If the job starts at time ttt, its actual processing time is Yi(t)=Xi+αitY_i(t)=X_i+\alpha_i tYi​(t)=Xi​+αi​t. Deterioration stops once processing starts. Write Sk(π)S_k(\pi)Sk​(π) for the time at which the first kkk scheduled jobs have all finished. The model sets S0(π)=0S_0(\pi)=0S0​(π)=0 and

Sk+1(π)=Sk(π)+Xπ(k+1)+απ(k+1)Sk(π)S_{k+1}(\pi)=S_k(\pi)+X_{\pi(k+1)}+\alpha_{\pi(k+1)}S_k(\pi)Sk+1​(π)=Sk​(π)+Xπ(k+1)​+απ(k+1)​Sk​(π)

in the paper's one-based position notation. Thus the completion time of the job in position kkk is Sk(π)S_k(\pi)Sk​(π). Its cost is its own rate cπ(k)c_{\pi(k)}cπ(k)​ times that completion time, giving

C(π)=∑k=1Ncπ(k)Sk(π).C(\pi)=\sum_{k=1}^{N}c_{\pi(k)}S_k(\pi).C(π)=k=1∑N​cπ(k)​Sk​(π).

All of these are random quantities until an expectation is taken. Equation (2) of the paper writes SkS_kSk​ as a sum of the initial requirements multiplied by the later growth factors. Equation (8) substitutes that expression into C(π0)C(\pi_0)C(π0​). Both equations are included as milestones, stated along an arbitrary schedule by relabelling the jobs. The third milestone is the exact change in CCC from swapping two adjacent jobs. These three statements are pathwise identities, so their mathematical content does not depend on a probability distribution.

Formalization targets

The principal target is Proposition 2: if both sequences of job-indexed ratios are strictly increasing,

E(X1)α1<⋯<E(XN)αN,α1c1(1+α1)<⋯<αNcN(1+αN),\frac{E(X_1)}{\alpha_1}<\cdots<\frac{E(X_N)}{\alpha_N}, \qquad \frac{\alpha_1}{c_1(1+\alpha_1)} <\cdots< \frac{\alpha_N}{c_N(1+\alpha_N)},α1​E(X1​)​<⋯<αN​E(XN​)​,c1​(1+α1​)α1​​<⋯<cN​(1+αN​)αN​​,

then, for every permutation σ\sigmaσ,

E[C(π0)]≤E[C(σ)].E[C(\pi_0)]\le E[C(\sigma)].E[C(π0​)]≤E[C(σ)].

The first ratio compares an initial expected requirement with its growth rate. The second couples growth and the cost rate. The conclusion is global optimality over the paper's whole class of nonpreemptive, non-idling permutations. It does not assert that the identity order is the unique minimizer; strict input ratios do not by themselves justify a uniqueness claim.

The attack path records exactly the supporting statements printed in the paper: the closed completion-time formula (2), the weighted cost formula (8), and the unnumbered adjacent-interchange identity after (8). The milestone quotations preserve the paper's printed display, while the Lean statements use an arbitrary permutation where relabelling permits it. The interchange display has a multiplication dot before its second bracket; expansion for two jobs shows that the term is added. The formal statement records that correction, and the source quotation retains the printed symbol.

What the result establishes

The proposition identifies a directly checkable pair of ordering conditions under which the natural job-label order solves a weighted stochastic scheduling problem. A condition involving only E(Xi)/αiE(X_i)/\alpha_iE(Xi​)/αi​, enough for the paper's expected-makespan target, does not determine this weighted objective. The cost rates introduce another ordering requirement. The result gives a sufficient rule, not a characterization of every optimal schedule or of every parameter choice.

The mathematical result was published in 1990; this mission asks for its machine-checked formalization. A complete development will connect the processing-time recursion, the pathwise cost identities, and the expected optimality statement in Lean. The recursion and cost definitions can be reused for other finite single-machine problems in which a job's processing time depends on its start time. The milestone identities are also useful independently of the final sufficient condition, including for studying other choices of weights and ordering indices.

Where the argument is difficult

Sorting by expected initial requirement alone cannot settle the problem, because processing a job changes later start times and hence later processing times. Even sorting by the expected-makespan index leaves the cost rates unaccounted for. The value of an adjacent swap depends on the elapsed time before the pair and on the completion costs of jobs after the pair. It is not enough to compare the two jobs' own completion costs in isolation.

The source states the sufficient condition after its interchange display but does not present a full proof of the global claim. Closing the Lean goal requires connecting local comparisons to every schedule and handling the expected value of the recursively defined cost. The identities are finite, but their indices change between zero-based Lean positions and the paper's one-based display, especially at the first position and at an empty suffix.

Formalization scope

Jobs are Fin N\mathrm{Fin}\,NFinN, and a policy is an equivalence permutation with π(k)\pi(k)π(k) equal to the job in position kkk. Completion time is defined by the processing rule Yi(t)=Xi+αitY_i(t)=X_i+\alpha_i tYi​(t)=Xi​+αi​t, not by the closed form (2). At positions beyond the NNN jobs it stays constant, and theorems about the closed form restrict kkk to 0≤k≤N0\le k\le N0≤k≤N. The total cost is defined from job-weighted completion times, not from equation (8). This keeps both identities substantive.

The proposition uses a probability space and the Bochner integral of the real-valued cost. Every XiX_iXi​ is integrable, so its expectation and the finite linear combinations appearing in the cost are meaningful. Initial requirements are nonnegative at every outcome, reflecting the paper's standing positive-processing convention; strict positivity is unnecessary for the claim. Growth rates and cost rates are strictly positive. Those two assumptions make the printed ratios well-defined and support the ordering rule. The paper's common independence convention is not required for these expectations and is not assumed.

The two strict orderings are over the labels of jobs in π0\pi_0π0​, not positions of an arbitrary schedule. The conclusion compares π0\pi_0π0​ with every permutation, not only with schedules obtained by one adjacent swap. The N=0N=0N=0 and N=1N=1N=1 cases are allowed: the order conditions have no pair to compare, and there is only one permutation. Solvers may contribute the finite-sum, interchange, and integrability facts needed to link the milestones to Proposition 2. The pathwise identities require no probability assumptions and can support later variants.

Selected references

  • Browne, Sid, and Uri Yechiali, Scheduling Deteriorating Jobs on a Single Processor, Operations Research 38(3), 495–498 (1990). DOI: 10.1287/opre.38.3.495.
6 thms2 active usersReviewed
Linear OptimizationOperations ResearchProbability·Captain: mikedeng1

A Re-solving Heuristic with Uniformly Bounded Loss for Network Revenue Management 2: Frequent Re-solving Loses at Most O(√T) Against the Deterministic LP, Uniformly in the CapacitiesResearch Paper

Motivation

Network revenue management is the problem of selling several limited, perishable resources (seats on flight legs, hotel room-nights, machine hours) to customers who arrive over time and each want a fixed bundle of them. A seller who accepts every request early may run out of the resources that the most valuable later customers need, and a seller who is too cautious leaves capacity unsold at the end of the horizon. Airlines, hotels and car-rental firms solve instances of this problem daily (Talluri and van Ryzin, 2004).

The exact optimal policy is a dynamic program over the vector of remaining capacities, which is intractable for realistic networks. The standard remedy replaces the random demand by its mean, which gives a linear program, the deterministic LP (DLP), and turns its solution into an admission rule. Its value is an upper bound on what any policy can earn (Gallego and van Ryzin, 1997). Solving the LP once, at time zero, loses O(T)O(\sqrt{T})O(T​) against that bound over a horizon of length TTT. A natural improvement is to re-solve the LP as capacity is consumed.

Timeline of the re-solving question, as the source surveys it (Sec. 1, pp. 3–4):

  • 1997: Gallego and van Ryzin: static policies built from the DLP lose Θ(T)\Theta(\sqrt{T})Θ(T​).
  • 2002: Cooper gives an example in which re-solving the DLP makes booking-limit control worse.
  • 2008: Reiman and Wang re-solve exactly once, at an endogenous random time, with probabilistic allocation, and obtain o(T)o(\sqrt{T})o(T​) loss.
  • 2012: Jasin and Kumar prove that re-solving after every unit of time with probabilistic allocation (the policy FR below) loses O(1)O(1)O(1), provided the DLP solution is nondegenerate. Wu et al. (2015) obtain O(1)O(1)O(1) for one resource, with a constant that blows up as the solution approaches degeneracy.
  • 2018: Bumpensanti and Wang (arXiv:1802.06192) show that FR can lose Ω(T)\Omega(\sqrt{T})Ω(T​) against the hindsight optimum on a degenerate instance, propose a modified policy with O(1)O(1)O(1) loss in all cases, and prove that FR never loses more than O(T)O(\sqrt{T})O(T​) against the DLP. This mission formalizes the last of these results.

Setting

There are nnn customer classes j∈[n]j \in [n]j∈[n] and mmm resources l∈[m]l \in [m]l∈[m]. Over the horizon [0,T][0, T][0,T], class-jjj customers arrive according to independent Poisson processes with rates λj>0\lambda_j > 0λj​>0. Accepting a class-jjj customer earns rj≥0r_j \ge 0rj​≥0 and consumes alj≥0a_{lj} \ge 0alj​≥0 units of each resource lll; A=(alj)A = (a_{lj})A=(alj​) is the bill-of-materials matrix and AjA_jAj​ its jjj-th column. The initial capacity vector is C≥0C \ge 0C≥0. A customer can be accepted only if Aj≤C′A_j \le C'Aj​≤C′ componentwise, where C′C'C′ is the capacity remaining at its arrival.

For a capacity-per-unit-time vector b≥0b \ge 0b≥0, let

v(b)=max⁡{∑j=1nrjxj : ∑j=1nAjxj≤b, 0≤xj≤λj}.v(b) = \max\Big\{ \sum_{j=1}^n r_j x_j \ :\ \sum_{j=1}^n A_j x_j \le b,\ 0 \le x_j \le \lambda_j \Big\}.v(b)=max{j=1∑n​rj​xj​ : j=1∑n​Aj​xj​≤b, 0≤xj​≤λj​}.

The DLP value is vDLP(T,C)=T v(C/T)v^{\mathrm{DLP}}(T, C) = T\, v(C/T)vDLP(T,C)=Tv(C/T).

The Frequent Re-solving policy (FR) divides the horizon into TTT unit periods [t,t+1)[t, t+1)[t,t+1). At the start of period ttt, with remaining capacity C(t)C(t)C(t), it sets b(t)=C(t)/(T−t)b(t) = C(t)/(T - t)b(t)=C(t)/(T−t), computes an optimal solution x(t)x(t)x(t) of the LP with right-hand side b(t)b(t)b(t), and during the period accepts each class-jjj arrival with probability xj(t)/λjx_j(t)/\lambda_jxj​(t)/λj​, subject to the capacity check. Its expected revenue is vFR(T,C)v^{\mathrm{FR}}(T, C)vFR(T,C). The LP may have several optimal solutions; the results hold for every rule choosing among them.

Formalization targets

Goal: Proposition 3

There is a constant MMM, depending only on λ\lambdaλ, rrr and AAA, such that for every integer T≥1T \ge 1T≥1, every capacity C≥0C \ge 0C≥0 and every choice of optimal LP solutions,

vDLP(T,C)−vFR(T,C)≤MT.v^{\mathrm{DLP}}(T, C) - v^{\mathrm{FR}}(T, C) \le M \sqrt{T}.vDLP(T,C)−vFR(T,C)≤MT​.

The content is the uniformity: MMM does not depend on CCC, so the bound holds whether capacity is scarce, abundant, or degenerate for the LP.

Milestones, in the order the proof uses them

  1. Eq. (32), p. 35. The capacity check costs FR at most ∑jrj(log⁡T+1)+∑jrjλj\sum_j r_j(\log T + 1) + \sum_j r_j \lambda_j∑j​rj​(logT+1)+∑j​rj​λj​ relative to the LP revenue it targets:
vFR≥E[∑t=0T−1∑j=1nrjxj(t)]−∑j=1nrj(log⁡T+1)−∑j=1nrjλj.v^{\mathrm{FR}} \ge \mathbb{E}\Big[\sum_{t=0}^{T-1} \sum_{j=1}^n r_j x_j(t)\Big] - \sum_{j=1}^n r_j (\log T + 1) - \sum_{j=1}^n r_j \lambda_j .vFR≥E[t=0∑T−1​j=1∑n​rj​xj​(t)]−j=1∑n​rj​(logT+1)−j=1∑n​rj​λj​.
  1. Eq. (33), p. 35. LP sensitivity in the right-hand side: v(b)−v(b′)≤∑lrmax⁡l(bl−bl′)+v(b) - v(b') \le \sum_l r^l_{\max} (b_l - b'_l)^+v(b)−v(b′)≤∑l​rmaxl​(bl​−bl′​)+ with rmax⁡l=max⁡jrjI(alj>0)/aljr^l_{\max} = \max_j r_j \mathbb{I}(a_{lj} > 0)/a_{lj}rmaxl​=maxj​rj​I(alj​>0)/alj​.
  2. Lemma 8, p. 43 (corrected). E[(bl−bl(t))+]≤Kl∑i=0t−1(T−i−1)−2\mathbb{E}[(b_l - b_l(t))^+] \le K_l \sqrt{\sum_{i=0}^{t-1} (T-i-1)^{-2}}E[(bl​−bl​(t))+]≤Kl​∑i=0t−1​(T−i−1)−2​ with Kl=∑jalj2λjK_l = \sqrt{\sum_j a_{lj}^2 \lambda_j}Kl​=∑j​alj2​λj​​.
  3. p. 36. ∑t=0T−1∑i=0t−1(T−i−1)−2≤2T+2\sum_{t=0}^{T-1} \sqrt{\sum_{i=0}^{t-1} (T-i-1)^{-2}} \le 2\sqrt{T} + \sqrt{2}∑t=0T−1​∑i=0t−1​(T−i−1)−2​≤2T​+2​.
  4. p. 36, explicit bound.
vDLP−vFR≤∑l=1mrmax⁡lKl(2T+2)+n rmax⁡(log⁡T+1)+n rmax⁡λmax⁡.v^{\mathrm{DLP}} - v^{\mathrm{FR}} \le \sum_{l=1}^m r^l_{\max} K_l (2\sqrt{T} + \sqrt{2}) + n\, r_{\max} (\log T + 1) + n\, r_{\max} \lambda_{\max} .vDLP−vFR≤l=1∑m​rmaxl​Kl​(2T​+2​)+nrmax​(logT+1)+nrmax​λmax​.

Significance

The result. Because vDLPv^{\mathrm{DLP}}vDLP bounds the expected revenue of every admissible policy, Proposition 3 says that FR loses at most O(T)O(\sqrt{T})O(T​) against the optimal policy in every instance, degenerate or not. Re-solving therefore never does worse, in order, than solving once. Together with the Ω(T)\Omega(\sqrt{T})Ω(T​) lower bound on a degenerate instance (Proposition 2 of the same paper), it shows that the order T\sqrt{T}T​ is exact for FR. The nondegeneracy assumption of the earlier O(1)O(1)O(1) analysis cannot be dropped. The explicit form (milestone 5) bounds the loss by constants computable from (λ,r,A)(\lambda, r, A)(λ,r,A).

Formalizing it. The result is proved in the source; no part of it is machine-checked. A formalization adds three things. It gives a precise model of an adaptive, randomized admission policy in a Poisson network, which other results on re-solving and bid-price policies can reuse. It gives a checked LP sensitivity bound. And it checks the paper's constants: the printed constant of Lemma 8 is wrong (see Formalization scope), and the mission states the corrected one.

Difficulty

The obvious argument compares FR with the DLP period by period: the LP that FR solves at time ttt differs from the original only in its right-hand side, so the loss should be controlled by how far b(t)b(t)b(t) drifts below b=C/Tb = C/Tb=C/T. Two things break a naive version of this. First, b(t)b(t)b(t) is a ratio whose denominator T−tT - tT−t shrinks to 111, so fluctuations late in the horizon are amplified; a crude bound on the drift at each ttt sums to more than T\sqrt{T}T​. Second, FR's realized consumption is not the LP's target: the capacity check rejects customers, and the LP solutions x(i)x(i)x(i) depend on the whole past, so the consumption in different periods is not independent.

Uniformity in CCC is the whole point. Arguments that rely on a margin between C/TC/TC/T and the degenerate points of the LP, as in the nondegenerate analysis, give constants that blow up as that margin vanishes.

Formalization scope

The source is arXiv:1802.06192v3, whose printed page numbers equal the PDF page numbers. Everything lives in the namespace ResolvingNRM.FRUpper.

  • LP value. v(b)v(b)v(b) is the published piValue A r b lam of RLPBidPrice.Unbiased.Model (a real supremum, equal to the LP maximum for b≥0b \ge 0b≥0).
  • Optimal solutions. The "arg⁡max⁡\arg\maxargmax" of Algorithm 2 is an arbitrary optimal-solution selector sel; every theorem quantifies over all selectors, with constants chosen before the selector.
  • Randomness. Within a period the acceptance probabilities are fixed, so the period's arrivals are represented exactly as a Poisson number of customers in arrival order, with i.i.d. classes of law λj/∑iλi\lambda_j / \sum_i \lambda_iλj​/∑i​λi​ and independent Bernoulli acceptance coins. Expectations are series over this law (windowExp). FR's value is a backward recursion over periods (frTail), and expectations of functions of C(t)C(t)C(t) are a forward recursion (frStateExp).
  • Horizon. TTT is a positive integer; capacities are real vectors.
  • Standing assumptions of p. 7, left implicit there and hypotheses here: λj>0\lambda_j > 0λj​>0, rj≥0r_j \ge 0rj​≥0, alj≥0a_{lj} \ge 0alj​≥0, C≥0C \ge 0C≥0.
  • O(⋅)O(\cdot)O(⋅). "=O(T)= O(\sqrt{T})=O(T​)" is ∃M, ∀ sel,T≥1,C≥0\exists M,\ \forall\, \mathrm{sel}, T \ge 1, C \ge 0∃M, ∀sel,T≥1,C≥0. The paper's threshold T1T_1T1​ is dropped, which is equivalent because 0≤vFR0 \le v^{\mathrm{FR}}0≤vFR and vDLP≤T∑jrjλjv^{\mathrm{DLP}} \le T\sum_j r_j\lambda_jvDLP≤T∑j​rj​λj​.
  • Corrected slip, Lemma 8. The printed Kl=∑jalj2λj2K_l = \sqrt{\sum_j a_{lj}^2 \lambda_j^2}Kl​=∑j​alj2​λj2​​ is false: the proof replaces the conditional variance xj(i)≤λjx_j(i) \le \lambda_jxj​(i)≤λj​ of a Poisson increment by λj2\lambda_j^2λj2​. With one class, one resource, a=1a = 1a=1, λ=0.01\lambda = 0.01λ=0.01, C=λTC = \lambda TC=λT, T=1000T = 1000T=1000 and t=2t = 2t=2, an exact computation gives E[(b−b(2))+]≈1.96⋅10−5\mathbb{E}[(b - b(2))^+] \approx 1.96 \cdot 10^{-5}E[(b−b(2))+]≈1.96⋅10−5, above the printed bound 1.42⋅10−51.42 \cdot 10^{-5}1.42⋅10−5. The mission uses Kl=∑jalj2λjK_l = \sqrt{\sum_j a_{lj}^2 \lambda_j}Kl​=∑j​alj2​λj​​ in Lemma 8 and in the explicit bound.
  • Index slip. The paper's sums ∑l=1L\sum_{l=1}^L∑l=1L​ run over its mmm resources and are read as l∈[m]l \in [m]l∈[m].

A trivializing formalization is ruled out. The constant MMM is chosen before CCC. FR is defined with every optimal LP solution, not only nondegenerate or vertex ones. The capacity check is kept arrival by arrival; without it, FR's expected revenue would equal the LP revenue it targets and the gap would be trivially small.

Contributions welcome on every milestone. The LP sensitivity bound (33) is a statement about linear programs alone and milestone 4 about real numbers alone; both are reusable outside this mission, as is the window model of a randomized admission policy.

Selected references

  • Y. Bumpensanti, H. Wang, A Re-solving Heuristic with Uniformly Bounded Loss for Network Revenue Management, arXiv:1802.06192v3, 2018 (the source of this mission; later in Management Science 66(7), 2020). https://arxiv.org/abs/1802.06192
  • G. Gallego, G. van Ryzin, A Multiproduct Dynamic Pricing Problem and Its Applications to Network Yield Management, Operations Research 45(1), 24–41, 1997.
  • W. L. Cooper, Asymptotic Behavior of an Allocation Policy for Revenue Management, Operations Research 50(4), 720–727, 2002.
  • M. I. Reiman, Q. Wang, An Asymptotically Optimal Policy for a Quantity-Based Network Revenue Management Problem, Mathematics of Operations Research 33(2), 257–282, 2008.
  • S. Jasin, S. Kumar, A Re-Solving Heuristic with Bounded Revenue Loss for Network Revenue Management with Customer Choice, Mathematics of Operations Research 37(2), 313–345, 2012.
  • K. T. Talluri, G. J. van Ryzin, The Theory and Practice of Revenue Management, Springer, 2004.

Bibliographic details of the non-arXiv entries are those of the source's reference list (pp. 24–25).

9 thms1 active userReviewed
Dynamic ProgrammingMachine LearningOperations Research+1·Captain: mikedeng1

Stable Function Approximation in Dynamic Programming I: In a Discounted Finite MDP, Value Iteration Through an Averager Converges to V₀ with ‖V₀ − V*‖ ≤ 2γε/(1 − γ)Research Paper

Motivation

Value iteration computes the optimal value function of a Markov decision process by applying the dynamic programming backup to every state until the values stop changing. When the state space is too large for a lookup table, practitioners replace the table by a function approximator: after each backup, the new values are computed only at a sample of states and an approximator (a neural net, a spline, a nearest-neighbour rule) is fitted to them. This approximate value iteration is the basis of much of reinforcement learning, and in the early 1990s it was known to work well in some experiments and to diverge in others, with no theory separating the two. Boyan and Moore (NIPS 7, 1995) exhibited divergence with linear regression and neural nets, and Tsitsiklis and Van Roy (1996) later studied the same question for feature-based architectures.

Gordon's technical report (CMU-CS-95-103, 1995; a shorter, differently numbered version appeared at ICML 1995) isolated a property of the approximator that guarantees convergence: the approximator must not exaggerate differences between target value functions in max norm. It identified a broad class with this property, the averagers (k-nearest-neighbour, kernel averaging, linear and bilinear interpolation on a mesh), and proved that in a discounted problem approximate value iteration through an averager always converges, with an explicit error bound. This mission formalizes that discounted theory: the report's §2–§3 and its error bound of §6.1.

Setting

A finite Markov decision process MMM has states 1,…,n1,\dots,n1,…,n, a finite nonempty set U(i)U(i)U(i) of actions at each state iii, an expected one-step cost ciac_{ia}cia​ for action aaa at state iii, and transition probabilities paij≥0p_{aij}\ge0paij​≥0 with ∑jpaij=1\sum_j p_{aij}=1∑j​paij​=1. It is discounted with factor 0≤γ<10\le\gamma<10≤γ<1. A value function is a vector V∈RnV\in\mathbb R^nV∈Rn, measured in the max norm ∥V∥=max⁡i∣V(i)∣\|V\|=\max_i|V(i)|∥V∥=maxi​∣V(i)∣.

The parallel value backup operator TMT_MTM​ updates every state at once:

(TMV)(i)=min⁡a∈U(i)(cia+γ∑j=1npaijV(j)).(T_MV)(i)=\min_{a\in U(i)}\Big(c_{ia}+\gamma\sum_{j=1}^n p_{aij}V(j)\Big).(TM​V)(i)=a∈U(i)min​(cia​+γj=1∑n​paij​V(j)).

Its fixed point V∗V^*V∗ is the optimal value function, the minimal expected discounted cost from each state.

A function approximator is studied through its mapping MFM_FMF​: the function sending a vector of target values to the vector of fitted values. Two operators MFM_FMF​ and TTT are compatible if the iterates (MF∘T)k(x0)(M_F\circ T)^k(x_0)(MF​∘T)k(x0​) converge from every initial guess x0x_0x0​.

An averager AAA is given by constants kik_iki​ and nonnegative weights βi,βij\beta_i,\beta_{ij}βi​,βij​ with βi+∑jβij=1\beta_i+\sum_j\beta_{ij}=1βi​+∑j​βij​=1 for every iii; its mapping is

MA(Y)i=βiki+∑j=1nβijYj.M_A(Y)_i=\beta_ik_i+\sum_{j=1}^n\beta_{ij}Y_j .MA​(Y)i​=βi​ki​+j=1∑n​βij​Yj​.

The weights are fixed in advance and do not depend on the targets YYY.

Formalization targets

Goal: Theorem 6.2 (p. 12)

Let VAV^AVA be any fixed point of MAM_AMA​ and ε=∥VA−V∗∥\varepsilon=\|V^A-V^*\|ε=∥VA−V∗∥. Then there is V0V_0V0​ such that (TM∘MA)k(V)→V0(T_M\circ M_A)^k(V)\to V_0(TM​∘MA​)k(V)→V0​ from every initial guess VVV, and

∥V0−V∗∥≤2γε1−γ.\|V_0-V^*\|\le\frac{2\gamma\varepsilon}{1-\gamma}.∥V0​−V∗∥≤1−γ2γε​.

The goal has two parts: convergence from every start to a common limit V0V_0V0​, and the error bound on that limit.

Milestones

  1. Theorem 2.2, first clause (p. 4). ∥TMV−TMW∥≤γ∥V−W∥\|T_MV-T_MW\|\le\gamma\|V-W\|∥TM​V−TM​W∥≤γ∥V−W∥.
  2. Theorem 3.2 (p. 7). MAM_AMA​ is a max-norm nonexpansion, ∥MA(Y)−MA(Z)∥≤∥Y−Z∥\|M_A(Y)-M_A(Z)\|\le\|Y-Z\|∥MA​(Y)−MA​(Z)∥≤∥Y−Z∥, and is compatible with TMT_MTM​ for every discounted MDP.
  3. Theorem 3.1 (p. 5). If MFM_FMF​ is any max-norm nonexpansion, then MFM_FMF​ is compatible with TMT_MTM​ and ∥MF(TMV)−MF(TMW)∥≤γ∥V−W∥\|M_F(T_MV)-M_F(T_MW)\|\le\gamma\|V-W\|∥MF​(TM​V)−MF​(TM​W)∥≤γ∥V−W∥.
  4. Corollary 3.1 (p. 6). There is V∞V_\inftyV∞​ with ∥(MF∘TM)k(V)−V∞∥≤γk∥V−V∞∥\|(M_F\circ T_M)^k(V)-V_\infty\|\le\gamma^k\|V-V_\infty\|∥(MF​∘TM​)k(V)−V∞​∥≤γk∥V−V∞​∥ for all VVV and kkk.

A further item, not a milestone, is the display after the proof of Theorem 6.2 (p. 13), the bound on the fitted output: ∥V∗−MA(V0)∥≤2ε+2γε/(1−γ)\|V^*-M_A(V_0)\|\le2\varepsilon+2\gamma\varepsilon/(1-\gamma)∥V∗−MA​(V0​)∥≤2ε+2γε/(1−γ).

Significance

Theorem 6.2 gives a guarantee that depends only on how well the approximator can represent V∗V^*V∗, not on how the iteration is started: if some fixed point of the averager lies within ε\varepsilonε of V∗V^*V∗, approximate value iteration finds a function within 2γε/(1−γ)2\gamma\varepsilon/(1-\gamma)2γε/(1−γ) of V∗V^*V∗. Theorems 3.1 and 3.2 explain why: an averager is a max-norm nonexpansion, and composing a nonexpansion with a γ\gammaγ-contraction leaves a γ\gammaγ-contraction. Together they separate the approximators that are safe to use with value iteration from those that are not (linear regression is not a nonexpansion: the report's Figure 2 shows it can expand max-norm distances).

All results of this mission are proved in the report; none is open. The contraction of the discounted Bellman operator and the identification of its fixed point with the optimal value function are proved on Prove2Me (BertsekasDP.discounted_main_theorem, used here as a reference item). No machine-checked proof of Gordon's averager results or of the 2γε/(1−γ)2\gamma\varepsilon/(1-\gamma)2γε/(1−γ) bound is known to exist; this mission produces one, on top of the published finite MDP model.

Difficulty

Each step is short on paper; the difficulty is in the bookkeeping that a formal proof cannot skip. The nonexpansion of an averager rests on nonnegative weights summing to at most one, which must be extracted from the row constraint βi+∑jβij=1\beta_i+\sum_j\beta_{ij}=1βi​+∑j​βij​=1 in the max norm on Rn\mathbb R^nRn. The goal's convergence clause asks for one limit V0V_0V0​ shared by all initial guesses, which needs completeness of Rn\mathbb R^nRn and the contraction-mapping theorem applied to TM∘MAT_M\circ M_ATM​∘MA​, not to TMT_MTM​. The error bound compares three different fixed points (V∗V^*V∗ of TMT_MTM​, VAV^AVA of MAM_AMA​, V0V_0V0​ of TM∘MAT_M\circ M_ATM​∘MA​) in a chain of triangle inequalities. The order of composition matters throughout: the compatibility results iterate MF∘TMM_F\circ T_MMF​∘TM​ (fit after the backup), while the goal iterates TM∘MAT_M\circ M_ATM​∘MA​ (back up after the fit), and the two may not be interchanged.

Formalization scope

  • The MDP is the published BertsekasSSPModel (Fin n states, a finite action type, nonempty admissible action sets U(i)U(i)U(i), costs g, transition probabilities p), and TMT_MTM​ is its BertsekasDiscountedBellmanOp M γ. That model allows substochastic rows; every statement adds the hypothesis ∑jpaij=1\sum_j p_{aij}=1∑j​paij​=1 for admissible aaa, which makes it the report's MDP. Action sets may depend on the state, a harmless generalization of the report's single action set. The initial-state distribution S0S_0S0​ never enters a statement and is omitted.
  • The discount satisfies 0≤γ<10\le\gamma<10≤γ<1 in every item. Theorem 6.2's page says only "with discount factor γ\gammaγ"; it belongs to the report's discounted discussion and its proof uses that TMT_MTM​ is a γ\gammaγ-contraction.
  • ∥⋅∥\|\cdot\|∥⋅∥ on Fin n → ℝ is Mathlib's sup norm, i.e. the max norm.
  • V∗V^*V∗ is a hypothesis: a fixed point of TMT_MTM​. Theorem 2.2's last clause, proved on the platform as BertsekasDP.discounted_main_theorem, identifies it with the optimal value function.
  • The averager acts on whole value functions Rn→Rn\mathbb R^n\to\mathbb R^nRn→Rn, indexed by the states. The report's approximator fits a sample X0X_0X0​ of states; ignoring the value at a state jjj outside the sample is the special case βij=0\beta_{ij}=0βij​=0.
  • Theorem 3.1 is printed with "X=S×AX=S\times AX=S×A" and MF∈R∣X∣↦R∣X∣M_F\in\mathbb R^{|X|}\mapsto\mathbb R^{|X|}MF​∈R∣X∣↦R∣X∣; since TMT_MTM​ acts on value functions of the state, MFM_FMF​ is stated on Rn\mathbb R^nRn.
  • "Converges at the rate γ\gammaγ" (Corollary 3.1) is the geometric rate of the contraction-mapping theorem, γk\gamma^kγk times the initial distance to the limit.
  • Theorem 6.2 keeps ε=∥VA−V∗∥\varepsilon=\|V^A-V^*\|ε=∥VA−V∗∥ as an equality, as printed, and its conclusion keeps the convergence clause. A statement asserting only the existence of some V0V_0V0​ with ∥V0−V∗∥≤2γε/(1−γ)\|V_0-V^*\|\le2\gamma\varepsilon/(1-\gamma)∥V0​−V∗∥≤2γε/(1−γ) would be trivial (V0=V∗V_0=V^*V0​=V∗) and is not the theorem.
  • Lemma 2.1 and the Contraction Mapping theorem (Theorem 2.1) are in Mathlib (LipschitzWith.comp, ContractingWith) and are not posed.

Proofs of any item are welcome, as are reusable lemmas on max-norm nonexpansions of row-stochastic linear maps, which also serve the nondiscounted companion mission (Stable Function Approximation in Dynamic Programming II).

Selected references

  • G. J. Gordon, Stable Function Approximation in Dynamic Programming, Technical Report CMU-CS-95-103, Carnegie Mellon University, 1995; shorter version in Machine Learning Proceedings 1995 (ICML), 1995. https://doi.org/10.1016/B978-1-55860-377-6.50040-2
  • D. P. Bertsekas and J. N. Tsitsiklis, Parallel and Distributed Computation: Numerical Methods, Prentice Hall, 1989 (the report's [BT89]; no DOI).
  • J. A. Boyan and A. W. Moore, Generalization in Reinforcement Learning: Safely Approximating the Value Function, Advances in Neural Information Processing Systems 7, MIT Press, 1995 (the report's [BM95]).
  • J. N. Tsitsiklis and B. Van Roy, Feature-Based Methods for Large Scale Dynamic Programming, Machine Learning 22, 1996, pp. 59–94. https://doi.org/10.1007/BF00114724
8 thms3 active usersReviewed
Operations ResearchStochastic Systems·Captain: mikedeng1

Extensions of the Queueing Relations L = λW and H = λG: Under (14) and (15) the Time Average H(t) Converges if and only if the Customer Average G(s) Does, and Then H = λGResearch Paper

Motivation

Queueing results often relate an average accumulated over customers to an average accumulated over time. In the familiar relation L=λWL=\lambda WL=λW, the long-run average number in a system equals the arrival rate times the average time spent there. Glynn and Whitt study a broader relation, H=λGH=\lambda GH=λG, that can represent queue lengths and waiting times but also costs, work, and other cumulative inputs. Their framework is deterministic: a stochastic model may supply a sample path, yet the central comparison is a statement about functions on that path. This lets the same theorem apply to different queueing models without choosing a probability law for each one. Glynn and Whitt (1989)

The paper asks for more than the usual forward implication from a customer average to a time average. Its main theorem identifies conditions under which either average has a finite limit exactly when the other does. It also compares lim inf and lim sup when ordinary limits fail to exist. Both questions matter when sample paths fluctuate: convergence of one average cannot simply be inferred from a visual similarity between the two ways of indexing the input. Glynn and Whitt (1989), §§1–2

Setting

A cumulative input is a real-valued function F(s,t)F(s,t)F(s,t) on [0,∞)×[0,∞)[0,\infty)\times[0,\infty)[0,∞)×[0,∞), nondecreasing separately in the customer coordinate sss and the time coordinate ttt. Its marginal limits F(s,∞)F(s,\infty)F(s,∞) and F(∞,t)F(\infty,t)F(∞,t) are finite for every fixed argument. The first counts all eventual input associated with customers through index sss; the second counts all input accumulated through time ttt. The marginal averages are

G(s)=F(s,∞)s,H(t)=F(∞,t)t.G(s)=\frac{F(s,\infty)}{s},\qquad H(t)=\frac{F(\infty,t)}{t}.G(s)=sF(s,∞)​,H(t)=tF(∞,t)​.

The paper permits cumulative inputs that are not distribution functions of measures on rectangles. In particular, it does not require a rectangle-increment inequality or nonnegative values of FFF. The finite marginal limits and monotonicity are the actual assumptions of its general framework. Glynn and Whitt (1989), p. 635, (1)

A time change Ti(s)T_i(s)Ti​(s), for i=1,2i=1,2i=1,2, is finite, nonnegative, nondecreasing, and right-continuous, and tends to infinity with sss. Its right-continuous inverse is Si(t)=inf⁡{s≥0:Ti(s)>t}S_i(t)=\inf\{s\geq0:T_i(s)>t\}Si​(t)=inf{s≥0:Ti​(s)>t}. The two time changes may differ. Both have the same asymptotic rate Ti(s)/s→λ−1T_i(s)/s\to\lambda^{-1}Ti​(s)/s→λ−1 for a positive finite λ\lambdaλ. The paper's two approximation conditions are

F(s,T1(s−))−F(∞,T1(s−))s⟶0(14),F(s,∞)−F(s,T2(s))s⟶0(15),\frac{F(s,T_1(s-))-F(\infty,T_1(s-))}{s}\longrightarrow0 \quad(14), \qquad \frac{F(s,\infty)-F(s,T_2(s))}{s}\longrightarrow0 \quad(15),sF(s,T1​(s−))−F(∞,T1​(s−))​⟶0(14),sF(s,∞)−F(s,T2​(s))​⟶0(15),

as s→∞s\to\inftys→∞, where T1(s−)T_1(s-)T1​(s−) is the left limit. Condition (14) concerns input already present by a left-limit time; condition (15) concerns input not yet present by a right-limit time. Glynn and Whitt (1989), p. 638, (3), (14)–(15)

Formalization targets

One-sided asymptotic bounds

With only (14) and the rate for T1T_1T1​, the corrected upper bounds are

lim inf⁡H≤lim inf⁡λG,lim sup⁡H≤lim sup⁡λG.\liminf H\leq\liminf \lambda G,\qquad \limsup H\leq\limsup \lambda G.liminfH≤liminfλG,limsupH≤limsupλG.

With only (15) and the rate for T2T_2T2​, the corrected lower bounds reverse both inequalities. The two bounds remain useful separately when only one approximation condition holds. Their lim inf and lim sup may be infinite. Glynn and Whitt (1989), p. 639, Theorem 1(a)–(b) and Remark 2

Equality of asymptotic bounds and finite limits

Under both conditions, Theorem 1(c) asserts equality of the respective lim inf and lim sup. The mission goal is Theorem 1(f): for finite real limits,

H(t)→h⟺G(s)→g,and whenever these limits exist, h=λg.H(t)\to h\quad\Longleftrightarrow\quad G(s)\to g, \qquad\text{and whenever these limits exist, }h=\lambda g.H(t)→h⟺G(s)→g,and whenever these limits exist, h=λg.

Here the equivalence means existence of finite limits, with the second clause identifying their values. The lim inf and lim sup statement is retained as a milestone because it also covers nonconvergent paths. Glynn and Whitt (1989), p. 639, Theorem 1(c), (f)

Significance

The goal gives a two-way transfer between customer-indexed and time-indexed long-run averages. If an application establishes one finite average, the theorem supplies the other and fixes its value. The one-sided milestones give meaningful bounds when only one approximation condition is available; the lim inf and lim sup milestone retains information when neither average converges. These outcomes are stated for a general cumulative input, so applications can supply their own FFF, T1T_1T1​, and T2T_2T2​ without changing the theorem. Glynn and Whitt (1989), §§2–4

The paper proves these results on paper. The formalization target is a machine-checked interface for the paper's deterministic framework, its inversion lemmas, its asymptotic inequalities, and the two-way limit theorem. At this drafting stage the Lean theorem statements compile with proof placeholders; no machine-checked proofs of these new statements are claimed. The definitions and inverse-rate lemma can be reused in other sample-path results.

Difficulty

The two marginal averages examine different slices of FFF, and a time change may jump or have flat intervals. A direct substitution of t=Ti(s)t=T_i(s)t=Ti​(s) does not give an equality between F(s,∞)F(s,\infty)F(s,∞) and F(∞,t)F(\infty,t)F(∞,t) under the paper's assumptions. The left limit in (14) and the value in (15) also behave differently at jumps. The inverse SiS_iSi​ connects the coordinates, but its boundary behavior and rate must be handled before comparing the averages. These issues are present even without stochastic randomness. Glynn and Whitt (1989), pp. 638–639

Formalization scope

Lean represents s,ts,ts,t by nonnegative real numbers and FFF by a real-valued function with separate monotonicity and bounded marginal ranges. Real suprema represent F(s,∞)F(s,\infty)F(s,∞) and F(∞,t)F(\infty,t)F(∞,t); the boundedness fields ensure those suprema are the paper's finite limits. The inverse is an infimum of a nonempty set because Ti→∞T_i\to\inftyTi​→∞. The left limit is the supremum over earlier nonnegative arguments, with T(0−)=0T(0-)=0T(0−)=0. Ratios at zero use Lean's total division convention, but every ratio assertion is asymptotic at infinity.

Lim inf and lim sup are taken in the extended reals so an unbounded average retains an infinite limit. Multiplication by λ\lambdaλ happens in the reals before conversion. Ordinary limits in Theorem 1(f) are finite real limits. The two time changes are independent and share only the positive rate λ\lambdaλ. The goal assumes only (14), (15), and the stated time-change rates; it does not assume its own inverse-rate or asymptotic conclusions. No nonnegativity or rectangle inequality is imposed on FFF.

Theorem 1(a) and (b) have their hypothesis pairing reversed in print. The formalized one-sided bounds use the corrected pairing, and the milestone text preserves the printed source for audit. The intermediate expressions involving G(Si(t))G(S_i(t))G(Si​(t)) are excluded from the corrected statements because the framework does not assume customer-coordinate right continuity. Theorem 1(c) and (f) use both conditions and are true as printed. The scope includes the definitions, Lemmas 1–2, corrected parts (a)–(b), and parts (c) and (f). Contributions toward their proofs and reusable time-change lemmas are welcome. Glynn and Whitt (1989), p. 639, Theorem 1

Selected references

  • P. W. Glynn and W. Whitt, Extensions of the Queueing Relations L = λW and H = λG, Operations Research 37(4):634–644, 1989. DOI: 10.1287/opre.37.4.634
9 thms1 active userReviewed
🏆Completed
CombinatoricsOperations ResearchTheoretical Computer Science·Captain: mikedeng1

Bounds on Multiprocessing Timing Anomalies 2: Scheduling the k Longest Independent Tasks Optimally First Gives ω(k)/ω₀ ≤ 1 + (1 − 1/n)/(1 + ⌊k/n⌋)Research Paper

Motivation

Parallel processing poses a basic allocation question: given tasks of known lengths and several identical processors, how much time is lost when tasks are assigned by a simple list rule instead of an optimal allocation? The finishing time is the moment the last processor completes its work. For independent tasks, a list rule starts each next task on a processor that becomes free first. Such a rule is easy to execute, but the resulting allocation can be worse than the best partition of tasks among processors. Graham's 1969 paper studies precise worst-case ratios for this model. Its Theorem 3 asks what guarantee follows when the first kkk tasks of the list are chosen among the longest and scheduled optimally before the remaining tasks are appended.

The paper also notes two endpoints of this family. With k=0k=0k=0, the rule is ordinary list scheduling and has ratio at most 2−1/n2-1/n2−1/n. With k=nk=nk=n, the nnn longest tasks can start one per processor, giving ratio at most 3/2−1/(2n)3/2-1/(2n)3/2−1/(2n). Theorem 3 expresses these as instances of one bound, including the integer jump at each multiple of nnn Graham, pp. 427–428.

Setting

There are r>0r>0r>0 independent tasks, indexed by jin{0,…,r−1}jin\{0,\ldots,r-1\}jin{0,…,r−1}, and n>0n>0n>0 identical processors, indexed by p∈{0,…,n−1}p\in\{0,\ldots,n-1\}p∈{0,…,n−1}. Task jjj takes a strictly positive time μj\mu_jμj​. A priority list LLL contains every task exactly once. Its first kkk tasks are kkk of the longest tasks; equal lengths may be ordered either way. As a processor becomes available, it takes the next task in the list. Once started, a task runs without interruption. With no precedence constraints, every unstarted task is ready, so a processor runs its assigned tasks consecutively from time zero.

An assignment σ\sigmaσ records the processor that executes each task. The load ℓp(σ)\ell_p(\sigma)ℓp​(σ) of processor ppp is the sum of its assigned task lengths. The finishing time is the largest load, ω(k)=max⁡pℓp(σ)\omega(k)=\max_p\ell_p(\sigma)ω(k)=maxp​ℓp​(σ). For a list assignment, each task is assigned to a processor whose load from earlier list tasks is smallest at that step. If two processors are tied, either can be selected without changing the finishing time. For any assignment τ\tauτ, let ωk(τ)\omega_k(\tau)ωk​(τ) be the largest load contributed by only the first kkk list tasks. The algorithm requires its own first kkk assignments to minimize ωk(τ)\omega_k(\tau)ωk​(τ) over all assignments τ\tauτ; the remaining tasks may occur in any list order.

Write ω0\omega_0ω0​ for the smallest finishing time achievable for all rrr tasks. The paper introduces it as the minimum over possible lists and later describes the same problem as minimizing the largest part sum over partitions of the task lengths Graham, pp. 421, 428. The formalization uses the partition or assignment form of ω0\omega_0ω0​.

Formalization targets

Theorem 3

For 0≤k≤r0\le k\le r0≤k≤r, when the first kkk longest tasks have an optimal prefix schedule, Graham's bound is

ω(k)ω0≤1+1−1/n1+⌊k/n⌋.\frac{\omega(k)}{\omega_0} \le 1+\frac{1-1/n}{1+\lfloor k/n\rfloor}.ω0​ω(k)​≤1+1+⌊k/n⌋1−1/n​.

Here ⌊k/n⌋\lfloor k/n\rfloor⌊k/n⌋ is the greatest integer at most k/nk/nk/n. The theorem also says the bound is best possible when kkk is divisible by nnn Graham, Theorem 3, p. 427. The equality examples are a separate companion statement in this mission.

Source milestones

The milestones state the finite-volume lower bound on ω0\omega_0ω0​, the case in which completing all tasks takes no longer than completing the first kkk, and the paper's numbered inequalities (14), (15), and (16). They use α∗\alpha^*α∗ for the greatest task length after the first kkk positions. These are individual mathematical claims from the proof on p. 427, with their original wording and formulas recorded alongside the formal statements.

Significance

The theorem gives a quantitative tradeoff between work spent optimizing a prefix and the worst-case finishing time of the full list. Its denominator is 1+⌊k/n⌋1+\lfloor k/n\rfloor1+⌊k/n⌋, so the guarantee improves when the optimized prefix contains another full processor's worth of long tasks. The example at multiples of nnn shows that the stated coefficient cannot be uniformly reduced for the algorithm as specified Graham, p. 427.

The result is proved in the paper. This mission's remaining work is a machine-checked proof of its exact statement and the source's intermediate inequalities. The published identical-machine makespan definition is reused, while the list-assignment rule, optimal prefix, and longest-remaining-task quantity are made explicit here. Those definitions can also support later work on list scheduling without precedence constraints. No machine-checked proof of Theorem 3 is claimed by this proposal.

Difficulty

An optimal schedule for the first kkk long tasks does not make the entire list optimal: short tasks appended later can affect which processor finishes last. A bound based only on average total work ignores this final imbalance; a bound based only on the largest remaining task ignores how many long tasks every assignment must place together. The proof must relate both constraints to one finishing time while preserving the floor ⌊k/n⌋\lfloor k/n\rfloor⌊k/n⌋. Replacing that floor with the real quotient changes the claim, and allowing an arbitrary prefix arrangement loses the algorithm's required optimality.

Formalization scope

Tasks and processors are finite indexed sets Fin r and Fin n; their zero-based indices correspond to the paper's one-based TjT_jTj​ and PiP_iPi​. Task lengths are positive real numbers, and both rrr and nnn are positive. The list is a permutation, not merely a sequence that might omit or repeat a task. The condition k≤rk\le rk≤r is explicit because choosing kkk tasks from rrr requires it; the paper treats r>kr>kr>k inside the proof and the case k=rk=rk=r is covered by the theorem. There is no precedence relation in this mission.

The list rule is a predicate on assignments: each next task goes to a processor with least current load. It omits the paper's smaller-index tie convention, since tied identical processors can be interchanged without changing the finishing time. The first kkk positions must contain kkk longest tasks, and their assignment must minimize the prefix finishing time among all assignments of those tasks. Those conditions are part of the goal; the inequalities (14)–(16) are conclusions to establish, not assumptions of the goal. A separate existence statement and a checked concrete instance ensure the list predicate is satisfiable.

All maxima and minima range over finite nonempty processor or assignment sets. The optimum is a minimum over assignments, equivalent to the paper's minimum over lists in the independent-task model. The quantity α∗\alpha^*α∗ is the largest duration outside the prefix when k<rk<rk<r, and is defined as zero when none remains; statements using it require k<rk<rk<r. Division is by n>0n>0n>0 and by ω0>0\omega_0>0ω0​>0. Lean's natural-number quotient represents ⌊k/n⌋\lfloor k/n\rfloor⌊k/n⌋; real subtraction is used for coefficients such as n−1n-1n−1. Contributions toward the finite load identities, the optimum-over-lists equivalence, and proofs of the listed bounds are within scope.

Selected references

  • R. L. Graham, Bounds on Multiprocessing Timing Anomalies, SIAM Journal on Applied Mathematics 17(2), 416–429, 1969. DOI: 10.1137/0117039.
8 thms2 active usersReviewed
CombinatoricsOperations ResearchOptimization·Captain: mikedeng1

Optimization and Approximation in Deterministic Sequencing and Scheduling: A Survey 1: The Optimal Two-Machine Open Shop Makespan Is max{T₁, T₂, maxⱼ(aⱼ + bⱼ)}Research Paper

Motivation

Shop scheduling asks how to sequence jobs that each need processing on several machines. In an open shop, a job's operations may be executed in any order, as in testing stations, repair bays, or classroom and examination timetables, where the order in which a candidate visits the stations is irrelevant. The objective studied here is the makespan Cmax⁡C_{\max}Cmax​, the time at which the last operation finishes.

The survey of Graham, Lawler, Lenstra and Rinnooy Kan (Ann. Discrete Math. 5, 1979) introduced the three-field notation α∣β∣γ\alpha|\beta|\gammaα∣β∣γ that the scheduling literature still uses, and classified the complexity of the problems it names. For the open shop, its §5.2.1 presents a simplified exposition of the result of Gonzalez and Sahni (J. ACM 23, 1976): with two machines and no preemption, the obvious lower bound on the makespan is always achieved. The same page records that the three-machine case O3∥Cmax⁡O3\|C_{\max}O3∥Cmax​ is binary NP-hard, so two machines is exactly where the problem is easy.

Timeline. Gonzalez and Sahni (1976) gave the linear-time algorithm for O2∥Cmax⁡O2\|C_{\max}O2∥Cmax​, proved NP-hardness for O3∥Cmax⁡O3\|C_{\max}O3∥Cmax​, and gave a polynomial algorithm for the preemptive problem O∣pmtn∣Cmax⁡O|pmtn|C_{\max}O∣pmtn∣Cmax​. Graham et al. (1979, §5.2.1) gave the shorter construction formalized here, and observed (§5.2.2) that it implies preemption brings no advantage for m=2m = 2m=2. Lenstra (cited as forthcoming in the survey) showed O2∣rj∣Cmax⁡O2|r_j|C_{\max}O2∣rj​∣Cmax​, O2∣tree∣Cmax⁡O2|tree|C_{\max}O2∣tree∣Cmax​ and O∥Cmax⁡O\|C_{\max}O∥Cmax​ unary NP-hard.

Setting

There are nnn jobs J1,…,JnJ_1, \dots, J_nJ1​,…,Jn​ and two machines M1M_1M1​, M2M_2M2​. Job JjJ_jJj​ has an operation on M1M_1M1​ of length aj≥0a_j \ge 0aj​≥0 and an operation on M2M_2M2​ of length bj≥0b_j \ge 0bj​≥0. There is no preemption, and every job is available at time 000. A schedule assigns start times s1(j)s_1(j)s1​(j) and s2(j)s_2(j)s2​(j) to the two operations of JjJ_jJj​, which then occupy [s1(j),s1(j)+aj)[s_1(j), s_1(j)+a_j)[s1​(j),s1​(j)+aj​) on M1M_1M1​ and [s2(j),s2(j)+bj)[s_2(j), s_2(j)+b_j)[s2​(j),s2​(j)+bj​) on M2M_2M2​.

A schedule is feasible if

  1. all start times are nonnegative;
  2. each machine processes at most one job at a time: the intervals of distinct jobs on the same machine do not overlap;
  3. each job is processed on at most one machine at a time: the two intervals of the same job do not overlap, in either order.

Write T1=∑jajT_1 = \sum_j a_jT1​=∑j​aj​ and T2=∑jbjT_2 = \sum_j b_jT2​=∑j​bj​ for the two machine loads. The survey's construction uses the sets

A={Jj∣aj≥bj},B={Jj∣aj<bj},A = \{J_j \mid a_j \ge b_j\}, \qquad B = \{J_j \mid a_j < b_j\},A={Jj​∣aj​≥bj​},B={Jj​∣aj​<bj​},

two distinct jobs JrJ_rJr​, JlJ_lJl​ with ar≥max⁡Jj∈Abja_r \ge \max_{J_j \in A} b_jar​≥maxJj​∈A​bj​ and bl≥max⁡Jj∈Bajb_l \ge \max_{J_j \in B} a_jbl​≥maxJj​∈B​aj​, and A′=A−{Jr,Jl}A' = A - \{J_r, J_l\}A′=A−{Jr​,Jl​}, B′=B−{Jr,Jl}B' = B - \{J_r, J_l\}B′=B−{Jr​,Jl​}.

Formalization targets

Goal: the optimal makespan

Cmax⁡∗=max⁡{T1, T2, max⁡j (aj+bj)},C^*_{\max} = \max\Big\{T_1,\ T_2,\ \max_j\,(a_j + b_j)\Big\},Cmax∗​=max{T1​, T2​, jmax​(aj​+bj​)},

and the optimum is attained. Formally, for every T≥0T \ge 0T≥0: a feasible schedule completing every operation by TTT exists if and only if T1≤TT_1 \le TT1​≤T, T2≤TT_2 \le TT2​≤T and aj+bj≤Ta_j + b_j \le Taj​+bj​≤T for all jjj. The goal mentions neither AAA, BBB, JrJ_rJr​, JlJ_lJl​ nor the case analysis; those are the milestones.

Milestones (in the order of the argument)

  1. Two distinct jobs JrJ_rJr​, JlJ_lJl​ with the required bounds exist when n≥2n \ge 2n≥2.
  2. Fig. 5.1: the blocks B′∪{Jl}B' \cup \{J_l\}B′∪{Jl​} and A′∪{Jr}A' \cup \{J_r\}A′∪{Jr​}, with A′A'A′ and B′B'B′ in arbitrary order, have feasible staircase schedules without idle time.
  3. Fig. 5.2: if T1−al≥T2−brT_1 - a_l \ge T_2 - b_rT1​−al​≥T2​−br​, the blocks combine into a feasible schedule of all jobs ending by T1+brT_1 + b_rT1​+br​.
  4. Case (1): if moreover ar≤T2−bra_r \le T_2 - b_rar​≤T2​−br​, some feasible schedule has length at most max⁡{T1,T2}\max\{T_1, T_2\}max{T1​,T2​}.
  5. Case (2): if moreover ar>T2−bra_r > T_2 - b_rar​>T2​−br​, some feasible schedule has length at most max⁡{T1,ar+br}\max\{T_1, a_r + b_r\}max{T1​,ar​+br​}.
  6. The symmetric case T1−al<T2−brT_1 - a_l < T_2 - b_rT1​−al​<T2​−br​: some feasible schedule has length at most max⁡{T1,T2,al+bl}\max\{T_1, T_2, a_l + b_l\}max{T1​,T2​,al​+bl​}.
  7. The lower bound: every feasible schedule has Cmax⁡≥max⁡{T1,T2,max⁡j(aj+bj)}C_{\max} \ge \max\{T_1, T_2, \max_j(a_j + b_j)\}Cmax​≥max{T1​,T2​,maxj​(aj​+bj​)}.

Significance

The result. The theorem gives a closed form for the optimal makespan of a two-machine open shop, together with a linear-time construction of an optimal schedule. The survey uses it immediately: since the bound is also a lower bound for preemptive schedules, O2∣pmtn∣Cmax⁡O2|pmtn|C_{\max}O2∣pmtn∣Cmax​ is solved by the same schedules, so preemption gives no advantage on two machines (§5.2.2). It is the standard example of a shop problem whose trivial lower bound is tight, and the contrast with the binary NP-hard O3∥Cmax⁡O3\|C_{\max}O3∥Cmax​ marks the complexity boundary for nonpreemptive open shops.

Formalizing it. The result is classical and proved on paper; no machine-checked proof is known to exist on this platform. The mission produces a reusable model of nonpreemptive two-machine open-shop schedules with real processing times, a verified lower bound, and a verified constructive argument. Unlike many existence-of-schedule results, the survey's construction is explicit (orders and start times), so it can be formalized directly rather than through an abstract existence argument.

Difficulty

The lower bound is the easy half. The difficulty is the construction: a schedule must meet the bound simultaneously on both machines and for every job. The natural first idea, running every job on M1M_1M1​ then M2M_2M2​ in some order (a flow-shop schedule), fails: Johnson's rule then gives a makespan that can exceed max⁡{T1,T2,max⁡j(aj+bj)}\max\{T_1, T_2, \max_j(a_j+b_j)\}max{T1​,T2​,maxj​(aj​+bj​)}, because the open shop needs some job to visit M2M_2M2​ first. The survey's construction moves exactly one job, JrJ_rJr​, to the front of M2M_2M2​, and its correctness depends on the choice of JrJ_rJr​ and JlJ_lJl​ and on the case split on T1−alT_1 - a_lT1​−al​ versus T2−brT_2 - b_rT2​−br​. Figures 5.3 and 5.4 are drawn for T1≥T2T_1 \ge T_2T1​≥T2​; in the other subcases the start times shown in the figures need adjustment, and the formal statements of the cases assert lengths rather than the figures' exact start times.

Formalization scope

All declarations live in the namespace SchedSurvey.O2. Jobs are Fin n, 0-based (JjJ_jJj​ is index j−1j-1j−1). Processing times and start times are real numbers with aj,bj≥0a_j, b_j \ge 0aj​,bj​≥0; the survey's integer data are a special case, and every claim of §5.2.1 holds over the reals. A schedule is a pair of start-time functions s₁ s₂ : Fin n → ℝ. Interval non-overlap is s + p ≤ s' ∨ s' + p' ≤ s, so touching intervals are allowed and a zero-length operation occupies nothing. Feasibility (IsFeasible) contains both disjointness constraints of §2.1, the machine constraint and the job constraint, with the two operations of a job in either order. The job constraint is essential: without it the optimum would be max⁡{T1,T2}\max\{T_1, T_2\}max{T1​,T2​} and the goal false.

"Length at most LLL" is CompletesBy a b S L: every operation ends by LLL. Optimality is stated in threshold form, which avoids taking a supremum or infimum over a possibly empty set and is equivalent to "Cmax⁡∗C^*_{\max}Cmax∗​ equals the maximum and is attained". A maximum over AAA or BBB appears as a bound on every member, which is also correct for empty AAA or BBB. The orders of A′A'A′ and B′B'B′ are duplicate-free lists whose members are exactly those sets; back-to-back start times are given by contigStart.

The milestone on the choice of JrJ_rJr​, JlJ_lJl​ assumes n≥2n \ge 2n≥2, which the page presupposes; the goal does not, and covers n≤1n \le 1n≤1 as well. The lower bound assumes T≥0T \ge 0T≥0, which matters only for n=0n = 0n=0.

A trivializing formalization is ruled out: feasibility includes both disjointness constraints and nonnegative start times, the threshold is quantified over all T≥0T \ge 0T≥0, and no constant is fixed.

Contributions welcome: proofs of the lower bound (a sum of disjoint intervals inside [0,T][0, T][0,T]), of the list-based block lemmas, of the case lemmas, and of the goal from them. The interval and back-to-back-schedule lemmas are reusable for other shop problems.

Selected references

  • R.L. Graham, E.L. Lawler, J.K. Lenstra, A.H.G. Rinnooy Kan, Optimization and approximation in deterministic sequencing and scheduling: a survey, Annals of Discrete Mathematics 5 (1979) 287–326. https://doi.org/10.1016/S0167-5060(08)70356-X
  • T. Gonzalez, S. Sahni, Open shop scheduling to minimize finish time, Journal of the ACM 23(4) (1976) 665–679. https://doi.org/10.1145/321978.321985
  • S.M. Johnson, Optimal two- and three-stage production schedules with setup times included, Naval Research Logistics Quarterly 1 (1954) 61–68. https://doi.org/10.1002/nav.3800010110
9 thms1 active userReviewed
Convex OptimizationOperations ResearchOptimization+1·Captain: mikedeng1

Deterministic Equivalents for Optimizing and Satisficing under Chance Constraints 2: The Fractional P-Model Program (38) Has the Same Supremum as the Convex Program (39)Research Paper

Motivation

A chance constraint limits the probability of violating a requirement rather than requiring that requirement to hold for every realization of uncertain data. Charnes and Cooper developed deterministic optimization problems for several ways of judging decisions under such constraints. Their P model gives a satisficing objective: increase the probability of reaching a specified aspiration level while meeting prescribed reliability levels for the resource constraints. The paper's concrete decision rule makes the decision vector depend linearly on the random right-hand side, and its P-model section moves from a fractional deterministic program to a convex one. The result explains how a risk-adjusted ratio can be optimized without retaining a fractional objective. The source is Charnes and Cooper, 1963, pp. 30–33, especially equations (35) and (38)–(39b).

The related linear-fractional change of variables was already being used for linear programs Charnes and Cooper, 1962; the present section applies it to constraints built from second moments rather than linear equations. That distinction matters because the normalized feasible set contains a boundary at zero scale, and because second-moment inequalities require their own convexity claim. The paper cites fractional programming results for its local-to-global assertion about (38); the mission focuses on its explicit transformed program (39). Charnes and Cooper, 1963, p. 32.

Setting

Let m,nm,nm,n be positive integers and (Ω,P)(\Omega,P)(Ω,P) a probability space. A fixed real m×nm\times nm×n matrix AAA has rows ai′a_i'ai′​. Random vectors b:Ω→Rmb:\Omega\to\mathbb R^mb:Ω→Rm and c:Ω→Rnc:\Omega\to\mathbb R^nc:Ω→Rn give the right-hand side and objective coefficients. The paper restricts decisions to the linear decision rule x=Dbx=Dbx=Db, where the real n×mn\times mn×m matrix DDD is chosen before bbb is realized. Write μb=E[b]\mu_b=E[b]μb​=E[b] and μc=E[c]\mu_c=E[c]μc​=E[c]. A number z0z_0z0​ is the given aspiration value. For each row iii, its reliability level αi\alpha_iαi​ is strictly between 1/21/21/2 and 111, and Ki=Φ−1(αi)>0K_i=\Phi^{-1}(\alpha_i)>0Ki​=Φ−1(αi​)>0 is the corresponding standard-normal quantile. These are the objects of equations (5), (19b), (21), and (27) in Charnes and Cooper, 1963.

The residual ai′Db−bia_i'Db-b_iai′​Db−bi​ has raw second moment σi2(D)=E[(ai′Db−bi)2]\sigma_i^2(D)=E[(a_i'Db-b_i)^2]σi2​(D)=E[(ai′​Db−bi​)2] and negative mean μi(D)=μbi−ai′Dμb\mu_i(D)=\mu_{b_i}-a_i'D\mu_bμi​(D)=μbi​​−ai′​Dμb​. The aspiration error has raw second moment V(D)=E[(c′Db−z0)2]V(D)=E[(c'Db-z_0)^2]V(D)=E[(c′Db−z0​)2]. These definitions come from equations (30) and (34). The expected linear objective appearing in the deterministic programs is μc′Dμb\mu_c'D\mu_bμc′​Dμb​; the model records the paper's assumption that the components of bbb and ccc are uncorrelated. Charnes and Cooper, 1963, pp. 26, 28, 30.

Program (38) chooses (D,v,v0,w0)(D,v,v_0,w_0)(D,v,v0​,w0​) and maximizes v0/w0v_0/w_0v0​/w0​. Its inequalities bound the mean objective below by z0+v0z_0+v_0z0​+v0​, bound w0w_0w0​ below by the root-mean-square aspiration error, and bound each nonnegative viv_ivi​ between the row's risk term and μi(D)\mu_i(D)μi​(D). The denominator satisfies w0>0w_0>0w0​>0. Program (39) introduces a nonnegative scale ttt and barred variables. It fixes wˉ0=1\bar w_0=1wˉ0​=1 and maximizes the linear objective vˉ0\bar v_0vˉ0​. The barred moments are calculated from Dˉ\bar DDˉ and ttt by equation (39b), rather than declared to be scaled copies of the unbarred moments. Charnes and Cooper, 1963, pp. 32–33.

Formalization targets

Convex transformed program

Let F39F_{39}F39​ contain every point satisfying all of (39), including t=0t=0t=0. The paper's convex-programming claim becomes

F39 is convex.F_{39}\text{ is convex}.F39​ is convex.

The source states the claim after displaying the barred moments, in the paragraph following (39b). Charnes and Cooper, 1963, p. 33.

Equal optimal values

Let F38F_{38}F38​ be the feasible set of (38). Provided F38F_{38}F38​ is nonempty, the mission goal states that the normalized substitution sends each point of F38F_{38}F38​ to a point of F39F_{39}F39​ with the same objective, and that

sup⁡(D,v,v0,w0)∈F38v0w0=sup⁡(Dˉ,vˉ,vˉ0,wˉ0,t)∈F39vˉ0.\sup_{(D,v,v_0,w_0)\in F_{38}}\frac{v_0}{w_0} =\sup_{(\bar D,\bar v,\bar v_0,\bar w_0,t)\in F_{39}}\bar v_0.(D,v,v0​,w0​)∈F38​sup​w0​v0​​=(Dˉ,vˉ,vˉ0​,wˉ0​,t)∈F39​sup​vˉ0​.

The suprema may be infinite. The equality concerns the complete program (39), including t=0t=0t=0. Positive-scale points have an inverse substitution; zero-scale points are retained in the comparison. This is the precise optimal-value reading of the paper's statement that (38) can be replaced by one convex program. Charnes and Cooper, 1963, pp. 32–33.

Significance

The result places the P model alongside the paper's E and V models as an optimization problem with convex feasible constraints and a nonfractional objective. A solver of (39) can compare aspiration and resource reliability within the same matrix decision rule. Equality of suprema says the transformed model has the same best attainable value even when the best value is only approached, and even when points at t=0t=0t=0 occur in the transformed feasible set. The forward and inverse substitution statements identify how positive-scale solutions correspond. Charnes and Cooper, 1963, pp. 30–33.

The paper result is a published mathematical claim. The present formalization states its definitions and assertions in Lean; its theorem proofs are still open. The standard Gaussian CDF and its inverse are available as a separately published Prove2Me definition, while the model-specific second moments and feasible sets must be formalized for this mission. The previously published Derman linear-fractional lemma concerns a polyhedral linear program and does not assert this P-model result. Completing the mission would add reusable formal machinery for expected-square constraints, a normalized perspective program, and equality of optimal values at a scale boundary.

Difficulty

The pointwise substitution t=1/w0t=1/w_0t=1/w0​ only reaches points of (39) with t>0t>0t>0, while (39) explicitly permits t=0t=0t=0. Therefore a bijection of feasible points at positive scale alone does not establish equality of the displayed suprema. The proof also has to reconcile the squared form of the row constraints with convexity: σˉi2\bar\sigma_i^2σˉi2​ is a raw second moment and μˉi2\bar\mu_i^2μˉ​i2​ is the square of its mean, so their difference is the variance term relevant to the risk bound. Taking the fourth inequality as a generic difference of quadratics would obscure that claim. The paper prints a conflicting square and sign in (38), which must be resolved against its earlier (29) and later (39). Charnes and Cooper, 1963, pp. 28, 32–33.

Formalization scope

Lean uses finite index types Fin m and Fin n, real matrices and scalars, a probability measure PPP, and Bochner integrals for the moments. Square integrability is stated for every component of bbb and ccc and every product cjbkc_jb_kcj​bk​; this keeps the expected squares meaningful. The paper assumes bbb and ccc are uncorrelated, so the same componentwise equalities are recorded. It also assumes that each row residual has a Gaussian law under a decision matrix; the Lean theorem retains this standing assumption even though the substitution from (38) to (39) is algebraic. The quantile KiK_iKi​ is imported from the published Cohen2019.Robust.PhiInvReal, with 1/2<αi<11/2<\alpha_i<11/2<αi​<1 excluding its junk endpoint values. The theorem concerns (38) onward; it does not assert the paper's analogous reduction from the original probability model (35), because the text does not establish a distributional theorem for its random objective. Charnes and Cooper, 1963, pp. 26–27, 31–33.

The source phrase “replace ... by one convex programming problem” is made explicit as convexity of the (39) feasible set, feasibility and value preservation of the forward scaling, and equality of extended-real suprema. The normalization wˉ0=1\bar w_0=1wˉ0​=1, strict w0>0w_0>0w0​>0, and weak t≥0t\ge0t≥0 are separate conditions. The t=0t=0t=0 slice is included, and the main theorem assumes F38F_{38}F38​ nonempty. The barred functions are genuine expectations of the homogenized expressions of (39b). The square-and-sign discrepancy in printed (38) is resolved in favor of the form printed in (29) and (39), consistent with the nearby statement that the row constraints are the same as before. These choices exclude a vacuous denominator, an artificially smaller transformed set, and a trivially defined scaling identity. Reusable contributions include moment lemmas, convexity results for expected-square constraints, and supremum comparison for normalized programs.

Selected references

  • A. Charnes and W. W. Cooper, Deterministic Equivalents for Optimizing and Satisficing under Chance Constraints, Operations Research 11(1), 1963, pp. 18–39. DOI.
  • A. Charnes and W. W. Cooper, Programming with Linear Fractional Functionals, Naval Research Logistics Quarterly 9(3–4), 1962, pp. 181–186. DOI.
  • C. Derman, On Sequential Decisions and Markov Chains, Management Science 9(1), 1962, pp. 16–24. DOI.
  • J. Cohen, E. Rosenfeld, and Z. Kolter, Certified Adversarial Robustness via Randomized Smoothing, ICML, 2019. arXiv.
6 thms1 active userReviewed
CombinatoricsOperations ResearchOptimization·Captain: mikedeng1

Optimization and Approximation in Deterministic Sequencing and Scheduling: A Survey 2: The Optimal Preemptive Open Shop Makespan Equals the Largest Machine Load or Job LengthResearch Paper

Motivation

Open shops model production and service systems in which every job must visit every machine, but the order of the visits is free: a car that needs an inspection, a wash and a tyre change, a patient who needs several tests, a student who sits several exams. The survey of Graham, Lawler, Lenstra and Rinnooy Kan (Ann. Discrete Math. 5, 1979) fixed the three-field notation α∣β∣γ\alpha|\beta|\gammaα∣β∣γ that the scheduling literature still uses, and classified the complexity of the problems it can express. Among the polynomially solvable cases, the preemptive open shop with makespan objective, O∣pmtn∣Cmax⁡O|pmtn|C_{\max}O∣pmtn∣Cmax​, is one of the few multi-machine problems whose optimal value has a closed form for any number of machines and jobs.

Timeline.

  • 1976: Gonzalez and Sahni (J. ACM 23) prove that the optimal preemptive open-shop makespan is the largest machine load or job length, and give a polynomial algorithm. In the same paper they solve O2∥Cmax⁡O2\|C_{\max}O2∥Cmax​ in linear time and show O3∥Cmax⁡O3\|C_{\max}O3∥Cmax​ NP-hard.
  • 1978: Lawler and Labetoulle (J. ACM 25) give a linear-programming treatment of preemptive scheduling on unrelated machines and reformulate the open-shop construction in terms of decrementing sets, found by an assignment problem through the Birkhoff–von Neumann theorem.
  • 1979: the survey (§5.2.2, p. 313) presents this construction as the standard argument and records the O(r+min⁡{m4,n4,r2})O(r+\min\{m^4,n^4,r^2\})O(r+min{m4,n4,r2}) bound of Gonzalez (1976), where rrr is the number of nonzero processing times.

Setting

There are mmm machines M1,…,MmM_1,\dots,M_mM1​,…,Mm​ and nnn jobs J1,…,JnJ_1,\dots,J_nJ1​,…,Jn​. Job JjJ_jJj​ consists of operations O1j,…,OmjO_{1j},\dots,O_{mj}O1j​,…,Omj​; operation OijO_{ij}Oij​ must be processed on machine MiM_iMi​ for pij≥0p_{ij}\ge 0pij​≥0 time units. The processing-time matrix is P=(pij)P=(p_{ij})P=(pij​): its rows are machines and its columns are jobs. Every job is available at time 000.

Preemption is allowed: an operation may be interrupted and resumed later. A schedule is a finite list of pieces (i,j,s,e)(i,j,s,e)(i,j,s,e), each meaning that MiM_iMi​ processes JjJ_jJj​ during [s,e)[s,e)[s,e). A schedule is feasible if

  1. every piece satisfies 0≤s≤e0\le s\le e0≤s≤e;
  2. each machine processes at most one job at a time, and each job is processed on at most one machine at a time: two pieces that share a machine or a job do not overlap;
  3. for every pair (i,j)(i,j)(i,j) the pieces of OijO_{ij}Oij​ have total length exactly pijp_{ij}pij​.

The makespan Cmax⁡C_{\max}Cmax​ is the time at which the last piece ends, and Cmax⁡∗C^*_{\max}Cmax∗​ is its minimum over feasible schedules. The load of machine MiM_iMi​ is the row sum ∑jpij\sum_j p_{ij}∑j​pij​, the length of job JjJ_jJj​ is the column sum ∑ipij\sum_i p_{ij}∑i​pij​, and

C=max⁡{max⁡j∑ipij, max⁡i∑jpij}.C=\max\Big\{\max_j \sum_i p_{ij},\ \max_i \sum_j p_{ij}\Big\}.C=max{jmax​i∑​pij​, imax​j∑​pij​}.

A row or column is tight if its sum equals CCC and slack otherwise. A decrementing set is a set SSS of strictly positive entries of PPP with exactly one element in each tight row and each tight column and at most one in each slack row and each slack column.

Formalization targets

Goal: Cmax⁡∗=CC^*_{\max}=CCmax∗​=C

For every T≥0T\ge 0T≥0,

(∃ feasible schedule with Cmax⁡≤T)  ⟺  (∑jpij≤T ∀i  and  ∑ipij≤T ∀j).\big(\exists \text{ feasible schedule with } C_{\max}\le T\big)\iff \Big(\sum_j p_{ij}\le T\ \forall i\ \text{ and }\ \sum_i p_{ij}\le T\ \forall j\Big).(∃ feasible schedule with Cmax​≤T)⟺(j∑​pij​≤T ∀i  and  i∑​pij​≤T ∀j).

This says that the optimal makespan is exactly the largest machine load or job length, and that it is attained.

Milestones (all from §5.2.2, p. 313)

  1. Lower bound Cmax⁡∗≥CC^*_{\max}\ge CCmax∗​≥C.
  2. Existence of a decrementing set for every nonzero nonnegative PPP.
  3. Positive step: for a decrementing set, the largest δ\deltaδ satisfying the constraints (1)–(3) of the survey exists and is positive.
  4. Step property: after replacing each pij∈Sp_{ij}\in Spij​∈S by max⁡{0,pij−δ}\max\{0,p_{ij}-\delta\}max{0,pij​−δ}, the largest line sum is exactly C−δC-\deltaC−δ.
  5. Partial schedule: for each pij∈Sp_{ij}\in Spij​∈S, MiM_iMi​ processes JjJ_jJj​ for min⁡{pij,δ}\min\{p_{ij},\delta\}min{pij​,δ} time units, with no machine or job used twice.
  6. Termination: every run of the procedure reaches P′=(0)P'=(0)P′=(0) within a bounded number of stages.
  7. Joining: the concatenated partial schedules form a feasible schedule with Cmax⁡≤CC_{\max}\le CCmax​≤C.

Significance

The result. The theorem turns an optimization over continuous-time schedules into the computation of m+nm+nm+n sums. It certifies optimality by a counting argument, it is the base case for preemptive open shops with release dates and due dates, and it is used elsewhere in the survey (§4.4.6) to reduce problems on unrelated machines with preemption to open-shop instances. Because a nonnegative matrix whose row and column sums are all equal is a multiple of a doubly stochastic matrix, the theorem is a scheduling form of the Birkhoff–von Neumann decomposition. It also underlies timetabling and edge-colouring results for bipartite multigraphs.

Formalizing it. The theorem has been proved since 1976 and is textbook material. No machine-checked proof is known to exist: Mathlib has the Birkhoff–von Neumann theorem for doubly stochastic matrices but no model of open-shop schedules. A formalization adds a reusable model of preemptive multi-machine schedules with both disjointness requirements, a checked proof of the decrementing-set construction, and a termination argument the survey asserts without proof.

Difficulty

The lower bound is a one-line counting argument. The difficulty is the construction of a schedule of length exactly CCC. Scheduling each machine's operations back to back gives length max⁡i∑jpij\max_i\sum_j p_{ij}maxi​∑j​pij​, but may run one job on two machines at once. Scheduling job by job has the symmetric defect. A greedy list schedule that only respects both constraints can leave machines idle and overshoot CCC. The construction must keep every tight line busy at every moment while never letting a slack line fall behind. The existence of the decrementing set at each stage is the combinatorial core: it is a Hall-type matching condition, not a local choice. Termination is also not automatic, because a careless choice of step length can produce infinitely many shrinking steps.

Formalization scope

All objects live in the namespace SchedSurvey.OPmtn. Machines and jobs are Fin m and Fin n, both 0-based, and processing times and piece endpoints are real numbers; integer data are a special case. A schedule is a List of pieces. Feasibility requires nonnegative start times, disjointness for pieces sharing a machine or a job (touching intervals allowed), and exactly pijp_{ij}pij​ units of processing for every pair (i,j)(i,j)(i,j). Every theorem assumes pij≥0p_{ij}\ge 0pij​≥0.

"CCC is the maximum" is the predicate IsMaxLoad P C: all line sums are at most CCC and one equals CCC. The goal is stated in threshold form and mentions no maximum at all. The display defining CCC on p. 313 prints max⁡i{∑ipij}\max_i\{\sum_i p_{ij}\}maxi​{∑i​pij​} for the second term; the following sentence shows it means the row sums ∑jpij\sum_j p_{ij}∑j​pij​, and the formalization uses those. The hypothesis T≥0T\ge 0T≥0 matters only for P=0P=0P=0, where the empty schedule finishes by every TTT.

A trivializing formalization is ruled out: the goal mentions neither decrementing sets nor δ\deltaδ. Its "if" direction asserts that a schedule exists. Feasibility counts work per pair (machine, job), not per job, and forbids a job from running on two machines at once. Without either requirement the statement would be a different and easier theorem.

A complete development needs: list sums of interval lengths over disjoint intervals, the existence of decrementing sets (via Birkhoff–von Neumann, König's theorem or Hall's theorem on the bipartite graph of positive entries), the step and termination lemmas, and concatenation of schedules. The schedule model and the decrementing-set lemma are reusable for other preemptive shop problems. Contributions of alternative proofs of any milestone, for example a direct Hall-theorem proof of the existence of decrementing sets, are welcome.

Selected references

  • R. L. Graham, E. L. Lawler, J. K. Lenstra, A. H. G. Rinnooy Kan, Optimization and approximation in deterministic sequencing and scheduling: a survey, Annals of Discrete Mathematics 5 (1979) 287–326. https://doi.org/10.1016/S0167-5060(08)70356-X
  • T. Gonzalez, S. Sahni, Open shop scheduling to minimize finish time, Journal of the ACM 23 (1976) 665–679. https://doi.org/10.1145/321978.321985
  • E. L. Lawler, J. Labetoulle, On preemptive scheduling of unrelated parallel processors by linear programming, Journal of the ACM 25 (1978) 612–619. https://doi.org/10.1145/322077.322090
9 thms1 active userReviewed
🏆Completed
CombinatoricsOperations ResearchTheoretical Computer Science·Captain: mikedeng1

Bounds on Multiprocessing Timing Anomalies 1: Changing the List, Relaxing the Order, Shortening the Tasks and Using n′ Processors Multiplies the Finishing Time by at Most 1 + (n − 1)/n′Research Paper

Motivation

Scheduling work on several identical processors creates a plausible expectation: completing tasks sooner, removing constraints, or adding a processor should not delay the overall finish. A fixed priority-list rule defeats that expectation. When a task becomes ready earlier, it can occupy a processor that would otherwise have run another task; that decision changes later availability. Graham gives explicit schedules in which changing only the list raises the finishing time from 12 to 14, removing two precedence constraints raises it to 16, shortening every task raises it to 13, or adding one processor raises it to 15. These examples establish that the effect is a property of the scheduling rule, rather than of a change in the total set of tasks. See Graham, §2, pp. 417–419.

This mission concerns the upper limit of that effect. An operations researcher comparing a list schedule before and after a change in available processors or task data needs a bound that survives all four changes at once. The result is also a compact benchmark for formalizing algorithms whose behavior depends on changing availability: the model must describe when tasks become ready, when processors are idle, and which ready task a processor takes next. Graham's Theorem 1, proved in the 1969 paper, supplies the bound.

Setting

There are rrr tasks T1,…,TrT_1,\ldots,T_rT1​,…,Tr​ and nnn identical processors. Each task TjT_jTj​ has a positive processing time μ(Tj)\mu(T_j)μ(Tj​). A strict precedence order ≺\prec≺ specifies tasks that must be completed first: Ti≺TjT_i\prec T_jTi​≺Tj​ means TjT_jTj​ cannot start before TiT_iTi​ ends. A priority list LLL orders all tasks once each. It may place a successor before a predecessor, because the processor skips any task that is not ready. These conventions are those of Graham's system in §2, p. 416.

A schedule gives each task a processor and a start time Sj≥0S_j\ge0Sj​≥0. Once started, the task occupies that processor continuously on [Sj,Sj+μ(Tj))[S_j,S_j+\mu(T_j))[Sj​,Sj​+μ(Tj​)). Two tasks on one processor cannot overlap, while tasks may meet at an endpoint. Precedence means Si+μ(Ti)≤SjS_i+\mu(T_i)\le S_jSi​+μ(Ti​)≤Sj​ whenever Ti≺TjT_i\prec T_jTi​≺Tj​. The finishing time ω\omegaω is the largest completion time Sj+μ(Tj)S_j+\mu(T_j)Sj​+μ(Tj​). The paper's list rule starts the first currently ready task in LLL whenever a processor can take a task. A ready task that has not started cannot coexist with an idle processor. If one task starts while another ready task waits, the started task is earlier in LLL.

The same task set is run a second time, with processing times μ′\mu'μ′, order ≺′\prec'≺′, list L′L'L′, processor count n′n'n′, and finishing time ω′\omega'ω′. The data satisfy μ′(Tj)≤μ(Tj)\mu'(T_j)\le\mu(T_j)μ′(Tj​)≤μ(Tj​) for every jjj and ≺′⊆≺\prec'\subseteq\prec≺′⊆≺. Thus the second run may have shorter tasks and fewer precedence relations; both lists may differ arbitrarily. Both runs obey the same list-scheduling rule Graham, §3, p. 419.

Formalization targets

General anomaly bound

For r,n,n′≥1r,n,n'\ge1r,n,n′≥1, positive processing times in both runs, and the two list schedules just described, the target is Graham's Theorem 1:

ω′ω≤1+n−1n′.\frac{\omega'}{\omega}\le 1+\frac{n-1}{n'}.ωω′​≤1+n′n−1​.

The numerator and denominator refer to the actual runs, with potentially different lists and processor counts. The conclusion does not require the new schedule to finish earlier. Its factor permits the anomalies shown in §2 while preventing an arbitrarily large increase for fixed n,n′n,n'n,n′. The supporting targets follow the proof's numbered displays: a precedence chain covering idle times in the second run (1), an idle-time estimate for that chain (2), a comparison of its length with the first run (3)–(4), and the work-volume bound used in (5) Graham, pp. 419–420.

Significance

The theorem places a quantitative limit on the damage caused by a list rule after simultaneous changes in task durations, precedence, ordering, and capacity. When n′=nn'=nn′=n, the factor is 2−1/n2-1/n2−1/n; when the first run has one processor, it is 111. The statement applies to every finite task set and every pair of lists, so it can be reused when a scheduling method produces a list without additional structural guarantees. Graham states that the bound is best possible, citing earlier examples; this mission formalizes the inequality in this paper and does not claim to formalize those external examples Graham, p. 420.

The result is proved in the source paper. The work here is to give its objects precise Lean definitions and to supply machine-checked proofs of the bound and its supporting claims. A formal development needs to account for continuous real start times, processor assignments, half-open execution intervals, and the behavior of the list rule when several tasks or processors become available together. The resulting model of a nonpreemptive list schedule and the basic volume and chain estimates can serve later formalizations of parallel scheduling. The present proposal contains statements and definitions; its theorem bodies are open proof obligations.

Difficulty

Total work alone does not control the anomaly: processors can be idle while precedence keeps available work from starting, and changing precedence can alter which tasks occupy the processors later. A direct comparison of corresponding task completion times between the two runs also fails in Graham's §2 examples. The central difficulty is expressing the second run's idle periods through work on a single precedence chain and then relating that chain to the first run's finishing time. In Lean, the chain and the time intervals must be represented without silently changing endpoint conventions or treating a ready but unstarted task as running.

Formalization scope

Tasks are Fin r and processors are Fin n, with zero-based Lean indices corresponding to Graham's one-based subscripts. Processing times and start times are real. A priority list is a bijection between positions and tasks, so it contains every task exactly once and need not respect precedence. The order is strict. Feasible schedules are nonpreemptive and use half-open running intervals. The finishing time is a finite maximum of completion times; for no tasks it is defined as zero, while the ratio theorem assumes r>0r>0r>0 so its denominator is positive. Both processor counts are positive. The strict positivity of both time functions is inherited from the paper's μ:T→(0,∞)\mu:T\to(0,\infty)μ:T→(0,∞) convention.

The model captures Graham's rule by no unforced idleness and list priority. It does not encode the smaller-index tie rule for identical processors, since the tie affects only processor labels and not start times or ω\omegaω. The covering-chain milestone represents Graham's set BBB as times before ω′\omega'ω′ when not all processors are busy; all-idle times before the finish cannot occur under the list rule. The idle-time milestone writes the total duration of empty tasks as n′ω′−∑jμ′(Tj)n'\omega'-\sum_j\mu'(T_j)n′ω′−∑j​μ′(Tj​) using display (5). Natural-number subtraction is not used in the constants: n−1n-1n−1 and n′−1n'-1n′−1 are real differences. The companion existence statement and a concrete two-task sanity check rule out a vacuous list-schedule predicate. Contributions can address that existence theorem, the chain construction, interval accounting, the volume bound, and the final ratio.

Selected references

  • R. L. Graham, Bounds on Multiprocessing Timing Anomalies, SIAM Journal on Applied Mathematics 17(2), 416–429, 1969. DOI: 10.1137/0117039.
7 thms2 active usersReviewed
🏆Completed
CombinatoricsGraph TheoryOperations Research·Captain: mikedeng1

On Representatives of Subsets: Two Partitions into m Classes Have a Common System of Representatives When Any k Classes of One Meet at Least k Classes of the OtherResearch Paper

Motivation

Many assignment questions reduce to one combinatorial question: given finitely many sets, can one choose a different element from each? Workers are matched to jobs they are qualified for, rows of a matrix to columns with nonzero entries. The criterion for when this is possible is Hall's marriage theorem, first stated and proved by P. Hall in a five-page note in 1935 (DOI 10.1112/jlms/s1-10.37.26). It underlies bipartite matching, the integrality of the assignment polytope, the Birkhoff–von Neumann theorem on doubly stochastic matrices, and transversal theory in matroids.

Hall's note was written with a second question in view. In 1916 D. König proved, in the language of bipartite graphs, that if a set of mnmnmn things is divided into mmm classes of nnn things in two ways, then one can choose mmm things that represent every class of both divisions at once ("Über Graphen und ihre Anwendungen", Math. Annalen 77 (1916), 453). Van der Waerden (1927) and Sperner (1927) gave the set-theoretic form and a short proof. Hall's contribution was a criterion for a common system of representatives of two divisions in which the classes need not have equal sizes, obtained from the marriage theorem in two short steps.

Setting

Let SSS be any set, finite or infinite, and let

T1,T2,…,Tm(1)T_1, T_2, \dots, T_m \tag{1}T1​,T2​,…,Tm​(1)

be a finite system of subsets of SSS. The sets TiT_iTi​ may be infinite and need not be distinct; when one speaks of kkk of the sets, kkk indices are meant, so a repeated set is counted with multiplicity. A complete set of distinct representatives, or C.D.R., of (1) is a choice of pairwise distinct elements a1,…,ama_1, \dots, a_ma1​,…,am​ of SSS with

ai∈Ti(i=1,…,m).a_i \in T_i \qquad (i = 1, \dots, m).ai​∈Ti​(i=1,…,m).

The system satisfies Hall's condition when any kkk of the sets contain between them at least kkk elements of SSS, for k=1,…,mk = 1, \dots, mk=1,…,m. The meet of all C.D.R.s, written RRR, is the set of elements of SSS that occur as a representative in every C.D.R. of (1).

A division of SSS into classes is a family of pairwise disjoint sets S1,S2,…S_1, S_2, \dotsS1​,S2​,… whose union is SSS. The paper writes A∧BA \wedge BA∧B and A∨BA \vee BA∨B for intersection and union; this mission writes A∩BA \cap BA∩B and A∪BA \cup BA∪B.

In Lean the system is T : ι → Set α over a finite index type, a C.D.R. is an injective a : ι → α with a i ∈ T i (IsCDR), Hall's condition is HallCondition, and the meet of all C.D.R.s is cdrMeet, all in the namespace HallReps.CDR.

Formalization targets

Goal: Theorem 3 (pp. 29–30)

Let SSS be divided into mmm classes in two ways, S=S1∪⋯∪Sm=S1′∪⋯∪Sm′S = S_1 \cup \dots \cup S_m = S_1' \cup \dots \cup S_m'S=S1​∪⋯∪Sm​=S1′​∪⋯∪Sm′​, each a division into pairwise disjoint classes. If, for each kkk, any kkk of the classes Sj′S_j'Sj′​ contain between them elements from at least kkk of the classes SiS_iSi​, then for some permutation σ\sigmaσ of {1,…,m}\{1, \dots, m\}{1,…,m} there are elements

ai∈Si∩Sσ(i)′(i=1,…,m).a_i \in S_i \cap S'_{\sigma(i)} \qquad (i = 1, \dots, m).ai​∈Si​∩Sσ(i)′​(i=1,…,m).

The set SSS and the classes may be infinite, and no class is assumed non-empty.

Milestones

  1. Lemma (p. 27). If aaa is a C.D.R. of (1) and RRR is the meet of all C.D.R.s, the sets TiT_iTi​ whose representative aia_iai​ lies in RRR contain between them exactly the elements of RRR, and there are ∣R∣|R|∣R∣ of them.
  2. Induction step, p. 28. With (4) the system T1,…,Tm−1T_1, \dots, T_{m-1}T1​,…,Tm−1​ and R∗R^*R∗ the meet of its C.D.R.s: if Tm⊈R∗T_m \not\subseteq R^*Tm​⊆R∗, then (1) has a C.D.R.
  3. Induction step, p. 29. If (4) has a C.D.R. and Tm⊆R∗T_m \subseteq R^*Tm​⊆R∗, then some ρ+1\rho + 1ρ+1 of the sets, including TmT_mTm​, have union exactly R∗R^*R∗, where ρ=∣R∗∣\rho = |R^*|ρ=∣R∗∣.
  4. Theorem 1 (p. 27). Hall's condition is sufficient for a C.D.R. of (1).
  5. Theorem 2 (p. 29). If SSS is divided into any number of classes and any kkk of the sets TiT_iTi​ contain between them elements from at least kkk classes, there are ai∈Tia_i \in T_iai​∈Ti​ lying in pairwise different classes.

A companion item states König's theorem (§1, p. 26), which the paper deduces from Theorem 3 on p. 30.

Significance

Theorem 3 gives a necessary and sufficient criterion for two partitions of a set into mmm classes to admit a common system of representatives. Necessity is immediate, and the paper proves sufficiency. It contains König's theorem, and through it the statement that a regular bipartite multigraph has a perfect matching, as the case of equal class sizes. Hall remarks that R. Rado's generalization of König's theorem (1933) also follows. Theorem 2, the passage from "distinct elements" to "elements of distinct classes", is the form used for transversals of partitions and is the first instance of what later became the theory of common transversals and matroid intersection.

On the formal side, Hall's theorem for finite sets is in Mathlib as Finset.all_card_le_biUnion_card_iff_existsInjective' (in Mathlib/Combinatorics/Hall/Finite.lean), and the platform already has a proved equivalence for arbitrary sets with a finite index type (YogeshwaranDM.sdr_iff, included in this mission as a reference item) as well as finite bipartite-graph forms. For that reason Theorem 1 is a milestone and not the goal. What this mission adds is Hall's own proof structure, namely the meet of all C.D.R.s and the Lemma about it, which has not been formalized; Theorems 2 and 3 for divisions of a possibly infinite set; and König's theorem in its set-partition form. To our knowledge none of these statements has a machine-checked proof on the platform.

Difficulty

Theorem 3 does not follow from Theorem 1 applied to the classes Sj′S_j'Sj′​ directly. Theorem 1 produces distinct elements, but the conclusion needs elements in distinct classes SiS_iSi​, and two distinct elements of Sj′S_j'Sj′​ may lie in the same SiS_iSi​. The paper's route goes through Theorem 2, which allows any number of classes. That route needs Theorem 1 for systems whose sets can be infinite, because a single TiT_iTi​ may meet infinitely many classes, so the finite-set version of Hall's theorem in Mathlib is not enough on its own. In Hall's own proof of Theorem 1, the work lies in the Lemma. It is an exchange statement about all C.D.R.s at once, whose object RRR is defined by a universal quantifier over C.D.R.s, and it must be established over an arbitrary finite index type with possibly infinite sets.

Formalization scope

  • The ground set is a type α, with no finiteness or decidability assumed. The system (1) is T : ι → Set α with [Finite ι] (or Fin (m + 1) in the two induction steps, where the paper's mmm is the Lean m + 1, its last set is T (Fin.last m), and (4) is fun i : Fin m => T i.castSucc).
  • Cardinalities of unions of the TiT_iTi​ are Set.encard in ℕ∞, so an infinite union counts as infinite. Set.ncard is used only for subsets of Fin m, for the finite set R∗R^*R∗ (with its finiteness stated), and in König's theorem.
  • "kkk of the sets" is a Finset ι of indices, so repeated sets count with multiplicity.
  • Divisions into classes are class maps: cls : α → κ in Theorem 2, with κ arbitrary, and p q : α → Fin m in Theorem 3 and König's theorem. A class map makes the classes cover SSS and be pairwise disjoint by construction. Empty classes are allowed.
  • In Theorem 3 the permutation is existential and chosen together with the representatives. ai∈Si∩Sσ(i)′a_i \in S_i \cap S'_{\sigma(i)}ai​∈Si​∩Sσ(i)′​ is p (a i) = i ∧ q (a i) = σ i.
  • Added or dropped hypotheses: the Lemma assumes a C.D.R. exists, as the page does (without one, cdrMeet is all of α). The first induction step omits the page's C.D.R. of (4), because its hypothesis already implies one. König's theorem adds 0<n0 < n0<n, which the page presumes and without which the statement is false.
  • The trivializing formalizations are ruled out. Typing the TiT_iTi​ as Finset α would reduce Theorem 1 to Mathlib and lose the page's "It is not necessary that the sets TiT_iTi​ shall be finite". Measuring unions by ncard would make Hall's condition fail exactly when a union is infinite. An infinite index type would make Theorem 1 and the Lemma false. None of these is used.
  • Useful contributions include proofs of the Lemma and of the induction steps, a proof of Theorem 1 either from them or from Mathlib's Hall theorem via a reduction to finite sets, and the reductions Theorem 1 → Theorem 2 → Theorem 3 → König.

Selected references

  • P. Hall, On representatives of subsets, J. London Math. Soc. 10 (1935), 26–30. https://doi.org/10.1112/jlms/s1-10.37.26
  • D. König, Über Graphen und ihre Anwendungen auf Determinantentheorie und Mengenlehre, Math. Annalen 77 (1916), 453–465. https://doi.org/10.1007/BF01456961
  • B. L. van der Waerden, Ein Satz über Klasseneinteilungen von endlichen Mengen, Abh. Math. Sem. Hamburg 5 (1927), 185–188. https://doi.org/10.1007/BF02952519
  • R. Rado, Bemerkungen zur Kombinatorik im Anschluss an Untersuchungen von Herrn D. König, Sitzungsber. Berliner Math. Ges. 32 (1933), 60–75.
  • Mathlib, Mathlib/Combinatorics/Hall/Finite.lean and Mathlib/Combinatorics/Hall/Basic.lean. https://github.com/leanprover-community/mathlib4
8 thms3 active usersReviewed
Convex OptimizationOperations ResearchOptimization+1·Captain: mikedeng1

Deterministic Equivalents for Optimizing and Satisficing under Chance Constraints 1: Under Normality, the E-Model Chance Constraints Are Equivalent to the Convex Program (29)Research Paper

Motivation

Chance-constrained programming replaces a linear program max⁡c′x\max c'xmaxc′x subject to Ax≤bAx\le bAx≤b by a problem in which some data are random and each constraint only has to hold with a prescribed probability. Charnes and Cooper introduced the idea in 1959 for scheduling heating-oil production against weather-dependent demand, and the formulation is now a standard modelling tool in operations research, finance, energy systems and engineering design (Charnes and Cooper 1959; Prékopa 1995).

A chance-constrained problem is not directly solvable: its constraints are probabilities of events that depend on the decision. The 1963 paper of Charnes and Cooper (doi:10.1287/opre.11.1.18) asks when such a problem has a deterministic equivalent, an ordinary mathematical program with the same feasible decisions and corresponding objective values, and when that equivalent is a convex program. Its first answer, for the expected-value ('E') model under linear decision rules and normality, is the subject of this mission. The resulting constraint form, a mean slack dominating KαK_\alphaKα​ standard deviations, is an early instance of the second-order-cone reformulation of individual normal chance constraints used throughout modern stochastic and robust optimization.

Timeline. 1959: Charnes and Cooper, chance-constrained programming with the heating-oil model. 1963: this paper, deterministic equivalents for the E, V and P models under linear decision rules x=Dbx=Dbx=Db. 1965: Miller and Wagner treat joint chance constraints with independent rows (doi:10.1287/opre.13.6.930). 1971: Prékopa's logarithmically concave measures give convexity of joint chance constraints under log-concave laws.

Setting

Let (Ω,F,P)(\Omega,\mathcal F,P)(Ω,F,P) be a probability space. The data are a constant m×nm\times nm×n matrix AAA with rows a1′,…,am′a_1',\dots,a_m'a1′​,…,am′​, a random right-hand side b:Ω→Rmb:\Omega\to\mathbb R^mb:Ω→Rm and random objective coefficients c:Ω→Rnc:\Omega\to\mathbb R^nc:Ω→Rn. A linear decision rule is an n×mn\times mn×m real matrix DDD; it chooses x=Dbx=Dbx=Db after bbb is observed. Write μb=Eb\mu_b=Ebμb​=Eb, μc=Ec\mu_c=Ecμc​=Ec and b^=b−μb\hat b=b-\mu_bb^=b−μb​.

The E-model (18) is

max⁡ E(c′Db)subject toP(ai′Db≤bi)≥αi(i=1,…,m),\max\ E(c'Db)\quad\text{subject to}\quad P(a_i'Db\le b_i)\ge\alpha_i\qquad(i=1,\dots,m),max E(c′Db)subject toP(ai′​Db≤bi​)≥αi​(i=1,…,m),

with one probability level αi\alpha_iαi​ per row: the constraints are row-wise, as in (3) of the paper, not a single joint constraint.

For 12<α<1\tfrac12<\alpha<121​<α<1 let Kα=Φ−1(α)>0K_\alpha=\Phi^{-1}(\alpha)>0Kα​=Φ−1(α)>0 be the standard normal α\alphaα-quantile. With the moment functions (30),

σi2(D)=E(ai′Db−bi)2,μi(D)=μbi−ai′Dμb,\sigma_i^2(D)=E(a_i'Db-b_i)^2,\qquad \mu_i(D)=\mu_{b_i}-a_i'D\mu_b,σi2​(D)=E(ai′​Db−bi​)2,μi​(D)=μbi​​−ai′​Dμb​,

the paper's deterministic program (29) in the variables (D,v)(D,v)(D,v), v∈Rmv\in\mathbb R^mv∈Rm, is

min⁡ −μc′Dμbs.t.μi(D)−vi≥0,−Kαi2σi2(D)+Kαi2μi2(D)+vi2≥0,vi≥0.\min\ -\mu_c'D\mu_b\quad\text{s.t.}\quad \mu_i(D)-v_i\ge0,\quad -K_{\alpha_i}^2\sigma_i^2(D)+K_{\alpha_i}^2\mu_i^2(D)+v_i^2\ge0,\quad v_i\ge0 .min −μc′​Dμb​s.t.μi​(D)−vi​≥0,−Kαi​2​σi2​(D)+Kαi​2​μi2​(D)+vi2​≥0,vi​≥0.

Formalization targets

Goal: (18) is equivalent to the convex program (29)

Assume every bkb_kbk​ is square integrable, every cjc_jcj​ and cjbkc_jb_kcj​bk​ integrable, bbb and ccc uncorrelated (E(cjbk)=Ecj EbkE(c_jb_k)=E c_j\,E b_kE(cj​bk​)=Ecj​Ebk​), every variate ai′Db−bia_i'Db-b_iai′​Db−bi​ normal (for every DDD and iii, zero variance allowed), and 12<αi<1\tfrac12<\alpha_i<121​<αi​<1. Then

(∀D: D feasible for (18)  ⟺  ∃v, (D,v) feasible for (29)) ∧ (∀D: E(c′Db)=μc′Dμb) ∧ {(D,v) feasible for (29)} is convex.\Big(\forall D:\ D\text{ feasible for (18)}\iff\exists v,\ (D,v)\text{ feasible for (29)}\Big)\ \wedge\ \Big(\forall D:\ E(c'Db)=\mu_c'D\mu_b\Big)\ \wedge\ \{(D,v)\ \text{feasible for (29)}\}\ \text{is convex}.(∀D: D feasible for (18)⟺∃v, (D,v) feasible for (29)) ∧ (∀D: E(c′Db)=μc′​Dμb​) ∧ {(D,v) feasible for (29)} is convex.

Milestones, in the order of the paper

  1. (19a): E(c′Db)=(Ec)′D(Eb)E(c'Db)=(Ec)'D(Eb)E(c′Db)=(Ec)′D(Eb) for uncorrelated bbb, ccc.
  2. (22)–(27): with positive variance, P(ai′Db≤bi)≥αi  ⟺  (−μbi+ai′Dμb)/E[b^i−ai′Db^]2≤−KαiP(a_i'Db\le b_i)\ge\alpha_i\iff(-\mu_{b_i}+a_i'D\mu_b)/\sqrt{E[\hat b_i-a_i'D\hat b]^2}\le-K_{\alpha_i}P(ai′​Db≤bi​)≥αi​⟺(−μbi​​+ai′​Dμb​)/E[b^i​−ai′​Db^]2​≤−Kαi​​.
  3. (28a)–(28b): (27) holds iff some viv_ivi​ satisfies μbi−ai′Dμb≥vi≥KαiE[b^i−ai′Db^]2≥0\mu_{b_i}-a_i'D\mu_b\ge v_i\ge K_{\alpha_i}\sqrt{E[\hat b_i-a_i'D\hat b]^2}\ge0μbi​​−ai′​Dμb​≥vi​≥Kαi​​E[b^i​−ai′​Db^]2​≥0.
  4. (28c)–(28d): for vi≥0v_i\ge0vi​≥0, that pair is equivalent to its squared form.
  5. Footnote ‡ to (30): σi2(D)−μi2(D)=E[b^i−ai′Db^]2\sigma_i^2(D)-\mu_i^2(D)=E[\hat b_i-a_i'D\hat b]^2σi2​(D)−μi2​(D)=E[b^i​−ai′​Db^]2.
  6. The convexity paragraph after (30): the feasible set of (29) is convex in (D,v)(D,v)(D,v).
  7. 'V Model' (32)–(34): under the same normal chance assumptions and square integrability of each cjbkc_jb_kcj​bk​, the chance constraints of (32) are equivalent to (33) for some vvv; the pair feasible set and V(D)=E(c′Db−z0)2V(D)=E(c'Db-z^0)^2V(D)=E(c′Db−z0)2 are convex.

Significance

The result. The theorem turns a problem whose constraints are probabilities into a finite-dimensional convex program whose data are the first two moments of bbb and the means of ccc. The optimal rules of (18) minimize (29), whose optimal value is the negative of the maximum in (18). The slack variables viv_ivi​ separate each constraint into a "quality" part (the mean slack μi(D)\mu_i(D)μi​(D)) and a "risk" part (KαiK_{\alpha_i}Kαi​​ standard deviations), which is the interpretation the paper develops in (31) and its Appendix. The same constraint set serves the V-model (33), so only the objective changes between the two models.

Formalizing it. The result is classical and its proof is elementary, but the paper's argument is informal in ways that matter for a machine-checked version: it divides by a standard deviation it then allows to vanish, writes FiF_iFi​ for what must be an upper-tail function, and labels a variance as σi2(D)\sigma_i^2(D)σi2​(D) while defining σi2(D)\sigma_i^2(D)σi2​(D) as a raw second moment. This mission produces a statement in which each of these points is settled, with every hypothesis explicit. No machine-checked version of the result is known to exist.

Difficulty

The chance-constraint step itself is a one-dimensional fact about the normal law, but three points need care. The variance of ai′Db−bia_i'Db-b_iai′​Db−bi​ may be zero for some DDD and iii; then the law is a point mass, the quotient in (27) is undefined, and the equivalence must be argued separately, as footnote † of p. 28 indicates. The quadratic constraint of (29) alone, vi2≥Kαi2(σi2(D)−μi2(D))v_i^2\ge K_{\alpha_i}^2(\sigma_i^2(D)-\mu_i^2(D))vi2​≥Kαi​2​(σi2​(D)−μi2​(D)), describes both nappes of a hyperboloid and is not convex; convexity needs vi≥0v_i\ge0vi​≥0 and the positive semidefiniteness of D↦Var⁡(ai′Db−bi)D\mapsto\operatorname{Var}(a_i'Db-b_i)D↦Var(ai′​Db−bi​), which comes from square integrability of bbb and not from normality. Finally, the identity relating σi2\sigma_i^2σi2​, μi2\mu_i^2μi2​ and the variance requires the integrals to be genuine, so the integrability hypotheses cannot be dropped.

Formalization scope

Everything is in the namespace ChanceDetEquiv.EModel. The probability space is (Ω, P) with [IsProbabilityMeasure P]; A : Matrix (Fin m) (Fin n) ℝ, b : Ω → Fin m → ℝ, c : Ω → Fin n → ℝ, D : Matrix (Fin n) (Fin m) ℝ; ai′Dba_i'Dbai′​Db is (A *ᵥ (D *ᵥ b ω)) i. Expectations are Bochner integrals and probabilities are P.real. Explicit readings of the paper's phrases:

  • "deterministic equivalent for (18)" is the conjunction of an iff between feasible sets (with the auxiliary vvv existentially quantified) and E(c′Db)=μc′DμbE(c'Db)=\mu_c'D\mu_bE(c′Db)=μc′​Dμb​ for every DDD; (29) minimizes the negative of this mean;
  • "is a convex programming problem" is Convex ℝ of the feasible set of (29) in (D,v)(D,v)(D,v), vi≥0v_i\ge0vi​≥0 included; for the V model it also asserts ConvexOn ℝ of VVV;
  • "normally distributed" is: for every DDD and iii, the law of ai′Db−bia_i'Db-b_iai′​Db−bi​ is gaussianReal μ s for some μ\muμ and s≥0s\ge0s≥0; joint normality of bbb is not assumed, since it would be a stronger hypothesis;
  • "bbb and ccc are uncorrelated" is E(cjbk)=Ecj EbkE(c_jb_k)=E c_j\,E b_kE(cj​bk​)=Ecj​Ebk​ for all j,kj,kj,k;
  • Kα=Φ−1(α)K_\alpha=\Phi^{-1}(\alpha)Kα​=Φ−1(α), using the published definition Cohen2019_Robust_Phi; FiF_iFi​ in (26)–(27) is read as the upper-tail function of ziz_izi​, and αi<1\alpha_i<1αi​<1 is added so that KαiK_{\alpha_i}Kαi​​ is finite;
  • σi2(D)\sigma_i^2(D)σi2​(D) is the raw second moment exactly as printed in (30).

Positive variance is a hypothesis of milestones 2 and 3, where (27) has a denominator. The goal and later milestones admit zero variance. The statements admit no trivializing reading: the normality hypothesis is satisfied by constant and by Gaussian bbb, the integrability hypotheses rule out the junk value 000 of non-integrable expectations, and αi<1\alpha_i<1αi​<1 rules out the junk value of Φ−1(1)\Phi^{-1}(1)Φ−1(1).

A complete development needs: the normal CDF and quantile, the law of an affine image of a random variable, variance as EX2−(EX)2E X^2-(EX)^2EX2−(EX)2 in L2L^2L2, and convexity of the epigraph of a seminorm composed with an affine map. The convexity milestones need no probability beyond L2L^2L2 and are reusable for any second-order-cone representation of individual chance constraints. Proofs of any milestone, and of the goal from the milestones, are welcome.

The related open platform item KallMayer.Chance.chapter2_theorem2_5 (convexity of a single normal chance-feasible set in xxx) is credited here and not restated: no item of this mission states the convexity of the set of DDD feasible for (18). Related published items that are about other models: DRCVRP.RCI.prob_le_iff_valueAtRisk_le (chance constraints and value-at-risk for a general law) and the log-concavity results of NumStochOpt.LogConcave.

Selected references

  • A. Charnes and W. W. Cooper, Deterministic Equivalents for Optimizing and Satisficing under Chance Constraints, Operations Research 11(1), 1963, 18–39. https://doi.org/10.1287/opre.11.1.18
  • A. Charnes and W. W. Cooper, Chance-Constrained Programming, Management Science 6(1), 1959, 73–79. https://doi.org/10.1287/mnsc.6.1.73
  • A. Prékopa, Stochastic Programming, Kluwer, 1995. https://doi.org/10.1007/978-94-017-3087-7
  • P. Kall and J. Mayer, Stochastic Linear Programming, 2nd ed., Springer, 2011. https://doi.org/10.1007/978-1-4419-7729-8
10 thms1 active userReviewed
Operations ResearchOptimizationProbability+1·Captain: mikedeng1

Statistics of Robust Optimization: A Generalized Empirical Likelihood Approach 3: Robust Optimal Values and Solution Sets over f-Divergence Balls Are ConsistentResearch Paper

Motivation

Stochastic optimization asks for a decision xxx in a set X⊂Rd\mathcal X\subset\mathbb R^dX⊂Rd that minimises an expected loss EP0[ℓ(x;ξ)]E_{P_0}[\ell(x;\xi)]EP0​​[ℓ(x;ξ)] when the distribution P0P_0P0​ of the data ξ\xiξ is known only through a sample ξ1,…,ξn\xi_1,\dots,\xi_nξ1​,…,ξn​. The classical estimator, sample average approximation, replaces P0P_0P0​ by the empirical distribution P^n\widehat P_nPn​. Distributionally robust optimization instead minimises the worst-case expected loss over all distributions close to P^n\widehat P_nPn​. Duchi, Glynn and Namkoong (arXiv:1610.03425v3; Math. Oper. Res. 46(3), 2021) take the neighbourhood to be an fff-divergence ball of radius ρ/n\rho/nρ/n and show that the robust optimal value is a calibrated upper confidence bound for the population optimum, in the spirit of Owen's empirical likelihood.

A confidence bound is useful only if the robust problem still estimates the right thing. Section 5 of the paper answers this: under essentially the conditions that make sample average approximation consistent, the robust optimal value converges to the population optimal value, and the robust minimisers approach the population minimisers. This mission formalizes that consistency result (contribution (iv), p. 3, and §5.1).

Setting

Let ξ1,ξ2,…\xi_1,\xi_2,\dotsξ1​,ξ2​,… be i.i.d. random elements of a separable metric space Ξ\XiΞ with law P0P_0P0​, and let P^n\widehat P_nPn​ be the empirical distribution of ξ1,…,ξn\xi_1,\dots,\xi_nξ1​,…,ξn​. Let ℓ:Rd×Ξ→R\ell:\mathbb R^d\times\Xi\to\mathbb Rℓ:Rd×Ξ→R be lower semicontinuous on X×Ξ\mathcal X\times\XiX×Ξ, with ℓ(x;⋅)\ell(x;\cdot)ℓ(x;⋅) measurable for x∈Xx\in\mathcal Xx∈X, and let X⊂Rd\mathcal X\subset\mathbb R^dX⊂Rd be a nonempty closed feasible set, as in the paper's opening setup (p. 1).

The divergence generator f:[0,∞)→R∪{+∞}f:[0,\infty)\to\mathbb R\cup\{+\infty\}f:[0,∞)→R∪{+∞} is convex with f(1)=0f(1)=0f(1)=0; Assumption A asks moreover that fff be three times differentiable near 111 with f′(1)=0f'(1)=0f′(1)=0 and f′′(1)=2f''(1)=2f′′(1)=2. For a distribution P≪P^nP\ll\widehat P_nP≪Pn​ with weights pip_ipi​ on the sample points, Df(P∥P^n)=1n∑if(npi)D_f(P\|\widehat P_n)=\frac1n\sum_i f(np_i)Df​(P∥Pn​)=n1​∑i​f(npi​). The robust objective and the population objective are

F^n(x)=sup⁡P≪P^n{EP[ℓ(x;ξ)]:Df(P∥P^n)≤ρn},F(x)=EP0[ℓ(x;ξ)],\widehat F_n(x)=\sup_{P\ll\widehat P_n}\Big\{E_P[\ell(x;\xi)] : D_f(P\|\widehat P_n)\le\frac{\rho}{n}\Big\},\qquad F(x)=E_{P_0}[\ell(x;\xi)],Fn​(x)=P≪Pn​sup​{EP​[ℓ(x;ξ)]:Df​(P∥Pn​)≤nρ​},F(x)=EP0​​[ℓ(x;ξ)],

with radius parameter ρ≥0\rho\ge0ρ≥0. Their solution sets are SP^n⋆=argmin⁡x∈XF^n(x)S^\star_{\widehat P_n}=\operatorname{argmin}_{x\in\mathcal X}\widehat F_n(x)SPn​⋆​=argminx∈X​Fn​(x) and SP0⋆=argmin⁡x∈XF(x)S^\star_{P_0}=\operatorname{argmin}_{x\in\mathcal X}F(x)SP0​⋆​=argminx∈X​F(x) (display (23)). The inclusion distance from a set AAA to a set BBB is d⊂(A,B)=sup⁡x∈Adist⁡(x,B)d_\subset(A,B)=\sup_{x\in A}\operatorname{dist}(x,B)d⊂​(A,B)=supx∈A​dist(x,B) (display (6)).

Assumption E asks for a measurable envelope Z≥0Z\ge0Z≥0 with ∣ℓ(x;ξ)∣≤Z(ξ)|\ell(x;\xi)|\le Z(\xi)∣ℓ(x;ξ)∣≤Z(ξ) for all x∈Xx\in\mathcal Xx∈X and EP0[Z1+ϵ]<∞E_{P_0}[Z^{1+\epsilon}]<\inftyEP0​​[Z1+ϵ]<∞ for some ϵ>0\epsilon>0ϵ>0. A class H\mathcal HH of functions on Ξ\XiΞ is Glivenko–Cantelli (Definition 2) if sup⁡h∈H∣EP^n[h]−EP0[h]∣→0\sup_{h\in\mathcal H}|E_{\widehat P_n}[h]-E_{P_0}[h]|\to0suph∈H​∣EPn​​[h]−EP0​​[h]∣→0 almost surely.

Formalization targets

Goal: Corollary 1 (p. 17)

Let Assumptions A and E hold, let X\mathcal XX be nonempty and compact, and let ℓ(⋅;ξ)\ell(\cdot;\xi)ℓ(⋅;ξ) be continuous on X\mathcal XX for every ξ\xiξ. Then, in outer probability,

inf⁡x∈XF^n(x)−inf⁡x∈XF(x)→P∗0andd⊂(SP^n⋆,SP0⋆)→P∗0.\inf_{x\in\mathcal X}\widehat F_n(x)-\inf_{x\in\mathcal X}F(x)\xrightarrow{P^*}0 \qquad\text{and}\qquad d_\subset\big(S^\star_{\widehat P_n},S^\star_{P_0}\big)\xrightarrow{P^*}0 .x∈Xinf​Fn​(x)−x∈Xinf​F(x)P∗​0andd⊂​(SPn​⋆​,SP0​⋆​)P∗​0.

Both conclusions belong to the goal. No rate is asserted; the statement survives any later sharpening.

Milestones

  1. Lemma 13 (p. 34): the likelihood-ratio vectors of the ball satisfy ∥np−1∥2≤ρCf\|np-\mathbb 1\|_2\le\sqrt{\rho C_f}∥np−1∥2​≤ρCf​​ uniformly in nnn, and the bound is of the right order (≥ρcf\ge\sqrt{\rho c_f}≥ρcf​​ for some n,pn,pn,p).
  2. (47) (App. E.1, p. 46): ∣EP[ℓ]−EP0[ℓ]∣≤EP^n[∣L−1∣p]1/pEP^n[∣ℓ∣q]1/q+∣EP^n[ℓ]−EP0[ℓ]∣|E_P[\ell]-E_{P_0}[\ell]|\le E_{\widehat P_n}[|L-1|^p]^{1/p}E_{\widehat P_n}[|\ell|^q]^{1/q}+|E_{\widehat P_n}[\ell]-E_{P_0}[\ell]|∣EP​[ℓ]−EP0​​[ℓ]∣≤EPn​​[∣L−1∣p]1/pEPn​​[∣ℓ∣q]1/q+∣EPn​​[ℓ]−EP0​​[ℓ]∣ with q=min⁡{2,1+ϵ}q=\min\{2,1+\epsilon\}q=min{2,1+ϵ}, p=max⁡{2,1+1/ϵ}p=\max\{2,1+1/\epsilon\}p=max{2,1+1/ϵ}.
  3. The display after (47) (p. 46): EP^n[∣L−1∣p]1/p≤n−1/pρCfE_{\widehat P_n}[|L-1|^p]^{1/p}\le n^{-1/p}\sqrt{\rho C_f}EPn​​[∣L−1∣p]1/p≤n−1/pρCf​​.
  4. Theorem 7 (p. 16): if {ℓ(x;⋅):x∈X}\{\ell(x;\cdot):x\in\mathcal X\}{ℓ(x;⋅):x∈X} is Glivenko–Cantelli, then
sup⁡x∈Xsup⁡P≪P^n{∣EP[ℓ(x;ξ)]−EP0[ℓ(x;ξ)]∣:Df(P∥P^n)≤ρn}→a.s.∗0.\sup_{x\in\mathcal X}\sup_{P\ll\widehat P_n}\Big\{|E_P[\ell(x;\xi)]-E_{P_0}[\ell(x;\xi)]| : D_f(P\|\widehat P_n)\le\tfrac{\rho}{n}\Big\}\xrightarrow{\text{a.s.}^*}0.x∈Xsup​P≪Pn​sup​{∣EP​[ℓ(x;ξ)]−EP0​​[ℓ(x;ξ)]∣:Df​(P∥Pn​)≤nρ​}a.s.∗​0.
  1. Example 5 (p. 16, from van der Vaart, Asymptotic Statistics, Example 19.8): a class of losses continuous on a compact X\mathcal XX for almost every ξ\xiξ, with an integrable envelope, is Glivenko–Cantelli.

Significance

The result. Corollary 1 shows that robustness against a ρ/n\rho/nρ/n-divergence perturbation of the data costs nothing asymptotically: the robust optimal value and its minimisers are consistent for the population problem. Together with the paper's coverage theorem, this justifies using the robust value both as a point estimate and as an upper confidence bound. Theorem 7 is stronger than what the corollary needs: it controls every reweighting in the ball uniformly over X\mathcal XX, which is the uniform law of large numbers for distributionally robust objectives, and it needs only slightly more than the first moment that sample average approximation needs.

Formalizing it. The results are proved in the paper; none is machine-checked. A formal development would supply a Glivenko–Cantelli notion for parametric loss classes, the bracketing argument behind Example 5 (a uniform strong law over a compact parameter set, not in Mathlib), and the passage from uniform convergence of objectives to convergence of optimal values and of argmin sets in the inclusion distance. The last two are standard steps of M-estimation and sample average approximation theory that are reusable well beyond this paper.

Difficulty

The obvious argument writes EP[ℓ]−EP0[ℓ]E_P[\ell]-E_{P_0}[\ell]EP​[ℓ]−EP0​​[ℓ] as a reweighting term plus the ordinary empirical deviation and handles the second by the Glivenko–Cantelli property. The reweighting term 1n∑i(npi−1)ℓ(x;ξi)\frac1n\sum_i(np_i-1)\ell(x;\xi_i)n1​∑i​(npi​−1)ℓ(x;ξi​) is the obstacle: the weights npinp_inpi​ are not bounded uniformly in nnn for every divergence, and a Cauchy–Schwarz bound would need a second moment of the envelope, which Assumption E does not provide. The exponent pair (p,q)(p,q)(p,q) and the uniform ℓ2\ell_2ℓ2​ control of Lemma 13 are what make 1+ϵ1+\epsilon1+ϵ moments enough.

For the solution sets, uniform convergence of F^n\widehat F_nFn​ to FFF does not by itself place the minimisers of F^n\widehat F_nFn​ near those of FFF; compactness of X\mathcal XX and continuity of FFF are needed to separate FFF on the complement of an ϵ\epsilonϵ-enlargement of SP0⋆S^\star_{P_0}SP0​⋆​ from its minimum. Measurability is a further obstacle: suprema over uncountable X\mathcal XX and over the divergence ball need not be measurable, which is why the paper works with outer probability and outer almost-sure convergence.

Formalization scope

  • Samples are ξ : ℕ → Ω → Ξ on a probability space, measurable, mutually independent (iIndepFun) and identically distributed with ξ 0; P0P_0P0​ is the law of ξ 0, and P^n\widehat P_nPn​ uses ξ 0, …, ξ (n-1) (0-based indices). The separable metric sample domain and lower semicontinuous loss from p. 1 are explicit in Theorem 7 and Corollary 1. Decisions live in EuclideanSpace ℝ (Fin d); ℓ x is measurable for each x∈Xx\in\mathcal Xx∈X.
  • fff is ℝ → EReal satisfying the published IsPhiDivergenceFunction (never −∞-\infty−∞, finite on (0,∞)(0,\infty)(0,∞), f(1)=0f(1)=0f(1)=0, convex on [0,∞)[0,\infty)[0,∞)) plus the smoothness of Assumption A, stated on t↦(f t).toRealt\mapsto(f\,t).\mathrm{toReal}t↦(ft).toReal on an open interval around 111.
  • A distribution P≪P^nP\ll\widehat P_nP≪Pn​ in the ball is a weight vector in the published probUncertaintySet f (1/n,…,1/n) (ρ/n), i.e. {p≥0:∑pi=1, ∑if(npi)≤ρ}\{p\ge0:\sum p_i=1,\ \sum_i f(np_i)\le\rho\}{p≥0:∑pi​=1, ∑i​f(npi​)≤ρ}. Every supremum "over PPP with Df(P∥P^n)≤ρ/nD_f(P\|\widehat P_n)\le\rho/nDf​(P∥Pn​)≤ρ/n" is read over P≪P^nP\ll\widehat P_nP≪Pn​, as in (4a).
  • Suprema of absolute deviations (Definition 2, Theorem 7) are taken in [0,∞][0,\infty][0,∞], and d⊂d_\subsetd⊂​ is [0,∞][0,\infty][0,∞]-valued; an unbounded family therefore cannot satisfy them through a junk real supremum of 000. Almost-sure statements use Mathlib's ∀ᵐ, which requires the exceptional set to have outer measure zero; convergence in outer probability is μ{ω:δ<∣Xn(ω)∣}→0\mu\{\omega:\delta<|X_n(\omega)|\}\to0μ{ω:δ<∣Xn​(ω)∣}→0 for every δ>0\delta>0δ>0 with Mathlib's outer measure and no measurability hypothesis.
  • Readings recorded in the items: in (47) the middle term is EP^n[∣L−1∣ ∣ℓ∣]E_{\widehat P_n}[|L-1|\,|\ell|]EPn​​[∣L−1∣∣ℓ∣] (the page omits the absolute value on ℓ\ellℓ); in the display after (47), ρ/γf\sqrt{\rho/\gamma_f}ρ/γf​​ is ρCf\sqrt{\rho C_f}ρCf​​ with CfC_fCf​ from Lemma 13; in Lemma 13 the constants may depend on ρ\rhoρ as well as fff, as in its proof.
  • A trivializing formalization would take the suprema in R\mathbb RR (where an unbounded set has supremum 000), or allow the argmin sets to be empty by construction; neither is possible here, and nonemptiness of the solution sets is not assumed.
  • Contributions welcome: a Glivenko–Cantelli library for parametric classes (Example 5), the deterministic inequalities (47) and Lemma 13, and the argmin-consistency argument of Corollary 1.

Selected references

  • J. C. Duchi, P. W. Glynn, H. Namkoong, Statistics of Robust Optimization: A Generalized Empirical Likelihood Approach, arXiv:1610.03425v3, 2018; Math. Oper. Res. 46(3), 2021. https://arxiv.org/abs/1610.03425 , https://doi.org/10.1287/moor.2020.1085
  • A. W. van der Vaart, Asymptotic Statistics, Cambridge University Press, 1998 (Example 19.8). https://doi.org/10.1017/CBO9780511802256
  • A. W. van der Vaart, J. A. Wellner, Weak Convergence and Empirical Processes, Springer, 1996. https://doi.org/10.1007/978-1-4757-2545-2
  • A. B. Owen, Empirical Likelihood, Chapman & Hall/CRC, 2001. https://doi.org/10.1201/9781420036152
  • A. Ben-Tal, D. den Hertog, A. De Waegenaere, B. Melenberg, G. Rennen, Robust Solutions of Optimization Problems Affected by Uncertain Probabilities, Management Science 59(2), 2013. https://doi.org/10.1287/mnsc.1120.1641
16 thms1 active userReviewed
Operations ResearchOptimizationProbability+1·Captain: mikedeng1

Mean-Variance Hedging in Continuous Time: The Feedback Futures Strategy Φ(G*) Minimizes the Expected Squared Deviation of Terminal Wealth from Any Target LevelResearch Paper

Motivation

A firm that will receive or deliver a quantity of a commodity, currency or security at a future date carries price risk until that date. When the asset itself cannot be traded in the meantime, the standard instrument for reducing that risk is a futures contract on a correlated asset: the firm takes a position in futures and adjusts it over time, and the gains or losses of the futures position offset part of the movement of its commitment. Choosing that position is the hedging problem. The classical answer, the minimum-variance hedge ratio, is a static one-period rule. Duffie and Richardson (Ann. Appl. Probab. 1991) solved the dynamic version in continuous time with a quadratic criterion: minimize the expected squared deviation of terminal wealth from a target. Their explicit feedback solution became a reference point for the later literature on mean-variance hedging in incomplete markets (Schweizer, Gouriéroux–Laurent–Pham, and others), where the same quadratic criterion is studied under general semimartingale prices.

Setting

Fix a horizon T>0T>0T>0 and a probability space (Ω,F,P)(\Omega,\mathcal F,P)(Ω,F,P) carrying a two-dimensional standard Brownian motion (B,ε)(B,\varepsilon)(B,ε) with its filtration F\mathbb FF. Let μ,σ,m,v,ρ\mu,\sigma,m,v,\rhoμ,σ,m,v,ρ be bounded measurable functions on [0,T][0,T][0,T], with ∣v∣|v|∣v∣ bounded away from zero and ρt∈[−1,1]\rho_t\in[-1,1]ρt​∈[−1,1]. The Brownian motion ξt=∫0tρs dBs+∫0t1−ρs2 dεs\xi_t=\int_0^t\rho_s\,dB_s+\int_0^t\sqrt{1-\rho_s^2}\,d\varepsilon_sξt​=∫0t​ρs​dBs​+∫0t​1−ρs2​​dεs​ has instantaneous correlation ρ\rhoρ with BBB. The committed asset SSS and the futures price FFF follow

dSt=μtSt dt+σtSt dBt,dFt=mtFt dt+vtFt dξt,S0,F0>0.dS_t=\mu_tS_t\,dt+\sigma_tS_t\,dB_t,\qquad dF_t=m_tF_t\,dt+v_tF_t\,d\xi_t,\qquad S_0,F_0>0.dSt​=μt​St​dt+σt​St​dBt​,dFt​=mt​Ft​dt+vt​Ft​dξt​,S0​,F0​>0.

The hedger is committed to kkk units of SSS at time TTT. A trading strategy is a progressively measurable process θ\thetaθ (the futures position) with E∫0Tθt2Ft2 dt<∞E\int_0^T\theta_t^2F_t^2\,dt<\inftyE∫0T​θt2​Ft2​dt<∞; Θ\ThetaΘ denotes the set of them. Its futures gain is the stochastic integral G(θ)t=∫0tθs dFsG(\theta)_t=\int_0^t\theta_s\,dF_sG(θ)t​=∫0t​θs​dFs​, and the terminal wealth is W(θ)=kST+G(θ)TW(\theta)=kS_T+G(\theta)_TW(θ)=kST​+G(θ)T​. Given a target level L∈RL\in\mathbb RL∈R, problem (3) is

min⁡θ∈ΘE[(W(θ)−L)2].\min_{\theta\in\Theta}E\big[(W(\theta)-L)^2\big].θ∈Θmin​E[(W(θ)−L)2].

With γt=mtσtρt/vt−μt\gamma_t=m_t\sigma_t\rho_t/v_t-\mu_tγt​=mt​σt​ρt​/vt​−μt​, the tracking process is Zt=kexp⁡(−∫tTγs ds)StZ_t=k\exp(-\int_t^T\gamma_s\,ds)S_tZt​=kexp(−∫tT​γs​ds)St​, so that ZT=kSTZ_T=kS_TZT​=kST​, and the feedback map is

Φ(Gt∗)=1Ft[mtvt2(L−Zt−Gt∗)−σtρtvtZt],\Phi(G^*_t)=\frac1{F_t}\Big[\frac{m_t}{v_t^2}(L-Z_t-G^*_t)-\frac{\sigma_t\rho_t}{v_t}Z_t\Big],Φ(Gt∗​)=Ft​1​[vt2​mt​​(L−Zt​−Gt∗​)−vt​σt​ρt​​Zt​],

where G∗G^*G∗ solves dGt∗=Φ(Gt∗) dFtdG^*_t=\Phi(G^*_t)\,dF_tdGt∗​=Φ(Gt∗​)dFt​, G0∗=0G^*_0=0G0∗​=0. The strategy φ=Φ(G∗)\varphi=\Phi(G^*)φ=Φ(G∗) depends only on the gains realized so far and the current price StS_tSt​.

Formalization targets

Goal: Proposition 1

φt=Φ(Gt∗)  solves  min⁡θ∈ΘE[(kST+G(θ)T−L)2]\varphi_t=\Phi(G^*_t)\ \text{ solves }\ \min_{\theta\in\Theta}E\big[(kS_T+G(\theta)_T-L)^2\big]φt​=Φ(Gt∗​)  solves  θ∈Θmin​E[(kST​+G(θ)T​−L)2]

for every commitment kkk, every target LLL and every solution G∗G^*G∗ of (10). No constant is hard-coded: the statement is the paper's for arbitrary coefficients satisfying the standing hypotheses.

Milestones

  1. Lemma 1: φ∈Θ\varphi\in\Thetaφ∈Θ is optimal iff E[(L−kST−G(φ)T) G(θ)T]=0E[(L-kS_T-G(\varphi)_T)\,G(\theta)_T]=0E[(L−kST​−G(φ)T​)G(θ)T​]=0 for every θ∈Θ\theta\in\Thetaθ∈Θ.
  2. Existence (§3.3): equation (10) has a solution with Gt∗∈L2(P)G^*_t\in L^2(P)Gt∗​∈L2(P).
  3. Itô dynamics of ZZZ: dZt=(γt+μt)Zt dt+σtZt dBtdZ_t=(\gamma_t+\mu_t)Z_t\,dt+\sigma_tZ_t\,dB_tdZt​=(γt​+μt​)Zt​dt+σt​Zt​dBt​.
  4. Moment equations for E(ZtGt)E(Z_tG_t)E(Zt​Gt​), E(Gt∗Gt)E(G^*_tG_t)E(Gt∗​Gt​) and E(Gt)E(G_t)E(Gt​), with G=G(θ)G=G(\theta)G=G(θ).
  5. Lemma 2: Ht=E[(L−Zt−Gt∗)G(θ)t]H_t=E[(L-Z_t-G^*_t)G(\theta)_t]Ht​=E[(L−Zt​−Gt∗​)G(θ)t​] satisfies H˙t=−(mt2/vt2)Ht\dot H_t=-(m_t^2/v_t^2)H_tH˙t​=−(mt2​/vt2​)Ht​.
  6. The solution of (13): Ht=H0exp⁡(−∫0tms2/vs2 ds)H_t=H_0\exp(-\int_0^tm_s^2/v_s^2\,ds)Ht​=H0​exp(−∫0t​ms2​/vs2​ds).

Two further items, not milestones, formalize §4: Lemma 3 (a solution of (3) is mean-variance efficient) and §4.1 (maximizing the quadratic utility E[W−cW2]E[W-cW^2]E[W−cW2], c>0c>0c>0, is problem (3) with L=1/(2c)L=1/(2c)L=1/(2c)).

Significance

Proposition 1 gives the optimal dynamic hedge in closed feedback form for every target level at once. Varying LLL traces out the whole mean-variance frontier of terminal wealth (Lemma 3), and the choice L=1/(2c)L=1/(2c)L=1/(2c) solves the quadratic-utility problem (§4.1); the minimum-variance hedge of §4.3 of the paper is obtained by optimizing over LLL. The result is also an instance of a general pattern: a quadratic hedging problem in an incomplete market reduces to an L2L^2L2 projection onto the space of attainable gains, and the projection is computed by a linear SDE.

The result is proved in the paper, in six pages. No machine-checked version of it, or of any continuous-time hedging result, exists on the platform. A formalization requires Itô's formula for products of Itô processes, the zero-mean property of square-integrable stochastic integrals, Fubini's theorem for moments, and existence for a linear SDE with an Itô-process forcing term; each of these is reusable well beyond this paper.

Difficulty

The projection step (Lemma 1) is Hilbert-space geometry and the final ODE step is Grönwall. The difficulty lies in between: the orthogonality E[(L−kST−GT∗)G(θ)T]=0E[(L-kS_T-G^*_T)G(\theta)_T]=0E[(L−kST​−GT∗​)G(θ)T​]=0 must be verified against every trading strategy θ\thetaθ, about which only E∫0Tθt2Ft2 dt<∞E\int_0^T\theta_t^2F_t^2\,dt<\inftyE∫0T​θt2​Ft2​dt<∞ is known. A computation that treats θ\thetaθ as bounded, continuous or simple does not suffice. Making the paper's moment computations rigorous requires controlling the integrability of products such as ZtθtFtZ_t\theta_tF_tZt​θt​Ft​ and Gt∗G(θ)tG^*_tG(\theta)_tGt∗​G(θ)t​, proving that the stochastic-integral parts of Itô's product rule are true martingales rather than local martingales, and differentiating expectations in time when the coefficients are only measurable, so that derivatives exist only almost everywhere.

Formalization scope

The stochastic layer is the published definition file Peng1990_SMP_Stochastic (the L2L^2L2 Itô integral and Itô processes on R≥0\mathbb R_{\ge0}R≥0​ time), imported, not redefined. The mission commits to the following conventions.

  • (B,ε)(B,\varepsilon)(B,ε) is one R2\mathbb R^2R2-valued standard Brownian motion; BBB is coordinate 0, ε\varepsilonε coordinate 1, and dξd\xidξ is expanded as ρ dB+1−ρ2 dε\rho\,dB+\sqrt{1-\rho^2}\,d\varepsilonρdB+1−ρ2​dε.
  • The filtration is the natural filtration of (B,ε)(B,\varepsilon)(B,ε), not its augmentation, and trading strategies are progressively measurable instead of predictable. Neither change alters the space of terminal gains.
  • Gains are relations: a gain process is any version of the Itô integral, and every statement quantifies over all versions.
  • The objective E[(W−L)2]E[(W-L)^2]E[(W−L)2] and variances take values in [0,∞][0,\infty][0,∞], so a non-square-integrable wealth cannot be optimal through a junk value 000; inner products carry explicit integrability.
  • ρt∈[−1,1]\rho_t\in[-1,1]ρt​∈[−1,1] (§3.1), not [0,1][0,1][0,1] (§2). The sign of vvv is free; only ∣v∣≥δ>0|v|\ge\delta>0∣v∣≥δ>0 is assumed.
  • "Φ(G∗)\Phi(G^*)Φ(G∗) defined by (9)–(11)" means: for every solution of (10), where a solution includes that Φ(G∗)\Phi(G^*)Φ(G∗) is a trading strategy. The paper takes this membership for granted.
  • Lemma 2 and the moment equations are stated in integral form (Ht=H0−∫0t(m2/v2)H dsH_t=H_0-\int_0^t(m^2/v^2)H\,dsHt​=H0​−∫0t​(m2/v2)Hds), which is the paper's "for almost every ttt" derivative together with absolute continuity; continuity of the coefficients is not assumed.
  • The display for dZdZdZ in the proof of Lemma 2 omits dtdtdt; the drift is (γt+μt)Zt dt(\gamma_t+\mu_t)Z_t\,dt(γt​+μt​)Zt​dt.
  • In §4.1, c>0c>0c>0 is assumed explicitly.

Proposition 1 would hold vacuously if equation (10) had no solution; the existence milestone rules this out and must be proved, not assumed. Contributions are welcome on Itô's product formula and the martingale property of Itô integrals in the Peng framework, on the existence of solutions of linear SDEs, and on the Grönwall-type uniqueness for (13).

Selected references

  • D. Duffie, H. R. Richardson, Mean-Variance Hedging in Continuous Time, The Annals of Applied Probability 1(1) (1991) 1–15. https://doi.org/10.1214/aoap/1177005978
  • S. Peng, A General Stochastic Maximum Principle for Optimal Control Problems, SIAM J. Control Optim. 28(4) (1990) 966–979. https://doi.org/10.1137/0328054
  • P. Protter, Stochastic Integration and Differential Equations, Springer, 1990. https://doi.org/10.1007/978-3-662-02619-9
  • D. G. Luenberger, Optimization by Vector Space Methods, Wiley, 1969.
  • M. Schweizer, Mean-Variance Hedging for General Claims, The Annals of Applied Probability 2(1) (1992) 171–179. https://doi.org/10.1214/aoap/1177005776
11 thms1 active userReviewed
🏆Completed
Operations ResearchOptimization·Captain: mikedeng1

How Many Parts to Make at Once: The Cost per Unit (CX + S)/240M + S/X + C Is Minimized Exactly at the Lot Size X = √(240MS/C)Research Paper

Motivation

Every manufacturer who makes a part in batches faces the trade-off Ford W. Harris described in 1913: large lots spread the fixed set-up cost of an order over many pieces, but they also tie up money in stock that must be carried. Harris's article "How many parts to make at once" (Factory, The Magazine of Management 10(2), 1913, reprinted in Operations Research 38(6), 1990) resolved the trade-off with a closed formula, the square-root or economic order quantity (EOQ) formula. It is the starting point of deterministic inventory theory and is still taught as the first model of every operations-management course.

Timeline. Harris published the formula in 1913, without proof ("the solution of this problem involves higher mathematics"). The same formula was popularised by R. H. Wilson in 1934 and was for decades attributed to him. D. Erlenkotter traced it back to Harris (Operations Research 38(6), 1990, 937–946), and the article was reprinted in the same issue. Later work built stochastic (Q, r) models on top of it; Zheng (1992) compared the EOQ heuristic with the optimal (Q, r) policy.

Setting

A part is used at a regular rate of MMM units per month (the movement). Each unit costs CCC dollars (the unit cost), and each order costs SSS dollars to set up. Parts are made in lots of XXX units, the lot size. Under regular movement a lot of XXX is delivered when the stock reaches nothing and is then used up at rate MMM, so the stock at time t≥0t \ge 0t≥0 (months, from a delivery) is the sawtooth

stock⁡(t)=X(1−{Mt/X}),\operatorname{stock}(t) = X\bigl(1 - \{Mt/X\}\bigr),stock(t)=X(1−{Mt/X}),

with {u}\{u\}{u} the fractional part. Interest and depreciation on stock are charged at ten per cent a year, a rate the paper fixes.

Harris prices a unit in three parts:

  1. the interest charge per piece: the average stock is X/2X/2X/2, its value including set-up is 12(CX+S)\tfrac12(CX+S)21​(CX+S), ten per cent of this is the annual charge, and dividing by the 12M12M12M units used a year gives 1240M(CX+S)\frac{1}{240M}(CX+S)240M1​(CX+S);
  2. the set-up cost per piece S/XS/XS/X;
  3. the unit cost CCC.

The cost per unit is therefore

Y(X)=1240M(CX+S)+SX+C,Y(X) = \frac{1}{240M}(CX + S) + \frac{S}{X} + C,Y(X)=240M1​(CX+S)+XS​+C,

and the economic lot size is X∗=240MS/CX^* = \sqrt{240MS/C}X∗=240MS/C​. In Lean these are stockLevel, interestPerPiece, costPerUnit and econLotSize in the namespace HarrisEOQ.Lot.

Formalization targets

Goal: the square-root formula

For M,C,S>0M, C, S > 0M,C,S>0,

X∗>0,Y(X∗)≤Y(X) for all X>0,Y(X)=Y(X∗), X>0  ⟹  X=X∗.X^* > 0, \qquad Y(X^*) \le Y(X) \text{ for all } X > 0, \qquad Y(X) = Y(X^*),\ X > 0 \implies X = X^* .X∗>0,Y(X∗)≤Y(X) for all X>0,Y(X)=Y(X∗), X>0⟹X=X∗.

This is Harris's claim that the value of XXX giving the minimum value to YYY "reduces to the square root of (240MS divided by C)": X∗X^*X∗ is admissible, attains the minimum, and is the only lot size that does.

Milestones: the derivation of YYY

  1. The long-run average of the sawtooth stock is X/2X/2X/2: lim⁡T→∞1T∫0Tstock⁡(t) dt=X/2\lim_{T\to\infty}\frac1T\int_0^T \operatorname{stock}(t)\,dt = X/2limT→∞​T1​∫0T​stock(t)dt=X/2.
  2. The interest charge per piece, built in the paper's steps, equals 1240M(CX+S)\frac{1}{240M}(CX+S)240M1​(CX+S), and YYY is the sum of the three per-piece costs.

These justify the objective YYY, not its minimization; the paper gives no argument for the minimization.

Companion statements

  • X∗=KMX^* = K\sqrt MX∗=KM​ with K=240S/CK = \sqrt{240S/C}K=240S/C​ (p. 948).
  • The fourfold law: X∗(M′)=2X∗(M)  ⟺  M′=4MX^*(M') = 2X^*(M) \iff M' = 4MX∗(M′)=2X∗(M)⟺M′=4M (p. 950).
  • A lot too small by ddd costs more than one too large by ddd: Y(X∗+d)<Y(X∗−d)Y(X^*+d) < Y(X^*-d)Y(X∗+d)<Y(X∗−d) for 0<d<X∗0 < d < X^*0<d<X∗ (p. 949, general form of an observation made on an example).
  • At the optimum, S/X∗=CX∗/(240M)S/X^* = CX^*/(240M)S/X∗=CX∗/(240M) (p. 948).
  • The paper's three worked lot sizes 2,190, 6,850 and 48.5, each to its last printed digit (pp. 948–949).

Significance

The result. The square-root formula gives the cost-minimising batch size in closed form from three observable numbers. Its consequences are the ones Harris draws: lot sizes grow only with the square root of demand (so consumption must quadruple to double a lot), the cost curve is flat near the optimum and asymmetric (erring small is worse than erring large), and at the optimum the set-up cost balances the variable carrying cost. Every later deterministic and stochastic lot-sizing model reduces to this one in its simplest case.

Formalizing it. The result is classical and proved in textbooks, but Harris's paper itself contains no proof. A formalization supplies the missing argument for the paper's exact objective, which differs from the textbook EOQ by charging interest on the set-up cost (S/2S/2S/2 in the stock value) and by the fixed ten per cent rate. It also makes the paper's modelling step precise: the claim that the average stock is X/2X/2X/2 becomes a statement about a time average of a sawtooth function. To our knowledge none of these statements has a machine-checked proof on the platform; the EOQ items of Zheng (1992) concern a different model, with backorders.

Difficulty

The minimization is elementary calculus; the substance of the mission is fidelity. The objective must be the display as printed, with 1240M\frac{1}{240M}240M1​ meaning 1/(240⋅M)1/(240\cdot M)1/(240⋅M), and the claim includes uniqueness, not only that X∗X^*X∗ is a minimizer. The average-stock milestone needs a genuine long-run average of a discontinuous periodic function over [0,T][0, T][0,T] with TTT not a whole number of cycles, which is where the integration and limit bookkeeping lies.

Formalization scope

All quantities are real numbers; lot sizes are not restricted to integers (the paper's own optimum is 48.5). The hypotheses M,C,S>0M, C, S > 0M,C,S>0 are not written on the page; they are implicit in the meaning of a usage rate, a price and a cost, and are added. Every quantifier over lot sizes is over X>0X > 0X>0. Time is measured in months, and the interest rate is fixed at ten per cent, so the constant 240=12⋅2⋅10240 = 12 \cdot 2 \cdot 10240=12⋅2⋅10 appears as printed; the formula is not generalized to an arbitrary rate.

A trivializing formalization is ruled out: YYY is defined as the printed display, not rewritten around X∗X^*X∗; the average stock is an integral of the stock level, never defined as X/2X/2X/2; and the goal does not quantify over all real XXX, where Lean's convention S/0=0S/0 = 0S/0=0 would make X=0X = 0X=0 a spurious minimizer.

The manufacturing interval TTT and the safe stock minimum play no role in the formula and are not modelled. The examples' cost figures (0.188 cents, $0.00028, and so on) are not formalized. The development needs only Mathlib's real numbers, square roots, fractional parts, interval integrals and limits; contributions of proofs of any item are welcome.

Selected references

  • F. W. Harris, How many parts to make at once, Factory, The Magazine of Management 10(2):135–136, 152, 1913; reprinted in Operations Research 38(6):947–950, 1990. https://doi.org/10.1287/opre.38.6.947
  • D. Erlenkotter, Ford Whitman Harris and the economic order quantity model, Operations Research 38(6):937–946, 1990. https://doi.org/10.1287/opre.38.6.937
  • R. H. Wilson, A scientific routine for stock control, Harvard Business Review 13:116–128, 1934.
  • Y.-S. Zheng, On properties of stochastic inventory systems, Management Science 38(1):87–103, 1992. https://doi.org/10.1287/mnsc.38.1.87
4 thms2 active usersReviewed
Operations ResearchProbabilityStochastic Systems·Captain: mikedeng1

Reflected Brownian Motion on an Orthant: The Skorokhod Construction Yields an Adapted, Almost Surely Unique, Time-Homogeneous Markov ProcessResearch Paper

Motivation

Reflected Brownian motion on the orthant is the diffusion that arises as the heavy-traffic limit of open networks of queues. In a KKK-station network the scaled queue-length vector lives in the nonnegative orthant R+K\mathbb R^K_+R+K​; in the interior it moves like a Brownian motion, and when a station empties the process is pushed back into the orthant in a direction determined by the routing of customers between stations. Harrison (1978) obtained such a limit for two queues in tandem, and Reiman (Open Queueing Networks in Heavy Traffic, Math. Oper. Res. 9 (1984)) showed that general KKK-station open networks lead exactly to the class of processes studied here.

Classical constructions of reflected diffusions (Stroock and Varadhan 1971, Watanabe 1971) require a smooth boundary and a reflection direction varying continuously on it. The orthant has corners and the reflection direction jumps between faces, so those results do not apply. Harrison and Reiman (Reflected Brownian Motion on an Orthant, Ann. Probab. 9 (1981)) construct the process pathwise, following Skorokhod's one-dimensional approach, and derive its Markov property from the construction. The process has since become the standard object in the diffusion approximation of queueing networks.

Setting

Fix a positive integer KKK. Vectors in RK\mathbb R^KRK are row vectors, indexed by j=1,…,Kj=1,\dots,Kj=1,…,K. Let AAA be a K×KK\times KK×K covariance matrix (symmetric, nonnegative definite), b∈RKb\in\mathbb R^Kb∈RK a drift vector, and Q=(qij)Q=(q_{ij})Q=(qij​) a nonnegative K×KK\times KK×K matrix with zeros on the diagonal and spectral radius strictly less than one. S=R+KS=\mathbb R^K_+S=R+K​ is the nonnegative orthant.

Let CCC be the space of continuous paths x:[0,∞)→RKx:[0,\infty)\to\mathbb R^Kx:[0,∞)→RK with the topology of uniform convergence on compact intervals, and CSC_SCS​ the paths with x(0)∈Sx(0)\in Sx(0)∈S. For x∈CSx\in C_Sx∈CS​, the Skorokhod problem asks for y,z∈Cy,z\in Cy,z∈C with, for every jjj,

zj(t)=xj(t)+yj(t)−∑i=1Kqij yi(t),zj(t)≥0,t≥0,(5–6)z_j(t)=x_j(t)+y_j(t)-\sum_{i=1}^K q_{ij}\,y_i(t),\qquad z_j(t)\ge 0,\qquad t\ge0, \tag{5–6}zj​(t)=xj​(t)+yj​(t)−i=1∑K​qij​yi​(t),zj​(t)≥0,t≥0,(5–6)

yjy_jyj​ nondecreasing with yj(0)=0y_j(0)=0yj​(0)=0 (7), and yjy_jyj​ increasing only at times ttt where zj(t)=0z_j(t)=0zj​(t)=0 (8). In matrix form, z=x+y(I−Q)z=x+y(I-Q)z=x+y(I−Q). Theorem 1 of the paper shows there is exactly one such pair, written y=ψ(x)y=\psi(x)y=ψ(x), z=ϕ(x)z=\phi(x)z=ϕ(x).

The process is obtained by feeding a Brownian path into this map. On a probability space (Ω,F,P)(\Omega,\mathcal F,P)(Ω,F,P) let XXX be a KKK-dimensional Brownian motion with covariance matrix AAA, drift bbb and X(0)∈SX(0)\in SX(0)∈S almost surely, with X(0)X(0)X(0) independent of the increments of XXX. Let Ft=F(X(s);0≤s≤t)\mathcal F_t=\mathcal F(X(s);0\le s\le t)Ft​=F(X(s);0≤s≤t). Set Y=ψ(X)Y=\psi(X)Y=ψ(X) and Z=ϕ(X)Z=\phi(X)Z=ϕ(X) where X∈CSX\in C_SX∈CS​, and Y=Z=0Y=Z=0Y=Z=0 on the exceptional null set. ZZZ is reflected Brownian motion on SSS with reflection matrix I−QI-QI−Q.

Formalization targets

Goal: Corollary 1

There is a family (κt)(\kappa_t)(κt​) of Markov transition kernels on RK\mathbb R^KRK, depending only on (Q,A,b)(Q,A,b)(Q,A,b), such that for every such XXX, YYY, ZZZ:

(a)Y(t), Z(t) are Ft-measurable, t≥0;\text{(a)}\quad Y(t),\ Z(t)\ \text{are } \mathcal F_t\text{-measurable},\ t\ge0;(a)Y(t), Z(t) are Ft​-measurable, t≥0; (b)(Y,Z) satisfies (1)–(4) a.s., and any pair satisfying (1)–(4) a.s. equals (Y,Z) a.s.;\text{(b)}\quad (Y,Z)\ \text{satisfies (1)–(4) a.s., and any pair satisfying (1)–(4) a.s. equals } (Y,Z) \text{ a.s.};(b)(Y,Z) satisfies (1)–(4) a.s., and any pair satisfying (1)–(4) a.s. equals (Y,Z) a.s.; (c)P[Z(s+t)∈B∣Fs]=κt(Z(s),B) a.s.,s,t≥0, B Borel.\text{(c)}\quad P\big[Z(s+t)\in B \mid \mathcal F_s\big]=\kappa_t\big(Z(s),B\big)\ \text{a.s.},\qquad s,t\ge0,\ B \text{ Borel}.(c)P[Z(s+t)∈B∣Fs​]=κt​(Z(s),B) a.s.,s,t≥0, B Borel.

Here (1)–(4) are (5)–(8) for the paths of XXX, YYY, ZZZ. The kernel is chosen before the probability space and the initial law, which is what "stationary transition probabilities" means.

Milestones

The milestones follow the proof of Theorem 1 on pp. 304–305:

  1. a positive diagonal Λ\LambdaΛ with ∥Λ−1QΛ∥<1\|\Lambda^{-1}Q\Lambda\|<1∥Λ−1QΛ∥<1 (Veinott scaling);
  2. (5)–(8) are invariant under (Q,x,y,z)↦(Λ−1QΛ,xΛ,yΛ,zΛ)(Q,x,y,z)\mapsto(\Lambda^{-1}Q\Lambda,x\Lambda,y\Lambda,z\Lambda)(Q,x,y,z)↦(Λ−1QΛ,xΛ,yΛ,zΛ);
  3. the key observation that (5)–(8) are equivalent to y∈C0y\in C_0y∈C0​, the fixed-point equation y=π(y)y=\pi(y)y=π(y) with π(y)(t)=sup⁡0≤s≤t[y(s)Q−x(s)]+\pi(y)(t)=\sup_{0\le s\le t}[y(s)Q-x(s)]^+π(y)(t)=sup0≤s≤t​[y(s)Q−x(s)]+, and z=x+y(I−Q)z=x+y(I-Q)z=x+y(I−Q);
  4. the contraction ∥π(y)−π(y′)∥≤α∥y−y′∥\|\pi(y)-\pi(y')\|\le\alpha\|y-y'\|∥π(y)−π(y′)∥≤α∥y−y′∥ on [0,T][0,T][0,T];
  5. convergence of the Picard iterates yn+1=π(yn)y^{n+1}=\pi(y^n)yn+1=π(yn), y0≡0y^0\equiv0y0≡0;
  6. the Lipschitz bound ∥ψ(x)−ψ(x′)∥≤∥x−x′∥/(1−α)\|\psi(x)-\psi(x')\|\le\|x-x'\|/(1-\alpha)∥ψ(x)−ψ(x′)∥≤∥x−x′∥/(1−α);
  7. Theorem 1 itself: existence and uniqueness, non-anticipation (9), continuity (10);
  8. the regeneration property (11): with x∗(t)=z(T)+x(T+t)−x(T)x^*(t)=z(T)+x(T+t)-x(T)x∗(t)=z(T)+x(T+t)−x(T), y∗(t)=y(T+t)−y(T)y^*(t)=y(T+t)-y(T)y∗(t)=y(T+t)−y(T), z∗(t)=z(T+t)z^*(t)=z(T+t)z∗(t)=z(T+t), one has y∗=ψ(x∗)y^*=\psi(x^*)y∗=ψ(x∗), z∗=ϕ(x∗)z^*=\phi(x^*)z∗=ϕ(x∗).

Milestone 7 is the platform theorem Reiman84.QueueLength.lemma_1, posed as an open target by an earlier mission (Reiman 1984 cites it as its Lemma 1). It is referenced here and not posed again.

Significance

Corollary 1 is what makes ZZZ a usable stochastic process: adaptedness and almost-sure uniqueness say ZZZ is determined by the driving Brownian motion in a non-anticipating way, and the Markov property with time-homogeneous kernels is the starting point for the change-of-variable formula of §3, for generators, for stationary distributions, and for the heavy-traffic limit theorems in which ZZZ appears as the limit. The pathwise map ϕ\phiϕ and its Lipschitz continuity are reused throughout queueing theory: the continuous-mapping argument for heavy-traffic limits rests on exactly the continuity (10) established here.

The results are classical, with complete published proofs. None of them has a machine-checked proof. Mathlib has the measure-theoretic layer (kernels, conditional expectation, independence) but no reflection maps, no construction of multidimensional Brownian motion with drift, and no Markov-process theory in continuous time. This mission provides a formal statement of the pathwise reflection theory and its probabilistic consequence on which such a development can build.

Difficulty

The pathwise part is a contraction argument, but the contraction is not in the original norm: the map y↦yQy\mapsto yQy↦yQ need not be a contraction for any standard norm when only the spectral radius of QQQ is below one. The proof first changes coordinates by a positive diagonal matrix, and the right norm must be matched to the row-vector convention. The fixed-point characterization also has to be shown equivalent to the complementarity condition (8), which is where the zero diagonal of QQQ enters.

For Corollary 1, the difficulty is measure-theoretic. Adaptedness requires measurability of a path functional with respect to the uncompleted natural filtration, which uses (9) and (10) and the fact that continuous paths are determined by countably many coordinates. The Markov property requires the regeneration identity (11) together with independence of the post-sss increments of XXX from Fs\mathcal F_sFs​, and a kernel that is jointly measurable and independent of the initial law. Conditioning on Fs\mathcal F_sFs​ alone, without identifying the future as a fixed functional of Z(s)Z(s)Z(s) and an independent Brownian motion, does not give a kernel that is the same for all sss.

Formalization scope

  • RK\mathbb R^KRK is Fin K → ℝ (paper index jjj = Lean index j−1j-1j−1), with K≥1K\ge1K≥1; row vector times matrix is Matrix.vecMul. Paths are functions ℝ → Fin K → ℝ; only times t≥0t\ge0t≥0 are constrained.
  • Spectral radius <1<1<1 is rendered as Qm→0Q^m\to0Qm→0, the rendering of Reiman84.QueueLength.lemma_1. AAA is PosSemidef.
  • (5)–(8) are the published Reiman84.QueueLength.IsReflectionPair; (8) reads "yjy_jyj​ is constant on every interval [s,t]⊆[0,∞)[s,t]\subseteq[0,\infty)[s,t]⊆[0,∞) on which zj>0z_j>0zj​>0". CSC_SCS​ is IsCPlus; uniform convergence on compacts is UocTendsto; Brownian motion from 000 with drift and covariance is IsDriftedBM.
  • The norm on C[0,T]C[0,T]C[0,T] is sup⁡0≤t≤T∥y(t)∥∞\sup_{0\le t\le T}\|y(t)\|_\inftysup0≤t≤T​∥y(t)∥∞​. The suprema in π\piπ and in the norm are real suprema, honest only for continuous paths, and every statement using them assumes continuity.
  • The paper's ∥P∥\|P\|∥P∥ is printed as the maximal row sum. Under the row-vector convention the contraction, Picard and Lipschitz steps need the maximal column sum; with the printed reading the contraction inequality is false (a nilpotent 3×33\times33×3 counterexample is recorded in those items). Veinott scaling is stated as printed; applying it to Q⊤Q^\topQ⊤ gives the column version.
  • The Brownian motion is X=X0+ξX=X_0+\xiX=X0​+ξ with ξ\xiξ a drifted Brownian motion from 000 and X0≥0X_0\ge0X0​≥0 a.s. independent of the whole process ξ\xiξ. Ft\mathcal F_tFt​ is the uncompleted σ-algebra generated by X(s)X(s)X(s), 0≤s≤t0\le s\le t0≤s≤t.
  • YYY and ZZZ enter Corollary 1 as hypotheses: a solution of (5)–(8) on {X∈CS}\{X\in C_S\}{X∈CS​}, zero elsewhere. That such processes exist is the existence part of Theorem 1, the referenced open item.
  • The kernel family is quantified before the probability space, so it cannot depend on sss, on Ω\OmegaΩ or on the law of X(0)X(0)X(0). A version of (c) with a kernel depending on these, with the completed or full σ-algebra in place of Fs\mathcal F_sFs​, or with one-dimensional marginals only, is a different and weaker statement and is ruled out.

Out of scope: Theorem 2 (the change-of-variable formula, which needs stochastic integration), the necessity of spectral radius <1<1<1, and §§3–4. Useful contributions beyond the milestones include a construction of multidimensional Brownian motion with drift in Mathlib, the Skorokhod map as a function on CSC_SCS​, and general lemmas on measurability of continuous path functionals.

Selected references

  • J. M. Harrison and M. I. Reiman, Reflected Brownian Motion on an Orthant, Annals of Probability 9(2), 302–308, 1981. https://doi.org/10.1214/aop/1176994471
  • M. I. Reiman, Open Queueing Networks in Heavy Traffic, Mathematics of Operations Research 9(3), 441–458, 1984. https://doi.org/10.1287/moor.9.3.441
  • A. F. Veinott, Jr., Discrete Dynamic Programming with Sensitive Discount Optimality Criteria, Annals of Mathematical Statistics 40(5), 1635–1660, 1969. https://doi.org/10.1214/aoms/1177697379
  • A. V. Skorokhod, Stochastic Equations for Diffusion Processes in a Bounded Region, Theory of Probability and Its Applications 6(3), 264–274, 1961. https://doi.org/10.1137/1106035
  • D. W. Stroock and S. R. S. Varadhan, Diffusion Processes with Boundary Conditions, Communications on Pure and Applied Mathematics 24, 147–225, 1971. https://doi.org/10.1002/cpa.3160240206
12 thms1 active userReviewed
Convex OptimizationLinear OptimizationOperations Research+1·Captain: mikedeng1

The Ellipsoid Method and Its Consequences in Combinatorial Optimization: With a Weak Separation Oracle, the Rounded Ellipsoid Method Is ε-Optimal After N = 4n²⌈log(2R²‖c‖/(rε))⌉ StepsResearch Paper

Motivation

The ellipsoid method decides questions about a convex set K⊆RnK \subseteq \mathbb{R}^nK⊆Rn by maintaining an ellipsoid that contains the relevant part of KKK and shrinking it step by step. Introduced for convex minimization by Yudin and Nemirovskii and by Shor in the 1970s, it became famous in 1979 when Khachiyan used it to show that linear programming is solvable in polynomial time. Grötschel, Lovász and Schrijver (Combinatorica 1 (1981)) observed that the method never needs an explicit description of KKK: it only needs, for a query point yyy, either a confirmation that yyy is (nearly) in KKK or a hyperplane (nearly) separating yyy from KKK. From this they derived that optimization and separation are polynomially equivalent for convex bodies, which in turn gives polynomial algorithms for problems with exponentially many constraints: matroid intersection, submodular function minimization, and the stable set problem in perfect graphs.

The engine of all of these applications is a single quantitative statement, Theorem (2.4) of the paper: with a weak separation oracle and with all numbers rounded to a fixed number of binary digits, a prescribed number NNN of ellipsoid steps produces an ε\varepsilonε-optimal point.

Timeline. 1976–1977: Yudin–Nemirovskii and Shor, the method for convex programming. 1979: Khachiyan, polynomial-time linear programming. 1981: Gács–Lovász publish a complete proof of Khachiyan's result with the explicit rounded update; Grötschel–Lovász–Schrijver state and prove the weak-oracle version, Theorem (2.4), and its combinatorial consequences; Bland–Goldfarb–Todd survey the method (Oper. Res. 29 (1981)). 1988: the monograph of Grötschel, Lovász and Schrijver (Springer) gives the full theory of weak oracles.

Setting

All norms are Euclidean: ∥v∥=vTv\|v\| = \sqrt{v^{\mathsf T}v}∥v∥=vTv​, and for a symmetric matrix ∥A∥\|A\|∥A∥ is the largest absolute eigenvalue. S(a0,ρ)S(a_0,\rho)S(a0​,ρ) is the closed Euclidean ball of radius ρ\rhoρ about a0a_0a0​, and S(K,δ)S(K,\delta)S(K,δ) the set of points within distance δ\deltaδ of KKK.

A convex body (K,a0,r,R)(K, a_0, r, R)(K,a0​,r,R) consists of a compact convex K⊆RnK\subseteq\mathbb{R}^nK⊆Rn, n≥2n\ge 2n≥2, and 0<r≤R0<r\le R0<r≤R with

S(a0,r)⊆K⊆S(a0,R).S(a_0,r)\subseteq K\subseteq S(a_0,R).S(a0​,r)⊆K⊆S(a0​,R).

A weak separation oracle with precision δ>0\delta>0δ>0 answers a query yyy either with "y∈S(K,δ)y\in S(K,\delta)y∈S(K,δ)", or with a vector ddd, ∥d∥≥1\|d\|\ge 1∥d∥≥1, such that dTx≤dTy+δd^{\mathsf T}x\le d^{\mathsf T}y+\deltadTx≤dTy+δ for all x∈Kx\in Kx∈K.

Given an objective ccc and an accuracy ε>0\varepsilon>0ε>0 (with ε<r\varepsilon<rε<r and ∥c∥≥1\|c\|\ge 1∥c∥≥1), set

N=4n2⌈log⁡2R2∥c∥rε⌉,δ=R2 4−N300n,p=5N.N = 4n^2\left\lceil \log\frac{2R^2\|c\|}{r\varepsilon}\right\rceil,\qquad \delta = \frac{R^2\,4^{-N}}{300n},\qquad p = 5N .N=4n2⌈logrε2R2∥c∥​⌉,δ=300nR24−N​,p=5N.

Start from x0=a0x_0=a_0x0​=a0​, A0=R2IA_0=R^2IA0​=R2I. At step kkk query the oracle at xkx_kxk​. If it answers "feasible", kkk is a feasible index and a=ca=ca=c; otherwise a=−da=-da=−d. Put bk=Aka/aTAkab_k = A_ka/\sqrt{a^{\mathsf T}A_ka}bk​=Ak​a/aTAk​a​ and

xk∗=xk+1n+1bk,Ak∗=2n2+32n2(Ak−2n+1bkbkT),x_k^* = x_k+\frac{1}{n+1}b_k,\qquad A_k^* = \frac{2n^2+3}{2n^2}\Bigl(A_k-\frac{2}{n+1}b_kb_k^{\mathsf T}\Bigr),xk∗​=xk​+n+11​bk​,Ak∗​=2n22n2+3​(Ak​−n+12​bk​bkT​),

and obtain xk+1x_{k+1}xk+1​, Ak+1A_{k+1}Ak+1​ by rounding xk∗x_k^*xk∗​, Ak∗A_k^*Ak∗​ to ppp binary digits, keeping Ak+1A_{k+1}Ak+1​ symmetric. The ellipsoids are Ek={x:(x−xk)TAk−1(x−xk)≤1}E_k=\{x : (x-x_k)^{\mathsf T}A_k^{-1}(x-x_k)\le 1\}Ek​={x:(x−xk​)TAk−1​(x−xk​)≤1}, and KkK_kKk​ is the set of points of KKK whose objective value is at least that of every feasible centre found before step kkk.

In Lean, IsRoundedRun K c a₀ R δ p N x A feas a d records exactly these conditions, Kk is KkK_kKk​, and EkE_kEk​ is the published LinearOptimization.ellipsoid (x k) (A k).

Formalization targets

Goal: Theorem (2.4)

If j<Nj<Nj<N is a feasible index whose centre is best among the feasible centres, cTxj=max⁡{cTxk:k<N feasible}c^{\mathsf T}x_j=\max\{c^{\mathsf T}x_k : k<N \text{ feasible}\}cTxj​=max{cTxk​:k<N feasible}, then

cTxj ≥ max⁡x∈KcTx−ε.c^{\mathsf T}x_j \ \ge\ \max_{x\in K} c^{\mathsf T}x - \varepsilon .cTxj​ ≥ x∈Kmax​cTx−ε.

The statement is for every run, i.e. for every sequence of valid oracle answers and every admissible rounding.

Milestones, in attack order

  1. (13): the explicit inverse (Ak∗)−1=2n22n2+3(Ak−1+2n−1aaTaTAka)(A_k^*)^{-1}=\frac{2n^2}{2n^2+3}\bigl(A_k^{-1}+\frac{2}{n-1}\frac{aa^{\mathsf T}}{a^{\mathsf T}A_ka}\bigr)(Ak∗​)−1=2n2+32n2​(Ak−1​+n−12​aTAk​aaaT​), and Ak∗≻0A_k^*\succ 0Ak∗​≻0.
  2. Lemma (2.1): A0,…,ANA_0,\dots,A_NA0​,…,AN​ are positive definite, ∥xk∥≤∥a0∥+R2k\|x_k\|\le\|a_0\|+R2^k∥xk​∥≤∥a0​∥+R2k, ∥Ak∥≤R22k\|A_k\|\le R^22^k∥Ak​∥≤R22k, ∥Ak−1∥≤R−24k\|A_k^{-1}\|\le R^{-2}4^k∥Ak−1​∥≤R−24k.
  3. Lemma (2.2): μ(Ek+1)<e−1/(5n)μ(Ek)\mu(E_{k+1}) < e^{-1/(5n)}\mu(E_k)μ(Ek+1​)<e−1/(5n)μ(Ek​).
  4. Lemma (2.3): Kk⊆EkK_k\subseteq E_kKk​⊆Ek​ for k=0,…,Nk=0,\dots,Nk=0,…,N.
  5. (32): μ(KN)≤μ(EN)≤e−N/(4n)μ(E0)=e−N/(4n)RnVn\mu(K_N)\le\mu(E_N)\le e^{-N/(4n)}\mu(E_0)=e^{-N/(4n)}R^nV_nμ(KN​)≤μ(EN​)≤e−N/(4n)μ(E0​)=e−N/(4n)RnVn​.
  6. (34): the piece above the level ttt of the cone with base the rrr-disc through x0x_0x0​ orthogonal to ccc and apex y∈Ky\in Ky∈K has volume Vn−1rn−1(ζ−cTx0)n∥c∥(ζ−tζ−cTx0)n\frac{V_{n-1}r^{n-1}(\zeta-c^{\mathsf T}x_0)}{n\|c\|}\bigl(\frac{\zeta-t}{\zeta-c^{\mathsf T}x_0}\bigr)^nn∥c∥Vn−1​rn−1(ζ−cTx0​)​(ζ−cTx0​ζ−t​)n, which bounds μ({z∈K:cTz≥t})\mu(\{z\in K: c^{\mathsf T}z\ge t\})μ({z∈K:cTz≥t}) from below.

Significance

Theorem (2.4) turns any weak separation procedure for a convex body into a weak optimization procedure, with a number of oracle calls and a numerical precision polynomial in nnn, log⁡R\log RlogR, log⁡(1/r)\log(1/r)log(1/r), log⁡∥c∥\log\|c\|log∥c∥ and log⁡(1/ε)\log(1/\varepsilon)log(1/ε). This is the "only if" half of the paper's Theorem (3.1), and through it the source of the polynomial algorithms of Chapters 4–6 of the paper and of the 1988 monograph. Its rounding analysis is what makes the method an algorithm on finite-precision numbers rather than an argument about exact real arithmetic.

The result is proved, and has been for over forty years. What this mission adds is a machine-checked proof of the rounded, weak-oracle version, including the error analysis that the paper compresses into "rounding errors can be estimated similarly". Related items already on the platform formalize exact-arithmetic ellipsoid methods: Bertsimas–Tsitsiklis's central-cut method for polyhedra (LinearOptimization.ellipsoid_method_correct, proved) and Bubeck's version for convex minimization with a first-order oracle (arXiv:1405.4980). Neither has a weak oracle, the inflated factor (2n2+3)/(2n2)(2n^2+3)/(2n^2)(2n2+3)/(2n2), or rounding.

Difficulty

For the exact update with factor n2/(n2−1)n^2/(n^2-1)n2/(n2−1) and an exact separating hyperplane through the centre, containment and volume decrease are a classical computation. Here three perturbations interact. The cut is shifted by δ\deltaδ, so the retained half-ellipsoid is slightly larger than a half. The rounded matrix differs from Ak∗A_k^*Ak∗​ by up to n2−pn2^{-p}n2−p in norm, which could destroy positive definiteness if the smallest eigenvalue were not controlled from below, and Lemma (2.1)'s bound R24−kR^24^{-k}R24−k is what controls it. The containment Kk+1⊆Ek+1K_{k+1}\subseteq E_{k+1}Kk+1​⊆Ek+1​ must absorb both errors, and it is the inflation factor (2n2+3)/(2n2)(2n^2+3)/(2n^2)(2n2+3)/(2n2), chosen larger than the optimal one, that leaves room. The paper bounds the remainder term in (29) only by "similar methods"; making that bound explicit is the bulk of the work. The final step also needs the volume rate e−N/(4n)e^{-N/(4n)}e−N/(4n) in (32), which is sharper than iterating Lemma (2.2) and requires the exact per-step volume ratio of the inflated update.

Formalization scope

Rn\mathbb{R}^nRn is Fin n → ℝ with Lebesgue measure. Since Lean's norm on Fin n → ℝ is the sup norm, the Euclidean norm is written out (euclNorm), and the bounds ∥Ak∥≤R22k\|A_k\|\le R^22^k∥Ak​∥≤R22k, ∥Ak−1∥≤R−24k\|A_k^{-1}\|\le R^{-2}4^k∥Ak−1​∥≤R−24k are stated as quadratic-form (eigenvalue) bounds. NNN uses the natural logarithm and the integer ceiling.

The runs generalize the page in three ways, each of which makes the theorems stronger: the oracle's answers are any answers valid for its specification; rounding is any symmetric value within 2−p2^{-p}2−p entrywise; and data are real rather than rational.

The page's standing assumptions ε<r\varepsilon<rε<r, ∥c∥≥1\|c\|\ge1∥c∥≥1, n≥2n\ge2n≥2 (p. 173) are hypotheses. Two hypotheses are added, because the page's NNN, δ\deltaδ and ppp are absolute numbers and the claims fail at extreme scales:

  • R≥1R\ge 1R≥1 (Lemmas (2.1)–(2.3), (32), Theorem (2.4)): for R=r=2−1000R=r=2^{-1000}R=r=2−1000, ε=r/2\varepsilon=r/2ε=r/2, n=2n=2n=2, rounding can make A1=0A_1=0A1​=0.
  • ε≤1\varepsilon\le1ε≤1 (Lemma (2.3), (32), Theorem (2.4)): for R=r=1013R=r=10^{13}R=r=1013, ε=0.99r\varepsilon=0.99rε=0.99r, n=2n=2n=2, δ>2r\delta>2rδ>2r, and a valid oracle can cut away all of KKK.

Neither is needed in (13) or (34).

A run predicate without the oracle clause would make Lemma (2.3) false, and one with exact equality instead of rounding would state a weaker theorem; the goal quantifies over every run, never over some run. Positive definiteness of the AkA_kAk​ is a consequence (Lemma (2.1)), not a hypothesis: since Lean's inverse of a singular matrix is 000, assuming it would hide the lemma's content.

Out of scope: the paper's polynomial-time claims (Theorem (3.1) and its consequences), the bit length of the numbers, and the rationality of inputs, since no oracle-machine model with bit complexity exists in Mathlib or on the platform.

Reusable infrastructure: volumes of ellipsoids and of cone pieces, Sherman–Morrison-type inverses, and perturbation bounds for positive definite matrices. Contributions of these as separate lemmas are welcome.

Selected references

  • M. Grötschel, L. Lovász, A. Schrijver, The ellipsoid method and its consequences in combinatorial optimization, Combinatorica 1(2) (1981) 169–197. https://doi.org/10.1007/bf02579273
  • P. Gács, L. Lovász, Khachiyan's algorithm for linear programming, Mathematical Programming Study 14 (1981) 61–68. https://doi.org/10.1007/BFb0120921
  • L. G. Khachiyan, A polynomial algorithm in linear programming, Soviet Mathematics Doklady 20 (1979) 191–194 (English translation of the original article).
  • R. G. Bland, D. Goldfarb, M. J. Todd, The ellipsoid method: a survey, Operations Research 29(6) (1981) 1039–1091. https://doi.org/10.1287/opre.29.6.1039
  • M. Grötschel, L. Lovász, A. Schrijver, Geometric Algorithms and Combinatorial Optimization, Springer, 1988. https://doi.org/10.1007/978-3-642-97881-4
  • D. Bertsimas, J. N. Tsitsiklis, Introduction to Linear Optimization, Athena Scientific, 1997, Ch. 8. Book record.
  • S. Bubeck, Convex Optimization: Algorithms and Complexity, Foundations and Trends in Machine Learning 8 (2015). https://arxiv.org/abs/1405.4980
10 thms2 active usersReviewed
🏆Completed
Graph TheoryOperations ResearchOptimization·Captain: mikedeng1

Approximation Schemes for the Restricted Shortest Path Problem: The Rounding Algorithm Outputs a T-Path of Length at Most (1 + ε)·OPTResearch Paper

Motivation

The restricted shortest path problem asks for a shortest route between two points of a network subject to a budget on a second additive quantity, such as travel time, cost or risk. It appears as the pricing subproblem of column generation for crew scheduling and vehicle routing, in quality-of-service routing in communication networks, and in scheduling, where Hassin's own §7 uses it for a single-machine problem. The problem is NP-hard (Garey and Johnson, 1979), so exact polynomial algorithms are not expected, and the natural question is how well it can be approximated in polynomial time.

Timeline.

  • 1966–1985. Practical exact methods and pseudopolynomial dynamic programs (Joksch 1966; Lawler 1976; Handler and Zang 1980; Aneja, Aggarwal and Nair 1983; Henig 1985).
  • 1987. Warburton gives the first fully polynomial approximation scheme (FPAS) for this problem on acyclic graphs, based on rounding and scaling (Warburton, Oper. Res. 35, 1987).
  • 1992. Hassin gives two faster FPASs: a rounding-and-scaling scheme driven by an approximate decision test (§3–§4), and a strongly polynomial scheme (§5–§6) (Hassin, Math. Oper. Res. 17, 1992).
  • 2001. Lorenz and Raz give a simpler and faster scheme built on the same test-and-search pattern (Lorenz–Raz, Oper. Res. Lett. 28, 2001).

Hassin's combination of an approximate decision test with a geometric search on the bounds is the pattern later schemes for resource-constrained path problems refine, which is why his first scheme is the subject of this mission.

Setting

A directed graph has vertex set {1,…,n}\{1,\dots,n\}{1,…,n}, n≥2n\ge 2n≥2, and edge set EEE. Following the paper, the vertices are numbered so that every edge (i,j)∈E(i,j)\in E(i,j)∈E has i<ji<ji<j; in particular the graph is acyclic. Each edge carries a positive integer length cijc_{ij}cij​ and a positive integer transition time tijt_{ij}tij​. A path p=(v0,…,vm)p=(v_0,\dots,v_m)p=(v0​,…,vm​) has length c(p)=∑rcvr−1vrc(p)=\sum_r c_{v_{r-1}v_r}c(p)=∑r​cvr−1​vr​​ and transition time t(p)=∑rtvr−1vrt(p)=\sum_r t_{v_{r-1}v_r}t(p)=∑r​tvr−1​vr​​. For a nonnegative integer TTT, a TTT-path is a path from 111 to nnn with t(p)≤Tt(p)\le Tt(p)≤T, and OPT\mathrm{OPT}OPT is the length of a shortest TTT-path.

Fix 0<ε<10<\varepsilon<10<ε<1. For a real VVV, the rounded lengths are

c~ijV=⌊cij(n−1)Vε⌋.\tilde c^V_{ij}=\Big\lfloor \frac{c_{ij}(n-1)}{V\varepsilon}\Big\rfloor .c~ijV​=⌊Vεcij​(n−1)​⌋.

Procedure TEST(V) deletes the edges with cij>Vc_{ij}>Vcij​>V and answers NO if, for some integer c<(n−1)/εc<(n-1)/\varepsilonc<(n−1)/ε, some 111–nnn path in the remaining graph has transition time at most TTT and rounded length at most ccc; otherwise it answers YES.

The Rounding Algorithm keeps bounds (LB,UB)(LB,UB)(LB,UB) on OPT. Starting from initial bounds (LB0,UB0)(LB_0,UB_0)(LB0​,UB0​), Step 1 repeats while UB>2LBUB>2LBUB>2LB: with V=(LB⋅UB)1/2V=(LB\cdot UB)^{1/2}V=(LB⋅UB)1/2 it sets LB←VLB\leftarrow VLB←V if TEST(V) = YES and UB←V(1+ε)UB\leftarrow V(1+\varepsilon)UB←V(1+ε) if TEST(V) = NO. Step 2 outputs a TTT-path that is shortest for the rounded lengths c~ijLB=⌊cij(n−1)/(εLB)⌋\tilde c^{LB}_{ij}=\lfloor c_{ij}(n-1)/(\varepsilon LB)\rfloorc~ijLB​=⌊cij​(n−1)/(εLB)⌋. The bounds after kkk passes are written (LBk,UBk)(LB_k,UB_k)(LBk​,UBk​).

Formalization targets

Goal: the approximation guarantee of the Rounding Algorithm

If LB0>0LB_0>0LB0​>0 is a lower bound on the length of every TTT-path, NNN is a stage at which UBN≤2LBNUB_N\le 2LB_NUBN​≤2LBN​, and ppp is a Step 2 output at LBNLB_NLBN​, then

c(p)≤(1+ε) c(q)for every T-path q,c(p)\le (1+\varepsilon)\,c(q)\qquad\text{for every }T\text{-path }q,c(p)≤(1+ε)c(q)for every T-path q,

that is, c(p)≤(1+ε) OPTc(p)\le(1+\varepsilon)\,\mathrm{OPT}c(p)≤(1+ε)OPT. The initial upper bound UB0UB_0UB0​ is arbitrary.

Milestones (§3–§4)

  1. Rounding error (§3, p. 38): with δ=Vε/(n−1)\delta=V\varepsilon/(n-1)δ=Vε/(n−1), 0≤cij−δc~ijV≤δ0\le c_{ij}-\delta\tilde c^V_{ij}\le\delta0≤cij​−δc~ijV​≤δ for every edge, and 0≤c(p)−δc~V(p)≤Vε0\le c(p)-\delta\tilde c^V(p)\le V\varepsilon0≤c(p)−δc~V(p)≤Vε for every path.
  2. TEST(V) = NO (§3, p. 38): some TTT-path has length <V(1+ε)<V(1+\varepsilon)<V(1+ε), so OPT<V(1+ε)\mathrm{OPT}<V(1+\varepsilon)OPT<V(1+ε).
  3. TEST(V) = YES (§3, p. 38): every TTT-path has length ≥V\ge V≥V, so OPT≥V\mathrm{OPT}\ge VOPT≥V.
  4. Bound update (§4, p. 39): along the run, LBk>0LB_k>0LBk​>0 and LBkLB_kLBk​ is a lower bound on every TTT-path; if some TTT-path has length at most UB0UB_0UB0​, some TTT-path has length at most UBkUB_kUBk​.
  5. Scaled-optimum error (§4, p. 39): a Step 2 output ppp at any LB>0LB>0LB>0 satisfies c(p)≤c(q)+εLBc(p)\le c(q)+\varepsilon LBc(p)≤c(q)+εLB for every TTT-path qqq.

Companion statements

  • Termination when (1+ε)2<2(1+\varepsilon)^2<2(1+ε)2<2: some stage NNN has UBN≤2LBNUB_N\le 2LB_NUBN​≤2LBN​; and an explicit instance with ε=9/10\varepsilon=9/10ε=9/10 on which Step 1 never stops.
  • Initial bounds (Step 0, p. 39): every 111–nnn path has length between 111 and the sum of the n−1n-1n−1 longest edge-lengths.
  • Algorithms A and B (§2, pp. 37–38): their recursions compute fj(t)f_j(t)fj​(t) and gj(c)g_j(c)gj​(c), with OPT=fn(T)=min⁡{c∣gn(c)≤T}\mathrm{OPT}=f_n(T)=\min\{c\mid g_n(c)\le T\}OPT=fn​(T)=min{c∣gn​(c)≤T}.

Significance

The guarantee makes the Rounding Algorithm a fully polynomial approximation scheme: combined with the paper's running-time analysis, a (1+ε)(1+\varepsilon)(1+ε)-approximate TTT-path is computed in time polynomial in the input size and 1/ε1/\varepsilon1/ε. The two ingredients, an approximate decision test that answers "OPT ≥V\ge V≥V" or "OPT <V(1+ε)<V(1+\varepsilon)<V(1+ε)", and a geometric search on the ratio UB/LBUB/LBUB/LB, are reused in later FPASs for constrained path, knapsack-type and scheduling problems; the milestones isolate them as separate statements.

The result has been proved since 1992 but, as far as a search of the platform and of Mathlib shows, none of it is machine-checked. This mission produces a checked version of the first scheme, stated for every stage at which the printed stopping test holds and every optimal Step 2 output. It also records, as a companion, that the printed Step 1 need not terminate when ε>2−1\varepsilon>\sqrt2-1ε>2​−1, and proves termination under (1+ε)2<2(1+\varepsilon)^2<2(1+ε)2<2.

Difficulty

The arithmetic of each step is short; the difficulty is in the combinatorial facts the page uses without proof and in the bookkeeping of a run. The rounding error of a path is at most VεV\varepsilonVε only because a 111–nnn path has at most n−1n-1n−1 edges, which follows from the numbering i<ji<ji<j and must be derived for list-encoded paths. The YES case must cover TTT-paths through edges that TEST deleted, which the rounding argument does not see. The bound update needs both bounds to stay positive so that (LB⋅UB)1/2(LB\cdot UB)^{1/2}(LB⋅UB)1/2 is a meaningful test point, an invariant of the whole run rather than of one step. A tempting shortcut, assuming that LB is a lower bound on OPT at the stopping stage, would assume milestone 4; the goal assumes it only for LB0LB_0LB0​.

Formalization scope

  • Representation. Vertices are natural numbers; an instance is a structure with nnn, a finite edge set of pairs, and length and time functions, with a well-formedness predicate: n≥2n\ge 2n≥2, every edge (i,j)(i,j)(i,j) has 1≤i<j≤n1\le i<j\le n1≤i<j≤n, and lengths and times are positive. The requirement n≥2n\ge2n≥2 is not printed: a 111–nnn path and the divisions by n−1n-1n−1 presuppose it. Paths are nonempty vertex lists.
  • Arithmetic. n−1n-1n−1 is taken in the reals; ⌊⋅⌋\lfloor\cdot\rfloor⌊⋅⌋ is the natural-number floor of a nonnegative real; (LB⋅UB)1/2(LB\cdot UB)^{1/2}(LB⋅UB)1/2 is the real square root. Bounds and ε\varepsilonε are reals, TTT is a natural number.
  • OPT. OPT is never a number in the formal statements, because it is ∞\infty∞ when no TTT-path exists. "OPT ≥V\ge V≥V" is a bound on every TTT-path, "OPT <V(1+ε)<V(1+\varepsilon)<V(1+ε)" is the existence of a TTT-path, and the goal compares the output with every TTT-path. Algorithms A and B use values in N∪{∞}\mathbb N\cup\{\infty\}N∪{∞}.
  • TEST(V) is defined by the answer the procedure reaches, not through Algorithm B's printed recursion, whose initial condition gj(0)=∞g_j(0)=\inftygj​(0)=∞ is wrong for rounded lengths 000; for n≥2n\ge2n≥2 and ε<1\varepsilon<1ε<1 the answers agree.
  • The run is the iterate of one pass of Step 1; a stopped state is a fixed point. Step 2 outputs any TTT-path optimal for the rounded lengths, without pruning edges, as printed.
  • Added hypothesis. The termination statement assumes (1+ε)2<2(1+\varepsilon)^2<2(1+ε)2<2, which the page does not state; without it the printed loop can run forever, and an explicit instance is included.
  • Not a trivialization. The goal assumes nothing about TEST's correctness, the rounding error or the lower-bound invariant along the run, and the termination companion shows that its stopping hypothesis is reachable.
  • Out of scope. The second, strongly polynomial scheme of §5–§6 is not included, because as printed its Partitioning Algorithm can report infeasibility on a feasible instance and formalizing it would require a corrected algorithm that is not the author's. All running-time claims, stated as O(⋅)O(\cdot)O(⋅) bounds under an informal operation count, are also excluded, as are the V′V'V′ variant of the test points and the scheduling application of §7.
  • Reusable parts. The list-based path layer with two additive weights, and the correctness of the pseudopolynomial recursions of Algorithms A and B, are independent of the approximation scheme. Contributions of proofs for any milestone or companion are welcome.

Selected references

  • R. Hassin, Approximation schemes for the restricted shortest path problem, Mathematics of Operations Research 17(1):36–42, 1992. https://doi.org/10.1287/moor.17.1.36
  • A. Warburton, Approximation of Pareto optima in multiple-objective, shortest-path problems, Operations Research 35(1):70–79, 1987. https://doi.org/10.1287/opre.35.1.70
  • D. H. Lorenz and D. Raz, A simple efficient approximation scheme for the restricted shortest path problem, Operations Research Letters 28(5):213–219, 2001. https://doi.org/10.1016/S0167-6377(01)00069-4
  • M. R. Garey and D. S. Johnson, Computers and Intractability: A Guide to the Theory of NP-Completeness, W. H. Freeman, 1979.
7 thms2 active usersReviewed
🏆Completed
Linear OptimizationOperations ResearchOptimization·Captain: mikedeng1

On Approximate Solutions of Systems of Linear Inequalities: If Ax ≦ b Is Consistent, Every x Has a Solution x₀ with Fₙ(x − x₀) ≦ c·Fₘ((Ax − b)⁺)Research Paper

Motivation

Iterative methods for a system of linear inequalities Ax≤bAx\le bAx≤b stop at a vector xˉ\bar xxˉ that only almost satisfies the system: the violation (Axˉ−b)+(A\bar x-b)^+(Axˉ−b)+ is small but not zero. A user then needs to know that xˉ\bar xxˉ is close to an actual solution. Hoffman's 1952 paper (J. Res. Nat. Bur. Standards 49) gives the first quantitative form of this fact: the distance from xˉ\bar xxˉ to the solution set is at most a fixed multiple of the violation. The paper itself names one application: in Brown's method for solving games, the computed strategy vector approaches the set of optimal strategy vectors.

The result is now known as Hoffman's error bound and the constant as the Hoffman constant. It is a standard tool in convergence analysis, sensitivity analysis of linear programs, and the theory of error bounds.

Timeline.

  • 1952: S. Agmon (The relaxation method for linear inequalities, NAML Report 52-27, NBS; later Canad. J. Math. 6, 1954, doi:10.4153/CJM-1954-037-2) proves the two geometric lemmas on which Hoffman's proof rests, and a bound in the Euclidean/max norm setting.
  • 1952: A. J. Hoffman proves the bound for arbitrary positive homogeneous size functions FnF_nFn​, FmF_mFm​, and gives explicit constants in the max and sum norms by way of matrix games.
  • Later work (Robinson 1973; Güler, Hoffman and Rothblum 1995; Peña, Vera and Zuluaga 2021) extends the bound to perturbed systems, characterises the sharp constant, and studies its computation.

Setting

Let A=(aij)A=(a_{ij})A=(aij​) be a real m×nm\times nm×n matrix with rows A1,…,AmA_1,\dots,A_mA1​,…,Am​ and let b∈Rmb\in\mathbb R^mb∈Rm. The system (1) is Ai⋅x≤biA_i\cdot x\le b_iAi​⋅x≤bi​ for i=1,…,mi=1,\dots,mi=1,…,m, briefly Ax≤bAx\le bAx≤b; its solution set is Ω={x:Ax≤b}\Omega=\{x : Ax\le b\}Ω={x:Ax≤b}, and the system is consistent if Ω≠∅\Omega\ne\emptysetΩ=∅. The iiith half space is {x:Ai⋅x≤bi}\{x : A_i\cdot x\le b_i\}{x:Ai​⋅x≤bi​}.

For a real number aaa, a+=aa^+=aa+=a if a≥0a\ge0a≥0 and a+=0a^+=0a+=0 otherwise; for a vector, y+y^+y+ is taken coordinatewise. So (Ax−b)+(Ax-b)^+(Ax−b)+ records by how much xxx violates each inequality.

Hoffman measures sizes with a positive homogeneous function FkF_kFk​ on Rk\mathbb R^kRk: a continuous real function with (i) Fk(x)≥0F_k(x)\ge0Fk​(x)≥0 and Fk(x)=0F_k(x)=0Fk​(x)=0 only for x=0x=0x=0, and (ii) Fk(αx)=αFk(x)F_k(\alpha x)=\alpha F_k(x)Fk​(αx)=αFk​(x) for α≥0\alpha\ge0α≥0. Norms are examples, but FkF_kFk​ need not be symmetric, subadditive or convex.

For a set SSS of rows, MMM is the m×nm\times nm×n matrix obtained from AAA by replacing the rows outside SSS by 000, and yˉ\bar yyˉ​ keeps the coordinates of y∈Rmy\in\mathbb R^my∈Rm in SSS and zeroes the others. "Nearest" always refers to Euclidean distance. The set EEE consists of the points xxx outside the cone {z:Mz≤0}\{z : Mz\le0\}{z:Mz≤0} whose nearest point in that cone is the origin; K′K'K′ is the cone spanned by the rows of MMM with the origin removed.

Section 3 uses three norms: ∣x∣|x|∣x∣ (largest absolute coordinate), ∥x∥\|x\|∥x∥ (sum of absolute coordinates) and the Euclidean norm. With gij=Ai⋅Ajg_{ij}=A_i\cdot A_jgij​=Ai​⋅Aj​, aSa_SaS​ is the largest absolute coordinate of a row in SSS, and vS=min⁡λmax⁡i∈S∑j∈Sgijλjv_S=\min_\lambda\max_{i\in S}\sum_{j\in S}g_{ij}\lambda_jvS​=minλ​maxi∈S​∑j∈S​gij​λj​ over probability vectors λ\lambdaλ on SSS, the value of the matrix game (gij)i,j∈S(g_{ij})_{i,j\in S}(gij​)i,j∈S​.

Formalization targets

Goal: Hoffman's theorem (Section 2, p. 263)

If Ax≤bAx\le bAx≤b is consistent and FnF_nFn​, FmF_mFm​ are positive homogeneous, there is c>0c>0c>0 such that for every xxx some solution x0x_0x0​ satisfies

Fn(x−x0)≤c Fm((Ax−b)+).F_n(x-x_0)\le c\,F_m\bigl((Ax-b)^+\bigr).Fn​(x−x0​)≤cFm​((Ax−b)+).

The constant is existential and fixed before xxx; no value is asserted. This is the weakest statement that carries the content and survives any later improvement of the constant.

Milestones: the proof's lemmas (pp. 263–264)

  • Lemma 2: if yyy is the point of Ω\OmegaΩ nearest to x∉Ωx\notin\Omegax∈/Ω, then xxx lies outside the intersection ΩS\Omega_SΩS​ of the half spaces active at yyy, and yyy is also the point of ΩS\Omega_SΩS​ nearest to xxx.
  • Lemma 3: for every set SSS of rows there is dS>0d_S>0dS​>0 with Fm((Mx)+)≥dSFn(x)F_m((Mx)^+)\ge d_S F_n(x)Fm​((Mx)+)≥dS​Fn​(x) for all x∈Ex\in Ex∈E.
  • Lemma 1: there is e>0e>0e>0 with Fm(yˉ)≤e Fm(y)F_m(\bar y)\le e\,F_m(y)Fm​(yˉ​)≤eFm​(y) for all yyy and all SSS.
  • Lemma 4: K′=EK'=EK′=E.

Milestones: explicit constants (pp. 264–265)

(9)∣x−x0∣≤av ∣(Ax−b)+∣if all Ai⋅Aj>0, v=min⁡i,jAi⋅Aj, a=max⁡i,j∣aij∣;\text{(9)}\quad |x-x_0|\le\frac{a}{v}\,|(Ax-b)^+|\quad\text{if all }A_i\cdot A_j>0,\ v=\min_{i,j}A_i\cdot A_j,\ a=\max_{i,j}|a_{ij}|;(9)∣x−x0​∣≤va​∣(Ax−b)+∣if all Ai​⋅Aj​>0, v=i,jmin​Ai​⋅Aj​, a=i,jmax​∣aij​∣; (10)∣x−x0∣≤aw ∥(Ax−b)+∥if w=min⁡i(gii+∑j: gij<0gij)>0;\text{(10)}\quad |x-x_0|\le\frac{a}{w}\,\|(Ax-b)^+\|\quad\text{if } w=\min_i\Bigl(g_{ii}+\sum_{j:\,g_{ij}<0}g_{ij}\Bigr)>0;(10)∣x−x0​∣≤wa​∥(Ax−b)+∥if w=imin​(gii​+j:gij​<0∑​gij​)>0; (8)∣x−x0∣≤c ∣(Ax−b)+∣,c=max⁡vS>0aSvS.\text{(8)}\quad |x-x_0|\le c\,|(Ax-b)^+|,\qquad c=\max_{v_S>0}\frac{a_S}{v_S}.(8)∣x−x0​∣≤c∣(Ax−b)+∣,c=vS​>0max​vS​aS​​.

Each is stated as in the theorem: for every xxx there is a solution x0x_0x0​ with the bound.

Significance

The result. The theorem converts a residual estimate into a distance estimate. Any scheme that drives (Ax−b)+(Ax-b)^+(Ax−b)+ to zero brings its iterates to the solution set at a linear rate in the residual. Linear convergence proofs for projection and first-order methods on polyhedral problems and stability results for LP solution sets build on it. Formulas (8)–(10) show that in the max and sum norms the constant can be read off the rows of AAA through a matrix game.

Formalizing it. The theorem has been proved since 1952, and later papers give several alternative proofs. The mission formalizes Hoffman's own proof route, Lemmas 1–4, in Lean and Mathlib, and the explicit constants (8)–(10). Mathlib has Farkas-type results and projections onto closed convex sets in inner product spaces, but no error bound for linear inequality systems, and the Prove2Me library has no statement of Hoffman's theorem.

Difficulty

For a single xxx, a bound is trivial: take x0x_0x0​ the nearest solution and choose ccc accordingly. The whole content is that one ccc works for all xxx, including xxx far from Ω\OmegaΩ and xxx approaching Ω\OmegaΩ along every direction. A compactness argument on {x:Fn(x)=1}\{x : F_n(x)=1\}{x:Fn​(x)=1} alone fails, because the ratio Fn(x−x0)/Fm((Ax−b)+)F_n(x-x_0)/F_m((Ax-b)^+)Fn​(x−x0​)/Fm​((Ax−b)+) is not a continuous function of xxx on a compact set: the nearest solution and the set of active constraints jump as xxx moves. Lemma 3 needs a positive lower bound on a set EEE that is not obviously closed away from the origin; its closedness comes from Lemma 4, i.e. from Farkas' lemma. Since FnF_nFn​, FmF_mFm​ are not norms, no argument using the triangle inequality or symmetry is available. For (8), a set SSS can arise in Lemma 2 with vS=0v_S=0vS​=0 (e.g. x1≤0x_1\le0x1​≤0, −x1≤0-x_1\le0−x1​≤0 in R2\mathbb R^2R2 with x=(1,0)x=(1,0)x=(1,0)), contrary to an unnumbered remark on p. 265; the bound (8) is still true, but that remark cannot be used.

Formalization scope

  • Vectors are Fin k → ℝ, AAA is Matrix (Fin m) (Fin n) ℝ, the system is A *ᵥ x ≤ b (componentwise), and y+y^+y+ is posPartVec y = fun i => max (y i) 0.
  • FnF_nFn​, FmF_mFm​ are arbitrary functions satisfying IsPosHomogeneous (continuity, nonnegativity, vanishing exactly at 000, positive homogeneity); they are never specialised to norms in the goal or Lemmas 1, 3.
  • "Nearest" is Euclidean and written with the dot product: yyy is nearest to xxx in Ω\OmegaΩ if (x−y)⋅(x−y)≤(x−z)⋅(x−z)(x-y)\cdot(x-y)\le(x-z)\cdot(x-z)(x−y)⋅(x−y)≤(x−z)⋅(x−z) for all z∈Ωz\in\Omegaz∈Ω. (Mathlib's dist on Fin n → ℝ is the sup distance and is not used.) Lemmas 2 and 3 take "a nearest point" as hypothesis; since the Euclidean nearest point of a closed convex set is unique, this is the page's "the nearest point".
  • A "subset SSS of the half spaces" is a Finset (Fin m) of row indices; MMM keeps all mmm rows, with zero rows outside SSS.
  • In (8)–(10), ∣x∣|x|∣x∣ is ⨆ i, |x i| and ∥x∥\|x\|∥x∥ is ∑ i, |x i|; minima and maxima over finite index sets are ⨅/⨆ in ℝ, equal to the attained min/max on nonempty sets. vSv_SvS​ is defined directly by (7) as a min over the simplex of a max, for nonempty SSS, so no minimax theorem is needed. In (8), ccc is the maximum over nonempty SSS with vS>0v_S>0vS​>0 and is 000 when there is none (only when A=0A=0A=0). In www, the page's summation range "j=1,…,nj=1,\dots,nj=1,…,n" is read as ranging over the mmm rows, since ggg is indexed by rows.
  • Consistency is a hypothesis of the goal and of (8)–(10).

The quantifier order ∃c>0, ∀x, ∃x0\exists c>0,\ \forall x,\ \exists x_0∃c>0, ∀x, ∃x0​ is part of the statement: a version with ccc chosen after xxx is trivially true and is not this theorem; likewise eee precedes yyy and SSS in Lemma 1 and dSd_SdS​ precedes xxx in Lemma 3.

Infrastructure a complete development needs: existence and the variational characterisation of the Euclidean projection onto a polyhedron in Fin n → ℝ; Farkas' lemma in cone form (published as LinearOptimization.farkas_cone_corollary); compactness of level sets of positive homogeneous functions. The projection and polyhedral-cone lemmas are reusable well beyond this mission. Proofs of any milestone, alternative proofs of the goal, and sharper or equivalent forms of the constants are welcome.

Selected references

  • A. J. Hoffman, On Approximate Solutions of Systems of Linear Inequalities, J. Res. Nat. Bur. Standards 49(4) (1952), 263–265. https://doi.org/10.6028/jres.049.027
  • S. Agmon, The Relaxation Method for Linear Inequalities, Canad. J. Math. 6 (1954), 382–392. https://doi.org/10.4153/CJM-1954-037-2
  • S. M. Robinson, Bounds for error in the solution set of a perturbed linear program, Linear Algebra Appl. 6 (1973), 69–81. https://doi.org/10.1016/0024-3795(73)90007-4
  • O. Güler, A. J. Hoffman, U. G. Rothblum, Approximations to solutions to systems of linear inequalities, SIAM J. Matrix Anal. Appl. 16(2) (1995), 688–696. https://doi.org/10.1137/S0895479892237744
  • J. Peña, J. C. Vera, L. F. Zuluaga, New characterizations of Hoffman constants for systems of linear constraints, Math. Program. 187 (2021), 79–109. https://doi.org/10.1007/s10107-020-01473-6
10 thms2 active usersReviewed
Operations ResearchProbabilityStochastic Systems·Captain: mikedeng1

Shock Models and Wear Processes I: Under Poisson Shocks, Cumulative Nonnegative I.I.D. Damage up to a Fixed Threshold Gives an IHRA Life DistributionResearch Paper

Motivation

Reliability theory classifies life distributions by how they age. The IHRA class (increasing hazard rate average) is the smallest class of life distributions that contains the exponential distributions and is closed under forming coherent systems and taking limits in distribution (Birnbaum, Esary and Marshall 1966). It is therefore the natural class for the lifetime of a system built from components that wear out. A distribution belongs to it when its survival function Fˉ\bar FFˉ satisfies: [Fˉ(t)]1/t[\bar F(t)]^{1/t}[Fˉ(t)]1/t is decreasing in t>0t > 0t>0.

Esary, Marshall and Proschan (Ann. Probability 1 (1973) 627–649) asked where such ageing comes from physically. Their answer is a shock model: a device receives shocks at the epochs of a Poisson process, each shock does random damage, and the device fails when the accumulated damage exceeds its capacity. The central result of their §4, formalized in this mission, is that this model always produces an IHRA life, whatever the damage distribution. In the authors' words, "the IHRA property has been obtained … as an implication of a natural physical model. The only hypothesis imposed upon FFF is that it be the distribution of a nonnegative random variable." The paper is a standard reference of reliability theory and the source of the cumulative damage model used across maintenance and insurance applications.

Setting

Shocks arrive according to a Poisson process with rate λ>0\lambda > 0λ>0. Write Pˉk\bar P_kPˉk​ for the probability that the device survives the first kkk shocks; then 1≥Pˉ0≥Pˉ1≥⋯≥01 \ge \bar P_0 \ge \bar P_1 \ge \dots \ge 01≥Pˉ0​≥Pˉ1​≥⋯≥0 (display (2.2)). Conditioning on the number of shocks in [0,t][0, t][0,t] gives the shock survival function (2.1):

Hˉ(t)=∑k=0∞Pˉk e−λt(λt)kk!,t≥0,\bar H(t) = \sum_{k=0}^{\infty} \bar P_k\, e^{-\lambda t}\frac{(\lambda t)^k}{k!}, \qquad t \ge 0,Hˉ(t)=k=0∑∞​Pˉk​e−λtk!(λt)k​,t≥0,

with Hˉ(t)=1\bar H(t) = 1Hˉ(t)=1 for t<0t < 0t<0. The weights K(k,t)=e−λt(λt)k/k!K(k,t) = e^{-\lambda t}(\lambda t)^k/k!K(k,t)=e−λt(λt)k/k! are the Poisson probabilities.

In the cumulative damage model the iiith shock causes a damage Xi≥0X_i \ge 0Xi​≥0, the damages are independent with common distribution function FFF (so F(z)=0F(z) = 0F(z)=0 for z<0z < 0z<0), and the device survives kkk shocks when X1+⋯+Xk≤xX_1 + \dots + X_k \le xX1​+⋯+Xk​≤x, for a fixed threshold xxx. Hence (4.1)

Pˉk=F(k)(x),k=0,1,…,\bar P_k = F^{(k)}(x), \qquad k = 0, 1, \dots,Pˉk​=F(k)(x),k=0,1,…,

where F(k)F^{(k)}F(k) is the kkk-fold convolution of FFF and F(0)F^{(0)}F(0) is degenerate at 000. A distribution with survival function Fˉ\bar FFˉ is IHRA if [Fˉ(t)]1/t[\bar F(t)]^{1/t}[Fˉ(t)]1/t is decreasing in t>0t > 0t>0; throughout, "decreasing" means non-increasing.

Formalization targets

Goal: Corollary 4.2, display (4.7)

For every distribution FFF on [0,∞)[0,\infty)[0,∞), every λ>0\lambda > 0λ>0 and every threshold xxx,

Hˉ(t)=∑k=0∞e−λt(λt)kk!F(k)(x)is IHRA.\bar H(t) = \sum_{k=0}^\infty e^{-\lambda t}\frac{(\lambda t)^k}{k!} F^{(k)}(x) \quad \text{is IHRA.}Hˉ(t)=k=0∑∞​e−λtk!(λt)k​F(k)(x)is IHRA.

This is the first of the three statements of Corollary 4.2; the second ((4.7a), independent damages FiF_iFi​ that worsen with iii) is an extra item of this mission, and the third ((4.7b), dependent damages satisfying (4.3)–(4.5)) belongs to mission III of this series.

Milestones

  1. (2.6): Hˉ(t)≥Hˉ(0)e−λt\bar H(t) \ge \bar H(0)e^{-\lambda t}Hˉ(t)≥Hˉ(0)e−λt for t≥0t \ge 0t≥0.
  2. Theorem 3.1 (3.4) through the three claims of its proof (p. 633): if 1=Pˉ0≥Pˉ1≥…1 = \bar P_0 \ge \bar P_1 \ge \dots1=Pˉ0​≥Pˉ1​≥… and Pˉk1/k\bar P_k^{1/k}Pˉk1/k​ is decreasing in k≥1k \ge 1k≥1, then Pˉk−ζk\bar P_k - \zeta^kPˉk​−ζk (0≤ζ≤10 \le \zeta \le 10≤ζ≤1) has at most one sign change, from +++ to −-−; this property passes to Hˉ(t)−e−(1−ζ)λt\bar H(t) - e^{-(1-\zeta)\lambda t}Hˉ(t)−e−(1−ζ)λt on t≥0t \ge 0t≥0; hence Hˉ(t)−e−θt\bar H(t) - e^{-\theta t}Hˉ(t)−e−θt has at most one sign change for every θ>0\theta > 0θ>0; and HHH is IHRA.
  3. Lemma 4.1: for FFF on [0,∞)[0,\infty)[0,∞), [F(k)(x)]1/k[F^{(k)}(x)]^{1/k}[F(k)(x)]1/k is decreasing in k=1,2,…k = 1, 2, \dotsk=1,2,….

Further items

Lemma 4.1a and Corollary 4.2 (4.7a); Theorem 4.4 ([F(k)(x)]1/k[F^{(k)}(x)]^{1/k}[F(k)(x)]1/k is constant in kkk iff FFF has no mass in (0,x](0,x](0,x]); Corollary 4.5 ((4.7) is exponential iff FFF has no mass in (0,x](0,x](0,x]); Corollary 4.11 ([P{N(x)≥k}]1/k[P\{N(x) \ge k\}]^{1/k}[P{N(x)≥k}]1/k is decreasing for the count N(x)N(x)N(x) of an ordinary renewal process).

Significance

The goal turns a modelling assumption into a theorem: anyone who models failure as accumulated nonnegative damage under Poisson shocks obtains, without further checks, every consequence of IHRA proved in reliability theory, including the closure of the class under the formation of coherent systems. Theorem 3.1 (3.4) is reusable on its own: it reduces the IHRA property of any Poisson mixture to a discrete condition on the Pˉk\bar P_kPˉk​, and the same scheme drives the first passage result for wear processes (Theorem 4.10, mission III). Lemma 4.1, applied to renewal processes, gives Corollary 4.11, a statement about renewal counts with no shock model in sight.

All results are proved in the paper; none has a machine-checked proof that we know of. The Mathlib library has the Poisson distribution and the convolution of measures, but no reliability classes, no total positivity and no variation diminishing property. The mission's output is a formal proof of the paper's chain of results and, along the way, reusable statements about Poisson mixtures and convolution powers.

Difficulty

Two steps resist a direct argument. The first is the transfer from sequences to functions: knowing that Pˉk−ζk\bar P_k - \zeta^kPˉk​−ζk changes sign at most once says nothing pointwise about the series ∑k(Pˉk−ζk)K(k,t)\sum_k(\bar P_k - \zeta^k)K(k,t)∑k​(Pˉk​−ζk)K(k,t). The paper invokes the variation diminishing property of the totally positive Poisson kernel (Karlin, Total Positivity, 1968), which is not in Mathlib. The second is Lemma 4.1, an inequality between convolution powers of an arbitrary law: no density, moments or continuity may be assumed, atoms at 000 and at xxx are allowed, so any argument through densities or Laplace transforms loses generality. A further subtlety is the passage from "one sign change of Hˉ(t)−e−θt\bar H(t) - e^{-\theta t}Hˉ(t)−e−θt for every θ\thetaθ" to the monotonicity of [Hˉ(t)]1/t[\bar H(t)]^{1/t}[Hˉ(t)]1/t, which needs care where Hˉ\bar HHˉ vanishes.

Formalization scope

  • A distribution FFF with F(z)=0F(z) = 0F(z)=0 for z<0z < 0z<0 is a probability measure μ\muμ on R\mathbb RR with μ(−∞,0)=0\mu(-\infty,0) = 0μ(−∞,0)=0; nothing else is assumed. F(k)F^{(k)}F(k) is the kkk-fold additive convolution of μ\muμ (Mathlib's Measure.conv) starting from the point mass at 000, and F(k)(x)F^{(k)}(x)F(k)(x) is the real number F(k)(−∞,x]F^{(k)}(-\infty,x]F(k)(−∞,x].
  • Hˉ\bar HHˉ is the series (2.1) as a function on R\mathbb RR, equal to 111 on t<0t < 0t<0. It is never defined through a constructed random failure time, and IHRA is never encoded through a condition on the Pˉk\bar P_kPˉk​: the goal concludes that [Hˉ(t)]1/t[\bar H(t)]^{1/t}[Hˉ(t)]1/t is decreasing on t>0t > 0t>0 for the series itself. This rules out the trivializing reading in which the goal unfolds to Lemma 4.1.
  • Powers [Hˉ(t)]1/t[\bar H(t)]^{1/t}[Hˉ(t)]1/t and Pˉk1/k\bar P_k^{1/k}Pˉk1/k​ are real powers with exponent 1/t1/t1/t, 1/k1/k1/k in R\mathbb RR.
  • Hypotheses the paper leaves implicit and the Lean statements make explicit: λ>0\lambda > 0λ>0; Pˉk≥0\bar P_k \ge 0Pˉk​≥0 (the Pˉk\bar P_kPˉk​ are probabilities); in Corollary 4.5, x≥0x \ge 0x≥0 (the threshold is a capacity), and "exponential" includes the degenerate rate 000.
  • Sign change statements about Hˉ\bar HHˉ hold on t≥0t \ge 0t≥0, where the series defines it.
  • The threshold xxx in the goal ranges over all reals, as printed.
  • In Corollary 4.11 the renewal process is given by independent measurable interarrival times with common law μ\muμ, and N(x)=#{k≥1:X1+⋯+Xk≤x}N(x) = \#\{k \ge 1 : X_1 + \dots + X_k \le x\}N(x)=#{k≥1:X1​+⋯+Xk​≤x} takes values in {0,1,…,∞}\{0, 1, \dots, \infty\}{0,1,…,∞}.

A complete development needs: the variation diminishing property of the Poisson kernel (reusable for every Poisson mixture), monotonicity of [F(k)(x)]1/k[F^{(k)}(x)]^{1/k}[F(k)(x)]1/k via convolution integrals, and elementary facts about real powers and sign changes. Proofs of any milestone or extra item, and general total positivity lemmas, are welcome.

Selected references

  • J. D. Esary, A. W. Marshall and F. Proschan, Shock Models and Wear Processes, The Annals of Probability 1(4) (1973) 627–649. https://doi.org/10.1214/aop/1176996891
  • Z. W. Birnbaum, J. D. Esary and A. W. Marshall, A Stochastic Characterization of Wear-Out for Components and Systems, The Annals of Mathematical Statistics 37 (1966) 816–825. https://doi.org/10.1214/aoms/1177699362
  • S. Karlin, Total Positivity, Vol. I, Stanford University Press, 1968.
  • R. E. Barlow and F. Proschan, Mathematical Theory of Reliability, Wiley, 1965. https://doi.org/10.1137/1.9781611971194
8 thms1 active userReviewed
Numerical AnalysisOperations ResearchOptimization·Captain: mikedeng1

Globally Convergent Inexact Newton Methods I: Inexact Newton Backtracking Converges to Every Limit Point Where F′ Is Invertible, That Point Is a Zero of F, and Initial Steps Are Eventually AcceptedResearch Paper

Motivation

Newton's method for a nonlinear system F(x)=0F(x) = 0F(x)=0, with F:Rn→RnF:\mathbb R^n\to\mathbb R^nF:Rn→Rn, solves the linear system F′(xk)sk=−F(xk)F'(x_k)s_k = -F(x_k)F′(xk​)sk​=−F(xk​) at every step. For large systems that solve is itself iterative (a Krylov method such as GMRES), and it is stopped early. The resulting inexact Newton methods, introduced by Dembo, Eisenstat and Steihaug (SIAM J. Numer. Anal. 19 (1982)), accept any step with ∥F(xk)+F′(xk)sk∥≤ηk∥F(xk)∥\|F(x_k)+F'(x_k)s_k\|\le\eta_k\|F(x_k)\|∥F(xk​)+F′(xk​)sk​∥≤ηk​∥F(xk​)∥, where the forcing term ηk∈[0,1)\eta_k\in[0,1)ηk​∈[0,1) controls how accurately the linear system is solved. Their theory is local: it applies once the iterates are near a solution with invertible derivative.

Practical solvers (Newton–Krylov codes in large-scale simulation, nonlinear solver libraries such as PETSc's SNES and SUNDIALS' KINSOL) combine such inexact steps with a globalization, most often backtracking along the step. Eisenstat and Walker (SIAM J. Optim. 4 (1994)) gave the global convergence theory for this combination: what can be said about the iterates from an arbitrary starting point, with no assumption that a solution exists or that F′F'F′ is invertible anywhere.

Timeline. Dembo, Eisenstat and Steihaug (1982) proved local convergence of inexact Newton methods. Dembo and Steihaug (Math. Program. 26 (1983)) studied truncated Newton methods for unconstrained minimization. Brown and Saad (1990) studied globalized Newton–Krylov methods with line searches and model trust regions, under the inner-product norm. Eisenstat and Walker (1994) gave the general framework treated here, for an arbitrary norm. Their 1996 paper (SIAM J. Sci. Comput. 17) proposed the forcing-term choices that are now standard.

Setting

Let EEE be Rn\mathbb R^nRn with an arbitrary norm ∥⋅∥\|\cdot\|∥⋅∥, and let F:E→EF:E\to EF:E→E be continuously differentiable with derivative F′(x)F'(x)F′(x). A point x∗x_*x∗​ is a limit point of (xk)(x_k)(xk​) if every ball Nδ(x∗)={y:∥y−x∗∥<δ}N_\delta(x_*)=\{y:\|y-x_*\|<\delta\}Nδ​(x∗​)={y:∥y−x∗​∥<δ} contains xkx_kxk​ for infinitely many kkk.

Algorithm GIN (global inexact Newton method). Fix t∈(0,1)t\in(0,1)t∈(0,1). At each kkk, find a level ηk∈[0,1)\eta_k\in[0,1)ηk​∈[0,1) and a step sks_ksk​ with

∥F(xk)+F′(xk)sk∥≤ηk∥F(xk)∥(2.1),∥F(xk+sk)∥≤[1−t(1−ηk)] ∥F(xk)∥(2.2),\|F(x_k)+F'(x_k)s_k\|\le\eta_k\|F(x_k)\| \quad (2.1),\qquad \|F(x_k+s_k)\|\le[1-t(1-\eta_k)]\,\|F(x_k)\| \quad (2.2),∥F(xk​)+F′(xk​)sk​∥≤ηk​∥F(xk​)∥(2.1),∥F(xk​+sk​)∥≤[1−t(1−ηk​)]∥F(xk​)∥(2.2),

and set xk+1=xk+skx_{k+1}=x_k+s_kxk+1​=xk​+sk​. Condition (2.1) says that sks_ksk​ reduces the norm of the local linear model by the factor ηk\eta_kηk​. Condition (2.2) asks that ∥F∥\|F\|∥F∥ itself decrease by a fixed fraction ttt of that predicted reduction.

Algorithm MR (minimum reduction method). Fix ηmax⁡∈[0,1)\eta_{\max}\in[0,1)ηmax​∈[0,1) and 0<θmin⁡<θmax⁡<10<\theta_{\min}<\theta_{\max}<10<θmin​<θmax​<1. At step kkk, choose ηˉk∈[0,ηmax⁡]\bar\eta_k\in[0,\eta_{\max}]ηˉ​k​∈[0,ηmax​] and a curve σk\sigma_kσk​ with ∥F(xk)+F′(xk)σk(η)∥≤η∥F(xk)∥\|F(x_k)+F'(x_k)\sigma_k(\eta)\|\le\eta\|F(x_k)\|∥F(xk​)+F′(xk​)σk​(η)∥≤η∥F(xk​)∥ for ηˉk≤η≤1\bar\eta_k\le\eta\le1ηˉ​k​≤η≤1 (5.1). Start at ηk=ηˉk\eta_k=\bar\eta_kηk​=ηˉ​k​. While (2.2) fails for sk=σk(ηk)s_k=\sigma_k(\eta_k)sk​=σk​(ηk​), replace ηk\eta_kηk​ by 1−θ(1−ηk)1-\theta(1-\eta_k)1−θ(1−ηk​) for some θ∈[θmin⁡,θmax⁡]\theta\in[\theta_{\min},\theta_{\max}]θ∈[θmin​,θmax​]. Then set xk+1=xk+σk(ηk)x_{k+1}=x_k+\sigma_k(\eta_k)xk+1​=xk​+σk​(ηk​).

Algorithm INB (inexact Newton backtracking). Choose ηˉk∈[0,ηmax⁡]\bar\eta_k\in[0,\eta_{\max}]ηˉ​k​∈[0,ηmax​] and an inexact Newton step sˉk\bar s_ksˉk​ at level ηˉk\bar\eta_kηˉ​k​. While (2.2) fails, shorten the step, sk←θsks_k\leftarrow\theta s_ksk​←θsk​, and raise the level, ηk←1−θ(1−ηk)\eta_k\leftarrow1-\theta(1-\eta_k)ηk​←1−θ(1−ηk​). INB is MR with the backtracking curve σk(η)=1−η1−ηˉksˉk\sigma_k(\eta)=\frac{1-\eta}{1-\bar\eta_k}\bar s_kσk​(η)=1−ηˉ​k​1−η​sˉk​ (6.1).

An algorithm does not break down if it produces an infinite sequence of iterates, in particular if every while-loop exits.

Formalization targets

Goal: Theorem 6.1 (global convergence of Algorithm INB)

If Algorithm INB does not break down and x∗x_*x∗​ is a limit point of (xk)(x_k)(xk​) at which F′(x∗)F'(x_*)F′(x∗​) is invertible, then

F(x∗)=0,xk→x∗,sk=sˉk and ηk=ηˉk for all sufficiently large k.F(x_*)=0,\qquad x_k\to x_*,\qquad s_k=\bar s_k\ \text{and}\ \eta_k=\bar\eta_k\ \text{for all sufficiently large }k.F(x∗​)=0,xk​→x∗​,sk​=sˉk​ and ηk​=ηˉ​k​ for all sufficiently large k.

The statement assumes no solution, bounded level set, Lipschitz derivative or particular norm. The last clause says that backtracking eventually stops, so the local rate is governed by the forcing terms ηˉk\bar\eta_kηˉ​k​.

Milestones

In attack order:

  1. Lemmas 1.1 and 1.2. Continuity of y↦F′(y)−1y\mapsto F'(y)^{-1}y↦F′(y)−1 at an invertible point, and a uniform linearization error ∥F(z)−F(y)−F′(y)(z−y)∥≤ε∥z−y∥\|F(z)-F(y)-F'(y)(z-y)\|\le\varepsilon\|z-y\|∥F(z)−F(y)−F′(y)(z−y)∥≤ε∥z−y∥ near xxx.
  2. Theorem 3.3. If F(xk)→0F(x_k)\to0F(xk​)→0, the steps satisfy (2.1) with a fixed η\etaη, and ∥F(xk)∥\|F(x_k)\|∥F(xk​)∥ is nonincreasing, then an invertible limit point is a zero and the limit.
  3. Theorem 3.4. A GIN run with ∑k(1−ηk)=∞\sum_k(1-\eta_k)=\infty∑k​(1−ηk​)=∞ has F(xk)→0F(x_k)\to0F(xk​)→0, plus the conclusion of Theorem 3.3 at invertible limit points.
  4. Theorem 3.5. A GIN run converges to a limit point near which ∥sk∥≤Γ(1−ηk)∥F(xk)∥\|s_k\|\le\Gamma(1-\eta_k)\|F(x_k)\|∥sk​∥≤Γ(1−ηk​)∥F(xk​)∥ (3.2).
  5. Lemma 5.1. The while-loop terminates, with 1−ηk≥min⁡{1−ηˉk,θmin⁡δ/(Γ∥F(xk)∥)}1-\eta_k\ge\min\{1-\bar\eta_k,\theta_{\min}\delta/(\Gamma\|F(x_k)\|)\}1−ηk​≥min{1−ηˉ​k​,θmin​δ/(Γ∥F(xk​)∥)}.
  6. MR runs are GIN runs (§5).
  7. Theorem 5.2 for MR. Under ∥σk(η)∥≤Γ(1−η)∥F(xk)∥\|\sigma_k(\eta)\|\le\Gamma(1-\eta)\|F(x_k)\|∥σk​(η)∥≤Γ(1−η)∥F(xk​)∥ near a limit point x∗x_*x∗​ (5.6): F(x∗)=0F(x_*)=0F(x∗​)=0, xk→x∗x_k\to x_*xk​→x∗​, and ηk=ηˉk\eta_k=\bar\eta_kηk​=ηˉ​k​ eventually.
  8. INB runs are MR runs with the curve (6.1), and sk=σk(ηk)s_k=\sigma_k(\eta_k)sk​=σk​(ηk​) throughout the loop (§6).

Further items, which are not milestones: Corollary 6.2 (exact Newton with backtracking takes full Newton steps eventually), Theorem 5.2 for Algorithm TL, Lemma 3.1 (existence of acceptable GIN steps), and Proposition 2.1 (the Goldstein–Armijo alpha condition implies (2.2) in the Euclidean norm).

Significance

The result. Theorem 6.1 is the global convergence guarantee for the inexact Newton backtracking method that Newton–Krylov solvers implement. It separates three outcomes: the iterates diverge, they accumulate only at points where F′F'F′ is singular, or they converge to a solution with invertible derivative and eventually take the unmodified inexact Newton steps. In the third case the local theory of Dembo, Eisenstat and Steihaug applies from some iteration on, so the forcing terms alone set the convergence rate. Theorem 5.2 is the template: §§6–8 of the paper derive the convergence of backtracking, equality-curve and dogleg-type methods from it by verifying (5.6).

Formalizing it. The results are proved on paper and none of them has a machine-checked proof that we know of. The mission produces a library of algorithm-run predicates with explicit while-loops for inexact Newton methods. It also checks the paper's reduction chain (INB is a run of MR, MR is a run of GIN) and the global convergence theorems in an arbitrary finite-dimensional norm.

Difficulty

The obvious argument fails at both ends. Sufficient decrease (2.2) alone gives monotonicity of ∥F(xk)∥\|F(x_k)\|∥F(xk​)∥, but not convergence of the iterates. On the page, F(x)=x2−1F(x)=x^2-1F(x)=x2−1 admits sequences satisfying (2.2) with both ±1\pm1±1 as limit points. Convergence of ∥F(xk)∥\|F(x_k)\|∥F(xk​)∥ to 000 needs ∑(1−ηk)=∞\sum(1-\eta_k)=\infty∑(1−ηk​)=∞, and nothing in the algorithm states this. In Theorem 5.2 it has to be derived from the exit level of the while-loop, which depends on a neighbourhood of x∗x_*x∗​ where the linearization error is uniformly controlled. A solver must combine a limit-point argument (only infinitely many iterates are near x∗x_*x∗​, not all of them) with the loop's worst-case backtracking factor θmin⁡\theta_{\min}θmin​. The invertibility of F′(x∗)F'(x_*)F′(x∗​) enters only through the bound (5.6) for the backtracking curve, which must be established uniformly in kkk.

Formalization scope

  • Space and norm. EEE is a finite-dimensional real normed space ([NormedAddCommGroup E] [NormedSpace ℝ E] [FiniteDimensional ℝ E]). This is exactly "Rn\mathbb R^nRn with an arbitrary norm". Fin n → ℝ (sup norm) and EuclideanSpace would each fix one norm. Only Proposition 2.1 assumes an inner product space, as the page does.
  • Derivative. F′F'F′ is fderiv ℝ F, with ContDiff ℝ 1 F (the paper's standing assumption). Invertibility is ContinuousLinearMap.IsInvertible, and F′(x)−1F'(x)^{-1}F′(x)−1 is ContinuousLinearMap.inverse.
  • Runs. An algorithm that does not break down is a predicate on infinite sequences (IsGINRun, IsMRRun, IsINBRun, plus IsTLRun, IsENBRun). The steps and levels the algorithm says to "find" or "choose" are data constrained only by the stated conditions. A while-loop is recorded by its number of passes mkm_kmk​ and factors θk,j∈[θmin⁡,θmax⁡]\theta_{k,j}\in[\theta_{\min},\theta_{\max}]θk,j​∈[θmin​,θmax​]. Every trial before the last fails the loop's test and the last one passes it. Termination is part of the run.
  • Limit point is MapClusterPt xstar atTop x. "For all sufficiently large kkk" is ∀ᶠ k in atTop. The paper's "whenever xkx_kxk​ is sufficiently near x∗x_*x∗​ [and kkk is sufficiently large]" is ∃ Γ, ∃ δ > 0, [∃ K,] ∀ k [≥ K], x k ∈ ball xstar δ → …. Γ\GammaΓ precedes kkk ("independent of kkk"), and the "kkk large" clause appears only in (3.2), where the page has it.
  • Hypotheses as printed. Theorems 3.5 and 5.2 do not assume F′(x∗)F'(x_*)F′(x∗​) invertible. Theorem 5.2 does not assume ∑(1−ηk)=∞\sum(1-\eta_k)=\infty∑(1−ηk​)=∞. Lemma 5.1 is stated for one iteration of the loop shared by MR and TL, for every choice of factors.
  • Trivializing readings ruled out. A run predicate without the "rejected" clause would allow needless backtracking, and one without the "accepted" clause would drop (2.2). Both clauses are present. A sorry-free check (F = id on R\mathbb RR) confirms that the INB, GIN and ENB run predicates and the goal's hypotheses are satisfiable, so the goal is not vacuous.
  • Infrastructure. Continuity of operator inversion and uniform differentiability on neighbourhoods are in Mathlib. The run predicates and trial-level recursions are reusable for any line-search or backtracking analysis. Each milestone is stated independently; contributions in any order are welcome.

Selected references

  • S. C. Eisenstat and H. F. Walker, Globally Convergent Inexact Newton Methods, SIAM J. Optim. 4(2) (1994) 393–422. https://doi.org/10.1137/0804022
  • R. S. Dembo, S. C. Eisenstat and T. Steihaug, Inexact Newton Methods, SIAM J. Numer. Anal. 19(2) (1982) 400–408. https://doi.org/10.1137/0719025
  • R. S. Dembo and T. Steihaug, Truncated-Newton algorithms for large-scale unconstrained optimization, Math. Program. 26 (1983) 190–212. https://doi.org/10.1007/BF02592055
  • P. N. Brown and Y. Saad, Hybrid Krylov Methods for Nonlinear Systems of Equations, SIAM J. Sci. Stat. Comput. 11(3) (1990) 450–481. https://doi.org/10.1137/0911026
  • S. C. Eisenstat and H. F. Walker, Choosing the Forcing Terms in an Inexact Newton Method, SIAM J. Sci. Comput. 17(1) (1996) 16–32. https://doi.org/10.1137/0917003
  • J. E. Dennis and R. B. Schnabel, Numerical Methods for Unconstrained Optimization and Nonlinear Equations, SIAM Classics in Applied Mathematics 16 (1996). https://doi.org/10.1137/1.9781611971200
12 thms1 active userReviewed
PreviousNext

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me