Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Operations Research

1,660 missions · 837 completed

The discipline of applying mathematical analysis to complex decision problems in operations: allocating scarce resources, scheduling, routing, inventory, and the design of service and production systems. Drawing on mathematical programming, stochastic modeling, queueing, simulation, and game-theoretic reasoning, it seeks policies that perform provably well in systems shaped by constraints, congestion, and uncertainty.

Missions

Open823Completed837All1660
Dynamic ProgrammingMarkov ChainProbability·Captain: mikedeng1

Inventory Control in a Fluctuating Demand Environment III: Under Stochastic Monotonicity, the Myopic and Optimal Basestock Levels Are Nondecreasing in the World StateResearch Paper

Motivation

Demand for many products does not arrive at a constant rate. It moves with an underlying environment: the economy, the season, a product's life-cycle stage, the state of a customer's own operations. Song and Zipkin (Oper. Res. 41(2):351–370, 1993) modelled this environment as a continuous-time Markov chain, the world, whose current state sets the Poisson demand rate, and showed that a basestock policy whose level depends on the current world state is optimal under linear order costs. Missions I and II of this series formalize those optimality results.

A practitioner who uses such a policy wants to know how the levels depend on the world. If a higher world state means more demand now and more demand later, a higher level should be kept. That is what intuition says, but the optimal level depends on the whole future of the world chain, not only on the current demand rate. §4 of the paper answers it for a world with an arbitrary partial order, which covers several independent demand drivers at once.

Setting

The world AAA is a continuous-time Markov chain on a countable set I\mathbf II with generator Q=(qij)Q = (q_{ij})Q=(qij​), qi=−qiiq_i = -q_{ii}qi​=−qii​, and bounded rates q∗=sup⁡iqiq^* = \sup_i q_iq∗=supi​qi​, λ∗=sup⁡iλi\lambda^* = \sup_i \lambda_iλ∗=supi​λi​. While A=iA = iA=i, unit demands arrive at rate λi\lambda_iλi​, all demand is backlogged, and orders arrive after a random lead time LLL that is independent of the world and the demand. Costs are discounted at rate α>0\alpha > 0α>0. With the unit order cost cˉ\bar ccˉ, holding rate hhh and penalty rate ppp, set c=cˉ E[e−αL]c = \bar c\,E[e^{-\alpha L}]c=cˉE[e−αL] and

C^(x)=max⁡{−px, hx},C(i,y)=E[e−αLC^(y−DLi)],\hat C(x) = \max\{-px,\ hx\}, \qquad C(i,y) = E\big[e^{-\alpha L}\hat C(y - D^i_L)\big],C^(x)=max{−px, hx},C(i,y)=E[e−αLC^(y−DLi​)],

where DLiD^i_LDLi​ is the demand during a lead time when the world starts in iii. Uniformizing at a rate μ≥q∗+λ∗\mu \ge q^* + \lambda^*μ≥q∗+λ∗ with β=1/(μ+α)\beta = 1/(\mu+\alpha)β=1/(μ+α) and γ=βμ\gamma = \beta\muγ=βμ, the myopic cost is G+(i,y)=(1−γ)cy+βC(i,y)G^+(i,y) = (1-\gamma)cy + \beta C(i,y)G+(i,y)=(1−γ)cy+βC(i,y). The linear-cost model (K=0K = 0K=0) is solved by value iteration from W0≡0W_0 \equiv 0W0​≡0:

Gn(i,y)=G+(i,y)+βλic+β{λiWn−1(i,y−1)+∑j≠iqijWn−1(j,y)+(μ−λi−qi)Wn−1(i,y)},G_n(i,y) = G^+(i,y) + \beta\lambda_i c + \beta\Big\{\lambda_i W_{n-1}(i,y-1) + \sum_{j\ne i} q_{ij}W_{n-1}(j,y) + (\mu-\lambda_i-q_i)W_{n-1}(i,y)\Big\},Gn​(i,y)=G+(i,y)+βλi​c+β{λi​Wn−1​(i,y−1)+j=i∑​qij​Wn−1​(j,y)+(μ−λi​−qi​)Wn−1​(i,y)},

Wn(i,x)=min⁡y≥xGn(i,y)W_n(i,x) = \min_{y\ge x} G_n(i,y)Wn​(i,x)=miny≥x​Gn​(i,y), with limits G∞G_\inftyG∞​ and W∞W_\inftyW∞​. The myopic level y+(i)y^+(i)y+(i), the finite-horizon levels yn∗(i)y^*_n(i)yn∗​(i) and the optimal level y∗(i)y^*(i)y∗(i) are the smallest minimizers of G+(i,⋅)G^+(i,\cdot)G+(i,⋅), Gn(i,⋅)G_n(i,\cdot)Gn​(i,⋅) and G∞(i,⋅)G_\infty(i,\cdot)G∞​(i,⋅), and y∞∗(i)=lim⁡nyn∗(i)y^*_\infty(i) = \lim_n y^*_n(i)y∞∗​(i)=limn​yn∗​(i). Throughout, αcˉ<p\alpha\bar c < pαcˉ<p (Assumption 1).

The world states carry a partial order ⪯\preceq⪯. The chain is stochastically partial-monotone (display (14)) if for every i⪯ji \preceq ji⪯j there is a probability space carrying copies of AAA started at iii and at jjj whose paths satisfy A(t)⪯A′(t)A(t) \preceq A'(t)A(t)⪯A′(t) for all t≥0t \ge 0t≥0 almost surely. Condition 1 requires this together with λi\lambda_iλi​ nondecreasing in iii.

Formalization targets

Goal: Theorem 8

Under Condition 1, the three families of levels exist and are nondecreasing along ⪯\preceq⪯:

i⪯j ⟹ y+(i)≤y+(j),y∗(i)≤y∗(j),y∞∗(i)≤y∞∗(j).i \preceq j \ \Longrightarrow\ y^+(i) \le y^+(j),\qquad y^*(i) \le y^*(j),\qquad y^*_\infty(i) \le y^*_\infty(j).i⪯j ⟹ y+(i)≤y+(j),y∗(i)≤y∗(j),y∞∗​(i)≤y∞∗​(j).

Milestones

  • Lemma 8, with its fixed-lead-time form from the proof: D(l)D(l)D(l) given A(0)=iA(0)=iA(0)=i is stochastically smaller than given A(0)=jA(0)=jA(0)=j for each l≥0l \ge 0l≥0, and DLi≤stDLjD^i_L \le_{st} D^j_LDLi​≤st​DLj​.
  • Lemma 9: ΔC(i,y)≥ΔC(j,y)\Delta C(i,y) \ge \Delta C(j,y)ΔC(i,y)≥ΔC(j,y) for i⪯ji \preceq ji⪯j.
  • Theorem 7: for all n≥1n \ge 1n≥1 and fixed xxx, ΔWn−1(i,x)\Delta W_{n-1}(i,x)ΔWn−1​(i,x) and ΔGn(i,x)\Delta G_n(i,x)ΔGn​(i,x) are nonincreasing in iii, and yn∗(i)y^*_n(i)yn∗​(i) is nondecreasing in iii.
  • Theorem 9 (companion): if qij≠0q_{ij} \ne 0qij​=0 only for j⪰ij \succeq ij⪰i, then y∗(i)=y+(i)y^*(i) = y^+(i)y∗(i)=y+(i), so the myopic policy is optimal.
  • Theorem 10 (companion): with a fixed order cost K>0K > 0K>0, the bounds S+(i)S^+(i)S+(i), r+(i)r^+(i)r+(i), r−(i)r^-(i)r−(i), r−−(i)r^{--}(i)r−−(i) on the optimal (r,S)(r,S)(r,S) parameters are nondecreasing in iii.

Significance

Theorem 8 turns an optimal policy into a structured one. A world-dependent basestock policy has one level per world state; monotonicity says the levels follow the order of the states, which reduces search, makes the levels interpretable, and gives sanity checks for computed solutions. Theorem 9 identifies when nothing beyond the one-step cost needs to be computed at all. Theorem 10 is the paper's substitute for an open question: the authors could not show that the optimal (r,S)(r,S)(r,S) parameters are monotone, and instead bound them between monotone functions.

All of these results are proved in the paper. None of them has been machine-checked. The formalization requires a value-iteration argument for a model with unbounded one-period costs, a coupling argument for Markov-modulated Poisson demand, and the passage to the limit in the levels. These are the ingredients of most monotone-policy results in inventory theory with Markov-modulated demand.

Difficulty

The obvious argument fails at the generator. For a single scalar world, stochastic monotonicity is equivalent to the expectation inequality (15) for nondecreasing functions, and the inductive step of Theorem 7 only needs that. For a partial order, the expectation inequality is strictly weaker than the coupling (14) (Massey 1987). The induction must also handle the cross term ∑jqijΔWn−1(j,x)\sum_j q_{ij}\Delta W_{n-1}(j,x)∑j​qij​ΔWn−1​(j,x), which requires an embedded discrete-time chain whose one-step kernel preserves the order. The paper's Lemma 7 asserts that the embedded chain P=I+Q/νP = I + Q/\nuP=I+Q/ν is monotone for every ν≥q∗\nu \ge q^*ν≥q∗. As printed, this is false at ν=q∗\nu = q^*ν=q∗: for two states with q01=q10=1q_{01} = q_{10} = 1q01​=q10​=1, PPP swaps the states. A complete proof cannot rely on that lemma as printed.

A second difficulty is that the one-period cost is unbounded. The classical theorems that ordered differences survive value iteration (Denardo, Lovejoy) assume bounded costs, so the induction has to be carried out by hand, and the limits G∞G_\inftyG∞​, y∞∗y^*_\inftyy∞∗​ must be justified by Lemma 4's uniform bounds.

Formalization scope

The Lean development lives in the namespace SongZipkinFluct.Monotone. World states form a countable nonempty type with a PartialOrder instance; no linear order is assumed. Inventory positions are integers. The demand-count law fi(d∣l)f_i(d\mid l)fi​(d∣l) and the world transition function P(t)P(t)P(t) are defined by uniformization at the model's rate μ\muμ, the paper's own device. The lead-time law is a probability measure on [0,∞)[0,\infty)[0,∞), and C(i,y)C(i,y)C(i,y) is the series ∑dgi(d∣α)C^(y−d)\sum_d g_i(d\mid\alpha)\hat C(y-d)∑d​gi​(d∣α)C^(y−d) of display (16). WnW_nWn​ uses an infimum over integers y≥xy \ge xy≥x, and W∞W_\inftyW∞​, G∞G_\inftyG∞​ are suprema over nnn, which equal the limits because the sequences are nondecreasing and bounded. Monotonicity in iii is Monotone/Antitone with respect to ⪯\preceq⪯. Smallest minimizers, maxima and minima are IsLeast/IsGreatest characterizations, never sInf on Z\mathbb ZZ.

Condition 1(a) is encoded as the coupling (14) itself, with one probability space per pair i⪯ji \preceq ji⪯j and copies identified by their finite-dimensional distributions. Replacing it by the expectation inequality (15), or the partial order by a total order, would change the theorem and is ruled out. Every goal statement asserts the existence of the levels it constrains before constraining them, so no conclusion holds vacuously. The standing hypotheses together with Condition 1 are satisfiable: a one-state instance is checked in Lean.

Lemma 7 is not included because it is false as printed. A guarded version (for instance with ν≥2q∗\nu \ge 2q^*ν≥2q∗) would be a welcome contribution. Reusable parts include the uniformized Markov-modulated Poisson process, the coupling definition of stochastic monotonicity for a countable partially ordered state space, and the usual stochastic order on N\mathbb NN. Proofs of Lemma 9 and Theorem 7 that avoid Lemma 7 are particularly welcome.

Selected references

  • J.-S. Song and P. Zipkin, Inventory Control in a Fluctuating Demand Environment, Operations Research 41(2):351–370, 1993. https://doi.org/10.1287/opre.41.2.351
  • W. A. Massey, Stochastic orderings for Markov processes on partially ordered spaces, Mathematics of Operations Research 12(2):350–367, 1987. https://doi.org/10.1287/moor.12.2.350
  • J. Keilson and A. Kester, Monotone matrices and monotone Markov processes, Stochastic Processes and their Applications 5(3):231–241, 1977. https://doi.org/10.1016/0304-4149(77)90033-3
  • A. F. Veinott Jr., Optimal policy for a multi-product, dynamic, nonstationary inventory problem, Management Science 12(3):206–222, 1965. https://doi.org/10.1287/mnsc.12.3.206
  • W. S. Lovejoy, Ordered solutions for dynamic programs, Mathematics of Operations Research 12(2):269–276, 1987. https://doi.org/10.1287/moor.12.2.269
11 thms1 active userReviewed
ProbabilityStatistics·Captain: mikedeng1

Some Aspects of the Sequential Design of Experiments III: Optional Stopping — P(Sₙ > αn^½ for Some n₁ ≤ n ≤ n₂) < (1 − Φ(α))/(1 − Φ(α(λ^½ − 1)/(λ − 1)^½))Research Paper

Optional stopping and the size of a test

Section 4 of Herbert Robbins's 1952 address Some aspects of the sequential design of experiments (Bull. Amer. Math. Soc. 58, 527–535, doi:10.1090/S0002-9904-1952-09620-8) isolates a problem that every user of significance tests meets: if the sample size is not fixed in advance, an experimenter can keep sampling until the test rejects. Robbins shows that a fixed-sample test then loses all control of its error probability, and he proposes the compromise of allowing the sample size to range over a window n1≤n≤n2n_1\le n\le n_2n1​≤n≤n2​, with an explicit bound on the resulting error.

The question is still current. "Optional stopping" and "peeking" at accumulating data are a standard concern in clinical trials and online A/B testing, and the modern theory of always-valid inference and confidence sequences (for example Howard, Ramdas, McAuliffe and Sekhon, Time-uniform, nonparametric, nonasymptotic confidence sequences, Ann. Statist. 49 (2021), arXiv:1810.08240) answers exactly the question Robbins raises: how large is the probability that a running statistic crosses a boundary at some time in a range. The earlier treatment Robbins cites is Feller's 1940 discussion of the statistics of ESP experiments.

Setting

Let x1,x2,…x_1,x_2,\dotsx1​,x2​,… be independent real random variables on a probability space (Ω,F,P)(\Omega,\mathcal F,P)(Ω,F,P), each normal with mean 000 and variance 111. This is the null hypothesis H0:θ=0H_0:\theta=0H0​:θ=0 for observations that are normal with unknown mean θ\thetaθ and unit variance; the alternative is H1:θ>0H_1:\theta>0H1​:θ>0. Write

Sn=x1+⋯+xn,S0=0.S_n=x_1+\cdots+x_n,\qquad S_0=0 .Sn​=x1​+⋯+xn​,S0​=0.

The fixed-sample test of size nnn rejects H0H_0H0​ if and only if

Sn>αn1/2(21)S_n>\alpha n^{1/2}\qquad(21)Sn​>αn1/2(21)

for a real constant α\alphaα. (In this mission α\alphaα always denotes this test constant; in Section 2 of the paper the same letter is the mean of a coin.) The standard normal distribution function is

Φ(x)=1(2π)1/2∫−∞xe−t2/2 dt.(23)\Phi(x)=\frac{1}{(2\pi)^{1/2}}\int_{-\infty}^{x}e^{-t^2/2}\,dt .\qquad(23)Φ(x)=(2π)1/21​∫−∞x​e−t2/2dt.(23)

For integers n1≤n2n_1\le n_2n1​≤n2​ the window probability is

g(n1,n2,α)=P[Sn>αn1/2 for some n1≤n≤n2],(24)g(n_1,n_2,\alpha)=P\bigl[S_n>\alpha n^{1/2}\ \text{for some}\ n_1\le n\le n_2\bigr],\qquad(24)g(n1​,n2​,α)=P[Sn​>αn1/2 for some n1​≤n≤n2​],(24)

and λ=n2/n1\lambda=n_2/n_1λ=n2​/n1​. In Lean these are Phi, S X n ω = ∑ i ∈ Finset.range n, X i ω and g P X n₁ n₂ α, in the namespace RobbinsSeqDesign.OptionalStopping.

Formalization targets

Goal: the window bound (25)

For integers 1≤n1<n21\le n_1<n_21≤n1​<n2​ and every real α\alphaα, with λ=n2/n1\lambda=n_2/n_1λ=n2​/n1​,

g(n1,n2,α)<1−Φ(α)1−Φ ⁣(α⋅λ1/2−1(λ−1)1/2).g(n_1,n_2,\alpha)<\frac{1-\Phi(\alpha)}{1-\Phi\!\Bigl(\alpha\cdot\dfrac{\lambda^{1/2}-1}{(\lambda-1)^{1/2}}\Bigr)} .g(n1​,n2​,α)<1−Φ(α⋅(λ−1)1/2λ1/2−1​)1−Φ(α)​.

The inequality is strict, as printed, and holds for every real α\alphaα, not only the large values of practical interest.

Milestone: the fixed-sample error (22)

For every n≥1n\ge1n≥1 and real α\alphaα,

ε(α)=P[Sn>αn1/2]=1−Φ(α).\varepsilon(\alpha)=P\bigl[S_n>\alpha n^{1/2}\bigr]=1-\Phi(\alpha).ε(α)=P[Sn​>αn1/2]=1−Φ(α).

Milestone: rejection infinitely often

For every real α\alphaα, with probability 111 the inequality Sn>αn1/2S_n>\alpha n^{1/2}Sn​>αn1/2 holds for infinitely many nnn.

Significance

The results. (22) says that the fixed-sample test has error probability 1−Φ(α)1-\Phi(\alpha)1−Φ(α) whatever nnn is. The infinitely-often statement says that this guarantee is void under unrestricted optional stopping: sampling until (21) holds rejects a true H0H_0H0​ with probability one, however large α\alphaα is. The goal (25) quantifies the compromise: if the stopping time is confined to [n1,n2][n_1,n_2][n1​,n2​], the error probability is at most the fixed-sample error divided by 1−Φ(αcλ)1-\Phi(\alpha c_\lambda)1−Φ(αcλ​), where cλ=(λ1/2−1)/(λ−1)1/2<1c_\lambda=(\lambda^{1/2}-1)/(\lambda-1)^{1/2}<1cλ​=(λ1/2−1)/(λ−1)1/2<1 depends only on the window's ratio. For large α\alphaα and moderate λ\lambdaλ this keeps the error of the same order as the fixed-sample error; Robbins notes that it is useful when λ\lambdaλ is not too large and that sharper inequalities can be devised.

Formalizing it. The three statements are classical and their proofs are short on paper, but none is machine-checked for Gaussian partial sums. The goal needs stopping-time machinery for discrete-time Gaussian random walks; the infinitely-often statement is a consequence of the lower half of the law of the iterated logarithm, which Mathlib does not contain. On the platform, DurrettProbability.brownian_limsup_sqrt (proved) gives lim sup⁡tBt/t=∞\limsup_t B_t/\sqrt t=\inftylimsupt​Bt​/t​=∞ for Brownian motion, a different process, and AzumaWeightedSums.IteratedLog.theorem2_limsup_le_one gives an upper iterated-logarithm bound for weighted sums, the opposite direction; neither states any of the targets here, but both are related infrastructure.

Difficulty

The goal is a maximal inequality over a window of times. The obvious argument, a union bound over n1≤n≤n2n_1\le n\le n_2n1​≤n≤n2​, gives (n2−n1+1)(1−Φ(α))(n_2-n_1+1)(1-\Phi(\alpha))(n2​−n1​+1)(1−Φ(α)), which grows with the window length instead of depending on λ\lambdaλ alone, and exceeds 111 for long windows. The events {Sn>αn1/2}\{S_n>\alpha n^{1/2}\}{Sn​>αn1/2} for different nnn are strongly dependent, and the boundary αn1/2\alpha n^{1/2}αn1/2 is curved, so the bound has to account for when, inside the window, the boundary is first crossed; this requires stopping-time arguments for a discrete-time walk that are not yet available for Gaussian random walks in Mathlib. The strictness of the inequality also has to be tracked through the argument. The infinitely-often statement cannot be obtained from the central limit theorem alone, which gives only P(Sn>αn1/2 i.o.)≥1−Φ(α)>0P(S_n>\alpha n^{1/2}\ \text{i.o.})\ge 1-\Phi(\alpha)>0P(Sn​>αn1/2 i.o.)≥1−Φ(α)>0; upgrading this to probability one needs a zero–one law or the law of the iterated logarithm.

Formalization scope

The observations are X : ℕ → Ω → ℝ on a probability space (Ω, P) with [IsProbabilityMeasure P], iIndepFun X P and ∀ i, HasLaw (X i) (gaussianReal 0 1) P; the paper's xix_ixi​ is X (i - 1). The explicit readings committed to are:

  • Φ\PhiΦ is the integral printed in (23) (a local check shows it equals Mathlib's cdf (gaussianReal 0 1)).
  • "The probability of rejecting H0H_0H0​" is P.real of the event; (22) is stated for n≥1n\ge1n≥1.
  • "With probability 1 … for infinitely many values of nnn" is ∀ᵐ ω ∂P, ∃ᶠ n in atTop, α * √n < S X n ω, for every real α\alphaα.
  • The window of (24) is n1≤n≤n2n_1\le n\le n_2n1​≤n≤n2​ with both endpoints; the stray comma printed in "n1,≤nn_1, \le nn1​,≤n" is a typesetting slip.
  • In (25), λ\lambdaλ is the real quotient n2/n1n_2/n_1n2​/n1​, and the hypotheses 1≤n1<n21\le n_1<n_21≤n1​<n2​ make λ>1\lambda>1λ>1 well defined; the inequality is strict and there is no sign restriction on α\alphaα.
  • The numeric example "α=3.09\alpha=3.09α=3.09 then ε(α)≅.001\varepsilon(\alpha)\cong .001ε(α)≅.001" and the phrase "useful when λ\lambdaλ is not too large" are not formalized.

A trivializing formalization is ruled out: ggg is the probability of the union over the whole window (not the event at n=n2n=n_2n=n2​ alone), Φ\PhiΦ is the fixed standard normal distribution function (not an arbitrary monotone function), and the parameter range excludes λ=1\lambda=1λ=1, where Lean's convention x/0=0x/0=0x/0=0 would replace the right side by 2(1−Φ(α))2(1-\Phi(\alpha))2(1−Φ(α)).

A complete development needs the law of a sum of independent Gaussians, the strong Markov property of a Gaussian random walk at a stopping time (or an equivalent first-passage decomposition), and, for the infinitely-often milestone, either the lower law of the iterated logarithm for Gaussian walks or the Hewitt–Savage/Kolmogorov zero–one law combined with the central limit theorem. These pieces are reusable well beyond this mission; contributions of any of them, as separate lemmas, are welcome.

Selected references

  • H. Robbins, Some aspects of the sequential design of experiments, Bull. Amer. Math. Soc. 58 (1952), 527–535. https://doi.org/10.1090/S0002-9904-1952-09620-8
  • W. Feller, Statistical aspects of ESP, J. Parapsychology 4 (1940), 271–298 (reference [11] of the paper).
  • S. R. Howard, A. Ramdas, J. McAuliffe, J. Sekhon, Time-uniform, nonparametric, nonasymptotic confidence sequences, Ann. Statist. 49 (2021), 1055–1080. https://arxiv.org/abs/1810.08240
4 thms1 active userReviewed
Convex OptimizationLinear OptimizationOptimization·Captain: mikedeng1

Convex Programming with Set-Inclusive Constraints and Applications to Inexact Linear Programming: The Set-Inclusive LP Has the Same Feasible Set as the LP of Support FunctionalsResearch Paper

Motivation

A linear program max⁡c⋅x\max c\cdot xmaxc⋅x subject to Ax≤bAx\le bAx≤b, x≥0x\ge 0x≥0 assumes that the constraint matrix AAA is known exactly. In practice the columns of AAA — the activity vectors, describing how much of each resource one unit of activity jjj consumes — are estimates. A. L. Soyster's 1973 technical note in Operations Research (doi:10.1287/opre.21.5.1154) asked what a decision xxx should satisfy if every activity vector is known only to lie in a given convex set, and the decision has to be feasible for every possible realisation. He called this inexact linear programming, a term he attributes to K. O. Kortanek.

The note is the earliest formulation of what is now called robust linear optimization. Its answer — replace each uncertain column by its coordinatewise worst case — is the "Soyster model" that later work on robust optimization takes as its point of departure: Ben-Tal and Nemirovski (Math. Oper. Res. 1998; Math. Program. 2000) and Bertsimas and Sim (Oper. Res. 2004) both introduce their less conservative uncertainty sets as alternatives to it.

Setting

Fix integers m,n≥0m,n\ge0m,n≥0. Vectors in Rm\mathbb R^mRm are compared componentwise. For a set S⊆RmS\subseteq\mathbb R^mS⊆Rm and a scalar ttt, tS={ta:a∈S}tS=\{ta: a\in S\}tS={ta:a∈S}, and the sum of sets is Minkowski addition, S+T={s+t:s∈S, t∈T}S+T=\{s+t: s\in S,\ t\in T\}S+T={s+t:s∈S, t∈T}.

Let K1,…,Kn⊆RmK_1,\dots,K_n\subseteq\mathbb R^mK1​,…,Kn​⊆Rm be nonempty convex activity sets and K⊆RmK\subseteq\mathbb R^mK⊆Rm a nonempty convex resource set. Problem (I) is

sup⁡ c⋅xsubject tox1K1+x2K2+⋯+xnKn⊆K,xj≥0,\sup\ c\cdot x\quad\text{subject to}\quad x_1K_1+x_2K_2+\cdots+x_nK_n\subseteq K,\quad x_j\ge0,sup c⋅xsubject tox1​K1​+x2​K2​+⋯+xn​Kn​⊆K,xj​≥0,

and X⊆RnX\subseteq\mathbb R^nX⊆Rn denotes its set of feasible xxx. Problem (Ib) is the special case K=K(b)={y∈Rm:y≤b}K=K(b)=\{y\in\mathbb R^m: y\le b\}K=K(b)={y∈Rm:y≤b} for a right-hand side b∈Rmb\in\mathbb R^mb∈Rm.

The support functional of a set SSS is δ∗(y∣S)=sup⁡a∈Sy⋅a\delta^*(y\mid S)=\sup_{a\in S}y\cdot aδ∗(y∣S)=supa∈S​y⋅a, a value in [−∞,+∞][-\infty,+\infty][−∞,+∞]. With eie_iei​ the iii-th unit vector, the auxiliary matrix Aˉ\bar AAˉ is the m×nm\times nm×n matrix with entries

aˉij=δ∗(ei∣Kj)=sup⁡aj∈Kjaij,\bar a_{ij}=\delta^*(e_i\mid K_j)=\sup_{a_j\in K_j}a_{ij},aˉij​=δ∗(ei​∣Kj​)=aj​∈Kj​sup​aij​,

defined when all of these are finite, and LP(Aˉ)(\bar A)(Aˉ) is the linear program max⁡c⋅x\max c\cdot xmaxc⋅x subject to Aˉx≤b\bar Ax\le bAˉx≤b, x≥0x\ge0x≥0. Finally MMM is the set of m×nm\times nm×n matrices (a1,…,an)(a_1,\dots,a_n)(a1​,…,an​) whose jjj-th column lies in KjK_jKj​.

In the application, the activity sets are Euclidean balls Kj={a∈Rm:∥a−aj∥2≤ρj}K_j=\{a\in\mathbb R^m:\|a-a_j\|_2\le\rho_j\}Kj​={a∈Rm:∥a−aj​∥2​≤ρj​} around nominal columns aja_jaj​ of a matrix A0A_0A0​, with radii ρj≥0\rho_j\ge0ρj​≥0.

Formalization targets

Goal: the THEOREM (p. 1156)

Assume every KjK_jKj​ is nonempty and convex and δ∗(ei∣Kj)<∞\delta^*(e_i\mid K_j)<\inftyδ∗(ei​∣Kj​)<∞ for all i,ji,ji,j. Then

{x:x feasible for (Ib)}={x:Aˉx≤b, x≥0},\{x : x\ \text{feasible for (Ib)}\}=\{x : \bar Ax\le b,\ x\ge 0\},{x:x feasible for (Ib)}={x:Aˉx≤b, x≥0},

and for every objective ccc, the optimal solutions of (Ib) and of LP(Aˉ)(\bar A)(Aˉ) coincide.

Milestones

  1. Feasibility for (I) is equivalent to x≥0x\ge0x≥0 and ∑jxjaj∈K\sum_j x_ja_j\in K∑j​xj​aj​∈K for every choice aj∈Kja_j\in K_jaj​∈Kj​ (p. 1154).
  2. LEMMA (p. 1155): XXX is convex.
  3. If δ∗(ei∣Kj)=∞\delta^*(e_i\mid K_j)=\inftyδ∗(ei​∣Kj​)=∞ for some iii, every feasible xxx of (Ib) has xj=0x_j=0xj​=0 (p. 1155).
  4. Compact activity sets have δ∗(ei∣Kj)<∞\delta^*(e_i\mid K_j)<\inftyδ∗(ei​∣Kj​)<∞ (p. 1156).
  5. xxx is feasible for (Ib) iff Ax≤bAx\le bAx≤b for every A∈MA\in MA∈M and x≥0x\ge0x≥0 (p. 1156).
  6. Every A∈MA\in MA∈M satisfies A≤AˉA\le\bar AA≤Aˉ entrywise (proof of THEOREM).
  7. Feasible for LP(Aˉ)(\bar A)(Aˉ) implies feasible for (Ib) (proof of THEOREM).
  8. Feasible for (Ib) implies ∑jxjsup⁡aj∈Kjaij≤bi\sum_j x_j\sup_{a_j\in K_j}a_{ij}\le b_i∑j​xj​supaj​∈Kj​​aij​≤bi​ for every iii, i.e. feasible for LP(Aˉ)(\bar A)(Aˉ) (proof of THEOREM).
  9. For Euclidean balls, δ∗(ei∣Kj)=aij+ρj\delta^*(e_i\mid K_j)=a_{ij}+\rho_jδ∗(ei​∣Kj​)=aij​+ρj​, so aˉj=aj+ρje\bar a_j=a_j+\rho_jeaˉj​=aj​+ρj​e with eee the all-ones vector (p. 1157).
  10. Inexact LP over balls: (Ib) has the same feasible and optimal solutions as max⁡c⋅x\max c\cdot xmaxc⋅x subject to ∑jxj(aj+ρje)≤b\sum_j x_j(a_j+\rho_je)\le b∑j​xj​(aj​+ρj​e)≤b, x≥0x\ge0x≥0 (p. 1157).

Significance

The THEOREM turns a semi-infinite constraint — one linear inequality for every matrix in MMM, of which there are typically uncountably many — into a single linear program of the original size, whose data are the support functionals of the activity sets. Any LP solver then solves the uncertain problem. The hypersphere corollary shows the cost of this guarantee concretely: every entry of column jjj is inflated by the full radius ρj\rho_jρj​, which is why the model is called conservative and why later robust-optimization work introduced ellipsoidal and budgeted uncertainty sets as less conservative alternatives. The LEMMA classifies (I) as a convex program in general, for resource sets that are not half-space intersections.

The results are proved in the paper and are standard. To our knowledge they have no machine-checked proof in Lean or Mathlib. The mission produces a formal statement of the set-inclusive constraint as an actual Minkowski-sum inclusion, the support-functional reduction with its finiteness hypotheses made explicit, and the Euclidean-ball computation — a base that robust-counterpart results for other uncertainty sets can be compared against.

Difficulty

The individual arguments are short; the work is in the bookkeeping that the paper leaves implicit. The step from "for every A∈MA\in MA∈M" to Aˉ\bar AAˉ uses that the supremum of a sum of independent terms is the sum of suprema, which needs every KjK_jKj​ nonempty and the scalars xjx_jxj​ nonnegative; with an empty activity set the Minkowski sum is empty and every x≥0x\ge0x≥0 becomes feasible. The support functional is valued in the extended reals, and its conversion to a real matrix entry is exact only under the finiteness assumption, which the paper secures by deleting columns. The ball computation needs the Euclidean norm and its dual characterisation of the maximum of a coordinate over a ball.

Formalization scope

  • Vectors are Fin m → ℝ and Fin n → ℝ, with indices 0,…,m−10,\dots,m-10,…,m−1 in place of 1,…,m1,\dots,m1,…,m; the order on vectors is componentwise.
  • Feasibility of (I) is the Minkowski-sum inclusion (∑ j, x j • K j) ⊆ R (pointwise set operations) together with x≥0x\ge0x≥0. It is not defined as "for every choice aj∈Kja_j\in K_jaj​∈Kj​", which would make milestones 1 and 5 trivial, and Aˉ\bar AAˉ is constructed from the KjK_jKj​, not an arbitrary matrix dominating MMM, which would make the goal trivial.
  • δ∗\delta^*δ∗ is valued in EReal. The entries of Aˉ\bar AAˉ are its real conversions, so every statement mentioning Aˉ\bar AAˉ assumes Kj≠∅K_j\neq\emptysetKj​=∅ and δ∗(ei∣Kj)<∞\delta^*(e_i\mid K_j)<\inftyδ∗(ei​∣Kj​)<∞, the paper's standing assumptions (pp. 1154–1156). Convexity of the KjK_jKj​ is also kept as a hypothesis wherever the paper has it, although only the LEMMA uses convexity (of KKK).
  • An optimal solution is a feasible point attaining the maximum of c⋅xc\cdot xc⋅x; the paper writes sup⁡\supsup and does not discuss attainment. Because the goal identifies the feasible sets, the two problems also have equal suprema.
  • Hyperspheres use the Euclidean norm (EuclideanSpace ℝ (Fin m)), not the sup norm of Fin m → ℝ, with radii ρj≥0\rho_j\ge0ρj​≥0.
  • The support functional restates the published FenchelRobust.Counterpart.supportFun with the same body.
  • Not formalized: Magnanti's extension to ≥\ge≥ and === rows (p. 1156), and the remarks on (GLP) and stochastic programming. Contributions of proofs of any milestone, and of an EReal statement equating the optimal values, are welcome.

Selected references

  • A. L. Soyster, Convex Programming with Set-Inclusive Constraints and Applications to Inexact Linear Programming, Operations Research 21(5), 1154–1157, 1973. https://doi.org/10.1287/opre.21.5.1154
  • G. B. Dantzig, Linear Programming and Extensions, Princeton University Press, 1963. https://doi.org/10.1515/9781400884179
  • A. Ben-Tal and A. Nemirovski, Robust Convex Optimization, Mathematics of Operations Research 23(4), 769–805, 1998. https://doi.org/10.1287/moor.23.4.769
  • A. Ben-Tal and A. Nemirovski, Robust solutions of Linear Programming problems contaminated with uncertain data, Mathematical Programming 88, 411–424, 2000. https://doi.org/10.1007/PL00011380
  • D. Bertsimas and M. Sim, The Price of Robustness, Operations Research 52(1), 35–53, 2004. https://doi.org/10.1287/opre.1030.0065
12 thms1 active userReviewed
Dynamic ProgrammingMarkov ChainOptimization·Captain: mikedeng1

Inventory Control in a Fluctuating Demand Environment I: With Linear Order Costs, a World-Dependent Basestock Policy Is Optimal over the Infinite HorizonResearch Paper

Motivation

An inventory controller must decide how much to order while demand changes with an observed external condition. A single demand rate misses that dependence: the same inventory position can justify different orders when the condition changes. Song and Zipkin's 1993 study asks whether a simple policy remains optimal when the condition follows a continuous-time Markov chain and orders arrive after a random lead time. The answer for linear ordering costs is a world-dependent basestock policy: each world state has one target inventory position, and an order raises the current position to that target when it lies below it.

The policy claim concerns an infinite horizon. It is stronger than showing that a particular collection of target levels performs well or that such a policy minimizes a one-step cost. Theorem 2 of Song and Zipkin identifies the targets through a limiting value function and establishes optimality for the full discounted problem. This mission formalizes that theorem and the finite-stage results the authors use to state its limit precisely.

Setting

The world state iii belongs to a nonempty countable set III. The world evolves according to a conservative continuous-time Markov generator Q=(qij)Q=(q_{ij})Q=(qij​), with exit rate qi=−qiiq_i=-q_{ii}qi​=−qii​. When the world is in state iii, customers demand individual units at rate λi≥0\lambda_i\ge0λi​≥0. The exit rates and demand rates are bounded above. Inventory is fully backlogged: a negative inventory level records unmet demand. The controller observes the world state and the inventory position x∈Zx\in\mathbb Zx∈Z, which includes outstanding orders, and chooses an order-up-to position y≥xy\ge xy≥x.

An order has actual unit cost cˉ≥0\bar c\ge0cˉ≥0 and may have fixed cost Kˉ≥0\bar K\ge0Kˉ≥0. This mission takes the linear-cost case, so the discounted fixed cost is K=0K=0K=0. The lead time LLL is a finite nonnegative random time, independent of the world and demand process. Its Laplace transform discounts the ordering costs to c=cˉ E[e−αL]c=\bar c\,E[e^{-\alpha L}]c=cˉE[e−αL], where α>0\alpha>0α>0 is the discount rate. Holding one unit costs h>0h>0h>0 per unit time; backlogging one unit costs p>0p>0p>0.

Write DLiD_L^iDLi​ for the number of demands during the lead time conditional on initial world state iii. The cost rate of an inventory level zzz is C^(z)=−pz\widehat C(z)=-pzC(z)=−pz for z<0z<0z<0 and hzhzhz otherwise. The lead-time cost and myopic cost are

C(i,y)=E[e−αLC^(y−DLi)],G+(i,y)=(1−γ)cy+βC(i,y),C(i,y)=E[e^{-\alpha L}\widehat C(y-D_L^i)],\qquad G^+(i,y)=(1-\gamma)cy+\beta C(i,y),C(i,y)=E[e−αLC(y−DLi​)],G+(i,y)=(1−γ)cy+βC(i,y),

where μ>0\mu>0μ>0 is a uniformization rate at least sup⁡iqi+sup⁡iλi\sup_iq_i+\sup_i\lambda_isupi​qi​+supi​λi​, β=(μ+α)−1\beta=(\mu+\alpha)^{-1}β=(μ+α)−1, and γ=βμ\gamma=\beta\muγ=βμ. The paper's Assumption 1, αcˉ<p\alpha\bar c<pαcˉ<p, applies to the later results. It ensures the myopic cost has finite nonnegative minimizers. The smallest such minimizer in world state iii is y+(i)y^+(i)y+(i), and ymin⁡+=min⁡iy+(i)y^+_{\min}=\min_i y^+(i)ymin+​=mini​y+(i).

With zero fixed cost and zero terminal cost, the nnn-stage transformed cost Wn(i,x)W_n(i,x)Wn​(i,x) minimizes the auxiliary cost Gn(i,y)G_n(i,y)Gn​(i,y) over y≥xy\ge xy≥x. Each GnG_nGn​ combines the myopic cost with the expected discounted continuation after a demand, a world-state jump, or a self-loop. Let W∞W_\inftyW∞​ and G∞G_\inftyG∞​ denote their pointwise limits. A basestock policy π(y)\pi(y)π(y) orders to max⁡{x,y(i)}\max\{x,y(i)\}max{x,y(i)} in state (i,x)(i,x)(i,x); it never cancels an outstanding order.

Formalization targets

The main target is the finite, smallest global minimizer y∗(i)y^*(i)y∗(i) of G∞(i,⋅)G_\infty(i,\cdot)G∞​(i,⋅) for each world state, with the inequalities of Theorem 2(c):

0≤ymin⁡+≤y∗(i)≤y∞∗(i)≤y+(i),G∞(i,y∞∗(i))=min⁡z∈ZG∞(i,z).0\le y^+_{\min}\le y^*(i)\le y^*_\infty(i)\le y^+(i), \qquad G_\infty(i,y^*_\infty(i))=\min_{z\in\mathbb Z}G_\infty(i,z).0≤ymin+​≤y∗(i)≤y∞∗​(i)≤y+(i),G∞​(i,y∞∗​(i))=z∈Zmin​G∞​(i,z).

Here y∞∗(i)y^*_\infty(i)y∞∗​(i) is the limit of the smallest finite-stage minimizers yn∗(i)y^*_n(i)yn∗​(i). Theorem 2(e) then asserts that π(y∗)\pi(y^*)π(y∗) has minimum infinite-horizon expected discounted cost from every state among all feasible policies. The milestone list states Lemmas 1, 2 and 4, Corollaries 1 and 2, all parts of Theorem 1 as identified by the paper's internal references, and the limit and optimality-equation clauses of Theorem 2. Together they fix the finite-stage and limiting objects used by the goal.

Significance

The theorem reduces a decision at every integer inventory position to one integer target for each observed world state. It gives an exact policy structure for a model with a changing demand rate and random lead time, rather than an approximation derived from a constant-demand model. The limiting inequalities also locate an optimal target relative to the myopic target and the finite-stage targets, giving a mathematically specified range for policy computation. These claims are the linear-cost part of Song and Zipkin's analysis; the paper proves the result but supplies no Lean proof.

Formalization will leave reusable definitions for countable-state uniformization with a demand counter, integer convexity of inventory cost functions, and discounted costs of history-dependent policies. The mission's theorem statements compile as open goals. The remaining work is to verify the analytic properties of the lead-time demand law, the finite-stage inequalities, convergence, and the infinite-horizon policy comparison. The fixed-order-cost and monotone-world-state results of the paper are separate missions.

Difficulty

The world can have countably many states, so a continuation value includes a series over possible world jumps. The stage cost grows with inventory position, so a bounded-cost finite-state dynamic-programming theorem does not directly cover the model. The minimization is over an unbounded set of integers, and the minimizers themselves change with the stage number. Convexity of a one-stage cost alone does not establish that the limiting policy beats policies that use the entire observation history. These are the specific gaps the paper's bound, ordered-difference, and limit results address.

Formalization scope

World states are a nonempty countable Lean type, inventory positions and order-up-to levels are integers, and costs are real until policy evaluation. The lead-time law is a probability measure on finite nonnegative real times, independent of world and demand. The demand-count law is defined by exact Poisson uniformization at rate μ\muμ, with demand, world-jump, and self-loop branches. The infinite-horizon policy cost uses extended nonnegative reals and a supremum of finite-horizon costs, so it can express an infinite expected cost without a default real value. Policies may depend on all past observed states; the goal compares its basestock policy against every feasible deterministic policy in this class. Randomized policies are omitted because they cannot improve expected nonnegative costs on this countable state space.

Assumption 1 is attached only to the results that use it. The linear-cost recursion has K=0K=0K=0 and W0=0W_0=0W0​=0. Integer convexity means nondecreasing forward differences. Smallest minimizers and the minimum across world states are asserted to exist; neither is encoded by an integer infimum that returns a default on an empty or unbounded set. The goal requires an actual optimal policy cost comparison from every state, so solving the limiting optimality equation only within basestock policies cannot close it. Contributions to the lead-time mixture, integer convexity, boundedness of the real series and infima, and unrestricted policy comparison all fit this scope.

Selected references

  • Jing-Sheng Song and Paul Zipkin, Inventory Control in a Fluctuating Demand Environment, Operations Research 41(2):351–370, 1993. DOI 10.1287/opre.41.2.351.
12 thms1 active userReviewed
AnalysisFunctional AnalysisOptimization·Captain: mikedeng1

An Implicit-Function Theorem for a Class of Nonsmooth Functions: Strong Approximation by a Function with Lipschitzian Inverse Yields a Unique Lipschitzian Implicit FunctionResearch Paper

Why a nonsmooth implicit-function theorem

The classical implicit-function theorem solves an equation F(x,y)=0F(x, y) = 0F(x,y)=0 for xxx as a function of a parameter yyy near a known solution (x0,y0)(x_0, y_0)(x0​,y0​), provided FFF is (strongly) Fréchet differentiable in xxx with an invertible partial derivative. Much of optimization does not meet that hypothesis. Optimality conditions of constrained problems, complementarity problems and variational inequalities are routinely rewritten as equations involving the projection onto a convex set, the componentwise min⁡\minmin, or the normal map of a polyhedron. These maps are Lipschitzian and piecewise smooth, but not differentiable. Sensitivity analysis asks whether the solution of such a system moves Lipschitz-continuously with the problem data, and the classical theorem cannot answer it.

Stephen M. Robinson, An Implicit-Function Theorem for a Class of Nonsmooth Functions, Mathematics of Operations Research 16(2), 1991, pp. 292–309, gives a theorem with the same shape as the classical one, in which differentiability is replaced by strong approximation by a function whose inverse is Lipschitzian. The paper's §4 applies it to parametric variational inequalities over polyhedral sets through the normal map.

Timeline. Robinson's Strongly regular generalized equations (Math. Oper. Res. 5, 1980) proved an implicit-function theorem for generalized equations under a linearization hypothesis called strong regularity. The 1991 paper reformulates that idea for single-valued nonsmooth equations: the approximating function fff need not be linear. Lemma 3.1 extends the Banach perturbation lemma for linear operators (Kantorovich–Akilov, Functional Analysis, Th. 4(2.V)) to Lipschitzian functions; after acceptance, A. Ioffe pointed the author to closely related results of Dmitruk, Milyutin and Osmolovskii (Lyusternik's theorem and the theory of extrema, Russian Math. Surveys, 1980, Theorems 1.2, 1.3), credited in the paper's footnote.

Setting

Let XXX, YYY, ZZZ be real normed linear spaces, with XXX complete. Fix x0∈Xx_0 \in Xx0​∈X, y0∈Yy_0 \in Yy0​∈Y, a neighborhood Ξ\XiΞ of x0x_0x0​ and a neighborhood HHH of y0y_0y0​. Let FFF map Ξ×H\Xi \times HΞ×H to ZZZ, with F(x0,y0)=0F(x_0, y_0) = 0F(x0​,y0​)=0, and let fff map Ξ\XiΞ to ZZZ, with f(x0)=0f(x_0) = 0f(x0​)=0. B(x,ρ)B(x, \rho)B(x,ρ) denotes the closed ball of radius ρ\rhoρ about xxx.

Expansion modulus. For a map fff between metric spaces and a set SSS,

δ(f,S)=inf⁡{∥f(x1)−f(x2)∥∥x1−x2∥:x1≠x2, x1,x2∈S}.\delta(f, S) = \inf\left\{ \frac{\|f(x_1) - f(x_2)\|}{\|x_1 - x_2\|} : x_1 \ne x_2,\ x_1, x_2 \in S \right\}.δ(f,S)=inf{∥x1​−x2​∥∥f(x1​)−f(x2​)∥​:x1​=x2​, x1​,x2​∈S}.

If δ(f,S)>0\delta(f,S) > 0δ(f,S)>0, then fff is one-to-one on SSS and its inverse is Lipschitzian with modulus δ(f,S)−1\delta(f,S)^{-1}δ(f,S)−1. In Lean the mission works with lower bounds: ExpansionAtLeast f S d says d ∥x1−x2∥≤∥f(x1)−f(x2)∥d\,\|x_1 - x_2\| \le \|f(x_1) - f(x_2)\|d∥x1​−x2​∥≤∥f(x1​)−f(x2​)∥ on SSS, i.e. d≤δ(f,S)d \le \delta(f,S)d≤δ(f,S).

Strong approximation (Definition 2.4). fff strongly approximates FFF in xxx at (x0,y0)(x_0, y_0)(x0​,y0​), written f≈xFf \approx_x Ff≈x​F (Lean: StronglyApproxInX f F x₀ y₀), if for each ε>0\varepsilon > 0ε>0 there are neighborhoods UUU of x0x_0x0​ and VVV of y0y_0y0​ with

∥[F(x,y)−f(x)]−[F(x′,y)−f(x′)]∥≤ε∥x−x′∥(x,x′∈U, y∈V).\big\|[F(x, y) - f(x)] - [F(x', y) - f(x')]\big\| \le \varepsilon \|x - x'\| \qquad (x, x' \in U,\ y \in V).​[F(x,y)−f(x)]−[F(x′,y)−f(x′)]​≤ε∥x−x′∥(x,x′∈U, y∈V).

When fff is the partial derivative map x↦Fx(x0,y0)(x−x0)x \mapsto F_x(x_0,y_0)(x - x_0)x↦Fx​(x0​,y0​)(x−x0​) this is strong partial Fréchet differentiability; in general fff may be piecewise linear or any map with a Lipschitzian inverse.

Formalization targets

Goal: Theorem 3.2 (p. 299)

Assume (a) f≈xFf \approx_x Ff≈x​F at (x0,y0)(x_0, y_0)(x0​,y0​); (b) for each x∈Ξx \in \Xix∈Ξ, F(x,⋅)F(x, \cdot)F(x,⋅) is Lipschitzian on HHH with modulus φ\varphiφ; (c) f(Ξ)f(\Xi)f(Ξ) is a neighborhood of 000 in ZZZ; (d) δ(f,Ξ)=:d0>0\delta(f, \Xi) =: d_0 > 0δ(f,Ξ)=:d0​>0. Then for each λ>d0−1φ\lambda > d_0^{-1}\varphiλ>d0−1​φ there are neighborhoods U⊆ΞU \subseteq \XiU⊆Ξ of x0x_0x0​, V⊆HV \subseteq HV⊆H of y0y_0y0​ and a function x:V→Ux : V \to Ux:V→U with

x(y0)=x0,∥x(y1)−x(y2)∥≤λ∥y1−y2∥ (y1,y2∈V),{ξ∈U:F(ξ,y)=0}={x(y)} (y∈V).x(y_0) = x_0, \qquad \|x(y_1) - x(y_2)\| \le \lambda \|y_1 - y_2\| \ (y_1, y_2 \in V), \qquad \{\xi \in U : F(\xi, y) = 0\} = \{x(y)\} \ (y \in V).x(y0​)=x0​,∥x(y1​)−x(y2​)∥≤λ∥y1​−y2​∥ (y1​,y2​∈V),{ξ∈U:F(ξ,y)=0}={x(y)} (y∈V).

Every λ\lambdaλ strictly above φ/d0\varphi/d_0φ/d0​ is claimed; λ=φ/d0\lambda = \varphi/d_0λ=φ/d0​ is not.

Milestones

  1. Lemma 3.1 (p. 298), the Lipschitz perturbation lemma: if fff maps Ω\OmegaΩ onto a ball B(y0,α)B(y_0, \alpha)B(y0​,α), hhh is Lipschitzian with modulus η<δ:=δ(f,Ω)\eta < \delta := \delta(f, \Omega)η<δ:=δ(f,Ω), Ω⊇B(x0,δ−1α)\Omega \supseteq B(x_0, \delta^{-1}\alpha)Ω⊇B(x0​,δ−1α) and θ:=(1−ηδ−1)α−∥h(x0)∥≥0\theta := (1 - \eta\delta^{-1})\alpha - \|h(x_0)\| \ge 0θ:=(1−ηδ−1)α−∥h(x0​)∥≥0, then
(f+h)(B(x0,δ−1α))⊇B(y0,θ),δ(f+h,Ω)≥δ−η>0.(f + h)\big(B(x_0, \delta^{-1}\alpha)\big) \supseteq B(y_0, \theta), \qquad \delta(f + h, \Omega) \ge \delta - \eta > 0.(f+h)(B(x0​,δ−1α))⊇B(y0​,θ),δ(f+h,Ω)≥δ−η>0.
  1. (3.1)–(3.2) in the proof of Theorem 3.2 (p. 300): for every ε∈(0,d0)\varepsilon \in (0, d_0)ε∈(0,d0​) there are α,κ>0\alpha, \kappa > 0α,κ>0 and a neighborhood V⊆HV \subseteq HV⊆H of y0y_0y0​ with Ω=B(x0,d0−1α)⊆Ξ\Omega = B(x_0, d_0^{-1}\alpha) \subseteq \XiΩ=B(x0​,d0−1​α)⊆Ξ such that for each y∈Vy \in Vy∈V
δ(F(⋅,y),Ω)≥d0−ε,F(⋅,y)(Ω)⊇B(0,θ(y))⊇B(0,κ),\delta(F(\cdot, y), \Omega) \ge d_0 - \varepsilon, \qquad F(\cdot, y)(\Omega) \supseteq B(0, \theta(y)) \supseteq B(0, \kappa),δ(F(⋅,y),Ω)≥d0​−ε,F(⋅,y)(Ω)⊇B(0,θ(y))⊇B(0,κ),

where θ(y)=(1−εd0−1)α−∥F(x0,y)∥\theta(y) = (1 - \varepsilon d_0^{-1})\alpha - \|F(x_0, y)\|θ(y)=(1−εd0−1​)α−∥F(x0​,y)∥.

Significance

The result. Theorem 3.2 yields existence, local uniqueness and Lipschitz dependence of solutions of parametrized nonsmooth equations, with an explicit Lipschitz modulus arbitrarily close to φ/d0\varphi/d_0φ/d0​. In the paper it underlies Theorem 3.3 and Corollary 3.4 (approximation and B-differentiation of the implicit function) and the sensitivity results of §4 for parametric variational inequalities over polyhedral convex sets. The same template, an equation approximated by a map with Lipschitzian inverse, is the basis of later strong-regularity and semismooth-Newton analyses in nonlinear programming and complementarity.

Formalizing it. The theorem is proved in the paper; it has not been machine-checked. The platform has the smooth implicit-function theorem (FamousTheorems.implicit_function_theorem, Rudin.ch09_implicit_function) and Mathlib has the contraction mapping principle, but there is no Lipschitz-inverse perturbation result and no notion of strong approximation. The mission produces both, together with the formal Theorem 3.2 that a follow-on mission (Theorem 3.3, Corollary 3.4, §4) would reference.

Difficulty

The obvious approach, differentiate and invert, is unavailable: fff need not have a derivative anywhere near x0x_0x0​, so neither Mathlib's implicit-function theorem nor its inverse-function theorem applies. The difficulty is to obtain surjectivity of F(⋅,y)F(\cdot, y)F(⋅,y) onto a ball uniformly in yyy from information about fff alone. Injectivity transfers directly from fff through the small Lipschitz modulus of F(⋅,y)−fF(\cdot, y) - fF(⋅,y)−f; surjectivity does not, because fff carries no information about F(⋅,y)F(\cdot, y)F(⋅,y) beyond the small Lipschitz modulus of the difference, and the domain ball, the image ball and the parameter neighborhood must be chosen once for all yyy. Completeness of XXX is essential (the paper stresses this on p. 306) and is not available for YYY and ZZZ.

Formalization scope

All statements live in namespace RobinsonNSIFT.Implicit. Committed conventions:

  • Scalars are real; XXX is a complete normed space ([CompleteSpace X]); YYY, ZZZ are normed spaces without completeness. Lemma 3.1's domain is a complete metric space, not a normed one.
  • δ(f,S)\delta(f, S)δ(f,S) via lower bounds. Every statement takes a real ddd with ExpansionAtLeast f S d in place of "d=δ(f,S)d = \delta(f,S)d=δ(f,S)", universally quantified. This is equivalent to the paper's statements and avoids a real infimum that would be 000 on sets with fewer than two points.
  • Total functions. FFF is a curried total function F : X → Y → Z and f:X→Zf : X \to Zf:X→Z; hypotheses constrain them on Ξ×H\Xi \times HΞ×H only, and the conclusions keep the implicit function inside the domain: U⊆ΞU \subseteq \XiU⊆Ξ, V⊆HV \subseteq HV⊆H, x(V)⊆Ux(V) \subseteq Ux(V)⊆U. This makes explicit what the paper leaves implicit (its FFF is only defined on Ξ×H\Xi \times HΞ×H). Likewise Ω⊆Ξ\Omega \subseteq \XiΩ⊆Ξ, used implicitly in the paper's proof, is a conclusion of milestone 2.
  • Closed balls (Metric.closedBall), radii δ−1α\delta^{-1}\alphaδ−1α written α / δ; neighborhoods are filter members ∈ 𝓝 _, not necessarily open; Lipschitz moduli are ℝ≥0 and Lipschitz conditions are LipschitzOnWith on the stated set.
  • Lemma 3.1 keeps the paper's hypothesis that Ω\OmegaΩ is open, although Theorem 3.2's proof applies it to a closed ball.
  • Milestone 2 states as an existence claim, for every ε∈(0,d0)\varepsilon \in (0, d_0)ε∈(0,d0​), the choices the paper makes at the start of its proof.

A formalization in which hypothesis (a) is the weak approximation of Definition 2.1 (only at y=y0y = y_0y=y0​), in which VVV may shrink to {y0}\{y_0\}{y0​}, λ\lambdaλ is existential, or uniqueness is asserted outside Ξ\XiΞ, would be a different and trivial or false statement; the statements here rule these out.

Needed infrastructure: the contraction mapping principle on a closed subset of a complete space (Mathlib's ContractingWith), Lipschitz estimates on sets, and the two definitions of this mission. Lemma 3.1 is reusable for any Lipschitz-perturbation argument. Proofs of either milestone, or a direct proof of the goal, are welcome.

Selected references

  • S. M. Robinson, An Implicit-Function Theorem for a Class of Nonsmooth Functions, Mathematics of Operations Research 16(2), 1991, 292–309. https://doi.org/10.1287/moor.16.2.292
  • S. M. Robinson, Strongly Regular Generalized Equations, Mathematics of Operations Research 5(1), 1980, 43–62. https://doi.org/10.1287/moor.5.1.43
  • A. V. Dmitruk, A. A. Milyutin, N. P. Osmolovskii, Lyusternik's theorem and the theory of extrema, Russian Mathematical Surveys 1980, No. 6, 11–51 (as cited in Robinson 1991, p. 298).
  • L. V. Kantorovich, G. P. Akilov, Functional Analysis, cited in Robinson 1991 as [17].
4 thms1 active userReviewed
CombinatoricsGraph Theory·Captain: mikedeng1

Edge-Disjoint Spanning Trees of Finite Graphs: A Finite Multigraph Has k Edge-Disjoint Spanning Trees iff Every Partition P of Its Vertices Is Crossed by at Least k(|P| − 1) EdgesResearch Paper

Why edge-disjoint spanning trees

A connected network survives the failure of any single link exactly when it has no bridge, but a stronger and more useful property is to carry several edge-disjoint spanning trees: each tree can broadcast to every node on its own, so kkk such trees give kkk independent routing or broadcast structures, and the network stays connected after any k−1k-1k−1 link failures. The question of when a graph contains kkk edge-disjoint spanning trees was answered in 1961, simultaneously and independently, by W. T. Tutte (On the problem of decomposing a graph into n connected factors) and C. St.J. A. Nash-Williams (Edge-disjoint spanning trees of finite graphs). The answer is a min-max condition over vertex partitions, now called the Tutte–Nash-Williams tree-packing theorem. It is a standard result in combinatorial optimization and the graphic case of Edmonds's matroid base-packing theorem (1965).

Timeline:

  • 1961. Tutte proves the theorem in an equivalent form; Nash-Williams, unaware of Tutte's work, gives a different proof a few months later, the one formalized here.
  • 1964. Nash-Williams proves the companion covering theorem: the edges can be covered by kkk forests iff every vertex set UUU spans at most k(∣U∣−1)k(|U|-1)k(∣U∣−1) edges.
  • 1965. Edmonds derives both results from matroid partition (Minimum partition of a matroid into independent subsets).

Setting

A graph GGG here is a finite unoriented multigraph in which every edge joins two distinct vertices; two vertices may be joined by several edges. Write VVV for its vertex set and EEE for its edge set. A tree on a non-empty vertex set WWW is an edge set TTT, all of whose edges have both ends in WWW, containing no cycle (two parallel edges count as a cycle), such that any two vertices of WWW are joined by a path of TTT-edges. A spanning tree of GGG is a tree on all of VVV using edges of GGG. Spanning trees are edge-disjoint if no two share an edge.

A partition PPP of VVV is a set of non-empty, pairwise disjoint subsets of VVV whose union is VVV; ∣P∣|P|∣P∣ is the number of its members. The crossing edges EP(G)E_P(G)EP​(G) are the edges whose two ends lie in different members of PPP, counted with multiplicity. Throughout, kkk is a fixed positive integer. For X⊆VX \subseteq VX⊆V, EXE_XEX​ is the set of edges with both ends in XXX, eX=∣EX∣e_X = |E_X|eX​=∣EX​∣, and

ΔG(X)=k(∣X∣−1)−eX.\Delta_G(X) = k(|X|-1) - e_X .ΔG​(X)=k(∣X∣−1)−eX​.

Formalization targets

Goal: Theorem 1

G has k edge-disjoint spanning trees  ⟺  ∣EP(G)∣≥k(∣P∣−1) for every partition P of V.(1)G \text{ has } k \text{ edge-disjoint spanning trees} \iff |E_P(G)| \ge k(|P|-1) \text{ for every partition } P \text{ of } V. \tag{1}G has k edge-disjoint spanning trees⟺∣EP​(G)∣≥k(∣P∣−1) for every partition P of V.(1)

Milestones, in the order of the proof

  1. Lemma 1: a tree on WWW has ∣W∣−1|W|-1∣W∣−1 edges. Lemma 2: every connected graph has a spanning tree.
  2. Necessity: kkk edge-disjoint spanning trees imply (1) for every PPP.
  3. (*) On couples [G,g][G,g][G,g] (g≥0g \ge 0g≥0 on vertices, ΔG≥0\Delta_G \ge 0ΔG​≥0 on non-empty sets): critical sets (ΔG=0\Delta_G = 0ΔG​=0) whose intersection is non-empty are closed under ∩\cap∩ and ∪\cup∪. The same holds for crucial sets (Γ=0\Gamma = 0Γ=0, where Γ(X)=ΔG(X)−s+g . Xˉ\Gamma(X) = \Delta_G(X) - s + g\,.\,\bar XΓ(X)=ΔG​(X)−s+g.Xˉ) when the couple is sss-good.
  4. Lemma 3: for s≥1s \ge 1s≥1, an sss-good couple has an (s−1)(s-1)(s−1)-good supercouple with one added edge. Corollary 3A: an sss-good couple has an sss-supercouple, obtained by adding sss edges.
  5. (†) and Lemma 4: a spanning tree of a graph produced by fusions at ξ\xiξ (replacing edges ξη\xi\etaξη, ξζ\xi\zetaξζ by a new edge ηζ\eta\zetaηζ) pulls back to a spanning tree of the original graph.
  6. Lemma 5: a graph with ∣E∣=k(∣V∣−1)|E| = k(|V|-1)∣E∣=k(∣V∣−1) satisfies (1) iff ΔG(X)≥0\Delta_G(X) \ge 0ΔG​(X)≥0 for every non-empty XXX.
  7. Lemma 6: under the inductive hypothesis of the proof, a critical partition other than {V}\{V\}{V} and the partition into singletons yields kkk edge-disjoint spanning trees.

Significance

The theorem gives an exact, checkable certificate in both directions: a family of kkk trees certifies the packing, and a single partition violating (1) certifies that no packing exists. Corollaries include that every 2k2k2k-edge-connected graph has kkk edge-disjoint spanning trees, and that the maximum number of edge-disjoint spanning trees (the strength-type parameter used in network reliability and in Nagamochi–Ibaraki style connectivity algorithms) is the minimum of ⌊∣EP(G)∣/(∣P∣−1)⌋\lfloor |E_P(G)|/(|P|-1) \rfloor⌊∣EP​(G)∣/(∣P∣−1)⌋ over partitions with ∣P∣≥2|P| \ge 2∣P∣≥2. The partition condition is also the prototype of the rank condition in matroid base packing.

The result itself is classical and fully proved. What this mission adds is a machine-checked version in a multigraph setting. Mathlib has trees and spanning trees for simple graphs (SimpleGraph.IsTree, SimpleGraph.Connected.exists_isTree_le), but not edge-disjoint tree packing, and its simple graphs cannot express the parallel edges that the theorem and its proof need. Related items on the platform include the multigraph layer NagamochiIbaraki.EdgeConn.Multigraph (reused here), the Keller–Trotter spanning-forest count for simple graphs, and Edmonds's matroid partition theorem with Nash-Williams's covering corollary. Covering and packing are different statements, so none of these yields Theorem 1 directly. Formalizing Tutte's alternative proof, or deriving Theorem 1 from a formalized matroid union theorem, would also be welcome.

Difficulty

Necessity is a counting argument. The difficulty lies in sufficiency. The obvious induction deletes an edge or contracts a set of vertices, but deleting an edge can destroy (1), and contracting changes the vertex set, so neither reduction preserves the hypothesis on its own. The hardest case is a graph in which only the partition into singletons is critical. There a vertex of degree less than 2k2k2k has to be removed while (1) is preserved on the remaining graph, and the trees found there have to be converted back into trees of the original graph. Both steps need careful bookkeeping of edges incident with that vertex. A simple-graph development cannot carry the argument, because the edges that the reduction adds among the neighbours of the removed vertex may be parallel to existing ones.

Formalization scope

  • Graphs. A vertex type V, an edge type E (both finite, in Type), and ends : E → Sym2 V, the published encoding of NagamochiIbaraki.EdgeConn. Loops are excluded by the hypothesis ∀ e, ¬ (ends e).IsDiag. Parallel edges are allowed, and simplicity is never assumed. A subgraph is a pair (W : Finset V, F : Finset E).
  • Trees. "Tree" means non-empty vertex set, edges inside it, no cycle (IsForest: every edge is a bridge) and connected. ∣T∣=∣W∣−1|T| = |W|-1∣T∣=∣W∣−1 is Lemma 1, not part of the definition. "kkk edge-disjoint spanning trees" is a family Fin k → Finset E of pairwise disjoint spanning trees.
  • Partitions are Mathlib Finpartition (Finset.univ : Finset V). (1) is required for every partition, including the one-part partition and the singletons. All counts involving subtraction (ΔG\Delta_GΔG​, (1), criticality, Γ\GammaΓ) are in Z\mathbb ZZ.
  • Explicit readings. VVV is non-empty in Theorem 1, since the paper's graphs have a vertex and on V=∅V = \emptysetV=∅ condition (1) holds while no tree exists. k≥1k \ge 1k≥1 in every statement. The paper's "X⊂V(G)X \subset V(G)X⊂V(G)" includes X=V(G)X = V(G)X=V(G) and is read as ⊆\subseteq⊆. "Exactly g(ξ)−h(ξ)g(\xi)-h(\xi)g(ξ)−h(ξ) new edges" is written deg⁡new(ξ)+h(ξ)=g(ξ)\deg_{\text{new}}(\xi) + h(\xi) = g(\xi)degnew​(ξ)+h(ξ)=g(ξ), without natural-number subtraction. A supergraph with sss added edges has edge type E ⊕ Fin s, so the added edges always exist; none of them may be a loop. A fusion uses a given fresh edge ρ : E in an ambient edge type, and a sequence of fusions is a list, each valid on the graph produced by the later ones (L=Φ1⋯ΦnGL = \Phi_1\cdots\Phi_n GL=Φ1​⋯Φn​G applies Φn\Phi_nΦn​ first). In (†) and Lemma 4, "is a tree" means "is a spanning tree of GGG", since the vertex set is all of VVV. Lemma 6 carries the paper's inductive hypothesis as an explicit hypothesis: Theorem 1 (admissible implies kkk trees) for all loopless multigraphs with smaller ∣V∣+∣E∣|V|+|E|∣V∣+∣E∣.
  • Ruled out. Defining a spanning tree by an edge count alone, or by acyclicity alone, would make Lemma 1 or the goal trivial; the definitions require both acyclicity and connectivity on the stated vertex set. Taking added edges from a fixed ambient type would make Lemma 3 false. Dropping or globalizing Lemma 6's inductive hypothesis would turn it into the goal or a tautology.
  • Infrastructure. Multigraph trees, the tree edge count and spanning-tree existence, contraction GPG_PGP​ of a partition, and splitting-off at a vertex. All of these are reusable beyond this mission. Contributions of general multigraph lemmas are welcome.

Selected references

  • C. St.J. A. Nash-Williams, Edge-disjoint spanning trees of finite graphs, J. London Math. Soc. 36 (1961), 445–450. https://doi.org/10.1112/jlms/s1-36.1.445
  • W. T. Tutte, On the problem of decomposing a graph into n connected factors, J. London Math. Soc. 36 (1961), 221–230. https://doi.org/10.1112/jlms/s1-36.1.221
  • C. St.J. A. Nash-Williams, Decomposition of finite graphs into forests, J. London Math. Soc. 39 (1964), 12. https://doi.org/10.1112/jlms/s1-39.1.12
  • J. Edmonds, Minimum partition of a matroid into independent subsets, J. Res. Nat. Bur. Standards 69B (1965), 67–72. https://doi.org/10.6028/jres.069B.004
  • C. Berge, Théorie des graphes et ses applications, Dunod, Paris, 1958.
15 thms1 active userReviewed
Algorithmic Game TheoryMechanism DesignOptimization·Captain: mikedeng1

Incentive Compatibility and the Bargaining Problem I: The Incentive-Feasible Set Is Compact and Convex, and the Generalized Nash Bargaining Solution over It Exists and Is UniqueResearch Paper

Why private information changes bargaining

An arbitrator choosing an outcome for several people can ask them about their preferences, but the answer to that question may affect the outcome. A person who expects to gain from a false report may give one. Roger Myerson's 1979 paper puts this incentive problem inside a bargaining model: the arbitrator may randomize over collective choices, and an allocation is considered feasible only if some mechanism makes truthful reporting an equilibrium. The paper then applies a weighted Nash bargaining criterion to the resulting set of feasible interim payoffs. The mission formalizes the existence and uniqueness result for that criterion, along with the finite Bayesian model on which it depends.

The issue matters whenever an agreement is selected using information known privately to its participants. If the arbitrator evaluates a payoff vector that can arise only when somebody has a reason to lie, that vector cannot serve as a credible bargaining alternative under the model's own behavior assumption. Myerson's feasible set keeps the behavioral constraint visible when the group compares agreements. This mission addresses the paper's Theorems 1 and 3 and the claims between them that establish the relevant sets and their reference point.

The finite Bayesian choice problem

Let III be a nonempty finite set of players. Player iii has a nonempty finite type set AiA_iAi​, and the group has a nonempty finite set CCC of possible choices. A type profile is α∈∏i∈IAi\alpha\in\prod_{i\in I}A_iα∈∏i∈I​Ai​. The utility Ui(c,α)∈RU_i(c,\alpha)\in\mathbb RUi​(c,α)∈R is player iii's payoff when choice ccc occurs and α\alphaα is the true profile. A nonnegative function PPP on type profiles, summing to one, is the common prior. Write Ri(ai)R_i(a_i)Ri​(ai​) for the probability that player iii has type aia_iai​, and Pi(α∣ai)P_i(\alpha\mid a_i)Pi​(α∣ai​) for the posterior probability of α\alphaα conditional on that type. Every Ri(ai)R_i(a_i)Ri​(ai​) is positive, so the conditional probabilities are defined.

A choice mechanism π\piπ asks each player for a response and assigns a probability π(c∣s)\pi(c\mid s)π(c∣s) to each choice ccc at each response profile sss. For the direct mechanisms used here, the response set of player iii is AiA_iAi​: a response is a claimed type. The probabilities are nonnegative and sum to one for each response profile. If a player whose true type is aia_iai​ instead reports bib_ibi​, while the others report truthfully, the player's conditional expected utility is Zi(π,bi∣ai)Z_i(\pi,b_i\mid a_i)Zi​(π,bi​∣ai​). The posterior Pi(α∣ai)P_i(\alpha\mid a_i)Pi​(α∣ai​) weights true profiles; the mechanism sees the profile with only coordinate iii replaced by bib_ibi​; and utility is evaluated at the true profile α\alphaα.

The mechanism is Bayesian incentive-compatible when Zi(π,ai∣ai)≥Zi(π,bi∣ai)Z_i(\pi,a_i\mid a_i)\ge Z_i(\pi,b_i\mid a_i)Zi​(π,ai​∣ai​)≥Zi​(π,bi​∣ai​) for every player and pair of types. Its interim payoff vector V(π)V(\pi)V(π) has one coordinate Vi,ai(π)=Zi(π,ai∣ai)V_{i,a_i}(\pi)=Z_i(\pi,a_i\mid a_i)Vi,ai​​(π)=Zi​(π,ai​∣ai​) for every player-type pair. The set FFF contains the vectors attained by all direct choice mechanisms; F∗F^*F∗ contains those attained by Bayesian incentive-compatible direct choice mechanisms. Theorem 1 says F∗F^*F∗ is nonempty, convex, compact, and contained in FFF. The nonemptiness claim includes the mechanism that selects each choice with probability 1/∣C∣1/|C|1/∣C∣, independent of all reports.

Formalization targets

Fix a conflict outcome c∗∈Cc^*\in Cc∗∈C: the choice that occurs if bargaining fails. Its conflict payoff vector ttt gives each player type the conditional expected utility from that fixed choice. A constant mechanism selects c∗c^*c∗ regardless of reports. It is incentive-compatible and generates ttt, so t∈F∗t\in F^*t∈F∗. The individually rational incentive-feasible set is

F+∗={x∈F∗:xi,ai≥ti,ai for all i,ai}.F^*_+=\{x\in F^*: x_{i,a_i}\ge t_{i,a_i}\text{ for all }i,a_i\}.F+∗​={x∈F∗:xi,ai​​≥ti,ai​​ for all i,ai​}.

For x∈F+∗x\in F^*_+x∈F+∗​, the generalized Nash product of equation (18) is

N(x)=∏i∈I∏ai∈Ai(xi,ai−ti,ai)Ri(ai).N(x)=\prod_{i\in I}\prod_{a_i\in A_i} (x_{i,a_i}-t_{i,a_i})^{R_i(a_i)}.N(x)=i∈I∏​ai​∈Ai​∏​(xi,ai​​−ti,ai​​)Ri​(ai​).

A bargaining solution is a vector in F+∗F^*_+F+∗​ that maximizes NNN over that set. Myerson's Theorem 3, the goal of this mission, says that if the constant conflict mechanism is not incentive-efficient—that is, an incentive-compatible mechanism strictly improves every player-type payoff over it—then exactly one such vector exists:

¬Efficient⁡(πc∗)⟹∃!x∈F+∗  ∀y∈F+∗,  N(y)≤N(x).\neg\operatorname{Efficient}(\pi_{c^*}) \quad\Longrightarrow\quad \exists!x\in F^*_+\;\forall y\in F^*_+,\;N(y)\le N(x).¬Efficient(πc∗​)⟹∃!x∈F+∗​∀y∈F+∗​,N(y)≤N(x).

The milestones follow the paper's claims: the uniform mechanism is incentive-compatible; F∗F^*F∗ has the four properties in Theorem 1; the conflict vector belongs to F∗F^*F∗; every Nash-product maximizer strictly improves each conflict payoff when such improvement is feasible; and every implementing mechanism is incentive-efficient. The final claim concerns a mechanism that realizes the maximizing vector. It does not assert uniqueness of that mechanism.

What the result provides

Theorem 1 supplies a feasible set that respects truthful reporting. Theorem 3 selects a unique interim payoff vector from that set after a conflict outcome is specified. It thereby gives a well-defined allocation criterion for the paper's finite Bayesian collective choice problems. Myerson also observes that several mechanisms may implement the same solution. The allocation, rather than a unique mechanism, is the object selected by the theorem.

The result was proved in the 1979 paper. The work here is a machine-checked statement and, for solvers, a proof of that known result and its supporting claims in Lean. The mission's statements are open proof targets; the source paper's proof is not claimed to have been formalized already. A related platform item on Nash's two-player axiomatic characterization concerns a solution function on compact convex subsets of R2\mathbb R^2R2. It is a distinct result and supplies neither this paper's Bayesian model nor Theorem 3.

The mathematical obstacle

The set of all real-valued functions on choices and reports is much larger than the set of mechanisms: probabilities must be nonnegative and sum to one at every report profile. Bayesian incentive compatibility adds inequalities involving the true and reported type in different positions. Theorem 1 requires these constraints to give the compact, convex set of attainable interim payoffs, rather than merely a formal collection of payoff functions.

The Nash product also has a boundary: an individually rational vector may match the conflict payoff in one coordinate, making its product zero. Theorem 3's hypothesis has to rule out a zero maximum before uniqueness of an interior maximum can be concluded. The weights Ri(ai)R_i(a_i)Ri​(ai​) matter in that uniqueness statement, and the result ranges over all player-type coordinates, not only one aggregate payoff per player. Restricting the maximization to an arbitrary small subset, fixing two players, or assuming a positive maximum would change the theorem.

Formalization scope

Lean represents players, each type set, and choices as finite nonempty types. Type profiles are dependent functions ∏iAi\prod_i A_i∏i​Ai​; interim vectors are real functions on the disjoint union ∑iAi\sum_i A_i∑i​Ai​, with the product topology. A mechanism is a real function π:C→(∏iAi)→R\pi:C\to(\prod_i A_i)\to\mathbb Rπ:C→(∏i​Ai​)→R subject to explicit nonnegativity and sum-to-one constraints. Both FFF and F∗F^*F∗ quantify only over functions satisfying those constraints. Conditional beliefs use the common prior in equations (3)–(4), and positive marginal probabilities make every denominator meaningful without requiring positive probability for each full profile. The positivity of every Ri(ai)R_i(a_i)Ri​(ai​) is an assumption the paper makes implicitly by dividing by it in (3); it is a field of the problem structure, not a hypothesis of the theorems. The subjective reading of PiP_iPi​ and RiR_iRi​ that the paper permits on p. 63, the response-plan equilibria of Section 3, and the numerical example of Section 6 are outside this mission.

Strict dominance means a strict gain for every player type. The constant mechanism, conflict vector, and individually rational set are defined from the problem data. The conflict vector is defined by equation (16), while its equality with the constant mechanism's payoff is a theorem item. The product uses real powers with the paper's marginal weights and is compared only on F+∗F^*_+F+∗​, where each base is nonnegative. A solution is a maximizer property; it is not chosen in advance or supplied as a theorem hypothesis. These choices exclude vacuous encodings of incentive efficiency, unrestricted mechanisms, and a maximization domain that already contains only a nominated winner.

A complete proof development needs finite sums and products, continuous and convex maps on finite-dimensional real spaces, compactness of the constrained mechanism set, and facts about positive weighted real powers or logarithms on the strictly positive region. The model definitions can be reused for the paper's separate revelation-principle mission; this mission also welcomes proofs of the explicit claims about the uniform mechanism, the conflict mechanism, and product maximizers.

Selected references

  • Roger B. Myerson, Incentive Compatibility and the Bargaining Problem, Econometrica 47(1), 61–73, 1979. DOI: 10.2307/1912346.
  • John F. Nash, The Bargaining Problem, Econometrica 18(2), 155–162, 1950. DOI: 10.2307/1907266.
  • John C. Harsanyi and Reinhard Selten, A Generalized Nash Solution for Two-Person Bargaining Games with Incomplete Information, Management Science 18(5), P80–P106, 1972. DOI: 10.1287/mnsc.18.5.80.
8 thms1 active userReviewed
OptimizationProbability·Captain: mikedeng1

Optimal Pricing and Return Policies for Perishable Commodities II: Neither Unlimited Returns at Full Credit nor a No-Returns Policy Coordinates the ChannelResearch Paper

Why return terms matter

Manufacturers of perishable goods must decide how much inventory risk to leave with retailers. A retailer who pays for every ordered unit may order less than is best for the manufacturer and retailer together; a generous return policy changes that incentive. Pasternack studies this question in a single-period setting, with a fixed selling price, uncertain demand and goodwill costs when customers cannot be served. The article identifies two familiar endpoint policies that fail: no returns, and unlimited returns reimbursed at the full wholesale price. It then investigates partial credit as a way to align the order decisions. Pasternack (1985)

The target here is the article's paired Theorems 1 and 2. They concern one retailer and one manufacturer, and their conclusion is about the order quantity the retailer chooses. The model does not ask the retailer to choose the selling price, nor does it compare realized profits for one particular demand outcome. The value of the result lies in ruling out two whole classes of pricing and return terms before considering how to divide the gains from a coordinated channel. Pasternack (1985), pp. 169–171

The single-period setting

A manufacturer produces at unit cost ccc and charges the retailer a wholesale price c1c_1c1​. The retailer orders Q≥0Q\ge0Q≥0 units before observing demand XXX, then sells at a fixed retail price ppp. Unsold units have salvage value c3c_3c3​. A return policy gives the retailer a credit c2c_2c2​ for a fraction R∈[0,1]R\in[0,1]R∈[0,1] of the order: R=0R=0R=0 permits no returns and R=1R=1R=1 permits returns of every leftover unit. The retailer incurs goodwill cost ggg for each unmet unit of demand; the manufacturer bears the additional cost g1g_1g1​, and g2=g+g1g_2=g+g_1g2​=g+g1​ is the total goodwill cost. The paper assumes c3<c<c1<pc_3<c<c_1<pc3​<c<c1​<p and c3<c2≤c1<pc_3<c_2\le c_1<pc3​<c2​≤c1​<p. Pasternack (1985), pp. 169–170, (1)–(2)

Demand is described by a density fff on the nonnegative reals and distribution function F(Q)=∫0Qf(x) dxF(Q)=\int_0^Q f(x)\,dxF(Q)=∫0Q​f(x)dx. From the same order and demand outcome, the paper computes three expected profits: EPT(Q)EP_T(Q)EPT​(Q) for an integrated company store, EPR(Q)EP_R(Q)EPR​(Q) for the independent retailer, and EPM(Q)EP_M(Q)EPM​(Q) for the manufacturer. Their definitions are equations (3), (6) and (8). An optimal order maximizes the relevant expected profit over nonnegative QQQ. The paper calls the channel coordinated when the retailer chooses a system-optimal order, as if the manufacturer operated the store directly. The formal model compares the sets of all such optimal orders, so it also handles a distribution whose CDF is flat over an interval. Pasternack (1985), pp. 170–171, (3), (6), (8)–(10)

Formalization targets

The integrated company's optimal-order equation (5) supplies the benchmark:

F(QT∗)=p+g2−cp+g2−c3.F(Q_T^*)=\frac{p+g_2-c}{p+g_2-c_3}.F(QT∗​)=p+g2​−c3​p+g2​−c​.

The retailer's optimal-order equation (7) includes both F(Q)F(Q)F(Q) and F((1−R)Q)F((1-R)Q)F((1−R)Q). Substituting the integrated benchmark gives equation (10), the common comparison used for the two endpoint policies. The first three milestones formalize these conditions, including existence of an integrated optimum. The last two milestones record the separate calculations in the appendix for full-credit returns and no returns. Pasternack (1985), pp. 170–171, 175

The mission goal combines Theorems 1 and 2 as the article does immediately after stating them. With R=1,c2=c1R=1,c_2=c_1R=1,c2​=c1​ or with R=0R=0R=0, every system-optimal order fails to be retailer-optimal:

arg max⁡Q≥0EPT(Q)≠∅,arg max⁡Q≥0EPT(Q)∩arg max⁡Q≥0EPR(Q)=∅.\operatorname*{arg\,max}_{Q\ge0}EP_T(Q)\ne\varnothing,\qquad \operatorname*{arg\,max}_{Q\ge0}EP_T(Q)\cap \operatorname*{arg\,max}_{Q\ge0}EP_R(Q)=\varnothing.Q≥0argmax​EPT​(Q)=∅,Q≥0argmax​EPT​(Q)∩Q≥0argmax​EPR​(Q)=∅.

The disjointness claim is read separately for each endpoint policy. It says more than merely finding one order on which the firms disagree: neither endpoint policy can induce the retailer to choose a system optimum. Pasternack (1985), Theorems 1–2 and following paragraph, p. 171

What the result establishes

The result separates a policy that reimburses all unsold stock at full wholesale price from one that offers no return option. Both may be simple to administer, but neither aligns the retailer's stocking choice with the integrated company's choice under the article's cost ordering. The result makes the paper's subsequent search for partial-credit terms substantive: the coordinating policy lies away from these two endpoints. It does not say that either endpoint always gives a loss, or that a retailer cannot make a profit. The claim concerns the order that maximizes expected channel profit. Pasternack (1985), pp. 171–172

The known result is proved in the article, but its definitions and theorem statements have not been machine-checked as part of this mission. Formalization gives a reusable account of the paper's piecewise expected profits, feasible order quantities and return fraction, and makes explicit the conditions under which the endpoint conclusions hold. Related proved platform statements include Snyder and Shen's wholesale coordination and wholesale under-ordering. They are not imported: their contract data require 0≤v<cr0\le v<c_r0≤v<cr​, while Pasternack's retailer has no separate own unit cost and the article does not require nonnegative salvage value.

The difficult boundary cases

The claim is sensitive to the demand model. If demand is deterministic, its CDF has a jump, and an order exactly equal to demand can be optimal under both the integrated profit and unlimited full-credit returns. The paper assumes a demand density; continuity of the CDF is therefore material to Theorem 1. Flat parts of a continuous CDF pose a different issue: a theorem identifying just one optimum would lose some orders, so the milestone conditions identify whole sets of maximizers. Pasternack (1985), p. 170, definition of fff and (4)–(7)

The no-return case also depends on the meaning of the manufacturer's additional goodwill cost. The paper names g1g_1g1​ as a cost but does not print a separate nonnegativity inequality. If it were allowed to be negative, the appendix's contradiction with c1>cc_1>cc1​>c could disappear. The formalization states g1≥0g_1\ge0g1​≥0, along with g≥0g\ge0g≥0, and identifies this convention openly. Pasternack (1985), pp. 170, 175

Formalization scope

Lean uses a probability measure DDD supported on [0,∞)[0,\infty)[0,∞) with finite first moment in place of a named density fff. The theorems assume that DDD has no atoms, giving the continuous CDF needed by the paper's first order conditions. The profit definitions retain the piecewise formulas of (3), (6) and (8), including the thresholds (1−R)Q(1-R)Q(1−R)Q and QQQ. Adjacent pieces agree at their boundaries. The fixed retail price and the fraction R∈[0,1]R\in[0,1]R∈[0,1] match the paper's setting. The cost ordering is split between fixed costs and an admissible policy, because the theorem compares particular policy choices.

Only Q≥0Q\ge0Q≥0 is feasible. An optimal-order predicate includes this membership as well as maximality, and coordination compares complete argmax sets. The goal explicitly asserts that a system optimum exists, preventing a vacuous conclusion about orders when there are none. At R=0R=0R=0 the retailer profit is independent of c2c_2c2​, so the goal quantifies over every credit without imposing an unused bound on it. The denominator p+g2−c3p+g_2-c_3p+g2​−c3​ is positive under c3<c<pc_3<c<pc3​<c<p and g,g1≥0g,g_1\ge0g,g1​≥0. Contributions that develop the optimal-order characterizations, the substitution identity, or the endpoint contradictions within these conventions directly support the goal.

Selected references

  • Barry Alan Pasternack, Optimal Pricing and Return Policies for Perishable Commodities, Marketing Science 4(2):166–176, 1985. DOI: 10.1287/mksc.4.2.166.
7 thms1 active userReviewed
OptimizationProbability·Captain: mikedeng1

Optimal Pricing and Return Policies for Perishable Commodities I: Unlimited Returns at Partial Credit Coordinate the Channel for Every Demand DistributionResearch Paper

Motivation

A manufacturer of a perishable good (newspapers, magazines, bread, seasonal fashion, printed books) sells through a retailer who must commit to an order before demand is known. Unsold units lose most of their value; unmet demand costs goodwill. When the retailer alone bears the risk of leftovers, it orders less than an integrated firm would, and the channel as a whole earns less. This inefficiency is the double marginalization of the newsvendor problem, and return policies, under which the manufacturer buys back unsold units, are the instrument publishers and other suppliers of perishable goods actually use against it.

Barry Alan Pasternack's paper Optimal Pricing and Return Policies for Perishable Commodities (Marketing Science, 1985) was the first to show, in a single-period newsvendor model, which return policies restore the integrated firm's order quantity. It became the starting point of the literature on supply-chain contracts: buy-back contracts are now a textbook chapter (Cachon 2003; Snyder and Shen, Fundamentals of Supply Chain Theory), and the paper's result is the standard example of a contract that coordinates a channel while letting the two firms split the profit.

Setting

A manufacturer produces at unit cost ccc. A retailer sells at the fixed retail price ppp. Leftover units are salvaged at c3c_3c3​ per unit. Each unit of unmet demand costs the retailer a goodwill penalty g≥0g \ge 0g≥0 and the manufacturer an additional penalty g1≥0g_1 \ge 0g1​≥0; write g2=g+g1g_2 = g + g_1g2​=g+g1​. The data satisfy c3<c<pc_3 < c < pc3​<c<p.

The manufacturer chooses a policy (c1,c2,R)(c_1, c_2, R)(c1​,c2​,R): the retailer pays c1c_1c1​ per unit ordered and may return up to the fraction R∈[0,1]R \in [0,1]R∈[0,1] of its order QQQ for a credit c2c_2c2​ per unit. The paper assumes

c3<c<c1<p,c3<c2≤c1<p.(1), (2)c_3 < c < c_1 < p, \qquad c_3 < c_2 \le c_1 < p. \qquad (1),\ (2)c3​<c<c1​<p,c3​<c2​≤c1​<p.(1), (2)

Demand X≥0X \ge 0X≥0 is random with distribution function FFF. Three expected profits are defined as functions of the order QQQ: EPT(Q)EP_T(Q)EPT​(Q), equation (3), the profit of a company store in which the manufacturer sells directly; EPR(Q)EP_R(Q)EPR​(Q), equation (6), the independent retailer's profit under the policy; and EPM(Q)EP_M(Q)EPM​(Q), equation (8), the manufacturer's profit when the retailer orders QQQ. An optimal order for a profit function is a Q≥0Q \ge 0Q≥0 maximizing it over [0,∞)[0,\infty)[0,∞). The policy coordinates the channel when the retailer's optimal orders are exactly the company store's optimal orders: the decentralized channel then produces the integrated firm's quantity.

The Lean development uses the same letters: Costs carries c,c3,p,g,g1c, c_3, p, g, g_1c,c3​,p,g,g1​; Costs.Admissible K c1 c2 R is (1)–(2) with 0≤R≤10 \le R \le 10≤R≤1; EPT, EPR, EPM are (3), (6), (8); IsOptimalOrder and Coordinates are the two notions just defined; FFF is cdf D for a demand law D.

Formalization targets

Goal: Theorem 3

A policy which allows for unlimited returns at partial credit will be system optimal for appropriately chosen values of c1c_1c1​ and c2c_2c2​. Precisely, for every price c1c_1c1​ with c<c1<pc < c_1 < pc<c1​<p there is a credit c2c_2c2​ with

c3<c2<c1,c1=(p+g)−(p+g2−c)(p+g−c2)p+g2−c3(11),c_3 < c_2 < c_1, \qquad c_1 = (p+g) - \frac{(p+g_2-c)(p+g-c_2)}{p+g_2-c_3} \quad (11),c3​<c2​<c1​,c1​=(p+g)−p+g2​−c3​(p+g2​−c)(p+g−c2​)​(11),

such that the policy (c1,c2,R=1)(c_1, c_2, R = 1)(c1​,c2​,R=1) coordinates the channel for every continuous demand distribution on [0,∞)[0,\infty)[0,∞) with finite mean. The credit is chosen before, and independently of, the demand law.

Milestones

  1. (4)–(5): the company store has an optimal order, and QQQ is optimal iff F(Q)=(p+g2−c)/(p+g2−c3)F(Q) = (p+g_2-c)/(p+g_2-c_3)F(Q)=(p+g2​−c)/(p+g2​−c3​).
  2. (7): under an admissible policy, QQQ is optimal for the retailer iff 0=−c1+p+g−F(Q)[p+g−c2]−F((1−R)Q)[(1−R)(c2−c3)]0 = -c_1 + p + g - F(Q)[p+g-c_2] - F((1-R)Q)[(1-R)(c_2-c_3)]0=−c1​+p+g−F(Q)[p+g−c2​]−F((1−R)Q)[(1−R)(c2​−c3​)].
  3. (9)–(10): an admissible policy coordinates the channel iff (10) holds at every system-optimal order.
  4. (11): with R=1R = 1R=1 and c2<c1c_2 < c_1c2​<c1​, coordination holds iff (11) holds, whatever the demand law.
  5. Appendix, proof of Theorem 3: for c<c1<pc < c_1 < pc<c1​<p, (11) has a solution c2c_2c2​ with c3<c2<c1c_3 < c_2 < c_1c3​<c2​<c1​.

Significance

The result. Theorem 3 says that a buy-back contract with full returns at a partial credit aligns the retailer's incentives with the channel's, and that the coordinating credit depends only on costs. The second point carries the paper's practical conclusion: a manufacturer selling one product to many retailers with different demand distributions can post one price and one return credit and still have every retailer order its system-optimal quantity. The one-parameter family of coordinating pairs (c1,c2)(c_1, c_2)(c1​,c2​) then splits the channel profit between the firms. The companion mission (Optimal Pricing and Return Policies for Perishable Commodities II) formalizes the negative results, Theorems 1 and 2: neither full credit with unlimited returns nor a no-returns policy coordinates.

Formalizing it. The paper's proofs are first-order conditions and a short algebraic argument. A machine-checked version adds three things. It makes the analytic content explicit: existence of the system optimum, global optimality of the first-order conditions for an arbitrary atomless demand law, and the quantifier structure "one credit for all demand laws". It repairs a gap: the printed argument for c3<c2c_3 < c_2c3​<c2​ establishes only c2>c3−g1c_2 > c_3 - g_1c2​>c3​−g1​, which suffices only when g1=0g_1 = 0g1​=0, although the claim holds for all g1≥0g_1 \ge 0g1​≥0. And it gives a reusable newsvendor layer with returns. Related results are proved on Prove2Me in a different model: Snyder–Shen's SupplyChainTheory.buyback_coordinates (Theorem 14.4) and SupplyChainTheory.buyback_profit_identities. They are not referenced here, because their contract data require a retailer cost cr>v≥0c_r > v \ge 0cr​>v≥0, which excludes Pasternack's retailer (no own cost), and because they fix the buy-back price and derive the wholesale price, with no range claim.

Difficulty

The algebraic core, milestone 5, is short. The work sits in the analytic milestones. Differentiating under the integral sign in (3) and (6) needs the integrands' piecewise structure and the absence of atoms; the global-maximum claim needs concavity of the expected profits on [0,∞)[0,\infty)[0,∞), including the boundary Q=0Q = 0Q=0. Coordination is a statement about sets of maximizers, not about one first-order condition: when FFF is flat at the critical fractile, the optimal orders form an interval, and showing that the retailer's maximizers coincide with the system's requires the monotonicity of the retailer's marginal profit, strict where FFF increases. The naive reading "both first-order conditions hold at QT∗Q^*_TQT∗​" proves one inclusion only.

Formalization scope

Demand is a probability measure D on R\mathbb RR with D (Iio 0) = 0 and finite mean (IsDemand), and FFF is cdf D. The paper's density is the hypothesis NullSingletonClass D (no atoms), imposed on each theorem that uses it. The expected profits are Lean integrals of the paper's piecewise integrands, written with if. The goodwill costs satisfy g,g1≥0g, g_1 \ge 0g,g1​≥0, implicit in the paper. RRR is a fraction in [0,1][0,1][0,1]. Optimal orders are maximizers over Q≥0Q \ge 0Q≥0 that are themselves ≥0\ge 0≥0. Coordination is equality of the retailer's and the company store's sets of optimal orders. The denominator p+g2−c3p + g_2 - c_3p+g2​−c3​ is positive under these assumptions, so no division is degenerate.

The goal is not the algebraic statement "there is c2∈(c3,c1)c_2 \in (c_3, c_1)c2​∈(c3​,c1​) solving (11)": that is milestone 5. A formalization of Theorem 3 must conclude Coordinates, a statement about the maximizers of the actual profit functions (3) and (6), and must place the quantifier over demand laws inside the existence of c2c_2c2​.

A complete development needs: differentiation of parametric integrals with piecewise-linear integrands, concavity of the newsvendor profit, the intermediate value theorem for continuous distribution functions, and the critical-fractile characterization. The newsvendor layer (milestones 1 and 2) is reusable for any single-period contract model. Proofs of the milestones, alternative proofs (for example via the identity EPR=k⋅EPT+constEP_R = k \cdot EP_T + \text{const}EPR​=k⋅EPT​+const under (11), which also removes the no-atoms hypothesis), and the profit formulas (12)–(14) at the coordinated optimum are all welcome.

Selected references

  • B. A. Pasternack, Optimal Pricing and Return Policies for Perishable Commodities, Marketing Science 4(2):166–176, 1985. https://doi.org/10.1287/mksc.4.2.166
  • G. P. Cachon, Supply Chain Coordination with Contracts, in Handbooks in Operations Research and Management Science 11, 2003, 227–339. https://doi.org/10.1016/S0927-0507(03)11006-7
  • L. V. Snyder and Z.-J. M. Shen, Fundamentals of Supply Chain Theory, 2nd ed., Wiley, 2019. https://doi.org/10.1002/9781119584445
7 thms1 active userReviewed
Convex OptimizationOptimization·Captain: mikedeng1

Scenarios and Policy Aggregation in Optimization Under Uncertainty 1: In the Convex Case Progressive Hedging Converges to Optimal Solutions of (P) and (D) Exactly When They ExistResearch Paper

Motivation

Decisions under uncertainty are often modelled by a finite set of scenarios: possible futures s∈Ss\in Ss∈S with weights psp_sps​, each with its own optimization problem. Solving every scenario separately is easy but useless in practice, because the decision taken today cannot depend on which scenario will be revealed tomorrow. Progressive hedging, introduced by Rockafellar and Wets in Scenarios and policy aggregation in optimization under uncertainty (IIASA Working Paper WP-87-119, 1987; Mathematics of Operations Research 16(1), 1991), restores this nonanticipativity by iterating between scenario-wise solves and an averaging step, guided by price systems that act as multipliers. It is the standard decomposition method for multistage stochastic programs and is implemented in widely used software such as PySP/mpi-sppy. This mission formalizes the paper's convergence theorem in the convex case, Theorem 5.1, together with the duality theory of §4 and the proof steps of §5 it rests on.

Setting

Let SSS be a finite set of scenarios with weights ps>0p_s>0ps​>0, ∑sps=1\sum_s p_s=1∑s​ps​=1. For each sss the scenario subproblem (Ps)(P_s)(Ps​) is to minimize fs(x)f_s(x)fs​(x) over x∈Cs⊂Rnx\in C_s\subset\mathbb R^nx∈Cs​⊂Rn, where CsC_sCs​ is nonempty and closed and fsf_sfs​ is locally Lipschitz with bounded level sets {x∈Cs∣fs(x)≤α}\{x\in C_s\mid f_s(x)\le\alpha\}{x∈Cs​∣fs​(x)≤α}. The convex case is when every fsf_sfs​ and CsC_sCs​ is convex.

A decision vector is split by time, x=(x1,…,xT)x=(x_1,\dots,x_T)x=(x1​,…,xT​). A policy is a map X:S→RnX:S\to\mathbb R^nX:S→Rn; the policy space E\mathcal EE carries the inner product ⟨X,Y⟩=∑spsX(s)⋅Y(s)\langle X,Y\rangle=\sum_s p_s X(s)\cdot Y(s)⟨X,Y⟩=∑s​ps​X(s)⋅Y(s) and norm ∥X∥=⟨X,X⟩1/2\|X\|=\langle X,X\rangle^{1/2}∥X∥=⟨X,X⟩1/2. At each time ttt the scenarios are partitioned into bundles A∈AtA\in\mathcal A_tA∈At​ of scenarios that cannot yet be told apart. The aggregation X^=JX\hat X=JXX^=JX replaces Xt(s)X_t(s)Xt​(s) by its ppp-weighted average over the bundle of sss at time ttt, and K=I−JK=I-JK=I−J. The implementable policies are N={X∣Xt\mathcal N=\{X\mid X_tN={X∣Xt​ constant on each A∈At}A\in\mathcal A_t\}A∈At​}, the price systems are M={W∣JW=0}=N⊥\mathcal M=\{W\mid JW=0\}=\mathcal N^\perpM={W∣JW=0}=N⊥, and the admissible policies are C={X∣X(s)∈Cs ∀s}\mathcal C=\{X\mid X(s)\in C_s\ \forall s\}C={X∣X(s)∈Cs​ ∀s}. With F(X)=∑spsfs(X(s))F(X)=\sum_s p_s f_s(X(s))F(X)=∑s​ps​fs​(X(s)) the problem is

(P)minimize F(X) subject to X∈C∩N.(P)\qquad \text{minimize } F(X) \text{ subject to } X\in\mathcal C\cap\mathcal N .(P)minimize F(X) subject to X∈C∩N.

Its Lagrangian is L(X,W)=F(X)+⟨X,W⟩L(X,W)=F(X)+\langle X,W\rangleL(X,W)=F(X)+⟨X,W⟩ on C×M\mathcal C\times\mathcal MC×M, the dual is (D)(D)(D): maximize G(W)=inf⁡X∈CL(X,W)G(W)=\inf_{X\in\mathcal C}L(X,W)G(W)=infX∈C​L(X,W) over W∈MW\in\mathcal MW∈M with G(W)>−∞G(W)>-\inftyG(W)>−∞.

The progressive hedging algorithm fixes r>0r>0r>0, starts from any X0X^0X0 and any W0∈MW^0\in\mathcal MW0∈M, and in iteration ν\nuν sets X^ν=JXν\hat X^\nu=JX^\nuX^ν=JXν, lets Xν+1(s)X^{\nu+1}(s)Xν+1(s) minimize

fs(x)+x⋅Wν(s)+12r ∣x−X^ν(s)∣2over x∈Csf_s(x)+x\cdot W^\nu(s)+\tfrac12 r\,|x-\hat X^\nu(s)|^2\quad\text{over } x\in C_sfs​(x)+x⋅Wν(s)+21​r∣x−X^ν(s)∣2over x∈Cs​

for every scenario, and updates Wν+1=Wν+rKXν+1W^{\nu+1}=W^\nu+rKX^{\nu+1}Wν+1=Wν+rKXν+1.

Formalization targets

Goal: Theorem 5.1

In the convex case with exact minimization, the sequences {X^ν}\{\hat X^\nu\}{X^ν} and {Wν}\{W^\nu\}{Wν} are bounded if and only if (P) and (D) have optimal solutions. In that case there are optimal X∗X^*X∗ for (P) and W∗W^*W∗ for (D) with

X^ν→X∗,Wν→W∗,\hat X^\nu\to X^*,\qquad W^\nu\to W^*,X^ν→X∗,Wν→W∗,

and, with ∥(X,W)∥r=(∥X∥2+r−2∥W∥2)1/2\|(X,W)\|_r=(\|X\|^2+r^{-2}\|W\|^2)^{1/2}∥(X,W)∥r​=(∥X∥2+r−2∥W∥2)1/2,

∥(X^ν+1,Wν+1)−(X∗,W∗)∥r≤∥(X^ν,Wν)−(X∗,W∗)∥r\|(\hat X^{\nu+1},W^{\nu+1})-(X^*,W^*)\|_r\le\|(\hat X^{\nu},W^{\nu})-(X^*,W^*)\|_r∥(X^ν+1,Wν+1)−(X∗,W∗)∥r​≤∥(X^ν,Wν)−(X∗,W∗)∥r​

for all ν≥0\nu\ge0ν≥0, strictly unless (X^ν,Wν)=(X∗,W∗)(\hat X^\nu,W^\nu)=(X^*,W^*)(X^ν,Wν)=(X∗,W∗), and the step lengths ∥(X^ν+1,Wν+1)−(X^ν,Wν)∥r\|(\hat X^{\nu+1},W^{\nu+1})-(\hat X^\nu,W^\nu)\|_r∥(X^ν+1,Wν+1)−(X^ν,Wν)∥r​ are nonincreasing from ν=1\nu=1ν=1 on.

Milestones

  1. Propositions 3.1–3.3: existence for the scenario subproblems, the lower bound α^=min⁡CF=E{min⁡(Ps)}≤min⁡(P)\hat\alpha=\min_{\mathcal C}F=E\{\min(P_s)\}\le\min(P)α^=minC​F=E{min(Ps​)}≤min(P), well-posedness of every modified subproblem (unique solution in the convex case), and compact level sets of FFF on C\mathcal CC.
  2. Theorem 4.2 and Proposition 4.4 (in the convex case): the scenario-wise subgradient conditions −W∗(s)∈∂fs(X∗(s))+NCs(X∗(s))-W^*(s)\in\partial f_s(X^*(s))+N_{C_s}(X^*(s))−W∗(s)∈∂fs​(X∗(s))+NCs​​(X∗(s)) are equivalent to a saddle point of LLL, and the analogous conditions are necessary and sufficient for the iterates.
  3. Proposition 4.5 and Theorem 4.6: the perturbation function Φ(U)=min⁡{F(X)∣X∈C, KX=U}\Phi(U)=\min\{F(X)\mid X\in\mathcal C,\ KX=U\}Φ(U)=min{F(X)∣X∈C, KX=U} and the duality −∞<min⁡(P)=sup⁡(D)-\infty<\min(P)=\sup(D)−∞<min(P)=sup(D), argmax⁡(D)=−∂Φ(0)\operatorname{argmax}(D)=-\partial\Phi(0)argmax(D)=−∂Φ(0).
  4. Proposition 5.3: each iteration is the unique saddle point of a proximal saddle function.
  5. From the proof of Theorem 5.1: firm nonexpansiveness (5.26) of the iteration map in ∥⋅∥r\|\cdot\|_r∥⋅∥r​, and the identification of its fixed points with primal–dual optimal pairs.

Significance

Theorem 5.1 is the guarantee behind progressive hedging in the convex case: solving only small scenario problems and averaging, the method finds a nonanticipative optimal policy and an optimal price system whenever these exist, with a distance to the solution that never increases. The dual sequence WνW^\nuWν converges to a solution of (D), which gives the prices of information that the paper interprets economically. Boundedness of the iterates is an exact test for solvability.

The result is classical and fully proved on paper; its proof reduces the algorithm to Rockafellar's proximal point algorithm for a maximal monotone operator. No machine-checked version is known to exist. The mission produces a formal statement and, eventually, a proof of the full chain from scenario data to convergence, including the duality theorem of §4, which is of independent use for scenario-based stochastic programming. A related platform mission in this series treats the nonconvex case (limits of the algorithm satisfy first-order conditions).

Difficulty

The algorithm is not a proximal point method in the variable XXX: it acts on the pair (X^,W)(\hat X,W)(X^,W), and the averaged policy X^ν\hat X^\nuX^ν is in general not admissible while XνX^\nuXν is in general not implementable. The step that fails in a direct attempt is showing that the map (X^ν,Wν)↦(X^ν+1,Wν+1)(\hat X^\nu,W^\nu)\mapsto(\hat X^{\nu+1},W^{\nu+1})(X^ν,Wν)↦(X^ν+1,Wν+1) is firmly nonexpansive, which requires recognizing it as the resolvent of the monotone operator of a saddle function restricted to N×M\mathcal N\times\mathcal MN×M, in the rescaled norm ∥⋅∥r\|\cdot\|_r∥⋅∥r​ rather than in the original product norm. A second difficulty is duality: identifying the fixed points of the iteration with optimal pairs of (P) and (D) needs the convex duality theory of §4 for an extended-real-valued perturbation function without any constraint qualification.

Formalization scope

Rn\mathbb R^nRn is EuclideanSpace ℝ (Fin n); policies are functions S → EuclideanSpace ℝ (Fin n) with S a Fintype. Time periods are a monotone map assigning each coordinate to its period, and each At\mathcal A_tAt​ is a Setoid S; no refinement between periods is assumed. The standing assumptions of §3 are fields of the model structure, and the convex case is a separate hypothesis.

The inner product (2.2), norm (2.3) and ∥⋅∥r\|\cdot\|_r∥⋅∥r​ (5.2) are explicit weighted sums. Mathlib's norm on a function type is the sup norm; it is used only for topology (boundedness, convergence, local Lipschitz continuity, compactness), which coincides with that of (2.3) in finite dimension. Stating (5.3) or (5.26) with Mathlib's sup norm would change the inequalities and is ruled out. Optimal values min⁡(P)\min(P)min(P), sup⁡(D)\sup(D)sup(D), GGG, Φ\PhiΦ, α^\hat\alphaα^ and ℓ\ellℓ are EReal infima and suprema, so that infeasibility gives +∞+\infty+∞ and an unbounded dual objective gives −∞-\infty−∞; real-valued sInf would silently return 000 there. A solution of (D) must have G(W∗)>−∞G(W^*)>-\inftyG(W∗)>−∞. The algorithm is a predicate on sequences, with X0X^0X0 arbitrary and W0∈MW^0\in\mathcal MW0∈M; Proposition 3.2 shows the predicate is satisfiable.

Subgradients and normal cones are those of convex analysis; the normal cone is the published definition FirstOrderOpt.ConvexTheory.normalCone. Not formalized: the nonconvex (Clarke) parts of §4, the linear-quadratic case and its rate result, and inexact minimization.

A complete development needs: separable minimization over product sets, finite-dimensional compactness arguments, convex duality for a perturbation function on a subspace, and the convergence of the proximal point algorithm for maximal monotone operators (Rockafellar 1976, Theorem 1 and Proposition 1). The last two are reusable well beyond this mission; contributions of either as standalone results are welcome.

Selected references

  • R. T. Rockafellar and R. J.-B. Wets, Scenarios and policy aggregation in optimization under uncertainty, IIASA Working Paper WP-87-119, 1987; Mathematics of Operations Research 16(1):119–147, 1991. https://pure.iiasa.ac.at/id/eprint/2933/ — https://doi.org/10.1287/moor.16.1.119
  • R. T. Rockafellar, Monotone operators and the proximal point algorithm, SIAM Journal on Control and Optimization 14(5):877–898, 1976. https://doi.org/10.1137/0314056
  • G. J. Minty, Monotone (nonlinear) operators in Hilbert space, Duke Mathematical Journal 29(3):341–346, 1962. https://doi.org/10.1215/S0012-7094-62-02933-2
  • R. T. Rockafellar, Convex Analysis, Princeton University Press, 1970. https://doi.org/10.1515/9781400873173
15 thms1 active userReviewed
Algorithmic Game TheoryGraph Theory·Captain: mikedeng1

Graphs and Cooperation in Games: The Unique Fair Allocation Rule, the Shapley Value of the Graph-Restricted Game, Is Totally Stable for Superadditive GamesResearch Paper

Motivation

Classical cooperative game theory assumes that any coalition of players can form and coordinate. In many settings cooperation is mediated by pairwise relationships: communication lines, contracts, alliances, or trade links. Roger Myerson's discussion paper Graphs and Cooperation in Games (Northwestern University, 1976; published in Mathematics of Operations Research 2(3), 1977, doi:10.1287/moor.2.3.225) models such a cooperation structure as a graph on the set of players and asks how the players should share the worth of the game when only linked players can coordinate directly.

The answer, now called the Myerson value, is the starting point of the literature on communication situations and network games. It underlies later work on network formation (Jackson and Wolinsky, A strategic model of social and economic networks, JET 1996) and on allocation rules for networks, and it is a standard textbook example of an axiomatic solution concept.

Timeline:

  • 1953. Shapley defines the Shapley value φ\varphiφ for transferable-utility games by efficiency, symmetry, a carrier axiom and additivity (Shapley 1953).
  • 1976–1977. Myerson introduces cooperation graphs, the fairness (equal gains from each link) condition, proves existence and uniqueness of the fair allocation rule, identifies it as the Shapley value of the graph-restricted game, proves its total stability for superadditive games, and extends existence and uniqueness to games without transferable utility in graph function form.

Setting

Let NNN be a nonempty finite set of players and CLCLCL the set of nonempty coalitions S⊆NS\subseteq NS⊆N. A game in characteristic function form is a vector v∈RCLv\in\mathbb R^{CL}v∈RCL; vSv_SvS​ is the transferable wealth coalition SSS can divide.

A link n:mn{:}mn:m is an unordered pair of distinct players and a graph ggg is a set of links; GRGRGR is the set of all graphs, gˉN\bar g^Ngˉ​N the complete graph, g∖n:mg\setminus n{:}mg∖n:m the graph with one link removed, and ∣g∣|g|∣g∣ the number of links. Players a,ba,ba,b are connected in SSS by ggg if a=b∈Sa=b\in Sa=b∈S or a path of links of ggg joins them through players of SSS only; the classes form the partition S/gS/gS/g of SSS, and N/gN/gN/g is the set of connected components of ggg. The graph-restricted game is

(v/g)S=∑T∈S/gvT.(v/g)_S=\sum_{T\in S/g}v_T .(v/g)S​=T∈S/g∑​vT​.

An allocation rule is a function Y:GR→RNY:GR\to\mathbb R^NY:GR→RN, with Yn(g)Y_n(g)Yn​(g) the payoff of player nnn under cooperation structure ggg. It is a fair allocation rule for vvv if

  1. (efficiency, (7)) ∑n∈SYn(g)=vS\sum_{n\in S}Y_n(g)=v_S∑n∈S​Yn​(g)=vS​ for every ggg and every component S∈N/gS\in N/gS∈N/g, and
  2. (equity, (10)) Yn(g)−Yn(g∖n:m)=Ym(g)−Ym(g∖n:m)Y_n(g)-Y_n(g\setminus n{:}m)=Y_m(g)-Y_m(g\setminus n{:}m)Yn​(g)−Yn​(g∖n:m)=Ym​(g)−Ym​(g∖n:m) for every ggg and every link n:m∈gn{:}m\in gn:m∈g.

YYY is totally stable if Yn(g)≥Yn(g∖n:m)Y_n(g)\ge Y_n(g\setminus n{:}m)Yn​(g)≥Yn​(g∖n:m) for every ggg and every link n:m∈gn{:}m\in gn:m∈g, and vvv is superadditive if vS∪T≥vS+vTv_{S\cup T}\ge v_S+v_TvS∪T​≥vS​+vT​ for disjoint S,T∈CLS,T\in CLS,T∈CL.

A game in graph function form assigns to every pair (S,g)(S,g)(S,g) with S∈N/gS\in N/gS∈N/g a closed, comprehensive (closed under decreasing coordinates), proper (∅≠W≠RS\emptyset\ne W\ne\mathbb R^S∅=W=RS) set w(S,g)⊆RSw(S,g)\subseteq\mathbb R^Sw(S,g)⊆RS of feasible payoffs; its fair allocation rule replaces (7) by (14), (Yn(g))n∈S∈∂w(S,g)(Y_n(g))_{n\in S}\in\partial w(S,g)(Yn​(g))n∈S​∈∂w(S,g).

Formalization targets

Goal: Theorem 3 (p. 8)

If vvv is superadditive, then the fair allocation rule YYY for vvv is totally stable:

Yn(g)≥Yn(g∖n:m)for all g∈GR, n:m∈g.Y_n(g)\ge Y_n(g\setminus n{:}m)\qquad\text{for all } g\in GR,\ n{:}m\in g .Yn​(g)≥Yn​(g∖n:m)for all g∈GR, n:m∈g.

Theorem 1 (p. 7) and Theorem 4 (p. 10)

Every v∈RCLv\in\mathbb R^{CL}v∈RCL has a unique fair allocation rule; every game www in graph function form has a unique YYY satisfying (14) and (10).

Theorem 2 (p. 8)

The fair allocation rule is

Y(g)=φ(v/g)for all g∈GR,in particular Y(gˉN)=φ(v).Y(g)=\varphi(v/g)\quad\text{for all }g\in GR,\qquad\text{in particular } Y(\bar g^N)=\varphi(v).Y(g)=φ(v/g)for all g∈GR,in particular Y(gˉ​N)=φ(v).

The milestones follow the paper's Section 7: the steps of the proof of Theorem 4 (displays (15)–(17)), Theorem 4, Theorem 1, the decomposition of v/gv/gv/g and the efficiency and equity of φ(v/g)\varphi(v/g)φ(v/g) (proof of Theorem 2), Theorem 2, and the monotonicity of v/gv/gv/g and φ(v/g)\varphi(v/g)φ(v/g) in a link (proof of Theorem 3). Theorem 3 is the goal because its proof uses the formula of Theorem 2, whose proof uses the uniqueness of Theorem 1, which is the transferable-utility case of Theorem 4: all four numbered results lie on one path.

Significance

The theorems give an axiomatic foundation for allocation in networks: two natural requirements, component-wise efficiency and equal gains from each link, single out one rule, and that rule is an explicit formula built from the Shapley value. At the complete graph it recovers the Shapley value itself, so the result is also a new characterization of the Shapley value. Total stability says that, for superadditive games, no player has an incentive to break a link, which connects the allocation rule to the question of which networks form.

The results are proved in the paper. A search of the platform found no formalization of cooperation graphs, the graph-restricted game, the Myerson value or total stability; the Shapley value is available as a platform definition and is reused. This mission produces machine-checked statements of all four theorems and of the intermediate steps of their proofs, together with a reusable definition layer for communication situations.

Difficulty

The equity condition (10) relates the payoff at a graph to the payoff at a graph with one fewer link, and it constrains only pairs of linked players; it is not evident that these conditions, together with efficiency on components, determine the rule at every graph, nor that they are consistent. Uniqueness and existence must hold simultaneously for all 2∣gˉN∣2^{|\bar g^N|}2∣gˉ​N∣ graphs, and the constraints couple each graph to all of its subgraphs and each player to every other player of its component. In the graph function form, efficiency becomes a boundary condition on a closed comprehensive set, and the existence and uniqueness of the relevant extremal point depend on all three properties of w(S,g)w(S,g)w(S,g).

Identifying the rule with φ(v/g)\varphi(v/g)φ(v/g) requires the efficiency of the Shapley value on each component of ggg, which is not the efficiency of φ\varphiφ on NNN, and equity requires tracking how the partitions S/gS/gS/g change when a link is removed. Total stability is false for general games: without superadditivity a player can gain by cutting a link, so the hypothesis cannot be dropped.

Formalization scope

Players are Fin n, with 0<n0<n0<n in every theorem as the paper assumes NNN nonempty; the paper's player kkk is index k−1k-1k−1. The general game carrier has its own definition module, and the graph-specific definitions build on it. Graphs are SimpleGraph (Fin n): gˉN\bar g^Ngˉ​N is ⊤, the empty graph ⊥, h⊆gh\subseteq gh⊆g is h ≤ g and h⊂gh\subset gh⊂g is h < g. A game is a function Finset (Fin n) → ℝ; its value at ∅\emptyset∅ is a junk coordinate that no definition reads, and no theorem assumes v∅=0v_\emptyset=0v∅​=0. Superadditivity quantifies over nonempty coalitions only. The Shapley value is the platform definition Supermodularity.Cooperative.ShapleyValue, applied after resetting the value at ∅\emptyset∅ to 000. RS\mathbb R^SRS is ↥S → ℝ with the product topology, and ∂\partial∂ is the topological frontier.

Explicit readings of the typescript:

  • The printed definition of "connected in SSS by ggg" (p. 3) asks ni∈Sn^i\in Sni∈S only for i≥1i\ge1i≥1; the formalization requires every vertex of the path, including the start, to lie in SSS, which makes S/gS/gS/g the partition of SSS the paper describes.
  • Comprehensiveness (p. 10) prints "∀n∈N\forall n\in N∀n∈N" for coordinates of vectors in RS\mathbb R^SRS; read as n∈Sn\in Sn∈S.
  • Display (17) writes Yn(h)Y_n(h)Yn​(h) under the index m∈Sm\in Sm∈S; read as Ym(h)Y_m(h)Ym​(h), as in (18b).
  • The proof headed "PROOF OF THEOREM 4." on p. 13 is the proof of Theorem 3.
  • "The unique fair allocation rule" in Theorems 2 and 3 is stated for every fair allocation rule; existence and uniqueness are Theorem 1.
  • The paper's NNN is nonempty; every theorem carries the corresponding hypothesis 0<n0<n0<n.

The equity and stability conditions quantify over links of ggg only. Quantifying over all pairs of players would make Theorem 1 false and the goal vacuous, so that reading is ruled out. Likewise (14) is boundary membership, not membership in w(S,g)w(S,g)w(S,g).

Contributions welcome: general lemmas on the partitions S/gS/gS/g (refinement under link deletion, restriction to components), Möbius inversion over the subgraph lattice of a finite simple graph, the carrier and null-player properties of the Shapley value, and the extremal-point lemma for closed comprehensive sets. These are reusable beyond this mission.

Selected references

  • R. B. Myerson, Graphs and Cooperation in Games, Discussion Paper No. 246, CMS-EMS, Northwestern University, September 1976; published in Mathematics of Operations Research 2(3):225–229, 1977. https://doi.org/10.1287/moor.2.3.225
  • L. S. Shapley, A Value for n-Person Games, in Contributions to the Theory of Games II, Annals of Mathematics Studies 28, Princeton University Press, 1953, pp. 307–317. https://doi.org/10.1515/9781400881970-018
  • M. O. Jackson and A. Wolinsky, A Strategic Model of Social and Economic Networks, Journal of Economic Theory 71(1):44–74, 1996. https://doi.org/10.1006/jeth.1996.0108
18 thms1 active userReviewed
Algorithmic Game TheoryProbability·Captain: mikedeng1

Comparison of Threshold Stop Rules and Maximum for Independent Nonnegative Random Variables I: A Median Threshold Rule Achieves EX* ≤ 2E⁺X_τResearch Paper

Why a threshold rule matters

In a finite stopping problem, a decision maker observes rewards one at a time and must accept one without seeing the future. A fully informed observer takes the maximum. This comparison is often called a prophet inequality. The abstract bound that an optimal stopping rule can secure at least half the expected maximum does not say how to choose a simple rule. Samuel-Cahn showed that a threshold chosen from a median of the maximum already gives this guarantee, even when the rewards are independent but differently distributed. The rule requires one number fixed before observations begin. Samuel-Cahn, 1984

The paper builds on earlier comparisons between the maximum and the best stopping value, then narrows attention to rules that accept an observation when it crosses a fixed threshold. This mission isolates its first main result, Theorem 1, and the two cases that determine whether the crossing test is strict or weak. The paper's second main result, concerning the sharpness of the constant for identically distributed rewards, belongs to the next mission in this series. Samuel-Cahn, 1984, pp. 1213–1215

Observations and threshold rules

Let n≥1n\ge1n≥1, and let X1,…,XnX_1,\ldots,X_nX1​,…,Xn​ be independent, nonnegative real random variables. Write Xn∗=max⁡(X1,…,Xn)X_n^*=\max(X_1,\ldots,X_n)Xn∗​=max(X1​,…,Xn​). For a threshold c≥0c\ge0c≥0, the weak threshold rule t(c)t(c)t(c) takes the first XiX_iXi​ with i<ni<ni<n and Xi≥cX_i\ge cXi​≥c; the strict threshold rule s(c)s(c)s(c) uses Xi>cX_i>cXi​>c. If no earlier observation qualifies, either rule takes XnX_nXn​, even when XnX_nXn​ is below the threshold. Hence every rule returns exactly one observed reward.

The paper distinguishes the full stopped reward from its positive threshold reward. In its notation,

E+Xt(c)=E[Xt(c)1{Xt(c)≥c}],E+Xs(c)=E[Xs(c)1{Xs(c)>c}].E^+X_{t(c)}=E[X_{t(c)}\mathbf1_{\{X_{t(c)}\ge c\}}], \qquad E^+X_{s(c)}=E[X_{s(c)}\mathbf1_{\{X_{s(c)}>c\}}].E+Xt(c)​=E[Xt(c)​1{Xt(c)​≥c}​],E+Xs(c)​=E[Xs(c)​1{Xs(c)​>c}​].

The last forced observation may contribute to EXt(c)E X_{t(c)}EXt(c)​ or EXs(c)E X_{s(c)}EXs(c)​ while contributing zero to E+Xt(c)E^+X_{t(c)}E+Xt(c)​ or E+Xs(c)E^+X_{s(c)}E+Xs(c)​. This difference is essential to the theorem's middle bounds. A median mmm of Xn∗X_n^*Xn∗​ means both P(Xn∗<m)≤12P(X_n^*<m)\le\tfrac12P(Xn∗​<m)≤21​ and P(Xn∗>m)≤12P(X_n^*>m)\le\tfrac12P(Xn∗​>m)≤21​. Define the excess sum β=∑i=1nE(Xi−m)+\beta=\sum_{i=1}^n E(X_i-m)^+β=∑i=1n​E(Xi​−m)+, where x+=max⁡(x,0)x^+=\max(x,0)x+=max(x,0). The two median inequalities allow an atom at mmm, and the two threshold rules handle that boundary differently. Samuel-Cahn, 1984, pp. 1213–1214, (1.1)–(1.2)

Formalization targets

Theorem 1: a median threshold

For every median mmm, the goal retains both of the paper's conditional conclusions:

β≥m⟹EXn∗≤2E+Xs(m)≤2EXs(m),β≤m⟹EXn∗≤2E+Xt(m)≤2EXt(m).\begin{aligned} \beta\ge m&\Longrightarrow E X_n^*\le2E^+X_{s(m)}\le2E X_{s(m)},\\ \beta\le m&\Longrightarrow E X_n^*\le2E^+X_{t(m)}\le2E X_{t(m)}. \end{aligned}β≥mβ≤m​⟹EXn∗​≤2E+Xs(m)​≤2EXs(m)​,⟹EXn∗​≤2E+Xt(m)​≤2EXt(m)​.​

At equality β=m\beta=mβ=m, both conclusions apply. The attack path follows the expected maximum bound (1.3), the displayed identities and probability bound in (1.4), and the companion weak threshold display. Each milestone points to an actual line of the paper. The NOTE and ASSERTION give a further interval of working thresholds: if a∗=E(Xn∗−a∗)+a^*=E(X_n^*-a^*)^+a∗=E(Xn∗​−a∗)+ and b∗=∑iE(Xi−b∗)+b^*=\sum_iE(X_i-b^*)^+b∗=∑i​E(Xi​−b∗)+, then every a∗≤c≤b∗a^*\le c\le b^*a∗≤c≤b∗ satisfies the same chain with t(c)t(c)t(c). Remark 1 records the special case of observations taking values in one common two point set. Samuel-Cahn, 1984, pp. 1214–1215

What the result gives

Theorem 1 replaces the unspecified best stopping policy with a specific threshold chosen from the distribution of the maximum. It also shows that the thresholded part of the stopped reward alone meets the factor two bound. That stronger middle statement distinguishes the theorem from an outer comparison EXn∗≤2EXτE X_n^*\le2E X_\tauEXn∗​≤2EXτ​. For a reward distribution with atoms, the theorem says exactly when to use >>> and when to use ≥\ge≥. Its companion ASSERTION shows that a median is not the only useful threshold choice. Samuel-Cahn, 1984, p. 1214

The result is proved in the paper; the work here is to express its assumptions, boundary behavior, and all displayed inequalities as Lean statements that solvers can prove. The milestones expose reusable facts about positive parts, forced stopping, and independence of a current observation from the event that the rule has survived earlier ones. No machine checked proof of these drafted statements is claimed. The second mission can use the completed theorem to formalize why the factor two cannot be improved uniformly over threshold rules, even for identically distributed observations.

Where the formal proof is delicate

The event that a rule reaches index iii depends on the observations before iii. Establishing its independence from the excess of XiX_iXi​ requires mutual independence of the whole family; pairwise independence does not express enough. A forced stop at nnn also makes the positive threshold reward smaller than the full stopped reward whenever the last observation misses the threshold. Ignoring that last case would erase one of the theorem's conclusions. Finally, atoms at the median prevent the strict and weak crossing events from being interchanged. Samuel-Cahn, 1984, (1.1)–(1.4)

Formalization scope

Lean indexes the nnn observations by Fin nnn with n>0n>0n>0. Its index zero is the paper's index one, and the greatest index is the paper's mandatory final stop nnn. The rules are the least qualifying index or that final index. The paper's s(m)>i−1s(m)>i-1s(m)>i−1 and t(m)>i−1t(m)>i-1t(m)>i−1 therefore become i≤s(m)i\le s(m)i≤s(m) and i≤t(m)i\le t(m)i≤t(m). Observations are measurable, nonnegative almost surely, and mutually independent under a probability measure.

Expectations use the extended nonnegative integral of the positive part, taking values in [0,∞][0,\infty][0,∞]. This keeps infinite expected rewards visible without imposing an integrability assumption absent from Theorem 1. The median has both strict tail inequalities from (1.1). The identities for positive stopped rewards state m≥0m\ge0m≥0 directly; in the goal this follows from nonnegativity and the median condition. The balance thresholds a∗a^*a∗ and b∗b^*b∗ are parameters satisfying the paper's defining equations, with no extra uniqueness hypothesis in statements that do not use it.

The goal cannot be satisfied by replacing E+XτE^+X_\tauE+Xτ​ with EXτE X_\tauEXτ​, by permitting a rule to return no observation, or by making the median predicate empty. Useful contributions include the measurable threshold rule interface, the pathwise excess decomposition, the factorization under mutual independence, and the remaining extended nonnegative arithmetic. Those pieces can also support other finite prophet inequality developments.

Selected references

  • E. Samuel-Cahn, Comparison of Threshold Stop Rules and Maximum for Independent Nonnegative Random Variables, The Annals of Probability 12(4), 1213–1216, 1984. DOI: 10.1214/aop/1176993150
9 thms1 active userReviewed
Linear OptimizationOptimizationProbability+1·Captain: mikedeng1

On Adaptive-Step Primal-Dual Interior-Point Algorithms for Linear Programming 4: For a Random Subspace, ‖Pq‖⁻∞ ≤ (log n/n)‖r‖² with Probability Tending to OneResearch Paper

Motivation

Primal–dual interior point methods follow a path of strictly feasible solutions to a linear program. Their worst case iteration bounds come from controlling a term that is quadratic in each search step. Mizuno, Todd, and Ye asked whether that term is typically much smaller than its worst case bound under a model in which a certain subspace is randomly oriented. Theorem 5 in their technical report gives a probability bound for the negative part of that term. It is a statement about one randomly oriented subspace and a fixed input vector, rather than a stochastic model for an entire algorithm run. The authors explicitly note that assigning the same random subspace model independently at successive iterations would be inconsistent with the algorithm's evolving state. Mizuno, Todd, and Ye, §6

Setting

Fix a dimension nnn, an integer ddd with 0≤d≤n0\le d\le n0≤d≤n, and a vector r∈Rnr\in\mathbb R^nr∈Rn. Draw a random ddd-dimensional subspace UUU from the distribution invariant under orthogonal transformations. Let ppp be the Euclidean orthogonal projection of rrr onto UUU, and put q=r−pq=r-pq=r−p, its projection onto U⊥U^\perpU⊥. The matrix P=diag⁡(p)P=\operatorname{diag}(p)P=diag(p) turns the vector qqq into the coordinatewise product Pq=(pjqj)j=1nPq=(p_jq_j)_{j=1}^nPq=(pj​qj​)j=1n​.

For a coordinate vector zzz, let z−=(min⁡{zj,0})j=1nz^-=(\min\{z_j,0\})_{j=1}^nz−=(min{zj​,0})j=1n​ and ∥z∥∞−=∥z−∥∞\|z\|^-_\infty=\|z^-\|_\infty∥z∥∞−​=∥z−∥∞​. Thus ∥Pq∥∞−\|Pq\|^-_\infty∥Pq∥∞−​ records the magnitude of the largest negative coordinate of PqPqPq. An unsubscripted vector norm is always the Euclidean ℓ2\ell_2ℓ2​ norm. These definitions follow the report's notation on printed pages 2 and 4. Mizuno, Todd, and Ye, §§1–2

The formal model samples an (n−d)×n(n-d)\times n(n−d)×n matrix GGG with independent standard normal entries and sets U=ker⁡GU=\ker GU=kerG. The report itself gives this construction as an example of the orthogonally invariant law. With probability one, this null space has dimension ddd. The construction covers the endpoint cases d=0d=0d=0 and d=nd=nd=n as well: the projection product is then zero. This probabilistic model has no linear programming data in its statement. The optimization setting explains why the quantity matters, while the result depends only on Euclidean projection geometry. Mizuno, Todd, and Ye, §6

Formalization targets

Theorem 5

For arbitrary choices rn∈Rnr_n\in\mathbb R^nrn​∈Rn and dn≤nd_n\le ndn​≤n at each dimension, the central target is

Pr⁡{∥Pnqn∥∞−≤log⁡nn∥rn∥22}⟶1(n⟶∞).\Pr\left\{\|P_nq_n\|^-_\infty\le \frac{\log n}{n}\|r_n\|_2^2\right\} \longrightarrow 1\qquad(n\longrightarrow\infty).Pr{∥Pn​qn​∥∞−​≤nlogn​∥rn​∥22​}⟶1(n⟶∞).

The logarithm is natural. The theorem asks for the exact coefficient shown in the report, rather than only an asymptotic order. The choice of rnr_nrn​ and dnd_ndn​ may change with nnn; the result does not require a common probability space for all dimensions. Mizuno, Todd, and Ye, Theorem 5, printed p. 13

Source milestones

The mission includes Lemma 6, which identifies a beta distributed radial coordinate and a uniform spherical direction for a projected vector; the componentwise identities and inequality (18)–(19); the Gaussian norm limit (20); the Gaussian coordinate maximum limit cited in the proof; and Lemma 7, which bounds the sup norm of a rotated uniform spherical direction by 3log⁡n/n\sqrt{3\log n/n}3logn/n​ with probability tending to one. Their statements, constants, and order follow printed pages 14–15 of the report. Mizuno, Todd, and Ye, §6

Significance

The result gives a precise high probability bound for the negative coordinates of the projection product. In the report this product represents the second order term of a primal–dual search direction, and a smaller value permits a larger admissible step in the relevant neighborhood analysis. The theorem therefore supplies a mathematically definite part of the paper's discussion of anticipated improved behavior. It does not by itself prove a typical iteration count: the paper does not provide a consistent random model for the sequence of subspaces visited by the algorithm. Mizuno, Todd, and Ye, §§2, 6–7

The report proves Theorem 5 and the two numbered lemmas on paper. The formalization work is to provide machine checked proofs of the random subspace representation, the beta and spherical laws, the finite dimensional Gaussian limits, and their connection to the projection bound. These results are reusable in other questions about random projections and coordinatewise estimates. The statements in this mission are open formalization targets; compilation of a statement with a proof placeholder does not count as a machine checked proof.

Difficulty

A direct norm bound on ppp and qqq loses the coordinate information needed for the factor log⁡n/n\log n/nlogn/n. The difficult part is that the desired bound concerns the most negative coordinate of a product of two dependent projections, while the distribution is specified through a random subspace. The paper's deterministic identity (18)–(19) relates this product to an angular coordinate. The remaining probabilistic statements must control the largest coordinate of a uniformly distributed spherical vector, including the numerical constant in Lemma 7. The laws of the radial and angular coordinates also need a sound measurable construction; simply writing a mapped measure without checking the map would not establish the claimed distributions.

Formalization scope

Vectors are EuclideanSpace ℝ (Fin n), so ∥r∥\|r\|∥r∥ is the ℓ2\ell_2ℓ2​ norm. Coordinate sup norms are separate definitions. A complete development needs finite dimensional inner product geometry, orthogonal projections, Gaussian product measures, beta measures, the uniform spherical law, and limits of real probabilities. The spherical law is encoded as the direction of a standard Gaussian vector. The Gaussian matrix construction fixes the invariant subspace distribution and must be connected to the stated ddd-dimensional law almost surely.

Lemma 6 concerns d,m≥1d,m\ge1d,m≥1 and n≥2n\ge2n≥2, where the beta parameters and the spherical direction are nondegenerate. Its angular direction is assigned zero at the zero coordinate, which has probability zero in this regime; the claimed decomposition and unit norm hold almost surely. Theorem 5 retains d=0d=0d=0, d=nd=nd=n, and r=0r=0r=0. Lemma 7 is stated only for frames in dimensions at least two; finitely many smaller dimensions are assigned probability one in its limit expression. Equation (20) keeps the report's condition ε>0\varepsilon>0ε>0. All limits are probabilities tending to one, never probability one at every finite nnn.

Contributions should preserve the source's constants and all three claims of Lemma 6. A proof of the beta law alone, or a bound for a single fixed direction, does not close the corresponding target. The invariant random subspace and projection model, the Gaussian and spherical distribution facts, and the coordinate estimates are each useful independently of this mission.

Selected references

  • Shinji Mizuno, Michael J. Todd, and Yinyu Ye, On Adaptive-Step Primal-Dual Interior-Point Algorithms for Linear Programming, Cornell ORIE Technical Report No. 944, 1990, revised 1991; published in Mathematics of Operations Research 18(4), 1993. DOI
  • Sidney I. Resnick, Extreme Values, Regular Variation, and Point Processes, Springer, 1987, pp. 42 and 71, cited in the report for the Gaussian maximum estimate. DOI
7 thms1 active userReviewed
Dynamic ProgrammingMarkov ChainStochastic Systems·Captain: mikedeng1

Quality Control under Markovian Deterioration 1: A Discounted-Optimal Policy Produces, Inspects, Produces Again and Revises on Successive Intervals of the BeliefResearch Paper

Motivation

A production process deteriorates over time, and the state it is in cannot be observed directly. Each period the operator chooses among three actions: produce without looking, produce and inspect the item (which reveals the current state at a cost), or revise the process back to its good state. This is one of the earliest partially observed Markov decision problems with a costly observation action, and it is the prototype of the inspection and machine-replacement models that followed in operations research and maintenance theory. Ross (Management Science 17(9), 1971) set it up for a countable state space, reduced it to a fully observed problem on beliefs, and determined the structure of an optimal policy for two states.

Intuition suggests a three-region policy for two states: produce while the probability of the bad state is small, inspect at intermediate probabilities, revise when it is large. Ross showed that the true structure has up to four regions: produce, inspect, produce again, revise. This mission formalizes that structure theorem and the general results it rests on.

Setting

The underlying process has a countable set of states 0,1,2,…0,1,2,\dots0,1,2,…, with transition probabilities PijP_{ij}Pij​ from state iii at the end of a period to state jjj at the beginning of the next. In state iii, producing without inspection costs CiC_iCi​, producing with inspection costs IiI_iIi​, and revising costs RiR_iRi​; costs are bounded, and future costs are discounted by β∈(0,1)\beta\in(0,1)β∈(0,1). A revision puts the process in state 000.

The decision maker tracks a belief P=(P0,P1,… )P=(P_0,P_1,\dots)P=(P0​,P1​,…), a probability vector on the states, ranging over

S={P:Pi≥0, ∑iPi=1}.S=\Big\{P: P_i\ge0,\ \sum_iP_i=1\Big\}.S={P:Pi​≥0, i∑​Pi​=1}.

Producing without inspection moves the belief to TPTPTP, with (TP)i=∑jPjPji(TP)_i=\sum_jP_jP_{ji}(TP)i​=∑j​Pj​Pji​. Inspecting reveals the state; if it is iii, the next belief is the row ei=(Pi0,Pi1,… )e^i=(P_{i0},P_{i1},\dots)ei=(Pi0​,Pi1​,…). Revising leads to e0e^0e0.

The β\betaβ-discounted optimal cost VβV_\betaVβ​ is the limit of value iteration: V0=0V^0=0V0=0 and

Vn+1(P)=min⁡{∑iPiCi+βVn(TP); ∑iPiIi+β∑iPiVn(ei); ∑iPiRi+βVn(e0)}.V^{n+1}(P)=\min\Big\{\sum_iP_iC_i+\beta V^n(TP);\ \sum_iP_iI_i+\beta\sum_iP_iV^n(e^i);\ \sum_iP_iR_i+\beta V^n(e^0)\Big\}.Vn+1(P)=min{i∑​Pi​Ci​+βVn(TP); i∑​Pi​Ii​+βi∑​Pi​Vn(ei); i∑​Pi​Ri​+βVn(e0)}.

The three terms with VnV^nVn replaced by VβV_\betaVβ​ form the right side of the optimality equation (1). The β\betaβ-optimal produce, inspect and revise regions are the sets of beliefs at which the corresponding term equals Vβ(P)V_\beta(P)Vβ​(P), and a stationary rule is β\betaβ-optimal when it always selects an action attaining the minimum.

In the two-state process of §3, state 000 is good and state 111 is bad: P00=1−πP_{00}=1-\piP00​=1−π, P11=1P_{11}=1P11​=1, C0=0C_0=0C0​=0, C1=CC_1=CC1​=C, I0=I1=II_0=I_1=II0​=I1​=I, R0=R1=RR_0=R_1=RR0​=R1​=R, with C<I<RC<I<RC<I<R. The belief is a number P∈[0,1]P\in[0,1]P∈[0,1], the probability of the bad state, TP=P+π−πPTP=P+\pi-\pi PTP=P+π−πP, and the optimality equation becomes

Vβ(P)=min⁡{CP+βVβ(TP); I+βPVβ(1)+β(1−P)Vβ(π); R+βVβ(π)}.(3)V_\beta(P)=\min\{CP+\beta V_\beta(TP);\ I+\beta PV_\beta(1)+\beta(1-P)V_\beta(\pi);\ R+\beta V_\beta(\pi)\}.\tag{3}Vβ​(P)=min{CP+βVβ​(TP); I+βPVβ​(1)+β(1−P)Vβ​(π); R+βVβ​(π)}.(3)

Formalization targets

Goal: Theorem 3.3, the four-region structure

There are thresholds π≤P1≤P2≤P3\pi\le P_1\le P_2\le P_3π≤P1​≤P2​≤P3​ with P2≤1P_2\le1P2​≤1 such that the rule

produce on [0,P1),inspect on [P1,P2),produce on [P2,P3),revise on [P3,1]\text{produce on }[0,P_1),\quad\text{inspect on }[P_1,P_2),\quad\text{produce on }[P_2,P_3),\quad\text{revise on }[P_3,1]produce on [0,P1​),inspect on [P1​,P2​),produce on [P2​,P3​),revise on [P3​,1]

is β\betaβ-optimal, and P3≤1P_3\le1P3​≤1 whenever revising is β\betaβ-optimal at some belief. Degenerate thresholds (empty intervals) are allowed, so the statement fixes only the order of the regions, not their number.

Milestones

  1. (1): value iteration converges on SSS, VβV_\betaVβ​ is bounded, solves (1), and is its unique bounded solution.
  2. Lemma 2.1: VβV_\betaVβ​ is concave on SSS.
  3. Theorem 2.2: the β\betaβ-optimal inspect and revise regions are convex.
  4. (3): the two-state optimality equation, as an instance of (1).
  5. Lemma 3.1: in the two-state model VβV_\betaVβ​ is nondecreasing on [0,1][0,1][0,1].
  6. Lemma 3.2: for 0≤P≤π0\le P\le\pi0≤P≤π, producing is strictly better than inspecting and than revising.

Significance

Theorem 3.3 reduces the search for an optimal policy in the two-state problem to the choice of three numbers, and it fixes the order of the regions: there is never a revise region below an inspect region, and inspection never occurs below the deterioration probability π\piπ. Together with Theorems 3.4 and 3.7 of the same paper (separate missions in this series), it is the basis for computing optimal inspection policies by searching over thresholds. Theorem 2.2 holds for any countable state space and is the general form of the observation that, in partially observed problems with linear-in-belief action costs, the regions of the "information" and "reset" actions are convex while the region of the passive action need not be.

The results are proved in the paper. As far as a search of the Prove2Me library shows (October 2026), none of them is formalized. Related formal work treats other models: belief-state reductions of finite POMDPs, and abstract contraction models for discounted dynamic programming. The mission produces machine-checked versions of the general model's optimality equation, the concavity of its value function, the convexity of two of its regions, and the two-state structure theorem.

Difficulty

The paper's proofs are short and lean on facts quoted from the literature. Theorem 3.3's proof is two sentences long. Filling it in requires several facts that the paper leaves implicit. The revise region of the two-state model is a closed right-hand interval. The inspect region meets [0,1][0,1][0,1] in an interval, through the affine embedding P↦(1−P,P)P\mapsto(1-P,P)P↦(1−P,P) of [0,1][0,1][0,1] into SSS. The half-open endpoints of the rule select optimal actions. That last point needs continuity of VβV_\betaVβ​ inside (0,1)(0,1)(0,1), a consequence of concavity, and Lemma 3.2 at the left end. The naive reading of the printed theorem, with all three thresholds in [0,1][0,1][0,1], is false in general (see below), so the threshold bookkeeping cannot be skipped.

On the general side, the optimality equation (1) is quoted from Blackwell. Here it must be proved for value iteration on the belief simplex of a countable state space, where the inspect term is an infinite series of values at the rows eie^iei. Its convergence and the contraction estimates use the boundedness of the costs.

Formalization scope

The general model is a structure over a type ι with [Countable ι], a distinguished state i₀, a transition matrix Pm, costs C I R : ι → ℝ and β. A separate predicate Model.Valid requires nonnegative entries, rows with HasSum (Pm i) 1, bounded costs and 0 < β < 1. The simplex uses HasSum P 1, never tsum, so it consists of genuine probability vectors. VβV_\betaVβ​ is defined as limUnder atTop of value iteration from V0=0V^0=0V0=0, which is the paper's own characterization in the proof of Lemma 2.1. It is not an arbitrary function assumed to satisfy (1). The paper's definition as an infimum over measurable policies is not formalized; the policy class would be a separate mission. Regions are subsets of SSS.

The two-state model is the instance ι = Fin 2 with P00=1−πP_{00}=1-\piP00​=1−π, P01=πP_{01}=\piP01​=π, P10=0P_{10}=0P10​=0, P11=1P_{11}=1P11​=1, and its value at the scalar belief PPP is the general VβV_\betaVβ​ at (1−P,P)(1-P,P)(1−P,P). The general Lemma 2.1 and Theorem 2.2 therefore apply to it without restatement. Standing hypotheses of §3 are 0<β<10<\beta<10<β<1, 0≤π≤10\le\pi\le10≤π≤1 and 0<C<I<R0<C<I<R0<C<I<R. 0<C0<C0<C is implicit in the paper, where the good state costs 000 and the bad state CCC. "β\betaβ-optimal rule" means a rule selecting a minimizer of the right side of (3) at every P∈[0,1]P\in[0,1]P∈[0,1], the criterion the paper quotes on p. 588. "Every β\betaβ-optimal policy produces" (Lemma 3.2) means that producing is the unique minimizer.

Threshold repair. The paper prints π≤P1≤P2≤P3≤1\pi\le P_1\le P_2\le P_3\le1π≤P1​≤P2​≤P3​≤1. This is false when revising is never optimal, for instance when R>C/(1−β(1−π))R>C/(1-\beta(1-\pi))R>C/(1−β(1−π)): then always producing is optimal and revising at P=1P=1P=1 is strictly worse, so no rule revising on a nonempty [P3,1][P_3,1][P3​,1] is optimal. The goal keeps P3≤1P_3\le1P3​≤1 exactly when the β\betaβ-optimal revise region is nonempty and otherwise allows P3>1P_3>1P3​>1; the rest of the printed chain, π≤P1≤P2≤1\pi\le P_1\le P_2\le1π≤P1​≤P2​≤1, is kept. Adding the hypothesis R<C/(1−β(1−π))R<C/(1-\beta(1-\pi))R<C/(1−β(1−π)) instead would drop a case the paper covers.

The statement admits no trivializing reading. The thresholds are quantified existentially, but the rule must be optimal at every belief in [0,1][0,1][0,1], VβV_\betaVβ​ is pinned down by its definition, and the paper's numbers (C=4C=4C=4, π=0.1\pi=0.1π=0.1, I=6I=6I=6, R=10R=10R=10, β=0.9\beta=0.9β=0.9) satisfy all hypotheses.

Infrastructure needed: tsum manipulations on the belief simplex (linearity of TTT, summability of ∑iPiV(ei)\sum_iP_iV(e^i)∑i​Pi​V(ei) for bounded VVV), a sup-norm contraction argument for value iteration, and closure of concavity under minima and pointwise limits. The value-iteration and contraction lemmas are reusable for any discounted model with bounded costs. Contributions of intermediate lemmas, such as continuity of the two-state VβV_\betaVβ​ on (0,1](0,1](0,1] or the bridge identities T(1−P,P)=(1−TP,TP)T(1-P,P)=(1-TP,TP)T(1−P,P)=(1−TP,TP), are welcome.

Selected references

  • S. M. Ross, Quality Control under Markovian Deterioration, Management Science 17(9):587–596, 1971. https://doi.org/10.1287/mnsc.17.9.587
  • D. Blackwell, Discounted Dynamic Programming, Annals of Mathematical Statistics 36(1):226–235, 1965. https://doi.org/10.1214/aoms/1177700285
  • K. J. Åström, Optimal Control of Markov Processes with Incomplete State Information, Journal of Mathematical Analysis and Applications 10(1):174–205, 1965. https://doi.org/10.1016/0022-247X(65)90154-X
9 thms1 active userReviewed
Algorithmic Game TheoryProbability·Captain: mikedeng1

Comparison of Threshold Stop Rules and Maximum for Independent Nonnegative Random Variables II: For I.I.D. Variables the Constant 2 Is Best Possible over Threshold RulesResearch Paper

Motivation

A prophet inequality compares two observers of a sequence of nonnegative random variables X1,…,XnX_1, \dots, X_nX1​,…,Xn​. The prophet knows all values in advance and collects Xn∗=max⁡(X1,…,Xn)X_n^* = \max(X_1, \dots, X_n)Xn∗​=max(X1​,…,Xn​). The gambler sees the values one at a time and must decide, irrevocably, when to stop and collect the current value. For independent variables the gambler's optimal value is at least half of EXn∗EX_n^*EXn∗​, and the factor 222 is sharp. Prophet inequalities are a basic tool in the analysis of online mechanisms, posted-price auctions and online selection problems, where the gambler's rule is a pricing policy and the prophet is the offline optimum.

Optimal stopping rules are often difficult to compute and to implement. A threshold rule, which stops at the first value at least ccc, is a posted price, and is the form used in applications. Samuel-Cahn (Ann. Probab. 12 (1984) 1213–1216) proved that a threshold rule alone attains the factor 222: with mmm a median of Xn∗X_n^*Xn∗​, Theorem 1 of the paper gives EXn∗≤2E+Xs(m)EX_n^* \le 2E^+X_{s(m)}EXn∗​≤2E+Xs(m)​ or EXn∗≤2E+Xt(m)EX_n^* \le 2E^+X_{t(m)}EXn∗​≤2E+Xt(m)​. Mission I of this series formalizes that theorem.

Timeline (as recounted on p. 1213 of the paper).

  • 1978: Krengel and Sucheston show EXn∗≤2Vn(X‾)EX_n^* \le 2V_n(\underline X)EXn∗​≤2Vn​(X​), where VnV_nVn​ is the optimal stopping value, for independent Xi≥0X_i \ge 0Xi​≥0; the constant 222 cannot be improved for any n≥2n \ge 2n≥2.
  • 1981: Hill and Kertz show that strict inequality holds in all but trivial cases.
  • 1982: Hill and Kertz show that for i.i.d. XiX_iXi​ the best constant αn\alpha_nαn​ for optimal rules depends on nnn and is bounded by 1.61.61.6.
  • 1983: Kertz (unpublished at the time) proves lim⁡αn=1+a∗=1.341…\lim \alpha_n = 1 + a^* = 1.341\ldotslimαn​=1+a∗=1.341… for a constant a∗a^*a∗ given by an integral equation.
  • 1984: Samuel-Cahn shows that a median threshold rule achieves the factor 222 (Theorem 1), and that for threshold rules the factor 222 cannot be lowered even for i.i.d. variables (Theorem 2). This mission is Theorem 2.

Setting

Fix n≥1n \ge 1n≥1 and a probability law μ\muμ on [0,∞)[0, \infty)[0,∞). Let X1,…,XnX_1, \dots, X_nX1​,…,Xn​ be independent with common law μ\muμ, and Xn∗=max⁡(X1,…,Xn)X_n^* = \max(X_1, \dots, X_n)Xn∗​=max(X1​,…,Xn​). For a constant c≥0c \ge 0c≥0 the threshold rules are

  • t(c)t(c)t(c): the smallest i<ni < ni<n with Xi≥cX_i \ge cXi​≥c, and t(c)=nt(c) = nt(c)=n otherwise;
  • s(c)s(c)s(c): the smallest i<ni < ni<n with Xi>cX_i > cXi​>c, and s(c)=ns(c) = ns(c)=n otherwise.

The stopped value is Xt(c)X_{t(c)}Xt(c)​ or Xs(c)X_{s(c)}Xs(c)​. The truncated expectations are E+Xt(c)=E[Xt(c)I(Xt(c)≥c)]E^+X_{t(c)} = E[X_{t(c)} I(X_{t(c)} \ge c)]E+Xt(c)​=E[Xt(c)​I(Xt(c)​≥c)] and E+Xs(c)=E[Xs(c)I(Xs(c)>c)]E^+X_{s(c)} = E[X_{s(c)} I(X_{s(c)} > c)]E+Xs(c)​=E[Xs(c)​I(Xs(c)​>c)]: they discard the forced stop at time nnn below the threshold. The class Tn∗T_n^*Tn∗​ is the set of all t(c)t(c)t(c) and s(c)s(c)s(c) with c≥0c \ge 0c≥0.

The lower half of the theorem uses an explicit family. For 0<a<10 < a < 10<a<1, b>0b > 0b>0, c>0c > 0c>0 and n>b+cn > b + cn>b+c, the variables Xi(n)X_i^{(n)}Xi(n)​ take the values 000, aaa, 111 with probabilities 1−(b+c)/n1 - (b+c)/n1−(b+c)/n, c/nc/nc/n, b/nb/nb/n. Two constants enter:

a∗=c(1−e−b)−be−b(1−e−c)c(1−e−b−c),Q(b,c)=1+e−b−e−b−c1−e−b−c−b(e−b−e−b−c)2c(1−e−b−c)(1−e−b).a^* = \frac{c(1 - e^{-b}) - b e^{-b}(1 - e^{-c})}{c(1 - e^{-b-c})}, \qquad Q(b, c) = 1 + \frac{e^{-b} - e^{-b-c}}{1 - e^{-b-c}} - \frac{b(e^{-b} - e^{-b-c})^2}{c(1 - e^{-b-c})(1 - e^{-b})}.a∗=c(1−e−b−c)c(1−e−b)−be−b(1−e−c)​,Q(b,c)=1+1−e−b−ce−b−e−b−c​−c(1−e−b−c)(1−e−b)b(e−b−e−b−c)2​.

This a∗a^*a∗ is unrelated to the a∗a^*a∗ of the NOTE in §1 of the paper.

In Lean (SamuelCahnProphet.IID), a sample is x : Fin n → ℝ under iidLaw μ n, the product measure; tIdx x c and sIdx x c are t(c)t(c)t(c) and s(c)s(c)s(c); Emax, EstopT, EstopS, EplusT, EplusS are EXn∗EX_n^*EXn∗​, EXt(c)EX_{t(c)}EXt(c)​, EXs(c)EX_{s(c)}EXs(c)​ and the E+E^+E+ terms; supE and supEplus are the two suprema over Tn∗T_n^*Tn∗​; threePoint n a b c is the law of Xi(n)X_i^{(n)}Xi(n)​; aStarIID and Q are the constants above.

Formalization targets

Goal: Theorem 2 (p. 1215)

sup⁡nsup⁡X‾[EXn∗sup⁡t∈Tn∗E+Xt]=sup⁡nsup⁡X‾[EXn∗sup⁡t∈Tn∗EXt]=2,\sup_n \sup_{\underline X} \left[\frac{EX_n^*}{\sup_{t \in T_n^*} E^+X_t}\right] = \sup_n \sup_{\underline X} \left[\frac{EX_n^*}{\sup_{t \in T_n^*} EX_t}\right] = 2,nsup​X​sup​[supt∈Tn∗​​E+Xt​EXn∗​​]=nsup​X​sup​[supt∈Tn∗​​EXt​EXn∗​​]=2,

over i.i.d. nonnegative X‾\underline XX​. It is stated as three facts: EXn∗≤2sup⁡Tn∗E+XtEX_n^* \le 2 \sup_{T_n^*} E^+X_tEXn∗​≤2supTn∗​​E+Xt​ for every nnn and law; sup⁡Tn∗E+Xt≤sup⁡Tn∗EXt\sup_{T_n^*} E^+X_t \le \sup_{T_n^*} EX_tsupTn∗​​E+Xt​≤supTn∗​​EXt​; and for every ε>0\varepsilon > 0ε>0 some nnn and law with (2−ε)sup⁡Tn∗EXt<EXn∗(2 - \varepsilon)\sup_{T_n^*} EX_t < EX_n^*(2−ε)supTn∗​​EXt​<EXn∗​.

Milestones (proof of Theorem 2, p. 1215)

  1. The upper bound EXn∗≤2sup⁡Tn∗E+XtEX_n^* \le 2\sup_{T_n^*} E^+X_tEXn∗​≤2supTn∗​​E+Xt​, attributed to Theorem 1.
  2. lim⁡nEXn(n)∗=1−e−b+a{e−b−e−b−c}\lim_n EX_n^{(n)*} = 1 - e^{-b} + a\{e^{-b} - e^{-b-c}\}limn​EXn(n)∗​=1−e−b+a{e−b−e−b−c}.
  3. For the three-point law, sup⁡Tn∗EXt=max⁡{EXt(a),EXt(1)}\sup_{T_n^*} EX_t = \max\{EX_{t(a)}, EX_{t(1)}\}supTn∗​​EXt​=max{EXt(a)​,EXt(1)​}.
  4. W(a)=lim⁡nEXt(a)(n)=(1−e−b−c)(b+ac)/(b+c)W(a) = \lim_n EX^{(n)}_{t(a)} = (1 - e^{-b-c})(b + ac)/(b + c)W(a)=limn​EXt(a)(n)​=(1−e−b−c)(b+ac)/(b+c).
  5. W(1)=lim⁡nEXt(1)(n)=1−e−bW(1) = \lim_n EX^{(n)}_{t(1)} = 1 - e^{-b}W(1)=limn​EXt(1)(n)​=1−e−b.
  6. W(a∗)=W(1)W(a^*) = W(1)W(a∗)=W(1) and 0<a∗<10 < a^* < 10<a∗<1.
  7. With a=a∗a = a^*a=a∗, lim⁡nEXn(n)∗/sup⁡Tn∗EXt(n)=Q(b,c)\lim_n EX_n^{(n)*}/\sup_{T_n^*} EX_t^{(n)} = Q(b, c)limn​EXn(n)∗​/supTn∗​​EXt(n)​=Q(b,c).
  8. Q(b,c)→2Q(b, c) \to 2Q(b,c)→2 as b→0+b \to 0^+b→0+ and c→∞c \to \inftyc→∞.

Significance

Theorem 1 says a posted price recovers half of the prophet's value. Theorem 2 says this guarantee is tight within the class of threshold rules even under the most favourable independence structure, identical distributions. This matters because for optimal rules the i.i.d. constant is at most 1.61.61.6 (Hill and Kertz 1982); the theorem separates threshold rules from optimal rules in the i.i.d. case and sets the benchmark that later single-threshold and order-selection analyses compare against.

The result is proved in the paper; to our knowledge no machine-checked proof exists. This mission produces one: a formal model of threshold rules on an i.i.d. sample, exact asymptotics of the expected maximum and of two stopped values for a triangular array of three-point laws, the reduction of the class Tn∗T_n^*Tn∗​ to two rules, and the two-parameter limit. The upper bound (milestone 1) is the i.i.d. case of mission I's goal, and may later be closed by reference to it.

Difficulty

The limits are "easily seen" on the page, but each requires controlling (1−x/n)n−1(1 - x/n)^{n-1}(1−x/n)n−1 uniformly with the exact law of a stopped index on a product space, including the forced stop at nnn whose contribution vanishes only in the limit. Milestone 3 is a finite claim over an uncountable family of rules: every t(c)t(c)t(c) and s(c)s(c)s(c) with c≥0c \ge 0c≥0 must be shown to coincide almost surely with one of t(0)t(0)t(0), t(a)t(a)t(a), t(1)t(1)t(1) or stopping at nnn, and the first and last must be shown dominated by t(a)t(a)t(a) for every finite n>b+cn > b + cn>b+c, not only asymptotically. The final step is a joint limit in (b,c)(b, c)(b,c), in which b/(1−e−b)→1b/(1 - e^{-b}) \to 1b/(1−e−b)→1 while the correction term vanishes like 1/c1/c1/c; an iterated limit is not the statement.

Formalization scope

The i.i.d. variables are the coordinates of Rn\mathbb R^nRn under the product measure μ⊗n\mu^{\otimes n}μ⊗n; all quantities depend only on the joint law, so the supremum over X‾\underline XX​ is a supremum over laws μ\muμ with μ((−∞,0))=0\mu((-\infty, 0)) = 0μ((−∞,0))=0. Indices are 0-based in Fin n with [NeZero n], the paper's index nnn being ⊤. Expectations are lintegrals of ENNReal.ofReal in [0,∞][0, \infty][0,∞]: no integrability is assumed and EXn∗=∞EX_n^* = \inftyEXn∗​=∞ is allowed. The sup over Tn∗T_n^*Tn∗​ ranges over c≥0c \ge 0c≥0 and over both families t(c)t(c)t(c) and s(c)s(c)s(c). Limits along the triangular array are indexed by n=k+1n = k + 1n=k+1 and taken in R\mathbb RR after toReal; the early terms with n≤b+cn \le b + cn≤b+c, where the clipped weights of threePoint do not form a probability measure, do not affect any limit.

The page's ratios are not written literally: in [0,∞][0, \infty][0,∞] the quotients 0/00/00/0 and ∞/∞\infty/\infty∞/∞ take junk values, so a literal supremum of ratios would be decided by degenerate laws. The goal's third fact uses a strict inequality and requires an explicit probability law on [0,∞)[0, \infty)[0,∞), which rules out the Dirac mass at 000 and sub-probability witnesses.

A complete development needs: the law of the first index of a product sample entering a set, expectations of finite-valued functions under Measure.pi, the limit (1−x/n)n→e−x(1 - x/n)^n \to e^{-x}(1−x/n)n→e−x along a triangular array, and elementary bounds on the exponential. The first two are reusable for any threshold or secretary-type stopping problem on i.i.d. samples. Proofs of the milestones in any order are welcome, as is a proof of the upper bound that does not route through the median.

Selected references

  • E. Samuel-Cahn, Comparison of threshold stop rules and maximum for independent nonnegative random variables, Ann. Probab. 12(4) (1984) 1213–1216. https://doi.org/10.1214/aop/1176993150
  • U. Krengel and L. Sucheston, On semiamarts, amarts, and processes with finite value, in Probability on Banach Spaces, Adv. Probab. Related Topics 4, Dekker, New York (1978) 197–266.
  • T. P. Hill and R. P. Kertz, Ratio comparisons of supremum and stop rule expectations, Z. Wahrsch. verw. Gebiete 56 (1981) 283–285. https://doi.org/10.1007/BF00536175
  • T. P. Hill and R. P. Kertz, Comparisons of stop rule and supremum expectations of i.i.d. random variables, Ann. Probab. 10(2) (1982) 336–345. https://doi.org/10.1214/aop/1176993861
10 thms1 active userReviewed
Convex OptimizationFunctional Analysis·Captain: mikedeng1

Stochastic Convex Programming: Basic Duality 1: With Bounded Constraint Sets the Two-Stage Stochastic Convex Program Satisfies min P = sup DResearch Paper

Motivation

A two-stage stochastic program with recourse models a decision taken in two steps: a first-stage decision is fixed before a random outcome is observed, and a second-stage (recourse) decision is chosen after the outcome is known, both subject to constraints and both incurring costs. The model is the standard framework for planning under uncertainty in operations research: capacity planning, production and inventory, energy dispatch, finance.

For linear recourse problems, duality was developed in the 1960s and early 1970s by Wets and others, partly under integrability restrictions on the random data. R. T. Rockafellar and R. J.-B. Wets, Stochastic convex programming: basic duality (Pacific J. Math. 62 (1976), doi:10.2140/pjm.1976.62.173), treat the convex case, where every cost and constraint function is convex, by embedding the problem in a family of perturbed problems and applying the perturbational theory of convex duality (Rockafellar, Conjugate Duality and Optimization, SIAM 1974) together with the theory of convex integral functionals. The paper's dual variables are integrable price systems, interpreted as equilibrium prices for perturbations of the constraints; it is the starting point of a series of papers by the same authors on stochastic convex programming (relatively complete recourse, Kuhn–Tucker conditions, singular multipliers).

Setting

Let (S,Σ,σ)(S,\Sigma,\sigma)(S,Σ,σ) be a probability space. A vector x1∈Rn1x_1\in\mathbb R^{n_1}x1​∈Rn1​ is chosen subject to x1∈C1x_1\in C_1x1​∈C1​ and f1i(x1)≤0f_{1i}(x_1)\le 0f1i​(x1​)≤0 (i=1,…,m1i=1,\dots,m_1i=1,…,m1​), at cost f10(x1)f_{10}(x_1)f10​(x1​). Then s∈Ss\in Ss∈S is observed and x2(s)∈Rn2x_2(s)\in\mathbb R^{n_2}x2​(s)∈Rn2​ is chosen subject to x2(s)∈C2x_2(s)\in C_2x2​(s)∈C2​ and f2i(s,x1,x2(s))≤0f_{2i}(s,x_1,x_2(s))\le 0f2i​(s,x1​,x2​(s))≤0 (i=1,…,m2i=1,\dots,m_2i=1,…,m2​), at cost f20(s,x1,x2(s))f_{20}(s,x_1,x_2(s))f20​(s,x1​,x2​(s)). The aim is to minimize the expected cost

f10(x1)+∫Sf20(s,x1,x2(s)) σ(ds).f_{10}(x_1)+\int_S f_{20}(s,x_1,x_2(s))\,\sigma(ds).f10​(x1​)+∫S​f20​(s,x1​,x2​(s))σ(ds).

The standing assumptions are: C1C_1C1​, C2C_2C2​ convex, closed and nonempty; f1if_{1i}f1i​ and f2i(s,⋅,⋅)f_{2i}(s,\cdot,\cdot)f2i​(s,⋅,⋅) convex and finite everywhere; s↦f2i(s,x1,x2)s\mapsto f_{2i}(s,x_1,x_2)s↦f2i​(s,x1​,x2​) measurable, summable for i=0i=0i=0 and bounded for i≥1i\ge 1i≥1.

Decisions live in X=Rn1×Ln2∞X=\mathbb R^{n_1}\times\mathcal L^\infty_{n_2}X=Rn1​×Ln2​∞​ and perturbations in U=Rm1×Lm2∞U=\mathbb R^{m_1}\times\mathcal L^\infty_{m_2}U=Rm1​×Lm2​∞​. The perturbation functional F(x,u)F(x,u)F(x,u) is the expected cost if xxx satisfies the constraints with right-hand sides u1u_1u1​ and, almost surely, u2(s)u_2(s)u2​(s), and +∞+\infty+∞ otherwise. The problem P\mathbf PP minimizes F(x,0)F(x,0)F(x,0).

The space Y=Rm1×Lm21Y=\mathbb R^{m_1}\times\mathcal L^1_{m_2}Y=Rm1​×Lm2​1​ is paired with UUU by ⟨u,y⟩=u1⋅y1+∫Su2(s)⋅y2(s) σ(ds)\langle u,y\rangle=u_1\cdot y_1+\int_S u_2(s)\cdot y_2(s)\,\sigma(ds)⟨u,y⟩=u1​⋅y1​+∫S​u2​(s)⋅y2​(s)σ(ds), and V=Rn1×Ln21V=\mathbb R^{n_1}\times\mathcal L^1_{n_2}V=Rn1​×Ln2​1​ with XXX in the same way. The Lagrangian is L(x,y)=inf⁡u∈U{⟨u,y⟩+F(x,u)}L(x,y)=\inf_{u\in U}\{\langle u,y\rangle+F(x,u)\}L(x,y)=infu∈U​{⟨u,y⟩+F(x,u)}, the dual D\mathbf DD maximizes g(y)=inf⁡x∈XL(x,y)g(y)=\inf_{x\in X}L(x,y)g(y)=infx∈X​L(x,y) over y∈Yy\in Yy∈Y, and the perturbation function is φ(u)=inf⁡x∈XF(x,u)\varphi(u)=\inf_{x\in X}F(x,u)φ(u)=infx∈X​F(x,u). Conjugates φ∗\varphi^*φ∗, φ∗∗\varphi^{**}φ∗∗ are taken with respect to the pairing of UUU with YYY.

Formalization targets

Goal: Theorem 3

If C1C_1C1​ and C2C_2C2​ are bounded, then

min⁡P=sup⁡D>−∞,\min\mathbf P=\sup\mathbf D>-\infty,minP=supD>−∞,

and in fact φ\varphiφ is a proper convex function on UUU, lower semicontinuous for the weak topology σ(U,Y)\sigma(U,Y)σ(U,Y), the infimum defining φ(u)\varphi(u)φ(u) is attained for every u∈Uu\in Uu∈U, and φ∗∗=φ\varphi^{**}=\varphiφ∗∗=φ. The goal is the theorem exactly as printed, all conclusions included.

Milestones

  1. p. 174: for bounded measurable x1(⋅)x_1(\cdot)x1​(⋅), x2(⋅)x_2(\cdot)x2​(⋅), the functions s↦f2i(s,x1(s),x2(s))s\mapsto f_{2i}(s,x_1(s),x_2(s))s↦f2i​(s,x1​(s),x2​(s)) are measurable, summable for i=0i=0i=0 and essentially bounded for i≥1i\ge1i≥1.
  2. Proposition 3: FFF is convex, not identically +∞+\infty+∞, and lower semicontinuous on X×UX\times UX×U for the norm topology and for the weak topology induced by V×YV\times YV×Y.
  3. (4.9): with C1,C2C_1,C_2C1​,C2​ bounded, X0={x:x1∈C1, x2(s)∈C2 a.s.}X_0=\{x: x_1\in C_1,\ x_2(s)\in C_2\text{ a.s.}\}X0​={x:x1​∈C1​, x2​(s)∈C2​ a.s.} is weakly compact in XXX, and X0′={x2∈Ln2∞:x2(s)∈C2 a.s.}X_0'=\{x_2\in\mathcal L^\infty_{n_2}: x_2(s)\in C_2\text{ a.s.}\}X0′​={x2​∈Ln2​∞​:x2​(s)∈C2​ a.s.} is compact in σ(Ln2∞,Ln21)\sigma(\mathcal L^\infty_{n_2},\mathcal L^1_{n_2})σ(Ln2​∞​,Ln2​1​).
  4. (4.1): g(y)=inf⁡u{⟨u,y⟩+φ(u)}=−φ∗(−y)g(y)=\inf_{u}\{\langle u,y\rangle+\varphi(u)\}=-\varphi^*(-y)g(y)=infu​{⟨u,y⟩+φ(u)}=−φ∗(−y).
  5. (4.2): φ∗∗(0)=sup⁡D\varphi^{**}(0)=\sup\mathbf Dφ∗∗(0)=supD.

The mission also poses the explicit form (1.8) of the Lagrangian and Corollary 1 (dual solutions are the negatives of subgradients of φ\varphiφ at 000; saddle-point characterization of primal solutions when ∂φ(0)≠∅\partial\varphi(0)\ne\emptyset∂φ(0)=∅).

Significance

Theorem 3 gives, for bounded constraint sets, the absence of a duality gap between a convex recourse problem with essentially bounded decisions and its Lagrangian dual over integrable multipliers, together with existence of an optimal decision. Through Corollary 1 it reduces the necessity of the Kuhn–Tucker (saddle-point) optimality conditions to the single question whether ∂φ(0)\partial\varphi(0)∂φ(0) is nonempty, and through the paper's later results it describes the directional derivatives of the optimal value with respect to perturbations of the constraints.

The result has been proved since 1976; it has not been machine-checked. A formal development produces the problem model on L∞\mathcal L^\inftyL∞ and L1\mathcal L^1L1 spaces, the weak topologies of the pairings, and conjugate duality for extended-real-valued functions on such paired spaces, none of which is currently available as a ready-made Lean statement on this platform.

Difficulty

The obvious argument fails at two points. First, inf⁡P=sup⁡D\inf\mathbf P=\sup\mathbf DinfP=supD is φ(0)=φ∗∗(0)\varphi(0)=\varphi^{**}(0)φ(0)=φ∗∗(0), and the biconjugate equals φ\varphiφ only for a lower semicontinuous proper convex function in a topology compatible with the pairing. Lower semicontinuity of φ\varphiφ in the norm topology of UUU is not enough: the pairing is with L1\mathcal L^1L1, not with the norm dual of L∞\mathcal L^\inftyL∞, so the relevant topology is the weak topology σ(U,Y)\sigma(U,Y)σ(U,Y), and an infimum of lower semicontinuous functions is in general not lower semicontinuous. Second, the lower semicontinuity of FFF itself, in the weak topology, is a statement about convex integral functionals on L∞\mathcal L^\inftyL∞ that rests on measurability of the integrands in sss jointly with continuity in the decision variables. Boundedness of C1C_1C1​, C2C_2C2​ is what supplies the compactness that is otherwise missing.

Formalization scope

  • Rn\mathbb R^nRn is Fin n → ℝ and the products u1⋅y1u_1\cdot y_1u1​⋅y1​, u2(s)⋅y2(s)u_2(s)\cdot y_2(s)u2​(s)⋅y2​(s) are dot products. Constraint indices i=1,…,mi=1,\dots,mi=1,…,m are Fin m.
  • Ln∞\mathcal L^\infty_nLn∞​ and Ln1\mathcal L^1_nLn1​ are Mathlib's Lp (Fin n → ℝ) ⊤ σ and Lp (Fin n → ℝ) 1 σ, spaces of almost-everywhere classes; all second-stage conditions are stated almost surely. σ\sigmaσ is a probability measure (IsProbabilityMeasure).
  • Values in R∪{±∞}\mathbb R\cup\{\pm\infty\}R∪{±∞} are EReal; infima and suprema are lattice operations in EReal, so there are no junk values for empty or unbounded sets. Every sum has a real first summand, so no ∞−∞\infty-\infty∞−∞ convention enters.
  • The expected cost is a real Bochner integral; its integrand is summable for x2∈L∞x_2\in\mathcal L^\inftyx2​∈L∞ (milestone 1), so it is the true expected cost. No extended-real-valued function is ever integrated.
  • A weak topology "induced by the pairing" is the coarsest topology making every functional of the pairing continuous; the product weak topology on X×UX\times UX×U is the product of the two. These are passed explicitly. Replacing them by the norm topologies would make the lower semicontinuity statements strictly weaker and the compactness statement false; such a formalization does not count.
  • An extended-real function is convex when its epigraph is convex, and proper when it never takes −∞-\infty−∞ and is somewhere finite.
  • Boundedness of C1C_1C1​, C2C_2C2​ is assumed exactly where the paper assumes it: Theorem 3, (4.9) and Corollary 1.

A complete development needs the identification of L∞\mathcal L^\inftyL∞ with the dual of L1\mathcal L^1L1 on a probability space (for weak-* compactness), lower semicontinuity of convex integral functionals, and conjugate duality on paired locally convex spaces. These are reusable well beyond this mission. Proofs of milestones, and of auxiliary lemmas of this kind as separate theorems, are welcome. The mission Stochastic Convex Programming: Basic Duality 2 formalizes the paper's other main result, on the first-stage problem and attainment of the recourse.

Selected references

  • R. T. Rockafellar and R. J.-B. Wets, Stochastic convex programming: basic duality, Pacific Journal of Mathematics 62(1) (1976) 173–195. https://doi.org/10.2140/pjm.1976.62.173
  • R. T. Rockafellar, Conjugate Duality and Optimization, CBMS-NSF Regional Conference Series in Applied Mathematics 16, SIAM, 1974. https://doi.org/10.1137/1.9781611970524
  • R. T. Rockafellar, Integrals which are convex functionals, Pacific Journal of Mathematics 24(3) (1968) 525–539. https://doi.org/10.2140/pjm.1968.24.525
  • R. T. Rockafellar, Integrals which are convex functionals, II, Pacific Journal of Mathematics 39(2) (1971) 439–469. https://doi.org/10.2140/pjm.1971.39.439
  • R. J.-B. Wets, Stochastic programs with fixed recourse: the equivalent deterministic program, SIAM Review 16(3) (1974) 309–339. https://doi.org/10.1137/1016053
8 thms1 active userReviewed
Convex OptimizationLinear algebraOptimization·Captain: mikedeng1

Strongly Regular Generalized Equations III: Reduced-Form Criterion — a Linear Generalized Equation over a Polyhedral Set Is Strongly Regular Iff Its Reduced Form Is Uniquely Solvable on LResearch Paper

Motivation

Many problems in optimization and equilibrium modelling, among them linear and nonlinear complementarity problems, variational inequalities over polyhedra, and the Karush–Kuhn–Tucker conditions of nonlinear programs, can be written as a single generalized equation

0∈f(x)+∂ψC(x),0\in f(x)+\partial\psi_C(x),0∈f(x)+∂ψC​(x),

where ∂ψC\partial\psi_C∂ψC​ is the normal-cone operator of a closed convex set CCC. S. M. Robinson introduced strong regularity of such an inclusion at a solution x0x_0x0​ in Strongly regular generalized equations (1980) and proved an implicit-function theorem for it: when the linearised inclusion has a locally unique, Lipschitz inverse, solutions of the perturbed problem exist, are locally unique and depend Lipschitz-continuously on the perturbation. Strong regularity has since become the standard stability notion behind sensitivity analysis and the local convergence of Newton-type methods for variational problems; see Dontchev and Rockafellar, Implicit Functions and Solution Mappings (Springer, 2nd ed. 2014, doi:10.1007/978-1-4939-1037-3).

Strong regularity depends only on the linearisation, so deciding it means deciding it for a linear generalized equation. For a general polyhedral set CCC the paper's appendix does this by a reduction: locally around x0x_0x0​ the problem is equivalent to a homogeneous problem on a cone, the reduced form, and strong regularity is equivalent to unique solvability of that reduced form. This mission formalizes that appendix and the criterion it yields.

Setting

Work in Rn\mathbb R^nRn with the standard inner product, which identifies Rn\mathbb R^nRn with its dual. For C⊆RnC\subseteq\mathbb R^nC⊆Rn the normal cone at xxx is

∂ψC(x)={y:⟨y,c−x⟩≤0 for all c∈C} if x∈C,∂ψC(x)=∅ if x∉C.\partial\psi_C(x)=\{y:\langle y,c-x\rangle\le 0\ \text{for all } c\in C\}\ \text{if } x\in C,\qquad \partial\psi_C(x)=\emptyset\ \text{if } x\notin C.∂ψC​(x)={y:⟨y,c−x⟩≤0 for all c∈C} if x∈C,∂ψC​(x)=∅ if x∈/C.

A set is polyhedral convex if it is the intersection of finitely many closed half-spaces. Fix a nonempty polyhedral convex CCC, an n×nn\times nn×n real matrix AAA and a∈Rna\in\mathbb R^na∈Rn, and consider

0∈Ax+a+∂ψC(x).(A.1)0\in Ax+a+\partial\psi_C(x).\qquad\text{(A.1)}0∈Ax+a+∂ψC​(x).(A.1)

It is strongly regular at a solution x0x_0x0​ with constant λ\lambdaλ if there are neighbourhoods UUU of 000 and VVV of x0x_0x0​ such that for each y∈Uy\in Uy∈U the perturbed inclusion

y∈Ax+a+∂ψC(x)(A.2)y\in Ax+a+\partial\psi_C(x)\qquad\text{(A.2)}y∈Ax+a+∂ψC​(x)(A.2)

has exactly one solution x=s(y)x=s(y)x=s(y) in VVV, and ∥s(y1)−s(y2)∥≤λ∥y1−y2∥\|s(y_1)-s(y_2)\|\le\lambda\|y_1-y_2\|∥s(y1​)−s(y2​)∥≤λ∥y1​−y2​∥ on UUU.

The reduction uses the following objects, all built from the data:

  • y0:=Ax0+ay_0:=Ax_0+ay0​:=Ax0​+a;
  • the face F:=∂ψC∗(−y0)F:=\partial\psi_C^*(-y_0)F:=∂ψC∗​(−y0​), the set of maximisers of ⟨−y0,⋅⟩\langle -y_0,\cdot\rangle⟨−y0​,⋅⟩ over CCC (it contains x0x_0x0​);
  • the tangent cone T:=TF(x0)=∂ψF(x0)∘T:=T_F(x_0)=\partial\psi_F(x_0)^\circT:=TF​(x0​)=∂ψF​(x0​)∘, the polar of the normal cone of FFF at x0x_0x0​;
  • the subspace LLL parallel to FFF (the direction of its affine hull) and the orthogonal projector PLP_LPL​;
  • the lineality space MMM of TTT, the subspace L∩M⊥L\cap M^\perpL∩M⊥, and the cone K:=T∩M⊥K:=T\cap M^\perpK:=T∩M⊥.

The reduced form of (A.1) at x0x_0x0​ is the inclusion z∈PLAw+∂ψT(w)z\in P_LAw+\partial\psi_T(w)z∈PL​Aw+∂ψT​(w) for z∈Lz\in Lz∈L; in an orthonormal basis adapted to MMM, L∩M⊥L\cap M^\perpL∩M⊥ and L⊥L^\perpL⊥ it is z∈Bw+∂ψRr×K(w)z\in Bw+\partial\psi_{\mathbb R^r\times K}(w)z∈Bw+∂ψRr×K​(w) with an (r+s)×(r+s)(r+s)\times(r+s)(r+s)×(r+s) matrix BBB. It is vacuous when L={0}L=\{0\}L={0}.

Formalization targets

Goal: Theorem A.4 (p. 60)

If x0x_0x0​ solves (A.1), then (A.1) is strongly regular at x0x_0x0​ if and only if

L={0}or∀z∈L ∃! w∈Rn: z∈PLAw+∂ψT(w).L=\{0\}\quad\text{or}\quad\forall z\in L\ \exists!\,w\in\mathbb R^n:\ z\in P_LAw+\partial\psi_T(w).L={0}or∀z∈L ∃!w∈Rn: z∈PL​Aw+∂ψT​(w).

No Lipschitz constant is fixed: the left side is "strongly regular for some λ\lambdaλ".

Milestones

  1. Proposition A.1 (p. 58): for x0∈Cx_0\in Cx0​∈C, (C−x0)∩U=TC(x0)∩U(C-x_0)\cap U=T_C(x_0)\cap U(C−x0​)∩U=TC​(x0​)∩U for some neighbourhood UUU of 000.
  2. Proposition A.2 (p. 58): on F=∂ψC∗(−y0)F=\partial\psi_C^*(-y_0)F=∂ψC∗​(−y0​), ∂ψF(x)=∂ψC(x)+y0R+\partial\psi_F(x)=\partial\psi_C(x)+y_0\mathbb R_+∂ψF​(x)=∂ψC​(x)+y0​R+​, and ∂ψC∗(−y)⊂F\partial\psi_C^*(-y)\subset F∂ψC∗​(−y)⊂F for yyy near y0y_0y0​.
  3. Proposition A.3 (p. 58): for x0∈Fx_0\in Fx0​∈F, near the origin, 0∈(y0+k)+∂ψC(x0+h)0\in(y_0+k)+\partial\psi_C(x_0+h)0∈(y0​+k)+∂ψC​(x0​+h) iff 0∈PLk+∂ψT(h)0\in P_Lk+\partial\psi_T(h)0∈PL​k+∂ψT​(h).
  4. The correspondence (A.4) (p. 60): for xxx near x0x_0x0​ and small yyy, (A.2) holds iff 0∈PL(Ah−y)+∂ψT(h)0\in P_L(Ah-y)+\partial\psi_T(h)0∈PL​(Ah−y)+∂ψT​(h) with h=x−x0h=x-x_0h=x−x0​.

Companions

  • Corollary 3.2 (p. 53), in two items. Sufficiency: the reduced form is vacuous, or B11B_{11}B11​ is nonsingular and the Schur complement B/B11B/B_{11}B/B11​ is positive definite. Characterisation when K=R+sK=\mathbb R^s_+K=R+s​: strongly regular iff vacuous, or B11B_{11}B11​ nonsingular and B/B11B/B_{11}B/B11​ a P-matrix.
  • The 3 × 3 linear complementarity example of §4 (p. 53): strongly regular at x0=(1,0,0)x_0=(1,0,0)x0​=(1,0,0), and not strongly regular once the entry 555 of AAA becomes 444.

Significance

Theorem A.4 turns a local stability property, defined through neighbourhoods and an inverse map, into a finite-dimensional algebraic question about one homogeneous problem on a polyhedral cone. Combined with the Schur-complement criterion of Theorem 3.1, it gives checkable conditions (Corollary 3.2): nonsingularity of a block and positive definiteness, or the P-matrix property, of its Schur complement. Through the KKT reformulation of §4 this is the route by which strong second-order sufficiency and linear independence of binding constraint gradients imply strong regularity in nonlinear programming. The example of p. 53 shows the criterion deciding cases where AAA itself is neither positive definite nor a P-matrix.

The results are classical and proved in the paper; to our knowledge none of them has a machine-checked proof. The formalization adds a coordinate-free statement of the reduced form, which the paper writes only in an adapted basis; a Lean account of exposed faces and tangent cones of polyhedra, with their local conic structure (Propositions A.1–A.2), which the paper lists "without proof" and cites to Rockafellar; and checked versions of the corollary and the example.

Difficulty

The definition of strong regularity is local, while condition (ii) is global on LLL. The obvious argument, "linearise and read off the inverse", does not apply, because ∂ψC\partial\psi_C∂ψC​ is a set-valued map whose graph changes shape from point to point. The step that carries the weight is Proposition A.3: a perturbation of y0y_0y0​ may move the solution off the face FFF, and only polyhedrality, through the finitely many values of ∂ψC\partial\psi_C∂ψC​ on FFF and the local conic structure of A.1–A.2, rules this out uniformly in a neighbourhood. The direction from strong regularity to (ii) needs positive homogeneity of the reduced form to pass from uniqueness near 000 to uniqueness on all of LLL. The direction from (ii) to strong regularity needs the Lipschitz property of a single-valued inverse of a polyhedral multifunction (Robinson 1979, cited as [12, Proposition 2]), which is not elementary.

Formalization scope

  • The space is EuclideanSpace ℝ (Fin n), with inclusions written as memberships: (A.2) is y−(Ax+a)∈∂ψC(x)y-(Ax+a)\in\partial\psi_C(x)y−(Ax+a)∈∂ψC​(x). A matrix acts through Matrix.toEuclideanLin. The normal cone carries the clause x∈Cx\in Cx∈C, so ∂ψC(x)=∅\partial\psi_C(x)=\emptyset∂ψC​(x)=∅ off CCC; without it every inclusion would be satisfiable at points outside CCC and the statements would change meaning.
  • TC(x0)T_C(x_0)TC​(x0​) is the polar of the normal cone, as on p. 58, not the closure of the cone of feasible directions. FFF is the set of maximisers of ⟨−y0,⋅⟩\langle -y_0,\cdot\rangle⟨−y0​,⋅⟩ (the sign matters: the opposite face would make the theorem false). LLL is the direction of the affine span of FFF, and PLP_LPL​ is Mathlib's Submodule.starProjection.
  • The reduced form is stated basis-free on LLL; ∂ψT\partial\psi_T∂ψT​ is the normal cone of TTT in all of Rn\mathbb R^nRn. In Corollary 3.2, B11B_{11}B11​ and B/B11B/B_{11}B/B11​ are expressed through projectors onto MMM and L∩M⊥L\cap M^\perpL∩M⊥. Only the case K=R+sK=\mathbb R^s_+K=R+s​ is stated in a basis, an orthonormal basis of L∩M⊥L\cap M^\perpL∩M⊥ in which KKK is the orthant.
  • "Positive definite" does not require symmetry. "Strongly regular" without a constant is existential in λ\lambdaλ, with λ\lambdaλ real.
  • Corollary 3.2's second sentence refers on the page to "(3.8)", an evident slip for (3.9); it is formalized for (3.9).
  • The standing assumption "C nonempty polyhedral convex" is a hypothesis of every item.
  • A trivializing formalization is ruled out: strong regularity requires existence, uniqueness in VVV and the Lipschitz bound together, and condition (ii) requires existence and uniqueness for every z∈Lz\in Lz∈L.
  • Needed infrastructure: faces and tangent cones of polyhedra and their local structure (Minkowski–Weyl, finitely many faces), orthogonal decompositions, and Lipschitz continuity of single-valued polyhedral inverses. All of this is reusable beyond this mission. Proofs of the propositions, of the correspondence, and of the companions are welcome independently.

Selected references

  • S. M. Robinson, Strongly regular generalized equations, Mathematics of Operations Research 5(1), 43–62, 1980. https://doi.org/10.1287/moor.5.1.43
  • S. M. Robinson, Generalized equations and their solutions, Part I: Basic theory, Mathematical Programming Study 10, 128–141, 1979. https://doi.org/10.1007/BFb0120850
  • R. T. Rockafellar, Convex Analysis, Princeton University Press, 1970. https://doi.org/10.1515/9781400873173
  • A. L. Dontchev and R. T. Rockafellar, Implicit Functions and Solution Mappings, 2nd ed., Springer, 2014. https://doi.org/10.1007/978-1-4939-1037-3
  • R. W. Cottle, Manifestations of the Schur complement, Linear Algebra and its Applications 8, 189–211, 1974. https://doi.org/10.1016/0024-3795(74)90066-4
6 thms1 active userReviewed
Linear algebraOptimization·Captain: mikedeng1

Strongly Regular Generalized Equations II: Schur-Complement Criterion — A₁₁ Nonsingular and (A/A₁₁) Positive Definite Make (A + ∂ψ_{ℝʳ×K})⁻¹ Lipschitz on ℝ^{r+s}; for K = ℝˢ₊, P-Matrix IffResearch Paper

Motivation

A constrained system can be written as a generalized equation: a smooth or linear expression must balance the normal cone of a feasible set. This form includes variational inequalities and the first-order conditions of many optimization problems. It is useful to know whether a small change in the right-hand side determines one nearby solution and how far that solution moves. In the linear finite-dimensional case, Robinson's Theorem 3.1 gives matrix conditions that guarantee something stronger: a unique solution for every right-hand side, with one Lipschitz bound valid over the entire space. The theorem also identifies an exact matrix criterion when the feasible set is a product with a nonnegative orthant.

The question is relevant whenever some coordinates of a system are free and others are constrained by inequalities. Eliminating the free coordinates produces a smaller matrix, the Schur complement. The resulting condition can be checked on the reduced block, and in the orthant case it becomes the familiar P-matrix criterion from linear complementarity. Robinson states both claims in a single theorem and relates them to the behavior of a generalized equation rather than to an isolated matrix property Robinson, pp. 51–52.

Setting

Let r,sr,sr,s be positive integers and give Rr+s\mathbb R^{r+s}Rr+s its Euclidean norm. Write w=(w1,w2)w=(w_1,w_2)w=(w1​,w2​), with w1∈Rrw_1\in\mathbb R^rw1​∈Rr and w2∈Rsw_2\in\mathbb R^sw2​∈Rs. Let K⊆RsK\subseteq\mathbb R^sK⊆Rs be nonempty, closed, and convex, and put D=Rr×KD=\mathbb R^r\times KD=Rr×K. For w∈Dw\in Dw∈D, the normal cone is

ND(w)={v∈Rr+s:⟨v,c−w⟩≤0 for every c∈D}.N_D(w)=\{v\in\mathbb R^{r+s}:\langle v,c-w\rangle\leq0\text{ for every }c\in D\}.ND​(w)={v∈Rr+s:⟨v,c−w⟩≤0 for every c∈D}.

For w∉Dw\notin Dw∈/D, ND(w)N_D(w)ND​(w) is empty. Thus the inclusion y∈Aw+ND(w)y\in Aw+N_D(w)y∈Aw+ND​(w) itself enforces feasibility. This is Robinson's indicator-subdifferential convention Robinson, pp. 43 and 51.

Partition the real square matrix AAA into blocks A11A_{11}A11​, A12A_{12}A12​, A21A_{21}A21​, and A22A_{22}A22​, where A11A_{11}A11​ is r×rr\times rr×r. When A11A_{11}A11​ is nonsingular, its Schur complement in AAA is

A/A11=A22−A21A11−1A12.A/A_{11}=A_{22}-A_{21}A_{11}^{-1}A_{12}.A/A11​=A22​−A21​A11−1​A12​.

A real matrix MMM is positive definite in the theorem's sense when v⊤Mv>0v^\top Mv>0v⊤Mv>0 for every nonzero vvv. Symmetry is not assumed. A P-matrix has strictly positive determinants for every nonempty principal submatrix. Write R+s\mathbb R^s_+R+s​ for the vectors with all components nonnegative. These conventions are stated or used in Theorem 3.1 and its proof.

Formalization targets

General closed convex set

For TK(w)=Aw+NRr×K(w)T_K(w)=Aw+N_{\mathbb R^r\times K}(w)TK​(w)=Aw+NRr×K​(w), the first target is the sufficient condition

det⁡A11≠0andv⊤(A/A11)v>0  (v≠0)⟹TK−1:Rr+s→Rr+s is Lipschitz.\det A_{11}\ne0\quad\text{and}\quad v^\top(A/A_{11})v>0\;(v\ne0) \quad\Longrightarrow\quad T_K^{-1}:\mathbb R^{r+s}\to\mathbb R^{r+s}\text{ is Lipschitz}.detA11​=0andv⊤(A/A11​)v>0(v=0)⟹TK−1​:Rr+s→Rr+s is Lipschitz.

Here “is Lipschitz” includes that exactly one inverse value exists at every yyy. The assertion holds for every nonempty closed convex KKK; it is not restricted to polyhedral sets.

Nonnegative orthant

When K=R+sK=\mathbb R^s_+K=R+s​, the second target is an equivalence:

TR+s−1 is everywhere defined, single-valued and Lipschitz⟺det⁡A11≠0 and A/A11 is a P-matrix.T_{\mathbb R^s_+}^{-1}\text{ is everywhere defined, single-valued and Lipschitz} \quad\Longleftrightarrow\quad \det A_{11}\ne0\text{ and }A/A_{11}\text{ is a P-matrix}.TR+s​−1​ is everywhere defined, single-valued and Lipschitz⟺detA11​=0 and A/A11​ is a P-matrix.

The goal theorem is the conjunction of these two statements, matching Theorem 3.1. Its milestones record the paper's local upper Lipschitz assertion for polyhedral multifunctions, the block reduction, the reduced inverse result, the complementarity characterization, and the necessity of nonsingularity.

Significance

The first part gives a global sensitivity guarantee for a generalized equation with an arbitrary nonempty closed convex lower-block constraint. For any two right-hand sides, their unique solutions differ by at most a fixed multiple of the distance between those right-hand sides. The second part tells when this guarantee holds for the orthant model: the P-matrix condition is necessary as well as sufficient. These are the precise conclusions of Robinson's theorem; the mission concerns their machine-checked formalization, not an unresolved mathematical conjecture.

A complete development would provide reusable definitions of the normal-cone generalized equation, an explicitly nonsymmetric notion of positive definiteness, P-matrices, and the global inverse property. It would also formalize the linear complementarity characterization quoted in the paper. The current draft has Lean-checked statements with proof placeholders. No proof of Theorem 3.1 or of its milestones is claimed here.

Difficulty

Nonsingularity of the full matrix AAA alone does not decide whether the constrained inverse exists uniquely: the normal cone can change as w2w_2w2​ reaches different faces of KKK. A pointwise uniqueness argument also does not by itself supply one Lipschitz constant on all of Rr+s\mathbb R^{r+s}Rr+s. For the orthant case, checking only the full determinant or leading principal minors would miss the criterion Robinson invokes; every nonempty principal minor matters. The difficulty is to connect a global statement about all right-hand sides with the reduced matrix condition while preserving the normal cone's behavior at boundary points Robinson, pp. 51–52.

Formalization scope

Lean represents Rr+s\mathbb R^{r+s}Rr+s as a Euclidean space indexed by the disjoint union of Fin(r)\mathrm{Fin}(r)Fin(r) and Fin(s)\mathrm{Fin}(s)Fin(s). This gives the paper's Euclidean norm rather than the sup norm of a product type. The normal cone is empty off its set, and the inverse property explicitly requires existence for every right-hand side, uniqueness, and one global real Lipschitz bound. The Schur complement appears only with a nonsingular A11A_{11}A11​ in the substantive claims; matrix inversion on a singular input would otherwise be totalized by Lean. Positive definiteness does not add a symmetry hypothesis. The goal retains r,s>0r,s>0r,s>0 as printed; the paper's later remark about zero-dimensional blocks is outside this theorem.

The polyhedral milestones use finite intersections of closed half-spaces. The reduced-operator milestone uses a nonempty closed convex KKK, matching the theorem's setting. The LCP milestone allows any finite dimension; at dimension zero, both its universal uniqueness statement and its empty-minor P-matrix condition hold. A weaker encoding in which the inverse is merely single-valued where it happens to exist would erase the global conclusion and is excluded here.

Solvers can contribute the block-normal-cone equivalence, the global inverse statement for the reduced operator, the polyhedral Lipschitz result, the P-matrix characterization, and the final theorem. The normal-cone and matrix definitions can also serve later generalized-equation missions that use the same conventions.

Selected references

  • S. M. Robinson, Strongly Regular Generalized Equations, Mathematics of Operations Research 5(1), 43–62, 1980. DOI 10.1287/moor.5.1.43.
8 thms1 active userReviewed
Functional AnalysisOptimization·Captain: mikedeng1

Strongly Regular Generalized Equations I: Implicit-Function Theorem — the Solution x(p) of 0 ∈ f(p, x) + ∂ψ_C(x) Is Locally Unique with ‖x(p) − x(q)‖ ≤ (λ + ε)‖f(p, x(q)) − f(q, x(q))‖Research Paper

Motivation

Many problems of optimization and equilibrium can be written as one inclusion. Some examples are the Karush–Kuhn–Tucker conditions of a nonlinear program, nonlinear complementarity problems, variational inequalities and the equilibrium conditions of economic and traffic models. In each of them a point xxx has to satisfy 0∈f(x)+∂ψC(x)0 \in f(x) + \partial\psi_C(x)0∈f(x)+∂ψC​(x). In applications the data fff depend on parameters: estimated coefficients, prices, or the iterate of an algorithm. One then wants to know whether a solution persists under a perturbation of the parameter, whether it stays locally unique, and how fast it moves. For a smooth equation f(p,x)=0f(p, x) = 0f(p,x)=0 the classical implicit-function theorem answers all three questions. Inequality constraints make the solution set nonsmooth, and the classical theorem no longer applies.

S. M. Robinson's paper Strongly regular generalized equations (Math. Oper. Res. 5 (1980) 43–62) introduced the condition of strong regularity and proved an implicit-function theorem for generalized equations under it. The condition and the theorem became the starting point of the stability theory of variational inequalities and nonlinear programs. Later work characterises strong regularity for nonlinear programs (Robinson's own §4, through the strong second-order sufficient condition), and develops it in the theory of metric regularity and of single-valued Lipschitz localisations (Dontchev–Rockafellar, Implicit Functions and Solution Mappings, Springer 2009/2014). Its sensitivity results underlie the convergence analysis of Newton and sequential quadratic programming methods for these problems.

This mission formalizes §1–§2 of the paper: the definition, the implicit-function theorem (Theorem 2.1) with its proof, and the three results derived from it.

Setting

Let XXX be a real normed linear space and X′X'X′ its topological dual, the continuous linear functionals on XXX. Let C⊆XC \subseteq XC⊆X be closed and convex. The normal-cone operator of CCC is

∂ψC(x)={{y∈X′:y(c−x)≤0 for all c∈C},x∈C,∅,x∉C.\partial\psi_C(x) = \begin{cases} \{y \in X' : y(c - x) \le 0 \text{ for all } c \in C\}, & x \in C, \\ \emptyset, & x \notin C. \end{cases}∂ψC​(x)={{y∈X′:y(c−x)≤0 for all c∈C},∅,​x∈C,x∈/C.​

A generalized equation is the inclusion 0∈f(x)+∂ψC(x)0 \in f(x) + \partial\psi_C(x)0∈f(x)+∂ψC​(x), for a function fff from an open set Ω⊆X\Omega \subseteq XΩ⊆X to X′X'X′. For C=XC = XC=X it is the equation f(x)=0f(x) = 0f(x)=0. For CCC the nonnegative orthant of Rn\mathbb R^nRn it is the nonlinear complementarity problem. For a general closed convex CCC it is the variational inequality over CCC.

Let x0∈Ωx_0 \in \Omegax0​∈Ω solve the generalized equation, and let fff be Fréchet differentiable at x0x_0x0​. Linearising fff gives the multifunction

Tx=f(x0)+f′(x0)(x−x0)+∂ψC(x).T x = f(x_0) + f'(x_0)(x - x_0) + \partial\psi_C(x).Tx=f(x0​)+f′(x0​)(x−x0​)+∂ψC​(x).

The generalized equation is strongly regular at x0x_0x0​ with associated Lipschitz constant λ\lambdaλ if there are neighbourhoods UUU of 000 in X′X'X′ and VVV of x0x_0x0​ with the following property: for every y∈Uy \in Uy∈U the inclusion y∈Txy \in Txy∈Tx has exactly one solution s(y)s(y)s(y) in VVV, and ∥s(y1)−s(y2)∥≤λ∥y1−y2∥\|s(y_1) - s(y_2)\| \le \lambda \|y_1 - y_2\|∥s(y1​)−s(y2​)∥≤λ∥y1​−y2​∥ on UUU. The condition depends only on f(x0)f(x_0)f(x0​), f′(x0)f'(x_0)f′(x0​) and CCC.

In the parametric problem the function is f(p,x)f(p, x)f(p,x), with ppp in a topological space PPP and base point p0p_0p0​. Its partial derivative in xxx is f′(p,x)f'(p, x)f′(p,x).

Formalization targets

Goal: Theorem 2.1 (p. 45)

Assume that f′f'f′ exists on P×ΩP \times \OmegaP×Ω, that fff and f′f'f′ are continuous at (p0,x0)(p_0, x_0)(p0​,x0​), and that x0x_0x0​ solves 0∈f(p0,x)+∂ψC(x)0 \in f(p_0, x) + \partial\psi_C(x)0∈f(p0​,x)+∂ψC​(x), strongly regularly with constant λ\lambdaλ. Then for every ε>0\varepsilon > 0ε>0 there are neighbourhoods NεN_\varepsilonNε​ of p0p_0p0​ and WεW_\varepsilonWε​ of x0x_0x0​, and a function x:Nε→Wεx : N_\varepsilon \to W_\varepsilonx:Nε​→Wε​, with two properties. First, x(p)x(p)x(p) is the unique solution in WεW_\varepsilonWε​ of 0∈f(p,x)+∂ψC(x)0 \in f(p, x) + \partial\psi_C(x)0∈f(p,x)+∂ψC​(x). Second,

∥x(p)−x(q)∥≤(λ+ε) ∥f(p,x(q))−f(q,x(q))∥(p,q∈Nε).\|x(p) - x(q)\| \le (\lambda + \varepsilon)\,\|f(p, x(q)) - f(q, x(q))\| \qquad (p, q \in N_\varepsilon).∥x(p)−x(q)∥≤(λ+ε)∥f(p,x(q))−f(q,x(q))∥(p,q∈Nε​).

Milestones: the steps of the proof (p. 46)

Write LLL for the linearisation at (p0,x0)(p_0, x_0)(p0​,x0​), r(p,x)=f(p0,x0)+f′(p0,x0)(x−x0)−f(p,x)r(p, x) = f(p_0, x_0) + f'(p_0, x_0)(x - x_0) - f(p, x)r(p,x)=f(p0​,x0​)+f′(p0​,x0​)(x−x0​)−f(p,x) for the residual, and Φp(x)=V∩L−1[r(p,x)]\Phi_p(x) = V \cap L^{-1}[r(p, x)]Φp​(x)=V∩L−1[r(p,x)]. The milestones are four claims of the proof:

  1. On the closed ball VεV_\varepsilonVε​, the fixed points of Φp\Phi_pΦp​ are exactly the solutions of the perturbed inclusion.
  2. ∥Φp(x1)−Φp(x2)∥≤λδ∥x1−x2∥\|\Phi_p(x_1) - \Phi_p(x_2)\| \le \lambda\delta \|x_1 - x_2\|∥Φp​(x1​)−Φp​(x2​)∥≤λδ∥x1​−x2​∥ on VεV_\varepsilonVε​.
  3. Φp\Phi_pΦp​ maps VεV_\varepsilonVε​ into itself.
  4. The contraction principle on VεV_\varepsilonVε​, with the bound ∥x(p)−x∥≤(1−λδ)−1∥Φp(x)−x∥\|x(p) - x\| \le (1 - \lambda\delta)^{-1} \|\Phi_p(x) - x\|∥x(p)−x∥≤(1−λδ)−1∥Φp​(x)−x∥ (2.5).

Companion results

  • Corollary 2.2 (pp. 46–47). If PPP lies in a normed space and ∥f(p,x)−f(q,x)∥≤ν∥p−q∥\|f(p, x) - f(q, x)\| \le \nu \|p - q\|∥f(p,x)−f(q,x)∥≤ν∥p−q∥, then x(⋅)x(\cdot)x(⋅) is Lipschitzian with modulus ν(λ+ε)\nu(\lambda + \varepsilon)ν(λ+ε).
  • Theorem 2.3 (p. 47). Let Φp(x0)\Phi_p(x_0)Φp​(x0​) be the unique local solution of the linear generalized equation 0∈f(p,x0)+f′(p0,x0)(x−x0)+∂ψC(x)0 \in f(p, x_0) + f'(p_0, x_0)(x - x_0) + \partial\psi_C(x)0∈f(p,x0​)+f′(p0​,x0​)(x−x0​)+∂ψC​(x). Then ∥x(p)−Φp(x0)∥≤αε(p)∥p−p0∥\|x(p) - \Phi_p(x_0)\| \le \alpha_\varepsilon(p)\|p - p_0\|∥x(p)−Φp​(x0​)∥≤αε​(p)∥p−p0​∥, with αε(p)→0\alpha_\varepsilon(p) \to 0αε​(p)→0.
  • Theorem 2.4 (p. 48). This is a perturbation lemma for linear generalized equations 0∈Ax+a+∂ψC(x)0 \in Ax + a + \partial\psi_C(x)0∈Ax+a+∂ψC​(x). Near (A0,a0)(A_0, a_0)(A0​,a0​) the localised inverse stays single-valued, and it is Lipschitzian with modulus λ(1−λ∥A−A0∥)−1\lambda(1 - \lambda\|A - A_0\|)^{-1}λ(1−λ∥A−A0​∥)−1.
  • The case C=XC = XC=X (remark on p. 45). There strong regularity is equivalent to f′(x0)f'(x_0)f′(x0​) having a continuous linear inverse.
  • Strong regularity is the weakest possible condition (remark on p. 47). For the canonical perturbation f(p,x)=f(x0)+f′(x0)(x−x0)−pf(p,x) = f(x_0) + f'(x_0)(x - x_0) - pf(p,x)=f(x0​)+f′(x0​)(x−x0​)−p, p∈X′p \in X'p∈X′, locally unique solvability with a Lipschitzian solution map x(⋅)x(\cdot)x(⋅) near p0=0p_0 = 0p0​=0 is exactly strong regularity at x0x_0x0​.

Significance

Theorem 2.1 reduces the stability of a nonsmooth problem to a property of one linearised problem at the base point. Once strong regularity is checked at x0x_0x0​, the solution exists, is locally unique and moves in a Lipschitz manner for every nearby parameter. Corollary 2.2 and Theorem 2.3 make this quantitative. Theorem 2.3 shows that a linear complementarity problem or a quadratic program approximates the nonlinear solution to first order. Theorem 2.4 is the analogue of Banach's perturbation lemma, which keeps an operator invertible under small perturbations. The later sections of the paper give checkable criteria for strong regularity: a Schur-complement test, a reduced-form test over polyhedral sets, and second-order conditions for nonlinear programs. Those criteria are the subject of the companion missions II–IV.

The theorems have been proved since 1980 and have been restated in textbooks. No machine-checked version of strong regularity or of this implicit-function theorem is known. Mathlib has the classical implicit- and inverse-function theorems for C1C^1C1 maps between Banach spaces, and the contraction mapping principle. It has nothing on normal-cone operators, generalized equations or Lipschitz localisations. The formalization adds this layer. It also shows that Theorem 2.1 needs no completeness of XXX.

Difficulty

The obvious approach is to apply the classical implicit-function theorem. It fails because x↦f(x)+∂ψC(x)x \mapsto f(x) + \partial\psi_C(x)x↦f(x)+∂ψC​(x) is set-valued and is not differentiable in any useful sense. The inverse is localised only to a neighbourhood VVV and is single-valued only there. So every step must keep the iterates inside sets on which strong regularity says something. The neighbourhoods have to be chosen in the right order: δ\deltaδ from ε\varepsilonε, then UUU and VVV, then the ball radius ρ\rhoρ, then the parameter neighbourhood. The estimate (2.4) has to come out with the constant λ+ε\lambda + \varepsilonλ+ε and no larger. The page applies the contraction principle in a space it calls only normed. A faithful proof must also obtain the fixed point without completeness of XXX, for example through the completeness of X′X'X′.

Formalization scope

  • X′X'X′ is StrongDual ℝ X, the normal cone is a Set (StrongDual ℝ X) that is empty off CCC, and an inclusion 0∈f(x)+∂ψC(x)0 \in f(x) + \partial\psi_C(x)0∈f(x)+∂ψC​(x) is written −f(x)∈∂ψC(x)-f(x) \in \partial\psi_C(x)−f(x)∈∂ψC​(x).
  • Strong regularity is a predicate on (C,f(x0),f′(x0),x0,λ)(C, f(x_0), f'(x_0), x_0, \lambda)(C,f(x0​),f′(x0​),x0​,λ) with real λ\lambdaλ. It requires existence, uniqueness in VVV and the Lipschitz bound.
  • fff is a total function P×X→X′P \times X \to X'P×X→X′ whose values off P×ΩP \times \OmegaP×Ω carry no hypothesis. The conclusion therefore asserts Wε⊆ΩW_\varepsilon \subseteq \OmegaWε​⊆Ω.
  • Differentiability is HasFDerivAt at every point of Ω\OmegaΩ, for every ppp. Continuity of f′f'f′ at (p0,x0)(p_0, x_0)(p0​,x0​) is joint and in operator norm.
  • Uniqueness is uniqueness within WεW_\varepsilonWε​, never global. Global uniqueness is false in general. Dropping uniqueness, or quantifying ε\varepsilonε after the neighbourhoods, would trivialize the goal, and the statements are written to exclude both.
  • Theorem 2.1, Corollary 2.2 and Theorem 2.3 do not assume completeness, as printed. Theorem 2.4 assumes a Banach space, as printed.
  • The contraction-principle milestone assumes completeness, under which the principle as invoked holds.
  • Corollary 2.2 asks for its Lipschitz hypothesis on Nε×VεN_\varepsilon \times V_\varepsilonNε​×Vε​, sets that Theorem 2.1 produces. It is therefore stated on fixed neighbourhoods given in advance.
  • Theorem 2.4 also asserts λ∥A−A0∥<1\lambda\|A - A_0\| < 1λ∥A−A0​∥<1, which its proof secures.

A complete development needs the following:

  • the mean-value inequality for Fréchet-differentiable maps on convex sets;
  • the contraction principle on a closed ball;
  • a fixed-point argument that obtains the fixed point through the complete space X′X'X′.

The definitions of normal cone and strong regularity are reusable for variational inequalities in general. Contributions are welcome at any level: proofs of the milestones, the goal from the milestones, or the companion results from the goal.

Selected references

  • S. M. Robinson, Strongly regular generalized equations, Mathematics of Operations Research 5(1):43–62, 1980. https://doi.org/10.1287/moor.5.1.43
  • A. L. Dontchev and R. T. Rockafellar, Implicit Functions and Solution Mappings, 2nd ed., Springer, 2014. https://doi.org/10.1007/978-1-4939-1037-3
6 thms1 active userReviewed
CombinatoricsGraph TheoryLinear Optimization+1·Captain: mikedeng1

The Geometry of Graphs and Some of Its Algorithmic Applications 1: Every Multicommodity Flow Network with k Source-Sink Pairs Has a Cut S with Cap(S)/Dem(S) ≤ O(log k) · maxflowResearch Paper

Motivation

Routing several commodities through one capacitated network at the same time is a basic problem of network optimization, with applications to communication networks, VLSI layout and divide-and-conquer graph algorithms. Its optimum is the value of a linear program, but the natural certificates of an upper bound are combinatorial: every cut of the network limits how much can be routed across it. For a single commodity the max-flow min-cut theorem says that the best cut certificate is exact. With many commodities it is not, and the size of the gap between the best flow and the best cut is the question of this mission.

  • 1988–1999, Leighton and Rao proved that for uniform demands (one unit between every pair of vertices) the gap is O(log⁡n)O(\log n)O(logn) on an nnn-vertex network, and that the bound is attained on expanders (Leighton–Rao, JACM 1999; FOCS 1988).
  • 1990–1995, Klein, Rao, Agrawal and Ravi extended a polylogarithmic bound to arbitrary demands, O(log⁡Clog⁡D)O(\log C \log D)O(logClogD) in the total capacity CCC and total demand DDD (Combinatorica 15, 1995); Plotkin and Tardos improved it to O(log⁡2k)O(\log^2 k)O(log2k) in the number of commodities kkk (Combinatorica 15, 1995).
  • 1995, Linial, London and Rabinovich (Combinatorica 15, 1995), and independently Aumann and Rabani (SIAM J. Comput. 1998), showed that the gap is bounded by the least distortion of embedding a metric derived from the network into ℓ1\ell_1ℓ1​, and obtained the bound O(log⁡k)O(\log k)O(logk) from Bourgain's embedding theorem. This mission formalizes that theorem, Theorem 4.1 of the Linial–London–Rabinovich paper.

Setting

A multicommodity flow network has a finite vertex set VVV, capacities Ci,j=Cj,i≥0C_{i,j} = C_{j,i} \ge 0Ci,j​=Cj,i​≥0 (zero for non-edges and on the diagonal), and kkk commodities: commodity μ\muμ has a source sμs_\musμ​, a sink tμt_\mutμ​ and a demand Dμ≥0D_\mu \ge 0Dμ​≥0.

A feasible concurrent flow of value λ\lambdaλ sends, for every μ\muμ, λDμ\lambda D_\muλDμ​ units of commodity μ\muμ from sμs_\musμ​ to tμt_\mutμ​: arc flows fμ(i,j)≥0f_\mu(i,j) \ge 0fμ​(i,j)≥0 satisfy conservation of matter, with net outflow λDμ\lambda D_\muλDμ​ at sμs_\musμ​, −λDμ-\lambda D_\mu−λDμ​ at tμt_\mutμ​ and 000 elsewhere, and the total flow of all commodities through each undirected edge {i,j}\{i,j\}{i,j}, in both directions, is at most Ci,jC_{i,j}Ci,j​. The maxflow of the network is the largest such λ\lambdaλ.

For S⊆VS \subseteq VS⊆V, Cap(S)=∑i∈S∑j∉SCi,j\mathrm{Cap}(S) = \sum_{i \in S}\sum_{j \notin S} C_{i,j}Cap(S)=∑i∈S​∑j∈/S​Ci,j​ is the capacity of the edges leaving SSS, and Dem(S)\mathrm{Dem}(S)Dem(S) is the total demand of the pairs that SSS separates, i.e. with ∣S∩{sμ,tμ}∣=1|S \cap \{s_\mu,t_\mu\}| = 1∣S∩{sμ​,tμ​}∣=1. Every flow of value λ\lambdaλ has to push λ Dem(S)\lambda\,\mathrm{Dem}(S)λDem(S) units across the cut, so

maxflow≤Cap(S)Dem(S)for every S with Dem(S)>0.\mathrm{maxflow} \le \frac{\mathrm{Cap}(S)}{\mathrm{Dem}(S)} \quad\text{for every } S \text{ with } \mathrm{Dem}(S) > 0.maxflow≤Dem(S)Cap(S)​for every S with Dem(S)>0.

A semi-metric on VVV is a function d≥0d \ge 0d≥0 with d(i,i)=0d(i,i) = 0d(i,i)=0, symmetry and the triangle inequality; distinct points may be at distance 000, as in the paper.

Formalization targets

Goal: Theorem 4.1

There is an absolute constant C0>0C_0 > 0C0​>0 such that every network in which some commodity has Dμ>0D_\mu > 0Dμ​>0 and sμ≠tμs_\mu \ne t_\musμ​=tμ​ has a set S⊆VS \subseteq VS⊆V with Dem(S)>0\mathrm{Dem}(S) > 0Dem(S)>0 and

Cap(S)Dem(S)≤C0log⁡(max⁡(k,2))⋅maxflow.\frac{\mathrm{Cap}(S)}{\mathrm{Dem}(S)} \le C_0 \log(\max(k,2)) \cdot \mathrm{maxflow}.Dem(S)Cap(S)​≤C0​log(max(k,2))⋅maxflow.

The constant is not fixed; only the shape O(log⁡k)O(\log k)O(logk) in the number of commodities is asserted.

Milestones, in the order the proof uses them

  1. Weak duality (§4, p. 226): λ Dem(S)≤Cap(S)\lambda\,\mathrm{Dem}(S) \le \mathrm{Cap}(S)λDem(S)≤Cap(S) for every feasible λ≥0\lambda \ge 0λ≥0 and every SSS.
  2. LP duality display (p. 227): maxflow=min⁡d∑{i,j}Ci,jdi,j∑μDμdsμ,tμ\mathrm{maxflow} = \min_d \dfrac{\sum_{\{i,j\}} C_{i,j} d_{i,j}}{\sum_\mu D_\mu d_{s_\mu,t_\mu}}maxflow=mind​∑μ​Dμ​dsμ​,tμ​​∑{i,j}​Ci,j​di,j​​ over semi-metrics ddd.
  3. Corollary 3.4, Claim 2 (p. 223): every finite semi-metric space with kkk marked pairs has a non-expanding map into some ℓ1m\ell_1^mℓ1m​ that shrinks each marked pair by at most C1log⁡(max⁡(k,2))C_1 \log(\max(k,2))C1​log(max(k,2)).
  4. Coordinate minimum (p. 227): for points of ℓ1m\ell_1^mℓ1m​, the cost-to-demand ratio is at least its value on the best single coordinate.
  5. 0/1 rounding (pp. 227–228): for symmetric real weights aaa and nonnegative symmetric weights bbb, the minimum of ∑aij∣zi−zj∣/∑bij∣zi−zj∣\sum a_{ij}|z_i - z_j| / \sum b_{ij}|z_i - z_j|∑aij​∣zi​−zj​∣/∑bij​∣zi​−zj​∣ over real vectors zzz is attained at a 0/1 vector.

Significance

The theorem bounds the flow–cut gap: the integrality gap of the linear relaxation of the sparsest cut problem is O(log⁡k)O(\log k)O(logk), so solving one linear program and rounding gives an O(log⁡k)O(\log k)O(logk)-approximation to the sparsest cut. Sparsest-cut approximations are the engine of approximation algorithms for minimum bisection, graph partitioning, crossing number and VLSI layout. The dependence on kkk rather than on the number of vertices matters when few pairs carry demand. The bound is tight up to the constant: on constant-degree expanders with all-pairs unit demands the gap is Ω(log⁡n)\Omega(\log n)Ω(logn) (Leighton–Rao).

The result has been proved since 1995 and is textbook material (Williamson–Shmoys, Ch. 15). It has no machine-checked proof. A formalization adds a verified bridge between concurrent flows, LP duality on networks and ℓ1\ell_1ℓ1​ embeddings of finite metrics; each piece is reusable on its own. Corollary 3.4, Claim 2 in particular is a terminal version of Bourgain's theorem, of which no formal proof exists either.

Difficulty

Two steps carry the weight. The first is the duality between concurrent flows and metrics: Mathlib has no linear programming duality theorem in a form that applies directly, and the dual of the arc-flow program has to be identified with a minimum over semi-metrics, which needs a shortest-path argument on top of LP duality. The second is the embedding: Claim 2 of Corollary 3.4 must achieve distortion O(log⁡k)O(\log k)O(logk) on the kkk marked pairs, independent of ∣X∣|X|∣X∣. A direct application of Bourgain's theorem to the whole space gives O(log⁡∣X∣)O(\log |X|)O(log∣X∣), which is not enough when kkk is much smaller than the number of vertices, and the paper's proof is a one-line reference to an earlier argument.

Formalization scope

  • Vertex sets are finite types V with [Fintype V] [DecidableEq V]; capacities are a function C : V → V → ℝ with symmetry, nonnegativity and zero diagonal as fields of a Network structure. Commodities are indexed by Fin k; coincident or repeated pairs are allowed.
  • Flows are arc flows; the capacity bounds the total over all commodities and both directions. maxflow is the supremum of feasible values; Lean's sSup returns 000 on an unbounded set, which only happens without a commodity of positive demand and distinct endpoints, and the goal assumes one.
  • Sums over edges are over unordered pairs: the page's ∑i≠j\sum_{i \ne j}∑i=j​ in the LP-duality and coordinate displays counts each edge twice, while Cap\mathrm{Cap}Cap counts it once; the statements use 12∑i∑j\tfrac12\sum_i\sum_j21​∑i​∑j​ in both places, which removes the factor-2 slip without changing the proof.
  • Explicit constants. The paper's O(log⁡k)O(\log k)O(logk) in Theorem 4.1 is C0log⁡(max⁡(k,2))C_0 \log(\max(k,2))C0​log(max(k,2)) with C0C_0C0​ quantified before the network; the Ω(1/log⁡k)\Omega(1/\log k)Ω(1/logk) of Corollary 3.4 is 1/(C1log⁡(max⁡(k,2)))1/(C_1\log(\max(k,2)))1/(C1​log(max(k,2))) with C1C_1C1​ quantified before the metric space. The max⁡(k,2)\max(k,2)max(k,2) keeps k=1k = 1k=1 in scope, where log⁡k=0\log k = 0logk=0.
  • Out of scope. The deterministic polynomial-time algorithms of Theorem 4.1 and Corollary 3.4, and the target dimension ℓ1O(n2)\ell_1^{O(n^2)}ℓ1O(n2)​ of the latter, are not stated; the statements assert the existence of the cut and of the embedding.
  • The 0/1 rounding step adds b≥0b \ge 0b≥0, which the page omits but its argument needs.
  • A trivializing formalization is ruled out: the constant C0C_0C0​ is quantified before the network, so it cannot depend on the instance, and maxflow is defined from flows, not as the metric minimum.
  • Contributions welcome: an LP duality theorem for finite-dimensional linear programs in the form needed here, a formal Bourgain-type embedding with terminal distortion, and the max-flow min-cut theorem for undirected capacities.

Selected references

  • N. Linial, E. London, Y. Rabinovich, The geometry of graphs and some of its algorithmic applications, Combinatorica 15 (1995) 215–245. https://doi.org/10.1007/BF01200757
  • Y. Aumann, Y. Rabani, An O(log k) approximate min-cut max-flow theorem and approximation algorithm, SIAM J. Comput. 27 (1998) 291–301. https://doi.org/10.1137/S0097539794285983
  • T. Leighton, S. Rao, Multicommodity max-flow min-cut theorems and their use in designing approximation algorithms, J. ACM 46 (1999) 787–832. https://doi.org/10.1145/331524.331526
  • J. Bourgain, On Lipschitz embedding of finite metric spaces in Hilbert space, Israel J. Math. 52 (1985) 46–52. https://doi.org/10.1007/BF02776078
  • D. P. Williamson, D. B. Shmoys, The Design of Approximation Algorithms, Cambridge University Press, 2011, Chapter 15. https://doi.org/10.1017/CBO9780511921735
9 thms1 active userReviewed
CombinatoricsGraph TheoryLinear Optimization+1·Captain: mikedeng1

Approximation Algorithms for Scheduling Unrelated Parallel Machines 1: Binary Search over Rounded LP Vertices Finds a Schedule within Twice the Optimal MakespanResearch Paper

Motivation

Scheduling unrelated parallel machines to minimize the makespan, written R ∥ Cmax⁡R\,\|\,C_{\max}R∥Cmax​, is one of the basic NP-hard problems of scheduling theory. A set of jobs must each be run on one of several machines, and the time a job takes depends arbitrarily on the machine; the goal is to finish all jobs as early as possible. Before the work formalized here, the best polynomial algorithm known guaranteed only a schedule within 2m2\sqrt m2m​ times the optimum (Davis and Jaffe, 1981), a factor that grows with the number of machines mmm.

Lenstra, Shmoys and Tardos (FOCS 1987; CWI Report OS-R8714, 1987; Math. Programming 46, 1990) gave a polynomial algorithm with guarantee 222, independent of mmm. Their tool is a rounding theorem: a vertex of a natural linear-programming relaxation can be rounded to an integral schedule that exceeds each machine's budget by at most one job. The rounding theorem and the binary-search framework around it became standard material in approximation algorithms.

Setting

There are nnn jobs and m≥1m\ge 1m≥1 machines. If job jjj is scheduled on machine iii, it takes pijp_{ij}pij​ time units, a positive integer. A schedule σ\sigmaσ assigns every job jjj to one machine σ(j)\sigma(j)σ(j). The load of machine iii is ∑j:σ(j)=ipij\sum_{j:\sigma(j)=i}p_{ij}∑j:σ(j)=i​pij​, the makespan of σ\sigmaσ is the largest load, and OPT\mathrm{OPT}OPT is the minimum makespan over all schedules.

For deadlines d1,…,dmd_1,\dots,d_md1​,…,dm​ and a threshold ttt, let Ji(t)={j:pij≤t}J_i(t)=\{j: p_{ij}\le t\}Ji​(t)={j:pij​≤t} and Mj(t)={i:pij≤t}M_j(t)=\{i : p_{ij}\le t\}Mj​(t)={i:pij​≤t}. The linear program (LP) has variables xij≥0x_{ij}\ge 0xij​≥0 for j∈Ji(t)j\in J_i(t)j∈Ji​(t) and constraints

∑i∈Mj(t)xij=1(j=1,…,n),∑j∈Ji(t)pijxij≤di(i=1,…,m).\sum_{i\in M_j(t)}x_{ij}=1\quad(j=1,\dots,n),\qquad \sum_{j\in J_i(t)}p_{ij}x_{ij}\le d_i\quad(i=1,\dots,m).i∈Mj​(t)∑​xij​=1(j=1,…,n),j∈Ji​(t)∑​pij​xij​≤di​(i=1,…,m).

The integer program (IP) replaces did_idi​ by di+td_i+tdi​+t and requires xij∈{0,1}x_{ij}\in\{0,1\}xij​∈{0,1}. A vertex of (LP) is an extreme point of its feasible polytope. The support graph of a point x~\tilde xx~ is the bipartite graph on machines and jobs with an edge (i,j)(i,j)(i,j) whenever x~ij>0\tilde x_{ij}>0x~ij​>0.

A ρ\rhoρ-relaxed decision procedure answers, for a deadline ddd, either 'no' or a schedule, such that (1) every schedule it returns has makespan at most ρd\rho dρd, and (2) if it answers 'no', no schedule has makespan at most ddd. The binary search of Lemma 1 starts from the greedy schedule (each job on a machine where it runs fastest), whose makespan ttt is an upper bound uuu, with lower bound l=⌈t/m⌉l=\lceil t/m\rceill=⌈t/m⌉, queries the procedure at d=⌊(u+l)/2⌋d=\lfloor(u+l)/2\rfloord=⌊(u+l)/2⌋, moves uuu to ddd on a schedule and lll to d+1d+1d+1 on 'no', and outputs the best schedule found once l=ul=ul=u.

The LP rounding procedure answers, on deadline ddd, by solving (LP) with d1=⋯=dm=t=dd_1=\dots=d_m=t=dd1​=⋯=dm​=t=d: 'no' if it is infeasible, and otherwise a 0-1 solution of (IP) obtained by rounding a vertex x~\tilde xx~ chosen by the LP solver, supported on x~\tilde xx~.

Formalization targets

Goal: Theorem 2

For every LP solver (every rule choosing a vertex of (LP) when it is feasible), an LP rounding procedure DDD exists, and for every such DDD the output σD\sigma_DσD​ of the binary search satisfies

makespan⁡(σD)≤2⋅OPT.\operatorname{makespan}(\sigma_D)\le 2\cdot\mathrm{OPT}.makespan(σD​)≤2⋅OPT.

Milestones

  1. The support graph of every vertex of (LP) is a pseudoforest: every set SSS of machines and TTT of jobs spans at most ∣S∣+∣T∣|S|+|T|∣S∣+∣T∣ edges (§2, p. 4).
  2. In a machine–job pseudoforest, every set of jobs of degree at least 222 can be matched injectively into the machines (§2, pp. 4–5).
  3. A schedule supported on a feasible x~\tilde xx~ with at most one fractional job per machine has loads at most di+td_i+tdi​+t (§2, p. 5).
  4. Theorem 1 (Rounding Theorem): every vertex x~\tilde xx~ of (LP) has a schedule σ\sigmaσ supported on x~\tilde xx~ with
∑j:σ(j)=ipij≤di+t(i=1,…,m).\sum_{j:\sigma(j)=i}p_{ij}\le d_i+t\qquad(i=1,\dots,m).j:σ(j)=i∑​pij​≤di​+t(i=1,…,m).
  1. Lemma 1: for every ρ\rhoρ-relaxed decision procedure, the binary search outputs a schedule of makespan at most ρ⋅OPT\rho\cdot\mathrm{OPT}ρ⋅OPT.
  2. A schedule with makespan at most ddd gives a feasible point of (LP) with di=t=dd_i=t=ddi​=t=d (§3, p. 5).
  3. The LP rounding procedure is 222-relaxed (§3, pp. 5–6).

Significance

Theorem 2 gives a constant-factor approximation for R ∥ Cmax⁡R\,\|\,C_{\max}R∥Cmax​ that does not depend on mmm. The same rounding theorem drives the paper's second algorithm, a (1+ϵ)(1+\epsilon)(1+ϵ)-approximation for a fixed number of machines using polynomial space, and the paper's lower bound shows that no polynomial algorithm achieves a factor below 3/23/23/2 unless P=NP\mathrm{P}=\mathrm{NP}P=NP. The Rounding Theorem, in its later form for generalized assignment by Shmoys and Tardos (1993), is a standard tool for LP-based scheduling and assignment.

The result is proved; it has, to our knowledge, no machine-checked proof. The platform contains Matoušek and Gärtner's textbook version (MatousekLP.Scheduling.lst_two_approximation, Theorem 8.3.4 of Understanding and Using Linear Programming), which uses a different relaxation: one bound minimized parametrically over TTT, optimal solutions with linearly independent columns, and no per-machine deadlines. This mission formalizes the report's own route: deadlines did_idi​, arbitrary vertices, binary search over a relaxed decision procedure. A formal proof would also yield reusable statements about extreme points of transportation-type polytopes and matchings in pseudoforests.

Difficulty

The obvious rounding, putting each job on a machine where x~ij\tilde x_{ij}x~ij​ is largest, can overload a machine by many jobs at once: nothing in feasibility alone prevents many jobs from each placing a small fraction on the same machine. The bound di+td_i+tdi​+t requires that each machine receive at most one job that the vertex treats fractionally, and this fails for general feasible points; it holds only because x~\tilde xx~ is a vertex. The step that carries the weight is therefore a statement about the combinatorial structure of the support of an extreme point, which must be derived from the linear independence of the tight constraints, followed by a matching argument on the resulting graph. Neither step is available in Mathlib in the form needed.

On the algorithmic side, the binary search must be shown to return a schedule within ρ⋅OPT\rho\cdot\mathrm{OPT}ρ⋅OPT although the decision procedure is only approximately correct; the invariants (the lower bound stays below OPT\mathrm{OPT}OPT, the stored schedule stays within ρ\rhoρ times the upper bound) have to be tracked through a recursion.

Formalization scope

  • Machines are Fin m, jobs Fin n, processing times a matrix P : Matrix (Fin m) (Fin n) ℕ with all entries positive in Lemma 1 and Theorem 2 (the paper's model, p. 2). Loads, makespans and optimal schedules are the published MatousekLP.Scheduling.Schedule definitions applied to the real matrix (pij)(p_{ij})(pij​); OPT\mathrm{OPT}OPT is the makespan of a schedule σopt with IsOptimalSchedule.
  • (LP) is modelled on full m×nm\times nm×n real matrices with the entries pij>tp_{ij}>tpij​>t fixed to 000; this polytope is affinely isomorphic to the paper's, so vertices (Mathlib's Set.extremePoints) correspond exactly. Theorem 1 and its steps are stated for real deadlines and real t≥0t\ge 0t≥0, more general than the paper's integers; the paper's proof does not use integrality, and mission 2 of this series needs non-integral ttt.
  • Algorithmic wording not formalized. Theorem 2 states "a 2-approximation algorithm ... that runs in time bounded by a polynomial in the input size"; Lemma 1 speaks of polynomial procedures; Theorem 1 adds "this rounding can be done in polynomial time". Running time, the ellipsoid method and vertex finding are not formalized. What is formalized is the guarantee the proofs establish: the binary search, written as a Lean function, returns a schedule within ρ⋅OPT\rho\cdot\mathrm{OPT}ρ⋅OPT (Lemma 1, for every ρ\rhoρ-relaxed procedure) and within 2⋅OPT2\cdot\mathrm{OPT}2⋅OPT for every LP rounding procedure and every choice of vertex (Theorem 2).
  • Explicit constants: the factor 222 of Theorem 2 and of the 222-relaxed procedure, which comes from di+td_i+tdi​+t with di=t=dd_i=t=ddi​=t=d; the overshoot ttt of Theorem 1; the initial bounds u=u=u= greedy makespan and l=⌈u/m⌉l=\lceil u/m\rceill=⌈u/m⌉ (the paper's t/mt/mt/m, rounded up because OPT\mathrm{OPT}OPT is an integer); the query point ⌊(u+l)/2⌋\lfloor(u+l)/2\rfloor⌊(u+l)/2⌋.
  • The LP solver's choice is quantified over by a vertex selector, returning a vertex when (LP) is feasible and nothing otherwise; one always exists, since the polytope is compact.
  • Trivializing formalization ruled out. "There is a schedule with makespan at most 2⋅OPT2\cdot\mathrm{OPT}2⋅OPT" is trivially witnessed by an optimal schedule; the goal instead bounds the output of the binary search, whose every 'almost' answer must be a rounding of the solver's vertex, supported on it and feasible for (IP).
  • Needed infrastructure: extreme points of polytopes given by linear constraints and their tight-constraint rank characterization; bipartite pseudoforests and Hall-type matchings; well-founded recursion for the search. Proofs of any milestone, and reusable lemmas on extreme points of assignment polytopes, are welcome.

Selected references

  • J. K. Lenstra, D. B. Shmoys, É. Tardos, Approximation algorithms for scheduling unrelated parallel machines, CWI Report OS-R8714, Centre for Mathematics and Computer Science, Amsterdam, 1987 (the source of this mission's statements and numbering); also Proc. 28th IEEE Symposium on Foundations of Computer Science (1987) 217–224
  • J. K. Lenstra, D. B. Shmoys, É. Tardos, Approximation algorithms for scheduling unrelated parallel machines, Mathematical Programming 46 (1990) 259–271, https://doi.org/10.1007/BF01585745
  • E. Davis, J. M. Jaffe, Algorithms for scheduling tasks on unrelated processors, Journal of the ACM 28 (1981) 721–736, https://doi.org/10.1145/322276.322284
  • D. B. Shmoys, É. Tardos, An approximation algorithm for the generalized assignment problem, Mathematical Programming 62 (1993) 461–474, https://doi.org/10.1007/BF01585178
  • J. Matoušek, B. Gärtner, Understanding and Using Linear Programming, Springer, 2007, §8.3, https://doi.org/10.1007/978-3-540-30717-4
11 thms1 active userReviewed
Dynamic ProgrammingNumerical Analysis·Captain: mikedeng1

Modified Policy Iteration Algorithms for Discounted Markov Decision Problems: From Bv₀ ≥ 0, Order-k Iterates Satisfy ‖v* − v_{n+1}‖ ≤ min{λ, λ(1−λᵏ)/(1−λ)‖P_n − P*‖ + λ^{k+1}}‖v_n − v*‖Research Paper

Motivation

Discounted Markov decision problems are solved in practice by two classical schemes. Value iteration (successive approximations) is cheap per step but contracts the error only by the discount factor λ\lambdaλ per step, which is slow when λ\lambdaλ is close to 111. Policy iteration (Howard, 1960) converges in few steps, but each step solves a linear system for the value of the current policy. Puterman and Brumelle (Mathematics of Operations Research, 1979) showed that policy iteration is Newton's method applied to the optimality equation.

Puterman and Shin (Management Science 24, 1978) interpolated between the two schemes: replace the exact policy evaluation by k+1k+1k+1 steps of successive approximation. This is modified policy iteration of order kkk. For k=0k=0k=0 it is value iteration; as k→∞k\to\inftyk→∞ it approaches policy iteration. The paper proves that every order converges and bounds its rate. The scheme remains a standard algorithm in dynamic programming (Puterman, Markov Decision Processes, Wiley 1994, §6.5), and it appears in reinforcement learning as "optimistic" or "generalized" policy iteration.

Timeline. Howard (1960): policy iteration for finite problems. Puterman–Brumelle (1979, circulated earlier): policy iteration as Newton–Kantorovich iteration, and the support inequality for the optimality operator. van Nunen (1976) and van Nunen–Wessels: convergence of related value-oriented methods in a different framework. Puterman–Shin (1978): convergence of modified policy iteration of every order from a starting point with Bv0≥0Bv_0\ge 0Bv0​≥0, and the rate bound formalized here.

Setting

SSS is a set of states with a σ\sigmaσ-algebra. A family P\mathcal PP of policies is given. Each P∈PP\in\mathcal PP∈P is a transition operator: a Markov kernel assigning to each state sss a probability distribution P(s,⋅)P(s,\cdot)P(s,⋅) on SSS. Each policy also has a one-period reward cP:S→Rc_P:S\to\mathbb RcP​:S→R, and the rewards are uniformly bounded: sup⁡Psup⁡s∣cP(s)∣≤M<∞\sup_P\sup_s|c_P(s)|\le M<\inftysupP​sups​∣cP​(s)∣≤M<∞. The discount rate satisfies 0≤λ<10\le\lambda<10≤λ<1.

VVV is the Banach space of bounded measurable functions v:S→Rv:S\to\mathbb Rv:S→R with ∥v∥=sup⁡s∣v(s)∣\|v\|=\sup_s|v(s)|∥v∥=sups​∣v(s)∣. A kernel acts on VVV by (Pv)(s)=∫v(t) P(s,dt)(Pv)(s)=\int v(t)\,P(s,dt)(Pv)(s)=∫v(t)P(s,dt). For linear AAA on VVV, ∥A∥=sup⁡∥x∥≤1∥Ax∥\|A\|=\sup_{\|x\|\le 1}\|Ax\|∥A∥=sup∥x∥≤1​∥Ax∥.

The optimality equation is

Bv≡max⁡P∈P{cP+(λP−I)v}=0.(1)Bv\equiv\max_{P\in\mathcal P}\{c_P+(\lambda P-I)v\}=0. \tag{1}Bv≡P∈Pmax​{cP​+(λP−I)v}=0.(1)

The paper assumes throughout that the maximum in (1) is attained for every v∈Vv\in Vv∈V, by a single policy PvP_vPv​ at every state.

For k≥0k\ge 0k≥0, the truncated Neumann series is APk=∑i=0k(λP)iA^k_P=\sum_{i=0}^k(\lambda P)^iAPk​=∑i=0k​(λP)i. Modified policy iteration of order kkk runs the recursion

vn+1=vn+APnkBvn,(4)v_{n+1}=v_n+A^k_{P_n}Bv_n, \tag{4}vn+1​=vn​+APn​k​Bvn​,(4)

where PnP_nPn​ attains the maximum in (1) at vnv_nvn​. A solution v∗∈Vv^*\in Vv∗∈V of Bv∗=0Bv^*=0Bv∗=0 exists and is unique. P∗=Pv∗P^*=P_{v^*}P∗=Pv∗​ denotes a policy attaining the maximum at v∗v^*v∗. The proofs also use the operators Ukv=max⁡P{∑i=0k(λP)icP+(λP)k+1v}U^kv=\max_P\{\sum_{i=0}^k(\lambda P)^ic_P+(\lambda P)^{k+1}v\}Ukv=maxP​{∑i=0k​(λP)icP​+(λP)k+1v} and the set VB={v∈V:Bv≥0}V_B=\{v\in V:Bv\ge 0\}VB​={v∈V:Bv≥0}.

Formalization targets

Goal: Theorem 2, bound (8)

If v0∈Vv_0\in Vv0​∈V and Bv0≥0Bv_0\ge 0Bv0​≥0, then for every nnn

∥v∗−vn+1∥ ≤ min⁡{λ, λ[1−λk]1−λ ∥Pn−P∗∥+λk+1} ∥vn−v∗∥.(8)\|v^*-v_{n+1}\|\ \le\ \min\Big\{\lambda,\ \frac{\lambda[1-\lambda^k]}{1-\lambda}\,\|P_n-P^*\|+\lambda^{k+1}\Big\}\,\|v_n-v^*\|. \tag{8}∥v∗−vn+1​∥ ≤ min{λ, 1−λλ[1−λk]​∥Pn​−P∗∥+λk+1}∥vn​−v∗∥.(8)

Milestones

  1. The support inequality (7): Bw≥Bv+(λPv−I)(w−v)Bw\ge Bv+(\lambda P_v-I)(w-v)Bw≥Bv+(λPv​−I)(w−v) for all v,w∈Vv,w\in Vv,w∈V.
  2. Lemma 1: UkU^kUk is a contraction with constant λk+1\lambda^{k+1}λk+1.
  3. Lemma 2: UkU^kUk-iteration converges geometrically to the unique fixed point of UkU^kUk, and this fixed point solves Bu=0Bu=0Bu=0.
  4. Lemma 3: Uku≥(I+AkB)vU^ku\ge(I+A^kB)vUku≥(I+AkB)v for u≥vu\ge vu≥v, and (I+AkB)u≥U0v(I+A^kB)u\ge U^0v(I+AkB)u≥U0v if in addition Bu≥0Bu\ge 0Bu≥0.
  5. Lemma 4: VBV_BVB​ is invariant under I+AkBI+A^kBI+AkB.
  6. Theorem 1: from Bv0≥0Bv_0\ge 0Bv0​≥0, {vn}\{v_n\}{vn​} converges monotonically and in norm to v∗v^*v∗.
  7. Corollary 1: (U0)nv0≤vn≤(Uk)nv0(U^0)^nv_0\le v_n\le (U^k)^nv_0(U0)nv0​≤vn​≤(Uk)nv0​.
  8. The two halves of (8): inequality (9), ∥v∗−vn+1∥≤(λ[1−λk]1−λ∥Pn−P∗∥+λk+1)∥v∗−vn∥\|v^*-v_{n+1}\|\le(\tfrac{\lambda[1-\lambda^k]}{1-\lambda}\|P_n-P^*\|+\lambda^{k+1})\|v^*-v_n\|∥v∗−vn+1​∥≤(1−λλ[1−λk]​∥Pn​−P∗∥+λk+1)∥v∗−vn​∥, and ∥v∗−vn+1∥≤λ∥v∗−vn∥\|v^*-v_{n+1}\|\le\lambda\|v^*-v_n\|∥v∗−vn+1​∥≤λ∥v∗−vn​∥.

The mission also contains four further theorems that are not milestones: Corollary 2 (asymptotic rate at most λk+1\lambda^{k+1}λk+1 when ∥Pn−P∗∥→0\|P_n-P^*\|\to 0∥Pn​−P∗∥→0), Proposition 2 (monotonicity in the order kkk), the representation (6) vn+1=Tnk+1vnv_{n+1}=T_n^{k+1}v_nvn+1​=Tnk+1​vn​, and Proposition 1 (policy iteration as Newton's method).

Significance

The result. Bound (8) gives two guarantees. Every order of modified policy iteration converges at least as fast as value iteration, with factor λ\lambdaλ per step. Once the improving policies stabilize near an optimal one, the factor approaches λk+1\lambda^{k+1}λk+1, the factor of k+1k+1k+1 value-iteration steps. This justifies spending kkk cheap evaluation sweeps per policy improvement instead of solving a linear system. It also underlies the analysis of the many later variants: action elimination, asynchronous and approximate versions, and optimistic policy iteration in reinforcement learning.

Formalizing it. The theorems are proved on paper. As far as the platform's library shows, none of them is machine-checked: existing items cover value iteration and exact policy iteration for finite state spaces. This mission formalizes the whole chain on general measurable state spaces with Markov kernels, including the support inequality and the comparison operators UkU^kUk. Corollary 2 is stated as an upper bound only, because the equality printed on the page fails in degenerate runs (see the item's note).

Difficulty

The obvious route to a rate is the contraction argument for value iteration: U0U^0U0 is monotone and a λ\lambdaλ-contraction, so its iterates converge geometrically. For k≥1k\ge1k≥1 that argument does not transfer to the map vn↦vn+APnkBvnv_n\mapsto v_n+A^k_{P_n}Bv_nvn​↦vn​+APn​k​Bvn​. The truncated series is taken for the policy chosen at the current point, so the map changes with vnv_nvn​, and it is not monotone in general. The van der Wal–van Nunen example on p. 1133 of the paper shows that iterates of a higher order need not dominate those of a lower order from the same start. Moreover, without the condition Bv0≥0Bv_0\ge0Bv0​≥0 the iterates need not even increase. A rate for (4) is therefore not a corollary of a fixed-point theorem for a single operator.

Formally, a second layer of difficulty is the setting itself. Everything happens in the space of bounded measurable functions on a general measurable space. So every operator applied to an iterate must be shown to preserve boundedness and measurability, and the maxima over policies are suprema over an arbitrary index set.

Formalization scope

The Lean development (namespace ModPolicyIter.Conv) represents:

  • the policies as an index type ι\iotaι, policy iii being a Markov kernel P i : Kernel S S with a measurable reward c i, ∣ci∣≤M|c_i|\le M∣ci​∣≤M;
  • VVV by the predicate IsBM (measurable and bounded), with supNorm v = ⨆ s, |v s|;
  • PivP_ivPi​v as the Bochner integral against Pi(s,⋅)P_i(s,\cdot)Pi​(s,⋅);
  • BBB and UkU^kUk as pointwise real suprema over ι\iotaι;
  • ∥Pi−Pj∥\|P_i-P_j\|∥Pi​−Pj​∥ as the supremum of ∥(Pi−Pj)x∥\|(P_i-P_j)x\|∥(Pi​−Pj​)x∥ over the unit ball of VVV.

The standing assumptions of §2 are carried by the model fields; items using a maximizer assume either global attainment (MaxAttained) or an explicit maximizing policy. A run of (4) is a sequence of functions paired with a sequence of policies, each policy a maximizer at the current iterate. Only v0∈Vv_0\in Vv0​∈V is assumed; that later iterates lie in VVV is part of the proofs.

Deviations from the page, all disclosed in the items:

  1. Theorem 2 and its companions assume Bv0≥0Bv_0\ge0Bv0​≥0, the hypothesis of Theorem 1, which the proof of Theorem 2 invokes.
  2. Lemmas 1–2 and Corollary 1 assume that UkU^kUk maps VVV into VVV. This is implicit on the page, and for k=0k=0k=0 it follows from attainment. Lemma 1 states this mapping property alongside the contraction inequality.
  3. The paper's P=∏sPs\mathcal P=\prod_s\mathcal P_sP=∏s​Ps​ is generalized to an arbitrary index set.
  4. Corollary 2 is stated as an upper bound.

The goal must not be trivialized by assuming vn≤v∗v_n\le v^*vn​≤v∗, the support inequality, the sandwich of Corollary 1, or anything about UkU^kUk. These are milestones to be proved, and none of them is a hypothesis of the goal.

Reusable infrastructure includes Markov kernels as operators on bounded measurable functions (positivity, ∥P∥≤1\|P\|\le1∥P∥≤1, measurability of PvPvPv), completeness of VVV, and the Banach fixed point theorem on VVV. The first of these serves any discounted dynamic-programming mission on general state spaces. Contributions of any milestone, or of helper lemmas about these operators, are welcome.

Selected references

  • M. L. Puterman and M. C. Shin, Modified policy iteration algorithms for discounted Markov decision problems, Management Science 24(11):1127–1137, 1978. https://doi.org/10.1287/mnsc.24.11.1127
  • M. L. Puterman and S. L. Brumelle, On the convergence of policy iteration in stationary dynamic programming, Mathematics of Operations Research 4(1):60–69, 1979. https://doi.org/10.1287/moor.4.1.60
  • R. A. Howard, Dynamic Programming and Markov Processes, MIT Press, 1960.
  • J. A. E. E. van Nunen, A set of successive approximation methods for discounted Markovian decision problems, Zeitschrift für Operations Research 20:203–208, 1976.
  • M. L. Puterman, Markov Decision Processes: Discrete Stochastic Dynamic Programming, Wiley, 1994. https://doi.org/10.1002/9780470316887
12 thms1 active userReviewed
Calculus of VariationsMechanism Design·Captain: mikedeng1

Monopoly and Product Quality: The Monopolist Sells Every Type Served Under Competition a Strictly Lower Quality, Except the Top TypeResearch Paper

Motivation

A firm that sells a product line of different qualities cannot see how much each customer values quality. It can only post a price for every quality and let customers choose. Mussa and Rosen's 1978 paper solves the monopolist's problem in this setting and compares the result with the competitive outcome. Their model is, together with Mirrlees' optimal income tax and Maskin and Riley's later treatment of nonlinear pricing, one of the founding examples of screening: the seller designs a menu so that customers sort themselves. The model's main qualitative prediction, that a monopolist degrades the quality sold to every customer except the one who values quality most, is the origin of the phrase "no distortion at the top". Textbooks on contract theory and mechanism design still teach it in this form.

Timeline. Mussa and Rosen (1978) give the first-order analysis, including "bunching" of customers at a common quality when marginal revenue is not monotone. Maskin and Riley (1984) treat the same problem for nonlinear quantity pricing. Myerson (1981) introduced the "ironing" procedure for non-monotone virtual valuations in auction design, which later became the standard way of describing the bunching conditions of this paper.

Setting

Consumer types are numbers θ∈[θ‾,θˉ]\theta\in[\underline\theta,\bar\theta]θ∈[θ​,θˉ] with 0≤θ‾<θˉ0\le\underline\theta<\bar\theta0≤θ​<θˉ, distributed with a density fff that is positive and differentiable on the whole interval; F(θ)=∫θ‾θf(s) dsF(\theta)=\int_{\underline\theta}^{\theta}f(s)\,dsF(θ)=∫θ​θ​f(s)ds. A consumer of type θ\thetaθ buys at most one unit, and from quality qqq at price ppp gets utility θq−p\theta q-pθq−p. Producing one unit of quality q≥0q\ge0q≥0 costs C(q)C(q)C(q), where C(0)=0C(0)=0C(0)=0, CCC is twice differentiable, and C′(q)>0C'(q)>0C′(q)>0, C′′(q)>0C''(q)>0C′′(q)>0 for q≥0q\ge0q≥0.

Under competition, price equals unit cost and type θ\thetaθ buys the quality J(θ)J(\theta)J(θ) with C′(J(θ))=θC'(J(\theta))=\thetaC′(J(θ))=θ, or nothing when θ≤C′(0)\theta\le C'(0)θ≤C′(0).

The monopolist chooses an assignment q(θ)q(\theta)q(θ), the quality bought by type θ\thetaθ. It must be nondecreasing, nonnegative and piecewise differentiable on [θ‾,θˉ][\underline\theta,\bar\theta][θ​,θˉ]; such assignments are called admissible. Incentive compatibility and participation fix the consumer surplus at z(θ)=∫θ‾θq(s) dsz(\theta)=\int_{\underline\theta}^{\theta}q(s)\,dsz(θ)=∫θ​θ​q(s)ds, so the monopolist maximizes

Π(q)=∫θ‾θˉ[θ q(θ)−z(θ)−C(q(θ))]f(θ) dθ.\Pi(q)=\int_{\underline\theta}^{\bar\theta}\bigl[\theta\,q(\theta)-z(\theta)-C(q(\theta))\bigr]f(\theta)\,d\theta .Π(q)=∫θ​θˉ​[θq(θ)−z(θ)−C(q(θ))]f(θ)dθ.

An assignment is optimal if it is admissible and maximizes Π\PiΠ among admissible assignments. The marginal revenue of quality sold to type θ\thetaθ is

MR(θ)=θ−1−F(θ)f(θ).MR(\theta)=\theta-\frac{1-F(\theta)}{f(\theta)} .MR(θ)=θ−f(θ)1−F(θ)​.

The paper's analysis runs through the marginal profit of a uniform quality increase for all types θ≥t\theta\ge tθ≥t,

μ(t)=∫tθˉ[θ−∫tθds−C′(q(θ))]f(θ) dθ.\mu(t)=\int_t^{\bar\theta}\Bigl[\theta-\int_t^\theta ds-C'(q(\theta))\Bigr]f(\theta)\,d\theta .μ(t)=∫tθˉ​[θ−∫tθ​ds−C′(q(θ))]f(θ)dθ.

Formalization targets

Goal: quality distortion below the top

For every optimal assignment qqq:

C′(q(θ))<θfor θ‾≤θ<θˉ, θ>C′(0);q(θ)=0for θ‾≤θ<θˉ, θ≤C′(0);C'(q(\theta))<\theta\quad\text{for }\underline\theta\le\theta<\bar\theta,\ \theta>C'(0);\qquad q(\theta)=0\quad\text{for }\underline\theta\le\theta<\bar\theta,\ \theta\le C'(0);C′(q(θ))<θfor θ​≤θ<θˉ, θ>C′(0);q(θ)=0for θ​≤θ<θˉ, θ≤C′(0);

and, if C′(0)<θˉC'(0)<\bar\thetaC′(0)<θˉ, the limit L=lim⁡θ↑θˉq(θ)L=\lim_{\theta\uparrow\bar\theta}q(\theta)L=limθ↑θˉ​q(θ) exists and satisfies C′(L)=θˉC'(L)=\bar\thetaC′(L)=θˉ (if θˉ≤C′(0)\bar\theta\le C'(0)θˉ≤C′(0), then q(θ)→0q(\theta)\to0q(θ)→0). In words: qm(θ)<J(θ)q^m(\theta)<J(\theta)qm(θ)<J(θ) for every type below the top that buys under competition, types that do not buy under competition do not buy from the monopolist, and qm(θˉ)=J(θˉ)q^m(\bar\theta)=J(\bar\theta)qm(θˉ)=J(θˉ).

Milestones

The paper's own chain of claims, in order: MR(θ)<θMR(\theta)<\thetaMR(θ)<θ except at θˉ\bar\thetaθˉ (p. 308); the first-order condition (9), Λ(h;q)≤0\Lambda(h;q)\le0Λ(h;q)≤0 for every admissible deformation; the identity (10) = (12), μ(t)=∫tθˉ[MR−C′(q)]f\mu(t)=\int_t^{\bar\theta}[MR-C'(q)]fμ(t)=∫tθˉ​[MR−C′(q)]f; condition (13), μ≤0\mu\le0μ≤0; condition (15), μ=0\mu=0μ=0 where q˙>0\dot q>0q˙​>0; μ=0\mu=0μ=0 at a jump; the absence of jumps; (17), C′(q)=MRC'(q)=MRC′(q)=MR where q˙>0\dot q>0q˙​>0; the bunching conditions (18)–(19); and the absence of a bunch at the top. Companion items state the two-type case of footnote 4, the uniform–quadratic example of §5, and the loss of consumer surplus (§6, "Second").

Significance

The result. The goal says how the monopolist differs from competition: it lowers every quality except the top one, and it never serves a type that competition leaves out. The distortion comes from the gap θ−MR(θ)=(1−F(θ))/f(θ)>0\theta-MR(\theta)=(1-F(\theta))/f(\theta)>0θ−MR(θ)=(1−F(θ))/f(θ)>0, which closes only at θˉ\bar\thetaθˉ. The same comparison underlies results on second-degree price discrimination, regulation of product lines, and versioning of information goods. The bunching conditions (18)–(19) are an early statement of what is now called ironing.

Formalizing it. The result has been proved since 1978 in the economic literature, under the paper's smoothness assumptions and by a variational argument. As far as is known, it has not been machine-checked: no formal library contains the monopoly quality problem, its first-order conditions or the bunching conditions. The mission produces a checked version with the hypotheses made explicit, including the conventions at the endpoints that the paper leaves implicit. The uniform–quadratic example gives a concrete optimum that certifies the hypotheses are satisfiable.

Difficulty

The obvious argument sets C′(q(θ))=MR(θ)C'(q(\theta))=MR(\theta)C′(q(θ))=MR(θ) pointwise and compares with C′(J(θ))=θC'(J(\theta))=\thetaC′(J(θ))=θ. This fails when MRMRMR is not increasing: the pointwise solution is then decreasing somewhere and not admissible. The optimal assignment is constant on some intervals, and on such a bunch C′(q)≠MRC'(q)\ne MRC′(q)=MR pointwise. The comparison with JJJ there needs the boundary conditions (18)–(19) and the fact that no bunch reaches θˉ\bar\thetaθˉ. All of these come from one-sided deformations that respect monotonicity, so the first-order conditions are inequalities and need a separate argument for equality. The paper also asserts without a separate step that optimal assignments have no jumps, and later steps use continuity.

Formalization scope

Types and assignments are real functions on R\mathbb RR; only their values on [θ‾,θˉ][\underline\theta,\bar\theta][θ​,θˉ] matter. The type distribution and MRMRMR are the published MechanismDesign.Screening.TypeDistribution and virtualValuation. The standing assumptions are hypotheses of every main statement: fff is differentiable on [θ‾,θˉ][\underline\theta,\bar\theta][θ​,θˉ] (positivity and total mass 1 are part of the distribution), C(0)=0C(0)=0C(0)=0, CCC and C′C'C′ are differentiable on R\mathbb RR, and C′>0C'>0C′>0, C′′>0C''>0C′′>0 on [0,∞)[0,\infty)[0,∞). C(0)=0C(0)=0C(0)=0 is an added normalization: quality 0 means not buying. "Piecewise differentiable" means differentiable on (θ‾,θˉ)(\underline\theta,\bar\theta)(θ​,θˉ) outside a finite set. The competitive assignment J=C′−1J=C'^{-1}J=C′−1 is never formed; every comparison with JJJ is written through C′C'C′. Admissible deformations hhh in (9) are required to keep q+h≥0q+h\ge0q+h≥0.

The value q(θˉ)q(\bar\theta)q(θˉ) does not affect Π\PiΠ, so a statement about q(θˉ)q(\bar\theta)q(θˉ) itself would be false; the top-type claim is stated as a left limit. Optimality ranges over admissible assignments only. Any reading under which no optimal assignment exists makes the goal vacuous; the §5 companion rules this out, since its optimal assignment has a kink and uses the same notion of optimality.

Needed infrastructure: interval integrals of monotone functions, first variations under monotonicity constraints, and fundamental-theorem-of-calculus arguments for FFF. The incentive-compatibility reduction (monotonicity and the envelope formula) is not posed here, because it is posed on the platform in Börgers' screening chapter. Related platform item: Börgers' Proposition 2.6 (MechanismDesign.Screening.nonlinear_pricing_optimal) treats a linear-cost, concave-valuation model under regularity, which is a different statement. Contributions to any milestone, and reusable lemmas about monotone deformations, are welcome.

Selected references

  • M. Mussa and S. Rosen, Monopoly and product quality, Journal of Economic Theory 18 (1978), 301–317. https://doi.org/10.1016/0022-0531(78)90085-6
  • E. Maskin and J. Riley, Monopoly with incomplete information, RAND Journal of Economics 15 (1984), 171–196. https://doi.org/10.2307/2555674
  • R. B. Myerson, Optimal auction design, Mathematics of Operations Research 6 (1981), 58–73. https://doi.org/10.1287/moor.6.1.58
  • J. A. Mirrlees, An exploration in the theory of optimum income taxation, Review of Economic Studies 38 (1971), 175–208. https://doi.org/10.2307/2296779
  • T. Börgers, An Introduction to the Theory of Mechanism Design, Oxford University Press, 2015, Chapter 2. https://doi.org/10.1093/acprof:oso/9780199734023.001.0001
14 thms1 active userReviewed
CombinatoricsOptimization·Captain: mikedeng1

Efficient Algorithms for Scheduling Semiconductor Burn-In Operations 4: Batch List Scheduling Is Within B + 1 − 1/m of the Optimal Makespan and Has a Bounded Relative Maximum-Lateness ErrorResearch Paper

Motivation

Semiconductor burn-in ovens can process several jobs at once. A group placed in one oven must remain together until the longest job has finished, so increasing batch size saves oven starts but can delay short jobs. When several ovens are available, a scheduler also has to decide which oven receives each batch. Lee, Uzsoy, and Martin-Vega studied this setting and gave guarantees for a simple rule that first groups an arbitrary job list into batches and then sends those batches to the next available oven (Lee, Uzsoy & Martin-Vega 1992, §§2 and 5). Their bounds give a way to assess this easily specified rule against the best possible schedule, even when finding that schedule is difficult.

The paper treats both makespan, the time when all jobs have finished, and maximum lateness, the largest difference between a job's completion time and its due date. These objectives respond differently to batching. The makespan ignores which particular job finishes late; maximum lateness depends on each job's due date. Proposition 4 relates the lateness guarantee to the makespan guarantee of Proposition 1, making the two results a natural formalization unit (Lee, Uzsoy & Martin-Vega 1992, pp. 772–773).

Setting

There are n>0n>0n>0 jobs, indexed by jjj, with processing times pj>0p_j>0pj​>0 and due dates dj≥0d_j\ge0dj​≥0. All jobs are available at time zero. There are m>0m>0m>0 identical batch machines, each able to process at most B>0B>0B>0 jobs at once. A batch cannot be interrupted or enlarged after it begins, and its processing time is the largest pjp_jpj​ among its members. A schedule partitions the jobs into nonempty batches, chooses a machine for each batch, and orders the batches on each machine. Batches assigned to a machine run one after another from time zero. Every job in a batch finishes when that batch finishes (Lee, Uzsoy & Martin-Vega 1992, p. 766).

For a set of jobs JJJ, write Cmax⁡∗(J)C_{\max}^*(J)Cmax∗​(J) for the least makespan over all valid batchings and machine assignments. Write L∗(J)L^*(J)L∗(J) for the least possible value of max⁡j∈J(Cj−dj)\max_{j\in J}(C_j-d_j)maxj∈J​(Cj​−dj​), where CjC_jCj​ is job jjj's completion time. For the full job set, abbreviate these by Cmax⁡∗C_{\max}^*Cmax∗​ and L∗L^*L∗. The maximum due date over all jobs is dmax⁡=max⁡jdjd_{\max}=\max_jd_jdmax​=maxj​dj​.

Batch list scheduling (BLS) begins with any ordering of the jobs. It divides successive entries into full batches of BBB jobs, apart from a possibly smaller final batch. It then assigns each next batch to a machine that becomes available first. Denote the resulting makespan by Cmax⁡BLSC_{\max}^{\mathrm{BLS}}CmaxBLS​ and its maximum lateness by LLL. The guarantee applies to every initial list; it does not require an earliest-due-date or longest-processing-time order (Lee, Uzsoy & Martin-Vega 1992, p. 771, Algorithm BLS).

Formalization targets

Makespan guarantee

Proposition 1 asserts, for every BLS list,

Cmax⁡BLS≤(B+1−1m)Cmax⁡∗.C_{\max}^{\mathrm{BLS}}\le\left(B+1-\frac1m\right)C_{\max}^*.CmaxBLS​≤(B+1−m1​)Cmax∗​.

The milestone list includes the paper's processing-volume lower bound, ∑jpj/(mB)≤Cmax⁡∗\sum_jp_j/(mB)\le C_{\max}^*∑j​pj​/(mB)≤Cmax∗​, and Proposition 1 itself. The latter is stated for arbitrary job subsets as well as the full instance, because the paper applies it to a prefix sub-instance in the proof of Proposition 4 (Lee, Uzsoy & Martin-Vega 1992, p. 772).

Relative maximum-lateness guarantee

The mission's goal is the printed ratio of Proposition 4:

L−L∗L∗+dmax⁡≤B−1m+dmax⁡L∗+dmax⁡.\frac{L-L^*}{L^*+d_{\max}} \le B-\frac1m+\frac{d_{\max}}{L^*+d_{\max}}.L∗+dmax​L−L∗​≤B−m1​+L∗+dmax​dmax​​.

The denominator is positive under the stated conditions, even if the optimal maximum lateness is negative. The remaining milestones record the paper's lower bound L∗(J)≥Cmax⁡∗(J)−dmax⁡L^*(J)\ge C_{\max}^*(J)-d_{\max}L∗(J)≥Cmax∗​(J)−dmax​ for a nonempty sub-instance and its reduction from the full instance to the BLS prefix containing a maximum-lateness job (Lee, Uzsoy & Martin-Vega 1992, p. 773).

Significance

The makespan result controls the cost of using an arbitrary initial list and simple next-available-machine assignments instead of optimizing both the batching and machine allocation. At B=1B=1B=1, its factor becomes 2−1/m2-1/m2−1/m, the ordinary list-scheduling factor noted by the authors. Proposition 4 gives a corresponding bound for maximum lateness, normalized in a way that remains meaningful when L∗<0L^*<0L∗<0 (Lee, Uzsoy & Martin-Vega 1992, pp. 772–773).

These are proved results in the 1992 paper. The formalization work is to give their batch model, sub-instance optima, and the printed inequalities machine-checked statements and eventually proofs. The imported library already has definitions of least-loaded list scheduling and optimal assignment makespan for ordinary items on identical machines. This mission adds the batch layer, its lateness objective, and the comparison between the batch algorithm and unrestricted batch schedules. The Lean declarations here compile as open theorem targets; this proposal does not claim completed machine-checked proofs.

Difficulty

The processing time of a batch is a maximum, while its contribution to the volume of jobs is a sum. Treating each batch as an ordinary job gives a list-scheduling instance, but it does not by itself compare that instance's optimum with the optimum over all ways to form batches. That gap is central to the makespan bound. The lateness goal has a second obstacle: the job that determines the BLS maximum lateness may sit in a batch that is not the last to finish, and due dates prevent a direct substitution of a makespan bound for a lateness bound. Moreover, L∗L^*L∗ may be negative, so dividing by it would not give a valid relative error. The stated normalization and its positivity require explicit attention (Lee, Uzsoy & Martin-Vega 1992, proof of Proposition 4).

Formalization scope

Jobs are Fin n and machines are Fin m; the paper's first job is Lean index zero. Processing times and due dates are real numbers. The paper's integer-data convention is sufficient for these inequalities but is not needed for their statements. Processing times are positive, all jobs are available at time zero, and the lateness goal requires nonnegative due dates. This last condition makes explicit what the paper's final inequality uses: allowing negative due dates makes Proposition 4 false. The full job set is nonempty. Prefix jobs are the first batches of the given arbitrary list, and the optimal values for a prefix range over every valid batching and assignment of those jobs.

The BLS implementation chunks the list into full batches and a final remainder. A batch is sent to a least-loaded machine, which is the first machine to become free when no idle time is inserted. The published list-scheduling definitions of NumStochOpt.ListScheduling supply this rule and the ordinary assignment optimum. They select the lowest machine index on a tie; identical-machine labels do not affect the resulting completion times. Machine schedules are represented by an ordered batch list and an assignment, with each machine processing its own batches back to back. No bound is obtained by defining the optimum over BLS-shaped consecutive batches, and no theorem fixes a favorable job list.

The mission covers correctness inequalities, not the paper's running-time claims or its later BLPT rule. Useful contributions include proofs of the four milestones, finite-schedule facts showing the optima are attained, and reusable links between batch completion times and least-loaded list scheduling. The parallel batch model can also support other objectives and scheduling rules.

Selected references

  • C.-Y. Lee, R. Uzsoy, and L. A. Martin-Vega, Efficient Algorithms for Scheduling Semiconductor Burn-In Operations, Operations Research 40(4), 764–775, 1992. DOI: 10.1287/opre.40.4.764.
8 thms1 active userReviewed
Dynamic ProgrammingOptimization·Captain: mikedeng1

Efficient Algorithms for Scheduling Semiconductor Burn-In Operations 1: Dynamic Program DP1 Finds a Minimum-Makespan On-Time Batch Schedule of Equal-Length Jobs with Agreeable Release and Due DatesResearch Paper

Motivation

Burn-in is the final testing stage of semiconductor manufacturing: finished integrated circuits are loaded on boards and held in an oven at high temperature for a prescribed minimum time, so that weak devices fail before shipment. An oven holds many boards at once, a load cannot be interrupted, and a board may stay in the oven longer than its specified time but never shorter. Because burn-in times are long compared to the other test operations, the ovens are frequently the bottleneck of the test facility, and the order in which lots enter them determines whether customer due dates are met.

Lee, Uzsoy and Martin-Vega (Operations Research 40(4), 1992) modelled an oven as a batch processing machine and gave polynomial algorithms for several due-date objectives. This mission covers the first of them: one machine, jobs with release times and a common processing time, and the question whether every job can be completed by its due date. Ikura and Gimple (Operations Research Letters 5(2), 1986) had already given an O(n2)O(n^2)O(n2) algorithm for this feasibility question when release times and due dates are agreeable; the paper replaces it by a simpler dynamic program, DP1, and uses DP1 with a bisection search to minimize the maximum tardiness.

Setting

There are nnn jobs, indexed 1,…,n1, \dots, n1,…,n. Job iii has a release time rir_iri​ (it cannot be processed earlier), a due date did_idi​, and the common processing time ppp; all data are natural numbers. One machine processes up to B≥1B \ge 1B≥1 jobs simultaneously.

A batch schedule of a set JJJ of jobs is a sequence of batches P1,…,PmP_1, \dots, P_mP1​,…,Pm​: nonempty, pairwise disjoint sets of at most BBB jobs whose union is JJJ, processed in this order. A batch cannot be interrupted, and no job joins it once it has started. It starts as soon as the previous batch is finished and all its jobs are released, and it takes time ppp:

C(Pk)=max⁡{r(Pk), C(Pk−1)}+p,r(P)=max⁡{ri:i∈P},C(P0)=0.C(P_k) = \max\{r(P_k),\, C(P_{k-1})\} + p,\qquad r(P) = \max\{r_i : i \in P\},\qquad C(P_0) = 0 .C(Pk​)=max{r(Pk​),C(Pk−1​)}+p,r(P)=max{ri​:i∈P},C(P0​)=0.

Job iii completes at Ci=C(Pk)C_i = C(P_k)Ci​=C(Pk​) for the batch Pk∋iP_k \ni iPk​∋i; the makespan is Cmax⁡=C(Pm)C_{\max} = C(P_m)Cmax​=C(Pm​). A schedule is feasible (has Tmax⁡=0T_{\max} = 0Tmax​=0) if Ci≤diC_i \le d_iCi​≤di​ for every job, and its maximum tardiness is Tmax⁡=max⁡imax⁡{0,Ci−di}T_{\max} = \max_i \max\{0, C_i - d_i\}Tmax​=maxi​max{0,Ci​−di​}.

Release times and due dates are agreeable if ri<rjr_i < r_jri​<rj​ implies di≤djd_i \le d_jdi​≤dj​. A schedule is in batch-EDD order if no job of an earlier batch has a larger due date than a job of a later batch.

Algorithm DP1. With the jobs indexed in nondecreasing order of due dates, let f(0)=0f(0) = 0f(0)=0 and, for j≥1j \ge 1j≥1,

f(j)=min⁡max⁡{1, j−B+1}≤i≤jfi(j),fi(j)={max⁡{f(i−1),rj}+pif max⁡{f(i−1),rj}+p≤di,∞otherwise.f(j) = \min_{\max\{1,\,j-B+1\} \le i \le j} f_i(j),\qquad f_i(j) = \begin{cases} \max\{f(i-1), r_j\} + p & \text{if } \max\{f(i-1), r_j\} + p \le d_i,\\ \infty & \text{otherwise.}\end{cases}f(j)=max{1,j−B+1}≤i≤jmin​fi​(j),fi​(j)={max{f(i−1),rj​}+p∞​if max{f(i−1),rj​}+p≤di​,otherwise.​

Formalization targets

Goal: correctness of DP1

For an index order nondecreasing in both ddd and rrr, and every 0≤j≤n0 \le j \le n0≤j≤n,

f(j)=min⁡{ Cmax⁡(S):S a feasible batch schedule of jobs 1,…,j },min⁡∅=∞.f(j) = \min\{\, C_{\max}(S) : S \text{ a feasible batch schedule of jobs } 1,\dots,j \,\},\qquad \min\emptyset = \infty .f(j)=min{Cmax​(S):S a feasible batch schedule of jobs 1,…,j},min∅=∞.

The minimum ranges over all batch schedules of the prefix: every batching and every batch order. The case j=nj = nj=n is the paper's statement that DP1 "will find a feasible schedule with minimum makespan if a feasible schedule exists" (p. 768).

Milestones

  1. Lemma 1 (p. 767): if a feasible schedule exists, a feasible schedule in batch-EDD order exists.
  2. Justification of DP1 (p. 768): every feasible schedule of jobs 1,…,j1, \dots, j1,…,j can be replaced by a feasible schedule whose batches are blocks of at most BBB consecutively indexed jobs, in increasing index order, with no larger makespan, so the problem "becomes a consecutive partition problem".
  3. Lemma 2 (p. 769): under rj+p≤djr_j + p \le d_jrj​+p≤dj​ for all jjj, some schedule has Tmax⁡≤(n−1)pT_{\max} \le (n-1)pTmax​≤(n−1)p.

Significance

DP1 decides feasibility of 1/ri,pi=p,B/Tmax⁡1/r_i, p_i = p, B/T_{\max}1/ri​,pi​=p,B/Tmax​ and, when the instance is feasible, returns the minimum makespan of an on-time schedule. Applied to due dates augmented by a trial value TTT, it decides whether Tmax⁡≤TT_{\max} \le TTmax​≤T is achievable, which together with the bound of Lemma 2 gives the paper's polynomial procedure for minimizing Tmax⁡T_{\max}Tmax​. The consecutive-partition structure behind it recurs in the paper's later dynamic programs (DP2 for agreeable processing times and due dates, DP3 for the number of tardy jobs), and in much of the later literature on batch scheduling with release dates.

The results are proved in the paper; none of them has a machine-checked proof. The mission formalizes the known proofs. Its formal statements also make explicit two assumptions that the printed text leaves loose: the tie-break of the index order, without which DP1 returns a wrong value, and the hypothesis rj+p≤djr_j + p \le d_jrj​+p≤dj​ of Lemma 2, without which the lemma is false.

Difficulty

The obvious argument for the goal is "by Lemma 1 the batches are consecutive, and DP1 enumerates consecutive partitions". Lemma 1 orders the batches by due dates, but it does not make the batches intervals of the index order: jobs with equal due dates may still be split across batches in an order that is not the index order, and when equal due dates are indexed against the release order DP1's value max⁡{f(i−1),rj}+p\max\{f(i-1), r_j\} + pmax{f(i−1),rj​}+p underestimates the start of the batch {i,…,j}\{i, \dots, j\}{i,…,j}. The step from batch-EDD order to consecutive batches, and the fact that the exchange never increases the makespan, are the content of the justification milestone. The goal also asserts two directions at once: that the DP value is attained by some feasible schedule, and that no feasible schedule, consecutive or not, finishes earlier.

Formalization scope

Jobs are Fin n, 0-based (the paper's job iii is i - 1); a prefix "jobs 1,…,j1, \dots, j1,…,j" is a prefix length j≤nj \le nj≤n. Data are natural numbers, as the paper assumes ("all data to be integers", p. 769). A batch schedule is a List (Finset (Fin n)); schedules are semi-active, starting every batch as early as possible, which loses nothing for the regular objectives here. DP1 is a def written as printed, with values in ℕ∞ and ∞=⊤\infty = \top∞=⊤; the minimum in the goal is an infimum in ℕ∞ over all valid feasible schedules, so its value on an infeasible prefix is ⊤\top⊤.

Explicit readings of loose phrases:

  • "Jobs are indexed in increasing order of due dates" (p. 767): the index order is nondecreasing in both ddd and rrr. Such an order exists for agreeable data (sort by (d,r)(d, r)(d,r)), and it implies agreeability. With ties in ddd ordered against rrr the goal is false: B=2B = 2B=2, p=1p = 1p=1, d=(2,2)d = (2, 2)d=(2,2), r=(1,0)r = (1, 0)r=(1,0) gives f(2)=1f(2) = 1f(2)=1, while every schedule finishes at time 222.
  • "Agreeable" is printed as "ri≤rjr_i \le r_jri​≤rj​ implies di≤djd_i \le d_jdi​≤dj​"; the strict form ri<rj⇒di≤djr_i < r_j \Rightarrow d_i \le d_jri​<rj​⇒di​≤dj​ is used, a weaker hypothesis.
  • "A solution with Tmax⁡=0T_{\max} = 0Tmax​=0" is a batch schedule in which every job is on time.
  • "(n−1)p(n - 1)p(n−1)p is an upper bound on the value of Tmax⁡T_{\max}Tmax​" (Lemma 2) is read as a bound on the optimal Tmax⁡T_{\max}Tmax​, with the hypothesis rj+p≤djr_j + p \le d_jrj​+p≤dj​ that its proof invokes ("by assumption rj+p<djr_j + p < d_jrj​+p<dj​"), in the weak form.
  • "If f(j)≤djf(j) \le d_jf(j)≤dj​, then it is possible to schedule jobs 1,…,j1, \dots, j1,…,j so that none are tardy" is not formalized separately; it is subsumed by the goal.

Not formalized: the O(nB)O(nB)O(nB) running time of DP1, Algorithm 1 (bisection over Tmax⁡T_{\max}Tmax​) and Corollary 1, whose content is a running time. A formalization that restricts the minimum in the goal to consecutive or batch-EDD schedules would assume the milestones and is excluded; so is a DP value defined as the optimum itself.

The development needs list-based schedule recursions and ℕ∞ arithmetic only; the exchange lemmas for batch schedules (moving a job between batches without delaying later batches) are reusable for the paper's other dynamic programs. Proofs of any milestone, and of auxiliary lemmas on finish, jobCompletion and permutations of batch lists, are welcome.

Selected references

  • C.-Y. Lee, R. Uzsoy, L. A. Martin-Vega, Efficient Algorithms for Scheduling Semiconductor Burn-In Operations, Operations Research 40(4), 764–775, 1992. https://doi.org/10.1287/opre.40.4.764
  • Y. Ikura, M. Gimple, Scheduling Algorithms for a Single Batch Processing Machine, Operations Research Letters 5(2), 61–65, 1986. https://doi.org/10.1016/0167-6377(86)90092-7
6 thms1 active userReviewed
PreviousPage 61 of 67Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me