Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Operations Research

1,339 missions · 670 completed

The discipline of applying mathematical analysis to complex decision problems in operations: allocating scarce resources, scheduling, routing, inventory, and the design of service and production systems. Drawing on mathematical programming, stochastic modeling, queueing, simulation, and game-theoretic reasoning, it seeks policies that perform provably well in systems shaped by constraints, congestion, and uncertainty.

Missions

Open669Completed670All1339
Algorithmic Game TheoryGraph Theory·Captain: mikedeng1

Graphs and Cooperation in Games: The Unique Fair Allocation Rule, the Shapley Value of the Graph-Restricted Game, Is Totally Stable for Superadditive GamesResearch Paper

Motivation

Classical cooperative game theory assumes that any coalition of players can form and coordinate. In many settings cooperation is mediated by pairwise relationships: communication lines, contracts, alliances, or trade links. Roger Myerson's discussion paper Graphs and Cooperation in Games (Northwestern University, 1976; published in Mathematics of Operations Research 2(3), 1977, doi:10.1287/moor.2.3.225) models such a cooperation structure as a graph on the set of players and asks how the players should share the worth of the game when only linked players can coordinate directly.

The answer, now called the Myerson value, is the starting point of the literature on communication situations and network games. It underlies later work on network formation (Jackson and Wolinsky, A strategic model of social and economic networks, JET 1996) and on allocation rules for networks, and it is a standard textbook example of an axiomatic solution concept.

Timeline:

  • 1953. Shapley defines the Shapley value φ\varphiφ for transferable-utility games by efficiency, symmetry, a carrier axiom and additivity (Shapley 1953).
  • 1976–1977. Myerson introduces cooperation graphs, the fairness (equal gains from each link) condition, proves existence and uniqueness of the fair allocation rule, identifies it as the Shapley value of the graph-restricted game, proves its total stability for superadditive games, and extends existence and uniqueness to games without transferable utility in graph function form.

Setting

Let NNN be a nonempty finite set of players and CLCLCL the set of nonempty coalitions S⊆NS\subseteq NS⊆N. A game in characteristic function form is a vector v∈RCLv\in\mathbb R^{CL}v∈RCL; vSv_SvS​ is the transferable wealth coalition SSS can divide.

A link n:mn{:}mn:m is an unordered pair of distinct players and a graph ggg is a set of links; GRGRGR is the set of all graphs, gˉN\bar g^Ngˉ​N the complete graph, g∖n:mg\setminus n{:}mg∖n:m the graph with one link removed, and ∣g∣|g|∣g∣ the number of links. Players a,ba,ba,b are connected in SSS by ggg if a=b∈Sa=b\in Sa=b∈S or a path of links of ggg joins them through players of SSS only; the classes form the partition S/gS/gS/g of SSS, and N/gN/gN/g is the set of connected components of ggg. The graph-restricted game is

(v/g)S=∑T∈S/gvT.(v/g)_S=\sum_{T\in S/g}v_T .(v/g)S​=T∈S/g∑​vT​.

An allocation rule is a function Y:GR→RNY:GR\to\mathbb R^NY:GR→RN, with Yn(g)Y_n(g)Yn​(g) the payoff of player nnn under cooperation structure ggg. It is a fair allocation rule for vvv if

  1. (efficiency, (7)) ∑n∈SYn(g)=vS\sum_{n\in S}Y_n(g)=v_S∑n∈S​Yn​(g)=vS​ for every ggg and every component S∈N/gS\in N/gS∈N/g, and
  2. (equity, (10)) Yn(g)−Yn(g∖n:m)=Ym(g)−Ym(g∖n:m)Y_n(g)-Y_n(g\setminus n{:}m)=Y_m(g)-Y_m(g\setminus n{:}m)Yn​(g)−Yn​(g∖n:m)=Ym​(g)−Ym​(g∖n:m) for every ggg and every link n:m∈gn{:}m\in gn:m∈g.

YYY is totally stable if Yn(g)≥Yn(g∖n:m)Y_n(g)\ge Y_n(g\setminus n{:}m)Yn​(g)≥Yn​(g∖n:m) for every ggg and every link n:m∈gn{:}m\in gn:m∈g, and vvv is superadditive if vS∪T≥vS+vTv_{S\cup T}\ge v_S+v_TvS∪T​≥vS​+vT​ for disjoint S,T∈CLS,T\in CLS,T∈CL.

A game in graph function form assigns to every pair (S,g)(S,g)(S,g) with S∈N/gS\in N/gS∈N/g a closed, comprehensive (closed under decreasing coordinates), proper (∅≠W≠RS\emptyset\ne W\ne\mathbb R^S∅=W=RS) set w(S,g)⊆RSw(S,g)\subseteq\mathbb R^Sw(S,g)⊆RS of feasible payoffs; its fair allocation rule replaces (7) by (14), (Yn(g))n∈S∈∂w(S,g)(Y_n(g))_{n\in S}\in\partial w(S,g)(Yn​(g))n∈S​∈∂w(S,g).

Formalization targets

Goal: Theorem 3 (p. 8)

If vvv is superadditive, then the fair allocation rule YYY for vvv is totally stable:

Yn(g)≥Yn(g∖n:m)for all g∈GR, n:m∈g.Y_n(g)\ge Y_n(g\setminus n{:}m)\qquad\text{for all } g\in GR,\ n{:}m\in g .Yn​(g)≥Yn​(g∖n:m)for all g∈GR, n:m∈g.

Theorem 1 (p. 7) and Theorem 4 (p. 10)

Every v∈RCLv\in\mathbb R^{CL}v∈RCL has a unique fair allocation rule; every game www in graph function form has a unique YYY satisfying (14) and (10).

Theorem 2 (p. 8)

The fair allocation rule is

Y(g)=φ(v/g)for all g∈GR,in particular Y(gˉN)=φ(v).Y(g)=\varphi(v/g)\quad\text{for all }g\in GR,\qquad\text{in particular } Y(\bar g^N)=\varphi(v).Y(g)=φ(v/g)for all g∈GR,in particular Y(gˉ​N)=φ(v).

The milestones follow the paper's Section 7: the steps of the proof of Theorem 4 (displays (15)–(17)), Theorem 4, Theorem 1, the decomposition of v/gv/gv/g and the efficiency and equity of φ(v/g)\varphi(v/g)φ(v/g) (proof of Theorem 2), Theorem 2, and the monotonicity of v/gv/gv/g and φ(v/g)\varphi(v/g)φ(v/g) in a link (proof of Theorem 3). Theorem 3 is the goal because its proof uses the formula of Theorem 2, whose proof uses the uniqueness of Theorem 1, which is the transferable-utility case of Theorem 4: all four numbered results lie on one path.

Significance

The theorems give an axiomatic foundation for allocation in networks: two natural requirements, component-wise efficiency and equal gains from each link, single out one rule, and that rule is an explicit formula built from the Shapley value. At the complete graph it recovers the Shapley value itself, so the result is also a new characterization of the Shapley value. Total stability says that, for superadditive games, no player has an incentive to break a link, which connects the allocation rule to the question of which networks form.

The results are proved in the paper. A search of the platform found no formalization of cooperation graphs, the graph-restricted game, the Myerson value or total stability; the Shapley value is available as a platform definition and is reused. This mission produces machine-checked statements of all four theorems and of the intermediate steps of their proofs, together with a reusable definition layer for communication situations.

Difficulty

The equity condition (10) relates the payoff at a graph to the payoff at a graph with one fewer link, and it constrains only pairs of linked players; it is not evident that these conditions, together with efficiency on components, determine the rule at every graph, nor that they are consistent. Uniqueness and existence must hold simultaneously for all 2∣gˉN∣2^{|\bar g^N|}2∣gˉ​N∣ graphs, and the constraints couple each graph to all of its subgraphs and each player to every other player of its component. In the graph function form, efficiency becomes a boundary condition on a closed comprehensive set, and the existence and uniqueness of the relevant extremal point depend on all three properties of w(S,g)w(S,g)w(S,g).

Identifying the rule with φ(v/g)\varphi(v/g)φ(v/g) requires the efficiency of the Shapley value on each component of ggg, which is not the efficiency of φ\varphiφ on NNN, and equity requires tracking how the partitions S/gS/gS/g change when a link is removed. Total stability is false for general games: without superadditivity a player can gain by cutting a link, so the hypothesis cannot be dropped.

Formalization scope

Players are Fin n, with 0<n0<n0<n in every theorem as the paper assumes NNN nonempty; the paper's player kkk is index k−1k-1k−1. The general game carrier has its own definition module, and the graph-specific definitions build on it. Graphs are SimpleGraph (Fin n): gˉN\bar g^Ngˉ​N is ⊤, the empty graph ⊥, h⊆gh\subseteq gh⊆g is h ≤ g and h⊂gh\subset gh⊂g is h < g. A game is a function Finset (Fin n) → ℝ; its value at ∅\emptyset∅ is a junk coordinate that no definition reads, and no theorem assumes v∅=0v_\emptyset=0v∅​=0. Superadditivity quantifies over nonempty coalitions only. The Shapley value is the platform definition Supermodularity.Cooperative.ShapleyValue, applied after resetting the value at ∅\emptyset∅ to 000. RS\mathbb R^SRS is ↥S → ℝ with the product topology, and ∂\partial∂ is the topological frontier.

Explicit readings of the typescript:

  • The printed definition of "connected in SSS by ggg" (p. 3) asks ni∈Sn^i\in Sni∈S only for i≥1i\ge1i≥1; the formalization requires every vertex of the path, including the start, to lie in SSS, which makes S/gS/gS/g the partition of SSS the paper describes.
  • Comprehensiveness (p. 10) prints "∀n∈N\forall n\in N∀n∈N" for coordinates of vectors in RS\mathbb R^SRS; read as n∈Sn\in Sn∈S.
  • Display (17) writes Yn(h)Y_n(h)Yn​(h) under the index m∈Sm\in Sm∈S; read as Ym(h)Y_m(h)Ym​(h), as in (18b).
  • The proof headed "PROOF OF THEOREM 4." on p. 13 is the proof of Theorem 3.
  • "The unique fair allocation rule" in Theorems 2 and 3 is stated for every fair allocation rule; existence and uniqueness are Theorem 1.
  • The paper's NNN is nonempty; every theorem carries the corresponding hypothesis 0<n0<n0<n.

The equity and stability conditions quantify over links of ggg only. Quantifying over all pairs of players would make Theorem 1 false and the goal vacuous, so that reading is ruled out. Likewise (14) is boundary membership, not membership in w(S,g)w(S,g)w(S,g).

Contributions welcome: general lemmas on the partitions S/gS/gS/g (refinement under link deletion, restriction to components), Möbius inversion over the subgraph lattice of a finite simple graph, the carrier and null-player properties of the Shapley value, and the extremal-point lemma for closed comprehensive sets. These are reusable beyond this mission.

Selected references

  • R. B. Myerson, Graphs and Cooperation in Games, Discussion Paper No. 246, CMS-EMS, Northwestern University, September 1976; published in Mathematics of Operations Research 2(3):225–229, 1977. https://doi.org/10.1287/moor.2.3.225
  • L. S. Shapley, A Value for n-Person Games, in Contributions to the Theory of Games II, Annals of Mathematics Studies 28, Princeton University Press, 1953, pp. 307–317. https://doi.org/10.1515/9781400881970-018
  • M. O. Jackson and A. Wolinsky, A Strategic Model of Social and Economic Networks, Journal of Economic Theory 71(1):44–74, 1996. https://doi.org/10.1006/jeth.1996.0108
18 thms1 active userReviewed
Algorithmic Game TheoryProbability·Captain: mikedeng1

Comparison of Threshold Stop Rules and Maximum for Independent Nonnegative Random Variables I: A Median Threshold Rule Achieves EX* ≤ 2E⁺X_τResearch Paper

Why a threshold rule matters

In a finite stopping problem, a decision maker observes rewards one at a time and must accept one without seeing the future. A fully informed observer takes the maximum. This comparison is often called a prophet inequality. The abstract bound that an optimal stopping rule can secure at least half the expected maximum does not say how to choose a simple rule. Samuel-Cahn showed that a threshold chosen from a median of the maximum already gives this guarantee, even when the rewards are independent but differently distributed. The rule requires one number fixed before observations begin. Samuel-Cahn, 1984

The paper builds on earlier comparisons between the maximum and the best stopping value, then narrows attention to rules that accept an observation when it crosses a fixed threshold. This mission isolates its first main result, Theorem 1, and the two cases that determine whether the crossing test is strict or weak. The paper's second main result, concerning the sharpness of the constant for identically distributed rewards, belongs to the next mission in this series. Samuel-Cahn, 1984, pp. 1213–1215

Observations and threshold rules

Let n≥1n\ge1n≥1, and let X1,…,XnX_1,\ldots,X_nX1​,…,Xn​ be independent, nonnegative real random variables. Write Xn∗=max⁡(X1,…,Xn)X_n^*=\max(X_1,\ldots,X_n)Xn∗​=max(X1​,…,Xn​). For a threshold c≥0c\ge0c≥0, the weak threshold rule t(c)t(c)t(c) takes the first XiX_iXi​ with i<ni<ni<n and Xi≥cX_i\ge cXi​≥c; the strict threshold rule s(c)s(c)s(c) uses Xi>cX_i>cXi​>c. If no earlier observation qualifies, either rule takes XnX_nXn​, even when XnX_nXn​ is below the threshold. Hence every rule returns exactly one observed reward.

The paper distinguishes the full stopped reward from its positive threshold reward. In its notation,

E+Xt(c)=E[Xt(c)1{Xt(c)≥c}],E+Xs(c)=E[Xs(c)1{Xs(c)>c}].E^+X_{t(c)}=E[X_{t(c)}\mathbf1_{\{X_{t(c)}\ge c\}}], \qquad E^+X_{s(c)}=E[X_{s(c)}\mathbf1_{\{X_{s(c)}>c\}}].E+Xt(c)​=E[Xt(c)​1{Xt(c)​≥c}​],E+Xs(c)​=E[Xs(c)​1{Xs(c)​>c}​].

The last forced observation may contribute to EXt(c)E X_{t(c)}EXt(c)​ or EXs(c)E X_{s(c)}EXs(c)​ while contributing zero to E+Xt(c)E^+X_{t(c)}E+Xt(c)​ or E+Xs(c)E^+X_{s(c)}E+Xs(c)​. This difference is essential to the theorem's middle bounds. A median mmm of Xn∗X_n^*Xn∗​ means both P(Xn∗<m)≤12P(X_n^*<m)\le\tfrac12P(Xn∗​<m)≤21​ and P(Xn∗>m)≤12P(X_n^*>m)\le\tfrac12P(Xn∗​>m)≤21​. Define the excess sum β=∑i=1nE(Xi−m)+\beta=\sum_{i=1}^n E(X_i-m)^+β=∑i=1n​E(Xi​−m)+, where x+=max⁡(x,0)x^+=\max(x,0)x+=max(x,0). The two median inequalities allow an atom at mmm, and the two threshold rules handle that boundary differently. Samuel-Cahn, 1984, pp. 1213–1214, (1.1)–(1.2)

Formalization targets

Theorem 1: a median threshold

For every median mmm, the goal retains both of the paper's conditional conclusions:

β≥m⟹EXn∗≤2E+Xs(m)≤2EXs(m),β≤m⟹EXn∗≤2E+Xt(m)≤2EXt(m).\begin{aligned} \beta\ge m&\Longrightarrow E X_n^*\le2E^+X_{s(m)}\le2E X_{s(m)},\\ \beta\le m&\Longrightarrow E X_n^*\le2E^+X_{t(m)}\le2E X_{t(m)}. \end{aligned}β≥mβ≤m​⟹EXn∗​≤2E+Xs(m)​≤2EXs(m)​,⟹EXn∗​≤2E+Xt(m)​≤2EXt(m)​.​

At equality β=m\beta=mβ=m, both conclusions apply. The attack path follows the expected maximum bound (1.3), the displayed identities and probability bound in (1.4), and the companion weak threshold display. Each milestone points to an actual line of the paper. The NOTE and ASSERTION give a further interval of working thresholds: if a∗=E(Xn∗−a∗)+a^*=E(X_n^*-a^*)^+a∗=E(Xn∗​−a∗)+ and b∗=∑iE(Xi−b∗)+b^*=\sum_iE(X_i-b^*)^+b∗=∑i​E(Xi​−b∗)+, then every a∗≤c≤b∗a^*\le c\le b^*a∗≤c≤b∗ satisfies the same chain with t(c)t(c)t(c). Remark 1 records the special case of observations taking values in one common two point set. Samuel-Cahn, 1984, pp. 1214–1215

What the result gives

Theorem 1 replaces the unspecified best stopping policy with a specific threshold chosen from the distribution of the maximum. It also shows that the thresholded part of the stopped reward alone meets the factor two bound. That stronger middle statement distinguishes the theorem from an outer comparison EXn∗≤2EXτE X_n^*\le2E X_\tauEXn∗​≤2EXτ​. For a reward distribution with atoms, the theorem says exactly when to use >>> and when to use ≥\ge≥. Its companion ASSERTION shows that a median is not the only useful threshold choice. Samuel-Cahn, 1984, p. 1214

The result is proved in the paper; the work here is to express its assumptions, boundary behavior, and all displayed inequalities as Lean statements that solvers can prove. The milestones expose reusable facts about positive parts, forced stopping, and independence of a current observation from the event that the rule has survived earlier ones. No machine checked proof of these drafted statements is claimed. The second mission can use the completed theorem to formalize why the factor two cannot be improved uniformly over threshold rules, even for identically distributed observations.

Where the formal proof is delicate

The event that a rule reaches index iii depends on the observations before iii. Establishing its independence from the excess of XiX_iXi​ requires mutual independence of the whole family; pairwise independence does not express enough. A forced stop at nnn also makes the positive threshold reward smaller than the full stopped reward whenever the last observation misses the threshold. Ignoring that last case would erase one of the theorem's conclusions. Finally, atoms at the median prevent the strict and weak crossing events from being interchanged. Samuel-Cahn, 1984, (1.1)–(1.4)

Formalization scope

Lean indexes the nnn observations by Fin nnn with n>0n>0n>0. Its index zero is the paper's index one, and the greatest index is the paper's mandatory final stop nnn. The rules are the least qualifying index or that final index. The paper's s(m)>i−1s(m)>i-1s(m)>i−1 and t(m)>i−1t(m)>i-1t(m)>i−1 therefore become i≤s(m)i\le s(m)i≤s(m) and i≤t(m)i\le t(m)i≤t(m). Observations are measurable, nonnegative almost surely, and mutually independent under a probability measure.

Expectations use the extended nonnegative integral of the positive part, taking values in [0,∞][0,\infty][0,∞]. This keeps infinite expected rewards visible without imposing an integrability assumption absent from Theorem 1. The median has both strict tail inequalities from (1.1). The identities for positive stopped rewards state m≥0m\ge0m≥0 directly; in the goal this follows from nonnegativity and the median condition. The balance thresholds a∗a^*a∗ and b∗b^*b∗ are parameters satisfying the paper's defining equations, with no extra uniqueness hypothesis in statements that do not use it.

The goal cannot be satisfied by replacing E+XτE^+X_\tauE+Xτ​ with EXτE X_\tauEXτ​, by permitting a rule to return no observation, or by making the median predicate empty. Useful contributions include the measurable threshold rule interface, the pathwise excess decomposition, the factorization under mutual independence, and the remaining extended nonnegative arithmetic. Those pieces can also support other finite prophet inequality developments.

Selected references

  • E. Samuel-Cahn, Comparison of Threshold Stop Rules and Maximum for Independent Nonnegative Random Variables, The Annals of Probability 12(4), 1213–1216, 1984. DOI: 10.1214/aop/1176993150
9 thms1 active userReviewed
Linear OptimizationOptimizationProbability+1·Captain: mikedeng1

On Adaptive-Step Primal-Dual Interior-Point Algorithms for Linear Programming 4: For a Random Subspace, ‖Pq‖⁻∞ ≤ (log n/n)‖r‖² with Probability Tending to OneResearch Paper

Motivation

Primal–dual interior point methods follow a path of strictly feasible solutions to a linear program. Their worst case iteration bounds come from controlling a term that is quadratic in each search step. Mizuno, Todd, and Ye asked whether that term is typically much smaller than its worst case bound under a model in which a certain subspace is randomly oriented. Theorem 5 in their technical report gives a probability bound for the negative part of that term. It is a statement about one randomly oriented subspace and a fixed input vector, rather than a stochastic model for an entire algorithm run. The authors explicitly note that assigning the same random subspace model independently at successive iterations would be inconsistent with the algorithm's evolving state. Mizuno, Todd, and Ye, §6

Setting

Fix a dimension nnn, an integer ddd with 0≤d≤n0\le d\le n0≤d≤n, and a vector r∈Rnr\in\mathbb R^nr∈Rn. Draw a random ddd-dimensional subspace UUU from the distribution invariant under orthogonal transformations. Let ppp be the Euclidean orthogonal projection of rrr onto UUU, and put q=r−pq=r-pq=r−p, its projection onto U⊥U^\perpU⊥. The matrix P=diag⁡(p)P=\operatorname{diag}(p)P=diag(p) turns the vector qqq into the coordinatewise product Pq=(pjqj)j=1nPq=(p_jq_j)_{j=1}^nPq=(pj​qj​)j=1n​.

For a coordinate vector zzz, let z−=(min⁡{zj,0})j=1nz^-=(\min\{z_j,0\})_{j=1}^nz−=(min{zj​,0})j=1n​ and ∥z∥∞−=∥z−∥∞\|z\|^-_\infty=\|z^-\|_\infty∥z∥∞−​=∥z−∥∞​. Thus ∥Pq∥∞−\|Pq\|^-_\infty∥Pq∥∞−​ records the magnitude of the largest negative coordinate of PqPqPq. An unsubscripted vector norm is always the Euclidean ℓ2\ell_2ℓ2​ norm. These definitions follow the report's notation on printed pages 2 and 4. Mizuno, Todd, and Ye, §§1–2

The formal model samples an (n−d)×n(n-d)\times n(n−d)×n matrix GGG with independent standard normal entries and sets U=ker⁡GU=\ker GU=kerG. The report itself gives this construction as an example of the orthogonally invariant law. With probability one, this null space has dimension ddd. The construction covers the endpoint cases d=0d=0d=0 and d=nd=nd=n as well: the projection product is then zero. This probabilistic model has no linear programming data in its statement. The optimization setting explains why the quantity matters, while the result depends only on Euclidean projection geometry. Mizuno, Todd, and Ye, §6

Formalization targets

Theorem 5

For arbitrary choices rn∈Rnr_n\in\mathbb R^nrn​∈Rn and dn≤nd_n\le ndn​≤n at each dimension, the central target is

Pr⁡{∥Pnqn∥∞−≤log⁡nn∥rn∥22}⟶1(n⟶∞).\Pr\left\{\|P_nq_n\|^-_\infty\le \frac{\log n}{n}\|r_n\|_2^2\right\} \longrightarrow 1\qquad(n\longrightarrow\infty).Pr{∥Pn​qn​∥∞−​≤nlogn​∥rn​∥22​}⟶1(n⟶∞).

The logarithm is natural. The theorem asks for the exact coefficient shown in the report, rather than only an asymptotic order. The choice of rnr_nrn​ and dnd_ndn​ may change with nnn; the result does not require a common probability space for all dimensions. Mizuno, Todd, and Ye, Theorem 5, printed p. 13

Source milestones

The mission includes Lemma 6, which identifies a beta distributed radial coordinate and a uniform spherical direction for a projected vector; the componentwise identities and inequality (18)–(19); the Gaussian norm limit (20); the Gaussian coordinate maximum limit cited in the proof; and Lemma 7, which bounds the sup norm of a rotated uniform spherical direction by 3log⁡n/n\sqrt{3\log n/n}3logn/n​ with probability tending to one. Their statements, constants, and order follow printed pages 14–15 of the report. Mizuno, Todd, and Ye, §6

Significance

The result gives a precise high probability bound for the negative coordinates of the projection product. In the report this product represents the second order term of a primal–dual search direction, and a smaller value permits a larger admissible step in the relevant neighborhood analysis. The theorem therefore supplies a mathematically definite part of the paper's discussion of anticipated improved behavior. It does not by itself prove a typical iteration count: the paper does not provide a consistent random model for the sequence of subspaces visited by the algorithm. Mizuno, Todd, and Ye, §§2, 6–7

The report proves Theorem 5 and the two numbered lemmas on paper. The formalization work is to provide machine checked proofs of the random subspace representation, the beta and spherical laws, the finite dimensional Gaussian limits, and their connection to the projection bound. These results are reusable in other questions about random projections and coordinatewise estimates. The statements in this mission are open formalization targets; compilation of a statement with a proof placeholder does not count as a machine checked proof.

Difficulty

A direct norm bound on ppp and qqq loses the coordinate information needed for the factor log⁡n/n\log n/nlogn/n. The difficult part is that the desired bound concerns the most negative coordinate of a product of two dependent projections, while the distribution is specified through a random subspace. The paper's deterministic identity (18)–(19) relates this product to an angular coordinate. The remaining probabilistic statements must control the largest coordinate of a uniformly distributed spherical vector, including the numerical constant in Lemma 7. The laws of the radial and angular coordinates also need a sound measurable construction; simply writing a mapped measure without checking the map would not establish the claimed distributions.

Formalization scope

Vectors are EuclideanSpace ℝ (Fin n), so ∥r∥\|r\|∥r∥ is the ℓ2\ell_2ℓ2​ norm. Coordinate sup norms are separate definitions. A complete development needs finite dimensional inner product geometry, orthogonal projections, Gaussian product measures, beta measures, the uniform spherical law, and limits of real probabilities. The spherical law is encoded as the direction of a standard Gaussian vector. The Gaussian matrix construction fixes the invariant subspace distribution and must be connected to the stated ddd-dimensional law almost surely.

Lemma 6 concerns d,m≥1d,m\ge1d,m≥1 and n≥2n\ge2n≥2, where the beta parameters and the spherical direction are nondegenerate. Its angular direction is assigned zero at the zero coordinate, which has probability zero in this regime; the claimed decomposition and unit norm hold almost surely. Theorem 5 retains d=0d=0d=0, d=nd=nd=n, and r=0r=0r=0. Lemma 7 is stated only for frames in dimensions at least two; finitely many smaller dimensions are assigned probability one in its limit expression. Equation (20) keeps the report's condition ε>0\varepsilon>0ε>0. All limits are probabilities tending to one, never probability one at every finite nnn.

Contributions should preserve the source's constants and all three claims of Lemma 6. A proof of the beta law alone, or a bound for a single fixed direction, does not close the corresponding target. The invariant random subspace and projection model, the Gaussian and spherical distribution facts, and the coordinate estimates are each useful independently of this mission.

Selected references

  • Shinji Mizuno, Michael J. Todd, and Yinyu Ye, On Adaptive-Step Primal-Dual Interior-Point Algorithms for Linear Programming, Cornell ORIE Technical Report No. 944, 1990, revised 1991; published in Mathematics of Operations Research 18(4), 1993. DOI
  • Sidney I. Resnick, Extreme Values, Regular Variation, and Point Processes, Springer, 1987, pp. 42 and 71, cited in the report for the Gaussian maximum estimate. DOI
7 thms1 active userReviewed
Stochastic Systems·Captain: mikedeng1

A Proof of the Optimality of the Shortest Remaining Processing Time Discipline: SRPT Minimizes the Number of Jobs in System at Every Time, for Every Arrival Stream and Every ScheduleResearch Paper

Motivation

A single processor receives jobs over time, each with a known amount of work, and may interrupt a job at any moment to work on another. Which rule should decide what to process? For the number of jobs waiting or in service, the answer is the Shortest Remaining Processing Time (SRPT) rule: at every moment, work on the job in system that is closest to completion. Its optimality is pathwise. It holds for every sequence of arrival times and processing times, not on average under a probabilistic model, so it applies to any single-server queue whatever the distribution of interarrival and processing times. By Little's law it also minimizes mean response time, which is why SRPT and its approximations are the reference policy in the analysis of size-based scheduling for web servers and networks (Harchol-Balter et al., 2003).

Timeline:

  • 1966. Schrage and Miller analyse the M/G/1 queue under SRPT and state, without proof, that SRPT minimizes the number in system at every time for every arrival sequence (Schrage–Miller, 1966).
  • 1968. Schrage publishes a letter giving a proof by an interchange argument (Schrage, 1968). This mission formalizes that letter.
  • 1978. D. R. Smith gives a new proof of the same statement (Smith, 1978) by a different argument.

Setting

An arrival stream is a sequence of pairs (A(n),P(n))(A(n), P(n))(A(n),P(n)), n=0,1,2,…n = 0, 1, 2, \dotsn=0,1,2,…, of real numbers: A(n)A(n)A(n) is the arrival time and P(n)P(n)P(n) the processing time of job nnn. A schedule is a family of measurable functions δ(n,⋅):R→{0,1}\delta(n, \cdot) : \mathbb R \to \{0, 1\}δ(n,⋅):R→{0,1}, with δ(n,t)=1\delta(n, t) = 1δ(n,t)=1 meaning that the processor works on job nnn at time ttt. No job is processed before it arrives (δ(n,t)=0\delta(n, t) = 0δ(n,t)=0 for t<A(n)t < A(n)t<A(n)), and the processor works on at most one job at a time.

The remaining processing time of job nnn at time ttt is

S(n,t)=P(n)−∫A(n)tδ(n,x) dx,S(n, t) = P(n) - \int_{A(n)}^{t} \delta(n, x)\,dx,S(n,t)=P(n)−∫A(n)t​δ(n,x)dx,

and its completion time is

C(n)=min⁡{x≥A(n):∫A(n)xδ(n,t) dt≥P(n)},C(n) = \min\Big\{x \ge A(n) : \int_{A(n)}^{x} \delta(n, t)\,dt \ge P(n)\Big\},C(n)=min{x≥A(n):∫A(n)x​δ(n,t)dt≥P(n)},

or +∞+\infty+∞ if the job never receives its processing time. The set of jobs in system at time ttt is θ(t)={n:A(n)≤t, S(n,t)>0}\theta(t) = \{n : A(n) \le t,\ S(n, t) > 0\}θ(t)={n:A(n)≤t, S(n,t)>0}, and N(t)N(t)N(t) is its cardinality.

A schedule follows SRPT if, at every time ttt with θ(t)≠∅\theta(t) \ne \emptysetθ(t)=∅, the processor works on a job k∈θ(t)k \in \theta(t)k∈θ(t) with S(k,t)≤S(j,t)S(k, t) \le S(j, t)S(k,t)≤S(j,t) for all j∈θ(t)j \in \theta(t)j∈θ(t). Ties may be broken arbitrarily.

Formalization targets

Goal: SRPT minimizes the number in system at every time

For every locally finite arrival stream, every SRPT schedule δs\delta_sδs​ and every schedule δ\deltaδ of the same stream,

Ns(t)≤N(t)for all t∈R.N_s(t) \le N(t) \qquad \text{for all } t \in \mathbb R.Ns​(t)≤N(t)for all t∈R.

The goal has no constants and no distributional assumptions. It is the statement quoted on p. 687 and concluded at the end of the PROOF on p. 689.

Milestones: the steps of the letter's interchange argument

All five come from the PROOF on p. 689. They compare an original schedule δo\delta_oδo​ with a revised schedule δr\delta_rδr​.

  1. Idle case (b1). If the processor is idle on [t,t+v][t, t+v][t,t+v] while job jjj waits, processing jjj there gives Cr(j)<Co(j)C_r(j) < C_o(j)Cr​(j)<Co​(j) and Cr(i)=Co(i)C_r(i) = C_o(i)Cr​(i)=Co​(i) for i≠ji \ne ji=j.
  2. Max identity. Reassigning the capacity that two jobs j,kj, kj,k share after time ttt, in any way, leaves max⁡{C(k),C(j)}\max\{C(k), C(j)\}max{C(k),C(j)} unchanged.
  3. SRPT minimizes the minimum. Giving that capacity first to the job with the smaller remaining time minimizes min⁡[C(k),C(j)]\min[C(k), C(j)]min[C(k),C(j)].
  4. Relation (2). If kkk is served on [t,t+v][t, t+v][t,t+v] while jjj with So(j,t)<So(k,t)S_o(j,t) < S_o(k,t)So​(j,t)<So​(k,t) waits, the SRPT reassignment gives min⁡[Cr(k),Cr(j)]<min⁡[Co(k),Co(j)]\min[C_r(k), C_r(j)] < \min[C_o(k), C_o(j)]min[Cr​(k),Cr​(j)]<min[Co​(k),Co​(j)].
  5. Counting. Relations (1)–(3) on completion times give Nr(y)=No(y)−1N_r(y) = N_o(y) - 1Nr​(y)=No​(y)−1 for Cr(j)≤y<min⁡[Co(k),Co(j)]C_r(j) \le y < \min[C_o(k), C_o(j)]Cr​(j)≤y<min[Co​(k),Co​(j)], and Nr(y)=No(y)N_r(y) = N_o(y)Nr​(y)=No​(y) otherwise.

Significance

The result. The goal is a sample-path dominance. Each consequence for averages follows by taking expectations or time averages: SRPT minimizes the mean number in system and, through Little's law (Little, 1961), the mean response time in every G/G/1 queue with known job sizes. It makes SRPT the benchmark against which other preemptive disciplines, size-based or size-oblivious, are measured.

Formalizing it. The statement has been proved on paper since 1968 and given a complete proof in 1978. No machine-checked proof of it is known to this mission. A formalization contributes three things: a precise continuous-time model of preemptive single-server schedules with measurable service indicators and possibly infinite completion times; checked proofs of the exchange steps of the 1968 letter, each of which needs a hypothesis the letter leaves implicit; and a checked proof of the pathwise optimality theorem itself.

Difficulty

The letter argues that a non-SRPT schedule contains an interval on which SRPT is violated, and that swapping service on that interval improves the schedule. The first step fails for measurable schedules. A schedule can violate SRPT on a set of positive measure that contains no interval (a fat Cantor set), or only on a null set. So the "interval of non-SRPT behaviour" need not exist, and a single interchange does not turn an arbitrary schedule into an SRPT one. Repeating interchanges also gives no obvious termination or limit argument, because the improvements can accumulate at a point. The goal therefore cannot be reached by formalizing the letter's induction literally. The milestones are the letter's local claims, which are true under the hypotheses stated with them. The goal needs an argument that compares an SRPT schedule with an arbitrary one at every time directly.

Formalization scope

All declarations live in the namespace SchrageSRPT.Opt. Jobs are indexed by ℕ from 000, and times, arrival times and processing times are real. A schedule is δ : ℕ → ℝ → ℝ with values in {0,1}\{0,1\}{0,1}, each δ n measurable, δ(n,t)=0\delta(n,t) = 0δ(n,t)=0 before arrival, and at most one job served at a time. The letter's ∑nδ(n,t)≤1\sum_n \delta(n,t) \le 1∑n​δ(n,t)≤1 is stated as "two served jobs are equal", not as a series. Assumption (I) of the letter (the arrival stream does not depend on the discipline) is encoded by comparing schedules of one fixed stream. Assumption (II) (preemption wastes no work) is the formula for S(n,t)S(n,t)S(n,t), which has no setup term. Completion times take values in WithTop ℝ, with +∞+\infty+∞ for a job that never completes. A job is in system on [A(n),C(n))[A(n), C(n))[A(n),C(n)). N(t)N(t)N(t) is Set.ncard, and the goal assumes local finiteness ({n:A(n)≤t}\{n : A(n) \le t\}{n:A(n)≤t} is finite for every ttt) so that it is a genuine count. SRPT is the verbal rule of p. 687, required at every ttt.

Two encodings would trivialize the goal, and both are ruled out. The displayed condition of p. 688 ("S(k,t)>S(j,t)S(k,t) > S(j,t)S(k,t)>S(j,t) for j∈θ(t)j \in \theta(t)j∈θ(t) implies δ(k,t)=0\delta(k,t)=0δ(k,t)=0") is satisfied by the schedule that never works, so it is not used as the definition of SRPT. The competitor class is every schedule of the stream: it is not restricted to work-conserving schedules, to finitely many jobs, or to schedules in which every job completes.

The milestones add disclosed hypotheses that the letter uses silently:

  • finiteness of Co(j)C_o(j)Co​(j) in the idle case;
  • no service on a job after it completes in the max identity;
  • that one of the two jobs completes under δo\delta_oδo​ in relation (2).

The counting milestone uses the half-open interval, since the letter's closed right endpoint is a slip.

A complete development needs:

  • continuity and monotonicity of x↦∫A(n)xδ(n,t) dtx \mapsto \int_{A(n)}^x \delta(n,t)\,dtx↦∫A(n)x​δ(n,t)dt;
  • the characterization n∈θ(t)  ⟺  A(n)≤t<C(n)n \in \theta(t) \iff A(n) \le t < C(n)n∈θ(t)⟺A(n)≤t<C(n);
  • interval integrals of schedules modified on sets.

All of this is reusable for other continuous-time preemptive scheduling results. Contributions are welcome in particular for this infrastructure, for proofs of the milestones, and for a complete proof of the goal.

Selected references

  • L. Schrage, A proof of the optimality of the shortest remaining processing time discipline, Operations Research 16(3):687–690, 1968. https://doi.org/10.1287/opre.16.3.687
  • L. E. Schrage and L. W. Miller, The queue M/G/1 with the shortest remaining processing time discipline, Operations Research 14(4):670–684, 1966. https://doi.org/10.1287/opre.14.4.670
  • D. R. Smith, A new proof of the optimality of the shortest remaining processing time discipline, Operations Research 26(1):197–199, 1978. https://doi.org/10.1287/opre.26.1.197
  • J. D. C. Little, A proof for the queuing formula L = λW, Operations Research 9(3):383–387, 1961. https://doi.org/10.1287/opre.9.3.383
  • M. Harchol-Balter, B. Schroeder, N. Bansal and M. Agrawal, Size-based scheduling to improve web performance, ACM Transactions on Computer Systems 21(2):207–233, 2003. https://doi.org/10.1145/762483.762486
7 thms1 active userReviewed
Dynamic ProgrammingMarkov ChainStochastic Systems·Captain: mikedeng1

Quality Control under Markovian Deterioration 1: A Discounted-Optimal Policy Produces, Inspects, Produces Again and Revises on Successive Intervals of the BeliefResearch Paper

Motivation

A production process deteriorates over time, and the state it is in cannot be observed directly. Each period the operator chooses among three actions: produce without looking, produce and inspect the item (which reveals the current state at a cost), or revise the process back to its good state. This is one of the earliest partially observed Markov decision problems with a costly observation action, and it is the prototype of the inspection and machine-replacement models that followed in operations research and maintenance theory. Ross (Management Science 17(9), 1971) set it up for a countable state space, reduced it to a fully observed problem on beliefs, and determined the structure of an optimal policy for two states.

Intuition suggests a three-region policy for two states: produce while the probability of the bad state is small, inspect at intermediate probabilities, revise when it is large. Ross showed that the true structure has up to four regions: produce, inspect, produce again, revise. This mission formalizes that structure theorem and the general results it rests on.

Setting

The underlying process has a countable set of states 0,1,2,…0,1,2,\dots0,1,2,…, with transition probabilities PijP_{ij}Pij​ from state iii at the end of a period to state jjj at the beginning of the next. In state iii, producing without inspection costs CiC_iCi​, producing with inspection costs IiI_iIi​, and revising costs RiR_iRi​; costs are bounded, and future costs are discounted by β∈(0,1)\beta\in(0,1)β∈(0,1). A revision puts the process in state 000.

The decision maker tracks a belief P=(P0,P1,… )P=(P_0,P_1,\dots)P=(P0​,P1​,…), a probability vector on the states, ranging over

S={P:Pi≥0, ∑iPi=1}.S=\Big\{P: P_i\ge0,\ \sum_iP_i=1\Big\}.S={P:Pi​≥0, i∑​Pi​=1}.

Producing without inspection moves the belief to TPTPTP, with (TP)i=∑jPjPji(TP)_i=\sum_jP_jP_{ji}(TP)i​=∑j​Pj​Pji​. Inspecting reveals the state; if it is iii, the next belief is the row ei=(Pi0,Pi1,… )e^i=(P_{i0},P_{i1},\dots)ei=(Pi0​,Pi1​,…). Revising leads to e0e^0e0.

The β\betaβ-discounted optimal cost VβV_\betaVβ​ is the limit of value iteration: V0=0V^0=0V0=0 and

Vn+1(P)=min⁡{∑iPiCi+βVn(TP); ∑iPiIi+β∑iPiVn(ei); ∑iPiRi+βVn(e0)}.V^{n+1}(P)=\min\Big\{\sum_iP_iC_i+\beta V^n(TP);\ \sum_iP_iI_i+\beta\sum_iP_iV^n(e^i);\ \sum_iP_iR_i+\beta V^n(e^0)\Big\}.Vn+1(P)=min{i∑​Pi​Ci​+βVn(TP); i∑​Pi​Ii​+βi∑​Pi​Vn(ei); i∑​Pi​Ri​+βVn(e0)}.

The three terms with VnV^nVn replaced by VβV_\betaVβ​ form the right side of the optimality equation (1). The β\betaβ-optimal produce, inspect and revise regions are the sets of beliefs at which the corresponding term equals Vβ(P)V_\beta(P)Vβ​(P), and a stationary rule is β\betaβ-optimal when it always selects an action attaining the minimum.

In the two-state process of §3, state 000 is good and state 111 is bad: P00=1−πP_{00}=1-\piP00​=1−π, P11=1P_{11}=1P11​=1, C0=0C_0=0C0​=0, C1=CC_1=CC1​=C, I0=I1=II_0=I_1=II0​=I1​=I, R0=R1=RR_0=R_1=RR0​=R1​=R, with C<I<RC<I<RC<I<R. The belief is a number P∈[0,1]P\in[0,1]P∈[0,1], the probability of the bad state, TP=P+π−πPTP=P+\pi-\pi PTP=P+π−πP, and the optimality equation becomes

Vβ(P)=min⁡{CP+βVβ(TP); I+βPVβ(1)+β(1−P)Vβ(π); R+βVβ(π)}.(3)V_\beta(P)=\min\{CP+\beta V_\beta(TP);\ I+\beta PV_\beta(1)+\beta(1-P)V_\beta(\pi);\ R+\beta V_\beta(\pi)\}.\tag{3}Vβ​(P)=min{CP+βVβ​(TP); I+βPVβ​(1)+β(1−P)Vβ​(π); R+βVβ​(π)}.(3)

Formalization targets

Goal: Theorem 3.3, the four-region structure

There are thresholds π≤P1≤P2≤P3\pi\le P_1\le P_2\le P_3π≤P1​≤P2​≤P3​ with P2≤1P_2\le1P2​≤1 such that the rule

produce on [0,P1),inspect on [P1,P2),produce on [P2,P3),revise on [P3,1]\text{produce on }[0,P_1),\quad\text{inspect on }[P_1,P_2),\quad\text{produce on }[P_2,P_3),\quad\text{revise on }[P_3,1]produce on [0,P1​),inspect on [P1​,P2​),produce on [P2​,P3​),revise on [P3​,1]

is β\betaβ-optimal, and P3≤1P_3\le1P3​≤1 whenever revising is β\betaβ-optimal at some belief. Degenerate thresholds (empty intervals) are allowed, so the statement fixes only the order of the regions, not their number.

Milestones

  1. (1): value iteration converges on SSS, VβV_\betaVβ​ is bounded, solves (1), and is its unique bounded solution.
  2. Lemma 2.1: VβV_\betaVβ​ is concave on SSS.
  3. Theorem 2.2: the β\betaβ-optimal inspect and revise regions are convex.
  4. (3): the two-state optimality equation, as an instance of (1).
  5. Lemma 3.1: in the two-state model VβV_\betaVβ​ is nondecreasing on [0,1][0,1][0,1].
  6. Lemma 3.2: for 0≤P≤π0\le P\le\pi0≤P≤π, producing is strictly better than inspecting and than revising.

Significance

Theorem 3.3 reduces the search for an optimal policy in the two-state problem to the choice of three numbers, and it fixes the order of the regions: there is never a revise region below an inspect region, and inspection never occurs below the deterioration probability π\piπ. Together with Theorems 3.4 and 3.7 of the same paper (separate missions in this series), it is the basis for computing optimal inspection policies by searching over thresholds. Theorem 2.2 holds for any countable state space and is the general form of the observation that, in partially observed problems with linear-in-belief action costs, the regions of the "information" and "reset" actions are convex while the region of the passive action need not be.

The results are proved in the paper. As far as a search of the Prove2Me library shows (October 2026), none of them is formalized. Related formal work treats other models: belief-state reductions of finite POMDPs, and abstract contraction models for discounted dynamic programming. The mission produces machine-checked versions of the general model's optimality equation, the concavity of its value function, the convexity of two of its regions, and the two-state structure theorem.

Difficulty

The paper's proofs are short and lean on facts quoted from the literature. Theorem 3.3's proof is two sentences long. Filling it in requires several facts that the paper leaves implicit. The revise region of the two-state model is a closed right-hand interval. The inspect region meets [0,1][0,1][0,1] in an interval, through the affine embedding P↦(1−P,P)P\mapsto(1-P,P)P↦(1−P,P) of [0,1][0,1][0,1] into SSS. The half-open endpoints of the rule select optimal actions. That last point needs continuity of VβV_\betaVβ​ inside (0,1)(0,1)(0,1), a consequence of concavity, and Lemma 3.2 at the left end. The naive reading of the printed theorem, with all three thresholds in [0,1][0,1][0,1], is false in general (see below), so the threshold bookkeeping cannot be skipped.

On the general side, the optimality equation (1) is quoted from Blackwell. Here it must be proved for value iteration on the belief simplex of a countable state space, where the inspect term is an infinite series of values at the rows eie^iei. Its convergence and the contraction estimates use the boundedness of the costs.

Formalization scope

The general model is a structure over a type ι with [Countable ι], a distinguished state i₀, a transition matrix Pm, costs C I R : ι → ℝ and β. A separate predicate Model.Valid requires nonnegative entries, rows with HasSum (Pm i) 1, bounded costs and 0 < β < 1. The simplex uses HasSum P 1, never tsum, so it consists of genuine probability vectors. VβV_\betaVβ​ is defined as limUnder atTop of value iteration from V0=0V^0=0V0=0, which is the paper's own characterization in the proof of Lemma 2.1. It is not an arbitrary function assumed to satisfy (1). The paper's definition as an infimum over measurable policies is not formalized; the policy class would be a separate mission. Regions are subsets of SSS.

The two-state model is the instance ι = Fin 2 with P00=1−πP_{00}=1-\piP00​=1−π, P01=πP_{01}=\piP01​=π, P10=0P_{10}=0P10​=0, P11=1P_{11}=1P11​=1, and its value at the scalar belief PPP is the general VβV_\betaVβ​ at (1−P,P)(1-P,P)(1−P,P). The general Lemma 2.1 and Theorem 2.2 therefore apply to it without restatement. Standing hypotheses of §3 are 0<β<10<\beta<10<β<1, 0≤π≤10\le\pi\le10≤π≤1 and 0<C<I<R0<C<I<R0<C<I<R. 0<C0<C0<C is implicit in the paper, where the good state costs 000 and the bad state CCC. "β\betaβ-optimal rule" means a rule selecting a minimizer of the right side of (3) at every P∈[0,1]P\in[0,1]P∈[0,1], the criterion the paper quotes on p. 588. "Every β\betaβ-optimal policy produces" (Lemma 3.2) means that producing is the unique minimizer.

Threshold repair. The paper prints π≤P1≤P2≤P3≤1\pi\le P_1\le P_2\le P_3\le1π≤P1​≤P2​≤P3​≤1. This is false when revising is never optimal, for instance when R>C/(1−β(1−π))R>C/(1-\beta(1-\pi))R>C/(1−β(1−π)): then always producing is optimal and revising at P=1P=1P=1 is strictly worse, so no rule revising on a nonempty [P3,1][P_3,1][P3​,1] is optimal. The goal keeps P3≤1P_3\le1P3​≤1 exactly when the β\betaβ-optimal revise region is nonempty and otherwise allows P3>1P_3>1P3​>1; the rest of the printed chain, π≤P1≤P2≤1\pi\le P_1\le P_2\le1π≤P1​≤P2​≤1, is kept. Adding the hypothesis R<C/(1−β(1−π))R<C/(1-\beta(1-\pi))R<C/(1−β(1−π)) instead would drop a case the paper covers.

The statement admits no trivializing reading. The thresholds are quantified existentially, but the rule must be optimal at every belief in [0,1][0,1][0,1], VβV_\betaVβ​ is pinned down by its definition, and the paper's numbers (C=4C=4C=4, π=0.1\pi=0.1π=0.1, I=6I=6I=6, R=10R=10R=10, β=0.9\beta=0.9β=0.9) satisfy all hypotheses.

Infrastructure needed: tsum manipulations on the belief simplex (linearity of TTT, summability of ∑iPiV(ei)\sum_iP_iV(e^i)∑i​Pi​V(ei) for bounded VVV), a sup-norm contraction argument for value iteration, and closure of concavity under minima and pointwise limits. The value-iteration and contraction lemmas are reusable for any discounted model with bounded costs. Contributions of intermediate lemmas, such as continuity of the two-state VβV_\betaVβ​ on (0,1](0,1](0,1] or the bridge identities T(1−P,P)=(1−TP,TP)T(1-P,P)=(1-TP,TP)T(1−P,P)=(1−TP,TP), are welcome.

Selected references

  • S. M. Ross, Quality Control under Markovian Deterioration, Management Science 17(9):587–596, 1971. https://doi.org/10.1287/mnsc.17.9.587
  • D. Blackwell, Discounted Dynamic Programming, Annals of Mathematical Statistics 36(1):226–235, 1965. https://doi.org/10.1214/aoms/1177700285
  • K. J. Åström, Optimal Control of Markov Processes with Incomplete State Information, Journal of Mathematical Analysis and Applications 10(1):174–205, 1965. https://doi.org/10.1016/0022-247X(65)90154-X
9 thms1 active userReviewed
Algorithmic Game TheoryProbability·Captain: mikedeng1

Comparison of Threshold Stop Rules and Maximum for Independent Nonnegative Random Variables II: For I.I.D. Variables the Constant 2 Is Best Possible over Threshold RulesResearch Paper

Motivation

A prophet inequality compares two observers of a sequence of nonnegative random variables X1,…,XnX_1, \dots, X_nX1​,…,Xn​. The prophet knows all values in advance and collects Xn∗=max⁡(X1,…,Xn)X_n^* = \max(X_1, \dots, X_n)Xn∗​=max(X1​,…,Xn​). The gambler sees the values one at a time and must decide, irrevocably, when to stop and collect the current value. For independent variables the gambler's optimal value is at least half of EXn∗EX_n^*EXn∗​, and the factor 222 is sharp. Prophet inequalities are a basic tool in the analysis of online mechanisms, posted-price auctions and online selection problems, where the gambler's rule is a pricing policy and the prophet is the offline optimum.

Optimal stopping rules are often difficult to compute and to implement. A threshold rule, which stops at the first value at least ccc, is a posted price, and is the form used in applications. Samuel-Cahn (Ann. Probab. 12 (1984) 1213–1216) proved that a threshold rule alone attains the factor 222: with mmm a median of Xn∗X_n^*Xn∗​, Theorem 1 of the paper gives EXn∗≤2E+Xs(m)EX_n^* \le 2E^+X_{s(m)}EXn∗​≤2E+Xs(m)​ or EXn∗≤2E+Xt(m)EX_n^* \le 2E^+X_{t(m)}EXn∗​≤2E+Xt(m)​. Mission I of this series formalizes that theorem.

Timeline (as recounted on p. 1213 of the paper).

  • 1978: Krengel and Sucheston show EXn∗≤2Vn(X‾)EX_n^* \le 2V_n(\underline X)EXn∗​≤2Vn​(X​), where VnV_nVn​ is the optimal stopping value, for independent Xi≥0X_i \ge 0Xi​≥0; the constant 222 cannot be improved for any n≥2n \ge 2n≥2.
  • 1981: Hill and Kertz show that strict inequality holds in all but trivial cases.
  • 1982: Hill and Kertz show that for i.i.d. XiX_iXi​ the best constant αn\alpha_nαn​ for optimal rules depends on nnn and is bounded by 1.61.61.6.
  • 1983: Kertz (unpublished at the time) proves lim⁡αn=1+a∗=1.341…\lim \alpha_n = 1 + a^* = 1.341\ldotslimαn​=1+a∗=1.341… for a constant a∗a^*a∗ given by an integral equation.
  • 1984: Samuel-Cahn shows that a median threshold rule achieves the factor 222 (Theorem 1), and that for threshold rules the factor 222 cannot be lowered even for i.i.d. variables (Theorem 2). This mission is Theorem 2.

Setting

Fix n≥1n \ge 1n≥1 and a probability law μ\muμ on [0,∞)[0, \infty)[0,∞). Let X1,…,XnX_1, \dots, X_nX1​,…,Xn​ be independent with common law μ\muμ, and Xn∗=max⁡(X1,…,Xn)X_n^* = \max(X_1, \dots, X_n)Xn∗​=max(X1​,…,Xn​). For a constant c≥0c \ge 0c≥0 the threshold rules are

  • t(c)t(c)t(c): the smallest i<ni < ni<n with Xi≥cX_i \ge cXi​≥c, and t(c)=nt(c) = nt(c)=n otherwise;
  • s(c)s(c)s(c): the smallest i<ni < ni<n with Xi>cX_i > cXi​>c, and s(c)=ns(c) = ns(c)=n otherwise.

The stopped value is Xt(c)X_{t(c)}Xt(c)​ or Xs(c)X_{s(c)}Xs(c)​. The truncated expectations are E+Xt(c)=E[Xt(c)I(Xt(c)≥c)]E^+X_{t(c)} = E[X_{t(c)} I(X_{t(c)} \ge c)]E+Xt(c)​=E[Xt(c)​I(Xt(c)​≥c)] and E+Xs(c)=E[Xs(c)I(Xs(c)>c)]E^+X_{s(c)} = E[X_{s(c)} I(X_{s(c)} > c)]E+Xs(c)​=E[Xs(c)​I(Xs(c)​>c)]: they discard the forced stop at time nnn below the threshold. The class Tn∗T_n^*Tn∗​ is the set of all t(c)t(c)t(c) and s(c)s(c)s(c) with c≥0c \ge 0c≥0.

The lower half of the theorem uses an explicit family. For 0<a<10 < a < 10<a<1, b>0b > 0b>0, c>0c > 0c>0 and n>b+cn > b + cn>b+c, the variables Xi(n)X_i^{(n)}Xi(n)​ take the values 000, aaa, 111 with probabilities 1−(b+c)/n1 - (b+c)/n1−(b+c)/n, c/nc/nc/n, b/nb/nb/n. Two constants enter:

a∗=c(1−e−b)−be−b(1−e−c)c(1−e−b−c),Q(b,c)=1+e−b−e−b−c1−e−b−c−b(e−b−e−b−c)2c(1−e−b−c)(1−e−b).a^* = \frac{c(1 - e^{-b}) - b e^{-b}(1 - e^{-c})}{c(1 - e^{-b-c})}, \qquad Q(b, c) = 1 + \frac{e^{-b} - e^{-b-c}}{1 - e^{-b-c}} - \frac{b(e^{-b} - e^{-b-c})^2}{c(1 - e^{-b-c})(1 - e^{-b})}.a∗=c(1−e−b−c)c(1−e−b)−be−b(1−e−c)​,Q(b,c)=1+1−e−b−ce−b−e−b−c​−c(1−e−b−c)(1−e−b)b(e−b−e−b−c)2​.

This a∗a^*a∗ is unrelated to the a∗a^*a∗ of the NOTE in §1 of the paper.

In Lean (SamuelCahnProphet.IID), a sample is x : Fin n → ℝ under iidLaw μ n, the product measure; tIdx x c and sIdx x c are t(c)t(c)t(c) and s(c)s(c)s(c); Emax, EstopT, EstopS, EplusT, EplusS are EXn∗EX_n^*EXn∗​, EXt(c)EX_{t(c)}EXt(c)​, EXs(c)EX_{s(c)}EXs(c)​ and the E+E^+E+ terms; supE and supEplus are the two suprema over Tn∗T_n^*Tn∗​; threePoint n a b c is the law of Xi(n)X_i^{(n)}Xi(n)​; aStarIID and Q are the constants above.

Formalization targets

Goal: Theorem 2 (p. 1215)

sup⁡nsup⁡X‾[EXn∗sup⁡t∈Tn∗E+Xt]=sup⁡nsup⁡X‾[EXn∗sup⁡t∈Tn∗EXt]=2,\sup_n \sup_{\underline X} \left[\frac{EX_n^*}{\sup_{t \in T_n^*} E^+X_t}\right] = \sup_n \sup_{\underline X} \left[\frac{EX_n^*}{\sup_{t \in T_n^*} EX_t}\right] = 2,nsup​X​sup​[supt∈Tn∗​​E+Xt​EXn∗​​]=nsup​X​sup​[supt∈Tn∗​​EXt​EXn∗​​]=2,

over i.i.d. nonnegative X‾\underline XX​. It is stated as three facts: EXn∗≤2sup⁡Tn∗E+XtEX_n^* \le 2 \sup_{T_n^*} E^+X_tEXn∗​≤2supTn∗​​E+Xt​ for every nnn and law; sup⁡Tn∗E+Xt≤sup⁡Tn∗EXt\sup_{T_n^*} E^+X_t \le \sup_{T_n^*} EX_tsupTn∗​​E+Xt​≤supTn∗​​EXt​; and for every ε>0\varepsilon > 0ε>0 some nnn and law with (2−ε)sup⁡Tn∗EXt<EXn∗(2 - \varepsilon)\sup_{T_n^*} EX_t < EX_n^*(2−ε)supTn∗​​EXt​<EXn∗​.

Milestones (proof of Theorem 2, p. 1215)

  1. The upper bound EXn∗≤2sup⁡Tn∗E+XtEX_n^* \le 2\sup_{T_n^*} E^+X_tEXn∗​≤2supTn∗​​E+Xt​, attributed to Theorem 1.
  2. lim⁡nEXn(n)∗=1−e−b+a{e−b−e−b−c}\lim_n EX_n^{(n)*} = 1 - e^{-b} + a\{e^{-b} - e^{-b-c}\}limn​EXn(n)∗​=1−e−b+a{e−b−e−b−c}.
  3. For the three-point law, sup⁡Tn∗EXt=max⁡{EXt(a),EXt(1)}\sup_{T_n^*} EX_t = \max\{EX_{t(a)}, EX_{t(1)}\}supTn∗​​EXt​=max{EXt(a)​,EXt(1)​}.
  4. W(a)=lim⁡nEXt(a)(n)=(1−e−b−c)(b+ac)/(b+c)W(a) = \lim_n EX^{(n)}_{t(a)} = (1 - e^{-b-c})(b + ac)/(b + c)W(a)=limn​EXt(a)(n)​=(1−e−b−c)(b+ac)/(b+c).
  5. W(1)=lim⁡nEXt(1)(n)=1−e−bW(1) = \lim_n EX^{(n)}_{t(1)} = 1 - e^{-b}W(1)=limn​EXt(1)(n)​=1−e−b.
  6. W(a∗)=W(1)W(a^*) = W(1)W(a∗)=W(1) and 0<a∗<10 < a^* < 10<a∗<1.
  7. With a=a∗a = a^*a=a∗, lim⁡nEXn(n)∗/sup⁡Tn∗EXt(n)=Q(b,c)\lim_n EX_n^{(n)*}/\sup_{T_n^*} EX_t^{(n)} = Q(b, c)limn​EXn(n)∗​/supTn∗​​EXt(n)​=Q(b,c).
  8. Q(b,c)→2Q(b, c) \to 2Q(b,c)→2 as b→0+b \to 0^+b→0+ and c→∞c \to \inftyc→∞.

Significance

Theorem 1 says a posted price recovers half of the prophet's value. Theorem 2 says this guarantee is tight within the class of threshold rules even under the most favourable independence structure, identical distributions. This matters because for optimal rules the i.i.d. constant is at most 1.61.61.6 (Hill and Kertz 1982); the theorem separates threshold rules from optimal rules in the i.i.d. case and sets the benchmark that later single-threshold and order-selection analyses compare against.

The result is proved in the paper; to our knowledge no machine-checked proof exists. This mission produces one: a formal model of threshold rules on an i.i.d. sample, exact asymptotics of the expected maximum and of two stopped values for a triangular array of three-point laws, the reduction of the class Tn∗T_n^*Tn∗​ to two rules, and the two-parameter limit. The upper bound (milestone 1) is the i.i.d. case of mission I's goal, and may later be closed by reference to it.

Difficulty

The limits are "easily seen" on the page, but each requires controlling (1−x/n)n−1(1 - x/n)^{n-1}(1−x/n)n−1 uniformly with the exact law of a stopped index on a product space, including the forced stop at nnn whose contribution vanishes only in the limit. Milestone 3 is a finite claim over an uncountable family of rules: every t(c)t(c)t(c) and s(c)s(c)s(c) with c≥0c \ge 0c≥0 must be shown to coincide almost surely with one of t(0)t(0)t(0), t(a)t(a)t(a), t(1)t(1)t(1) or stopping at nnn, and the first and last must be shown dominated by t(a)t(a)t(a) for every finite n>b+cn > b + cn>b+c, not only asymptotically. The final step is a joint limit in (b,c)(b, c)(b,c), in which b/(1−e−b)→1b/(1 - e^{-b}) \to 1b/(1−e−b)→1 while the correction term vanishes like 1/c1/c1/c; an iterated limit is not the statement.

Formalization scope

The i.i.d. variables are the coordinates of Rn\mathbb R^nRn under the product measure μ⊗n\mu^{\otimes n}μ⊗n; all quantities depend only on the joint law, so the supremum over X‾\underline XX​ is a supremum over laws μ\muμ with μ((−∞,0))=0\mu((-\infty, 0)) = 0μ((−∞,0))=0. Indices are 0-based in Fin n with [NeZero n], the paper's index nnn being ⊤. Expectations are lintegrals of ENNReal.ofReal in [0,∞][0, \infty][0,∞]: no integrability is assumed and EXn∗=∞EX_n^* = \inftyEXn∗​=∞ is allowed. The sup over Tn∗T_n^*Tn∗​ ranges over c≥0c \ge 0c≥0 and over both families t(c)t(c)t(c) and s(c)s(c)s(c). Limits along the triangular array are indexed by n=k+1n = k + 1n=k+1 and taken in R\mathbb RR after toReal; the early terms with n≤b+cn \le b + cn≤b+c, where the clipped weights of threePoint do not form a probability measure, do not affect any limit.

The page's ratios are not written literally: in [0,∞][0, \infty][0,∞] the quotients 0/00/00/0 and ∞/∞\infty/\infty∞/∞ take junk values, so a literal supremum of ratios would be decided by degenerate laws. The goal's third fact uses a strict inequality and requires an explicit probability law on [0,∞)[0, \infty)[0,∞), which rules out the Dirac mass at 000 and sub-probability witnesses.

A complete development needs: the law of the first index of a product sample entering a set, expectations of finite-valued functions under Measure.pi, the limit (1−x/n)n→e−x(1 - x/n)^n \to e^{-x}(1−x/n)n→e−x along a triangular array, and elementary bounds on the exponential. The first two are reusable for any threshold or secretary-type stopping problem on i.i.d. samples. Proofs of the milestones in any order are welcome, as is a proof of the upper bound that does not route through the median.

Selected references

  • E. Samuel-Cahn, Comparison of threshold stop rules and maximum for independent nonnegative random variables, Ann. Probab. 12(4) (1984) 1213–1216. https://doi.org/10.1214/aop/1176993150
  • U. Krengel and L. Sucheston, On semiamarts, amarts, and processes with finite value, in Probability on Banach Spaces, Adv. Probab. Related Topics 4, Dekker, New York (1978) 197–266.
  • T. P. Hill and R. P. Kertz, Ratio comparisons of supremum and stop rule expectations, Z. Wahrsch. verw. Gebiete 56 (1981) 283–285. https://doi.org/10.1007/BF00536175
  • T. P. Hill and R. P. Kertz, Comparisons of stop rule and supremum expectations of i.i.d. random variables, Ann. Probab. 10(2) (1982) 336–345. https://doi.org/10.1214/aop/1176993861
10 thms1 active userReviewed
CombinatoricsGraph TheoryLinear Optimization·Captain: mikedeng1

Integer Programming Formulation of Traveling Salesman Problems: The Miller–Tucker–Zemlin Constraints Exactly Describe the Itineraries with at Most p Cities per TourResearch Paper

Why this formulation matters

The traveling salesman problem asks for a shortest closed route through a set of cities. Writing it as an integer program requires linear constraints whose integer solutions are exactly the routes. The assignment constraints (each city entered once and left once) are not enough: their integer solutions include collections of disjoint cycles, called subtours, that never pass through the starting city. Some extra family of constraints must rule these out.

In 1960 C. E. Miller, A. W. Tucker and R. A. Zemlin gave such a family using one auxiliary real variable per city (J. ACM 7(4), 326–329). Their MTZ constraints have polynomially many rows, n2−nn^2-nn2−n for nnn cities, whereas the subtour elimination constraints of Dantzig, Fulkerson and Johnson (1954) (Oper. Res. 2(4)) have one row per subset of cities. They also handle a generalization: a salesman who returns to base several times, visiting at most ppp cities per trip. This is the basic form of a capacitated vehicle routing problem. MTZ-type constraints remain standard in vehicle routing models and in textbook formulations of the TSP. Their linear relaxations are known to be weaker than those of the subtour elimination formulation (Padberg and Sung, 1991).

The paper attributes the model to Tucker and reports five machine experiments with Gomory's all-integer algorithm. The computational part is outside this mission.

Setting

There are nnn cities 1,…,n1,\dots,n1,…,n and a base city 000. A tour is a succession of visits to cities without stopping at city 000. In problem (1) the salesman leaves 000, visits each of the nnn cities exactly once and returns to 000, possibly several times, with at most ppp cities per tour. Formally, an itinerary is a list I=(T1,…,Tt)I=(T_1,\dots,T_t)I=(T1​,…,Tt​) of tours. Each tour is a nonempty list of cities other than 000 of length at most ppp, and each city 1,…,n1,\dots,n1,…,n occurs exactly once in the concatenation of the tours. The number ttt of tours is the number of returns to 000. Tour (c1,…,ck)(c_1,\dots,c_k)(c1​,…,ck​) travels the arcs (0,c1),(c1,c2),…,(ck,0)(0,c_1),(c_1,c_2),\dots,(c_k,0)(0,c1​),(c1​,c2​),…,(ck​,0). aij(I)a_{ij}(I)aij​(I) denotes the number of times III travels the arc (i,j)(i,j)(i,j). For real distances dijd_{ij}dij​, the length of III is the sum of dijd_{ij}dij​ over the arcs it travels.

Problem (2) has non-negative integer variables xijx_{ij}xij​ (0≤i≠j≤n0\le i\ne j\le n0≤i=j≤n) and real variables u1,…,unu_1,\dots,u_nu1​,…,un​:

min⁡∑∑0≤i≠j≤ndijxijs.t.∑i=0i≠jnxij=1 (j≥1),∑j=0j≠inxij=1 (i≥1),ui−uj+p xij≤p−1 (1≤i≠j≤n).\min \sum\sum_{0\le i\ne j\le n} d_{ij}x_{ij}\quad\text{s.t.}\quad \sum_{\substack{i=0\\ i\ne j}}^{n} x_{ij}=1\ (j\ge1),\quad \sum_{\substack{j=0\\ j\ne i}}^{n} x_{ij}=1\ (i\ge1),\quad u_i-u_j+p\,x_{ij}\le p-1\ (1\le i\ne j\le n).min∑0≤i=j≤n∑​dij​xij​s.t.i=0i=j​∑n​xij​=1 (j≥1),j=0j=i​∑n​xij​=1 (i≥1),ui​−uj​+pxij​≤p−1 (1≤i=j≤n).

When the number of tours ttt is fixed, the relation ∑i=1nxi0=t\sum_{i=1}^n x_{i0}=t∑i=1n​xi0​=t is added. With t=1t=1t=1 and p≥np\ge np≥n, (1) is the standard traveling salesman problem.

Formalization targets

Goal: the equivalence of (1) and (2)

For every n≥0n\ge0n≥0 and every p≥1p\ge1p≥1:

{ x:∃u, (x,u) feasible for (2) }  =  { a(I):I a legitimate itinerary of (1) },\{\,x : \exists u,\ (x,u)\ \text{feasible for (2)}\,\} \;=\; \{\,a(I) : I \text{ a legitimate itinerary of (1)}\,\},{x:∃u, (x,u) feasible for (2)}={a(I):I a legitimate itinerary of (1)},

with ∑i=1nxi0\sum_{i=1}^n x_{i0}∑i=1n​xi0​ equal to the number of tours t(I)t(I)t(I), and with the uiu_iui​ in the converse taken to be non-negative integers. In addition, ∑∑i≠jdij aij(I)\sum\sum_{i\ne j} d_{ij}\,a_{ij}(I)∑∑i=j​dij​aij​(I) equals the length of III for all real ddd. The paper says that (2) "will be shown to be equivalent to (1)". Its "burden of proof" is that the two feasible sets correspond and the two objectives agree, and the goal states exactly that.

Milestones, in the order of the paper's proof

  1. The constraints of (2) force xij∈{0,1}x_{ij}\in\{0,1\}xij​∈{0,1} (p. 327).
  2. Along a path r0,…,rmr_0,\dots,r_mr0​,…,rm​ of non-base cities with all xrkrk+1=1x_{r_kr_{k+1}}=1xrk​rk+1​​=1, ur0−urm≤−mu_{r_0}-u_{r_m}\le-mur0​​−urm​​≤−m (p. 328).
  3. A feasible xxx has no cycle that avoids city 000, so all tours include city 0 (pp. 327–328).
  4. For p≥1p\ge1p≥1, no tour of a feasible xxx visits more than ppp cities (p. 328).
  5. The converse: ui=u_i=ui​= the position of city iii in its tour makes (a(I),u)(a(I),u)(a(I),u) feasible, with 1≤ui≤p1\le u_i\le p1≤ui​≤p (p. 328).
  6. Under x=a(I)x=a(I)x=a(I) the objective of (2) is the distance travelled in (1) (p. 327).
  7. An itinerary with ttt tours of at most ppp cities requires tp≥ntp\ge ntp≥n (p. 326).

Significance

The result. The theorem justifies using (2) in place of (1). Because the feasible sets match and the objectives agree, an optimal solution of (2) is an optimal itinerary of (1), and the same holds with the number of tours fixed. It also shows that a compact, polynomial-size family of linear inequalities in auxiliary potentials excludes every subtour. The same idea, with the uiu_iui​ read as loads or arrival times, underlies the standard capacity and time-window constraints of vehicle routing.

Formalizing it. The result is classical and its proof is short, but the paper argues informally. It follows successor chains, treats "a tour" without defining an itinerary, and leaves several steps implicit, including the hypothesis p≥1p\ge1p≥1 and the distinctness of rp+1r_{p+1}rp+1​ and r1r_1r1​. No machine-checked statement of the MTZ equivalence is recorded on the platform. The remaining work is the whole formal proof: the combinatorics that turns a 0/1 matrix with unit row and column sums and no subtours into a list of tours, the converse labelling, and the bookkeeping identity between the two objectives.

Difficulty

The inequalities themselves are elementary. Each milestone about (2) is a short computation with the potentials uiu_iui​. The work is in the passage from a feasible matrix xxx to an itinerary. The successor walk from city 000 must be shown to terminate at 000 and to cover every arc of xxx. The resulting tours must be listed so that their arc counts reproduce xxx exactly, including the number of arcs leaving 000. That number is not constrained directly in (2). It equals ∑ixi0\sum_{i}x_{i0}∑i​xi0​ only through a counting argument on the row and column sums. A proof that only shows some itinerary exists does not establish the correspondence the paper claims.

Formalization scope

Cities are Fin (n + 1) with 0 the base city, which is the paper's indexing. The commitments, each also stated in the items' Formalization Notes, are:

  • An itinerary is a List of tours, each tour a List of cities. The paper's "legitimate itinerary" is read as: every tour nonempty, free of 0, of length at most ppp; the concatenation duplicate-free; every city 1,…,n1,\dots,n1,…,n present.
  • "A feasible solution to (2) has xijx_{ij}xij​ which do define a legitimate itinerary" is read as x=a(I)x=a(I)x=a(I), the arc counts of III, together with ∑i=1nxi0=t(I)\sum_{i=1}^n x_{i0}=t(I)∑i=1n​xi0​=t(I) ("The number of returns to city 0 is given by ∑xi0\sum x_{i0}∑xi0​"). Arc counts are counts, so xij∈{0,1}x_{ij}\in\{0,1\}xij​∈{0,1} is a theorem, not an encoding choice.
  • "Together with appropriate uiu_iui​" is made explicit as the existence of natural-number uiu_iui​, following the paper's remark that the uiu_iui​ may be taken non-negative integers. The labelling ui=ju_i=jui​=j is a definition.
  • Problem (2) has no variables xiix_{ii}xii​. The matrix xxx is indexed by all pairs and the clause xii=0x_{ii}=0xii​=0 encodes their absence. u0u_0u0​ exists in the encoding but appears in no constraint.
  • xij∈Nx_{ij}\in\mathbb Nxij​∈N ("non-negative integers"), ui∈Ru_i\in\mathbb Rui​∈R ("arbitrary real numbers"), and p−1p-1p−1 and p xijp\,x_{ij}pxij​ are computed in R\mathbb RR.
  • Added hypothesis p≥1p\ge1p≥1 in the goal and in milestone 4. The paper does not state it, and the claim is false without it: for n=1n=1n=1, p=0p=0p=0, x01=x10=1x_{01}=x_{10}=1x01​=x10​=1 is feasible for (2) but no itinerary exists.
  • The distances dijd_{ij}dij​ are arbitrary reals, with no sign, symmetry or triangle condition, as on the page.
  • Milestone 2 states the exact summed bound −m-m−m. The page prints the weaker j+1−kj+1-kj+1−k.
  • Milestone 3 excludes every cycle of xxx avoiding 000. The page argues for the cycle met while following successors from 000, by an argument that applies to any such cycle.

Not formalized: the constraint and variable counts and the elimination of xi0,x0jx_{i0},x_{0j}xi0​,x0j​ "to produce an equivalent problem with n2+nn^2+nn2+n inequalities and n2n^2n2 variables" (p. 328), which the paper does not make precise, and the machine experiments (pp. 328–329).

Trivializing readings are ruled out. The goal identifies xxx with the arc counts of an itinerary, not merely the existence of some itinerary. The hypotheses are satisfiable: for n=3n=3n=3, p=2p=2p=2, the itinerary [[1,2],[3]][[1,2],[3]][[1,2],[3]] with u=(1,2,1)u=(1,2,1)u=(1,2,1) is feasible for (2), while the subtour x01=x10=x23=x32=1x_{01}=x_{10}=x_{23}=x_{32}=1x01​=x10​=x23​=x32​=1 is not, for any uuu. Contributions welcome: proofs of the milestones, a reusable library of "functional digraph with unit in- and out-degree" decompositions, and the optimization corollary (equal optimal values of (1) and (2)).

Selected references

  • C. E. Miller, A. W. Tucker, R. A. Zemlin, Integer Programming Formulation of Traveling Salesman Problems, Journal of the ACM 7(4), 326–329, 1960. https://doi.org/10.1145/321043.321046
  • G. Dantzig, R. Fulkerson, S. Johnson, Solution of a Large-Scale Traveling-Salesman Problem, Operations Research 2(4), 393–410, 1954. https://doi.org/10.1287/opre.2.4.393
  • M. Padberg, T.-Y. Sung, An analytical comparison of different formulations of the travelling salesman problem, Mathematical Programming 52, 315–357, 1991. https://doi.org/10.1007/BF01582894
  • R. E. Gomory, Outline of an algorithm for integer solutions to linear programs, Bulletin of the AMS 64(5), 275–278, 1958. https://doi.org/10.1090/S0002-9904-1958-10224-4
9 thms1 active userReviewed
Convex OptimizationFunctional Analysis·Captain: mikedeng1

Stochastic Convex Programming: Basic Duality 1: With Bounded Constraint Sets the Two-Stage Stochastic Convex Program Satisfies min P = sup DResearch Paper

Motivation

A two-stage stochastic program with recourse models a decision taken in two steps: a first-stage decision is fixed before a random outcome is observed, and a second-stage (recourse) decision is chosen after the outcome is known, both subject to constraints and both incurring costs. The model is the standard framework for planning under uncertainty in operations research: capacity planning, production and inventory, energy dispatch, finance.

For linear recourse problems, duality was developed in the 1960s and early 1970s by Wets and others, partly under integrability restrictions on the random data. R. T. Rockafellar and R. J.-B. Wets, Stochastic convex programming: basic duality (Pacific J. Math. 62 (1976), doi:10.2140/pjm.1976.62.173), treat the convex case, where every cost and constraint function is convex, by embedding the problem in a family of perturbed problems and applying the perturbational theory of convex duality (Rockafellar, Conjugate Duality and Optimization, SIAM 1974) together with the theory of convex integral functionals. The paper's dual variables are integrable price systems, interpreted as equilibrium prices for perturbations of the constraints; it is the starting point of a series of papers by the same authors on stochastic convex programming (relatively complete recourse, Kuhn–Tucker conditions, singular multipliers).

Setting

Let (S,Σ,σ)(S,\Sigma,\sigma)(S,Σ,σ) be a probability space. A vector x1∈Rn1x_1\in\mathbb R^{n_1}x1​∈Rn1​ is chosen subject to x1∈C1x_1\in C_1x1​∈C1​ and f1i(x1)≤0f_{1i}(x_1)\le 0f1i​(x1​)≤0 (i=1,…,m1i=1,\dots,m_1i=1,…,m1​), at cost f10(x1)f_{10}(x_1)f10​(x1​). Then s∈Ss\in Ss∈S is observed and x2(s)∈Rn2x_2(s)\in\mathbb R^{n_2}x2​(s)∈Rn2​ is chosen subject to x2(s)∈C2x_2(s)\in C_2x2​(s)∈C2​ and f2i(s,x1,x2(s))≤0f_{2i}(s,x_1,x_2(s))\le 0f2i​(s,x1​,x2​(s))≤0 (i=1,…,m2i=1,\dots,m_2i=1,…,m2​), at cost f20(s,x1,x2(s))f_{20}(s,x_1,x_2(s))f20​(s,x1​,x2​(s)). The aim is to minimize the expected cost

f10(x1)+∫Sf20(s,x1,x2(s)) σ(ds).f_{10}(x_1)+\int_S f_{20}(s,x_1,x_2(s))\,\sigma(ds).f10​(x1​)+∫S​f20​(s,x1​,x2​(s))σ(ds).

The standing assumptions are: C1C_1C1​, C2C_2C2​ convex, closed and nonempty; f1if_{1i}f1i​ and f2i(s,⋅,⋅)f_{2i}(s,\cdot,\cdot)f2i​(s,⋅,⋅) convex and finite everywhere; s↦f2i(s,x1,x2)s\mapsto f_{2i}(s,x_1,x_2)s↦f2i​(s,x1​,x2​) measurable, summable for i=0i=0i=0 and bounded for i≥1i\ge 1i≥1.

Decisions live in X=Rn1×Ln2∞X=\mathbb R^{n_1}\times\mathcal L^\infty_{n_2}X=Rn1​×Ln2​∞​ and perturbations in U=Rm1×Lm2∞U=\mathbb R^{m_1}\times\mathcal L^\infty_{m_2}U=Rm1​×Lm2​∞​. The perturbation functional F(x,u)F(x,u)F(x,u) is the expected cost if xxx satisfies the constraints with right-hand sides u1u_1u1​ and, almost surely, u2(s)u_2(s)u2​(s), and +∞+\infty+∞ otherwise. The problem P\mathbf PP minimizes F(x,0)F(x,0)F(x,0).

The space Y=Rm1×Lm21Y=\mathbb R^{m_1}\times\mathcal L^1_{m_2}Y=Rm1​×Lm2​1​ is paired with UUU by ⟨u,y⟩=u1⋅y1+∫Su2(s)⋅y2(s) σ(ds)\langle u,y\rangle=u_1\cdot y_1+\int_S u_2(s)\cdot y_2(s)\,\sigma(ds)⟨u,y⟩=u1​⋅y1​+∫S​u2​(s)⋅y2​(s)σ(ds), and V=Rn1×Ln21V=\mathbb R^{n_1}\times\mathcal L^1_{n_2}V=Rn1​×Ln2​1​ with XXX in the same way. The Lagrangian is L(x,y)=inf⁡u∈U{⟨u,y⟩+F(x,u)}L(x,y)=\inf_{u\in U}\{\langle u,y\rangle+F(x,u)\}L(x,y)=infu∈U​{⟨u,y⟩+F(x,u)}, the dual D\mathbf DD maximizes g(y)=inf⁡x∈XL(x,y)g(y)=\inf_{x\in X}L(x,y)g(y)=infx∈X​L(x,y) over y∈Yy\in Yy∈Y, and the perturbation function is φ(u)=inf⁡x∈XF(x,u)\varphi(u)=\inf_{x\in X}F(x,u)φ(u)=infx∈X​F(x,u). Conjugates φ∗\varphi^*φ∗, φ∗∗\varphi^{**}φ∗∗ are taken with respect to the pairing of UUU with YYY.

Formalization targets

Goal: Theorem 3

If C1C_1C1​ and C2C_2C2​ are bounded, then

min⁡P=sup⁡D>−∞,\min\mathbf P=\sup\mathbf D>-\infty,minP=supD>−∞,

and in fact φ\varphiφ is a proper convex function on UUU, lower semicontinuous for the weak topology σ(U,Y)\sigma(U,Y)σ(U,Y), the infimum defining φ(u)\varphi(u)φ(u) is attained for every u∈Uu\in Uu∈U, and φ∗∗=φ\varphi^{**}=\varphiφ∗∗=φ. The goal is the theorem exactly as printed, all conclusions included.

Milestones

  1. p. 174: for bounded measurable x1(⋅)x_1(\cdot)x1​(⋅), x2(⋅)x_2(\cdot)x2​(⋅), the functions s↦f2i(s,x1(s),x2(s))s\mapsto f_{2i}(s,x_1(s),x_2(s))s↦f2i​(s,x1​(s),x2​(s)) are measurable, summable for i=0i=0i=0 and essentially bounded for i≥1i\ge1i≥1.
  2. Proposition 3: FFF is convex, not identically +∞+\infty+∞, and lower semicontinuous on X×UX\times UX×U for the norm topology and for the weak topology induced by V×YV\times YV×Y.
  3. (4.9): with C1,C2C_1,C_2C1​,C2​ bounded, X0={x:x1∈C1, x2(s)∈C2 a.s.}X_0=\{x: x_1\in C_1,\ x_2(s)\in C_2\text{ a.s.}\}X0​={x:x1​∈C1​, x2​(s)∈C2​ a.s.} is weakly compact in XXX, and X0′={x2∈Ln2∞:x2(s)∈C2 a.s.}X_0'=\{x_2\in\mathcal L^\infty_{n_2}: x_2(s)\in C_2\text{ a.s.}\}X0′​={x2​∈Ln2​∞​:x2​(s)∈C2​ a.s.} is compact in σ(Ln2∞,Ln21)\sigma(\mathcal L^\infty_{n_2},\mathcal L^1_{n_2})σ(Ln2​∞​,Ln2​1​).
  4. (4.1): g(y)=inf⁡u{⟨u,y⟩+φ(u)}=−φ∗(−y)g(y)=\inf_{u}\{\langle u,y\rangle+\varphi(u)\}=-\varphi^*(-y)g(y)=infu​{⟨u,y⟩+φ(u)}=−φ∗(−y).
  5. (4.2): φ∗∗(0)=sup⁡D\varphi^{**}(0)=\sup\mathbf Dφ∗∗(0)=supD.

The mission also poses the explicit form (1.8) of the Lagrangian and Corollary 1 (dual solutions are the negatives of subgradients of φ\varphiφ at 000; saddle-point characterization of primal solutions when ∂φ(0)≠∅\partial\varphi(0)\ne\emptyset∂φ(0)=∅).

Significance

Theorem 3 gives, for bounded constraint sets, the absence of a duality gap between a convex recourse problem with essentially bounded decisions and its Lagrangian dual over integrable multipliers, together with existence of an optimal decision. Through Corollary 1 it reduces the necessity of the Kuhn–Tucker (saddle-point) optimality conditions to the single question whether ∂φ(0)\partial\varphi(0)∂φ(0) is nonempty, and through the paper's later results it describes the directional derivatives of the optimal value with respect to perturbations of the constraints.

The result has been proved since 1976; it has not been machine-checked. A formal development produces the problem model on L∞\mathcal L^\inftyL∞ and L1\mathcal L^1L1 spaces, the weak topologies of the pairings, and conjugate duality for extended-real-valued functions on such paired spaces, none of which is currently available as a ready-made Lean statement on this platform.

Difficulty

The obvious argument fails at two points. First, inf⁡P=sup⁡D\inf\mathbf P=\sup\mathbf DinfP=supD is φ(0)=φ∗∗(0)\varphi(0)=\varphi^{**}(0)φ(0)=φ∗∗(0), and the biconjugate equals φ\varphiφ only for a lower semicontinuous proper convex function in a topology compatible with the pairing. Lower semicontinuity of φ\varphiφ in the norm topology of UUU is not enough: the pairing is with L1\mathcal L^1L1, not with the norm dual of L∞\mathcal L^\inftyL∞, so the relevant topology is the weak topology σ(U,Y)\sigma(U,Y)σ(U,Y), and an infimum of lower semicontinuous functions is in general not lower semicontinuous. Second, the lower semicontinuity of FFF itself, in the weak topology, is a statement about convex integral functionals on L∞\mathcal L^\inftyL∞ that rests on measurability of the integrands in sss jointly with continuity in the decision variables. Boundedness of C1C_1C1​, C2C_2C2​ is what supplies the compactness that is otherwise missing.

Formalization scope

  • Rn\mathbb R^nRn is Fin n → ℝ and the products u1⋅y1u_1\cdot y_1u1​⋅y1​, u2(s)⋅y2(s)u_2(s)\cdot y_2(s)u2​(s)⋅y2​(s) are dot products. Constraint indices i=1,…,mi=1,\dots,mi=1,…,m are Fin m.
  • Ln∞\mathcal L^\infty_nLn∞​ and Ln1\mathcal L^1_nLn1​ are Mathlib's Lp (Fin n → ℝ) ⊤ σ and Lp (Fin n → ℝ) 1 σ, spaces of almost-everywhere classes; all second-stage conditions are stated almost surely. σ\sigmaσ is a probability measure (IsProbabilityMeasure).
  • Values in R∪{±∞}\mathbb R\cup\{\pm\infty\}R∪{±∞} are EReal; infima and suprema are lattice operations in EReal, so there are no junk values for empty or unbounded sets. Every sum has a real first summand, so no ∞−∞\infty-\infty∞−∞ convention enters.
  • The expected cost is a real Bochner integral; its integrand is summable for x2∈L∞x_2\in\mathcal L^\inftyx2​∈L∞ (milestone 1), so it is the true expected cost. No extended-real-valued function is ever integrated.
  • A weak topology "induced by the pairing" is the coarsest topology making every functional of the pairing continuous; the product weak topology on X×UX\times UX×U is the product of the two. These are passed explicitly. Replacing them by the norm topologies would make the lower semicontinuity statements strictly weaker and the compactness statement false; such a formalization does not count.
  • An extended-real function is convex when its epigraph is convex, and proper when it never takes −∞-\infty−∞ and is somewhere finite.
  • Boundedness of C1C_1C1​, C2C_2C2​ is assumed exactly where the paper assumes it: Theorem 3, (4.9) and Corollary 1.

A complete development needs the identification of L∞\mathcal L^\inftyL∞ with the dual of L1\mathcal L^1L1 on a probability space (for weak-* compactness), lower semicontinuity of convex integral functionals, and conjugate duality on paired locally convex spaces. These are reusable well beyond this mission. Proofs of milestones, and of auxiliary lemmas of this kind as separate theorems, are welcome. The mission Stochastic Convex Programming: Basic Duality 2 formalizes the paper's other main result, on the first-stage problem and attainment of the recourse.

Selected references

  • R. T. Rockafellar and R. J.-B. Wets, Stochastic convex programming: basic duality, Pacific Journal of Mathematics 62(1) (1976) 173–195. https://doi.org/10.2140/pjm.1976.62.173
  • R. T. Rockafellar, Conjugate Duality and Optimization, CBMS-NSF Regional Conference Series in Applied Mathematics 16, SIAM, 1974. https://doi.org/10.1137/1.9781611970524
  • R. T. Rockafellar, Integrals which are convex functionals, Pacific Journal of Mathematics 24(3) (1968) 525–539. https://doi.org/10.2140/pjm.1968.24.525
  • R. T. Rockafellar, Integrals which are convex functionals, II, Pacific Journal of Mathematics 39(2) (1971) 439–469. https://doi.org/10.2140/pjm.1971.39.439
  • R. J.-B. Wets, Stochastic programs with fixed recourse: the equivalent deterministic program, SIAM Review 16(3) (1974) 309–339. https://doi.org/10.1137/1016053
8 thms1 active userReviewed
Convex OptimizationFunctional AnalysisOptimization·Captain: mikedeng1

Régularisation d'inéquations variationnelles par approximations successives I: Every Weak Cluster Point of the Regularized Iterates Solves the Monotone Variational InequalityResearch Paper

Motivation

The proximal point algorithm is a basic iterative scheme of convex optimization and monotone operator theory. To solve a problem governed by a monotone operator, it replaces the problem by a sequence of better-conditioned problems, each regularized by a quadratic term centred at the previous iterate. Augmented Lagrangian methods, the Douglas–Rachford and ADMM splitting schemes, and many bundle methods can all be read as instances of it.

The scheme first appeared in a five-page note by Bernard Martinet in the Revue française d'informatique et de recherche opérationnelle (1970), under the name régularisation par approximations successives. Martinet stated it for a monotone variational inequality on a bounded closed convex subset of a Hilbert space and proved that the weak cluster points of the iterates are solutions. This mission formalizes that first convergence theorem as it was originally stated.

Timeline.

  • 1966–1967: Hartman–Stampacchia and Lions–Stampacchia prove existence of solutions for monotone, hemicontinuous variational inequalities on bounded closed convex sets (Lions–Stampacchia 1967). Minty's lemma characterizes the solution set by the inequality with the operator evaluated at the variable point.
  • 1970: Martinet introduces the regularization iteration (2) and proves Théorème 1 below (Martinet 1970). In §IV of the same note he states the convex-minimization version.
  • 1976: Rockafellar extends the method to maximal monotone operators, allowing inexact steps and variable step sizes, and proves weak convergence of the whole sequence when a zero exists (Rockafellar 1976).
  • 1991: Güler constructs an example in which the iterates converge weakly but not strongly (Güler 1991).

Setting

Let HHH be a real Hilbert space with inner product ⟨⋅,⋅⟩\langle\cdot,\cdot\rangle⟨⋅,⋅⟩ and norm ∥⋅∥\|\cdot\|∥⋅∥. Let H′H'H′ be its dual, and write (φ,y)(\varphi, y)(φ,y) for the value of a functional φ∈H′\varphi\in H'φ∈H′ at y∈Hy\in Hy∈H. Let C⊆HC\subseteq HC⊆H be convex, closed and bounded, and let T:H→H′T:H\to H'T:H→H′ be

  • monotone on CCC: (Tx−Ty, x−y)≥0(Tx-Ty,\,x-y)\ge0(Tx−Ty,x−y)≥0 for all x,y∈Cx,y\in Cx,y∈C;
  • hemicontinuous on CCC: for all x,y∈Cx,y\in Cx,y∈C, the map t↦T((1−t)x+ty)t\mapsto T((1-t)x+ty)t↦T((1−t)x+ty), t∈[0,1]t\in[0,1]t∈[0,1], is continuous into H′H'H′ with its weak topology.

The variational inequality (1) asks for xˉ∈C\bar x\in Cxˉ∈C such that

(Txˉ, x−xˉ)≥0∀x∈C.(T\bar x,\, x-\bar x)\ge 0\qquad\forall x\in C .(Txˉ,x−xˉ)≥0∀x∈C.

Its solution set is denoted MMM (solSet T C in Lean).

Martinet's regularization algorithm starts from x0∈Cx^0\in Cx0∈C. Given xn∈Cx^n\in Cxn∈C, it determines xn+1∈Cx^{n+1}\in Cxn+1∈C such that

(Txn+1, x−xn+1)+⟨xn+1−xn, x−xn+1⟩≥0∀x∈C.(2)(Tx^{n+1},\, x-x^{n+1})+\langle x^{n+1}-x^n,\, x-x^{n+1}\rangle\ge 0\qquad\forall x\in C. \tag{2}(Txn+1,x−xn+1)+⟨xn+1−xn,x−xn+1⟩≥0∀x∈C.(2)

In words, xn+1x^{n+1}xn+1 solves the variational inequality for the operator T+( ⋅ −xn)T+(\,\cdot\,-x^n)T+(⋅−xn), which is strongly monotone. A point x~\tilde xx~ is a weak cluster point of (xn)(x^n)(xn) if every neighbourhood of x~\tilde xx~ in the weak topology contains xnx^nxn for infinitely many nnn.

Formalization targets

Goal: Théorème 1

x~ a weak cluster point of (xn) ⟹ x~∈M.\tilde x \text{ a weak cluster point of } (x^n)\ \Longrightarrow\ \tilde x\in M .x~ a weak cluster point of (xn) ⟹ x~∈M.

Every weak cluster point of the regularized iterates solves (1). The paper's Lemme 2 states the same thing. The goal assumes neither that (1) has a solution nor that TTT is bounded on CCC.

Milestones, in the order the paper uses them

  1. §2.1: (1) has at least one solution when C≠∅C\neq\emptysetC=∅, so M≠∅M\neq\emptysetM=∅.
  2. §2.2: the step (2) has exactly one solution xn+1∈Cx^{n+1}\in Cxn+1∈C for every xn∈Cx^n\in Cxn∈C.
  3. §2.3, (5): Minty's characterization M={xˉ∈C∣(Tx, x−xˉ)≥0 ∀x∈C}M=\{\bar x\in C\mid (Tx,\,x-\bar x)\ge0\ \forall x\in C\}M={xˉ∈C∣(Tx,x−xˉ)≥0 ∀x∈C}.
  4. §2.3, (7): for every xˉ∈M\bar x\in Mxˉ∈M, ∥xn+1−xˉ∥2≤∥xn−xˉ∥2−∥xn+1−xn∥2\|x^{n+1}-\bar x\|^2\le\|x^n-\bar x\|^2-\|x^{n+1}-x^n\|^2∥xn+1−xˉ∥2≤∥xn−xˉ∥2−∥xn+1−xn∥2.
  5. Lemme 1: ∥xn+1−xn∥→0\|x^{n+1}-x^n\|\to0∥xn+1−xn∥→0.
  6. §2.3, (8): lim inf⁡n(Txn+1, x−xn+1)≥0\liminf_n (Tx^{n+1},\,x-x^{n+1})\ge0liminfn​(Txn+1,x−xn+1)≥0 for every x∈Cx\in Cx∈C.
  7. §2.3, (9): lim inf⁡n(Tx, x−xn)≥0\liminf_n (Tx,\,x-x^{n})\ge0liminfn​(Tx,x−xn)≥0 for every x∈Cx\in Cx∈C.
  8. Corollaire (stronger than the goal): if M={xˉ}M=\{\bar x\}M={xˉ}, then xn⇀xˉx^n\rightharpoonup\bar xxn⇀xˉ.

Significance

The result. Théorème 1 is the first convergence theorem for the proximal point method. The method only needs to solve strongly monotone subproblems, and those are well posed even when the original problem is not. Together with the existence result, the theorem says the iterates accumulate weakly only at solutions. When the solution is unique, the whole sequence converges weakly (the Corollaire). The later theory of Rockafellar, Brézis–Lions and the splitting literature refines this statement.

Formalizing it. The result has been proved since 1970. What this mission adds is a machine-checked version that follows the original hypotheses: an operator into the dual, hemicontinuity rather than continuity, and no maximality assumption. The cited ingredients, the Lions–Stampacchia existence theorem in an infinite-dimensional Hilbert space and Minty's lemma, are not in Mathlib as far as this mission is aware. Formalizing them is part of the work and is reusable well beyond this paper. The milestone items on the platform are statements awaiting proof. None of them has a machine-checked proof yet.

Difficulty

Lemme 1 and inequality (7) follow from the defining inequality (2) and the algebra of the inner product. The difficulty is at two other points.

First, the iterates satisfy the variational inequality only approximately, and only with TTT evaluated at the iterate. A weak cluster point gives no control over TxnTx^{n}Txn, because TTT is merely hemicontinuous and is not assumed weakly continuous or bounded. The obvious idea, to pass to the limit in (Txn+1, x−xn+1)≥−εn(Tx^{n+1},\,x-x^{n+1})\ge -\varepsilon_n(Txn+1,x−xn+1)≥−εn​, fails for this reason. Passing to the limit requires the reformulation in which TTT is evaluated at a fixed point of CCC. That reformulation is Minty's characterization (5), and proving it uses hemicontinuity along segments.

Second, the proof of Lemme 1 needs a solution of (1) to exist. In infinite dimensions that is the Lions–Stampacchia theorem. Its standard proof goes through Brouwer's fixed point theorem on finite-dimensional sections together with weak compactness of CCC, and this is the heaviest item of the mission.

Formalization scope

  • HHH is a real Hilbert space: NormedAddCommGroup H, InnerProductSpace ℝ H, CompleteSpace H. The paper says only "espace de Hilbert". Its ordered inequalities force real scalars.
  • H′H'H′ is StrongDual ℝ H, and (φ,y)(\varphi,y)(φ,y) is φ y. TTT is not replaced by a map H→HH\to HH→H through the Riesz isomorphism.
  • Hemicontinuity is weak-* continuity: for x,y∈Cx,y\in Cx,y∈C and every z∈Hz\in Hz∈H, the map t↦(T((1−t)x+ty),z)t\mapsto (T((1-t)x+ty),z)t↦(T((1−t)x+ty),z) is continuous on [0,1][0,1][0,1]. Since HHH is reflexive, this is the paper's weak topology on H′H'H′. It is not strengthened to continuity of TTT.
  • The algorithm is a relation (IsRegSeq): any sequence with x0∈Cx^0\in Cx0∈C that satisfies (2) at every step. Existence and uniqueness of the step are milestone 2, not built into a definition.
  • A weak cluster point is MapClusterPt in WeakSpace ℝ H, a cluster point in the weak topology. It is not a cluster point in the norm topology, which would make the goal weaker.
  • lim inf⁡nan≥0\liminf_n a_n\ge0liminfn​an​≥0 in (8) and (9) is stated as ∀ε>0\forall\varepsilon>0∀ε>0, eventually an≥−εa_n\ge-\varepsilonan​≥−ε. Filter.liminf on R\mathbb RR returns a junk value on sequences that are unbounded below.
  • "C nonempty" is added to the existence milestone. The paper leaves it implicit, and the claim is false for C=∅C=\emptysetC=∅.
  • In Lean the sequence is called xxx and an arbitrary point of CCC is called yyy. The paper uses the letter xxx for both.

A trivializing formalization is ruled out. The goal does not assume M≠∅M\neq\emptysetM=∅, boundedness of TTT, or strong cluster points. Its hypotheses are satisfiable: H=RH=\mathbb RH=R, C=[−1,1]C=[-1,1]C=[−1,1], (Tx,y)=xy(Tx,y)=xy(Tx,y)=xy, xn=2−nx^n=2^{-n}xn=2−n is an instance, checked locally.

Not formalized: Remarques 1 and 2 of §II (a variable-weight variant of (2), whose printed form is apparently misprinted, and the removal of boundedness of CCC under a coercivity condition), because the paper gives neither a proof. Théorème 2 (§III) and the convex-minimization §IV are not formalized either. §IV is the subject of the companion mission.

Contributions are welcome on each milestone, and especially on the general infrastructure: Minty's lemma, Hartman–Stampacchia/Lions–Stampacchia existence for monotone hemicontinuous operators, and the fact that bounded sequences in a Hilbert space have weak cluster points. A proved Brouwer fixed point theorem (AGT.brouwer_fixed_point) and a Banach–Alaoglu theorem (FamousTheorems.banach_alaoglu) are available on the platform as tools.

Selected references

  • B. Martinet, Brève communication. Régularisation d'inéquations variationnelles par approximations successives, Revue française d'informatique et de recherche opérationnelle, série rouge, 4(R-3) (1970), 154–158. https://doi.org/10.1051/m2an/197004R301541
  • J.-L. Lions, G. Stampacchia, Variational inequalities, Communications on Pure and Applied Mathematics 20 (1967), 493–519. https://doi.org/10.1002/cpa.3160200302
  • R. T. Rockafellar, Monotone operators and the proximal point algorithm, SIAM Journal on Control and Optimization 14 (1976), 877–898. https://doi.org/10.1137/0314056
  • O. Güler, On the convergence of the proximal point algorithm for convex minimization, SIAM Journal on Control and Optimization 29 (1991), 403–419. https://doi.org/10.1137/0329022
10 thms1 active userReviewed
Convex OptimizationLinear algebraOptimization·Captain: mikedeng1

Strongly Regular Generalized Equations III: Reduced-Form Criterion — a Linear Generalized Equation over a Polyhedral Set Is Strongly Regular Iff Its Reduced Form Is Uniquely Solvable on LResearch Paper

Motivation

Many problems in optimization and equilibrium modelling, among them linear and nonlinear complementarity problems, variational inequalities over polyhedra, and the Karush–Kuhn–Tucker conditions of nonlinear programs, can be written as a single generalized equation

0∈f(x)+∂ψC(x),0\in f(x)+\partial\psi_C(x),0∈f(x)+∂ψC​(x),

where ∂ψC\partial\psi_C∂ψC​ is the normal-cone operator of a closed convex set CCC. S. M. Robinson introduced strong regularity of such an inclusion at a solution x0x_0x0​ in Strongly regular generalized equations (1980) and proved an implicit-function theorem for it: when the linearised inclusion has a locally unique, Lipschitz inverse, solutions of the perturbed problem exist, are locally unique and depend Lipschitz-continuously on the perturbation. Strong regularity has since become the standard stability notion behind sensitivity analysis and the local convergence of Newton-type methods for variational problems; see Dontchev and Rockafellar, Implicit Functions and Solution Mappings (Springer, 2nd ed. 2014, doi:10.1007/978-1-4939-1037-3).

Strong regularity depends only on the linearisation, so deciding it means deciding it for a linear generalized equation. For a general polyhedral set CCC the paper's appendix does this by a reduction: locally around x0x_0x0​ the problem is equivalent to a homogeneous problem on a cone, the reduced form, and strong regularity is equivalent to unique solvability of that reduced form. This mission formalizes that appendix and the criterion it yields.

Setting

Work in Rn\mathbb R^nRn with the standard inner product, which identifies Rn\mathbb R^nRn with its dual. For C⊆RnC\subseteq\mathbb R^nC⊆Rn the normal cone at xxx is

∂ψC(x)={y:⟨y,c−x⟩≤0 for all c∈C} if x∈C,∂ψC(x)=∅ if x∉C.\partial\psi_C(x)=\{y:\langle y,c-x\rangle\le 0\ \text{for all } c\in C\}\ \text{if } x\in C,\qquad \partial\psi_C(x)=\emptyset\ \text{if } x\notin C.∂ψC​(x)={y:⟨y,c−x⟩≤0 for all c∈C} if x∈C,∂ψC​(x)=∅ if x∈/C.

A set is polyhedral convex if it is the intersection of finitely many closed half-spaces. Fix a nonempty polyhedral convex CCC, an n×nn\times nn×n real matrix AAA and a∈Rna\in\mathbb R^na∈Rn, and consider

0∈Ax+a+∂ψC(x).(A.1)0\in Ax+a+\partial\psi_C(x).\qquad\text{(A.1)}0∈Ax+a+∂ψC​(x).(A.1)

It is strongly regular at a solution x0x_0x0​ with constant λ\lambdaλ if there are neighbourhoods UUU of 000 and VVV of x0x_0x0​ such that for each y∈Uy\in Uy∈U the perturbed inclusion

y∈Ax+a+∂ψC(x)(A.2)y\in Ax+a+\partial\psi_C(x)\qquad\text{(A.2)}y∈Ax+a+∂ψC​(x)(A.2)

has exactly one solution x=s(y)x=s(y)x=s(y) in VVV, and ∥s(y1)−s(y2)∥≤λ∥y1−y2∥\|s(y_1)-s(y_2)\|\le\lambda\|y_1-y_2\|∥s(y1​)−s(y2​)∥≤λ∥y1​−y2​∥ on UUU.

The reduction uses the following objects, all built from the data:

  • y0:=Ax0+ay_0:=Ax_0+ay0​:=Ax0​+a;
  • the face F:=∂ψC∗(−y0)F:=\partial\psi_C^*(-y_0)F:=∂ψC∗​(−y0​), the set of maximisers of ⟨−y0,⋅⟩\langle -y_0,\cdot\rangle⟨−y0​,⋅⟩ over CCC (it contains x0x_0x0​);
  • the tangent cone T:=TF(x0)=∂ψF(x0)∘T:=T_F(x_0)=\partial\psi_F(x_0)^\circT:=TF​(x0​)=∂ψF​(x0​)∘, the polar of the normal cone of FFF at x0x_0x0​;
  • the subspace LLL parallel to FFF (the direction of its affine hull) and the orthogonal projector PLP_LPL​;
  • the lineality space MMM of TTT, the subspace L∩M⊥L\cap M^\perpL∩M⊥, and the cone K:=T∩M⊥K:=T\cap M^\perpK:=T∩M⊥.

The reduced form of (A.1) at x0x_0x0​ is the inclusion z∈PLAw+∂ψT(w)z\in P_LAw+\partial\psi_T(w)z∈PL​Aw+∂ψT​(w) for z∈Lz\in Lz∈L; in an orthonormal basis adapted to MMM, L∩M⊥L\cap M^\perpL∩M⊥ and L⊥L^\perpL⊥ it is z∈Bw+∂ψRr×K(w)z\in Bw+\partial\psi_{\mathbb R^r\times K}(w)z∈Bw+∂ψRr×K​(w) with an (r+s)×(r+s)(r+s)\times(r+s)(r+s)×(r+s) matrix BBB. It is vacuous when L={0}L=\{0\}L={0}.

Formalization targets

Goal: Theorem A.4 (p. 60)

If x0x_0x0​ solves (A.1), then (A.1) is strongly regular at x0x_0x0​ if and only if

L={0}or∀z∈L ∃! w∈Rn: z∈PLAw+∂ψT(w).L=\{0\}\quad\text{or}\quad\forall z\in L\ \exists!\,w\in\mathbb R^n:\ z\in P_LAw+\partial\psi_T(w).L={0}or∀z∈L ∃!w∈Rn: z∈PL​Aw+∂ψT​(w).

No Lipschitz constant is fixed: the left side is "strongly regular for some λ\lambdaλ".

Milestones

  1. Proposition A.1 (p. 58): for x0∈Cx_0\in Cx0​∈C, (C−x0)∩U=TC(x0)∩U(C-x_0)\cap U=T_C(x_0)\cap U(C−x0​)∩U=TC​(x0​)∩U for some neighbourhood UUU of 000.
  2. Proposition A.2 (p. 58): on F=∂ψC∗(−y0)F=\partial\psi_C^*(-y_0)F=∂ψC∗​(−y0​), ∂ψF(x)=∂ψC(x)+y0R+\partial\psi_F(x)=\partial\psi_C(x)+y_0\mathbb R_+∂ψF​(x)=∂ψC​(x)+y0​R+​, and ∂ψC∗(−y)⊂F\partial\psi_C^*(-y)\subset F∂ψC∗​(−y)⊂F for yyy near y0y_0y0​.
  3. Proposition A.3 (p. 58): for x0∈Fx_0\in Fx0​∈F, near the origin, 0∈(y0+k)+∂ψC(x0+h)0\in(y_0+k)+\partial\psi_C(x_0+h)0∈(y0​+k)+∂ψC​(x0​+h) iff 0∈PLk+∂ψT(h)0\in P_Lk+\partial\psi_T(h)0∈PL​k+∂ψT​(h).
  4. The correspondence (A.4) (p. 60): for xxx near x0x_0x0​ and small yyy, (A.2) holds iff 0∈PL(Ah−y)+∂ψT(h)0\in P_L(Ah-y)+\partial\psi_T(h)0∈PL​(Ah−y)+∂ψT​(h) with h=x−x0h=x-x_0h=x−x0​.

Companions

  • Corollary 3.2 (p. 53), in two items. Sufficiency: the reduced form is vacuous, or B11B_{11}B11​ is nonsingular and the Schur complement B/B11B/B_{11}B/B11​ is positive definite. Characterisation when K=R+sK=\mathbb R^s_+K=R+s​: strongly regular iff vacuous, or B11B_{11}B11​ nonsingular and B/B11B/B_{11}B/B11​ a P-matrix.
  • The 3 × 3 linear complementarity example of §4 (p. 53): strongly regular at x0=(1,0,0)x_0=(1,0,0)x0​=(1,0,0), and not strongly regular once the entry 555 of AAA becomes 444.

Significance

Theorem A.4 turns a local stability property, defined through neighbourhoods and an inverse map, into a finite-dimensional algebraic question about one homogeneous problem on a polyhedral cone. Combined with the Schur-complement criterion of Theorem 3.1, it gives checkable conditions (Corollary 3.2): nonsingularity of a block and positive definiteness, or the P-matrix property, of its Schur complement. Through the KKT reformulation of §4 this is the route by which strong second-order sufficiency and linear independence of binding constraint gradients imply strong regularity in nonlinear programming. The example of p. 53 shows the criterion deciding cases where AAA itself is neither positive definite nor a P-matrix.

The results are classical and proved in the paper; to our knowledge none of them has a machine-checked proof. The formalization adds a coordinate-free statement of the reduced form, which the paper writes only in an adapted basis; a Lean account of exposed faces and tangent cones of polyhedra, with their local conic structure (Propositions A.1–A.2), which the paper lists "without proof" and cites to Rockafellar; and checked versions of the corollary and the example.

Difficulty

The definition of strong regularity is local, while condition (ii) is global on LLL. The obvious argument, "linearise and read off the inverse", does not apply, because ∂ψC\partial\psi_C∂ψC​ is a set-valued map whose graph changes shape from point to point. The step that carries the weight is Proposition A.3: a perturbation of y0y_0y0​ may move the solution off the face FFF, and only polyhedrality, through the finitely many values of ∂ψC\partial\psi_C∂ψC​ on FFF and the local conic structure of A.1–A.2, rules this out uniformly in a neighbourhood. The direction from strong regularity to (ii) needs positive homogeneity of the reduced form to pass from uniqueness near 000 to uniqueness on all of LLL. The direction from (ii) to strong regularity needs the Lipschitz property of a single-valued inverse of a polyhedral multifunction (Robinson 1979, cited as [12, Proposition 2]), which is not elementary.

Formalization scope

  • The space is EuclideanSpace ℝ (Fin n), with inclusions written as memberships: (A.2) is y−(Ax+a)∈∂ψC(x)y-(Ax+a)\in\partial\psi_C(x)y−(Ax+a)∈∂ψC​(x). A matrix acts through Matrix.toEuclideanLin. The normal cone carries the clause x∈Cx\in Cx∈C, so ∂ψC(x)=∅\partial\psi_C(x)=\emptyset∂ψC​(x)=∅ off CCC; without it every inclusion would be satisfiable at points outside CCC and the statements would change meaning.
  • TC(x0)T_C(x_0)TC​(x0​) is the polar of the normal cone, as on p. 58, not the closure of the cone of feasible directions. FFF is the set of maximisers of ⟨−y0,⋅⟩\langle -y_0,\cdot\rangle⟨−y0​,⋅⟩ (the sign matters: the opposite face would make the theorem false). LLL is the direction of the affine span of FFF, and PLP_LPL​ is Mathlib's Submodule.starProjection.
  • The reduced form is stated basis-free on LLL; ∂ψT\partial\psi_T∂ψT​ is the normal cone of TTT in all of Rn\mathbb R^nRn. In Corollary 3.2, B11B_{11}B11​ and B/B11B/B_{11}B/B11​ are expressed through projectors onto MMM and L∩M⊥L\cap M^\perpL∩M⊥. Only the case K=R+sK=\mathbb R^s_+K=R+s​ is stated in a basis, an orthonormal basis of L∩M⊥L\cap M^\perpL∩M⊥ in which KKK is the orthant.
  • "Positive definite" does not require symmetry. "Strongly regular" without a constant is existential in λ\lambdaλ, with λ\lambdaλ real.
  • Corollary 3.2's second sentence refers on the page to "(3.8)", an evident slip for (3.9); it is formalized for (3.9).
  • The standing assumption "C nonempty polyhedral convex" is a hypothesis of every item.
  • A trivializing formalization is ruled out: strong regularity requires existence, uniqueness in VVV and the Lipschitz bound together, and condition (ii) requires existence and uniqueness for every z∈Lz\in Lz∈L.
  • Needed infrastructure: faces and tangent cones of polyhedra and their local structure (Minkowski–Weyl, finitely many faces), orthogonal decompositions, and Lipschitz continuity of single-valued polyhedral inverses. All of this is reusable beyond this mission. Proofs of the propositions, of the correspondence, and of the companions are welcome independently.

Selected references

  • S. M. Robinson, Strongly regular generalized equations, Mathematics of Operations Research 5(1), 43–62, 1980. https://doi.org/10.1287/moor.5.1.43
  • S. M. Robinson, Generalized equations and their solutions, Part I: Basic theory, Mathematical Programming Study 10, 128–141, 1979. https://doi.org/10.1007/BFb0120850
  • R. T. Rockafellar, Convex Analysis, Princeton University Press, 1970. https://doi.org/10.1515/9781400873173
  • A. L. Dontchev and R. T. Rockafellar, Implicit Functions and Solution Mappings, 2nd ed., Springer, 2014. https://doi.org/10.1007/978-1-4939-1037-3
  • R. W. Cottle, Manifestations of the Schur complement, Linear Algebra and its Applications 8, 189–211, 1974. https://doi.org/10.1016/0024-3795(74)90066-4
6 thms1 active userReviewed
Linear algebraOptimization·Captain: mikedeng1

Strongly Regular Generalized Equations II: Schur-Complement Criterion — A₁₁ Nonsingular and (A/A₁₁) Positive Definite Make (A + ∂ψ_{ℝʳ×K})⁻¹ Lipschitz on ℝ^{r+s}; for K = ℝˢ₊, P-Matrix IffResearch Paper

Motivation

A constrained system can be written as a generalized equation: a smooth or linear expression must balance the normal cone of a feasible set. This form includes variational inequalities and the first-order conditions of many optimization problems. It is useful to know whether a small change in the right-hand side determines one nearby solution and how far that solution moves. In the linear finite-dimensional case, Robinson's Theorem 3.1 gives matrix conditions that guarantee something stronger: a unique solution for every right-hand side, with one Lipschitz bound valid over the entire space. The theorem also identifies an exact matrix criterion when the feasible set is a product with a nonnegative orthant.

The question is relevant whenever some coordinates of a system are free and others are constrained by inequalities. Eliminating the free coordinates produces a smaller matrix, the Schur complement. The resulting condition can be checked on the reduced block, and in the orthant case it becomes the familiar P-matrix criterion from linear complementarity. Robinson states both claims in a single theorem and relates them to the behavior of a generalized equation rather than to an isolated matrix property Robinson, pp. 51–52.

Setting

Let r,sr,sr,s be positive integers and give Rr+s\mathbb R^{r+s}Rr+s its Euclidean norm. Write w=(w1,w2)w=(w_1,w_2)w=(w1​,w2​), with w1∈Rrw_1\in\mathbb R^rw1​∈Rr and w2∈Rsw_2\in\mathbb R^sw2​∈Rs. Let K⊆RsK\subseteq\mathbb R^sK⊆Rs be nonempty, closed, and convex, and put D=Rr×KD=\mathbb R^r\times KD=Rr×K. For w∈Dw\in Dw∈D, the normal cone is

ND(w)={v∈Rr+s:⟨v,c−w⟩≤0 for every c∈D}.N_D(w)=\{v\in\mathbb R^{r+s}:\langle v,c-w\rangle\leq0\text{ for every }c\in D\}.ND​(w)={v∈Rr+s:⟨v,c−w⟩≤0 for every c∈D}.

For w∉Dw\notin Dw∈/D, ND(w)N_D(w)ND​(w) is empty. Thus the inclusion y∈Aw+ND(w)y\in Aw+N_D(w)y∈Aw+ND​(w) itself enforces feasibility. This is Robinson's indicator-subdifferential convention Robinson, pp. 43 and 51.

Partition the real square matrix AAA into blocks A11A_{11}A11​, A12A_{12}A12​, A21A_{21}A21​, and A22A_{22}A22​, where A11A_{11}A11​ is r×rr\times rr×r. When A11A_{11}A11​ is nonsingular, its Schur complement in AAA is

A/A11=A22−A21A11−1A12.A/A_{11}=A_{22}-A_{21}A_{11}^{-1}A_{12}.A/A11​=A22​−A21​A11−1​A12​.

A real matrix MMM is positive definite in the theorem's sense when v⊤Mv>0v^\top Mv>0v⊤Mv>0 for every nonzero vvv. Symmetry is not assumed. A P-matrix has strictly positive determinants for every nonempty principal submatrix. Write R+s\mathbb R^s_+R+s​ for the vectors with all components nonnegative. These conventions are stated or used in Theorem 3.1 and its proof.

Formalization targets

General closed convex set

For TK(w)=Aw+NRr×K(w)T_K(w)=Aw+N_{\mathbb R^r\times K}(w)TK​(w)=Aw+NRr×K​(w), the first target is the sufficient condition

det⁡A11≠0andv⊤(A/A11)v>0  (v≠0)⟹TK−1:Rr+s→Rr+s is Lipschitz.\det A_{11}\ne0\quad\text{and}\quad v^\top(A/A_{11})v>0\;(v\ne0) \quad\Longrightarrow\quad T_K^{-1}:\mathbb R^{r+s}\to\mathbb R^{r+s}\text{ is Lipschitz}.detA11​=0andv⊤(A/A11​)v>0(v=0)⟹TK−1​:Rr+s→Rr+s is Lipschitz.

Here “is Lipschitz” includes that exactly one inverse value exists at every yyy. The assertion holds for every nonempty closed convex KKK; it is not restricted to polyhedral sets.

Nonnegative orthant

When K=R+sK=\mathbb R^s_+K=R+s​, the second target is an equivalence:

TR+s−1 is everywhere defined, single-valued and Lipschitz⟺det⁡A11≠0 and A/A11 is a P-matrix.T_{\mathbb R^s_+}^{-1}\text{ is everywhere defined, single-valued and Lipschitz} \quad\Longleftrightarrow\quad \det A_{11}\ne0\text{ and }A/A_{11}\text{ is a P-matrix}.TR+s​−1​ is everywhere defined, single-valued and Lipschitz⟺detA11​=0 and A/A11​ is a P-matrix.

The goal theorem is the conjunction of these two statements, matching Theorem 3.1. Its milestones record the paper's local upper Lipschitz assertion for polyhedral multifunctions, the block reduction, the reduced inverse result, the complementarity characterization, and the necessity of nonsingularity.

Significance

The first part gives a global sensitivity guarantee for a generalized equation with an arbitrary nonempty closed convex lower-block constraint. For any two right-hand sides, their unique solutions differ by at most a fixed multiple of the distance between those right-hand sides. The second part tells when this guarantee holds for the orthant model: the P-matrix condition is necessary as well as sufficient. These are the precise conclusions of Robinson's theorem; the mission concerns their machine-checked formalization, not an unresolved mathematical conjecture.

A complete development would provide reusable definitions of the normal-cone generalized equation, an explicitly nonsymmetric notion of positive definiteness, P-matrices, and the global inverse property. It would also formalize the linear complementarity characterization quoted in the paper. The current draft has Lean-checked statements with proof placeholders. No proof of Theorem 3.1 or of its milestones is claimed here.

Difficulty

Nonsingularity of the full matrix AAA alone does not decide whether the constrained inverse exists uniquely: the normal cone can change as w2w_2w2​ reaches different faces of KKK. A pointwise uniqueness argument also does not by itself supply one Lipschitz constant on all of Rr+s\mathbb R^{r+s}Rr+s. For the orthant case, checking only the full determinant or leading principal minors would miss the criterion Robinson invokes; every nonempty principal minor matters. The difficulty is to connect a global statement about all right-hand sides with the reduced matrix condition while preserving the normal cone's behavior at boundary points Robinson, pp. 51–52.

Formalization scope

Lean represents Rr+s\mathbb R^{r+s}Rr+s as a Euclidean space indexed by the disjoint union of Fin(r)\mathrm{Fin}(r)Fin(r) and Fin(s)\mathrm{Fin}(s)Fin(s). This gives the paper's Euclidean norm rather than the sup norm of a product type. The normal cone is empty off its set, and the inverse property explicitly requires existence for every right-hand side, uniqueness, and one global real Lipschitz bound. The Schur complement appears only with a nonsingular A11A_{11}A11​ in the substantive claims; matrix inversion on a singular input would otherwise be totalized by Lean. Positive definiteness does not add a symmetry hypothesis. The goal retains r,s>0r,s>0r,s>0 as printed; the paper's later remark about zero-dimensional blocks is outside this theorem.

The polyhedral milestones use finite intersections of closed half-spaces. The reduced-operator milestone uses a nonempty closed convex KKK, matching the theorem's setting. The LCP milestone allows any finite dimension; at dimension zero, both its universal uniqueness statement and its empty-minor P-matrix condition hold. A weaker encoding in which the inverse is merely single-valued where it happens to exist would erase the global conclusion and is excluded here.

Solvers can contribute the block-normal-cone equivalence, the global inverse statement for the reduced operator, the polyhedral Lipschitz result, the P-matrix characterization, and the final theorem. The normal-cone and matrix definitions can also serve later generalized-equation missions that use the same conventions.

Selected references

  • S. M. Robinson, Strongly Regular Generalized Equations, Mathematics of Operations Research 5(1), 43–62, 1980. DOI 10.1287/moor.5.1.43.
8 thms1 active userReviewed
🏆Completed
CombinatoricsLinear OptimizationOptimization·Captain: mikedeng1

On the Job-Shop Scheduling Problem: The Integer Program (2)–(7) with 0–1 Variables y_jk Attains Exactly the Minimum Make-SpanResearch Paper

Motivation

The job-shop scheduling problem asks how to time a set of tasks on shared machines so that every product is finished as early as possible. Around 1959 several authors proposed to solve it with Gomory's then new integer programming (Gomory 1958). The obstacle is the noninterference condition: two tasks on the same machine must not overlap, so one of them must finish before the other starts. That is an "either-or" condition. It describes a nonconvex set, and classical linear programming cannot express it.

A. S. Manne's note On the Job-Shop Scheduling Problem (Operations Research 8 (1960) 219–223) writes the either-or condition as two linear inequalities in integers. It adds one 0–1 variable per pair of tasks that compete for a machine, and it uses a large constant derived from a bound TTT on the start days. This is the origin of the big-M disjunctive formulation, which remains the standard textbook integer program for job shops and, more broadly, the standard way to linearize a disjunction of two linear inequalities.

Timeline. Johnson (1954) introduced the make-span criterion for two- and three-stage production schedules. Bowman (1959) and Wagner (1959) proposed integer programs for machine scheduling. Manne (1960), stimulated by Bowman's paper, gave the formulation stated here. He counted its unknowns as 275 for 5 machines with 10 tasks each, against 600 for Wagner's formulation on the same example (p. 222).

Setting

There are n≥1n\ge1n≥1 tasks and MMM machines. Task jjj requires the single machine μ(j)\mu(j)μ(j) for aja_jaj​ consecutive days, where aja_jaj​ is an integer. An integer horizon TTT bounds the start days: the integer unknown xj∈{0,1,…,T}x_j\in\{0,1,\dots,T\}xj​∈{0,1,…,T} is the day on which task jjj begins. A pair (j,k)(j,k)(j,k) with j<kj<kj<k and μ(j)=μ(k)\mu(j)=\mu(k)μ(j)=μ(k) is a conflicting pair. For each such pair the tasks must not overlap:

xj−xk≥akor elsexk−xj≥aj.(1)x_j-x_k\ge a_k\quad\text{or else}\quad x_k-x_j\ge a_j. \tag{1}xj​−xk​≥ak​or elsexk​−xj​≥aj​.(1)

The instance may also impose precedence xj+aj≤xkx_j+a_j\le x_kxj​+aj​≤xk​ for given pairs (5a), exact delays xj+aj+Θjk=xkx_j+a_j+\Theta_{jk}=x_kxj​+aj​+Θjk​=xk​ for given pairs (5c), and delivery dates xj+aj≤djx_j+a_j\le d_jxj​+aj​≤dj​ for given tasks (6). A schedule is an x∈{0,…,T}nx\in\{0,\dots,T\}^nx∈{0,…,T}n satisfying (1), (5a), (5c) and (6). Its make-span is

ms⁡(x)=max⁡j (xj+aj),\operatorname{ms}(x)=\max_{j}\,(x_j+a_j),ms(x)=jmax​(xj​+aj​),

the calendar time needed for all jobs when the shop starts on day 000.

Manne's integer program has integer unknowns xjx_jxj​ with 0≤xj≤T0\le x_j\le T0≤xj​≤T, one integer yjky_{jk}yjk​ for each conflicting pair, and the minimand ttt, subject to (5a), (5c), (6),

0≤yjk≤1,(2)0\le y_{jk}\le 1,\tag{2}0≤yjk​≤1,(2) (T+ak) yjk+(xj−xk)≥ak,(3)(T+a_k)\,y_{jk}+(x_j-x_k)\ge a_k,\tag{3}(T+ak​)yjk​+(xj​−xk​)≥ak​,(3) (T+aj)(1−yjk)+(xk−xj)≥aj,(4)(T+a_j)(1-y_{jk})+(x_k-x_j)\ge a_j,\tag{4}(T+aj​)(1−yjk​)+(xk​−xj​)≥aj​,(4)

and xj+aj≤tx_j+a_j\le txj​+aj​≤t for every jjj (7). The value yjk=1y_{jk}=1yjk​=1 means that jjj precedes kkk; yjk=0y_{jk}=0yjk​=0 means that kkk precedes jjj.

Formalization targets

Goal: the integer program solves the make-span problem

For every instance and every integer t∗t^\astt∗,

t∗=min⁡{t: ∃ x,y integer satisfying 0≤xj≤T and (2)–(7)}  ⟺  t∗=min⁡x schedulems⁡(x).t^\ast=\min\{t:\ \exists\,x,y\ \text{integer satisfying } 0\le x_j\le T \text{ and } (2)\text{–}(7)\}\iff t^\ast=\min_{x\ \text{schedule}}\operatorname{ms}(x).t∗=min{t: ∃x,y integer satisfying 0≤xj​≤T and (2)–(7)}⟺t∗=x schedulemin​ms(x).

Both minima are required to exist. In particular the program has an optimum exactly when a schedule exists. The paper claims this when it says that "the problem now consists of the minimization of ttt" subject to (2)–(7) (p. 221).

Milestones

  1. Pair equivalence (p. 220). If ∣xj−xk∣≤T|x_j-x_k|\le T∣xj​−xk​∣≤T, some integer yjky_{jk}yjk​ satisfies (2)–(4) if and only if (1) holds.
  2. Equal start days are excluded (p. 220). If xj=xkx_j=x_kxj​=xk​ and aj,ak>0a_j,a_k>0aj​,ak​>0, no yjky_{jk}yjk​ satisfies (2)–(4).
  3. Feasibility correspondence (pp. 220–221). For fixed xxx and ttt, some yyy makes (x,y,t)(x,y,t)(x,y,t) feasible for (2)–(7) if and only if xxx is a schedule with xj+aj≤tx_j+a_j\le txj​+aj​≤t for all jjj.
  4. The yjky_{jk}yjk​ must be discrete (p. 222). With yjky_{jk}yjk​ real in [0,1][0,1][0,1] and 0<aj,ak≤T0<a_j,a_k\le T0<aj​,ak​≤T, conditions (3)–(4) admit xj=xkx_j=x_kxj​=xk​, where (1) fails.
  5. Counting unknowns (pp. 221–222). With MMM machines of ppp tasks each, n=Mpn=Mpn=Mp and there are M p(p−1)/2M\,p(p-1)/2Mp(p−1)/2 conflicting pairs; for M=5M=5M=5, p=10p=10p=10 this gives 50+225=27550+225=27550+225=275 unknowns.

Significance

The result. The goal certifies that a single integer program, with one binary variable per conflicting pair, computes the optimal make-span of a job shop with precedence, exact delays and delivery dates. The same pattern is used whenever a disjunction f≥0f\ge0f≥0 or g≥0g\ge0g≥0 of bounded linear forms has to be put into a mixed-integer program: a binary variable selects the active branch, and a constant at least as large as the range of the inactive form switches the other branch off. Milestone 1 is that pattern in its simplest form, and milestone 4 shows why the binary variable cannot be relaxed.

Formalizing it. The paper's argument is informal. It rests on a summary table of admissible values of yjky_{jk}yjk​ that holds only when the gap ∣xj−xk∣|x_j-x_k|∣xj​−xk​∣ is large enough. A machine-checked version fixes the exact hypotheses: integrality of yjky_{jk}yjk​, the bound ∣xj−xk∣≤T|x_j-x_k|\le T∣xj​−xk​∣≤T, and nonemptiness of the task set. To the best of the curators' knowledge, no machine-checked proof of the correctness of the big-M job-shop formulation exists; the definitions here can serve later scheduling missions that need a disjunctive integer program.

Difficulty

The mathematics is elementary, and the difficulty lies in stating it exactly. The obvious reading, "(3)–(4) are equivalent to (1)", is false without the bound ∣xj−xk∣≤T|x_j-x_k|\le T∣xj​−xk​∣≤T. For instance, with yjk=0y_{jk}=0yjk​=0 condition (4) reads xj−xk≤Tx_j-x_k\le Txj​−xk​≤T, which cuts off valid orders if start days may lie beyond the horizon. It is also false for real yjky_{jk}yjk​. Equally, "minimize ttt subject to (7)" equals the maximum of xj+ajx_j+a_jxj​+aj​ only after the optimum over ttt and over xxx are interchanged and the empty task set is excluded. A naive formalization that states the schedule side as "the least ttt with (7)" proves nothing about the make-span.

Formalization scope

Tasks are Fin n (the paper's task jjj is index j−1j-1j−1), machines Fin M. Start days, durations, horizon, delays, delivery dates, yjky_{jk}yjk​ and ttt are integers (ℤ), so that xj−xkx_j-x_kxj​−xk​ and 1−yjk1-y_{jk}1−yjk​ are not truncated. Durations are not assumed positive except in milestones 2 and 4, where positivity is necessary. One definitions file, ManneJobShop.Formulation.Model, holds the instance, the conflicting pairs, schedules, the make-span (Finset.sup', so n≥1n\ge1n≥1 is required via [NeZero n]) and the integer program.

Explicit readings of loose phrases:

  • "a (large) integer TTT that will constitute a redundant upper bound upon the unknowns xjx_jxj​" (p. 219): both the schedule problem and the integer program restrict start days to 0≤xj≤T0\le x_j\le T0≤xj​≤T. Redundancy is not assumed.
  • "The effect of conditions (3) and (4) may therefore be summarized as follows" (p. 220): stated as the equivalence of milestone 1 and the exclusion of milestone 2, not row by row (for 0<xj−xk<ak0<x_j-x_k<a_k0<xj​−xk​<ak​, condition (3) forces yjk=1y_{jk}=1yjk​=1, not {0,1}\{0,1\}{0,1}).
  • "the minimization of ttt" (p. 221): IsLeast of the feasible values of ttt, matched against IsLeast of the set of make-spans of schedules.
  • "necessarily of a discrete nature" (p. 222): existence of a real yjk∈[0,1]y_{jk}\in[0,1]yjk​∈[0,1] satisfying (3)–(4) at xj=xkx_j=x_kxj​=xk​ when 0<aj,ak≤T0<a_j,a_k\le T0<aj​,ak​≤T ("large" TTT read as T≥aj,akT\ge a_j,a_kT≥aj​,ak​).
  • "mmm possible conflicting pairs of machine assignments" (p. 222): pairs j<kj<kj<k on the same machine, one yjky_{jk}yjk​ each.
  • "If task jjj is the last task which the shop is to perform upon the item" (p. 221): a delivery date may be attached to any task, which contains the paper's case.

Trivializing formalizations are ruled out: the make-span is a maximum, not a restatement of (7); yjky_{jk}yjk​ is an integer; the horizon appears on both sides; the goal is stated for every instance with n≥1n\ge1n≥1, including infeasible ones. The (5b) example is (5a) for two pairs. Wagner's comparison, the remarks on Gomory's algorithm, Dantzig's secondary constraints and Monte Carlo methods, and the economic discussion of the make-span are not formalized. Proofs of every milestone and of the goal are welcome.

Selected references

  • A. S. Manne, On the Job-Shop Scheduling Problem, Operations Research 8(2) (1960) 219–223. https://doi.org/10.1287/opre.8.2.219
  • E. H. Bowman, The Schedule-Sequencing Problem, Operations Research 7(5) (1959) 621–624. https://doi.org/10.1287/opre.7.5.621
  • H. M. Wagner, An Integer Linear-Programming Model for Machine Scheduling, Naval Research Logistics Quarterly 6(2) (1959) 131–140. https://doi.org/10.1002/nav.3800060205
  • R. E. Gomory, Outline of an Algorithm for Integer Solutions to Linear Programs, Bulletin of the AMS 64(5) (1958) 275–278. https://doi.org/10.1090/S0002-9904-1958-10224-4
  • S. M. Johnson, Optimal Two- and Three-Stage Production Schedules with Setup Times Included, Naval Research Logistics Quarterly 1(1) (1954) 61–68. https://doi.org/10.1002/nav.3800010110
7 thms1 active userReviewed
Functional AnalysisOptimization·Captain: mikedeng1

Strongly Regular Generalized Equations I: Implicit-Function Theorem — the Solution x(p) of 0 ∈ f(p, x) + ∂ψ_C(x) Is Locally Unique with ‖x(p) − x(q)‖ ≤ (λ + ε)‖f(p, x(q)) − f(q, x(q))‖Research Paper

Motivation

Many problems of optimization and equilibrium can be written as one inclusion. Some examples are the Karush–Kuhn–Tucker conditions of a nonlinear program, nonlinear complementarity problems, variational inequalities and the equilibrium conditions of economic and traffic models. In each of them a point xxx has to satisfy 0∈f(x)+∂ψC(x)0 \in f(x) + \partial\psi_C(x)0∈f(x)+∂ψC​(x). In applications the data fff depend on parameters: estimated coefficients, prices, or the iterate of an algorithm. One then wants to know whether a solution persists under a perturbation of the parameter, whether it stays locally unique, and how fast it moves. For a smooth equation f(p,x)=0f(p, x) = 0f(p,x)=0 the classical implicit-function theorem answers all three questions. Inequality constraints make the solution set nonsmooth, and the classical theorem no longer applies.

S. M. Robinson's paper Strongly regular generalized equations (Math. Oper. Res. 5 (1980) 43–62) introduced the condition of strong regularity and proved an implicit-function theorem for generalized equations under it. The condition and the theorem became the starting point of the stability theory of variational inequalities and nonlinear programs. Later work characterises strong regularity for nonlinear programs (Robinson's own §4, through the strong second-order sufficient condition), and develops it in the theory of metric regularity and of single-valued Lipschitz localisations (Dontchev–Rockafellar, Implicit Functions and Solution Mappings, Springer 2009/2014). Its sensitivity results underlie the convergence analysis of Newton and sequential quadratic programming methods for these problems.

This mission formalizes §1–§2 of the paper: the definition, the implicit-function theorem (Theorem 2.1) with its proof, and the three results derived from it.

Setting

Let XXX be a real normed linear space and X′X'X′ its topological dual, the continuous linear functionals on XXX. Let C⊆XC \subseteq XC⊆X be closed and convex. The normal-cone operator of CCC is

∂ψC(x)={{y∈X′:y(c−x)≤0 for all c∈C},x∈C,∅,x∉C.\partial\psi_C(x) = \begin{cases} \{y \in X' : y(c - x) \le 0 \text{ for all } c \in C\}, & x \in C, \\ \emptyset, & x \notin C. \end{cases}∂ψC​(x)={{y∈X′:y(c−x)≤0 for all c∈C},∅,​x∈C,x∈/C.​

A generalized equation is the inclusion 0∈f(x)+∂ψC(x)0 \in f(x) + \partial\psi_C(x)0∈f(x)+∂ψC​(x), for a function fff from an open set Ω⊆X\Omega \subseteq XΩ⊆X to X′X'X′. For C=XC = XC=X it is the equation f(x)=0f(x) = 0f(x)=0. For CCC the nonnegative orthant of Rn\mathbb R^nRn it is the nonlinear complementarity problem. For a general closed convex CCC it is the variational inequality over CCC.

Let x0∈Ωx_0 \in \Omegax0​∈Ω solve the generalized equation, and let fff be Fréchet differentiable at x0x_0x0​. Linearising fff gives the multifunction

Tx=f(x0)+f′(x0)(x−x0)+∂ψC(x).T x = f(x_0) + f'(x_0)(x - x_0) + \partial\psi_C(x).Tx=f(x0​)+f′(x0​)(x−x0​)+∂ψC​(x).

The generalized equation is strongly regular at x0x_0x0​ with associated Lipschitz constant λ\lambdaλ if there are neighbourhoods UUU of 000 in X′X'X′ and VVV of x0x_0x0​ with the following property: for every y∈Uy \in Uy∈U the inclusion y∈Txy \in Txy∈Tx has exactly one solution s(y)s(y)s(y) in VVV, and ∥s(y1)−s(y2)∥≤λ∥y1−y2∥\|s(y_1) - s(y_2)\| \le \lambda \|y_1 - y_2\|∥s(y1​)−s(y2​)∥≤λ∥y1​−y2​∥ on UUU. The condition depends only on f(x0)f(x_0)f(x0​), f′(x0)f'(x_0)f′(x0​) and CCC.

In the parametric problem the function is f(p,x)f(p, x)f(p,x), with ppp in a topological space PPP and base point p0p_0p0​. Its partial derivative in xxx is f′(p,x)f'(p, x)f′(p,x).

Formalization targets

Goal: Theorem 2.1 (p. 45)

Assume that f′f'f′ exists on P×ΩP \times \OmegaP×Ω, that fff and f′f'f′ are continuous at (p0,x0)(p_0, x_0)(p0​,x0​), and that x0x_0x0​ solves 0∈f(p0,x)+∂ψC(x)0 \in f(p_0, x) + \partial\psi_C(x)0∈f(p0​,x)+∂ψC​(x), strongly regularly with constant λ\lambdaλ. Then for every ε>0\varepsilon > 0ε>0 there are neighbourhoods NεN_\varepsilonNε​ of p0p_0p0​ and WεW_\varepsilonWε​ of x0x_0x0​, and a function x:Nε→Wεx : N_\varepsilon \to W_\varepsilonx:Nε​→Wε​, with two properties. First, x(p)x(p)x(p) is the unique solution in WεW_\varepsilonWε​ of 0∈f(p,x)+∂ψC(x)0 \in f(p, x) + \partial\psi_C(x)0∈f(p,x)+∂ψC​(x). Second,

∥x(p)−x(q)∥≤(λ+ε) ∥f(p,x(q))−f(q,x(q))∥(p,q∈Nε).\|x(p) - x(q)\| \le (\lambda + \varepsilon)\,\|f(p, x(q)) - f(q, x(q))\| \qquad (p, q \in N_\varepsilon).∥x(p)−x(q)∥≤(λ+ε)∥f(p,x(q))−f(q,x(q))∥(p,q∈Nε​).

Milestones: the steps of the proof (p. 46)

Write LLL for the linearisation at (p0,x0)(p_0, x_0)(p0​,x0​), r(p,x)=f(p0,x0)+f′(p0,x0)(x−x0)−f(p,x)r(p, x) = f(p_0, x_0) + f'(p_0, x_0)(x - x_0) - f(p, x)r(p,x)=f(p0​,x0​)+f′(p0​,x0​)(x−x0​)−f(p,x) for the residual, and Φp(x)=V∩L−1[r(p,x)]\Phi_p(x) = V \cap L^{-1}[r(p, x)]Φp​(x)=V∩L−1[r(p,x)]. The milestones are four claims of the proof:

  1. On the closed ball VεV_\varepsilonVε​, the fixed points of Φp\Phi_pΦp​ are exactly the solutions of the perturbed inclusion.
  2. ∥Φp(x1)−Φp(x2)∥≤λδ∥x1−x2∥\|\Phi_p(x_1) - \Phi_p(x_2)\| \le \lambda\delta \|x_1 - x_2\|∥Φp​(x1​)−Φp​(x2​)∥≤λδ∥x1​−x2​∥ on VεV_\varepsilonVε​.
  3. Φp\Phi_pΦp​ maps VεV_\varepsilonVε​ into itself.
  4. The contraction principle on VεV_\varepsilonVε​, with the bound ∥x(p)−x∥≤(1−λδ)−1∥Φp(x)−x∥\|x(p) - x\| \le (1 - \lambda\delta)^{-1} \|\Phi_p(x) - x\|∥x(p)−x∥≤(1−λδ)−1∥Φp​(x)−x∥ (2.5).

Companion results

  • Corollary 2.2 (pp. 46–47). If PPP lies in a normed space and ∥f(p,x)−f(q,x)∥≤ν∥p−q∥\|f(p, x) - f(q, x)\| \le \nu \|p - q\|∥f(p,x)−f(q,x)∥≤ν∥p−q∥, then x(⋅)x(\cdot)x(⋅) is Lipschitzian with modulus ν(λ+ε)\nu(\lambda + \varepsilon)ν(λ+ε).
  • Theorem 2.3 (p. 47). Let Φp(x0)\Phi_p(x_0)Φp​(x0​) be the unique local solution of the linear generalized equation 0∈f(p,x0)+f′(p0,x0)(x−x0)+∂ψC(x)0 \in f(p, x_0) + f'(p_0, x_0)(x - x_0) + \partial\psi_C(x)0∈f(p,x0​)+f′(p0​,x0​)(x−x0​)+∂ψC​(x). Then ∥x(p)−Φp(x0)∥≤αε(p)∥p−p0∥\|x(p) - \Phi_p(x_0)\| \le \alpha_\varepsilon(p)\|p - p_0\|∥x(p)−Φp​(x0​)∥≤αε​(p)∥p−p0​∥, with αε(p)→0\alpha_\varepsilon(p) \to 0αε​(p)→0.
  • Theorem 2.4 (p. 48). This is a perturbation lemma for linear generalized equations 0∈Ax+a+∂ψC(x)0 \in Ax + a + \partial\psi_C(x)0∈Ax+a+∂ψC​(x). Near (A0,a0)(A_0, a_0)(A0​,a0​) the localised inverse stays single-valued, and it is Lipschitzian with modulus λ(1−λ∥A−A0∥)−1\lambda(1 - \lambda\|A - A_0\|)^{-1}λ(1−λ∥A−A0​∥)−1.
  • The case C=XC = XC=X (remark on p. 45). There strong regularity is equivalent to f′(x0)f'(x_0)f′(x0​) having a continuous linear inverse.
  • Strong regularity is the weakest possible condition (remark on p. 47). For the canonical perturbation f(p,x)=f(x0)+f′(x0)(x−x0)−pf(p,x) = f(x_0) + f'(x_0)(x - x_0) - pf(p,x)=f(x0​)+f′(x0​)(x−x0​)−p, p∈X′p \in X'p∈X′, locally unique solvability with a Lipschitzian solution map x(⋅)x(\cdot)x(⋅) near p0=0p_0 = 0p0​=0 is exactly strong regularity at x0x_0x0​.

Significance

Theorem 2.1 reduces the stability of a nonsmooth problem to a property of one linearised problem at the base point. Once strong regularity is checked at x0x_0x0​, the solution exists, is locally unique and moves in a Lipschitz manner for every nearby parameter. Corollary 2.2 and Theorem 2.3 make this quantitative. Theorem 2.3 shows that a linear complementarity problem or a quadratic program approximates the nonlinear solution to first order. Theorem 2.4 is the analogue of Banach's perturbation lemma, which keeps an operator invertible under small perturbations. The later sections of the paper give checkable criteria for strong regularity: a Schur-complement test, a reduced-form test over polyhedral sets, and second-order conditions for nonlinear programs. Those criteria are the subject of the companion missions II–IV.

The theorems have been proved since 1980 and have been restated in textbooks. No machine-checked version of strong regularity or of this implicit-function theorem is known. Mathlib has the classical implicit- and inverse-function theorems for C1C^1C1 maps between Banach spaces, and the contraction mapping principle. It has nothing on normal-cone operators, generalized equations or Lipschitz localisations. The formalization adds this layer. It also shows that Theorem 2.1 needs no completeness of XXX.

Difficulty

The obvious approach is to apply the classical implicit-function theorem. It fails because x↦f(x)+∂ψC(x)x \mapsto f(x) + \partial\psi_C(x)x↦f(x)+∂ψC​(x) is set-valued and is not differentiable in any useful sense. The inverse is localised only to a neighbourhood VVV and is single-valued only there. So every step must keep the iterates inside sets on which strong regularity says something. The neighbourhoods have to be chosen in the right order: δ\deltaδ from ε\varepsilonε, then UUU and VVV, then the ball radius ρ\rhoρ, then the parameter neighbourhood. The estimate (2.4) has to come out with the constant λ+ε\lambda + \varepsilonλ+ε and no larger. The page applies the contraction principle in a space it calls only normed. A faithful proof must also obtain the fixed point without completeness of XXX, for example through the completeness of X′X'X′.

Formalization scope

  • X′X'X′ is StrongDual ℝ X, the normal cone is a Set (StrongDual ℝ X) that is empty off CCC, and an inclusion 0∈f(x)+∂ψC(x)0 \in f(x) + \partial\psi_C(x)0∈f(x)+∂ψC​(x) is written −f(x)∈∂ψC(x)-f(x) \in \partial\psi_C(x)−f(x)∈∂ψC​(x).
  • Strong regularity is a predicate on (C,f(x0),f′(x0),x0,λ)(C, f(x_0), f'(x_0), x_0, \lambda)(C,f(x0​),f′(x0​),x0​,λ) with real λ\lambdaλ. It requires existence, uniqueness in VVV and the Lipschitz bound.
  • fff is a total function P×X→X′P \times X \to X'P×X→X′ whose values off P×ΩP \times \OmegaP×Ω carry no hypothesis. The conclusion therefore asserts Wε⊆ΩW_\varepsilon \subseteq \OmegaWε​⊆Ω.
  • Differentiability is HasFDerivAt at every point of Ω\OmegaΩ, for every ppp. Continuity of f′f'f′ at (p0,x0)(p_0, x_0)(p0​,x0​) is joint and in operator norm.
  • Uniqueness is uniqueness within WεW_\varepsilonWε​, never global. Global uniqueness is false in general. Dropping uniqueness, or quantifying ε\varepsilonε after the neighbourhoods, would trivialize the goal, and the statements are written to exclude both.
  • Theorem 2.1, Corollary 2.2 and Theorem 2.3 do not assume completeness, as printed. Theorem 2.4 assumes a Banach space, as printed.
  • The contraction-principle milestone assumes completeness, under which the principle as invoked holds.
  • Corollary 2.2 asks for its Lipschitz hypothesis on Nε×VεN_\varepsilon \times V_\varepsilonNε​×Vε​, sets that Theorem 2.1 produces. It is therefore stated on fixed neighbourhoods given in advance.
  • Theorem 2.4 also asserts λ∥A−A0∥<1\lambda\|A - A_0\| < 1λ∥A−A0​∥<1, which its proof secures.

A complete development needs the following:

  • the mean-value inequality for Fréchet-differentiable maps on convex sets;
  • the contraction principle on a closed ball;
  • a fixed-point argument that obtains the fixed point through the complete space X′X'X′.

The definitions of normal cone and strong regularity are reusable for variational inequalities in general. Contributions are welcome at any level: proofs of the milestones, the goal from the milestones, or the companion results from the goal.

Selected references

  • S. M. Robinson, Strongly regular generalized equations, Mathematics of Operations Research 5(1):43–62, 1980. https://doi.org/10.1287/moor.5.1.43
  • A. L. Dontchev and R. T. Rockafellar, Implicit Functions and Solution Mappings, 2nd ed., Springer, 2014. https://doi.org/10.1007/978-1-4939-1037-3
6 thms1 active userReviewed
Machine LearningProbabilityTheoretical Computer Science·Captain: mikedeng1

The Weighted Majority Algorithm 6: Under the Weak Independence Condition, the Randomized Master WMR Has E(m) ≤ E(ln(w_init/w_fin))/(1−β)Research Paper

Motivation

Prediction with expert advice asks a learner to predict a binary label in each of a sequence of trials, having seen the predictions of a pool of nnn prediction algorithms (the experts), and to make not many more mistakes than the best of them, with no probabilistic assumption on how the instances and labels are generated. Littlestone and Warmuth's Weighted Majority Algorithm (Littlestone, Warmuth 1994) maintains a weight for each pool member, predicts by a weighted vote, and shrinks the weights of members that err. Its mistake bounds are the origin of the multiplicative-weights method used throughout online learning, game theory and optimization (Arora, Hazan, Kale 2012).

A deterministic master with binary predictions can be forced to err in every trial in which the weight is split evenly, which costs it a factor of about two against the best expert. Section 6 of the paper introduces a randomized master, WMR, which predicts 111 with probability equal to the weighted average prediction of the pool. Theorem 6.1 bounds its expected number of mistakes under a precisely stated condition on how its randomization interacts with the choice of instances and labels.

Timeline:

  • 1989: Littlestone and Warmuth's technical report and FOCS paper introduce the Weighted Majority Algorithm and its randomized variant.
  • 1991: Maass independently analyses the case β=0\beta = 0β=0 with binary pool predictions and a lazy update ([Maa91], cited in the paper).
  • 1994: the journal version states the weak independence condition and proves Theorem 6.1 (p. 240).
  • 1997: Freund and Schapire's Hedge algorithm recasts the randomized master as a distribution over experts in a decision-theoretic setting (Freund, Schapire 1997).

Setting

A pool of nnn algorithms is run for ttt trials on a probability space (Ω,F,P)(\Omega, \mathcal F, P)(Ω,F,P). In trial jjj the pool member iii predicts xi(j)∈[0,1]x_i^{(j)} \in [0,1]xi(j)​∈[0,1], the label is ρ(j)∈{0,1}\rho^{(j)} \in \{0,1\}ρ(j)∈{0,1}, and the master predicts λ(j)∈{0,1}\lambda^{(j)} \in \{0,1\}λ(j)∈{0,1}. All of these are random variables; deterministic sequences are a special case. Write x(j)=(x1(j),…,xn(j))x^{(j)} = (x_1^{(j)}, \dots, x_n^{(j)})x(j)=(x1(j)​,…,xn(j)​).

Each member carries a weight. The initial weights wi(1)w_i^{(1)}wi(1)​ are positive, and the update step (5.1) multiplies the weight of member iii in trial jjj by a factor FFF that depends on β\betaβ, xi(j)x_i^{(j)}xi(j)​ and ρ(j)\rho^{(j)}ρ(j):

wi(j+1)=F wi(j),β∣xi(j)−ρ(j)∣≤F≤1−(1−β) ∣xi(j)−ρ(j)∣,w_i^{(j+1)} = F\,w_i^{(j)}, \qquad \beta^{|x_i^{(j)}-\rho^{(j)}|} \le F \le 1-(1-\beta)\,|x_i^{(j)}-\rho^{(j)}|,wi(j+1)​=Fwi(j)​,β∣xi(j)​−ρ(j)∣≤F≤1−(1−β)∣xi(j)​−ρ(j)∣,

where 0≤β<10 \le \beta < 10≤β<1 and 00=10^0 = 100=1. WMR updates in every trial. Let s(j)=∑iwi(j)s^{(j)} = \sum_i w_i^{(j)}s(j)=∑i​wi(j)​, so s(1)=winits^{(1)} = w_{\mathrm{init}}s(1)=winit​ and s(t+1)=wfins^{(t+1)} = w_{\mathrm{fin}}s(t+1)=wfin​, and let

γ(j)=∑i=1nwi(j)xi(j)s(j)\gamma^{(j)} = \frac{\sum_{i=1}^n w_i^{(j)} x_i^{(j)}}{s^{(j)}}γ(j)=s(j)∑i=1n​wi(j)​xi(j)​​

be the weighted average prediction. WMR predicts 111 with probability γ(j)\gamma^{(j)}γ(j). Its number of mistakes is m=∑j=1t∣λ(j)−ρ(j)∣m = \sum_{j=1}^t |\lambda^{(j)} - \rho^{(j)}|m=∑j=1t​∣λ(j)−ρ(j)∣.

The weak independence condition (p. 238) requires, for j=1,…,tj = 1, \dots, tj=1,…,t,

E(λ(j) ∣ (x(1),ρ(1)),…,(x(j),ρ(j)))=γ(j)almost surely.\mathbf E\big(\lambda^{(j)} \,\big|\, (x^{(1)},\rho^{(1)}), \dots, (x^{(j)},\rho^{(j)})\big) = \gamma^{(j)} \quad \text{almost surely}.E(λ(j)​(x(1),ρ(1)),…,(x(j),ρ(j)))=γ(j)almost surely.

The conditioning includes the current predictions of the pool and the current label. It allows instances and labels to depend on the master's past predictions, and it holds, for instance, when WMR draws one uniform number r∈[0,1]r \in [0,1]r∈[0,1] and predicts 111 whenever γ(j)≥r\gamma^{(j)} \ge rγ(j)≥r, provided the instances and labels are generated independently of rrr.

Formalization targets

Goal: Theorem 6.1

Under the weak independence condition, and with wfin>0w_{\mathrm{fin}} > 0wfin​>0 almost surely,

E(m)≤E(ln⁡(winit/wfin))1−β.\mathbf E(m) \le \frac{\mathbf E\big(\ln(w_{\mathrm{init}}/w_{\mathrm{fin}})\big)}{1-\beta}.E(m)≤1−βE(ln(winit​/wfin​))​.

The statement fixes neither the pool, nor the update factors within (5.1), nor the distribution of instances and labels.

Milestone: expected mistakes equal expected loss of the weighted average

The step of the proof on p. 240: under the weak independence condition, E(∣λ(j)−ρ(j)∣∣Fj)=∣γ(j)−ρ(j)∣\mathbf E(|\lambda^{(j)}-\rho^{(j)}| \mid \mathcal F_j) = |\gamma^{(j)}-\rho^{(j)}|E(∣λ(j)−ρ(j)∣∣Fj​)=∣γ(j)−ρ(j)∣ almost surely, and hence

E(m)=E(∑j=1t∣γ(j)−ρ(j)∣).\mathbf E(m) = \mathbf E\Big(\sum_{j=1}^t |\gamma^{(j)}-\rho^{(j)}|\Big).E(m)=E(j=1∑t​∣γ(j)−ρ(j)∣).

Significance

Theorem 6.1 gives the randomized master the same bound that Theorem 5.2 gives the deterministic master WMC, whose predictions are allowed to lie in [0,1][0,1][0,1]. With equal initial weights, ln⁡(winit/wfin)≤ln⁡n+miln⁡(1/β)\ln(w_{\mathrm{init}}/w_{\mathrm{fin}}) \le \ln n + m_i \ln(1/\beta)ln(winit​/wfin​)≤lnn+mi​ln(1/β) for every pool member iii with total loss mim_imi​, and the bound yields Corollary 6.1 (p. 241): E(m)≤(ln⁡n+E(mi)ln⁡(1/β))/(1−β)\mathbf E(m) \le (\ln n + \mathbf E(m_i)\ln(1/\beta))/(1-\beta)E(m)≤(lnn+E(mi​)ln(1/β))/(1−β). For β\betaβ close to 111 this is better by nearly a factor of two than the bound for the deterministic binary master WMG. The weak independence condition is also what makes the bound valid against labels that adapt to the master's past predictions, which is the setting of later regret analyses.

The result is proved in the paper; this mission produces a machine-checked version. The platform has proofs of the randomized weighted majority bound in the form of Hazan's Lemma 1.4 and of Mohri et al.'s Theorem 8.4, but both state an expectation over the algorithm's internal distribution with deterministic data, unit weights and one fixed update rule. Neither covers random instances and labels, the conditional-expectation condition, or the whole class of updates (5.1).

Difficulty

The pathwise part of the argument is the loss bound for the weighted average (Lemma 5.3, posed in the companion mission on WMC). The new difficulty is probabilistic. The predictions, labels and weights are random and may depend on each other across trials, so the mistake indicator ∣λ(j)−ρ(j)∣|\lambda^{(j)}-\rho^{(j)}|∣λ(j)−ρ(j)∣ cannot be replaced by ∣γ(j)−ρ(j)∣|\gamma^{(j)}-\rho^{(j)}|∣γ(j)−ρ(j)∣ pointwise. The replacement holds only after conditioning on the σ\sigmaσ-algebra Fj\mathcal F_jFj​, and requires that ρ(j)\rho^{(j)}ρ(j) is Fj\mathcal F_jFj​-measurable and binary, so that the indicator is affine in λ(j)\lambda^{(j)}λ(j). A reading that conditions on less (dropping the current label) or uses unconditional expectations does not support this step when the label depends on earlier randomness.

A second difficulty is that E(ln⁡(winit/wfin))\mathbf E(\ln(w_{\mathrm{init}}/w_{\mathrm{fin}}))E(ln(winit​/wfin​)) may be infinite: the weights can become arbitrarily small with positive probability.

Formalization scope

The pool is Fin n; trials are indexed from 000 to t−1t-1t−1, so totalWeight … 0 is winitw_{\mathrm{init}}winit​ and totalWeight … t is wfinw_{\mathrm{fin}}wfin​. The probability space is a measure P with IsProbabilityMeasure P. Predictions, labels and master predictions are real-valued measurable random variables; pool predictions lie in [0,1][0,1][0,1] and labels and master predictions in {0,1}\{0,1\}{0,1} on every sample path. Initial weights are deterministic and positive. The update factor of member iii in trial jjj is a measurable function Fj,i(x,r)F_{j,i}(x, r)Fj,i​(x,r) of the member's prediction and the label, satisfying (5.1) on every sample path; the weights are computed from it, so they are random variables determined by the predictions and labels. Fj\mathcal F_jFj​ is the supremum of the σ\sigmaσ-algebras generated by the pairs (x(k),ρ(k))(x^{(k)}, \rho^{(k)})(x(k),ρ(k)), k≤jk \le jk≤j, and the weak independence condition is stated with Mathlib's conditional expectation P[λ j | 𝓕 j].

Expectations in the goal are lower Lebesgue integrals in [0,∞][0,\infty][0,∞], so the right-hand side may be +∞+\infty+∞ and no integrability of the logarithm is assumed. The hypothesis wfin>0w_{\mathrm{fin}} > 0wfin​>0 almost surely excludes the case where the paper's bound is infinite and Lean's ln⁡0=0\ln 0 = 0ln0=0 would make the literal statement false. A formalization that replaces the conditional expectation by the unconditional one, takes the logarithm's Bochner integral (which is 000 when the logarithm is not integrable), or restricts to deterministic instances and labels does not state Theorem 6.1.

A complete development needs the pathwise loss bound of Lemma 5.3 for this weight model, the pull-out property of conditional expectations for bounded measurable factors, and the exchange of expectation and finite sums. The weight model and the filtration are reusable for Theorem 6.3 and for the lazy variant of the Appendix. Proofs of the milestone and of the goal are welcome, as are formalizations of Corollary 6.1.

Selected references

  • N. Littlestone, M. K. Warmuth, The Weighted Majority Algorithm, Information and Computation 108(2), 212–261, 1994. https://doi.org/10.1006/inco.1994.1009
  • Y. Freund, R. E. Schapire, A Decision-Theoretic Generalization of On-Line Learning and an Application to Boosting, Journal of Computer and System Sciences 55(1), 119–139, 1997. https://doi.org/10.1006/jcss.1997.1504
  • S. Arora, E. Hazan, S. Kale, The Multiplicative Weights Update Method: a Meta-Algorithm and Applications, Theory of Computing 8, 121–164, 2012. https://doi.org/10.4086/toc.2012.v008a006
  • N. Cesa-Bianchi, G. Lugosi, Prediction, Learning, and Games, Cambridge University Press, 2006. https://doi.org/10.1017/CBO9780511546921
3 thms1 active userReviewed
CombinatoricsGraph TheoryLinear Optimization+1·Captain: mikedeng1

The Geometry of Graphs and Some of Its Algorithmic Applications 1: Every Multicommodity Flow Network with k Source-Sink Pairs Has a Cut S with Cap(S)/Dem(S) ≤ O(log k) · maxflowResearch Paper

Motivation

Routing several commodities through one capacitated network at the same time is a basic problem of network optimization, with applications to communication networks, VLSI layout and divide-and-conquer graph algorithms. Its optimum is the value of a linear program, but the natural certificates of an upper bound are combinatorial: every cut of the network limits how much can be routed across it. For a single commodity the max-flow min-cut theorem says that the best cut certificate is exact. With many commodities it is not, and the size of the gap between the best flow and the best cut is the question of this mission.

  • 1988–1999, Leighton and Rao proved that for uniform demands (one unit between every pair of vertices) the gap is O(log⁡n)O(\log n)O(logn) on an nnn-vertex network, and that the bound is attained on expanders (Leighton–Rao, JACM 1999; FOCS 1988).
  • 1990–1995, Klein, Rao, Agrawal and Ravi extended a polylogarithmic bound to arbitrary demands, O(log⁡Clog⁡D)O(\log C \log D)O(logClogD) in the total capacity CCC and total demand DDD (Combinatorica 15, 1995); Plotkin and Tardos improved it to O(log⁡2k)O(\log^2 k)O(log2k) in the number of commodities kkk (Combinatorica 15, 1995).
  • 1995, Linial, London and Rabinovich (Combinatorica 15, 1995), and independently Aumann and Rabani (SIAM J. Comput. 1998), showed that the gap is bounded by the least distortion of embedding a metric derived from the network into ℓ1\ell_1ℓ1​, and obtained the bound O(log⁡k)O(\log k)O(logk) from Bourgain's embedding theorem. This mission formalizes that theorem, Theorem 4.1 of the Linial–London–Rabinovich paper.

Setting

A multicommodity flow network has a finite vertex set VVV, capacities Ci,j=Cj,i≥0C_{i,j} = C_{j,i} \ge 0Ci,j​=Cj,i​≥0 (zero for non-edges and on the diagonal), and kkk commodities: commodity μ\muμ has a source sμs_\musμ​, a sink tμt_\mutμ​ and a demand Dμ≥0D_\mu \ge 0Dμ​≥0.

A feasible concurrent flow of value λ\lambdaλ sends, for every μ\muμ, λDμ\lambda D_\muλDμ​ units of commodity μ\muμ from sμs_\musμ​ to tμt_\mutμ​: arc flows fμ(i,j)≥0f_\mu(i,j) \ge 0fμ​(i,j)≥0 satisfy conservation of matter, with net outflow λDμ\lambda D_\muλDμ​ at sμs_\musμ​, −λDμ-\lambda D_\mu−λDμ​ at tμt_\mutμ​ and 000 elsewhere, and the total flow of all commodities through each undirected edge {i,j}\{i,j\}{i,j}, in both directions, is at most Ci,jC_{i,j}Ci,j​. The maxflow of the network is the largest such λ\lambdaλ.

For S⊆VS \subseteq VS⊆V, Cap(S)=∑i∈S∑j∉SCi,j\mathrm{Cap}(S) = \sum_{i \in S}\sum_{j \notin S} C_{i,j}Cap(S)=∑i∈S​∑j∈/S​Ci,j​ is the capacity of the edges leaving SSS, and Dem(S)\mathrm{Dem}(S)Dem(S) is the total demand of the pairs that SSS separates, i.e. with ∣S∩{sμ,tμ}∣=1|S \cap \{s_\mu,t_\mu\}| = 1∣S∩{sμ​,tμ​}∣=1. Every flow of value λ\lambdaλ has to push λ Dem(S)\lambda\,\mathrm{Dem}(S)λDem(S) units across the cut, so

maxflow≤Cap(S)Dem(S)for every S with Dem(S)>0.\mathrm{maxflow} \le \frac{\mathrm{Cap}(S)}{\mathrm{Dem}(S)} \quad\text{for every } S \text{ with } \mathrm{Dem}(S) > 0.maxflow≤Dem(S)Cap(S)​for every S with Dem(S)>0.

A semi-metric on VVV is a function d≥0d \ge 0d≥0 with d(i,i)=0d(i,i) = 0d(i,i)=0, symmetry and the triangle inequality; distinct points may be at distance 000, as in the paper.

Formalization targets

Goal: Theorem 4.1

There is an absolute constant C0>0C_0 > 0C0​>0 such that every network in which some commodity has Dμ>0D_\mu > 0Dμ​>0 and sμ≠tμs_\mu \ne t_\musμ​=tμ​ has a set S⊆VS \subseteq VS⊆V with Dem(S)>0\mathrm{Dem}(S) > 0Dem(S)>0 and

Cap(S)Dem(S)≤C0log⁡(max⁡(k,2))⋅maxflow.\frac{\mathrm{Cap}(S)}{\mathrm{Dem}(S)} \le C_0 \log(\max(k,2)) \cdot \mathrm{maxflow}.Dem(S)Cap(S)​≤C0​log(max(k,2))⋅maxflow.

The constant is not fixed; only the shape O(log⁡k)O(\log k)O(logk) in the number of commodities is asserted.

Milestones, in the order the proof uses them

  1. Weak duality (§4, p. 226): λ Dem(S)≤Cap(S)\lambda\,\mathrm{Dem}(S) \le \mathrm{Cap}(S)λDem(S)≤Cap(S) for every feasible λ≥0\lambda \ge 0λ≥0 and every SSS.
  2. LP duality display (p. 227): maxflow=min⁡d∑{i,j}Ci,jdi,j∑μDμdsμ,tμ\mathrm{maxflow} = \min_d \dfrac{\sum_{\{i,j\}} C_{i,j} d_{i,j}}{\sum_\mu D_\mu d_{s_\mu,t_\mu}}maxflow=mind​∑μ​Dμ​dsμ​,tμ​​∑{i,j}​Ci,j​di,j​​ over semi-metrics ddd.
  3. Corollary 3.4, Claim 2 (p. 223): every finite semi-metric space with kkk marked pairs has a non-expanding map into some ℓ1m\ell_1^mℓ1m​ that shrinks each marked pair by at most C1log⁡(max⁡(k,2))C_1 \log(\max(k,2))C1​log(max(k,2)).
  4. Coordinate minimum (p. 227): for points of ℓ1m\ell_1^mℓ1m​, the cost-to-demand ratio is at least its value on the best single coordinate.
  5. 0/1 rounding (pp. 227–228): for symmetric real weights aaa and nonnegative symmetric weights bbb, the minimum of ∑aij∣zi−zj∣/∑bij∣zi−zj∣\sum a_{ij}|z_i - z_j| / \sum b_{ij}|z_i - z_j|∑aij​∣zi​−zj​∣/∑bij​∣zi​−zj​∣ over real vectors zzz is attained at a 0/1 vector.

Significance

The theorem bounds the flow–cut gap: the integrality gap of the linear relaxation of the sparsest cut problem is O(log⁡k)O(\log k)O(logk), so solving one linear program and rounding gives an O(log⁡k)O(\log k)O(logk)-approximation to the sparsest cut. Sparsest-cut approximations are the engine of approximation algorithms for minimum bisection, graph partitioning, crossing number and VLSI layout. The dependence on kkk rather than on the number of vertices matters when few pairs carry demand. The bound is tight up to the constant: on constant-degree expanders with all-pairs unit demands the gap is Ω(log⁡n)\Omega(\log n)Ω(logn) (Leighton–Rao).

The result has been proved since 1995 and is textbook material (Williamson–Shmoys, Ch. 15). It has no machine-checked proof. A formalization adds a verified bridge between concurrent flows, LP duality on networks and ℓ1\ell_1ℓ1​ embeddings of finite metrics; each piece is reusable on its own. Corollary 3.4, Claim 2 in particular is a terminal version of Bourgain's theorem, of which no formal proof exists either.

Difficulty

Two steps carry the weight. The first is the duality between concurrent flows and metrics: Mathlib has no linear programming duality theorem in a form that applies directly, and the dual of the arc-flow program has to be identified with a minimum over semi-metrics, which needs a shortest-path argument on top of LP duality. The second is the embedding: Claim 2 of Corollary 3.4 must achieve distortion O(log⁡k)O(\log k)O(logk) on the kkk marked pairs, independent of ∣X∣|X|∣X∣. A direct application of Bourgain's theorem to the whole space gives O(log⁡∣X∣)O(\log |X|)O(log∣X∣), which is not enough when kkk is much smaller than the number of vertices, and the paper's proof is a one-line reference to an earlier argument.

Formalization scope

  • Vertex sets are finite types V with [Fintype V] [DecidableEq V]; capacities are a function C : V → V → ℝ with symmetry, nonnegativity and zero diagonal as fields of a Network structure. Commodities are indexed by Fin k; coincident or repeated pairs are allowed.
  • Flows are arc flows; the capacity bounds the total over all commodities and both directions. maxflow is the supremum of feasible values; Lean's sSup returns 000 on an unbounded set, which only happens without a commodity of positive demand and distinct endpoints, and the goal assumes one.
  • Sums over edges are over unordered pairs: the page's ∑i≠j\sum_{i \ne j}∑i=j​ in the LP-duality and coordinate displays counts each edge twice, while Cap\mathrm{Cap}Cap counts it once; the statements use 12∑i∑j\tfrac12\sum_i\sum_j21​∑i​∑j​ in both places, which removes the factor-2 slip without changing the proof.
  • Explicit constants. The paper's O(log⁡k)O(\log k)O(logk) in Theorem 4.1 is C0log⁡(max⁡(k,2))C_0 \log(\max(k,2))C0​log(max(k,2)) with C0C_0C0​ quantified before the network; the Ω(1/log⁡k)\Omega(1/\log k)Ω(1/logk) of Corollary 3.4 is 1/(C1log⁡(max⁡(k,2)))1/(C_1\log(\max(k,2)))1/(C1​log(max(k,2))) with C1C_1C1​ quantified before the metric space. The max⁡(k,2)\max(k,2)max(k,2) keeps k=1k = 1k=1 in scope, where log⁡k=0\log k = 0logk=0.
  • Out of scope. The deterministic polynomial-time algorithms of Theorem 4.1 and Corollary 3.4, and the target dimension ℓ1O(n2)\ell_1^{O(n^2)}ℓ1O(n2)​ of the latter, are not stated; the statements assert the existence of the cut and of the embedding.
  • The 0/1 rounding step adds b≥0b \ge 0b≥0, which the page omits but its argument needs.
  • A trivializing formalization is ruled out: the constant C0C_0C0​ is quantified before the network, so it cannot depend on the instance, and maxflow is defined from flows, not as the metric minimum.
  • Contributions welcome: an LP duality theorem for finite-dimensional linear programs in the form needed here, a formal Bourgain-type embedding with terminal distortion, and the max-flow min-cut theorem for undirected capacities.

Selected references

  • N. Linial, E. London, Y. Rabinovich, The geometry of graphs and some of its algorithmic applications, Combinatorica 15 (1995) 215–245. https://doi.org/10.1007/BF01200757
  • Y. Aumann, Y. Rabani, An O(log k) approximate min-cut max-flow theorem and approximation algorithm, SIAM J. Comput. 27 (1998) 291–301. https://doi.org/10.1137/S0097539794285983
  • T. Leighton, S. Rao, Multicommodity max-flow min-cut theorems and their use in designing approximation algorithms, J. ACM 46 (1999) 787–832. https://doi.org/10.1145/331524.331526
  • J. Bourgain, On Lipschitz embedding of finite metric spaces in Hilbert space, Israel J. Math. 52 (1985) 46–52. https://doi.org/10.1007/BF02776078
  • D. P. Williamson, D. B. Shmoys, The Design of Approximation Algorithms, Cambridge University Press, 2011, Chapter 15. https://doi.org/10.1017/CBO9780511921735
9 thms1 active userReviewed
Machine LearningTheoretical Computer Science·Captain: mikedeng1

The Weighted Majority Algorithm 3: On a Countably Infinite Pool, WMI2 Makes at Most inf_i (log(Ŵ(1)/W(i)) + m_i log(1/β) + log 2)/log(1/u) MistakesResearch Paper

Motivation

In prediction with expert advice, a master algorithm predicts a binary label in each of a sequence of trials, after seeing the predictions of a pool of other algorithms (the "experts"), and is charged one mistake whenever its prediction differs from the label. No probabilistic assumption is made on the sequence: the goal is a bound on the master's mistakes, valid for every sequence, in terms of the mistakes of the best pool member. The Weighted Majority Algorithm of Littlestone and Warmuth (Inform. and Comput. 108, 1994) achieves this for a finite pool of nnn members with O(log⁡n+mi)O(\log n + m_i)O(logn+mi​) mistakes, where mim_imi​ is the number of mistakes of member iii.

Many natural pools are infinite: all programs in an enumeration, all hypotheses of a countable class, all values of a discretised parameter. Section 4 of the paper asks whether a master can compete with every member of a countably infinite pool A1,A2,…A_1, A_2, \dotsA1​,A2​,…, making at most c(log⁡i+mi)c(\log i + m_i)c(logi+mi​) mistakes for every iii, while keeping only finitely many weights at any time. Running the Weighted Majority Algorithm on infinitely many weights would give such a bound, but cannot be implemented.

Timeline. Barzdin and Freivalds (1972, 1974) studied prediction of a sequence by an enumerable family of functions and gave an essentially optimal bound for the case of a pool containing a member consistent with the whole sequence (β=0\beta = 0β=0 below). Littlestone and Warmuth's earlier versions of the paper (1989) introduced an algorithm WMI for infinite pools; the journal version (1994) replaced it by WMI2\mathrm{WMI}_2WMI2​, which matches the Barzdin–Freivalds bound when β=0\beta = 0β=0 and a consistent member exists, and extends it to pools in which every member may err.

Setting

Fix a parameter β\betaβ with 0≤β<10 \le \beta < 10≤β<1 and put u=(1+β)/2u = (1+\beta)/2u=(1+β)/2. Fix two real functions WWW and W^\hat WW^ on the positive integers with

W(i)>0,∑iW(i)<∞,W^(i)≥∑j≥iW(j),lim⁡i→∞W^(i)=0.W(i) > 0, \qquad \sum_{i} W(i) < \infty, \qquad \hat W(i) \ge \sum_{j \ge i} W(j), \qquad \lim_{i \to \infty} \hat W(i) = 0 .W(i)>0,i∑​W(i)<∞,W^(i)≥j≥i∑​W(j),i→∞lim​W^(i)=0.

W(i)W(i)W(i) is the initial weight of the pool member AiA_iAi​, and W^(i)\hat W(i)W^(i) bounds the weight of the tail Ai,Ai+1,…A_i, A_{i+1}, \dotsAi​,Ai+1​,….

A sequence of TTT trials gives, for each trial ttt, the prediction xt(i)∈{0,1}x_t(i) \in \{0,1\}xt​(i)∈{0,1} of every pool member and a label ρt∈{0,1}\rho_t \in \{0,1\}ρt​∈{0,1}. Member AiA_iAi​ makes at most mim_imi​ mistakes: xt(i)≠ρtx_t(i) \ne \rho_txt​(i)=ρt​ for at most mim_imi​ trials ttt.

The master WMI2\mathrm{WMI}_2WMI2​ keeps an active pool A1,…,AlA_1, \dots, A_lA1​,…,Al​ and a weight for each active member. With mmm the number of its own mistakes so far, let

θ(m)=um+1 W^(1)(1−β)(m+1)(m+2).\theta(m) = \frac{u^{m+1}\,\hat W(1)}{(1-\beta)(m+1)(m+2)} .θ(m)=(1−β)(m+1)(m+2)um+1W^(1)​.

Initially, and after each trial in which it errs, WMI2\mathrm{WMI}_2WMI2​ raises lll (starting from l=0l = 0l=0) to the least value with W^(l+1)≤θ(m)\hat W(l+1) \le \theta(m)W^(l+1)≤θ(m); a newly activated AiA_iAi​ gets weight W(i)W(i)W(i). In a trial it computes the active weight q0q_0q0​ predicting 000 and q1q_1q1​ predicting 111; it predicts 000 if q0>q1+θ(m)q_0 > q_1 + \theta(m)q0​>q1​+θ(m), predicts 111 if q1>q0+θ(m)q_1 > q_0 + \theta(m)q1​>q0​+θ(m), and may predict either otherwise. After a mistake, every active member that disagreed with the label has its weight multiplied by β\betaβ. The weights ωi\omega_iωi​ of the analysis are the current weight of an active member and W(i)W(i)W(i) for an inactive one.

Formalization targets

The goal is Theorem 4.1, part 3 (p. 227). Let mmm be the total number of mistakes of WMI2\mathrm{WMI}_2WMI2​ on the sequence.

Goal: the mistake bound of WMI2\mathrm{WMI}_2WMI2​

If 0<β<10 < \beta < 10<β<1, then

m≤inf⁡i≥1log⁡(W^(1)/W(i))+milog⁡(1/β)+log⁡2log⁡(1/u),m \le \inf_{i \ge 1} \frac{\log\bigl(\hat W(1)/W(i)\bigr) + m_i \log(1/\beta) + \log 2}{\log(1/u)} ,m≤i≥1inf​log(1/u)log(W^(1)/W(i))+mi​log(1/β)+log2​,

and if β=0\beta = 0β=0 and mi=0m_i = 0mi​=0 for some iii, then m≤1+log⁡2(W^(1)/W(i))m \le 1 + \log_2\bigl(\hat W(1)/W(i)\bigr)m≤1+log2​(W^(1)/W(i)).

Milestone: the size of the active pool (Theorem 4.1, part 1)

At the beginning of any trial, lll is the minimum lll with W^(l+1)≤θ(m)\hat W(l+1) \le \theta(m)W^(l+1)≤θ(m), where mmm counts the mistakes made in prior trials.

Milestone: the weight invariant (Theorem 4.1, part 2)

After any initial sequence of trials in which mmm mistakes have been made,

∑i=1∞ωi≤(2−1m+1)um W^(1).\sum_{i=1}^{\infty} \omega_i \le \Bigl(2 - \frac{1}{m+1}\Bigr) u^{m}\, \hat W(1) .i=1∑∞​ωi​≤(2−m+11​)umW^(1).

Significance

The result. The bound holds simultaneously for every pool member, so the master competes with the best member of an infinite pool, paying log⁡(W^(1)/W(i))\log(\hat W(1)/W(i))log(W^(1)/W(i)) for the position of that member in the enumeration. With W(i)=1/(i(i+1))W(i) = 1/(i(i+1))W(i)=1/(i(i+1)) and W^(i)=1/i\hat W(i) = 1/iW^(i)=1/i (the paper's Corollary 4.1) this is O(log⁡i+mi)O(\log i + m_i)O(logi+mi​) mistakes, with an active pool that grows exponentially in the number of mistakes but is finite at every time. Different choices of WWW trade the mistake bound against the growth of the active pool. The same analysis shows how the predictions can be computed from finite-precision approximations of the weights, which is the reason for the slack band in the prediction rule. Its β=0\beta = 0β=0 case recovers the Barzdin–Freivalds bound.

Formalizing it. The theorem is proved in the paper; no machine-checked version is known to exist, and there is no formalization of the Weighted Majority Algorithm on infinite pools on Prove2Me. The work is to formalize the paper's proof: the size statement for the active pool, the inductive invariant for the total weight, and the final logarithmic bound. The definition of a run of WMI2\mathrm{WMI}_2WMI2​, with free predictions in the slack band and lazily activated weights, is reusable for other lazy-activation algorithms on countable pools, and the paper's Corollaries 4.1–4.3 are direct instances once the goal is proved.

Difficulty

The ordinary Weighted Majority analysis tracks the total weight of the whole pool, which shrinks by the factor uuu after each mistake. For WMI2\mathrm{WMI}_2WMI2​ that argument does not apply as is: the master only sees the active weights, and the inactive tail, whose weight is unknown to the algorithm and charged at its initial value, may vote with the label. The obvious bound on the tail is too weak if applied with a fixed slack; it must shrink with the number of mistakes at the right rate so that the accumulated overhead stays below a constant factor. The slack band in the prediction rule interacts with this: when the master errs inside the band, the active majority may not have been wrong by much, and the shrinkage factor must be recovered from the band's width. The factor 2−1/(m+1)2 - 1/(m+1)2−1/(m+1) is where these effects are balanced.

Formalization scope

The pool is indexed by ℕ+ and trials by Fin T; false encodes the prediction 000, true the prediction 111. IsWMI2Run is a relation between the input sequence and the master's predictions, the weights wt(i)w_t(i)wt​(i) and the active-pool sizes ltl_tlt​ at every trial boundary t∈{0,…,T}t \in \{0, \dots, T\}t∈{0,…,T}; a prediction inside the slack band is unconstrained, so the theorems hold for every run. Only active weights are constrained; the analysis uses omega, which counts inactive members at W(i)W(i)W(i). The bound mim_imi​ is any upper bound on the mistakes of AiA_iAi​. The tail hypothesis is stated with a tsum together with Summable W, and the milestone on the total weight asserts summability of ω\omegaω in its conclusion, so it cannot hold through the value 000 that Lean assigns to a divergent series. The infimum in the goal is stated as a bound for every iii, which is equivalent. Logarithms in the ratio are natural logarithms (the base cancels); the β=0\beta = 0β=0 bound uses Real.logb 2. The paper requires WWW and W^\hat WW^ to be computable; this only makes the algorithm implementable, and the formal statements hold for arbitrary real functions with the stated analytic properties.

A statement for an algorithm whose runs do not exist would be vacuous; runs of WMI2\mathrm{WMI}_2WMI2​ exist for every sequence under the hypotheses (this has been checked locally in Lean), because W^→0\hat W \to 0W^→0 and θ(m)>0\theta(m) > 0θ(m)>0 keep the active pool finite.

Needed infrastructure: finite sums over the active pool, tsum manipulations for sequences that agree with WWW outside a finite set, and real logarithm inequalities. Contributions welcome: proofs of the two milestones and the goal, and the Corollaries 4.1–4.3 as follow-up statements.

Selected references

  • N. Littlestone, M. K. Warmuth, The Weighted Majority Algorithm, Information and Computation 108(2), 212–261, 1994. https://doi.org/10.1006/inco.1994.1009
  • J. M. Barzdin, R. V. Freivalds, On the prediction of general recursive functions, Soviet Mathematics Doklady 13, 1224–1228, 1972.
  • J. M. Barzdin, R. V. Freivalds, Prognozirovanie i predel'nyi sintez effektivno perechislimykh klassov funktsii [Prediction and limit synthesis of effectively enumerable classes of functions], in Theory of Algorithms and Programs (J. M. Barzdin, ed.), Vol. 1, 101–111, Latvian State University, 1974 (in Russian).
  • N. Littlestone, M. K. Warmuth, The Weighted Majority Algorithm, Proceedings of the 30th Annual Symposium on Foundations of Computer Science, 256–261, IEEE, 1989 (cited in the journal paper as [LW89a]).
4 thms1 active userReviewed
CombinatoricsGraph TheoryLinear Optimization+1·Captain: mikedeng1

Approximation Algorithms for Scheduling Unrelated Parallel Machines 1: Binary Search over Rounded LP Vertices Finds a Schedule within Twice the Optimal MakespanResearch Paper

Motivation

Scheduling unrelated parallel machines to minimize the makespan, written R ∥ Cmax⁡R\,\|\,C_{\max}R∥Cmax​, is one of the basic NP-hard problems of scheduling theory. A set of jobs must each be run on one of several machines, and the time a job takes depends arbitrarily on the machine; the goal is to finish all jobs as early as possible. Before the work formalized here, the best polynomial algorithm known guaranteed only a schedule within 2m2\sqrt m2m​ times the optimum (Davis and Jaffe, 1981), a factor that grows with the number of machines mmm.

Lenstra, Shmoys and Tardos (FOCS 1987; CWI Report OS-R8714, 1987; Math. Programming 46, 1990) gave a polynomial algorithm with guarantee 222, independent of mmm. Their tool is a rounding theorem: a vertex of a natural linear-programming relaxation can be rounded to an integral schedule that exceeds each machine's budget by at most one job. The rounding theorem and the binary-search framework around it became standard material in approximation algorithms.

Setting

There are nnn jobs and m≥1m\ge 1m≥1 machines. If job jjj is scheduled on machine iii, it takes pijp_{ij}pij​ time units, a positive integer. A schedule σ\sigmaσ assigns every job jjj to one machine σ(j)\sigma(j)σ(j). The load of machine iii is ∑j:σ(j)=ipij\sum_{j:\sigma(j)=i}p_{ij}∑j:σ(j)=i​pij​, the makespan of σ\sigmaσ is the largest load, and OPT\mathrm{OPT}OPT is the minimum makespan over all schedules.

For deadlines d1,…,dmd_1,\dots,d_md1​,…,dm​ and a threshold ttt, let Ji(t)={j:pij≤t}J_i(t)=\{j: p_{ij}\le t\}Ji​(t)={j:pij​≤t} and Mj(t)={i:pij≤t}M_j(t)=\{i : p_{ij}\le t\}Mj​(t)={i:pij​≤t}. The linear program (LP) has variables xij≥0x_{ij}\ge 0xij​≥0 for j∈Ji(t)j\in J_i(t)j∈Ji​(t) and constraints

∑i∈Mj(t)xij=1(j=1,…,n),∑j∈Ji(t)pijxij≤di(i=1,…,m).\sum_{i\in M_j(t)}x_{ij}=1\quad(j=1,\dots,n),\qquad \sum_{j\in J_i(t)}p_{ij}x_{ij}\le d_i\quad(i=1,\dots,m).i∈Mj​(t)∑​xij​=1(j=1,…,n),j∈Ji​(t)∑​pij​xij​≤di​(i=1,…,m).

The integer program (IP) replaces did_idi​ by di+td_i+tdi​+t and requires xij∈{0,1}x_{ij}\in\{0,1\}xij​∈{0,1}. A vertex of (LP) is an extreme point of its feasible polytope. The support graph of a point x~\tilde xx~ is the bipartite graph on machines and jobs with an edge (i,j)(i,j)(i,j) whenever x~ij>0\tilde x_{ij}>0x~ij​>0.

A ρ\rhoρ-relaxed decision procedure answers, for a deadline ddd, either 'no' or a schedule, such that (1) every schedule it returns has makespan at most ρd\rho dρd, and (2) if it answers 'no', no schedule has makespan at most ddd. The binary search of Lemma 1 starts from the greedy schedule (each job on a machine where it runs fastest), whose makespan ttt is an upper bound uuu, with lower bound l=⌈t/m⌉l=\lceil t/m\rceill=⌈t/m⌉, queries the procedure at d=⌊(u+l)/2⌋d=\lfloor(u+l)/2\rfloord=⌊(u+l)/2⌋, moves uuu to ddd on a schedule and lll to d+1d+1d+1 on 'no', and outputs the best schedule found once l=ul=ul=u.

The LP rounding procedure answers, on deadline ddd, by solving (LP) with d1=⋯=dm=t=dd_1=\dots=d_m=t=dd1​=⋯=dm​=t=d: 'no' if it is infeasible, and otherwise a 0-1 solution of (IP) obtained by rounding a vertex x~\tilde xx~ chosen by the LP solver, supported on x~\tilde xx~.

Formalization targets

Goal: Theorem 2

For every LP solver (every rule choosing a vertex of (LP) when it is feasible), an LP rounding procedure DDD exists, and for every such DDD the output σD\sigma_DσD​ of the binary search satisfies

makespan⁡(σD)≤2⋅OPT.\operatorname{makespan}(\sigma_D)\le 2\cdot\mathrm{OPT}.makespan(σD​)≤2⋅OPT.

Milestones

  1. The support graph of every vertex of (LP) is a pseudoforest: every set SSS of machines and TTT of jobs spans at most ∣S∣+∣T∣|S|+|T|∣S∣+∣T∣ edges (§2, p. 4).
  2. In a machine–job pseudoforest, every set of jobs of degree at least 222 can be matched injectively into the machines (§2, pp. 4–5).
  3. A schedule supported on a feasible x~\tilde xx~ with at most one fractional job per machine has loads at most di+td_i+tdi​+t (§2, p. 5).
  4. Theorem 1 (Rounding Theorem): every vertex x~\tilde xx~ of (LP) has a schedule σ\sigmaσ supported on x~\tilde xx~ with
∑j:σ(j)=ipij≤di+t(i=1,…,m).\sum_{j:\sigma(j)=i}p_{ij}\le d_i+t\qquad(i=1,\dots,m).j:σ(j)=i∑​pij​≤di​+t(i=1,…,m).
  1. Lemma 1: for every ρ\rhoρ-relaxed decision procedure, the binary search outputs a schedule of makespan at most ρ⋅OPT\rho\cdot\mathrm{OPT}ρ⋅OPT.
  2. A schedule with makespan at most ddd gives a feasible point of (LP) with di=t=dd_i=t=ddi​=t=d (§3, p. 5).
  3. The LP rounding procedure is 222-relaxed (§3, pp. 5–6).

Significance

Theorem 2 gives a constant-factor approximation for R ∥ Cmax⁡R\,\|\,C_{\max}R∥Cmax​ that does not depend on mmm. The same rounding theorem drives the paper's second algorithm, a (1+ϵ)(1+\epsilon)(1+ϵ)-approximation for a fixed number of machines using polynomial space, and the paper's lower bound shows that no polynomial algorithm achieves a factor below 3/23/23/2 unless P=NP\mathrm{P}=\mathrm{NP}P=NP. The Rounding Theorem, in its later form for generalized assignment by Shmoys and Tardos (1993), is a standard tool for LP-based scheduling and assignment.

The result is proved; it has, to our knowledge, no machine-checked proof. The platform contains Matoušek and Gärtner's textbook version (MatousekLP.Scheduling.lst_two_approximation, Theorem 8.3.4 of Understanding and Using Linear Programming), which uses a different relaxation: one bound minimized parametrically over TTT, optimal solutions with linearly independent columns, and no per-machine deadlines. This mission formalizes the report's own route: deadlines did_idi​, arbitrary vertices, binary search over a relaxed decision procedure. A formal proof would also yield reusable statements about extreme points of transportation-type polytopes and matchings in pseudoforests.

Difficulty

The obvious rounding, putting each job on a machine where x~ij\tilde x_{ij}x~ij​ is largest, can overload a machine by many jobs at once: nothing in feasibility alone prevents many jobs from each placing a small fraction on the same machine. The bound di+td_i+tdi​+t requires that each machine receive at most one job that the vertex treats fractionally, and this fails for general feasible points; it holds only because x~\tilde xx~ is a vertex. The step that carries the weight is therefore a statement about the combinatorial structure of the support of an extreme point, which must be derived from the linear independence of the tight constraints, followed by a matching argument on the resulting graph. Neither step is available in Mathlib in the form needed.

On the algorithmic side, the binary search must be shown to return a schedule within ρ⋅OPT\rho\cdot\mathrm{OPT}ρ⋅OPT although the decision procedure is only approximately correct; the invariants (the lower bound stays below OPT\mathrm{OPT}OPT, the stored schedule stays within ρ\rhoρ times the upper bound) have to be tracked through a recursion.

Formalization scope

  • Machines are Fin m, jobs Fin n, processing times a matrix P : Matrix (Fin m) (Fin n) ℕ with all entries positive in Lemma 1 and Theorem 2 (the paper's model, p. 2). Loads, makespans and optimal schedules are the published MatousekLP.Scheduling.Schedule definitions applied to the real matrix (pij)(p_{ij})(pij​); OPT\mathrm{OPT}OPT is the makespan of a schedule σopt with IsOptimalSchedule.
  • (LP) is modelled on full m×nm\times nm×n real matrices with the entries pij>tp_{ij}>tpij​>t fixed to 000; this polytope is affinely isomorphic to the paper's, so vertices (Mathlib's Set.extremePoints) correspond exactly. Theorem 1 and its steps are stated for real deadlines and real t≥0t\ge 0t≥0, more general than the paper's integers; the paper's proof does not use integrality, and mission 2 of this series needs non-integral ttt.
  • Algorithmic wording not formalized. Theorem 2 states "a 2-approximation algorithm ... that runs in time bounded by a polynomial in the input size"; Lemma 1 speaks of polynomial procedures; Theorem 1 adds "this rounding can be done in polynomial time". Running time, the ellipsoid method and vertex finding are not formalized. What is formalized is the guarantee the proofs establish: the binary search, written as a Lean function, returns a schedule within ρ⋅OPT\rho\cdot\mathrm{OPT}ρ⋅OPT (Lemma 1, for every ρ\rhoρ-relaxed procedure) and within 2⋅OPT2\cdot\mathrm{OPT}2⋅OPT for every LP rounding procedure and every choice of vertex (Theorem 2).
  • Explicit constants: the factor 222 of Theorem 2 and of the 222-relaxed procedure, which comes from di+td_i+tdi​+t with di=t=dd_i=t=ddi​=t=d; the overshoot ttt of Theorem 1; the initial bounds u=u=u= greedy makespan and l=⌈u/m⌉l=\lceil u/m\rceill=⌈u/m⌉ (the paper's t/mt/mt/m, rounded up because OPT\mathrm{OPT}OPT is an integer); the query point ⌊(u+l)/2⌋\lfloor(u+l)/2\rfloor⌊(u+l)/2⌋.
  • The LP solver's choice is quantified over by a vertex selector, returning a vertex when (LP) is feasible and nothing otherwise; one always exists, since the polytope is compact.
  • Trivializing formalization ruled out. "There is a schedule with makespan at most 2⋅OPT2\cdot\mathrm{OPT}2⋅OPT" is trivially witnessed by an optimal schedule; the goal instead bounds the output of the binary search, whose every 'almost' answer must be a rounding of the solver's vertex, supported on it and feasible for (IP).
  • Needed infrastructure: extreme points of polytopes given by linear constraints and their tight-constraint rank characterization; bipartite pseudoforests and Hall-type matchings; well-founded recursion for the search. Proofs of any milestone, and reusable lemmas on extreme points of assignment polytopes, are welcome.

Selected references

  • J. K. Lenstra, D. B. Shmoys, É. Tardos, Approximation algorithms for scheduling unrelated parallel machines, CWI Report OS-R8714, Centre for Mathematics and Computer Science, Amsterdam, 1987 (the source of this mission's statements and numbering); also Proc. 28th IEEE Symposium on Foundations of Computer Science (1987) 217–224
  • J. K. Lenstra, D. B. Shmoys, É. Tardos, Approximation algorithms for scheduling unrelated parallel machines, Mathematical Programming 46 (1990) 259–271, https://doi.org/10.1007/BF01585745
  • E. Davis, J. M. Jaffe, Algorithms for scheduling tasks on unrelated processors, Journal of the ACM 28 (1981) 721–736, https://doi.org/10.1145/322276.322284
  • D. B. Shmoys, É. Tardos, An approximation algorithm for the generalized assignment problem, Mathematical Programming 62 (1993) 461–474, https://doi.org/10.1007/BF01585178
  • J. Matoušek, B. Gärtner, Understanding and Using Linear Programming, Springer, 2007, §8.3, https://doi.org/10.1007/978-3-540-30717-4
11 thms1 active userReviewed
Dynamic ProgrammingNumerical Analysis·Captain: mikedeng1

Modified Policy Iteration Algorithms for Discounted Markov Decision Problems: From Bv₀ ≥ 0, Order-k Iterates Satisfy ‖v* − v_{n+1}‖ ≤ min{λ, λ(1−λᵏ)/(1−λ)‖P_n − P*‖ + λ^{k+1}}‖v_n − v*‖Research Paper

Motivation

Discounted Markov decision problems are solved in practice by two classical schemes. Value iteration (successive approximations) is cheap per step but contracts the error only by the discount factor λ\lambdaλ per step, which is slow when λ\lambdaλ is close to 111. Policy iteration (Howard, 1960) converges in few steps, but each step solves a linear system for the value of the current policy. Puterman and Brumelle (Mathematics of Operations Research, 1979) showed that policy iteration is Newton's method applied to the optimality equation.

Puterman and Shin (Management Science 24, 1978) interpolated between the two schemes: replace the exact policy evaluation by k+1k+1k+1 steps of successive approximation. This is modified policy iteration of order kkk. For k=0k=0k=0 it is value iteration; as k→∞k\to\inftyk→∞ it approaches policy iteration. The paper proves that every order converges and bounds its rate. The scheme remains a standard algorithm in dynamic programming (Puterman, Markov Decision Processes, Wiley 1994, §6.5), and it appears in reinforcement learning as "optimistic" or "generalized" policy iteration.

Timeline. Howard (1960): policy iteration for finite problems. Puterman–Brumelle (1979, circulated earlier): policy iteration as Newton–Kantorovich iteration, and the support inequality for the optimality operator. van Nunen (1976) and van Nunen–Wessels: convergence of related value-oriented methods in a different framework. Puterman–Shin (1978): convergence of modified policy iteration of every order from a starting point with Bv0≥0Bv_0\ge 0Bv0​≥0, and the rate bound formalized here.

Setting

SSS is a set of states with a σ\sigmaσ-algebra. A family P\mathcal PP of policies is given. Each P∈PP\in\mathcal PP∈P is a transition operator: a Markov kernel assigning to each state sss a probability distribution P(s,⋅)P(s,\cdot)P(s,⋅) on SSS. Each policy also has a one-period reward cP:S→Rc_P:S\to\mathbb RcP​:S→R, and the rewards are uniformly bounded: sup⁡Psup⁡s∣cP(s)∣≤M<∞\sup_P\sup_s|c_P(s)|\le M<\inftysupP​sups​∣cP​(s)∣≤M<∞. The discount rate satisfies 0≤λ<10\le\lambda<10≤λ<1.

VVV is the Banach space of bounded measurable functions v:S→Rv:S\to\mathbb Rv:S→R with ∥v∥=sup⁡s∣v(s)∣\|v\|=\sup_s|v(s)|∥v∥=sups​∣v(s)∣. A kernel acts on VVV by (Pv)(s)=∫v(t) P(s,dt)(Pv)(s)=\int v(t)\,P(s,dt)(Pv)(s)=∫v(t)P(s,dt). For linear AAA on VVV, ∥A∥=sup⁡∥x∥≤1∥Ax∥\|A\|=\sup_{\|x\|\le 1}\|Ax\|∥A∥=sup∥x∥≤1​∥Ax∥.

The optimality equation is

Bv≡max⁡P∈P{cP+(λP−I)v}=0.(1)Bv\equiv\max_{P\in\mathcal P}\{c_P+(\lambda P-I)v\}=0. \tag{1}Bv≡P∈Pmax​{cP​+(λP−I)v}=0.(1)

The paper assumes throughout that the maximum in (1) is attained for every v∈Vv\in Vv∈V, by a single policy PvP_vPv​ at every state.

For k≥0k\ge 0k≥0, the truncated Neumann series is APk=∑i=0k(λP)iA^k_P=\sum_{i=0}^k(\lambda P)^iAPk​=∑i=0k​(λP)i. Modified policy iteration of order kkk runs the recursion

vn+1=vn+APnkBvn,(4)v_{n+1}=v_n+A^k_{P_n}Bv_n, \tag{4}vn+1​=vn​+APn​k​Bvn​,(4)

where PnP_nPn​ attains the maximum in (1) at vnv_nvn​. A solution v∗∈Vv^*\in Vv∗∈V of Bv∗=0Bv^*=0Bv∗=0 exists and is unique. P∗=Pv∗P^*=P_{v^*}P∗=Pv∗​ denotes a policy attaining the maximum at v∗v^*v∗. The proofs also use the operators Ukv=max⁡P{∑i=0k(λP)icP+(λP)k+1v}U^kv=\max_P\{\sum_{i=0}^k(\lambda P)^ic_P+(\lambda P)^{k+1}v\}Ukv=maxP​{∑i=0k​(λP)icP​+(λP)k+1v} and the set VB={v∈V:Bv≥0}V_B=\{v\in V:Bv\ge 0\}VB​={v∈V:Bv≥0}.

Formalization targets

Goal: Theorem 2, bound (8)

If v0∈Vv_0\in Vv0​∈V and Bv0≥0Bv_0\ge 0Bv0​≥0, then for every nnn

∥v∗−vn+1∥ ≤ min⁡{λ, λ[1−λk]1−λ ∥Pn−P∗∥+λk+1} ∥vn−v∗∥.(8)\|v^*-v_{n+1}\|\ \le\ \min\Big\{\lambda,\ \frac{\lambda[1-\lambda^k]}{1-\lambda}\,\|P_n-P^*\|+\lambda^{k+1}\Big\}\,\|v_n-v^*\|. \tag{8}∥v∗−vn+1​∥ ≤ min{λ, 1−λλ[1−λk]​∥Pn​−P∗∥+λk+1}∥vn​−v∗∥.(8)

Milestones

  1. The support inequality (7): Bw≥Bv+(λPv−I)(w−v)Bw\ge Bv+(\lambda P_v-I)(w-v)Bw≥Bv+(λPv​−I)(w−v) for all v,w∈Vv,w\in Vv,w∈V.
  2. Lemma 1: UkU^kUk is a contraction with constant λk+1\lambda^{k+1}λk+1.
  3. Lemma 2: UkU^kUk-iteration converges geometrically to the unique fixed point of UkU^kUk, and this fixed point solves Bu=0Bu=0Bu=0.
  4. Lemma 3: Uku≥(I+AkB)vU^ku\ge(I+A^kB)vUku≥(I+AkB)v for u≥vu\ge vu≥v, and (I+AkB)u≥U0v(I+A^kB)u\ge U^0v(I+AkB)u≥U0v if in addition Bu≥0Bu\ge 0Bu≥0.
  5. Lemma 4: VBV_BVB​ is invariant under I+AkBI+A^kBI+AkB.
  6. Theorem 1: from Bv0≥0Bv_0\ge 0Bv0​≥0, {vn}\{v_n\}{vn​} converges monotonically and in norm to v∗v^*v∗.
  7. Corollary 1: (U0)nv0≤vn≤(Uk)nv0(U^0)^nv_0\le v_n\le (U^k)^nv_0(U0)nv0​≤vn​≤(Uk)nv0​.
  8. The two halves of (8): inequality (9), ∥v∗−vn+1∥≤(λ[1−λk]1−λ∥Pn−P∗∥+λk+1)∥v∗−vn∥\|v^*-v_{n+1}\|\le(\tfrac{\lambda[1-\lambda^k]}{1-\lambda}\|P_n-P^*\|+\lambda^{k+1})\|v^*-v_n\|∥v∗−vn+1​∥≤(1−λλ[1−λk]​∥Pn​−P∗∥+λk+1)∥v∗−vn​∥, and ∥v∗−vn+1∥≤λ∥v∗−vn∥\|v^*-v_{n+1}\|\le\lambda\|v^*-v_n\|∥v∗−vn+1​∥≤λ∥v∗−vn​∥.

The mission also contains four further theorems that are not milestones: Corollary 2 (asymptotic rate at most λk+1\lambda^{k+1}λk+1 when ∥Pn−P∗∥→0\|P_n-P^*\|\to 0∥Pn​−P∗∥→0), Proposition 2 (monotonicity in the order kkk), the representation (6) vn+1=Tnk+1vnv_{n+1}=T_n^{k+1}v_nvn+1​=Tnk+1​vn​, and Proposition 1 (policy iteration as Newton's method).

Significance

The result. Bound (8) gives two guarantees. Every order of modified policy iteration converges at least as fast as value iteration, with factor λ\lambdaλ per step. Once the improving policies stabilize near an optimal one, the factor approaches λk+1\lambda^{k+1}λk+1, the factor of k+1k+1k+1 value-iteration steps. This justifies spending kkk cheap evaluation sweeps per policy improvement instead of solving a linear system. It also underlies the analysis of the many later variants: action elimination, asynchronous and approximate versions, and optimistic policy iteration in reinforcement learning.

Formalizing it. The theorems are proved on paper. As far as the platform's library shows, none of them is machine-checked: existing items cover value iteration and exact policy iteration for finite state spaces. This mission formalizes the whole chain on general measurable state spaces with Markov kernels, including the support inequality and the comparison operators UkU^kUk. Corollary 2 is stated as an upper bound only, because the equality printed on the page fails in degenerate runs (see the item's note).

Difficulty

The obvious route to a rate is the contraction argument for value iteration: U0U^0U0 is monotone and a λ\lambdaλ-contraction, so its iterates converge geometrically. For k≥1k\ge1k≥1 that argument does not transfer to the map vn↦vn+APnkBvnv_n\mapsto v_n+A^k_{P_n}Bv_nvn​↦vn​+APn​k​Bvn​. The truncated series is taken for the policy chosen at the current point, so the map changes with vnv_nvn​, and it is not monotone in general. The van der Wal–van Nunen example on p. 1133 of the paper shows that iterates of a higher order need not dominate those of a lower order from the same start. Moreover, without the condition Bv0≥0Bv_0\ge0Bv0​≥0 the iterates need not even increase. A rate for (4) is therefore not a corollary of a fixed-point theorem for a single operator.

Formally, a second layer of difficulty is the setting itself. Everything happens in the space of bounded measurable functions on a general measurable space. So every operator applied to an iterate must be shown to preserve boundedness and measurability, and the maxima over policies are suprema over an arbitrary index set.

Formalization scope

The Lean development (namespace ModPolicyIter.Conv) represents:

  • the policies as an index type ι\iotaι, policy iii being a Markov kernel P i : Kernel S S with a measurable reward c i, ∣ci∣≤M|c_i|\le M∣ci​∣≤M;
  • VVV by the predicate IsBM (measurable and bounded), with supNorm v = ⨆ s, |v s|;
  • PivP_ivPi​v as the Bochner integral against Pi(s,⋅)P_i(s,\cdot)Pi​(s,⋅);
  • BBB and UkU^kUk as pointwise real suprema over ι\iotaι;
  • ∥Pi−Pj∥\|P_i-P_j\|∥Pi​−Pj​∥ as the supremum of ∥(Pi−Pj)x∥\|(P_i-P_j)x\|∥(Pi​−Pj​)x∥ over the unit ball of VVV.

The standing assumptions of §2 are carried by the model fields; items using a maximizer assume either global attainment (MaxAttained) or an explicit maximizing policy. A run of (4) is a sequence of functions paired with a sequence of policies, each policy a maximizer at the current iterate. Only v0∈Vv_0\in Vv0​∈V is assumed; that later iterates lie in VVV is part of the proofs.

Deviations from the page, all disclosed in the items:

  1. Theorem 2 and its companions assume Bv0≥0Bv_0\ge0Bv0​≥0, the hypothesis of Theorem 1, which the proof of Theorem 2 invokes.
  2. Lemmas 1–2 and Corollary 1 assume that UkU^kUk maps VVV into VVV. This is implicit on the page, and for k=0k=0k=0 it follows from attainment. Lemma 1 states this mapping property alongside the contraction inequality.
  3. The paper's P=∏sPs\mathcal P=\prod_s\mathcal P_sP=∏s​Ps​ is generalized to an arbitrary index set.
  4. Corollary 2 is stated as an upper bound.

The goal must not be trivialized by assuming vn≤v∗v_n\le v^*vn​≤v∗, the support inequality, the sandwich of Corollary 1, or anything about UkU^kUk. These are milestones to be proved, and none of them is a hypothesis of the goal.

Reusable infrastructure includes Markov kernels as operators on bounded measurable functions (positivity, ∥P∥≤1\|P\|\le1∥P∥≤1, measurability of PvPvPv), completeness of VVV, and the Banach fixed point theorem on VVV. The first of these serves any discounted dynamic-programming mission on general state spaces. Contributions of any milestone, or of helper lemmas about these operators, are welcome.

Selected references

  • M. L. Puterman and M. C. Shin, Modified policy iteration algorithms for discounted Markov decision problems, Management Science 24(11):1127–1137, 1978. https://doi.org/10.1287/mnsc.24.11.1127
  • M. L. Puterman and S. L. Brumelle, On the convergence of policy iteration in stationary dynamic programming, Mathematics of Operations Research 4(1):60–69, 1979. https://doi.org/10.1287/moor.4.1.60
  • R. A. Howard, Dynamic Programming and Markov Processes, MIT Press, 1960.
  • J. A. E. E. van Nunen, A set of successive approximation methods for discounted Markovian decision problems, Zeitschrift für Operations Research 20:203–208, 1976.
  • M. L. Puterman, Markov Decision Processes: Discrete Stochastic Dynamic Programming, Wiley, 1994. https://doi.org/10.1002/9780470316887
12 thms1 active userReviewed
Machine LearningTheoretical Computer Science·Captain: mikedeng1

The Weighted Majority Algorithm 2: On Any Partition into Segments, WML Makes at Most Σ min(l_i, (log(n/(βγ)) + m_i log(1/β))/log(1/u)) MistakesResearch Paper

Motivation

Prediction with expert advice asks a master algorithm to combine the binary predictions of a pool of nnn prediction algorithms, trial after trial, so that it makes few more mistakes than the best member of the pool, without any probabilistic assumption on the data. Littlestone and Warmuth's Weighted Majority Algorithm WM (Littlestone and Warmuth 1994) keeps a weight per member, predicts with the weighted vote, and multiplies the weights of the wrong members by a factor β<1\beta<1β<1 after each of its own mistakes. Its mistake bound is of order log⁡n+m\log n + mlogn+m, where mmm is the number of mistakes of the best member on the whole sequence.

That bound compares the master with a single fixed member. In many applications the member that predicts well changes over time: one algorithm is accurate for a while, then a second one, then a third. Against a shifting target of this kind, WM can do badly, because the weight of a member that was wrong for a long time has become so small that it takes many mistakes to recover it. Section 3 of the paper introduces the variant WML, which never decreases a weight that is already small relative to the total, and proves that it pays only a logarithmic cost per change of target. This was the first result of what is now called tracking the best expert; it was later refined by Herbster and Warmuth's Fixed-Share algorithm (Herbster and Warmuth 1998).

Timeline. 1989: a conference version of the paper appears at FOCS. 1994: the journal version, the source of this mission, gives Lemma 3.1 and Theorem 3.1 in their present form. 1998: Herbster and Warmuth's Tracking the Best Expert generalizes the shifting bound to other loss functions.

Setting

A run takes place over TTT trials t=0,…,T−1t = 0, \dots, T-1t=0,…,T−1. In trial ttt each member i∈{1,…,n}i \in \{1,\dots,n\}i∈{1,…,n} of the pool predicts xi(t)∈{0,1}x_i^{(t)} \in \{0,1\}xi(t)​∈{0,1}, the master predicts λ(t)∈{0,1}\lambda^{(t)} \in \{0,1\}λ(t)∈{0,1}, and the label ρ(t)∈{0,1}\rho^{(t)} \in \{0,1\}ρ(t)∈{0,1} is revealed. The predictions of the pool and the labels are arbitrary.

The master keeps weights wi(t)>0w_i^{(t)} > 0wi(t)​>0, the weights at the beginning of trial ttt. Let W(t)=∑jwj(t)W^{(t)} = \sum_j w_j^{(t)}W(t)=∑j​wj(t)​ be the total weight and qb(t)q_b^{(t)}qb(t)​ the total weight of the members predicting bbb. WML has parameters 0<β<10 < \beta < 10<β<1 and 0≤γ<120 \le \gamma < \tfrac120≤γ<21​:

  1. it predicts 000 if q0(t)>q1(t)q_0^{(t)} > q_1^{(t)}q0(t)​>q1(t)​, 111 if q1(t)>q0(t)q_1^{(t)} > q_0^{(t)}q1(t)​>q0(t)​, and either value on a tie;
  2. if λ(t)≠ρ(t)\lambda^{(t)} \ne \rho^{(t)}λ(t)=ρ(t), each member iii with xi(t)≠ρ(t)x_i^{(t)} \ne \rho^{(t)}xi(t)​=ρ(t) and wi(t)>γnW(t)w_i^{(t)} > \frac{\gamma}{n} W^{(t)}wi(t)​>nγ​W(t) has its weight multiplied by β\betaβ; all other weights stay;
  3. if λ(t)=ρ(t)\lambda^{(t)} = \rho^{(t)}λ(t)=ρ(t), no weight changes.

With γ=0\gamma = 0γ=0 this is WM. Write mmm for the number of mistakes of the master and

u=1+β2+(1−β)γ,u = \frac{1+\beta}{2} + (1-\beta)\gamma ,u=21+β​+(1−β)γ,

which lies in [12,1)[\tfrac12, 1)[21​,1) for the stated parameter ranges.

Formalization targets

Goal: Theorem 3.1 (p. 224)

Split the sequence into consecutive segments S1,…,Sk\mathcal S_1, \dots, \mathcal S_kS1​,…,Sk​, with lil_ili​ trials in Si\mathcal S_iSi​, and let mim_imi​ be the smallest number of mistakes any single pool member makes on Si\mathcal S_iSi​. If γ>0\gamma > 0γ>0 and every initial weight is at least βγ/n\beta\gamma/nβγ/n times the total initial weight, then

m≤∑i=1kmin⁡(li, log⁡(n/(βγ))+milog⁡(1/β)log⁡(1/u)).m \le \sum_{i=1}^{k} \min\left( l_i,\ \frac{\log\big(n/(\beta\gamma)\big) + m_i \log(1/\beta)}{\log(1/u)} \right).m≤i=1∑k​min(li​, log(1/u)log(n/(βγ))+mi​log(1/β)​).

The partition is arbitrary and unknown to the algorithm; the bound holds for all partitions simultaneously.

Milestone: Lemma 3.1 (pp. 223–224)

The single-segment case, k=1k = 1k=1, together with the statement that the weight floor survives the run: if every initial weight is at least βγ/n\beta\gamma/nβγ/n times the total, then

m≤log⁡(n/(βγ))+m0log⁡(1/β)log⁡(1/u),m \le \frac{\log\big(n/(\beta\gamma)\big) + m_0 \log(1/\beta)}{\log(1/u)},m≤log(1/u)log(n/(βγ))+m0​log(1/β)​,

and every final weight is at least βγ/n\beta\gamma/nβγ/n times the total final weight.

Milestone: the contraction step (p. 224, proof of Lemma 3.1)

On every mistake trial, W(t+1)≤u W(t)W^{(t+1)} \le u\, W^{(t)}W(t+1)≤uW(t).

Significance

The result. Theorem 3.1 shows that an online algorithm with no knowledge of when or how often the best predictor changes can compete with the best sequence of predictors, at a price of O(log⁡(n/(βγ)))O(\log(n/(\beta\gamma)))O(log(n/(βγ))) mistakes per segment. The min⁡\minmin with lil_ili​ says that a segment never costs more than its length. The bound is the template for later tracking and adaptive-regret results in online learning and for algorithms whose weights are kept bounded away from zero.

Formalizing it. The result is proved in the paper; no machine-checked proof of a shifting-target bound exists on Prove2Me or, to our knowledge, in Mathlib. This mission produces a formal model of WML in which ties are arbitrary (a run is a relation, so the bounds cover every tie-breaking rule), the per-mistake contraction, the single-sequence bound with its preserved invariant, and the segment bound. The model of trials, majority votes and mistake counts is reusable for the other algorithms of the paper.

Difficulty

The standard argument for WM compares the decrease of the total weight with the final weight of the best member. For a shifting target this fails twice. First, the best member of a later segment may have been wrong during all earlier segments; under WM its weight has shrunk by β\betaβ per mistake, and the master has to make many mistakes before that member regains influence. Second, the floor that prevents this also prevents some wrong members from being penalized, so the total weight shrinks by less on each mistake than under WM. The statement has to control both effects at once, and the per-segment accounting has to restart from whatever weights the previous segments left behind. A natural first idea, applying the single-sequence bound to each part of an arbitrary (interleaved) partition, does not work: for interleaved subsequences the inequality is false, and the theorem is about consecutive segments.

Formalization scope

The pool is Fin n with n>0n > 0n>0; trials are Fin T; binary values are Bool; weights are real, w : ℕ → Fin n → ℝ, with w t the weights at the beginning of trial ttt, w 0 the initial and w T the final weights. A run is the relation IsWMLRun β γ x ρ w lam; it fixes positive initial weights, the majority rule with arbitrary ties, and the update, whose threshold is strict and uses the total weight at the beginning of the trial. Logarithms are natural logarithms; the base cancels in every ratio. The minimum over the pool is an infimum in ℕ over Fin n. Segments are given by monotone boundaries b : Fin (k+1) → ℕ with b 0 = 0 and b (Fin.last k) = T; empty segments are allowed and contribute 000.

The paper allows γ=0\gamma = 0γ=0 for the algorithm, but then the bounds read log⁡(n/0)=+∞\log(n/0) = +\inftylog(n/0)=+∞. In Lean, n / 0 = 0, so the bounds assume γ>0\gamma > 0γ>0; the contraction milestone holds for 0≤γ<120 \le \gamma < \tfrac120≤γ<21​ and is stated so. The hypothesis γ<12\gamma < \tfrac12γ<21​ is kept as stated in the paper, not replaced by u<1u < 1u<1. A trivializing formalization, such as fixing the tie-breaking rule, dropping the strict weight test, letting the floor hypothesis be unsatisfiable, or allowing interleaved subsequences (which makes the goal false), is ruled out: a run exists for every input from every positive initial weights, and equal initial weights satisfy the floor.

Contributions welcome: proofs of the three statements, and lemmas on restricting a WML run to a block of trials, which the goal needs and which apply to any segment-wise analysis.

Selected references

  • N. Littlestone, M. K. Warmuth, The Weighted Majority Algorithm, Information and Computation 108(2), 212–261, 1994. https://doi.org/10.1006/inco.1994.1009
  • N. Littlestone, M. K. Warmuth, The Weighted Majority Algorithm, Proc. 30th IEEE FOCS, 256–261, 1989. https://doi.org/10.1109/SFCS.1989.63487
  • M. Herbster, M. K. Warmuth, Tracking the Best Expert, Machine Learning 32, 151–178, 1998. https://doi.org/10.1023/A:1007424614876
4 thms1 active userReviewed
CombinatoricsLinear Optimization·Captain: mikedeng1

Algorithms for the Assignment and Transportation Problems: Munkres' Algorithm Terminates on Every Real n × n Matrix, and Its Final Starred Zeros Form a Minimum-Sum AssignmentResearch Paper

Motivation

The assignment problem asks how to assign nnn men to nnn jobs, one man per job, so that the total cost (or, equivalently, the total rating) is optimal. It is the simplest combinatorial optimization problem with a nontrivial polynomial-time algorithm, and it appears as a subroutine across operations research: in transportation and network-flow methods, in tracking and data association, in scheduling, and as the relaxation behind branch-and-bound methods for the travelling salesman problem.

The algorithm studied here is the one now usually called the Hungarian method or Kuhn–Munkres algorithm.

  • 1931: Kőnig and Egerváry prove the theorem on lines and independent zeros of a matrix that the method rests on.
  • 1955: H. W. Kuhn gives the Hungarian method, with finiteness argued for integer matrices through a decreasing integer sum (Kuhn 1955). M. Flood restates it as Steps A–D.
  • 1957: J. Munkres gives a fully specified version, in which Step B of Flood's outline (find a minimal set of lines containing all zeros and a maximal set of independent zeros) is carried out by an explicit marking procedure with starred and primed zeros. He proves it correct, shows that the integrality assumption is unnecessary, and bounds the work by a polynomial in nnn (Munkres 1957).

The mission formalizes Munkres' correctness proof for §1 of that paper.

Setting

Let A=(xij)A=(x_{ij})A=(xij​) be a real n×nn\times nn×n matrix, xijx_{ij}xij​ being the cost of assigning man iii (row iii) to job jjj (column jjj). A set of entries is independent if no two of them lie in the same line (row or column). An assignment is a permutation σ\sigmaσ, with σ(r)\sigma(r)σ(r) the man doing job rrr. Its cost is ∑rxσ(r) r\sum_r x_{\sigma(r)\,r}∑r​xσ(r)r​, and σ\sigmaσ is an optimal assignment if this cost is at most that of every permutation τ\tauτ. Choosing nnn independent entries of minimum sum is the same as choosing an optimal assignment.

The algorithm. A state of the algorithm holds the current matrix, a set of starred zeros 0∗0^*0∗, a set of primed zeros 0′0'0′, a set of covered rows and a set of covered columns. An entry is non-covered, once-covered or twice-covered according as it lies in zero, one or two covered lines.

  • Preliminaries. Subtract from each row its smallest element, then from each column its smallest entry. Consider the zeros in turn and star each one that has no starred zero in its row or column. Cover the columns containing a 0∗0^*0∗.
  • Step 1. Prime a non-covered zero. If its row contains no 0∗0^*0∗, go to Step 2. Otherwise cover its row and uncover the column of that 0∗0^*0∗. When no non-covered zero remains, go to Step 3.
  • Step 2. Build the alternating sequence Z0,Z1,…,Z2kZ_0,Z_1,\dots,Z_{2k}Z0​,Z1​,…,Z2k​. It starts at the 0′0'0′ just found. Each Z2i+1Z_{2i+1}Z2i+1​ is the 0∗0^*0∗ in the column of Z2iZ_{2i}Z2i​, each Z2i+2Z_{2i+2}Z2i+2​ is the 0′0'0′ in the row of Z2i+1Z_{2i+1}Z2i+1​, and the sequence stops at a 0′0'0′ with no 0∗0^*0∗ in its column. Unstar its starred zeros and star its primed zeros. Erase all primes, uncover all rows and cover the columns containing a 0∗0^*0∗. Stop if all columns are covered; otherwise return to Step 1.
  • Step 3. Let hhh be the smallest non-covered element. Add hhh to each covered row, subtract hhh from each uncovered column, and return to Step 1 with all marks kept.

The quantity nkn_knk​, the maximal number of independent zeros of the matrix AkA_kAk​, measures progress.

Formalization targets

Goal: correctness of the algorithm

For every real n×nn\times nn×n matrix AAA:

∃ start;every run is finite;no reachable non-final state is stuck;at a final state {0∗}={(σ(r),r)} with ∑rxσ(r)r=min⁡τ∑rxτ(r)r.\exists\,\text{start};\quad \text{every run is finite};\quad \text{no reachable non-final state is stuck};\quad \text{at a final state } \{0^*\}=\{(\sigma(r),r)\}\ \text{with}\ \sum_r x_{\sigma(r)r}=\min_\tau \sum_r x_{\tau(r)r}.∃start;every run is finite;no reachable non-final state is stuck;at a final state {0∗}={(σ(r),r)} with r∑​xσ(r)r​=τmin​r∑​xτ(r)r​.

The four clauses are needed together: optimality at final states alone holds for an algorithm that never stops.

Milestones

  1. Remark (2): subtracting row constants uiu_iui​ and column constants vjv_jvj​ does not change the optimal assignments.
  2. The zeros starred in the Preliminaries are independent.
  3. At Step 2 the sequence Z0,…,Z2kZ_0,\dots,Z_{2k}Z0​,…,Z2k​ exists, is unique and has distinct elements.
  4. Step 2 leaves an independent set of starred zeros, larger by one.
  5. Lines containing all the zeros number at least the maximal number of independent zeros.
  6. At Step 3 the starred zeros are a maximal independent set and the covered lines a minimal cover.
  7. At Step 3, h>0h>0h>0; the transformation subtracts hhh from non-covered entries, adds hhh to twice-covered ones, keeps every 0∗0^*0∗ and 0′0'0′ a zero, and nk+1≥nkn_{k+1}\ge n_knk+1​≥nk​.
  8. If nk+1=nkn_{k+1}=n_knk+1​=nk​, Step 2 does not occur before the next Step 3, which begins with more covered rows.
  9. While nkn_knk​ is constant, Step 3 is applied at most nnn times.
  10. Every row and column of the matrix always contains a zero.
  11. Step 3 decreases the sum of the entries by n(n−nk)hn(n-n_k)hn(n−nk​)h.

Significance

Correctness of the Hungarian method is the basis of a standard algorithm for the assignment problem and, through it, of methods for transportation problems, minimum-cost bipartite matching and weighted bipartite matching. Its O(n3)O(n^3)O(n3) refinements remain in practical use. The invariants of the proof are the primal–dual structure of the problem: the row and column constants subtracted along the way form a dual solution, and the starred zeros at the end are a primal solution satisfying complementary slackness.

The result has been proved since 1957 and is in every textbook on combinatorial optimization. A machine-checked version of Munkres' specific procedure, as a transition system with all its free choices, with finiteness for real (not only integer) matrices, is not available on this platform; Mathlib has no assignment algorithm. The mission produces a verified specification of the algorithm, reusable invariants about covers and independent zeros, and a termination argument that does not rely on integrality.

Difficulty

Optimality at termination is short once the invariants are known. The work lies in two places.

First, the invariants hold only along runs. "Each 0∗0^*0∗ is covered by precisely one line", "no column contains more than one 0∗0^*0∗" and "no row contains more than one 0′0'0′" fail for arbitrary marked matrices, so they must be carried as an inductive invariant through every move, including the Step 3 transformation, which keeps the primes.

Second, termination. The obvious measure, the sum of the entries, decreases by n(n−nk)hn(n-n_k)hn(n−nk​)h at each Step 3, but for real entries hhh can be arbitrarily small, so the decreasing sum gives no bound on the number of steps. The page replaces this argument by the stronger result of p. 35 (milestone 8), which holds for real entries. Turning it into a proof that every run of the nondeterministic move relation is finite, including the moves inside Step 1 and Step 2, is the core of the formalization.

Formalization scope

  • Matrices and positions. Entries are arbitrary reals, as on p. 35. Positions are Fin n × Fin n (row, column).
  • Output orientation. The output permutation follows the published definition HeldWolfeCrowder_Assignment_Setting: σ r is the row assigned to column r, the starred positions are (σ(r),r)(\sigma(r),r)(σ(r),r), and optimality is IsOptimalAssignment A σ with respect to the original input matrix.
  • Nondeterminism. The algorithm is an inductive move relation Step. The order in which the Preliminaries consider the zeros, and the non-covered zero primed in Step 1, are free choices. Every claim holds for every run.
  • Relational steps. Step 2's sequence and Step 3's hhh are described relationally. Their existence, and h>0h>0h>0, are theorems, not built into the moves.
  • Reachable states. Invariants are stated for states reachable from a start state, never for arbitrary states.
  • Finiteness. Finiteness of every run is accessibility (Acc) of each start state for the reversed move relation.
  • Termination test after the Preliminaries. "If all columns are covered, stop" is also applied when leaving the Preliminaries. The page goes to Step 1 unconditionally there. If the Preliminaries already star nnn zeros, Step 3 would then have no non-covered element.
  • Independent zeros. The maximal number of independent zeros is a finite maximum of cardinalities, so it has no junk value.
  • Edge case n=0n=0n=0. No positivity of nnn is assumed. For n=0n=0n=0 the start state is final.
  • Ruled out. A goal stating only optimality at final states, or invariants stated for arbitrary states, would be a trivializing formalization; the goal states termination of every run and absence of stuck states as well.

Not formalized: the operation count (11n3+12n2+31n)/6(11n^3+12n^2+31n)/6(11n3+12n2+31n)/6 of pp. 35–36, whose cost model is informal; the argument that returning to the standard input after Step 3 is unnecessary (pp. 34–35); König's theorem (Remark (1), cited); and §2 on the transportation problem, which is stated without proof.

Welcome contributions: proofs of the milestones, a general library of lines and independent zeros in matrices (reusable for König–Egerváry), and an executable refinement of the move relation.

Selected references

  • J. Munkres, Algorithms for the assignment and transportation problems, J. Soc. Indust. Appl. Math. 5 (1957), 32–38. https://doi.org/10.1137/0105003
  • H. W. Kuhn, The Hungarian method for the assignment problem, Naval Research Logistics Quarterly 2 (1955), 83–97. https://doi.org/10.1002/nav.3800020109
  • M. Held, P. Wolfe, H. P. Crowder, Validation of subgradient optimization, Mathematical Programming 6 (1974), 62–88. https://doi.org/10.1007/BF01580223 (source of the published assignment-cost definitions reused here)
15 thms1 active userReviewed
Calculus of VariationsMechanism Design·Captain: mikedeng1

Monopoly and Product Quality: The Monopolist Sells Every Type Served Under Competition a Strictly Lower Quality, Except the Top TypeResearch Paper

Motivation

A firm that sells a product line of different qualities cannot see how much each customer values quality. It can only post a price for every quality and let customers choose. Mussa and Rosen's 1978 paper solves the monopolist's problem in this setting and compares the result with the competitive outcome. Their model is, together with Mirrlees' optimal income tax and Maskin and Riley's later treatment of nonlinear pricing, one of the founding examples of screening: the seller designs a menu so that customers sort themselves. The model's main qualitative prediction, that a monopolist degrades the quality sold to every customer except the one who values quality most, is the origin of the phrase "no distortion at the top". Textbooks on contract theory and mechanism design still teach it in this form.

Timeline. Mussa and Rosen (1978) give the first-order analysis, including "bunching" of customers at a common quality when marginal revenue is not monotone. Maskin and Riley (1984) treat the same problem for nonlinear quantity pricing. Myerson (1981) introduced the "ironing" procedure for non-monotone virtual valuations in auction design, which later became the standard way of describing the bunching conditions of this paper.

Setting

Consumer types are numbers θ∈[θ‾,θˉ]\theta\in[\underline\theta,\bar\theta]θ∈[θ​,θˉ] with 0≤θ‾<θˉ0\le\underline\theta<\bar\theta0≤θ​<θˉ, distributed with a density fff that is positive and differentiable on the whole interval; F(θ)=∫θ‾θf(s) dsF(\theta)=\int_{\underline\theta}^{\theta}f(s)\,dsF(θ)=∫θ​θ​f(s)ds. A consumer of type θ\thetaθ buys at most one unit, and from quality qqq at price ppp gets utility θq−p\theta q-pθq−p. Producing one unit of quality q≥0q\ge0q≥0 costs C(q)C(q)C(q), where C(0)=0C(0)=0C(0)=0, CCC is twice differentiable, and C′(q)>0C'(q)>0C′(q)>0, C′′(q)>0C''(q)>0C′′(q)>0 for q≥0q\ge0q≥0.

Under competition, price equals unit cost and type θ\thetaθ buys the quality J(θ)J(\theta)J(θ) with C′(J(θ))=θC'(J(\theta))=\thetaC′(J(θ))=θ, or nothing when θ≤C′(0)\theta\le C'(0)θ≤C′(0).

The monopolist chooses an assignment q(θ)q(\theta)q(θ), the quality bought by type θ\thetaθ. It must be nondecreasing, nonnegative and piecewise differentiable on [θ‾,θˉ][\underline\theta,\bar\theta][θ​,θˉ]; such assignments are called admissible. Incentive compatibility and participation fix the consumer surplus at z(θ)=∫θ‾θq(s) dsz(\theta)=\int_{\underline\theta}^{\theta}q(s)\,dsz(θ)=∫θ​θ​q(s)ds, so the monopolist maximizes

Π(q)=∫θ‾θˉ[θ q(θ)−z(θ)−C(q(θ))]f(θ) dθ.\Pi(q)=\int_{\underline\theta}^{\bar\theta}\bigl[\theta\,q(\theta)-z(\theta)-C(q(\theta))\bigr]f(\theta)\,d\theta .Π(q)=∫θ​θˉ​[θq(θ)−z(θ)−C(q(θ))]f(θ)dθ.

An assignment is optimal if it is admissible and maximizes Π\PiΠ among admissible assignments. The marginal revenue of quality sold to type θ\thetaθ is

MR(θ)=θ−1−F(θ)f(θ).MR(\theta)=\theta-\frac{1-F(\theta)}{f(\theta)} .MR(θ)=θ−f(θ)1−F(θ)​.

The paper's analysis runs through the marginal profit of a uniform quality increase for all types θ≥t\theta\ge tθ≥t,

μ(t)=∫tθˉ[θ−∫tθds−C′(q(θ))]f(θ) dθ.\mu(t)=\int_t^{\bar\theta}\Bigl[\theta-\int_t^\theta ds-C'(q(\theta))\Bigr]f(\theta)\,d\theta .μ(t)=∫tθˉ​[θ−∫tθ​ds−C′(q(θ))]f(θ)dθ.

Formalization targets

Goal: quality distortion below the top

For every optimal assignment qqq:

C′(q(θ))<θfor θ‾≤θ<θˉ, θ>C′(0);q(θ)=0for θ‾≤θ<θˉ, θ≤C′(0);C'(q(\theta))<\theta\quad\text{for }\underline\theta\le\theta<\bar\theta,\ \theta>C'(0);\qquad q(\theta)=0\quad\text{for }\underline\theta\le\theta<\bar\theta,\ \theta\le C'(0);C′(q(θ))<θfor θ​≤θ<θˉ, θ>C′(0);q(θ)=0for θ​≤θ<θˉ, θ≤C′(0);

and, if C′(0)<θˉC'(0)<\bar\thetaC′(0)<θˉ, the limit L=lim⁡θ↑θˉq(θ)L=\lim_{\theta\uparrow\bar\theta}q(\theta)L=limθ↑θˉ​q(θ) exists and satisfies C′(L)=θˉC'(L)=\bar\thetaC′(L)=θˉ (if θˉ≤C′(0)\bar\theta\le C'(0)θˉ≤C′(0), then q(θ)→0q(\theta)\to0q(θ)→0). In words: qm(θ)<J(θ)q^m(\theta)<J(\theta)qm(θ)<J(θ) for every type below the top that buys under competition, types that do not buy under competition do not buy from the monopolist, and qm(θˉ)=J(θˉ)q^m(\bar\theta)=J(\bar\theta)qm(θˉ)=J(θˉ).

Milestones

The paper's own chain of claims, in order: MR(θ)<θMR(\theta)<\thetaMR(θ)<θ except at θˉ\bar\thetaθˉ (p. 308); the first-order condition (9), Λ(h;q)≤0\Lambda(h;q)\le0Λ(h;q)≤0 for every admissible deformation; the identity (10) = (12), μ(t)=∫tθˉ[MR−C′(q)]f\mu(t)=\int_t^{\bar\theta}[MR-C'(q)]fμ(t)=∫tθˉ​[MR−C′(q)]f; condition (13), μ≤0\mu\le0μ≤0; condition (15), μ=0\mu=0μ=0 where q˙>0\dot q>0q˙​>0; μ=0\mu=0μ=0 at a jump; the absence of jumps; (17), C′(q)=MRC'(q)=MRC′(q)=MR where q˙>0\dot q>0q˙​>0; the bunching conditions (18)–(19); and the absence of a bunch at the top. Companion items state the two-type case of footnote 4, the uniform–quadratic example of §5, and the loss of consumer surplus (§6, "Second").

Significance

The result. The goal says how the monopolist differs from competition: it lowers every quality except the top one, and it never serves a type that competition leaves out. The distortion comes from the gap θ−MR(θ)=(1−F(θ))/f(θ)>0\theta-MR(\theta)=(1-F(\theta))/f(\theta)>0θ−MR(θ)=(1−F(θ))/f(θ)>0, which closes only at θˉ\bar\thetaθˉ. The same comparison underlies results on second-degree price discrimination, regulation of product lines, and versioning of information goods. The bunching conditions (18)–(19) are an early statement of what is now called ironing.

Formalizing it. The result has been proved since 1978 in the economic literature, under the paper's smoothness assumptions and by a variational argument. As far as is known, it has not been machine-checked: no formal library contains the monopoly quality problem, its first-order conditions or the bunching conditions. The mission produces a checked version with the hypotheses made explicit, including the conventions at the endpoints that the paper leaves implicit. The uniform–quadratic example gives a concrete optimum that certifies the hypotheses are satisfiable.

Difficulty

The obvious argument sets C′(q(θ))=MR(θ)C'(q(\theta))=MR(\theta)C′(q(θ))=MR(θ) pointwise and compares with C′(J(θ))=θC'(J(\theta))=\thetaC′(J(θ))=θ. This fails when MRMRMR is not increasing: the pointwise solution is then decreasing somewhere and not admissible. The optimal assignment is constant on some intervals, and on such a bunch C′(q)≠MRC'(q)\ne MRC′(q)=MR pointwise. The comparison with JJJ there needs the boundary conditions (18)–(19) and the fact that no bunch reaches θˉ\bar\thetaθˉ. All of these come from one-sided deformations that respect monotonicity, so the first-order conditions are inequalities and need a separate argument for equality. The paper also asserts without a separate step that optimal assignments have no jumps, and later steps use continuity.

Formalization scope

Types and assignments are real functions on R\mathbb RR; only their values on [θ‾,θˉ][\underline\theta,\bar\theta][θ​,θˉ] matter. The type distribution and MRMRMR are the published MechanismDesign.Screening.TypeDistribution and virtualValuation. The standing assumptions are hypotheses of every main statement: fff is differentiable on [θ‾,θˉ][\underline\theta,\bar\theta][θ​,θˉ] (positivity and total mass 1 are part of the distribution), C(0)=0C(0)=0C(0)=0, CCC and C′C'C′ are differentiable on R\mathbb RR, and C′>0C'>0C′>0, C′′>0C''>0C′′>0 on [0,∞)[0,\infty)[0,∞). C(0)=0C(0)=0C(0)=0 is an added normalization: quality 0 means not buying. "Piecewise differentiable" means differentiable on (θ‾,θˉ)(\underline\theta,\bar\theta)(θ​,θˉ) outside a finite set. The competitive assignment J=C′−1J=C'^{-1}J=C′−1 is never formed; every comparison with JJJ is written through C′C'C′. Admissible deformations hhh in (9) are required to keep q+h≥0q+h\ge0q+h≥0.

The value q(θˉ)q(\bar\theta)q(θˉ) does not affect Π\PiΠ, so a statement about q(θˉ)q(\bar\theta)q(θˉ) itself would be false; the top-type claim is stated as a left limit. Optimality ranges over admissible assignments only. Any reading under which no optimal assignment exists makes the goal vacuous; the §5 companion rules this out, since its optimal assignment has a kink and uses the same notion of optimality.

Needed infrastructure: interval integrals of monotone functions, first variations under monotonicity constraints, and fundamental-theorem-of-calculus arguments for FFF. The incentive-compatibility reduction (monotonicity and the envelope formula) is not posed here, because it is posed on the platform in Börgers' screening chapter. Related platform item: Börgers' Proposition 2.6 (MechanismDesign.Screening.nonlinear_pricing_optimal) treats a linear-cost, concave-valuation model under regularity, which is a different statement. Contributions to any milestone, and reusable lemmas about monotone deformations, are welcome.

Selected references

  • M. Mussa and S. Rosen, Monopoly and product quality, Journal of Economic Theory 18 (1978), 301–317. https://doi.org/10.1016/0022-0531(78)90085-6
  • E. Maskin and J. Riley, Monopoly with incomplete information, RAND Journal of Economics 15 (1984), 171–196. https://doi.org/10.2307/2555674
  • R. B. Myerson, Optimal auction design, Mathematics of Operations Research 6 (1981), 58–73. https://doi.org/10.1287/moor.6.1.58
  • J. A. Mirrlees, An exploration in the theory of optimum income taxation, Review of Economic Studies 38 (1971), 175–208. https://doi.org/10.2307/2296779
  • T. Börgers, An Introduction to the Theory of Mechanism Design, Oxford University Press, 2015, Chapter 2. https://doi.org/10.1093/acprof:oso/9780199734023.001.0001
14 thms1 active userReviewed
CombinatoricsOptimization·Captain: mikedeng1

Efficient Algorithms for Scheduling Semiconductor Burn-In Operations 4: Batch List Scheduling Is Within B + 1 − 1/m of the Optimal Makespan and Has a Bounded Relative Maximum-Lateness ErrorResearch Paper

Motivation

Semiconductor burn-in ovens can process several jobs at once. A group placed in one oven must remain together until the longest job has finished, so increasing batch size saves oven starts but can delay short jobs. When several ovens are available, a scheduler also has to decide which oven receives each batch. Lee, Uzsoy, and Martin-Vega studied this setting and gave guarantees for a simple rule that first groups an arbitrary job list into batches and then sends those batches to the next available oven (Lee, Uzsoy & Martin-Vega 1992, §§2 and 5). Their bounds give a way to assess this easily specified rule against the best possible schedule, even when finding that schedule is difficult.

The paper treats both makespan, the time when all jobs have finished, and maximum lateness, the largest difference between a job's completion time and its due date. These objectives respond differently to batching. The makespan ignores which particular job finishes late; maximum lateness depends on each job's due date. Proposition 4 relates the lateness guarantee to the makespan guarantee of Proposition 1, making the two results a natural formalization unit (Lee, Uzsoy & Martin-Vega 1992, pp. 772–773).

Setting

There are n>0n>0n>0 jobs, indexed by jjj, with processing times pj>0p_j>0pj​>0 and due dates dj≥0d_j\ge0dj​≥0. All jobs are available at time zero. There are m>0m>0m>0 identical batch machines, each able to process at most B>0B>0B>0 jobs at once. A batch cannot be interrupted or enlarged after it begins, and its processing time is the largest pjp_jpj​ among its members. A schedule partitions the jobs into nonempty batches, chooses a machine for each batch, and orders the batches on each machine. Batches assigned to a machine run one after another from time zero. Every job in a batch finishes when that batch finishes (Lee, Uzsoy & Martin-Vega 1992, p. 766).

For a set of jobs JJJ, write Cmax⁡∗(J)C_{\max}^*(J)Cmax∗​(J) for the least makespan over all valid batchings and machine assignments. Write L∗(J)L^*(J)L∗(J) for the least possible value of max⁡j∈J(Cj−dj)\max_{j\in J}(C_j-d_j)maxj∈J​(Cj​−dj​), where CjC_jCj​ is job jjj's completion time. For the full job set, abbreviate these by Cmax⁡∗C_{\max}^*Cmax∗​ and L∗L^*L∗. The maximum due date over all jobs is dmax⁡=max⁡jdjd_{\max}=\max_jd_jdmax​=maxj​dj​.

Batch list scheduling (BLS) begins with any ordering of the jobs. It divides successive entries into full batches of BBB jobs, apart from a possibly smaller final batch. It then assigns each next batch to a machine that becomes available first. Denote the resulting makespan by Cmax⁡BLSC_{\max}^{\mathrm{BLS}}CmaxBLS​ and its maximum lateness by LLL. The guarantee applies to every initial list; it does not require an earliest-due-date or longest-processing-time order (Lee, Uzsoy & Martin-Vega 1992, p. 771, Algorithm BLS).

Formalization targets

Makespan guarantee

Proposition 1 asserts, for every BLS list,

Cmax⁡BLS≤(B+1−1m)Cmax⁡∗.C_{\max}^{\mathrm{BLS}}\le\left(B+1-\frac1m\right)C_{\max}^*.CmaxBLS​≤(B+1−m1​)Cmax∗​.

The milestone list includes the paper's processing-volume lower bound, ∑jpj/(mB)≤Cmax⁡∗\sum_jp_j/(mB)\le C_{\max}^*∑j​pj​/(mB)≤Cmax∗​, and Proposition 1 itself. The latter is stated for arbitrary job subsets as well as the full instance, because the paper applies it to a prefix sub-instance in the proof of Proposition 4 (Lee, Uzsoy & Martin-Vega 1992, p. 772).

Relative maximum-lateness guarantee

The mission's goal is the printed ratio of Proposition 4:

L−L∗L∗+dmax⁡≤B−1m+dmax⁡L∗+dmax⁡.\frac{L-L^*}{L^*+d_{\max}} \le B-\frac1m+\frac{d_{\max}}{L^*+d_{\max}}.L∗+dmax​L−L∗​≤B−m1​+L∗+dmax​dmax​​.

The denominator is positive under the stated conditions, even if the optimal maximum lateness is negative. The remaining milestones record the paper's lower bound L∗(J)≥Cmax⁡∗(J)−dmax⁡L^*(J)\ge C_{\max}^*(J)-d_{\max}L∗(J)≥Cmax∗​(J)−dmax​ for a nonempty sub-instance and its reduction from the full instance to the BLS prefix containing a maximum-lateness job (Lee, Uzsoy & Martin-Vega 1992, p. 773).

Significance

The makespan result controls the cost of using an arbitrary initial list and simple next-available-machine assignments instead of optimizing both the batching and machine allocation. At B=1B=1B=1, its factor becomes 2−1/m2-1/m2−1/m, the ordinary list-scheduling factor noted by the authors. Proposition 4 gives a corresponding bound for maximum lateness, normalized in a way that remains meaningful when L∗<0L^*<0L∗<0 (Lee, Uzsoy & Martin-Vega 1992, pp. 772–773).

These are proved results in the 1992 paper. The formalization work is to give their batch model, sub-instance optima, and the printed inequalities machine-checked statements and eventually proofs. The imported library already has definitions of least-loaded list scheduling and optimal assignment makespan for ordinary items on identical machines. This mission adds the batch layer, its lateness objective, and the comparison between the batch algorithm and unrestricted batch schedules. The Lean declarations here compile as open theorem targets; this proposal does not claim completed machine-checked proofs.

Difficulty

The processing time of a batch is a maximum, while its contribution to the volume of jobs is a sum. Treating each batch as an ordinary job gives a list-scheduling instance, but it does not by itself compare that instance's optimum with the optimum over all ways to form batches. That gap is central to the makespan bound. The lateness goal has a second obstacle: the job that determines the BLS maximum lateness may sit in a batch that is not the last to finish, and due dates prevent a direct substitution of a makespan bound for a lateness bound. Moreover, L∗L^*L∗ may be negative, so dividing by it would not give a valid relative error. The stated normalization and its positivity require explicit attention (Lee, Uzsoy & Martin-Vega 1992, proof of Proposition 4).

Formalization scope

Jobs are Fin n and machines are Fin m; the paper's first job is Lean index zero. Processing times and due dates are real numbers. The paper's integer-data convention is sufficient for these inequalities but is not needed for their statements. Processing times are positive, all jobs are available at time zero, and the lateness goal requires nonnegative due dates. This last condition makes explicit what the paper's final inequality uses: allowing negative due dates makes Proposition 4 false. The full job set is nonempty. Prefix jobs are the first batches of the given arbitrary list, and the optimal values for a prefix range over every valid batching and assignment of those jobs.

The BLS implementation chunks the list into full batches and a final remainder. A batch is sent to a least-loaded machine, which is the first machine to become free when no idle time is inserted. The published list-scheduling definitions of NumStochOpt.ListScheduling supply this rule and the ordinary assignment optimum. They select the lowest machine index on a tie; identical-machine labels do not affect the resulting completion times. Machine schedules are represented by an ordered batch list and an assignment, with each machine processing its own batches back to back. No bound is obtained by defining the optimum over BLS-shaped consecutive batches, and no theorem fixes a favorable job list.

The mission covers correctness inequalities, not the paper's running-time claims or its later BLPT rule. Useful contributions include proofs of the four milestones, finite-schedule facts showing the optima are attained, and reusable links between batch completion times and least-loaded list scheduling. The parallel batch model can also support other objectives and scheduling rules.

Selected references

  • C.-Y. Lee, R. Uzsoy, and L. A. Martin-Vega, Efficient Algorithms for Scheduling Semiconductor Burn-In Operations, Operations Research 40(4), 764–775, 1992. DOI: 10.1287/opre.40.4.764.
8 thms1 active userReviewed
Dynamic ProgrammingOptimization·Captain: mikedeng1

Efficient Algorithms for Scheduling Semiconductor Burn-In Operations 1: Dynamic Program DP1 Finds a Minimum-Makespan On-Time Batch Schedule of Equal-Length Jobs with Agreeable Release and Due DatesResearch Paper

Motivation

Burn-in is the final testing stage of semiconductor manufacturing: finished integrated circuits are loaded on boards and held in an oven at high temperature for a prescribed minimum time, so that weak devices fail before shipment. An oven holds many boards at once, a load cannot be interrupted, and a board may stay in the oven longer than its specified time but never shorter. Because burn-in times are long compared to the other test operations, the ovens are frequently the bottleneck of the test facility, and the order in which lots enter them determines whether customer due dates are met.

Lee, Uzsoy and Martin-Vega (Operations Research 40(4), 1992) modelled an oven as a batch processing machine and gave polynomial algorithms for several due-date objectives. This mission covers the first of them: one machine, jobs with release times and a common processing time, and the question whether every job can be completed by its due date. Ikura and Gimple (Operations Research Letters 5(2), 1986) had already given an O(n2)O(n^2)O(n2) algorithm for this feasibility question when release times and due dates are agreeable; the paper replaces it by a simpler dynamic program, DP1, and uses DP1 with a bisection search to minimize the maximum tardiness.

Setting

There are nnn jobs, indexed 1,…,n1, \dots, n1,…,n. Job iii has a release time rir_iri​ (it cannot be processed earlier), a due date did_idi​, and the common processing time ppp; all data are natural numbers. One machine processes up to B≥1B \ge 1B≥1 jobs simultaneously.

A batch schedule of a set JJJ of jobs is a sequence of batches P1,…,PmP_1, \dots, P_mP1​,…,Pm​: nonempty, pairwise disjoint sets of at most BBB jobs whose union is JJJ, processed in this order. A batch cannot be interrupted, and no job joins it once it has started. It starts as soon as the previous batch is finished and all its jobs are released, and it takes time ppp:

C(Pk)=max⁡{r(Pk), C(Pk−1)}+p,r(P)=max⁡{ri:i∈P},C(P0)=0.C(P_k) = \max\{r(P_k),\, C(P_{k-1})\} + p,\qquad r(P) = \max\{r_i : i \in P\},\qquad C(P_0) = 0 .C(Pk​)=max{r(Pk​),C(Pk−1​)}+p,r(P)=max{ri​:i∈P},C(P0​)=0.

Job iii completes at Ci=C(Pk)C_i = C(P_k)Ci​=C(Pk​) for the batch Pk∋iP_k \ni iPk​∋i; the makespan is Cmax⁡=C(Pm)C_{\max} = C(P_m)Cmax​=C(Pm​). A schedule is feasible (has Tmax⁡=0T_{\max} = 0Tmax​=0) if Ci≤diC_i \le d_iCi​≤di​ for every job, and its maximum tardiness is Tmax⁡=max⁡imax⁡{0,Ci−di}T_{\max} = \max_i \max\{0, C_i - d_i\}Tmax​=maxi​max{0,Ci​−di​}.

Release times and due dates are agreeable if ri<rjr_i < r_jri​<rj​ implies di≤djd_i \le d_jdi​≤dj​. A schedule is in batch-EDD order if no job of an earlier batch has a larger due date than a job of a later batch.

Algorithm DP1. With the jobs indexed in nondecreasing order of due dates, let f(0)=0f(0) = 0f(0)=0 and, for j≥1j \ge 1j≥1,

f(j)=min⁡max⁡{1, j−B+1}≤i≤jfi(j),fi(j)={max⁡{f(i−1),rj}+pif max⁡{f(i−1),rj}+p≤di,∞otherwise.f(j) = \min_{\max\{1,\,j-B+1\} \le i \le j} f_i(j),\qquad f_i(j) = \begin{cases} \max\{f(i-1), r_j\} + p & \text{if } \max\{f(i-1), r_j\} + p \le d_i,\\ \infty & \text{otherwise.}\end{cases}f(j)=max{1,j−B+1}≤i≤jmin​fi​(j),fi​(j)={max{f(i−1),rj​}+p∞​if max{f(i−1),rj​}+p≤di​,otherwise.​

Formalization targets

Goal: correctness of DP1

For an index order nondecreasing in both ddd and rrr, and every 0≤j≤n0 \le j \le n0≤j≤n,

f(j)=min⁡{ Cmax⁡(S):S a feasible batch schedule of jobs 1,…,j },min⁡∅=∞.f(j) = \min\{\, C_{\max}(S) : S \text{ a feasible batch schedule of jobs } 1,\dots,j \,\},\qquad \min\emptyset = \infty .f(j)=min{Cmax​(S):S a feasible batch schedule of jobs 1,…,j},min∅=∞.

The minimum ranges over all batch schedules of the prefix: every batching and every batch order. The case j=nj = nj=n is the paper's statement that DP1 "will find a feasible schedule with minimum makespan if a feasible schedule exists" (p. 768).

Milestones

  1. Lemma 1 (p. 767): if a feasible schedule exists, a feasible schedule in batch-EDD order exists.
  2. Justification of DP1 (p. 768): every feasible schedule of jobs 1,…,j1, \dots, j1,…,j can be replaced by a feasible schedule whose batches are blocks of at most BBB consecutively indexed jobs, in increasing index order, with no larger makespan, so the problem "becomes a consecutive partition problem".
  3. Lemma 2 (p. 769): under rj+p≤djr_j + p \le d_jrj​+p≤dj​ for all jjj, some schedule has Tmax⁡≤(n−1)pT_{\max} \le (n-1)pTmax​≤(n−1)p.

Significance

DP1 decides feasibility of 1/ri,pi=p,B/Tmax⁡1/r_i, p_i = p, B/T_{\max}1/ri​,pi​=p,B/Tmax​ and, when the instance is feasible, returns the minimum makespan of an on-time schedule. Applied to due dates augmented by a trial value TTT, it decides whether Tmax⁡≤TT_{\max} \le TTmax​≤T is achievable, which together with the bound of Lemma 2 gives the paper's polynomial procedure for minimizing Tmax⁡T_{\max}Tmax​. The consecutive-partition structure behind it recurs in the paper's later dynamic programs (DP2 for agreeable processing times and due dates, DP3 for the number of tardy jobs), and in much of the later literature on batch scheduling with release dates.

The results are proved in the paper; none of them has a machine-checked proof. The mission formalizes the known proofs. Its formal statements also make explicit two assumptions that the printed text leaves loose: the tie-break of the index order, without which DP1 returns a wrong value, and the hypothesis rj+p≤djr_j + p \le d_jrj​+p≤dj​ of Lemma 2, without which the lemma is false.

Difficulty

The obvious argument for the goal is "by Lemma 1 the batches are consecutive, and DP1 enumerates consecutive partitions". Lemma 1 orders the batches by due dates, but it does not make the batches intervals of the index order: jobs with equal due dates may still be split across batches in an order that is not the index order, and when equal due dates are indexed against the release order DP1's value max⁡{f(i−1),rj}+p\max\{f(i-1), r_j\} + pmax{f(i−1),rj​}+p underestimates the start of the batch {i,…,j}\{i, \dots, j\}{i,…,j}. The step from batch-EDD order to consecutive batches, and the fact that the exchange never increases the makespan, are the content of the justification milestone. The goal also asserts two directions at once: that the DP value is attained by some feasible schedule, and that no feasible schedule, consecutive or not, finishes earlier.

Formalization scope

Jobs are Fin n, 0-based (the paper's job iii is i - 1); a prefix "jobs 1,…,j1, \dots, j1,…,j" is a prefix length j≤nj \le nj≤n. Data are natural numbers, as the paper assumes ("all data to be integers", p. 769). A batch schedule is a List (Finset (Fin n)); schedules are semi-active, starting every batch as early as possible, which loses nothing for the regular objectives here. DP1 is a def written as printed, with values in ℕ∞ and ∞=⊤\infty = \top∞=⊤; the minimum in the goal is an infimum in ℕ∞ over all valid feasible schedules, so its value on an infeasible prefix is ⊤\top⊤.

Explicit readings of loose phrases:

  • "Jobs are indexed in increasing order of due dates" (p. 767): the index order is nondecreasing in both ddd and rrr. Such an order exists for agreeable data (sort by (d,r)(d, r)(d,r)), and it implies agreeability. With ties in ddd ordered against rrr the goal is false: B=2B = 2B=2, p=1p = 1p=1, d=(2,2)d = (2, 2)d=(2,2), r=(1,0)r = (1, 0)r=(1,0) gives f(2)=1f(2) = 1f(2)=1, while every schedule finishes at time 222.
  • "Agreeable" is printed as "ri≤rjr_i \le r_jri​≤rj​ implies di≤djd_i \le d_jdi​≤dj​"; the strict form ri<rj⇒di≤djr_i < r_j \Rightarrow d_i \le d_jri​<rj​⇒di​≤dj​ is used, a weaker hypothesis.
  • "A solution with Tmax⁡=0T_{\max} = 0Tmax​=0" is a batch schedule in which every job is on time.
  • "(n−1)p(n - 1)p(n−1)p is an upper bound on the value of Tmax⁡T_{\max}Tmax​" (Lemma 2) is read as a bound on the optimal Tmax⁡T_{\max}Tmax​, with the hypothesis rj+p≤djr_j + p \le d_jrj​+p≤dj​ that its proof invokes ("by assumption rj+p<djr_j + p < d_jrj​+p<dj​"), in the weak form.
  • "If f(j)≤djf(j) \le d_jf(j)≤dj​, then it is possible to schedule jobs 1,…,j1, \dots, j1,…,j so that none are tardy" is not formalized separately; it is subsumed by the goal.

Not formalized: the O(nB)O(nB)O(nB) running time of DP1, Algorithm 1 (bisection over Tmax⁡T_{\max}Tmax​) and Corollary 1, whose content is a running time. A formalization that restricts the minimum in the goal to consecutive or batch-EDD schedules would assume the milestones and is excluded; so is a DP value defined as the optimum itself.

The development needs list-based schedule recursions and ℕ∞ arithmetic only; the exchange lemmas for batch schedules (moving a job between batches without delaying later batches) are reusable for the paper's other dynamic programs. Proofs of any milestone, and of auxiliary lemmas on finish, jobCompletion and permutations of batch lists, are welcome.

Selected references

  • C.-Y. Lee, R. Uzsoy, L. A. Martin-Vega, Efficient Algorithms for Scheduling Semiconductor Burn-In Operations, Operations Research 40(4), 764–775, 1992. https://doi.org/10.1287/opre.40.4.764
  • Y. Ikura, M. Gimple, Scheduling Algorithms for a Single Batch Processing Machine, Operations Research Letters 5(2), 61–65, 1986. https://doi.org/10.1016/0167-6377(86)90092-7
6 thms1 active userReviewed
Dynamic ProgrammingOptimization·Captain: mikedeng1

Efficient Algorithms for Scheduling Semiconductor Burn-In Operations 2: Dynamic Program DP2 Finds a Minimum-Makespan On-Time Batch Schedule When Processing Times and Due Dates Are AgreeableResearch Paper

Burn-in ovens as batch processing machines

In semiconductor manufacturing, finished chips go through burn-in: they are loaded on boards and held in an oven at high temperature to expose early failures. An oven holds a bounded number of boards, a load cannot be interrupted once started, and a chip may stay in the oven longer than its specified burn-in time but not shorter. Lee, Uzsoy and Martin-Vega (Oper. Res. 40(4), 1992) model the oven as a batch processing machine and give polynomial algorithms for several due-date objectives. The model has since become a standard one in scheduling theory; the survey of Potts and Kovalyov (2000) traces the batching literature that grew from it.

This mission formalizes the part of the paper's §3 on minimizing maximum tardiness when all jobs are available at time 000 and processing times and due dates are agreeable. That is the problem the paper writes 1/B/Tmax⁡1/B/T_{\max}1/B/Tmax​. The paper's own route is a feasibility test by dynamic programming, Algorithm DP2, which a bisection over due-date shifts turns into a Tmax⁡T_{\max}Tmax​ minimizer.

The batch machine

There are nnn jobs 1,…,n1,\dots,n1,…,n. Job iii has a processing time pip_ipi​ and a due date did_idi​, both natural numbers. The machine has capacity B≥1B\ge 1B≥1. A batch is a nonempty set of at most BBB jobs processed together. It occupies the machine for the processing time of its longest job,

t(P)=max⁡i∈Ppi.t(P)=\max_{i\in P}p_i .t(P)=i∈Pmax​pi​.

A batch schedule of a job set JJJ is a sequence S=(P1,…,Pm)S=(P_1,\dots,P_m)S=(P1​,…,Pm​) of pairwise disjoint batches covering JJJ, processed in this order and back to back from time 000. Batch PkP_kPk​ and all of its jobs complete at C(Pk)=t(P1)+⋯+t(Pk)C(P_k)=t(P_1)+\dots+t(P_k)C(Pk​)=t(P1​)+⋯+t(Pk​). The makespan is Cmax⁡(S)=C(Pm)C_{\max}(S)=C(P_m)Cmax​(S)=C(Pm​), and the maximum tardiness is

Tmax⁡(S)=max⁡kmax⁡i∈Pkmax⁡{0, C(Pk)−di}.T_{\max}(S)=\max_k\max_{i\in P_k}\max\{0,\,C(P_k)-d_i\}.Tmax​(S)=kmax​i∈Pk​max​max{0,C(Pk​)−di​}.

A schedule is feasible when Tmax⁡(S)=0T_{\max}(S)=0Tmax​(S)=0, that is, when every job meets its due date.

A sequence is in batch-EDD order (Definition 1) if no job in an earlier batch has a strictly later due date than a job in a later batch. Processing times and due dates are agreeable if pi<pjp_i<p_jpi​<pj​ implies di≤djd_i\le d_jdi​≤dj​. A schedule is consecutive when every batch is a block {i,i+1,…,k}\{i,i+1,\dots,k\}{i,i+1,…,k} of indices and the blocks appear in increasing order.

Algorithm DP2 computes values f(0),…,f(n)∈N∪{∞}f(0),\dots,f(n)\in\mathbb N\cup\{\infty\}f(0),…,f(n)∈N∪{∞}:

f(0)=0,f(j)=min⁡max⁡{1, j−B+1}≤i≤jfi(j),fi(j)={f(i−1)+pj,f(i−1)+pj≤di,∞,otherwise.f(0)=0,\qquad f(j)=\min_{\max\{1,\,j-B+1\}\le i\le j} f_i(j),\qquad f_i(j)=\begin{cases}f(i-1)+p_j,& f(i-1)+p_j\le d_i,\\ \infty,&\text{otherwise.}\end{cases}f(0)=0,f(j)=max{1,j−B+1}≤i≤jmin​fi​(j),fi​(j)={f(i−1)+pj​,∞,​f(i−1)+pj​≤di​,otherwise.​

Formalization targets

Goal: correctness of DP2

Index the jobs so that d1≤⋯≤dnd_1\le\dots\le d_nd1​≤⋯≤dn​ and p1≤⋯≤pnp_1\le\dots\le p_np1​≤⋯≤pn​. Then for every 0≤j≤n0\le j\le n0≤j≤n,

f(j)=min⁡{ Cmax⁡(S):S a batch schedule of jobs 1,…,j, Tmax⁡(S)=0 },f(j)=\min\{\,C_{\max}(S) : S \text{ a batch schedule of jobs } 1,\dots,j,\ T_{\max}(S)=0\,\},f(j)=min{Cmax​(S):S a batch schedule of jobs 1,…,j, Tmax​(S)=0},

with min⁡∅=∞\min\emptyset=\inftymin∅=∞. The minimum ranges over all schedules: any batching, any order. This is the paper's reading of f(j)f(j)f(j) as "the minimum completion time of jobs 1,…,j1,\dots,j1,…,j if they can be scheduled feasibly, and infinity otherwise".

Milestones

  1. Lemma 3. With agreeable processing times and due dates, if a feasible schedule exists, then a feasible schedule in batch-EDD order exists.
  2. Consecutive partition (justification of DP2). Under the index order above, if jobs 1,…,j1,\dots,j1,…,j can be scheduled feasibly, then some feasible schedule of minimum makespan is consecutive.
  3. FBEDD. With equal processing times and due dates in index order, the Full-Batch EDD schedule {1,…,B},{B+1,…,2B},…\{1,\dots,B\},\{B+1,\dots,2B\},\dots{1,…,B},{B+1,…,2B},… has Tmax⁡T_{\max}Tmax​ no larger than that of any batch schedule.

Significance

DP2 is the paper's feasibility test for 1/B/Tmax⁡1/B/T_{\max}1/B/Tmax​ with agreeable data. With a bisection over the common shift of the due dates, it yields a polynomial algorithm for minimizing Tmax⁡T_{\max}Tmax​. A correct statement of what DP2 computes is therefore the core of that result. The same consecutive-partition structure underlies the paper's DP1 (release times, equal processing times) and DP3 (number of tardy jobs), which are separate missions of this series.

No machine-checked proof of any of these statements is known. The dynamic program's correctness is argued in the paper only by reference ("the justification of this algorithm is similar to that of algorithm DP1"), and the index order it needs is left implicit. A formal proof pins down exactly which ordering of the jobs makes the recursion correct.

Difficulty

The recursion charges pjp_jpj​ for the last batch {i,…,j}\{i,\dots,j\}{i,…,j} and checks only did_idi​. Both shortcuts rely on the jobs being sorted by due date and by processing time at the same time. Lemma 3's exchange argument sorts a feasible schedule by due date, but it does not by itself produce consecutive blocks of a fixed index order. With ties in due dates the indexing also has to be compatible with processing times. Without that, the recursion is wrong: for B=2B=2B=2, p=(3,1)p=(3,1)p=(3,1), d=(5,5)d=(5,5)d=(5,5) it gives f(2)=1f(2)=1f(2)=1, while every schedule takes at least 333. The goal compares the DP with the optimum over all schedules, so the exchange arguments have to bridge arbitrary batchings and the consecutive ones the recursion enumerates. That bridge is the main step left to prove.

Formalization scope

  • Jobs are Fin n (job iii of the paper is index i−1i-1i−1); jobs 1,…,j1,\dots,j1,…,j are jobsUpTo n j. Data are natural numbers; the paper assumes integral data (p. 769).
  • A schedule is a List (Finset (Fin n)); validity requires nonempty batches of size at most BBB inside the job set, pairwise disjoint, covering the set. Batches start as early as possible. Batch time is the maximum processing time in the batch.
  • ∞\infty∞ is ⊤ : ℕ∞, and the goal's minimum is the infimum in ℕ∞, which is ⊤ exactly when no feasible schedule exists. DP2 is defined by the printed recursion, not as an optimum.
  • Explicit readings of loose phrases:
    • "jobs are indexed in increasing order of due dates" (p. 767) becomes Monotone d ∧ Monotone p for DP2 and its justification, and Monotone d for FBEDD;
    • "agreeable" (printed "pi≤pjp_i\le p_jpi​≤pj​ implies di≤djd_i\le d_jdi​≤dj​", which would force equal due dates for equal processing times) becomes the strict form pi<pj⇒di≤djp_i<p_j\Rightarrow d_i\le d_jpi​<pj​⇒di​≤dj​, a weaker hypothesis;
    • "optimally solves" for FBEDD becomes "valid, and Tmax⁡T_{\max}Tmax​ at most that of every valid schedule";
    • "a consecutive partition problem" becomes the existence of a consecutive minimum-makespan feasible schedule.
  • Not formalized: the O(nB)O(nB)O(nB) and O[nBlog⁡2(npmax⁡)]O[nB\log_2(np_{\max})]O[nBlog2​(npmax​)] running times, the bisection procedure, and the remark that npmax⁡np_{\max}npmax​ bounds Tmax⁡T_{\max}Tmax​.
  • Trivializations ruled out: the goal's minimum ranges over all valid schedules, not only batch-EDD or consecutive ones (which would assume the milestones), and DP2 is the printed recursion, not a restatement of the optimum.
  • Infrastructure needed: list-indexed schedules, exchange arguments on adjacent batches, and induction on prefix length for the recursion. The single-machine batch model is shared in spirit with missions 1 and 3 of this series. No published platform definition was reused, since nothing on batch machines exists yet.

Selected references

  • C.-Y. Lee, R. Uzsoy, L. A. Martin-Vega, Efficient Algorithms for Scheduling Semiconductor Burn-In Operations, Operations Research 40(4), 764–775, 1992. https://doi.org/10.1287/opre.40.4.764
  • Y. Ikura, M. Gimple, Efficient scheduling algorithms for a single batch processing machine, Operations Research Letters 5(2), 61–65, 1986. https://doi.org/10.1016/0167-6377(86)90104-5
  • C. N. Potts, M. Y. Kovalyov, Scheduling with batching: A review, European Journal of Operational Research 120(2), 228–249, 2000. https://doi.org/10.1016/S0377-2217(99)00153-8
7 thms1 active userReviewed
🏆Completed
Dynamic ProgrammingOptimization·Captain: mikedeng1

A Functional Equation and Its Application to Resource Allocation and Sequencing Problems 3: The Minimum Weighted Number of Tardy Jobs Is Σ p_j Minus the Value f(n, d_n) of Equation (3)Research Paper

Motivation

Minimizing the weighted number of tardy jobs on a single machine, written 1∥∑wjUj1\|\sum w_jU_j1∥∑wj​Uj​ in later scheduling notation, is one of the basic due-date objectives: each job either meets its deadline or pays a fixed penalty, and the question is which jobs to sacrifice. Moore (Management Sci. 15, 1968) solved the unweighted case pj=1p_j = 1pj​=1 with a greedy procedure. Lawler and Moore (Management Sci. 16, 1969) handled arbitrary weights by recasting the problem as a knapsack problem with nested prefix constraints and solving it by a recursion, their Equation (3). This is the classical pseudo-polynomial algorithm for the weighted problem; Lenstra, Rinnooy Kan and Brucker (Ann. Discrete Math. 1, 1977) showed that the weighted problem is NP-hard, so a pseudo-polynomial method is the expected kind of exact algorithm.

The paper's Sections 5 and 6 state the reduction in a few sentences: on-time jobs can be taken in deadline order, the problem is "equivalent" to the prefix-constrained knapsack, and (3) solves the latter. This mission turns those sentences into precise statements.

Setting

There are n≥1n \ge 1n≥1 jobs, processed by a single machine one immediately following the other from time 000. Job jjj has a nonnegative integer processing time aj′a'_jaj′​, a nonnegative integer deadline djd_jdj​ and a penalty pj≥0p_j \ge 0pj​≥0. A sequence σ\sigmaσ is an ordering of all jobs; job jjj completes at time Cj(σ)C_j(\sigma)Cj​(σ), the total processing time of job jjj and the jobs before it. Job jjj is tardy in σ\sigmaσ if Cj(σ)>djC_j(\sigma) > d_jCj​(σ)>dj​, and the total loss of σ\sigmaσ is

W(σ)=∑j tardy in σpj,W(\sigma) = \sum_{j \text{ tardy in } \sigma} p_j ,W(σ)=j tardy in σ∑​pj​,

the loss cj(t)c_j(t)cj​(t) being 000 for t≤djt \le d_jt≤dj​ and pjp_jpj​ for t>djt > d_jt>dj​.

The jobs are numbered by deadline, d1≤d2≤⋯≤dnd_1 \le d_2 \le \cdots \le d_nd1​≤d2​≤⋯≤dn​. A 0–1 vector xxx (xj=1x_j = 1xj​=1: job jjj on time; xj=0x_j = 0xj​=0: tardy) is prefix-feasible if

a1′x1+⋯+ak′xk≤dk(k=1,…,n).a'_1x_1 + \cdots + a'_kx_k \le d_k \qquad (k = 1, \dots, n).a1′​x1​+⋯+ak′​xk​≤dk​(k=1,…,n).

Equation (3) defines f(j,t)f(j,t)f(j,t) for j=0,…,nj = 0, \dots, nj=0,…,n and integer ttt:

f(j,t)={max⁡{f(j,t−1), f(j−1,t), pj+f(j−1,t−aj′)},0≤t≤dj,f(j,dj),t>dj,f(j,t) = \begin{cases}\max\{f(j,t-1),\ f(j-1,t),\ p_j + f(j-1,t-a'_j)\}, & 0 \le t \le d_j,\\ f(j, d_j), & t > d_j,\end{cases}f(j,t)={max{f(j,t−1), f(j−1,t), pj​+f(j−1,t−aj′​)},f(j,dj​),​0≤t≤dj​,t>dj​,​

with f(0,t)=0f(0,t) = 0f(0,t)=0 for t≥0t \ge 0t≥0 and f(j,t)=−∞f(j,t) = -\inftyf(j,t)=−∞ for t<0t < 0t<0.

Formalization targets

Goal: the minimum weighted number of tardy jobs

With d1≤⋯≤dnd_1 \le \cdots \le d_nd1​≤⋯≤dn​ and pj≥0p_j \ge 0pj​≥0, f(n,dn)f(n, d_n)f(n,dn​) is finite and

min⁡σW(σ)=∑j=1npj−f(n,dn).\min_{\sigma} W(\sigma) = \sum_{j=1}^n p_j - f(n, d_n).σmin​W(σ)=j=1∑n​pj​−f(n,dn​).

This is the paper's claim that the problem "is solved by" its recursion, with the evaluation point made explicit.

Milestones (Section 5, Section 6, Eq. (3))

  1. Section 5. For any sequence, the on-time jobs, sequenced in order of their deadlines and followed by the tardy jobs in arbitrary order, stay on time, and the total loss does not increase.
  2. Section 6. Every sequence has a prefix-feasible xxx with ∑pj−∑pjxj≤W(σ)\sum p_j - \sum p_jx_j \le W(\sigma)∑pj​−∑pj​xj​≤W(σ), and every prefix-feasible xxx has a sequence with W(σ)≤∑pj−∑pjxjW(\sigma) \le \sum p_j - \sum p_jx_jW(σ)≤∑pj​−∑pj​xj​: the two problems have the same optimal value.
  3. Eq. (3). For 0≤j≤n0 \le j \le n0≤j≤n and t≥0t \ge 0t≥0,
f(j,t)=max⁡{∑i≤jpixi:∑i≤kai′xi≤dk (k≤j), ∑i≤jai′xi≤t}.f(j,t) = \max\Bigl\{\textstyle\sum_{i \le j} p_ix_i : \sum_{i\le k} a'_ix_i \le d_k\ (k \le j),\ \sum_{i\le j} a'_ix_i \le t\Bigr\}.f(j,t)=max{∑i≤j​pi​xi​:∑i≤k​ai′​xi​≤dk​ (k≤j), ∑i≤j​ai′​xi​≤t}.

The goal follows from milestones 2 and 3 at j=nj = nj=n, t=dnt = d_nt=dn​.

Significance

The result is the exact algorithm for 1∥∑wjUj1\|\sum w_jU_j1∥∑wj​Uj​ with running time proportional to n dnn\,d_nndn​, and the reduction behind it (on-time jobs in earliest-deadline order, then a knapsack over the on-time set) is the template reused by later work on due-date objectives, including the two-agent and batching variants. The prefix-constrained knapsack itself reappears whenever a set of jobs must be feasible under nested capacity limits.

On formalization: the paper's argument is three sentences long and leaves several points implicit: the base cases of (3), the role of the deadline numbering, the sign of the penalties, and what "equivalent" means. A machine-checked development fixes each of them and yields a verified pseudo-polynomial algorithm for an NP-hard scheduling problem. To our knowledge none of these statements has a machine-checked proof; the platform's SchedComplexity.OneMachine.* items (Lenstra, Rinnooy Kan and Brucker) state the NP-hardness of the same problem in another model, MooreLateJobs.NumLate.* covers Moore's unweighted case, and TwoAgentSched.LateLate.lemma_7_1 is a two-agent analogue of milestone 1.

Difficulty

The obvious argument works with the set of on-time jobs and asserts that this set can be sequenced on time iff its earliest-deadline order is. That step is Jackson's rule, an exchange argument on lists that is not in Mathlib; it is where both milestone 1 and the first half of milestone 2 sit. The second half of milestone 2 needs the deadline numbering: for a job kkk that is tardy, the prefix constraint at kkk is not a completion-time constraint of any job, and only the monotonicity di≤dkd_i \le d_kdi​≤dk​ for the last on-time job i≤ki \le ki≤k bounds it. Milestone 3 is a dynamic-programming correctness proof in which the cap f(j,t)=f(j,dj)f(j,t) = f(j,d_j)f(j,t)=f(j,dj​) for t>djt > d_jt>dj​ and the −∞-\infty−∞ base cases must be tracked through a well-founded recursion on (j,t)(j, t)(j,t).

Formalization scope

Jobs are Fin n, 0-based: Lean job jjj is the paper's job j+1j+1j+1, and the paper's f(j,⋅)f(j,\cdot)f(j,⋅) uses Lean job ⟨j-1, _⟩. Sequences are lists in the published model MooreLateJobs.Shared (IsSchedule Finset.univ l, completionTime, no idle time, start at 000), which replaces the paper's permutation π\piπ; tardy jobs are the published MooreLateJobs.NumLate.lateSet (strictly dj<Cjd_j < C_jdj​<Cj​). Processing times and deadlines are natural numbers, penalties real. Vectors xxx are Fin n → Bool. fff takes values in WithBot ℝ, with ⊥=−∞\bot = -\infty⊥=−∞ and p+⊥=⊥p + \bot = \botp+⊥=⊥; +∞+\infty+∞ never occurs.

Explicit readings of the paper's loose phrases:

  • Integer data: (3) steps ttt by 111 and subtracts aj′a'_jaj′​, so aj′a'_jaj′​ and djd_jdj​ are nonnegative integers.
  • Penalties pj≥0p_j \ge 0pj​≥0 ("a penalty pjp_jpj​ is exacted"); the goal, milestone 1 and milestone 2 assume it, milestone 3 does not need it.
  • Deadline numbering ("ordering the jobs by deadlines") is Monotone d on the job index; assumed in the goal and milestone 2 only.
  • Base cases of (3) are those of Equation (1), with −∞-\infty−∞ for a maximum: f(0,t)=0f(0,t) = 0f(0,t)=0 (t≥0t \ge 0t≥0), f(j,t)=−∞f(j,t) = -\inftyf(j,t)=−∞ (t<0t < 0t<0). The dominated term f(j,t−1)f(j,t-1)f(j,t−1) is kept as printed.
  • "Equivalent" is the pair of inequalities of milestone 2, i.e. equal optimal values.
  • "Solved by" means f(n,dn)f(n,d_n)f(n,dn​) is finite and ∑pj−f(n,dn)\sum p_j - f(n,d_n)∑pj​−f(n,dn​) is the least weighted number of tardy jobs (IsLeast over all schedules); n≥1n \ge 1n≥1 only so that dnd_ndn​ exists.
  • "Arbitrary order" of the tardy jobs in milestone 1 is a universal quantifier over the remaining lists.

Section 5 literally applies Equation (1) with aj=aj′a_j = a'_jaj​=aj′​, αj(t)=0\alpha_j(t) = 0αj​(t)=0, bj=0b_j = 0bj​=0, βj(t)=pj\beta_j(t) = p_jβj​(t)=pj​; read literally, that leaves the deadlines unenforced, so the mission formalizes the paper's own corrected form (3) instead. Trivializing formalizations are ruled out: the weighted number of tardy jobs is defined from completion times, not through xxx; the optimum is a minimum over sequences, not defined as fff; (3) keeps its cap f(j,t)=f(j,dj)f(j,t) = f(j,d_j)f(j,t)=f(j,dj​); the goal assumes pj≥0p_j \ge 0pj​≥0 and sorted deadlines, without which it is false.

Infrastructure: an exchange lemma for earliest-deadline order on lists (Jackson's rule, posed on the platform as MooreLateJobs.NumLate.jackson) and well-founded-recursion lemmas for WithBot ℝ maxima are reusable beyond this mission. Proofs of any milestone, and of Jackson's rule, are welcome.

Selected references

  • E. L. Lawler, J. M. Moore, A Functional Equation and Its Application to Resource Allocation and Sequencing Problems, Management Science 16(1), 1969, 77–84. https://doi.org/10.1287/mnsc.16.1.77
  • J. M. Moore, An n Job, One Machine Sequencing Algorithm for Minimizing the Number of Tardy Jobs, Management Science 15(1), 1968, 102–109. https://doi.org/10.1287/mnsc.15.1.102
  • J. R. Jackson, Scheduling a Production Line to Minimize Maximum Tardiness, Research Report 43, Management Science Research Project, UCLA, 1955.
  • J. K. Lenstra, A. H. G. Rinnooy Kan, P. Brucker, Complexity of Machine Scheduling Problems, Annals of Discrete Mathematics 1, 1977, 343–362. https://doi.org/10.1016/S0167-5060(08)70743-X
9 thms1 active userReviewed
PreviousPage 45 of 54Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me