Prove2Me
Navigate
DiscoverFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Theoretical Computer Science

169 missions · 112 completed

The mathematical foundations of computation: which problems can be solved, by what algorithms, and at what cost in time, space, or communication. Distinguished by its emphasis on rigor and unconditional lower bounds, it spans computational complexity, algorithm design, automata and computability, cryptography, and the analysis of Boolean functions.

Missions

Open57Completed112All169
Operations Research·Captain: Shuze Chen

The k-Server ConjectureOpen Problem

Motivation

The kkk-server problem was introduced by Manasse, McGeoch, and Sleator (STOC 1988 / J. Algorithms 1990) as a common generalization of paging, weighted caching, and related sequential decision problems, and their kkk-server conjecture has since become the central open question of competitive analysis. The conjecture asserts that a single ratio — exactly kkk — governs deterministic online server management on every metric space.

Timeline

  • 1985. Sleator and Tarjan introduce competitive analysis — an online algorithm judged against the offline optimum on every input — for list update and paging, and ask for a theory of such guarantees.
  • 1988–1990. Manasse, McGeoch, and Sleator introduce the kkk-server problem (STOC 1988; J. Algorithms 1990) and settle its extremes: no deterministic algorithm beats ratio kkk on any space with more than kkk points (Corollary 7), two servers admit a 222-competitive algorithm (Theorem 5, algorithm RES), and kkk servers on k+1k+1k+1 points admit a kkk-competitive one (Theorem 4, algorithm BAL). Section 8 poses the kkk-server conjecture, in the symmetric finite setting of the paper.
  • 1990. Fiat, Rabani, and Ravid (FOCS 1990) give the first competitive ratio depending on kkk alone — exponential in kkk, but finite on every metric space.
  • 1991. Chrobak, Karloff, Payne, and Vishwanathan (SIAM J. Discrete Math.) prove the conjecture on the real line via Double Coverage; Chrobak and Larmore (SIAM J. Comput.) extend it to all tree metrics.
  • 1995. Koutsoupias and Papadimitriou (J. ACM) prove the Work Function Algorithm is (2k−1)(2k-1)(2k−1)-competitive on every metric space — the breakthrough, and still the best general bound. Their Conjecture 1.1 fixes the conjecture's modern form: for every metric space there is an online algorithm with competitive ratio kkk.
  • 1996. The same authors verify the conjecture on spaces of k+2k+2k+2 points via the dual 2-evader problem (Inf. Process. Lett. 57).
  • 2004. Bartal and Koutsoupias prove the WFA itself is kkk-competitive on the line, weighted stars, and all spaces of k+2k+2k+2 points.
  • 2021. Coester and Koutsoupias (ICALP) give a unifying potential for all known WFA analyses and push the frontier to the circle.
  • 2023. Bubeck, Coester, and Rabani (STOC) refute the randomized analogue: no o(log⁡2k)o(\log^2 k)o(log2k)-competitive randomized algorithm exists in general. The deterministic conjecture — this mission's goal — survives as the central open question, with the gap between kkk and 2k−12k-12k−1 unmoved since 1995.
  • 2026. Coester, Koutsoupias, and Zbysiński post The kkk-server conjecture is true (arXiv:2609.15979), a claimed proof of the full conjecture: the Work Function Algorithm itself is kkk-competitive on every metric space, via a matrix representation of work functions and a potential function built on it. The preprint is not yet peer-reviewed; this mission's goal stays open until a machine-checked proof exists.

Setting

Fix a metric space MMM with distance function ddd, and a number of servers k≥1k \ge 1k≥1. A configuration records where the kkk servers stand: it is a function CCC assigning to each server i∈{1,…,k}i \in \{1, \dots, k\}i∈{1,…,k} a point C(i)∈MC(i) \in MC(i)∈M. Moving the servers from configuration CCC to configuration C′C'C′ means server iii travels from C(i)C(i)C(i) to C′(i)C'(i)C′(i); the movement cost is the total distance traveled,

moveCost(C,C′)  =  ∑i=1kd(C(i), C′(i)).\mathrm{moveCost}(C, C') \;=\; \sum_{i=1}^{k} d\bigl(C(i),\, C'(i)\bigr).moveCost(C,C′)=i=1∑k​d(C(i),C′(i)).

A request sequence is a finite list σ=(r1,…,rn)\sigma = (r_1, \dots, r_n)σ=(r1​,…,rn​) of points of MMM, presented one at a time; write σ≤j=(r1,…,rj)\sigma_{\le j} = (r_1, \dots, r_j)σ≤j​=(r1​,…,rj​) for the list of the first jjj requests (so σ≤0\sigma_{\le 0}σ≤0​ is the empty list).

A deterministic online algorithm AAA is a rule that, for every finite request sequence ℓ\ellℓ, specifies a configuration A(ℓ)A(\ell)A(ℓ) — where the servers stand after serving the requests of ℓ\ellℓ in order. In particular A(empty list)A(\text{empty list})A(empty list) is the initial configuration, before any request arrives. Two points about this way of modeling an algorithm:

  • Online and deterministic, by construction. The configuration after jjj requests is A(σ≤j)A(\sigma_{\le j})A(σ≤j​), a function of those first jjj requests only — the algorithm cannot see the future, and makes no random choices.
  • The service constraint. Whenever a request sequence ends with a request rrr, some server must stand at rrr immediately after: for every list ℓ\ellℓ and every point rrr, the configuration reached after serving ℓ\ellℓ followed by rrr places at least one server at the point rrr.

Running AAA on σ=(r1,…,rn)\sigma = (r_1, \dots, r_n)σ=(r1​,…,rn​) produces the configurations A(σ≤0), A(σ≤1), …, A(σ≤n)A(\sigma_{\le 0}),\, A(\sigma_{\le 1}),\, \dots,\, A(\sigma_{\le n})A(σ≤0​),A(σ≤1​),…,A(σ≤n​), and its cost is the total movement along this trajectory:

costA(σ)  =  ∑j=1nmoveCost(A(σ≤j−1), A(σ≤j)).\mathrm{cost}_A(\sigma) \;=\; \sum_{j=1}^{n} \mathrm{moveCost}\bigl(A(\sigma_{\le j-1}),\, A(\sigma_{\le j})\bigr).costA​(σ)=j=1∑n​moveCost(A(σ≤j−1​),A(σ≤j​)).

For comparison, an offline schedule for σ\sigmaσ starting at a configuration C0C_0C0​ is any sequence of configurations S0=C0,S1,…,SnS_0 = C_0, S_1, \dots, S_nS0​=C0​,S1​,…,Sn​ in which SjS_jSj​ places a server at the request rjr_jrj​, for each jjj — chosen with the whole of σ\sigmaσ known in advance. The optimal offline cost OPT(C0,σ)\mathrm{OPT}(C_0, \sigma)OPT(C0​,σ) is the infimum, over all such schedules, of the total movement ∑j=1nmoveCost(Sj−1,Sj)\sum_{j=1}^{n} \mathrm{moveCost}(S_{j-1}, S_j)∑j=1n​moveCost(Sj−1​,Sj​).

Finally, AAA is ccc-competitive if there is a constant aaa — depending on the algorithm, hence possibly on the metric space and the initial configuration, but never on the request sequence — with

costA(σ)  ≤  c⋅OPT(A(empty list), σ)+afor every request sequence σ.\mathrm{cost}_A(\sigma) \;\le\; c \cdot \mathrm{OPT}\bigl(A(\text{empty list}),\, \sigma\bigr) + a \qquad \text{for every request sequence } \sigma.costA​(σ)≤c⋅OPT(A(empty list),σ)+afor every request sequence σ.

Formalization targets

Goal — the kkk-server conjecture

For every k≥1, every metric space M, and every initial configuration C0: ∃ A starting at C0 that is k-competitive.\text{For every } k \ge 1,\ \text{every metric space } M,\ \text{and every initial configuration } C_0:\ \exists\, A \text{ starting at } C_0 \text{ that is } k\text{-competitive.}For every k≥1, every metric space M, and every initial configuration C0​: ∃A starting at C0​ that is k-competitive.

The goal fixes no algorithm: any kkk-competitive construction settles it. This is the weakest stable form of the conjecture — it survives every improvement in constants or techniques short of a disproof.

Milestones — the known ladder

The milestones are the classical results between the trivial and the conjectured, each an existence or impossibility statement over the same definitions: the lower bound c≥kc \ge kc≥k on any space with at least k+1k+1k+1 points; the conjecture for k=2k = 2k=2; for spaces of exactly k+1k+1k+1 points; for the real line; the (2k−1)(2k-1)(2k−1) upper bound of the Work Function Algorithm on every space; the conjecture for spaces of exactly k+2k+2k+2 points; the conjecture for three servers in the Manhattan plane (R2,ℓ1)(\mathbb{R}^2, \ell^1)(R2,ℓ1) — the one settled case over a genuinely two-dimensional continuum (Bein–Chrobak–Larmore 2002; reproved by the unifying potential of Coester–Koutsoupias 2021); Coester–Koutsoupias's 2021 result that the Work Function Algorithm itself — not just some algorithm — is 333-competitive for three servers on trees, stated over an explicit formalization of the WFA; and the 2023 Bubeck–Coester–Rabani refutation of the randomized analogue: there are (k+1)(k+1)(k+1)-point spaces on which every randomized algorithm is Ω(log⁡2k)\Omega(\log^2 k)Ω(log2k)-competitive, stated over a mixed-strategy model of randomized online algorithms.

Significance

A proof of the conjecture would close the founding problem of competitive analysis and pin down the exact power of determinism in online optimization over arbitrary metrics; a disproof would separate general metric spaces from every special class where the ratio kkk is known tight. Either outcome recalibrates the field's standard model of adversarial request sequences.

None of these results — not even the lower bound — has a machine-checked proof, and online algorithms as a subject are absent from Mathlib. This mission builds the base layer: a faithful model of online service systems (configurations, online algorithms as prefix functions, offline schedules, competitiveness), the classical possibility and impossibility results over it, and, at the top, the Koutsoupias–Papadimitriou bound, whose potential-function argument is self-contained but delicate. The model is reusable for paging, weighted caching, metrical task systems, and the randomized kkk-server problem.

Difficulty

The obvious first idea — the greedy algorithm, moving the nearest server to each request — is not competitive for any constant, already on three points of the line: two nearby points can ping-pong one server forever while a server parked slightly farther away never moves. Every known competitive algorithm must sometimes move a server other than the nearest one, and the whole difficulty of the conjecture is quantifying exactly how much such foresight-free hedging can achieve. The Work Function Algorithm's analysis via a potential over offline work functions loses a factor of two for reasons nobody has been able to remove; on the lower-bound side, no metric space is known where the deterministic ratio exceeds kkk.

Formalization scope

The Lean model commits to: configurations as functions Fin k → M (labeled servers — equivalent in cost to the unlabeled multiset model, since offline can permute labels for free); algorithms as total functions List M → (Fin k → M) with the service constraint, so a step may move several servers (the standard laziness reduction makes this equivalent to one-move-per-request); costs in ℝ via Metric.dist; the offline optimum as an sInf over schedules, which agrees with the attained minimum on finite spaces; and the additive-constant form of competitiveness, quantified as ∃ a, ∀ σ.

Two conventions guard against trivialization. The additive constant is quantified before the request sequence — allowing it to depend on σ\sigmaσ would make every algorithm 111-competitive. And the lower-bound milestone requires k+1k+1k+1 distinct points (Finset.card = k + 1); on spaces with at most kkk points the conjecture is trivially true and the lower bound false.

Three further definitional layers extend the model. The work function workFunction C₀ σ C is the sInf of (schedule cost + final move to C) over schedules serving σ from C₀, and the Work Function Algorithm WFA is defined on finite spaces with k ≥ 1 servers: after each request it moves to a configuration containing the request minimizing (movement cost) + (work function of the history including the request), a minimizer existing by finiteness and ties broken by a fixed arbitrary choice — matching the standard definition with its "ties broken arbitrarily" (our fixed choice is one admissible instance). A tree is a finite metric space carrying a tree graph whose weighted path lengths realize the metric — exactly "the set of vertices of a tree" of the sources. A randomized algorithm is a mixed strategy: a probability measure over an index type together with a deterministic algorithm per outcome and measurable per-sequence cost; its expected cost is a lower Lebesgue integral in [0,∞][0,\infty][0,∞], and ccc-competitiveness from C0C_0C0​ demands every outcome start at C0C_0C0​ and one additive constant work for all request sequences.

Welcome contributions: proofs of any milestone in any order (the lower bound and the (k+1)(k+1)(k+1)-point case are the natural entry points); alternative algorithms for milestones already closed; and infrastructure lemmas about moveCost, schedules, and work functions published as reusable platform theorems.

Selected references

  • M. Manasse, L. McGeoch, D. Sleator, Competitive algorithms for server problems, J. Algorithms 11 (1990). doi:10.1016/0196-6774(90)90003-W
  • A. Fiat, Y. Rabani, Y. Ravid, Competitive k-server algorithms, FOCS 1990. doi:10.1109/FSCS.1990.89566
  • M. Chrobak, H. Karloff, T. Payne, S. Vishwanathan, New results on server problems, SIAM J. Discrete Math. 4 (1991). doi:10.1137/0404017
  • M. Chrobak, L. Larmore, An optimal on-line algorithm for k servers on trees, SIAM J. Comput. 20 (1991). doi:10.1137/0220008
  • E. Koutsoupias, C. Papadimitriou, On the k-server conjecture, J. ACM 42 (1995). doi:10.1145/210118.210128
  • E. Koutsoupias, C. Papadimitriou, The 2-evader problem, Inf. Process. Lett. 57(5) (1996), 249–252.
  • C. Coester, E. Koutsoupias, Towards the k-server conjecture: a unifying potential, pushing the frontier to the circle, ICALP 2021. arXiv:2102.10474
  • S. Bubeck, C. Coester, Y. Rabani, The randomized k-server conjecture is false!, STOC 2023. arXiv:2211.05753
  • E. Koutsoupias, The k-server problem (survey), Computer Science Review 3 (2009). doi:10.1016/j.cosrev.2009.04.002
122 thms11 active usersReviewed
AlgebraAnalysisCombinatorics+3·Captain: Lucas

Formal Conjectures Portfolio: Bateman-Horn and CompanionsOpen Problem

1. Motivation

Wikipedia's pages on open problems are, for many mathematicians, the first contact with a conjecture: a one-paragraph statement, a short history, a list of partial results. The Formal Conjectures library (Google DeepMind, Apache-2.0) turned a large part of that material into Lean 4 statements, so that the conjectures can be attacked — and, just as importantly, stated unambiguously — by machine.

This mission ports a coherent slice of that material to Prove2Me. It is deliberately a portfolio mission: the goal theorem is the Bateman–Horn conjecture, the strongest single statement in the collection, and the milestone list gathers the other conjectures and the landmark theorems that surround them. Some milestones are genuine steps toward the goal (the Bunyakovsky conjecture is literally the one-polynomial case); most are independent open problems from other fields, grouped here because they share a source, a level of difficulty, and a need for faithful formal statements. A reader should not assume that proving a milestone advances the goal theorem. The mission's value is that every statement in it has been written against the same Mathlib revision, checked to compile, and documented well enough to be attacked.

A rough timeline of the collection's landmarks:

  • 1947 — Mills: a real A>1A>1A>1 with ⌊A3n⌋\lfloor A^{3^n}\rfloor⌊A3n⌋ always prime.
  • 1962 — Radó: the busy beaver function outgrows every computable function.
  • 1971 — Davies: planar Kakeya sets have Hausdorff dimension 222.
  • 1978 — Apéry: ζ(3)\zeta(3)ζ(3) is irrational.
  • 1985 — Read (after Enflo, 1981): an operator on ℓ1\ell^1ℓ1 with no nontrivial closed invariant subspace.
  • 2001 — Zudilin: one of ζ(5),ζ(7),ζ(9),ζ(11)\zeta(5),\zeta(7),\zeta(9),\zeta(11)ζ(5),ζ(7),ζ(9),ζ(11) is irrational.
  • 2002 — Mihăilescu: 888 and 999 are the only consecutive perfect powers (Catalan's conjecture).
  • 2009 / 2021 — Dvir; Bukh–Chao: the finite-field Kakeya bound and its sharp density constant.
  • 2021 — Gardam: Kaplansky's unit conjecture is false (its zero-divisor and idempotent companions remain open).
  • 2024 — Saito: Mills' constant is irrational; bbchallenge: BB(5)=47 176 870\mathrm{BB}(5)=47\,176\,870BB(5)=47176870.
  • 2025 — Wang–Zahl: the Kakeya set conjecture in R3\mathbb{R}^3R3.

2. Setting

The goal theorem concerns prime values of polynomials. Fix a finite set S={f1,…,fk}⊆Z[X]S=\{f_1,\dots,f_k\}\subseteq\mathbb{Z}[X]S={f1​,…,fk​}⊆Z[X] of distinct polynomials. Say that fff satisfies the Bunyakovsky condition if its leading coefficient is positive, deg⁡f≥1\deg f\ge 1degf≥1, and fff is irreducible over Z\mathbb{Z}Z; say that SSS satisfies the Schinzel condition if for every prime ppp there is an integer nnn with p∤f1(n)⋯fk(n)p\nmid f_1(n)\cdots f_k(n)p∤f1​(n)⋯fk​(n) — i.e. no fixed prime divides the product at every argument.

For a prime ppp let ωp(S)\omega_p(S)ωp​(S) be the number of residue classes n mod pn \bmod pnmodp at which some fif_ifi​ vanishes, let D=∏ideg⁡fiD=\prod_i \deg f_iD=∏i​degfi​, and let

πS(x)=#{ n≤x:∣fi(n)∣ is prime for every i }.\pi_S(x)=\#\{\,n\le x : |f_i(n)| \text{ is prime for every } i\,\}.πS​(x)=#{n≤x:∣fi​(n)∣ is prime for every i}.

The Bateman–Horn constant is the (conditionally convergent) Euler product

C=lim⁡N→∞ ∏p<N(1−1p)−k(1−ωp(S)p).C=\lim_{N\to\infty}\ \prod_{p<N}\Big(1-\tfrac1p\Big)^{-k}\Big(1-\tfrac{\omega_p(S)}{p}\Big).C=N→∞lim​ p<N∏​(1−p1​)−k(1−pωp​(S)​).

The other groups use their own vocabulary, each fixed in a definition item of this mission: Kakeya sets in Rn\mathbb{R}^nRn and over Fq\mathbb{F}_qFq​; Mills' property ⌊A3n⌋∈P\lfloor A^{3^n}\rfloor \in \mathbb{P}⌊A3n⌋∈P; Wagstaff primes and Catalan–Mersenne numbers; polynomial self-maps and their Jacobian matrix; nontrivial closed invariant subspaces; linear extensions of a finite poset; Catalan's constant; and an explicit two-symbol Turing machine model with its maximum-shifts function BB\mathrm{BB}BB.

3. Target

The goal theorem is the Bateman–Horn asymptotic: under the Bunyakovsky and Schinzel hypotheses, CCC exists and is positive and

πS(x) ∼ CD x(log⁡x)k(x→∞).\pi_S(x)\ \sim\ \frac{C}{D}\,\frac{x}{(\log x)^{k}}\qquad (x\to\infty).πS​(x) ∼ DC​(logx)kx​(x→∞).

Weaker statements in the same direction appear as milestones, first of all Bunyakovsky's conjecture: under the same hypotheses with k=1k=1k=1, fff takes prime values infinitely often. The remaining milestones are listed in the milestone panel and are grouped by subject: Diophantine equations (Brocard, Pillai, Lebesgue–Nagell, Catalan/Mihăilescu), Mersenne-type primality (New Mersenne, infinitude of Mersenne primes, Catalan–Mersenne), prime-representing constants (Mills), geometric measure theory (Kakeya in Rn\mathbb{R}^nRn, Kakeya over Fq\mathbb{F}_qFq​, Falconer), operator theory (invariant subspace problem and Read's ℓ1\ell^1ℓ1 counterexample), group algebras (Kaplansky's zero-divisor and idempotent conjectures), affine algebraic geometry (the two-variable Jacobian conjecture), irrationality and transcendence (ζ(5)\zeta(5)ζ(5), all odd zeta values, Zudilin's theorem, e+πe+\pie+π, eπe\pieπ, γ\gammaγ, Catalan's constant), order theory (the 1/31/31/3–2/32/32/3 conjecture), and computability (Radó's theorem).

4. Significance

The results themselves. Bateman–Horn is the quantitative form of Schinzel's hypothesis H: it contains the twin prime conjecture, the infinitude of primes of the form n2+1n^2+1n2+1, and Bunyakovsky as special cases, and it is the standard heuristic behind prime-counting predictions. The other targets are each the headline question of their area: whether every bounded Hilbert-space operator has an invariant subspace; whether group algebras of torsion-free groups are domains; whether Kakeya sets must have full dimension. The solved milestones (Mihăilescu, Davies, Dvir, Zudilin, Read, Saito, Radó) are landmarks whose formal proofs would be significant library contributions in their own right.

Formalizing them. None of the open statements is expected to fall here; the concrete deliverable is a set of faithful, compiling, reusable statements plus formal proofs of the solved milestones, most of which are not in Mathlib today. Several are realistically in reach: the finite-field Kakeya bound (Dvir's polynomial method is short), the elementary fact that π+e\pi+eπ+e and πe\pi eπe cannot both be algebraic, and Radó's diagonal argument.

5. Difficulty

For Bateman–Horn, the obstruction is visible already for k=1k=1k=1, deg⁡f=2\deg f = 2degf=2: sieve methods bound πS(x)\pi_S(x)πS​(x) from above by a constant times the conjectured main term and produce almost-primes, but the parity problem blocks every known sieve from producing a single prime value of an irreducible quadratic. The conditional convergence of the Euler product is a second, smaller trap: the product over p<Np<Np<N must be taken in order, so any reformulation as an unordered infinite product changes the statement.

Each other group has its own obstruction, and they do not transfer: the parity problem says nothing about Kakeya, where the difficulty is that dimension is not stable under the natural compactness arguments, nor about the invariant subspace problem, where the known counterexamples on ℓ1\ell^1ℓ1 show that no soft argument can work.

6. Formalization scope

Conventions this mission commits to, all fixed in the definition items:

  • Polynomials are elements of ℤ[X]; primality of a polynomial value is primality of its absolute value, and the counting function ranges over natural numbers n≤⌊x⌋n \le \lfloor x\rfloorn≤⌊x⌋.
  • The Bateman–Horn constant is the limit of the ordered partial products over p<Np<Np<N, not an unordered infinite product.
  • Kakeya sets carry no compactness or measurability hypothesis, matching the source; the conjecture is stated as an equality of Hausdorff dimensions in [0,∞][0,\infty][0,∞].
  • Falconer's hypothesis is written d<2dim⁡HEd < 2\dim_H Ed<2dimH​E to avoid division in [0,∞][0,\infty][0,∞].
  • Torsion-freeness of a group is spelled out as "every element of finite order is the identity", which is the hypothesis the source intends (it is weaker than Mathlib's IsMulTorsionFree).
  • Linear extensions are order-preserving bijections onto {0,…,∣P∣−1}\{0,\dots,|P|-1\}{0,…,∣P∣−1}, and probabilities are quotients of set cardinalities in Q\mathbb{Q}Q.
  • The busy beaver model is an explicit nnn-state, 222-symbol machine with a bi-infinite Boolean tape; BB\mathrm{BB}BB counts transitions performed (maximum shifts), the halting transition included, and BB(0)=0\mathrm{BB}(0)=0BB(0)=0.
  • Several source statements are phrased as "is XXX true?" with an unknown answer. Prove2Me statements must be definite, so each such question is recorded in its affirmative form (e.g. "e+πe+\pie+π is irrational"); a solver who can refute one should submit a disproof. The one question with no statable answer, "what is BB(6)\mathrm{BB}(6)BB(6)?", is replaced by Radó's growth theorem rather than guessed at.
  • Nothing here is vacuous: each hypothesis set is satisfiable (e.g. closed unit balls are Kakeya sets, and X2+1X^2+1X2+1 satisfies the Bunyakovsky and Schinzel conditions).

Contributions welcome: proofs of the solved milestones; sharper variants; and additional faithful statements from the same source library, which contains far more than fits in one mission.

7. Selected references

  • P. T. Bateman and R. A. Horn, A heuristic asymptotic formula concerning the distribution of prime numbers, Math. Comp. 16 (1962), 363–367. DOI
  • T. Radó, On non-computable functions, Bell System Tech. J. 41 (1962), 877–884. DOI
  • R. O. Davies, Some remarks on the Kakeya problem, Math. Proc. Cambridge Philos. Soc. 69 (1971), 417–421. DOI
  • C. J. Read, A solution to the invariant subspace problem on the space ℓ1\ell_1ℓ1​, Bull. London Math. Soc. 17 (1985), 305–317. DOI
  • K. Falconer, On the Hausdorff dimensions of distance sets, Mathematika 32 (1985), 206–212. DOI
  • W. Zudilin, One of the numbers ζ(5),ζ(7),ζ(9),ζ(11)\zeta(5),\zeta(7),\zeta(9),\zeta(11)ζ(5),ζ(7),ζ(9),ζ(11) is irrational, Russian Math. Surveys 56 (2001), 774–776. DOI
  • P. Mihăilescu, Primary cyclotomic units and a proof of Catalan's conjecture, J. reine angew. Math. 572 (2004), 167–195. DOI
  • Z. Dvir, On the size of Kakeya sets in finite fields, J. Amer. Math. Soc. 22 (2009), 1093–1097. DOI
  • B. Bukh and T.-W. Chao, Sharp density bounds on the finite field Kakeya problem, Discrete Analysis 26 (2021). DOI
  • G. Gardam, A counterexample to the unit conjecture for group rings, Ann. of Math. 194 (2021), 967–979. DOI
  • K. Saito, Mills' constant is irrational, Mathematika 71 (2025), e70027. arXiv:2404.19461
  • H. Wang and J. Zahl, Volume estimates for unions of convex sets, and the Kakeya set conjecture in three dimensions, arXiv:2502.17655
  • Google DeepMind, Formal Conjectures, Apache-2.0, github.com/google-deepmind/formal-conjectures

Provenance note. The Lean statements in this mission are adaptations of the Formal Conjectures library (Apache-2.0), rewritten to depend only on Mathlib and on this mission's own definition items, and checked to compile against the platform's Mathlib revision. Each draft item carries a read-back; those read-backs are non-blind — they were written by the same agent that drafted the statements, and each says so in its first line. They are documentation, not independent testimony.

81 thms8 active usersReviewed
Linear OptimizationOperations ResearchOptimization·Captain: ORdos

Smale's Ninth Problem: Strongly Polynomial Linear ProgrammingOpen Problem

The problem of solving linear inequalities

The linear feasibility problem takes a matrix A∈Rm×nA \in \mathbb{R}^{m\times n}A∈Rm×n and a vector b∈Rmb \in \mathbb{R}^mb∈Rm and asks whether the system of mmm linear inequalities in nnn real unknowns

{ x∈Rn∣Ax≥b }  ≠  ∅\{\,x \in \mathbb{R}^n \mid Ax \ge b\,\} \;\ne\; \emptyset{x∈Rn∣Ax≥b}=∅

has a solution. By linear programming duality, optimizing a linear objective over such a set reduces to feasibility, so this decision problem carries the whole complexity of linear programming.

What "polynomial time" means here depends on the machine. In the bit model the input is a list of rational numbers, its size LLL counts the bits of all numerators and denominators, and an algorithm is polynomial if it runs in time poly(m,n,L)\mathrm{poly}(m, n, L)poly(m,n,L). In the real-number model the input is a list of mn+mmn + mmn+m exact real numbers, each arithmetic operation (+,−,×,÷+, -, \times, \div+,−,×,÷), comparison, or memory move costs one unit, and a running time may only depend on mmm and nnn. An algorithm polynomial in this second sense is what Smale asks for; the closely related bit-model notion — poly(m,n)\mathrm{poly}(m,n)poly(m,n) arithmetic operations and polynomially bounded intermediate bit sizes — is called strongly polynomial. This mission fixes the real-number model precisely as a Blum–Shub–Smale (BSS) machine (Blum–Shub–Smale 1989): a finite program of instructions acting on a bi-infinite tape Z→R\mathbb{Z} \to \mathbb{R}Z→R of real registers — loads of arbitrary real machine constants, exact field arithmetic at fixed addresses, two-sided tape shifts, a sign-test branch, and accept/reject — with cost equal to the number of executed instructions. The convention that costs something: the program must be uniform, one finite instruction list serving every mmm, nnn, and every real instance. Uniformity is exactly what separates the question from point-location tricks available to non-uniform families of decision trees.

Why it matters

For optimization, the question is the last gap in the complexity of its central problem. Linear programs with combinatorial structure already admit strongly polynomial algorithms — Tardos (1986) solved every LP whose running time may depend on the entries of AAA but not on bbb or ccc, covering network flows and all {0,±1}\{0,\pm1\}{0,±1}-constraint problems — and a positive answer for general LP would extend that unification to the whole class, while explaining why simplex-type methods behave so well in practice (Spielman–Teng 2004).

For the theory of computation over the reals, the problem is a benchmark for what unit-cost exact arithmetic can do: it is Problem 9 on Smale's list of mathematical problems for the twenty-first century (Smale 1998), posed in the BSS model as the real-number analogue of the P-versus-NP style questions of that program, and it interacts with polyhedral combinatorics through the polynomial Hirsch conjecture: a polynomial bound on polytope diameters is a necessary condition for any polynomial pivot rule. A problem that calibrates both the practice of optimization and the foundations of real computation is a subject, not a special case.

The question and what is known

Question (Smale’s 9th).Is there a uniform BSS program deciding {x∣Ax≥b}≠∅ in poly(m,n) steps?\textbf{Question (Smale's 9th).}\quad \text{Is there a uniform BSS program deciding } \{x \mid Ax \ge b\} \ne \emptyset \text{ in } \mathrm{poly}(m,n) \text{ steps?}Question (Smale’s 9th).Is there a uniform BSS program deciding {x∣Ax≥b}=∅ in poly(m,n) steps?

The timeline splits into a negative branch (lower bounds against algorithm classes) and a positive branch (polynomial algorithms in weaker senses).

Lower bounds. Klee–Minty (1972) constructed a deformed cube on which Dantzig's largest-coefficient simplex rule visits all 2n2^n2n vertices; analogous exponential examples were later found for essentially every deterministic pivot rule, and randomized rules were driven to subexponential lower bounds by Friedmann–Hansen–Zwick (2011) — against upper bounds of exp⁡(O(nlog⁡n))\exp(O(\sqrt{n \log n}))exp(O(nlogn​)) from Kalai (1992) and Matoušek–Sharir–Welzl (1996). On the interior-point side, Allamigeon–Benchimol–Gaubert–Joswig (2018) showed by tropical methods that log-barrier path following is not strongly polynomial, and Allamigeon–Gaubert–Vandame (2022) extended this to every self-concordant barrier: no interior-point method of that class can settle the question positively.

Polynomial algorithms in weaker senses. Khachiyan (1979/80) proved LP feasibility is polynomial in the bit model via the ellipsoid method; Karmarkar (1984) and then Renegar (1988) brought interior-point methods to O(n L)O(\sqrt{n}\,L)O(n​L) iterations. Megiddo (1984) solved LP in linear time for every fixed dimension; Tardos (1986) gave the combinatorial strongly polynomial class; Vavasis–Ye (1996) and Dadush–Huiberts–Natura–Végh (2020) replaced the bit size by condition measures of AAA alone; Ye (2011) proved policy iteration strongly polynomial for fixed-discount Markov decision processes.

The central difficulty is visible in every positive result: each known iteration count is controlled by a scale-dependent quantity — bit length, condition number, barrier curvature — that is unbounded over the real instances with m,nm, nm,n fixed. The naive plan, "run the ellipsoid method and round", fails at its first step in the real model: the number of iterations needed to separate a feasible system from an infeasible one grows with the thinness of the feasible set, which is not a function of (m,n)(m, n)(m,n); no data-independent perturbation ε\varepsilonε exists when the data are arbitrary reals. All results above are proved on paper only; none has a machine-checked proof in the literature. What is already formalized, on this platform, is the substrate this mission builds on: the simplex iteration (mission Introduction to Linear Optimization IV), the ellipsoid method with its volume-halving correctness theorem (XI), interior-point path following (XII), and self-concordance with the barrier method (Convex Optimization VI).

A hierarchy of formalization targets

The mission's milestone list realizes this hierarchy in order; each level states what it deliberately leaves open.

Level 0 — the model works. A uniform BSS program decides one-variable feasibility in linear time:

∃ P, C  ∀m, ∀(a,b)∈Rm×Rm: P decides {x∈R∣aix≥bi ∀i}≠∅ within C(m+1) steps.\exists\,P,\,C\ \ \forall m,\ \forall (a,b) \in \mathbb{R}^m \times \mathbb{R}^m:\ P \text{ decides } \{x \in \mathbb{R} \mid a_i x \ge b_i\ \forall i\} \ne \emptyset \text{ within } C(m{+}1) \text{ steps}.∃P,C  ∀m, ∀(a,b)∈Rm×Rm: P decides {x∈R∣ai​x≥bi​ ∀i}=∅ within C(m+1) steps.

It fixes nothing about n≥2n \ge 2n≥2; its role is to certify that the machine model and cost semantics of the goal are non-vacuous.

Level 1 — the classical method is exponential. On the Klee–Minty cube, Dantzig's rule admits a run of

2n−1 pivots2^n - 1 \text{ pivots}2n−1 pivots

from the all-slack basis to the optimum. It leaves open all other pivot rules — extensions to further rules are welcome as strengthenings.

Level 2 — the bit model succeeds. Through the Cramer–Hadamard solution bound ∣xj∣≤n! Un|x_j| \le n!\,U^n∣xj​∣≤n!Un and the perturbation estimates, Khachiyan's theorem: for integer data bounded by UUU, every admissible ellipsoid run decides feasibility within

t∗≤106 (n+2)4(log⁡2U+n+2) iterations.t^* \le 10^6\,(n{+}2)^4(\log_2 U + n + 2) \text{ iterations}.t∗≤106(n+2)4(log2​U+n+2) iterations.

The generous constants are deliberate — only the polynomial order is load-bearing. This level leaves open exactly the dependence on log⁡U\log UlogU.

Level 3 — the goal (open). A uniform program with data-independent polynomial cost:

∃ P, C, d  ∀m,n,A,b: P decides {x∣Ax≥b}≠∅ within C (mn+m+2)d steps.\exists\,P,\,C,\,d\ \ \forall m, n, A, b:\ P \text{ decides } \{x \mid Ax \ge b\} \ne \emptyset \text{ within } C\,(mn + m + 2)^d \text{ steps}.∃P,C,d  ∀m,n,A,b: P decides {x∣Ax≥b}=∅ within C(mn+m+2)d steps.

The statement asserts only the shape of the truth — no hard-coded degree or constant — so it is stable under every future quantitative improvement. These levels do not exhaust the project: Tardos' combinatorial LP theorem, Ye's fixed-discount MDP result, and impossibility statements for restricted program classes in the style of Allamigeon–Gaubert–Vandame are natural later milestones.

Formalization scope

Polyhedra, simplex states, pivots, and ellipsoid runs are the platform's existing LinearOptimization development over Matrix (Fin m) (Fin n) ℝ, with {x∣Ax≥b}\{x \mid Ax \ge b\}{x∣Ax≥b} as polyhedron A b; algorithms with data-dependent iteration counts are formalized as run predicates, as in the parent missions. The new SmaleNinth definitions supply what the goal genuinely needs and the run-predicate style cannot express: a concrete inductive type of BSS programs with operational semantics and unit-cost accounting, the Klee–Minty data with Dantzig's rule, and the explicit Khachiyan constants. One convention closes the degenerate escape hatch: the goal quantifies over finite BSSProgram terms under the fixed encodeLP input convention — formalizing "algorithm" as an arbitrary function Rmn+m→Bool\mathbb{R}^{mn+m} \to \mathrm{Bool}Rmn+m→Bool would make the statement trivially true and is not the theorem. Division is totalized as x/0=0x/0 = 0x/0=0 and the branch test is xi≤0x_i \le 0xi​≤0; both are benign for the class of programs quantified over.

The machine module is infrastructure beyond this mission — any real-number complexity statement (other Smale problems, sums-of-square-roots, BSS-completeness) can reuse it, as can any pivot-rule lower bound reuse the Klee–Minty module. Formalization forces distinctions the literature leaves informal: which machine variant carries the unit-cost claim, how ties in Dantzig's rule are resolved, and which of the interchangeable Khachiyan constants each estimate actually needs. Welcome contributions include proofs of any milestone, alternative exponential instances for other pivot rules, sharper constants in the Khachiyan module, and ports of the known strongly polynomial special cases.

Selected references

  • L. Blum, M. Shub, S. Smale, On a theory of computation and complexity over the real numbers, Bull. AMS 21(1):1–46, 1989. DOI
  • S. Smale, Mathematical problems for the next century, Math. Intelligencer 20(2):7–15, 1998. DOI
  • V. Klee, G. J. Minty, How good is the simplex algorithm?, in Inequalities III, Academic Press, 1972, pp. 159–175.
  • L. G. Khachiyan, Polynomial algorithms in linear programming, USSR Comput. Math. Math. Phys. 20:53–72, 1980. DOI
  • N. Karmarkar, A new polynomial-time algorithm for linear programming, Combinatorica 4:373–395, 1984. DOI
  • J. Renegar, A polynomial-time algorithm, based on Newton's method, for linear programming, Math. Programming 40:59–93, 1988. DOI
  • É. Tardos, A strongly polynomial algorithm to solve combinatorial linear programs, Oper. Res. 34(2):250–256, 1986. DOI
  • N. Megiddo, Linear programming in linear time when the dimension is fixed, J. ACM 31(1):114–127, 1984. DOI
  • G. Kalai, A subexponential randomized simplex algorithm, STOC 1992. DOI
  • O. Friedmann, T. D. Hansen, U. Zwick, Subexponential lower bounds for randomized pivoting rules for the simplex algorithm, STOC 2011. DOI
  • D. A. Spielman, S.-H. Teng, Smoothed analysis of algorithms: why the simplex algorithm usually takes polynomial time, J. ACM 51(3):385–463, 2004. DOI
  • S. A. Vavasis, Y. Ye, A primal-dual interior point method whose running time depends only on the constraint matrix, Math. Programming 74:79–120, 1996. DOI
  • Y. Ye, The simplex and policy-iteration methods are strongly polynomial for the Markov decision problem with a fixed discount rate, Math. Oper. Res. 36(4):593–603, 2011. DOI
  • X. Allamigeon, P. Benchimol, S. Gaubert, M. Joswig, Log-barrier interior point methods are not strongly polynomial, SIAM J. Appl. Algebra Geom. 2(1):140–178, 2018. DOI
  • X. Allamigeon, S. Gaubert, N. Vandame, No self-concordant barrier interior point method is strongly polynomial, STOC 2022. arXiv
  • D. Dadush, S. Huiberts, B. Natura, L. A. Végh, A scaling-invariant algorithm for linear programming whose running time depends only on the constraint matrix, STOC 2020. arXiv
  • D. Bertsimas, J. N. Tsitsiklis, Introduction to Linear Optimization, Athena Scientific, 1997 (Chapters 3, 8, 9 — formalized in the Introduction to Linear Optimization mission series).
  • B. Korte, J. Vygen, Combinatorial Optimization: Theory and Algorithms, 6th ed., Springer, 2018, §4.1–4.5.
29 thms6 active usersReviewed
Captain: xuanji

AlphaEvolve Eighth-Power Bound: omega < 2.371177Research Paper

Formalize ω<2.371177\omega < 2.371177ω<2.371177, the current record from Dupont, Eisenberger, Kozlovskii, Mehrabian, Ruiz, See, Zhou, Alman, Vassilevska Williams and Balog (arXiv:2608.16884, August 2026).

The paper applies the combination-loss laser method of Alman et al. (arXiv:2404.16349), formalized here as the ω<2.37134\omega < 2.37134ω<2.37134 entry, to CW5⊗8CW_5^{\otimes 8}CW5⊗8​. That is level ℓ∗=4\ell^* = 4ℓ∗=4 instead of 3, with an exact rational certificate of about 7⋅1067\cdot 10^67⋅106 parameters found by gradient-based optimization and AlphaEvolve. The authors state that the solution and verification code are being prepared for release.

6 thms5 active usersReviewed
Computational GeometryLinear OptimizationOperations Research·Captain: mikedeng1

Linear Programming in Linear Time When the Dimension Is Fixed: Fixed-Dimension LP Feasibility Decided in Linear Time on the Real RAMResearch Paper

Motivation

A linear program asks for a point x∈Rdx\in\mathbb{R}^dx∈Rd minimizing cTxc^TxcTx subject to nnn linear inequalities ∑j=1daijxj≥bi\sum_{j=1}^d a_{ij}x_j\ge b_i∑j=1d​aij​xj​≥bi​. Many problems in computational geometry and statistics are linear programs with few variables and very many constraints: separating two point sets by a line or plane, fitting a line in the Chebyshev (L∞L_\inftyL∞​) norm, finding the smallest disk or ball containing a point set (a related convex problem). For these problems the number of variables ddd is a small constant, and what matters is how the running time grows with nnn.

Nimrod Megiddo showed that for every fixed ddd the problem can be solved in time C(d)⋅nC(d)\cdot nC(d)⋅n (J. ACM 31(1), 1984).

Timeline.

  • 1983. Megiddo (SIAM J. Comput. 12) and, independently, Dyer (SIAM J. Comput. 13 (1984)) give linear-time algorithms for d=2d=2d=2 and d=3d=3d=3.
  • 1984. Megiddo extends the method to every fixed ddd, with C(d)<22d+2C(d)<2^{2^{d+2}}C(d)<22d+2 (the paper formalized here).
  • 1988–1991. Clarkson (J. ACM 42 (1995), conference version 1988) gives a randomized algorithm with expected time O(d2n)+dO(d)log⁡nO(d^2n)+d^{O(\sqrt d)}\log nO(d2n)+dO(d​)logn. Seidel (Discrete Comput. Geom. 6 (1991)) gives a simple randomized O(d! n)O(d!\,n)O(d!n) algorithm.
  • 1992–1996. Matoušek, Sharir and Welzl and, independently, Kalai give subexponential randomized bounds. Chazelle and Matoušek derandomize the linear dependence with C(d)=dO(d)C(d)=d^{O(d)}C(d)=dO(d) (J. Algorithms 21 (1996)).

Setting

Fix ddd. An instance is a matrix A∈Rn×dA\in\mathbb{R}^{n\times d}A∈Rn×d and a vector b∈Rnb\in\mathbb{R}^nb∈Rn, and its feasible region is the polyhedron P(A,b)={x∈Rd:Ax≥b}P(A,b)=\{x\in\mathbb{R}^d: Ax\ge b\}P(A,b)={x∈Rd:Ax≥b}. Here nnn is the number of constraints and ddd the number of variables.

The model of computation is the real RAM. A program is a finite list of instructions acting on real registers, integer pointer registers and a memory Z→R\mathbb{Z}\to\mathbb{R}Z→R. It performs exact +,−,×,/+,-,\times,/+,−,×,/ on reals at unit cost, tests the sign of a real, sets, copies, increments, decrements and compares pointers, and loads and stores through pointers. The input is the standard encoding of (A,b)(A,b)(A,b) in memory: the numbers nnn and ddd, then AAA row by row, then bbb. A program decides an instance within TTT steps with output β∈{accept,reject}\beta\in\{\text{accept},\text{reject}\}β∈{accept,reject} if it halts on that output after at most TTT steps.

Megiddo's method rests on multidimensional search. There is an unknown point x∗∈Rdx^*\in\mathbb{R}^dx∗∈Rd and an oracle that, for any hyperplane {x:aTx=b}\{x: a^Tx=b\}{x:aTx=b}, answers whether aTx∗<ba^Tx^*<baTx∗<b, =b=b=b or >b>b>b. Given hyperplanes Hi={aiTx=bi}H_i=\{a_i^Tx=b_i\}Hi​={aiT​x=bi​} with ai≠0a_i\ne0ai​=0, the question is how many oracle calls determine the position of x∗x^*x∗ relative to all of them. A search strategy is a ternary decision tree: inner nodes are hyperplane queries, leaves carry outputs, and the tree is built from the data alone. For linear programming, x∗x^*x∗ is an optimal solution, or a minimizer of the infeasibility function f(x)=max⁡i(bi−aiTx)f(x)=\max_i(b_i-a_i^Tx)f(x)=maxi​(bi​−aiT​x) when the system is infeasible. The oracle is implemented by solving problems in d−1d-1d−1 variables.

Formalization targets

Goal: linear-time feasibility on the real RAM

∀d ∃R ∃C ∀n ∀A∈Rn×d, b∈Rn:R decides within C (n+1) steps whether {x:Ax≥b}≠∅.\forall d\ \exists R\ \exists C\ \forall n\ \forall A\in\mathbb{R}^{n\times d},\,b\in\mathbb{R}^n:\quad R\text{ decides within }C\,(n+1)\text{ steps whether } \{x: Ax\ge b\}\neq\emptyset.∀d ∃R ∃C ∀n ∀A∈Rn×d,b∈Rn:R decides within C(n+1) steps whether {x:Ax≥b}=∅.

The program and the constant depend on ddd only. No explicit form of C(d)C(d)C(d) is fixed.

Milestones

  1. One query settles half of nnn hyperplanes on the line (A(1)=1A(1)=1A(1)=1, B(1)=12B(1)=\tfrac12B(1)=21​).
  2. v(ϵ)=(1,ϵ,…,ϵd−1)v(\epsilon)=(1,\epsilon,\dots,\epsilon^{d-1})v(ϵ)=(1,ϵ,…,ϵd−1) is orthogonal to some aia_iai​ for at most n(d−1)n(d-1)n(d−1) values of ϵ\epsilonϵ, so there is a basis in which all aij≠0a_{ij}\ne0aij​=0.
  3. For hyperplanes of opposite slopes in the (x1,x2)(x_1,x_2)(x1​,x2​) plane, the answers for Hik(1)H^{(1)}_{ik}Hik(1)​ and Hik(2)H^{(2)}_{ik}Hik(2)​ settle one of HiH_iHi​, HkH_kHk​.
  4. A linearly dependent pair of opposite slopes has ai1=ak1=0a_{i1}=a_{k1}=0ai1​=ak1​=0, and the middle hyperplane settles one of them.
  5. Approach I: 2d−12^{d-1}2d−1 queries settle at least ⌊21−2dn⌋\lfloor 2^{1-2^d}n\rfloor⌊21−2dn⌋ hyperplanes.
  6. C(d)log⁡nC(d)\log nC(d)logn queries settle all nnn hyperplanes.
  7. If a hyperplane contains no optimal point, all optimal points lie on one side of it.
  8. The oracle, Case I: at an optimum relative to {xd=0}\{x_d=0\}{xd​=0}, two auxiliary systems decide the side or certify global optimality.
  9. The oracle, Case II: at a minimizer of fff on {xd=0}\{x_d=0\}{xd​=0}, systems (1) and (2) decide the side or certify infeasibility.

Significance

The result. For every fixed dimension, linear programming is solvable in time linear in the number of constraints. The algorithm is also strongly polynomial in fixed dimension: its operation count does not depend on the bit size of the data. Deciding whether the optimum is at most ttt is feasibility of Ax≥bAx\ge bAx≥b together with −cTx≥−t-c^Tx\ge-t−cTx≥−t, so the goal also covers the decision form of optimization. The prune-and-search technique of the paper, which discards a constant fraction of the constraints per round, became a standard tool of computational geometry.

Formalizing it. The result is proved and classical. The platform already has the cases d=1d=1d=1 (linear time) and d=2d=2d=2 (quadratic time, by Fourier–Motzkin elimination) on the same machine and input encoding (SmaleNinth.real_ram_decides_one_variable_lp_linear, SmaleNinth.real_ram_decides_two_variable_lp_quadratic). No machine-checked proof of the general statement is known. The work consists of the query-complexity layer (milestones 1–6), the convex-analytic correctness of the oracle (milestones 7–9), and a real-RAM implementation with a step count linear in nnn, including linear-time median selection. Alternative proofs, for example through Clarkson's or Seidel's algorithms made deterministic, are welcome for the goal.

Difficulty

The obvious approach is to find the optimum by testing constraints one by one or by eliminating variables. Fourier–Motzkin elimination produces Θ(n2)\Theta(n^2)Θ(n2) constraints after one step. Pivoting methods have no known bound linear in nnn. The key difficulty is to discard a constant fraction of the constraints using only a constant number of recursive calls in dimension d−1d-1d−1, when no single hyperplane test gives information about more than one constraint. The multidimensional search layer gives this, and it is where the pairing of hyperplanes by slope and the degenerate cases (dependent pairs, zero coefficients) have to be handled exactly. At the machine level, the step count must stay linear in nnn for a fixed program, so every median selection and every recursive call must be implemented within the budget, with the recursion depth depending on ddd only.

Formalization scope

  • Machine and input. The machine is the platform's real RAM SmaleNinth.RAMProgram with RAMDecidesInTime, and the input convention is SmaleNinth.encodeLP (published definitions, reused unchanged). No instruction is added: there is no LP, median, floor or sort primitive. Time is the number of machine steps.
  • Quantifier order. ∀d ∃R ∃C ∀n,A,b\forall d\ \exists R\ \exists C\ \forall n, A, b∀d ∃R ∃C ∀n,A,b. The bound is C(n+1)C(n+1)C(n+1) in the number nnn of constraints, so that the machine can halt at n=0n=0n=0. The paper's C(d)<22d+2C(d)<2^{2^{d+2}}C(d)<22d+2 counts unspecified units of "effort" with an unquantified θ(nd)\theta(nd)θ(nd) term, and it is not transferred to machine steps. Where a milestone's proof fixes a constant exactly, the constant is stated: 2d−12^{d-1}2d−1 queries and ⌊n/22d−1⌋\lfloor n/2^{2^d-1}\rfloor⌊n/22d−1⌋ settled hyperplanes in milestone 5.
  • Feasibility only. The machine outputs accept or reject. Returning an optimizer, "unbounded", or a minimizer of fff is not part of the goal. The case d=0d=0d=0 is included.
  • Query trees. Nodes are queries compare (a ⬝ᵥ x) b and nothing else, leaves hold fixed values, and correctness is required for every xxx. A tree over arbitrary tests of xxx would make milestones 5 and 6 empty, and it is excluded by the definition.
  • Indices. The paper's x1,x2x_1,x_2x1​,x2​ are indices 0, 1 of Fin (d + 2), and its xdx_dxd​ is Fin.last d of Fin (d + 1).
  • Corrections. Two passages of §4 are stated in corrected form. The Case I auxiliary objective includes the ±cd\pm c_d±cd​ term of the direction. In Case II, feasibility of (1) puts improvement in {xd>0}\{x_d>0\}{xd​>0}, where the page's last sentence says {xd<0}\{x_d<0\}{xd​<0}. The pairing claim carries ak1ai2−ak2ai1≠0a_{k1}a_{i2}-a_{k2}a_{i1}\ne0ak1​ai2​−ak2​ai1​=0, the hypothesis its argument uses, since linear independence alone does not give it.
  • Not included. Approach II and its bound O(n(log⁡n)d2)O(n(\log n)^{d^2})O(n(logn)d2), the remarks on slowly growing ddd, the randomized variants, and the applications of §1.
  • Reusable parts. The query-tree definition and milestones 1–6 apply to any prune-and-search problem with a hyperplane oracle. The oracle lemmas (7–9) are statements about convex piecewise-linear functions and polyhedra.

Selected references

  • N. Megiddo, Linear programming in linear time when the dimension is fixed, J. ACM 31(1):114–127, 1984. https://doi.org/10.1145/2422.322418
  • N. Megiddo, Linear-time algorithms for linear programming in R3R^3R3 and related problems, SIAM J. Comput. 12(4):759–776, 1983. https://doi.org/10.1137/0212052
  • M. E. Dyer, Linear time algorithms for two- and three-variable linear programs, SIAM J. Comput. 13(1):31–45, 1984. https://doi.org/10.1137/0213003
  • K. L. Clarkson, Las Vegas algorithms for linear and integer programming when the dimension is small, J. ACM 42(2):488–499, 1995. https://doi.org/10.1145/201019.201036
  • R. Seidel, Small-dimensional linear programming and convex hulls made easy, Discrete Comput. Geom. 6:423–434, 1991. https://doi.org/10.1007/BF02574699
  • B. Chazelle, J. Matoušek, On linear-time deterministic algorithms for optimization problems in fixed dimension, J. Algorithms 21(3):579–597, 1996. https://doi.org/10.1006/jagm.1996.0046
16 thms5 active usersReviewed
Quantum Information·Captain: Goku

Stabilizer Rank of Magic StatesOpen Problem

Motivation

Quantum circuits built from Clifford gates alone are classically simulable in polynomial time. Universality is recovered by adding copies of a magic state, and the fastest known classical simulators of such circuits work by writing the magic-state input as a short linear combination of stabilizer states. The length of the shortest such combination -- the stabilizer rank -- is therefore the exponent governing classical simulation of quantum computation in this model, and lower bounds on it are among the very few unconditional obstructions to classical simulation available at all.

A timeline of what is established for the standard magic state ∣H⟩|H\rangle∣H⟩:

  • 2016. Bravyi, Smith and Smolin exhibit a decomposition giving χ(∣H⊗6⟩)≤7\chi(|H^{\otimes 6}\rangle)\le 7χ(∣H⊗6⟩)≤7, hence χ(∣H⊗n⟩)≤7 n/6≤2 0.468n\chi(|H^{\otimes n}\rangle)\le 7^{\,n/6}\le 2^{\,0.468n}χ(∣H⊗n⟩)≤7n/6≤20.468n, and prove a lower bound of order n\sqrt{n}n​.
  • 2020. Huang, Newman and Szegedy show that hardness assumptions stronger than P≠NP\mathrm{P}\neq\mathrm{NP}P=NP, such as the exponential time hypothesis, imply χ(∣H⊗n⟩)=2Ω(n)\chi(|H^{\otimes n}\rangle)=2^{\Omega(n)}χ(∣H⊗n⟩)=2Ω(n) (arXiv link).
  • 2022. Peleg, Shpilka and Volk improve the unconditional lower bound to Ω(n)\Omega(n)Ω(n) and give the first non-trivial bound for the approximate rank (arXiv:2106.03214).
  • 2024. A quadratic lower bound is obtained for the approximate stabilizer rank (arXiv:2305.10277).

Between the linear unconditional lower bound and the 20.468n2^{0.468n}20.468n upper bound lies the open problem this mission targets.

Setting

Index the computational basis of an nnn-qubit system by bit strings x∈{0,1}nx\in\{0,1\}^nx∈{0,1}n, so a state is a vector ψ∈C2n\psi\in\mathbb{C}^{2^n}ψ∈C2n with coordinates ψ(x)\psi(x)ψ(x).

The Pauli operators are XaZbX^aZ^bXaZb for a,b∈{0,1}na,b\in\{0,1\}^na,b∈{0,1}n, acting by XaZb∣x⟩=(−1) b⋅x∣x⊕a⟩X^aZ^b|x\rangle=(-1)^{\,b\cdot x}|x\oplus a\rangleXaZb∣x⟩=(−1)b⋅x∣x⊕a⟩, where b⋅xb\cdot xb⋅x counts the coordinates on which both are 111 and ⊕\oplus⊕ is bitwise addition; the Pauli group is the set of 4⋅4n4\cdot 4^n4⋅4n operators icXaZbi^cX^aZ^bicXaZb. A unitary UUU is a Clifford unitary when UPU†UPU^\daggerUPU† lies in the Pauli group for every Pauli group element PPP, and a stabilizer state is a vector U∣0⋯0⟩U|0\cdots0\rangleU∣0⋯0⟩ for some Clifford UUU. There are 2n∏k=1n(2k+1)2^n\prod_{k=1}^{n}(2^k+1)2n∏k=1n​(2k+1) of them up to phase -- six for a single qubit.

The stabilizer rank χ(ψ)\chi(\psi)χ(ψ) is the least rrr admitting coefficients c1,…,cr∈Cc_1,\dots,c_r\in\mathbb{C}c1​,…,cr​∈C and stabilizer states φ1,…,φr\varphi_1,\dots,\varphi_rφ1​,…,φr​ with ψ=∑j≤rcjφj\psi=\sum_{j\le r}c_j\varphi_jψ=∑j≤r​cj​φj​.

The magic state is ∣H⟩=cos⁡(π/8)∣0⟩+sin⁡(π/8)∣1⟩|H\rangle=\cos(\pi/8)|0\rangle+\sin(\pi/8)|1\rangle∣H⟩=cos(π/8)∣0⟩+sin(π/8)∣1⟩, and ∣H⊗n⟩|H^{\otimes n}\rangle∣H⊗n⟩ its nnn-fold tensor power, with coordinates cos⁡(π/8) n−∣x∣sin⁡(π/8) ∣x∣\cos(\pi/8)^{\,n-|x|}\sin(\pi/8)^{\,|x|}cos(π/8)n−∣x∣sin(π/8)∣x∣ where ∣x∣|x|∣x∣ is the Hamming weight of xxx.

Target

The goal is a super-polynomial lower bound: for every exponent ddd and constant CCC there exists nnn with

χ(∣H⊗n⟩)  >  C nd,\chi\bigl(|H^{\otimes n}\rangle\bigr)\;>\;C\,n^{d},χ(∣H⊗n⟩)>Cnd,

equivalently, χ(∣H⊗n⟩)\chi(|H^{\otimes n}\rangle)χ(∣H⊗n⟩) is not O(nd)O(n^d)O(nd) for any fixed ddd.

Stronger statements are expected but are deliberately not the goal. An exponential bound χ=2Ω(n)\chi=2^{\Omega(n)}χ=2Ω(n) is believed and follows from hardness assumptions, but a goal naming a specific growth rate would be superseded by the next improvement; super-polynomiality is the weakest statement that settles the question of principle.

Significance

The result itself. A super-polynomial lower bound would unconditionally rule out efficient classical simulation of Clifford-plus-magic-state circuits by stabilizer decomposition, currently the leading such technique. The converse direction shows how much is at stake: a polynomial upper bound on χ(∣H⊗n⟩)\chi(|H^{\otimes n}\rangle)χ(∣H⊗n⟩) would imply BPP=BQP\mathrm{BPP}=\mathrm{BQP}BPP=BQP, and via postselection P=NP\mathrm{P}=\mathrm{NP}P=NP. There is also a purely classical payoff -- improving the known bound even to super-linear would produce a Boolean function computable in polynomial time requiring a super-linear number of summands in any decomposition into exponentials of quadratic forms over F2\mathbb{F}_2F2​, resolving a separate open question.

Formalizing it. The goal is open, so no known proof is being transcribed. What the mission produces is a machine-checked statement of the problem together with formalizations of the established bounds, none of which has a machine-checked proof anywhere. It also produces the first Pauli/Clifford/stabilizer layer in Lean: no existing Lean library contains the nnn-qubit Pauli group, the Clifford group, or stabilizer states, and that layer is reusable for stabilizer error correction, magic monotones, and Clifford simulation generally.

Difficulty

Counting settles the problem for random states: the stabilizer states are too few for short combinations to cover a generic state, so almost every state has exponential stabilizer rank. This says nothing about ∣H⊗n⟩|H^{\otimes n}\rangle∣H⊗n⟩, which is a single explicit, highly structured vector, and the entire difficulty is that lower bounds must be proved for that specific state rather than for a typical one. Every newcomer proposes the counting argument; it does not apply.

The known techniques reduce the question to statements about decompositions of explicit Boolean functions into quadratic-form exponentials, and the barrier is quantitative: the available arguments lose a factor that caps them at linear bounds. The source of the current record documents explicitly why its method cannot pass super-linear, and the fact that going beyond linear would resolve an independent open problem in Boolean function complexity indicates the obstruction is not merely technical.

Formalization scope

State vectors are functions {0,1}n→C\{0,1\}^n\to\mathbb{C}{0,1}n→C and are not required to be normalised; normalisation does not affect the rank, and stabilizer states are unit vectors automatically as Clifford images of ∣0⋯0⟩|0\cdots0\rangle∣0⋯0⟩. The Pauli group is given by the explicit parametrisation icXaZbi^cX^aZ^bicXaZb rather than an abstract presentation, and the Clifford group is characterised as its unitary normaliser, equivalent to the usual generated-by-H,S,CNOTH,S,\mathrm{CNOT}H,S,CNOT description. Because eiθUe^{i\theta}UeiθU normalises the Pauli group whenever UUU does, the stabilizer states are closed under global phase; this is harmless, as the coefficients are arbitrary complex numbers.

One trivialising reading must be excluded. The rank is defined as an infimum over a set of natural numbers, and Lean gives the empty infimum the value 000; if no decomposition existed the rank would be 000 for every state and the goal would be false rather than merely unproved. The milestone χ(ψ)≤2n\chi(\psi)\le 2^nχ(ψ)≤2n is what certifies the set is nonempty, making the rank a genuine minimum, and it should be proved first. Separately, the goal quantifies CCC over all reals including negative values, for which the inequality is trivially satisfiable; the content lies in large positive CCC.

A complete development needs, beyond the published definitions, the correspondence between stabilizer states and affine subspaces carrying quadratic phase functions, on which all known lower-bound arguments rest. Contributions of any milestone are welcome, as are function-level reformulations of the rank and the equivalent characterisation of stabilizer states via maximal abelian Pauli subgroups.

Selected references

  • S. Peleg, A. Shpilka, B. L. Volk, Lower Bounds on Stabilizer Rank, Quantum 6 (2022) 652; arXiv:2106.03214.
  • S. Bravyi, G. Smith, J. Smolin, Trading Classical and Quantum Computational Resources, Phys. Rev. X 6 (2016) 021043; arXiv:1506.01396.
  • C. Huang, M. Newman, M. Szegedy, Explicit Lower Bounds on Strong Quantum Simulation, IEEE Trans. Inf. Theory 66(9) (2020) 5585--5600.
  • Quadratic Lower Bounds on the Approximate Stabilizer Rank: A Probabilistic Approach, STOC 2024; arXiv:2305.10277.
5 thms4 active usersReviewed
CombinatoricsOperations ResearchProbability·Captain: mikedeng1

A Polylogarithmic-Competitive Algorithm for the k-Server Problem: Randomized k-Server Is O(log² k · log³ n · log log n)-Competitive on Every n-Point MetricResearch Paper

Motivation

The k-server problem (Manasse, McGeoch and Sleator, 1990) is the central problem of online computation: kkk servers sit on points of a metric space, requests arrive one at a time at points of the space, and each request must be served by moving a server to it, at a cost equal to the distance travelled. An online algorithm decides without knowing future requests; its quality is its competitive ratio, the worst-case ratio between its cost and the cost of an optimal offline schedule. Paging (caching) is the special case of a uniform metric, and weighted paging the case of a weighted star.

Timeline of the upper bounds for general metrics:

  • 1990: Manasse, McGeoch and Sleator prove that every deterministic algorithm has ratio at least kkk and conjecture that kkk is achievable.
  • 1991: Fiat, Rabani and Ravid give the first ratio depending on kkk only (exponential in kkk).
  • 1995: Koutsoupias and Papadimitriou prove that the work function algorithm is (2k−1)(2k-1)(2k−1)-competitive.
  • For randomized algorithms against an oblivious adversary, the conjectured answer is O(log⁡k)O(\log k)O(logk), achieved for paging (Fiat et al., 1991), but until 2011 nothing better than the deterministic 2k−12k-12k−1 was known for general metrics, even when the ratio may depend on the number of points nnn.
  • 2011: Bansal, Buchbinder, Mądry and Naor give the first polylogarithmic bound, O(log⁡2klog⁡3nlog⁡log⁡n)O(\log^2 k\log^3 n\log\log n)O(log2klog3nloglogn) (arXiv:1110.1580; J. ACM 62(5), 2015, DOI 10.1145/2783434), the result of this mission.

Setting

Let (M,dist)(M,\mathrm{dist})(M,dist) be a finite metric space with nnn points and kkk a number of servers. A configuration C:{1,…,k}→MC:\{1,\dots,k\}\to MC:{1,…,k}→M places server iii at C(i)C(i)C(i). A deterministic online algorithm maps each prefix of the request sequence to a configuration that has a server at the last request; its cost on a sequence ρ\rhoρ is the total distance travelled. OPT(C0,ρ)\mathrm{OPT}(C_0,\rho)OPT(C0​,ρ) is the least cost of any schedule serving ρ\rhoρ from the initial configuration C0C_0C0​. A randomized algorithm is a probability distribution over deterministic online algorithms, all starting at C0C_0C0​; it is ccc-competitive if there is a constant aaa such that its expected cost on every request sequence ρ\rhoρ is at most c⋅OPT(C0,ρ)+ac\cdot\mathrm{OPT}(C_0,\rho)+ac⋅OPT(C0​,ρ)+a.

The paper works with three auxiliary objects. A σ-HST is a rooted tree whose leaves are the points, in which all edges from a node to its children have one common length, equal to 1/σ1/\sigma1/σ times the length of the edge above that node; the distance between two leaves is the length of the tree path. A weighted σ-HST only requires that the edge above a non-root internal node be at least σ\sigmaσ times each edge below it. In the fractional k-server problem on a tree, the state is a vector xxx of server probabilities on the leaves with 0≤xi≤10\le x_i\le10≤xi​≤1 and ∑ixi=k\sum_i x_i=k∑i​xi​=k, a request at leaf iii forces xi=1x_i=1xi​=1, and moving from xxx to x′x'x′ costs ∑vW(v) ∣xv′−xv∣\sum_v W(v)\,|x'_v-x_v|∑v​W(v)∣xv′​−xv​∣, where xvx_vxv​ is the mass below node vvv and W(v)W(v)W(v) the length of the edge above vvv. In the allocation problem on a weighted star with weights wiw_iwi​, requests carry a location iti^tit, a monotone cost vector ht(0)≥⋯≥ht(k)≥0h^t(0)\ge\dots\ge h^t(k)\ge0ht(0)≥⋯≥ht(k)≥0 (the cost of serving with jjj servers there) and a server quota κ(t)≤k\kappa(t)\le kκ(t)≤k.

Formalization targets

Goal: Theorem 1

There is a universal constant C>0C>0C>0 such that for all k≥2k\ge2k≥2, every metric space MMM with n≥3n\ge3n≥3 points and every initial configuration C0C_0C0​, some randomized online algorithm starting at C0C_0C0​ is

C log⁡2k log⁡3n log⁡log⁡n-competitive.C\,\log^2 k\,\log^3 n\,\log\log n\text{-competitive.}Clog2klog3nloglogn-competitive.

Milestones

In the order the proof uses them:

  1. Claim 15: the fix-stage inequality behind the allocation algorithm's analysis.
  2. Theorem 5: for every 0<ε≤10<\varepsilon\le10<ε≤1, a fractional allocation algorithm whose hit cost is at most (1+ε)(Opt+wmax⁡g(κ))+a(1+\varepsilon)(\mathrm{Opt}+w_{\max}g(\kappa))+a(1+ε)(Opt+wmax​g(κ))+a and whose movement cost is at most O(log⁡(k/ε))(Opt+wmax⁡g(κ))+aO(\log(k/\varepsilon))(\mathrm{Opt}+w_{\max}g(\kappa))+aO(log(k/ε))(Opt+wmax​g(κ))+a, where g(κ)=∑t∣κ(t)−κ(t−1)∣g(\kappa)=\sum_t|\kappa(t)-\kappa(t-1)|g(κ)=∑t​∣κ(t)−κ(t−1)∣.
  3. Theorem 6: given such allocation algorithms, an O(ℓlog⁡(kℓ))O(\ell\log(k\ell))O(ℓlog(kℓ))-competitive fractional k-server algorithm on every weighted σ-HST of depth ℓ\ellℓ with σ=Ω(ℓlog⁡(kℓ))\sigma=\Omega(\ell\log(k\ell))σ=Ω(ℓlog(kℓ)).
  4. Theorem 8: every σ-HST with nnn leaves becomes a weighted σ-HST of depth O(log⁡n)O(\log n)O(logn) on the same leaves, with distances distorted by at most 2σ/(σ−1)2\sigma/(\sigma-1)2σ/(σ−1).
  5. Lemma 25 and Theorem 24: on a σ-HST with σ>5\sigma>5σ>5, randomized states consistent with a changing fractional state can be maintained online at cost O(ct)O(c_t)O(ct​) per step.
  6. Theorem 7: on a σ-HST with σ>5\sigma>5σ>5, a ccc-competitive fractional algorithm yields an O(c)O(c)O(c)-competitive randomized one.

Significance

The theorem broke the exponential gap between the Ω(log⁡k)\Omega(\log k)Ω(logk) lower bound and the 2k−12k-12k−1 upper bound for randomized k-server, and showed that randomization helps on every finite metric, not only on uniform or specially structured ones. Its two-level method (a fractional algorithm on trees driven by per-node allocation problems, followed by an online rounding) became the template for later work, including the O(log⁡2k)O(\log^2 k)O(log2k) bound on HSTs of Bubeck, Cohen, Lee, Lee and Mądry (STOC 2018) and Lee's O(log⁡6k)O(\log^6 k)O(log6k) bound on general metrics (FOCS 2018).

The result is proved, in this paper. As far as is known it has no machine-checked proof. Formalizing it means formalizing the analysis of an online algorithm driven by a continuous-time process, a potential-function argument with exact constants, a tree contraction with a distortion bound, and an online randomized rounding against a transportation cost. The allocation, HST and rounding statements are reusable for other online problems on trees (metrical task systems, weighted paging).

Difficulty

For a deterministic or randomized algorithm on a tree, the natural recursion splits the servers of each node among its children. Coté, Meyerson and Poplawski showed that this works if each node solves an allocation problem with a strong guarantee: hit cost within a factor 1+ε1+\varepsilon1+ε of optimal. Integral allocation algorithms cannot achieve this; the integrality gap example of the paper (p. 8) gives a factor Ω(k)\Omega(k)Ω(k). The fractional relaxation avoids the gap, but then the rounding step must keep a randomized state consistent with a fractional state at constant-factor cost, and the HSTs obtained from general metrics have depth growing with the aspect ratio, which a depth-dependent ratio cannot afford. Each of the three reductions (allocation to fractional k-server, deep HST to shallow weighted HST, fractional to randomized) loses only polylogarithmic or constant factors, and the main theorem needs all three at once.

Formalization scope

The k-server model, randomized algorithms and competitiveness are the published definitions KServer_model and KServer_randomized; competitiveness carries an additive constant fixed before the request sequence. Trees are finite rooted trees with a parent map, a depth function and positive edge lengths; points of the k-server problem are the leaves, and the theorems take an arbitrary finite metric space together with a bijection to the leaves and the hypothesis that the distance equals the tree distance. Fractional k-server states have exactly kkk units of mass, each leaf at most 111, and fractional algorithms are measured against the integral offline optimum. The allocation optimum is the integral optimum; cost vectors are finite, non-negative and non-increasing; the diameter of the star is wmax⁡=max⁡iwiw_{\max}=\max_i w_iwmax​=maxi​wi​. The cost of changing a randomized state is the transportation cost over couplings, with minimum-matching cost between configurations. Every O(⋅)O(\cdot)O(⋅) is an explicit constant quantified before the instance, except that in Theorems 7 and 24 and Lemma 25 it may depend on σ\sigmaσ.

Formalizations that make the targets trivial are excluded: the fractional state must place a full server on every request and stay in [0,1][0,1][0,1], the benchmark is the integral optimum (not the algorithm's own or the fractional cost), and no constant may depend on kkk, nnn, the metric or the tree, since otherwise Theorem 1 would follow from the 2k−12k-12k−1 bound.

The proof of Theorem 1 also uses the embedding of Fakcharoenphol, Rao and Talwar [18] of a finite metric into a distribution over σ-HSTs with expected distortion O(σlog⁡σn)O(\sigma\log_\sigma n)O(σlogσ​n). It is an external ingredient, not a result of this paper, and is not a milestone; contributions formalizing it (or Bartal's earlier embedding) are welcome, as are formalizations of the integral optimum's properties on trees (Lemmas 21–22 of the paper), which are not stated here.

Selected references

  • N. Bansal, N. Buchbinder, A. Mądry, J. Naor, A Polylogarithmic-Competitive Algorithm for the k-Server Problem, arXiv:1110.1580v1, 2011; J. ACM 62(5), 2015. https://arxiv.org/abs/1110.1580, https://doi.org/10.1145/2783434
  • M. Manasse, L. McGeoch, D. Sleator, Competitive algorithms for server problems, J. Algorithms 11, 1990. https://doi.org/10.1016/0196-6774(90)90003-W
  • E. Koutsoupias, C. Papadimitriou, On the k-server conjecture, J. ACM 42(5), 1995. https://doi.org/10.1145/210118.210128
  • A. Fiat, R. Karp, M. Luby, L. McGeoch, D. Sleator, N. Young, Competitive paging algorithms, J. Algorithms 12, 1991. https://doi.org/10.1016/0196-6774(91)90041-V
  • J. Fakcharoenphol, S. Rao, K. Talwar, A tight bound on approximating arbitrary metrics by tree metrics, J. Comput. Syst. Sci. 69(3), 2004. https://doi.org/10.1016/j.jcss.2004.04.011
  • A. Coté, A. Meyerson, L. Poplawski, Randomized k-server on hierarchical binary trees, STOC 2008. https://doi.org/10.1145/1374376.1374474
14 thms3 active usersReviewed
Linear OptimizationOperations ResearchProbability·Captain: mikedeng1

Competitive Randomized Algorithms for Nonuniform Problems IV: The Optimal Randomized Two-Server Ratio 1652/1069 on the 3-4-5 TriangleResearch Paper

Motivation

The kkk-server problem is a basic model of on-line decision making. kkk mobile servers move in a metric space, requests for points arrive one at a time, and each request has to be covered by a server before the next one arrives. The cost is the total distance the servers move. The problem includes paging, caching and disk-head scheduling as special cases (Manasse, McGeoch, Sleator 1990). An on-line algorithm is judged by its competitive factor: how much its cost can exceed that of an off-line algorithm that knows the whole request sequence in advance.

For randomized algorithms against an oblivious adversary (one that fixes the whole request sequence before the algorithm flips any coins), the best-understood case is paging, which is the kkk-server problem on a uniform metric space. There the optimal factor is the harmonic number Hk=∑i=1k1/iH_k=\sum_{i=1}^k 1/iHk​=∑i=1k​1/i. Fiat et al. proved the lower bound (1991) and McGeoch and Sleator the matching upper bound (1991). Karlin, Manasse, McGeoch and Owicki (Algorithmica 11, 1994, §5) asked whether HkH_kHk​-competitive algorithms also exist when the metric space is not uniform. They answered no, already for two servers on three points: on certain triangles the optimal randomized factor is strictly larger than H2=3/2H_2 = 3/2H2​=3/2. This mission formalizes their Theorem 13, which gives the exact optimal factor on the triangle with edge lengths 3, 4 and 5.

Timeline:

  • 1990: Manasse, McGeoch and Sleator introduce the kkk-server problem; kkk is the deterministic optimum for k=2k=2k=2.
  • 1991: Fiat, Karp, Luby, McGeoch, Sleator and Young prove the HkH_kHk​ lower bound for randomized paging. McGeoch and Sleator give an HkH_kHk​-competitive paging algorithm.
  • 1994: Karlin, Manasse, McGeoch and Owicki determine the optimal randomized two-server factors on the isosceles triangles 111-ddd-ddd (Theorem 12) and on the 3-4-5 triangle (Theorem 13, the ratio 1652/10691652/10691652/1069). Both exceed 3/23/23/2.

Setting

Let MMM be a metric space with exactly three points a,b,ca, b, ca,b,c, where d(a,b)=3d(a,b)=3d(a,b)=3, d(a,c)=5d(a,c)=5d(a,c)=5 and d(b,c)=4d(b,c)=4d(b,c)=4. A configuration CCC gives the positions of two labelled servers in MMM. A request sequence σ\sigmaσ is a finite list of points of MMM.

A deterministic on-line algorithm assigns to each prefix of a request sequence a configuration, in which the last request is covered. Its configuration after a prefix therefore cannot depend on later requests. Its initial configuration is the one it assigns to the empty prefix, and its cost CA(σ)C_A(\sigma)CA​(σ) on σ\sigmaσ is the total distance its servers move while serving σ\sigmaσ request by request.

The optimal off-line cost Copt(σ)C_{opt}(\sigma)Copt​(σ) from an initial configuration C0C_0C0​ is the infimum, over all schedules that start at C0C_0C0​ and cover each request of σ\sigmaσ in turn, of the total distance moved.

A randomized on-line algorithm AAA is a probability distribution over deterministic on-line algorithms, all starting at C0C_0C0​. The cost on each fixed σ\sigmaσ is required to be measurable in the random choice, and ECA(σ)\mathbf{E}C_A(\sigma)ECA​(σ) is the expected cost. AAA is ρ\rhoρ-competitive against an oblivious adversary if there is a constant aaa such that for every request sequence σ\sigmaσ,

ECA(σ)≤ρ⋅Copt(σ)+a.\mathbf{E}C_A(\sigma) \le \rho\cdot C_{opt}(\sigma) + a .ECA​(σ)≤ρ⋅Copt​(σ)+a.

These are the definitions of p. 543 of the paper. They are the platform's published KServer_model and KServer_randomized, which this mission reuses unchanged: KServer.RandomizedAlgorithm 2 M and A.IsCompetitiveFrom C₀ ρ.

Formalization targets

Goal: Theorem 13

For every initial configuration C0C_0C0​ of the two servers,

(∀A, ∀ρ, A is ρ-competitive from C0⇒ρ≥16521069) ∧ (∃A, A is 16521069-competitive from C0).\Big(\forall A,\ \forall \rho,\ A \text{ is } \rho\text{-competitive from } C_0 \Rightarrow \rho \ge \tfrac{1652}{1069}\Big)\ \wedge\ \Big(\exists A,\ A \text{ is } \tfrac{1652}{1069}\text{-competitive from } C_0\Big).(∀A, ∀ρ, A is ρ-competitive from C0​⇒ρ≥10691652​) ∧ (∃A, A is 10691652​-competitive from C0​).

The first claim is quantified over all randomized algorithms, so it also covers deterministic ones (point masses). The second claim asks for one algorithm. Together they say that 1652/1069≈1.5451652/1069 \approx 1.5451652/1069≈1.545 is the exact optimal randomized factor on this triangle.

Milestones

  1. The phase LP lower bound (p. 568). Twelve linear constraints in nine probabilities π1,…,π9\pi_1,\dots,\pi_9π1​,…,π9​, three potentials Φab,Φac,Φbc\Phi_{ab},\Phi_{ac},\Phi_{bc}Φab​,Φac​,Φbc​ and a ratio α\alphaα, one constraint for each possible phase of the request sequence, of the form
A’s cost≤α⋅(opt’s cost)+Φinitial−Φfinal.\text{A's cost} \le \alpha\cdot(\text{opt's cost}) + \Phi_{\text{initial}} - \Phi_{\text{final}}.A’s cost≤α⋅(opt’s cost)+Φinitial​−Φfinal​.

Every real solution has α≥1652/1069\alpha \ge 1652/1069α≥1652/1069. 2. The LP attainment (p. 568). The paper's printed probabilities lie in [0,1][0,1][0,1], and with suitable potentials they satisfy all twelve constraints at α=1652/1069\alpha = 1652/1069α=1652/1069. 3. Theorem 13, first claim: the lower bound for every randomized algorithm. 4. Theorem 13, second claim: a 1652/10691652/10691652/1069-competitive randomized algorithm exists.

Significance

The result. Theorem 13 shows that the HkH_kHk​ behaviour of randomized paging does not carry over to general metric spaces. Two servers on a three-point space already force a factor above 3/23/23/2. The value is exact, which makes this triangle a test case for any general theory of randomized kkk-server algorithms on small metric spaces. With Theorem 12 (the isosceles triangles, a companion mission of this series), it is one of the few non-uniform metric spaces with a known optimal randomized factor.

Formalizing it. The result has been proved since 1994. To our knowledge there is no machine-checked proof. The paper derives both bounds from two framework theorems for phase-based algorithms: Theorem 3 (an LP lower bound for phase-based algorithms bounds every algorithm) and Theorem 2 (a lazy phase-based algorithm with LP bound α\alphaα is α\alphaα-competitive). The phase tables themselves (which phases can occur and what they cost) are stated without detailed proof. A formal proof has to supply both framework arguments for this space and verify the phase tables, as well as the finite linear algebra of milestones 1 and 2. The milestones isolate the exact-arithmetic core so that it can be closed independently of the probabilistic part.

Difficulty

The two LP milestones are finite exact-arithmetic facts. The hard part is linking them to Theorem 13.

For the lower bound, an algorithm need not be phase-based at all. Its probabilities may depend on the whole history, not only on the current phase, and it may leave the configuration of the off-line optimum at the end of a phase. The obvious attempt is to fix one hard request sequence and compare costs, but that cannot work: randomization defeats any single sequence. The reduction from arbitrary algorithms to phase-based ones (the paper's Theorem 3) is the substantive step.

For the upper bound, the printed probabilities describe the algorithm's marginal position after each prefix of a phase. They have to be realized as a single probability distribution over deterministic on-line algorithms that is lazy (it moves only to serve a request) and whose expected cost per phase equals the table's entry. On top of this, the LP accounting has to be turned into a bound on arbitrary request sequences, including partial phases and a start away from the optimum's configuration.

Formalization scope

  • Model. The platform definitions KServer_model and KServer_randomized are used unchanged. Servers are labelled (Config 2 M = Fin 2 → M). A deterministic algorithm is a function of the request prefix, which makes it on-line by construction. A randomized algorithm is a mixed strategy with a probability measure and a measurability field, and its expected cost is the lower Lebesgue integral of the nonnegative cost. The off-line optimum is a real infimum over schedules from C0C_0C0​; the set is nonempty and bounded below by 000. Competitiveness allows any real additive constant.
  • The triangle is given by hypotheses on an arbitrary metric space: every point equals aaa, bbb or ccc, and d(a,b)=3d(a,b)=3d(a,b)=3, d(a,c)=5d(a,c)=5d(a,c)=5, d(b,c)=4d(b,c)=4d(b,c)=4. These hypotheses are satisfiable (3+4≥53+4\ge53+4≥5) and force three distinct points.
  • Initial configuration. Both claims are stated for every initial configuration C0C_0C0​, including both servers on one point. The paper does not fix the start; the additive constant absorbs it.
  • LP milestones. The thirteen LP variables are free reals, with no box 0≤πi≤10\le\pi_i\le 10≤πi​≤1, exactly as the paper permits. This makes milestone 1 stronger than the boxed version; the minimum is the same either way. The twelve constraints are written out one per hypothesis, in the table's order, with the potential difference Φinitial−Φfinal\Phi_{\text{initial}} - \Phi_{\text{final}}Φinitial​−Φfinal​ on the right. In milestone 2 the potentials are existentially quantified, since the paper names none.
  • Not stated. The paper's Theorems 2 and 3 (the phase framework) and the phase tables are not separate milestones. Milestone 1 feeds the first claim through Theorem 3, and milestone 2 feeds the second claim through Theorem 2. Contributions formalizing phase-based algorithms, laziness and the LP-bound reduction for finite metric spaces would be reusable for Theorem 12 and Theorem 14 of the same paper.
  • Ruled out. The lower bound is not restricted to deterministic or to phase-based algorithms, and it is not stated as "one sequence defeats every algorithm". The constant is exactly 1652/10691652/10691652/1069, not an approximation, and the attainment claim is not weakened to "for some initial configuration".

Selected references

  • A. R. Karlin, M. S. Manasse, L. A. McGeoch, S. Owicki, Competitive Randomized Algorithms for Nonuniform Problems, Algorithmica 11 (1994) 542–571. https://doi.org/10.1007/BF01189993
  • M. S. Manasse, L. A. McGeoch, D. D. Sleator, Competitive Algorithms for Server Problems, Journal of Algorithms 11 (1990) 208–230. https://doi.org/10.1016/0196-6774(90)90003-W
  • A. Fiat, R. M. Karp, M. Luby, L. A. McGeoch, D. D. Sleator, N. E. Young, Competitive Paging Algorithms, Journal of Algorithms 12 (1991) 685–699. https://doi.org/10.1016/0196-6774(91)90041-V
  • L. A. McGeoch, D. D. Sleator, A Strongly Competitive Randomized Paging Algorithm, Algorithmica 6 (1991) 816–825. https://doi.org/10.1007/BF01759073
7 thms3 active usersReviewed
Linear OptimizationOperations ResearchProbability·Captain: mikedeng1

Competitive Randomized Algorithms for Nonuniform Problems III: The Optimal Randomized Two-Server Ratio on the 1-d-d Isosceles TriangleResearch Paper

Motivation

The k-server problem of Manasse, McGeoch and Sleator (J. Algorithms 11 (1990)) asks how kkk mobile servers in a metric space should respond, on-line, to a sequence of requests at points of the space, each of which must be covered by a server. It is the central model of on-line computation: paging is the special case of a uniform metric, and many caching and scheduling problems reduce to it. For two servers the deterministic picture is complete: the optimal competitive ratio is 222 on every metric space with at least three points.

Randomization changes the picture, and the smallest nontrivial case already shows how. On the equilateral triangle the optimal randomized ratio against an oblivious adversary is 3/23/23/2. Karlin, Manasse, McGeoch and Owicki (Algorithmica 11 (1994) 542–571) computed the exact optimal randomized ratio for several nonuniform triangles, where the distances differ, and showed that it depends on the geometry. Their Theorem 12 settles the whole family of isosceles triangles with edge lengths 111, ddd, ddd. These exact values are among the few known optimal randomized ratios for server problems.

Timeline:

  • 1990: Manasse, McGeoch and Sleator introduce the kkk-server problem and prove the deterministic two-server ratio is 222.
  • 1990–1994: Karlin, Manasse, McGeoch and Owicki submit this paper (received August 1990, revised September 1991) and publish it in Algorithmica in 1994, with the isosceles-triangle ratios of Theorem 12 and the 3-4-5 triangle ratio 1652/10691652/10691652/1069 of Theorem 13.
  • Later: Karloff, Rabani and Ravid extend the technique to Ω(log⁡log⁡k)\Omega(\log\log k)Ω(loglogk) and Ω(log⁡k)\Omega(\log k)Ω(logk) randomized lower bounds (cited on p. 564); Bubeck, Coester and Rabani (STOC 2023) refute the randomized kkk-server conjecture.

Setting

Fix an integer d≥1d\ge1d≥1. The isosceles triangle MMM has three points aaa, bbb, ccc with

dist⁡(a,b)=1,dist⁡(a,c)=dist⁡(b,c)=d.\operatorname{dist}(a,b)=1,\qquad \operatorname{dist}(a,c)=\operatorname{dist}(b,c)=d.dist(a,b)=1,dist(a,c)=dist(b,c)=d.

A configuration C:{0,1}→MC:\{0,1\}\to MC:{0,1}→M places two labelled servers on points of MMM. A deterministic on-line algorithm assigns to every finite request sequence σ=(r1,…,rn)\sigma=(r_1,\dots,r_n)σ=(r1​,…,rn​) a configuration, computed from σ\sigmaσ alone and covering the last request; its value on the empty sequence is its initial configuration. Its cost CA(σ)C_A(\sigma)CA​(σ) is the total distance its servers move while serving σ\sigmaσ request by request. The off-line optimum Copt(σ)C_{opt}(\sigma)Copt​(σ) from an initial configuration C0C_0C0​ is the least total movement of any schedule that starts at C0C_0C0​ and covers each request in turn, knowing σ\sigmaσ in advance.

A randomized algorithm is a probability distribution on deterministic on-line algorithms; its expected cost is ECA(σ)\mathbf{E}C_A(\sigma)ECA​(σ). It is ρ\rhoρ-competitive against an oblivious adversary from C0C_0C0​ if every algorithm in its support starts at C0C_0C0​ and there is a constant aaa such that

ECA(σ)≤ρ⋅Copt(σ)+afor every request sequence σ.\mathbf{E}C_A(\sigma)\le\rho\cdot C_{opt}(\sigma)+a\qquad\text{for every request sequence }\sigma.ECA​(σ)≤ρ⋅Copt​(σ)+afor every request sequence σ.

The request sequence is fixed in advance and does not react to the algorithm's coin flips.

Write ep=(1+1/p)pe_p=(1+1/p)^pep​=(1+1/p)p and

αd=e2d−1+1/4d(e2d−1−1)+1/2d,e2d−1=(2d2d−1)2d−1.\alpha_d=\frac{e_{2d-1}+1/4d}{(e_{2d-1}-1)+1/2d},\qquad e_{2d-1}=\left(\frac{2d}{2d-1}\right)^{2d-1}.αd​=(e2d−1​−1)+1/2de2d−1​+1/4d​,e2d−1​=(2d−12d​)2d−1.

In Lean this is NonuniformCompetitive.Isosceles.isoscelesRatio d.

Formalization targets

Goal: Theorem 12

For every d≥1d\ge1d≥1 and every initial configuration C0C_0C0​:

∀A, ∀ρ,A is ρ-competitive from C0 ⟹ ρ≥αd,\forall A,\ \forall\rho,\quad A\text{ is }\rho\text{-competitive from }C_0\ \Longrightarrow\ \rho\ge\alpha_d,∀A, ∀ρ,A is ρ-competitive from C0​ ⟹ ρ≥αd​, ∃A: A is αd-competitive from C0.\exists A:\ A\text{ is }\alpha_d\text{-competitive from }C_0.∃A: A is αd​-competitive from C0​.

The two claims are also milestones of their own (no_better_ratio, ratio_attained).

The phase LP (§5, pp. 565–566)

For free real π1,…,π2d−1\pi_1,\dots,\pi_{2d-1}π1​,…,π2d−1​ and real α\alphaα with

(πk)2d+∑i=1k(1−πi)≤αk  (1≤k<2d),2d+∑i=12d−1(1−πi)+12≤α⋅2d,(\pi_k)2d+\sum_{i=1}^k(1-\pi_i)\le\alpha k\ \ (1\le k<2d),\qquad 2d+\sum_{i=1}^{2d-1}(1-\pi_i)+\tfrac12\le\alpha\cdot2d,(πk​)2d+i=1∑k​(1−πi​)≤αk  (1≤k<2d),2d+i=1∑2d−1​(1−πi​)+21​≤α⋅2d,

one has α≥αd\alpha\ge\alpha_dα≥αd​ (lp_lower_bound); and πk=(αd−1)((2d/(2d−1))k−1)\pi_k=(\alpha_d-1)\big((2d/(2d-1))^k-1\big)πk​=(αd​−1)((2d/(2d−1))k−1), π2d=1\pi_{2d}=1π2d​=1 is nondecreasing from π1≥0\pi_1\ge0π1​≥0 to 111 and makes every constraint an equality (lp_attained).

The limit remark (§5, p. 566)

α1<α2<α3<⋯ ,lim⁡d→∞αd=ee−1\alpha_1<\alpha_2<\alpha_3<\cdots,\qquad \lim_{d\to\infty}\alpha_d=\frac{e}{e-1}α1​<α2​<α3​<⋯,d→∞lim​αd​=e−1e​

(ratio_increases_to_e_ratio).

Significance

The theorem gives an exact optimal randomized ratio for an infinite family of metric spaces. It shows that the optimal randomized two-server ratio is not a constant: it runs from 3/23/23/2 on the equilateral triangle to e/(e−1)≈1.582e/(e-1)\approx1.582e/(e−1)≈1.582 as the triangle becomes long and thin, where the problem resembles ski rental. With the deterministic ratio 222, it quantifies exactly how much randomization gains on these spaces.

The results are proved in the paper; none is formalized on Prove2Me, and no machine-checked proof of them is known. A formal proof would require the paper's phase framework (Theorems 1–3 and the appendix's Theorem 15) for server problems, which this mission does not state separately, and a concrete randomized algorithm as a measurable mixed strategy. Both would be reusable for Theorem 13 (the 3-4-5 triangle) and for other exact ratios on small metric spaces.

Difficulty

The phase LP milestones are finite real arithmetic. The difficulty is the passage between them and the goal. The lower bound must hold for every randomized algorithm, not only phase-based lazy ones: an arbitrary algorithm may condition on the whole history, move non-lazily, and randomize in ways that do not reduce to the probabilities πk\pi_kπk​. The paper handles this with Theorem 3, which says that the LP bound of phase-based algorithms bounds the competitive factor of all algorithms; its proof uses an averaging argument over histories that must be made rigorous. The upper bound needs a mixed strategy over infinitely many phases, with measurable costs, an explicit additive constant covering the first partial phase from an arbitrary initial configuration, and an accounting of CoptC_{opt}Copt​ across phase boundaries.

Formalization scope

The model is the platform's published KServer_model and KServer_randomized (reference items): labelled servers Fin 2 → M; a deterministic on-line algorithm as a map from request prefixes to configurations; a randomized algorithm as a probability measure over deterministic algorithms, with the cost of each fixed sequence measurable in the random outcome; expected cost as a lower Lebesgue integral in [0,∞][0,\infty][0,∞]; the off-line optimum as a real infimum over schedules from C0C_0C0​ (nonempty and bounded below by 000); and IsCompetitiveFrom A C₀ c with a real additive constant.

Committed conventions:

  • The triangle is any metric space whose points are exactly a,b,ca,b,ca,b,c at distances 1,d,d1,d,d1,d,d, with ddd a natural number and d≥1d\ge1d≥1. Every such space is isometric to the paper's triangle; at d=0d=0d=0 it would not be a triangle.
  • Both claims are stated for every initial configuration, including both servers on one point. The paper treats the initial state {a,b}\{a,b\}{a,b} separately and absorbs the first partial phase into the additive constant.
  • The lower bound quantifies over all randomized algorithms (deterministic ones are point masses), never over phase-based ones only.
  • In the LP milestones the πk\pi_kπk​ are free reals, as printed; no box 0≤πk≤10\le\pi_k\le10≤πk​≤1 is imposed.
  • "Grows" in the limit remark is read as strictly increasing.
  • The paper prints the recurrence on p. 565 as πk=α−1+(πk−1)2d−12d\pi_k=\frac{\alpha-1+(\pi_{k-1})2d-1}{2d}πk​=2dα−1+(πk−1​)2d−1​; the equations (∗)(*)(∗) give πk=α−1+2d πk−12d−1\pi_k=\frac{\alpha-1+2d\,\pi_{k-1}}{2d-1}πk​=2d−1α−1+2dπk−1​​. The recurrence is not used; the closed form printed on p. 566 is correct and is the one stated.

Without the measurability field of a randomized algorithm the lower integral would under-report expected cost and the attainment claim would become easier than the paper's; the published definition includes it. The lower bound is not vacuous: the triangle hypotheses are satisfiable for every d≥1d\ge1d≥1.

Welcome contributions: a formal version of the phase framework (Theorems 1–3, 15) for finite metric spaces, reusable across missions III and IV; a measurable construction of phase-based randomized algorithms; and proofs of the LP milestones.

Selected references

  • A. R. Karlin, M. S. Manasse, L. A. McGeoch, S. Owicki, Competitive Randomized Algorithms for Nonuniform Problems, Algorithmica 11 (1994) 542–571. https://doi.org/10.1007/BF01189993
  • M. S. Manasse, L. A. McGeoch, D. D. Sleator, Competitive Algorithms for Server Problems, J. Algorithms 11 (1990) 208–230. https://doi.org/10.1016/0196-6774(90)90003-W
  • H. Karloff, Y. Rabani, Y. Ravid, Lower Bounds for Randomized k-Server and Motion-Planning Algorithms, SIAM J. Comput. 23 (1994) 293–312. https://doi.org/10.1137/S0097539792224838
  • S. Bubeck, C. Coester, Y. Rabani, The Randomized k-Server Conjecture Is False!, STOC 2023. https://arxiv.org/abs/2211.05753
9 thms3 active usersReviewed
CombinatoricsComplexity TheoryOperations Research+1·Captain: mikedeng1

A Threshold of ln n for Approximating Set Cover II: The Inapproximability of Max k-CoverResearch Paper

Motivation

Max kkk-cover is the basic coverage problem of combinatorial optimization. The input is a collection of subsets of a finite ground set and a number kkk; the task is to choose kkk subsets that together cover as many points as possible. It models facility and sensor placement, the selection of a small committee or feature set representing a population, and budgeted versions of set cover. It is also the prototype of maximizing a monotone submodular function under a cardinality constraint.

The greedy algorithm covers at least a 1−1/e≈0.6321-1/e\approx 0.6321−1/e≈0.632 fraction of the optimum. This bound goes back to Hochbaum and Pathria and, for general submodular functions, to Nemhauser, Wolsey and Fisher (1978). For two decades it was not known whether a polynomial-time algorithm could do better. Uriel Feige answered the question in A Threshold of ln n for Approximating Set Cover (J. ACM 45(4), 1998, pp. 634–652, doi:10.1145/285055.285059), Section 5. His Theorem 5.3 (p. 648) states: "For any ϵ>0\epsilon > 0ϵ>0, max kkk-cover cannot be approximated in polynomial time within a ratio of (1−1/e+ϵ)(1 - 1/e + \epsilon)(1−1/e+ϵ), unless P=NPP = NPP=NP." Together with the greedy bound, it makes 1−1/e1-1/e1−1/e the exact approximation threshold of max kkk-cover.

Timeline:

  • 1978: Nemhauser, Wolsey and Fisher prove the greedy 1−1/e1-1/e1−1/e bound for monotone submodular maximization.
  • 1992: Arora, Lund, Motwani, Sudan and Szegedy prove the PCP theorem. With Papadimitriou–Yannakakis (1991) it gives Theorem 2.1.1 of the paper: MAX 3SAT-B has a constant gap unless P = NP.
  • 1994: Lund and Yannakakis introduce partition-system reductions from multi-prover proof systems to set cover.
  • 1995: Raz proves the parallel repetition theorem (Theorem 2.2.2 of the paper).
  • 1998: Feige proves the ln n threshold for set cover (the subject of mission I of this series) and the 1−1/e1-1/e1−1/e threshold for max kkk-cover.

Setting

An instance consists of nnn points {0,…,n−1}\{0,\dots,n-1\}{0,…,n−1}, a list of subsets S1,…,SsS_1,\dots,S_sS1​,…,Ss​ of the points, and a number kkk. Its value opt\mathrm{opt}opt is the largest number of points covered by at most kkk of the sets. Instances are written over a three-letter alphabet:

  • nnn in unary;
  • each set as its characteristic bit-vector;
  • kkk in unary.

Following p. 648, a polynomial-time algorithm approximates max kkk-cover within a ratio δ\deltaδ if on every input it outputs a number vvv with

δ⋅opt≤v≤opt.\delta\cdot\mathrm{opt}\le v\le\mathrm{opt}.δ⋅opt≤v≤opt.

The algorithm need not name the sets. This is the non-constructive notion of approximation.

The proof is a reduction from the MAX 3SAT-5 problem. A 3CNF-5 formula has exactly three literals per clause, over three distinct variables, and every variable occurs in exactly five clauses. The reduction goes through a kkk-prover proof system for such a formula φ\varphiφ with MMM clauses:

  • The verifier picks ℓ\ellℓ clauses at random, and a distinguished variable in each; there are R=(3M)ℓR=(3M)^\ellR=(3M)ℓ random strings rrr.
  • Each prover PiP_iPi​ is attached to a code word of length ℓ\ellℓ and weight ℓ/2\ell/2ℓ/2; distinct words are at Hamming distance at least ℓ/3\ell/3ℓ/3.
  • On coordinate jjj, prover PiP_iPi​ receives the clause if its bit is 1, and the distinguished variable if its bit is 0.
  • Answers are satisfying assignments of the received clauses and bits for the received variables.
  • Two provers are consistent if they assign the same values to the distinguished variables. The verifier weakly accepts if some pair of distinct provers is consistent, and strongly accepts if every pair is.

The max k′k'k′-cover instance of §5 attaches to every random string rrr a copy BrB_rBr​ of the explicit partition system. Its points are the vectors in {0,…,k−1}L\{0,\dots,k-1\}^L{0,…,k−1}L with L=2ℓL=2^\ellL=2ℓ, so m=kLm=k^Lm=kL. Its LLL partitions are labelled by the ℓ\ellℓ-bit strings, and each splits the points by the value of one coordinate. There are N=mRN=mRN=mR points in all. For each prover iii, question qqq and answer aaa, the set S(q,a,i)S_{(q,a,i)}S(q,a,i)​ collects, for every rrr on which PiP_iPi​ receives qqq, the iiith part of the partition of BrB_rBr​ labelled by the values that aaa gives to the distinguished variables of rrr. The budget is k′=kQk'=kQk′=kQ, where QQQ is the number of questions a single prover can receive.

Formalization targets

Goal: Theorem 5.3

∀ε>0:max k-cover is approximable within 1−1e+ε ⟹ P=NP,\forall\varepsilon>0:\quad \text{max } k\text{-cover is approximable within } 1-\tfrac1e+\varepsilon \ \Longrightarrow\ \mathrm{P}=\mathrm{NP},∀ε>0:max k-cover is approximable within 1−e1​+ε ⟹ P=NP,

conditional on the two cited results below. The ratio is left free (any ε>0\varepsilon>0ε>0), so the goal records the shape of the threshold and not a particular constant.

Milestones

  • Proposition 2.1.2 (p. 640): for some ε>0\varepsilon>0ε>0 it is NP-hard to distinguish satisfiable 3CNF-5 formulas from those in which at most a (1−ε)(1-\varepsilon)(1−ε)-fraction of the clauses can be satisfied simultaneously.
  • Lemma 2.3.1 (p. 643): a satisfiable φ\varphiφ admits a strategy that always strongly accepts; on a far-from-satisfiable φ\varphiφ the weak acceptance probability is at most k2 2−cℓk^2\,2^{-c\ell}k22−cℓ.
  • Coverage of the explicit partition system (p. 649): jjj subsets from pairwise different partitions cover exactly (1−(1−1/k)j)m(1-(1-1/k)^j)m(1−(1−1/k)j)m points.
  • Proposition 5.4 (p. 649): if at most kQkQkQ sets cover a (1−1/e+ε)(1-1/e+\varepsilon)(1−1/e+ε)-fraction of the points, then at least an ε/3\varepsilon/3ε/3-fraction of the random strings are good. Here rrr is good if wr≤3k/εw_r\le3k/\varepsilonwr​≤3k/ε sets meet BrB_rBr​ and two of them from different provers lie in the same partition.
  • Decoding (p. 649): such a covering yields a strategy that weakly accepts with probability at least (ε/3)(ε/3k)2(\varepsilon/3)(\varepsilon/3k)^2(ε/3)(ε/3k)2.
  • Gap (p. 649): a satisfiable formula gives a cover of all NNN points by kQkQkQ sets. If at most a (1−ε′)(1-\varepsilon')(1−ε′)-fraction of the clauses are satisfiable, kQkQkQ sets cover at most (1−1/e+g(k))N(1-1/e+g(k))N(1−1/e+g(k))N points, where g(k)→0g(k)\to0g(k)→0, for all large ℓ\ellℓ.
  • Proposition 5.1 (p. 647): every greedy run covers at least (1−1/e) opt(1-1/e)\,\mathrm{opt}(1−1/e)opt points.

Significance

The result closes the approximability of max kkk-cover: the greedy algorithm cannot be beaten by any constant unless P = NP. Consequences:

  • Submodular maximization. Coverage functions are monotone submodular, so the bound transfers to monotone submodular maximization under a cardinality constraint, whenever the function is given in a form that encodes a coverage instance.
  • Other problems. Hardness results for facility location, budgeted allocation, and welfare maximization with coverage valuations reduce from it.
  • The reduction itself. The ℓ\ellℓ-fold kkk-prover system combined with a partition system that is exactly countable is the template for later 1−1/e1-1/e1−1/e hardness proofs.

Status: the theorem has been proved since 1998. It has not been formalized; neither the reduction nor the underlying proof systems exist in Mathlib or on this platform. This mission produces:

  • a machine-checked reduction from MAX 3SAT-5 to max kkk-cover;
  • an exact counting lemma for product partition systems;
  • the averaging and concavity argument of Proposition 5.4;
  • a formal statement of the greedy bound for coverage.

The cited PCP-based gap (Theorem 2.1.1) and parallel repetition (Theorem 2.2.2) remain hypotheses. They are separate, much larger formalization projects.

Difficulty

The obvious argument uses the soundness of the proof system directly: a large cover should force consistent answers. It fails because a cover may spend many sets on a few random strings and cover them completely, while covering the rest partially without any two sets from the same partition. What saves the argument is exact counting. For sets from pairwise different partitions, coverage is exactly h(j)=(1−(1−1/k)j)mh(j)=(1-(1-1/k)^j)mh(j)=(1−(1−1/k)j)m, a concave function of the number jjj of sets used. Since the sets meet a random string kkk times on average, Jensen's inequality caps the total coverage of such "unstructured" strings at about (1−(1−1/k)k)(1-(1-1/k)^k)(1−(1−1/k)k), which tends to 1−1/e1-1/e1−1/e. A further obstacle is that the reduction must run in polynomial time. The paper therefore takes ℓ\ellℓ and kkk constant (unlike the set-cover reduction, where ℓ=Θ(log⁡log⁡n)\ell=\Theta(\log\log n)ℓ=Θ(loglogn)), and the soundness bound k22−cℓk^2 2^{-c\ell}k22−cℓ must beat (ε/3)(ε/3k)2(\varepsilon/3)(\varepsilon/3k)^2(ε/3)(ε/3k)2 at a constant ℓ\ellℓ. The quantifier order (kkk large first, then ℓ\ellℓ large) is part of the difficulty.

A second obstacle is the machine model. The goal is a statement about polynomial-time Turing machines, so the reduction and the decision procedure built from a hypothetical approximation algorithm must be compiled into Cook's one-tape machines.

Formalization scope

  • Machine model. CookPvsNP_defs (a published platform definition): one-tape Turing machines, P\mathrm{P}P, NP\mathrm{NP}NP, polynomial-time computable functions, CNF formulas and their encoding. "P = NP" is P Bool = NP Bool, the form in which CookPvsNP.P_ne_NP states the open problem.
  • Cited results as hypotheses. Theorem 2.1.1 enters as Thm211. Raz's theorem enters as RazRepetition, its consequence stated on p. 642: the ℓ\ellℓ-fold clause–variable game on a far-from-satisfiable 3CNF-5 formula has acceptance probability at most 2−cℓ2^{-c\ell}2−cℓ. This is weaker than Raz's general theorem, so the conditional statement is stronger. No hypothesis about max kkk-cover is assumed.
  • Approximation. The value form above, with no size threshold. For ε>1/e\varepsilon>1/eε>1/e the ratio exceeds one and the hypothesis is unsatisfiable on any instance with opt>0\mathrm{opt}>0opt>0; those values are vacuous, as in the paper.
  • opt\mathrm{opt}opt. Taken over at most kkk sets. This agrees with the paper's "exactly kkk" whenever k≤sk\le sk≤s.
  • Probability and counting. Probabilities are uniform counts over the (3M)ℓ(3M)^\ell(3M)ℓ random strings. Fractions in lower-bound statements are written as counts compared with multiples of RRR.
  • Canonical answers. The type of answers is restricted to satisfying assignments of the received clauses, following the paper's "without loss of generality" (p. 643). All indices are 0-based.
  • Partition system. The §4 construction is defined for any partition system with ℓ\ellℓ-bit partition labels and instantiated with the explicit product system. Its L=2ℓL=2^\ellL=2ℓ coordinates are the ℓ\ellℓ-bit strings themselves.
  • Not formalized. The running time of the greedy algorithm, and the constructive variant (Proposition 5.2), which belongs to the set-cover mission.

A trivializing formalization is ruled out: every cited input is a named, satisfiable proposition about 3CNF formulas or the two-prover game, never about max kkk-cover, and the approximation hypothesis is satisfiable for ratios up to 111.

Needed infrastructure, reusable beyond this mission:

  • composition and simulation lemmas for Cook's machines;
  • the uniformity of the verifier's questions on 3CNF-5 formulas;
  • concavity of j↦1−(1−1/k)jj\mapsto 1-(1-1/k)^jj↦1−(1−1/k)j;
  • (1−1/k)k→1/e(1-1/k)^k\to 1/e(1−1/k)k→1/e bounds.

Contributions to any of these, or to either cited theorem, are welcome.

Selected references

  • U. Feige, A threshold of ln n for approximating set cover, J. ACM 45(4) (1998) 634–652. https://doi.org/10.1145/285055.285059
  • R. Raz, A parallel repetition theorem, SIAM J. Comput. 27(3) (1998) 763–803 (STOC 1995). https://doi.org/10.1137/S0097539795280895
  • S. Arora, C. Lund, R. Motwani, M. Sudan, M. Szegedy, Proof verification and the hardness of approximation problems, J. ACM 45(3) (1998) 501–555. https://doi.org/10.1145/278298.278306
  • C. Papadimitriou, M. Yannakakis, Optimization, approximation, and complexity classes, J. Comput. System Sci. 43(3) (1991) 425–440. https://doi.org/10.1016/0022-0000(91)90023-X
  • C. Lund, M. Yannakakis, On the hardness of approximating minimization problems, J. ACM 41(5) (1994) 960–981. https://doi.org/10.1145/185675.306789
  • G. L. Nemhauser, L. A. Wolsey, M. L. Fisher, An analysis of approximations for maximizing submodular set functions—I, Math. Programming 14 (1978) 265–294. https://doi.org/10.1007/BF01588971
  • S. Cook, The P versus NP problem, Clay Mathematics Institute. https://www.claymath.org/wp-content/uploads/2022/06/pvsnp.pdf
13 thms3 active usersReviewed
CombinatoricsComplexity TheoryOperations Research·Captain: mikedeng1

A Threshold of ln n for Approximating Set Cover I: The ln n Inapproximability of Set CoverResearch Paper

Motivation

Set cover is the problem of covering a finite ground set with as few members of a given family of subsets as possible. It models facility location, crew scheduling, test-suite minimization and many other selection problems in operations research, and it is one of the canonical NP-hard problems. The greedy algorithm, which repeatedly picks the subset covering the most uncovered points, finds a cover at most about ln⁡n\ln nlnn times larger than the optimum on an instance with nnn points (Johnson 1974; Lovász 1975; Chvátal 1979). Whether any efficient algorithm does substantially better was open for two decades.

Timeline of the lower bounds:

  • 1992. The PCP theorem (Arora, Lund, Motwani, Sudan, Szegedy) implies that set cover cannot be approximated within some constant 1+ε1+\varepsilon1+ε unless P = NP.
  • 1994. Lund and Yannakakis showed that set cover cannot be approximated within 14log⁡2n\tfrac14\log_2 n41​log2​n unless NP⊆TIME(nO(polylog n))\mathrm{NP}\subseteq\mathrm{TIME}(n^{O(\mathrm{polylog}\, n)})NP⊆TIME(nO(polylogn)), and within 12log⁡2n≈0.72ln⁡n\tfrac12\log_2 n\approx 0.72\ln n21​log2​n≈0.72lnn under a randomized assumption.
  • 1998. Feige showed that for every ε>0\varepsilon>0ε>0, set cover cannot be approximated within (1−ε)ln⁡n(1-\varepsilon)\ln n(1−ε)lnn unless NP⊆TIME(nO(log⁡log⁡n))\mathrm{NP}\subseteq\mathrm{TIME}(n^{O(\log\log n)})NP⊆TIME(nO(loglogn)) (J. ACM 45(4), 634–652). This matches the greedy bound up to lower-order terms.
  • 2014. Dinur and Steurer replaced the assumption by P ≠ NP (STOC 2014).

This mission formalizes Feige's theorem, the result that fixed ln⁡n\ln nlnn as the threshold.

Setting

An instance consists of nnn points {0,…,n−1}\{0,\dots,n-1\}{0,…,n−1} and a list of subsets S1,…,SsS_1,\dots,S_sS1​,…,Ss​. A cover is a set of indices whose subsets together contain every point. The instance is coverable if every point lies in some SiS_iSi​. It is written as a string: nnn in unary, then each subset as its characteristic vector.

A deterministic polynomial-time algorithm approximates set cover within ρ(n)\rho(n)ρ(n) if, for some threshold n0n_0n0​ and every coverable instance with n≥n0n \ge n_0n≥n0​ points, the value vvv it outputs satisfies OPT≤v≤ρ(n)⋅OPT\mathrm{OPT}\le v\le\rho(n)\cdot\mathrm{OPT}OPT≤v≤ρ(n)⋅OPT, where OPT\mathrm{OPT}OPT is the size of a smallest cover.

TIME(nO(log⁡log⁡n))\mathrm{TIME}(n^{O(\log\log n)})TIME(nO(loglogn)) is the class of languages that a deterministic one-tape Turing machine decides within ∣w∣c(log⁡2log⁡2∣w∣+1)+c|w|^{c(\log_2\log_2|w|+1)}+c∣w∣c(log2​log2​∣w∣+1)+c steps, for some constant ccc. Machines, P\mathrm{P}P and NP\mathrm{NP}NP are those of the published definition CookPvsNP_defs.

The proof passes through three objects, each defined in the mission:

  1. 3CNF-5 formulas: CNF formulas in which every clause has three literals on distinct variables and every variable occurs in exactly five clauses.
  2. The kkk-prover proof system of §2.3. A verifier picks ℓ\ellℓ random clauses and a distinguished variable in each. Each prover, according to its code word, receives some of these clauses and the distinguished variables of the others. Under the weak acceptance predicate, some two provers give consistent answers on the distinguished variables. Under the strong acceptance predicate, all provers do.
  3. Partition systems B(m,L,k,d)B(m,L,k,d)B(m,L,k,d) (Definition 3.1). These are LLL partitions of mmm points, each into kkk parts, such that covering the points with parts taken from pairwise different partitions needs at least ddd parts.

Formalization targets

Goal: Theorem 4.4

∃ ε>0: set cover is approximable within (1−ε)ln⁡n ⟹ NP⊆TIME(nO(log⁡log⁡n)).\exists\,\varepsilon>0:\ \text{set cover is approximable within }(1-\varepsilon)\ln n\ \Longrightarrow\ \mathrm{NP}\subseteq\mathrm{TIME}\big(n^{O(\log\log n)}\big).∃ε>0: set cover is approximable within (1−ε)lnn ⟹ NP⊆TIME(nO(loglogn)).

The statement fixes no constant beyond ε\varepsilonε. The parameters kkk, ℓ\ellℓ and mmm of the reduction are choices made inside the proof. The goal carries three cited results as hypotheses: Theorem 2.1.1 (MAX 3SAT-B gap), the consequence of Raz's parallel repetition theorem for the clause–variable game, and the Naor–Schulman–Srinivasan construction of partition systems.

Milestones, in the order the proof uses them

  1. Proposition 2.1.2: MAX 3SAT-5 is gap NP-hard.
  2. Proposition 2.2.1: the one-round clause–variable game has value 1−ε/31-\varepsilon/31−ε/3.
  3. Lemma 2.3.1: the kkk-prover system is complete with strong acceptance and has soundness k22−cℓk^2 2^{-c\ell}k22−cℓ for weak acceptance.
  4. Lemma 3.2: partition systems with d=(1−2/k)kln⁡md=(1-2/k)k\ln md=(1−2/k)klnm exist.
  5. Propositions 4.2 and 4.3: a cover with (1−δ)kQln⁡m(1-\delta)kQ\ln m(1−δ)kQlnm subsets yields a prover strategy that is weakly accepted with probability at least 2δ/(kln⁡m)22\delta/(k\ln m)^22δ/(klnm)2.
  6. Lemma 4.1: the gap between kQkQkQ and (1−2f(k))kQln⁡m(1-2f(k))kQ\ln m(1−2f(k))kQlnm.

Significance

The result. Combined with the greedy algorithm, Theorem 4.4 shows that ln⁡n\ln nlnn is the approximation threshold of set cover under a mild complexity assumption. Set cover reduces approximation-preservingly to many covering problems, so the threshold transfers to them. Examples are dominating set, several facility-location and group Steiner problems, and hitting-set formulations used in scheduling and testing. The kkk-prover system with two acceptance predicates and the partition-system gadget became standard tools for later hardness-of-approximation proofs.

Formalizing it. The theorem is proved and has been strengthened (Dinur–Steurer 2014), but no machine-checked proof of any Ω(log⁡n)\Omega(\log n)Ω(logn) inapproximability of set cover is known. This mission contributes:

  • a Lean model of multi-prover proof systems with uniform-count probabilities;
  • partition systems and their probabilistic existence proof;
  • a gap-preserving reduction whose running time is analysed on Turing machines, not merely asserted.

Difficulty

  • The ratio comes from two gaps at once. One is a gap in acceptance probability. The other is a gap between strong and weak acceptance. A reduction from a two-prover system, as in Lund–Yannakakis, loses a constant factor because a cheating cover can use two parts of the same partition. Feige's analysis must turn every small cover into a strategy under which some pair of provers is consistent (Proposition 4.3), and this averaging argument has to lose only a factor (kln⁡m)2(k\ln m)^2(klnm)2.
  • Parameters interlock. ℓ=Θ(log⁡log⁡n)\ell=\Theta(\log\log n)ℓ=Θ(loglogn) must make k22−cℓk^2 2^{-c\ell}k22−cℓ smaller than 2δ/(kln⁡m)22\delta/(k\ln m)^22δ/(klnm)2 while keeping the instance of size nO(log⁡log⁡n)n^{O(\log\log n)}nO(loglogn). The time bound must hold for a one-tape machine, including the deterministic partition-system construction.
  • Encoding. The reduction must be computed by an explicit machine on string encodings. Showing that a "clearly polynomial" construction meets the time bound on such a machine is substantial work.

Formalization scope

  • Cited results as hypotheses. Theorem 2.1.1, Raz's theorem and the Naor et al. construction are not proved in the mission; each is a named proposition (Thm211, RazRepetition, NaorPartitionSystems) and a hypothesis of the goal.
    • RazRepetition is only the consequence of Raz's theorem that the paper uses (p. 642): a 2−cℓ2^{-c\ell}2−cℓ error bound for the repeated clause–variable game on 3CNF-5 formulas far from satisfiable.
    • NaorPartitionSystems relaxes "time linear in mmm" to polynomial time and renders "LLL polynomial in ddd" as L≤⌊log⁡2m⌋aL\le\lfloor\log_2 m\rfloor^aL≤⌊log2​m⌋a. Both relaxations weaken the hypothesis.
  • Approximation in value form. The algorithm outputs a number vvv with OPT≤v≤ρ(n)OPT\mathrm{OPT}\le v\le\rho(n)\mathrm{OPT}OPT≤v≤ρ(n)OPT, and only on coverable instances with n≥n0n\ge n_0n≥n0​. Any algorithm that outputs a cover yields such a value, so this hypothesis is weaker than the paper's. The guard n≥n0n\ge n_0n≥n0​ is needed because (1−ε)ln⁡n<1(1-\varepsilon)\ln n<1(1−ε)lnn<1 for small nnn.
  • Machine model. The machines are Cook's deterministic one-tape machines. Multi-tape simulation costs a quadratic factor, which the class absorbs.
  • Probabilities are uniform counts over the (5n)ℓ(5n)^\ell(5n)ℓ random strings. Strategies are deterministic. Answers are canonical (satisfying on clause coordinates), as the paper assumes without loss of generality.
  • Not formalized. Randomized classes (ZTIME) are not defined here, so the following are omitted: the last sentence of Lemma 3.2, Proposition 6.1, and the randomized variants.
  • Ruling out a trivial formalization. The gap notion requires far-from-satisfiable formulas to have at least one clause. Otherwise the empty formula would be both a yes-instance and a no-instance, and Theorem 2.1.1 would hold trivially.
  • Infrastructure and reuse. The shared layer can serve other PCP-based hardness proofs: 3CNF-5 formulas, the kkk-prover system, partition systems, and the gap-NP-hardness notion. Welcome contributions include:
    • time bounds for list and table manipulations on one-tape machines;
    • a Hadamard-code construction satisfying the weight and distance conditions;
    • the union-bound and averaging lemmas behind Lemma 2.3.1 and Proposition 4.2.

Selected references

  • U. Feige, A threshold of ln n for approximating set cover, J. ACM 45(4), 634–652, 1998. https://doi.org/10.1145/285055.285059
  • C. Lund, M. Yannakakis, On the hardness of approximating minimization problems, J. ACM 41(5), 960–981, 1994. https://doi.org/10.1145/185675.306789
  • R. Raz, A parallel repetition theorem, SIAM J. Comput. 27(3), 763–803, 1998 (STOC 1995). https://doi.org/10.1137/S0097539795280895
  • M. Naor, L. J. Schulman, A. Srinivasan, Splitters and near-optimal derandomization, FOCS 1995, 182–191. https://doi.org/10.1109/SFCS.1995.492475
  • S. Arora, C. Lund, R. Motwani, M. Sudan, M. Szegedy, Proof verification and the hardness of approximation problems, J. ACM 45(3), 501–555, 1998. https://doi.org/10.1145/278298.278306
  • C. Papadimitriou, M. Yannakakis, Optimization, approximation, and complexity classes, J. Comput. Syst. Sci. 43(3), 425–440, 1991. https://doi.org/10.1016/0022-0000(91)90023-X
  • V. Chvátal, A greedy heuristic for the set-covering problem, Math. Oper. Res. 4(3), 233–235, 1979. https://doi.org/10.1287/moor.4.3.233
  • I. Dinur, D. Steurer, Analytical approach to parallel repetition, STOC 2014, 624–633. https://doi.org/10.1145/2591796.2591884
15 thms3 active usersReviewed
CombinatoricsComplexity TheoryOperations Research·Captain: mikedeng1

Scheduling Subject to Resource Constraints: Classification and Complexity I: Unit-Time Chains on Two Identical Machines with One Unit Resource Are Strongly NP-hardResearch Paper

Resource constraints and the easy/hard borderline in scheduling

Machine scheduling asks how to assign jobs to machines over time so that a criterion such as the makespan Cmax⁡C_{\max}Cmax​, the time at which the last job completes, is as small as possible. In practice jobs also compete for scarce resources beyond the machines themselves: tools, operators, memory, power. Błażewicz, Lenstra and Rinnooy Kan (DAM 1983) extended the standard three-field classification α∣β∣γ\alpha\mid\beta\mid\gammaα∣β∣γ of Graham, Lawler, Lenstra and Rinnooy Kan (1979) by a resource field resλσρres\lambda\sigma\rhoresλσρ. They then settled the complexity of every problem with parallel identical or uniform machines, unit-time jobs, precedence constraints and the Cmax⁡C_{\max}Cmax​ criterion. Their Fig. 2 separates the maximal polynomially solvable problems from the minimal NP-hard ones, and it has been the reference map for resource-constrained scheduling since.

Brief timeline of the problems involved:

  • 1975. Garey and Johnson (SIAM J. Comput. 4) show that P2∣res⋯ ,pj=1∣Cmax⁡P2\mid res\cdots, p_j=1\mid C_{\max}P2∣res⋯,pj​=1∣Cmax​ is solvable in polynomial time via matchings, and that P3∣res1⋅⋅,pj=1∣Cmax⁡P3\mid res1\cdot\cdot, p_j=1\mid C_{\max}P3∣res1⋅⋅,pj​=1∣Cmax​ and P2∣res1⋅⋅,tree,pj=1∣Cmax⁡P2\mid res1\cdot\cdot, tree, p_j=1\mid C_{\max}P2∣res1⋅⋅,tree,pj​=1∣Cmax​ are NP-hard in the strong sense, by reduction from 3-PARTITION.
  • 1976. Ullman (Complexity of sequencing problems, in Coffman, ed., Computer & Job/Shop Scheduling Theory, Wiley) gives strong NP-hardness of P2∣res111,prec,pj=1∣Cmax⁡P2\mid res111, prec, p_j=1\mid C_{\max}P2∣res111,prec,pj​=1∣Cmax​ under arbitrary precedence constraints.
  • 1983. Błażewicz, Lenstra and Rinnooy Kan prove Theorem 7: chains suffice. Two identical machines, one resource of size one, requirements in {0,1}\{0,1\}{0,1} and chain-like precedence already give a strongly NP-hard problem. The result dominates both earlier two-machine results.

Setting

There are nnn jobs J1,…,JnJ_1,\dots,J_nJ1​,…,Jn​ and mmm machines M1,…,MmM_1,\dots,M_mM1​,…,Mm​. Every job has processing time 111 on every machine, each machine handles at most one job at a time, and jobs are not preempted. There are lll resources; resource RhR_hRh​ has a positive integer size shs_hsh​, the amount available at any time, and job JjJ_jJj​ has a nonnegative integer requirement rhjr_{hj}rhj​, the amount it holds throughout its execution. A directed acyclic graph HHH on the jobs gives the precedence constraints: if HHH has a path from jjj to kkk (Jj→JkJ_j\to J_kJj​→Jk​), then JjJ_jJj​ must complete before JkJ_kJk​ starts. The precedence is chain-like when every vertex of HHH has indegree and outdegree at most one.

A schedule gives each job a machine and a real start time SjS_jSj​; the job occupies [Sj,Sj+1)[S_j, S_j+1)[Sj​,Sj​+1) and completes at Cj=Sj+1C_j = S_j+1Cj​=Sj​+1. It is feasible if jobs on one machine do not overlap, precedence is respected, and at every time ttt the jobs running at ttt require at most shs_hsh​ of each resource RhR_hRh​. The makespan is Cmax⁡=max⁡jCjC_{\max} = \max_j C_jCmax​=maxj​Cj​.

The problem P2∣res111,chain,pj=1∣Cmax⁡P2\mid res111, chain, p_j=1\mid C_{\max}P2∣res111,chain,pj​=1∣Cmax​ restricts this to m=2m=2m=2, one resource (λ=1\lambda=1λ=1) of size 111 (σ=1\sigma=1σ=1), every requirement at most 111 (ρ=1\rho=1ρ=1), and chain-like precedence. The problem P3∣res1⋅⋅,pj=1∣Cmax⁡P3\mid res1\cdot\cdot, p_j=1\mid C_{\max}P3∣res1⋅⋅,pj​=1∣Cmax​ has m=3m=3m=3, one resource of arbitrary size and requirements, and no precedence.

3-PARTITION: given ttt, a positive integer bbb and positive integers a1,…,a3ta_1,\dots,a_{3t}a1​,…,a3t​ with ∑jaj=tb\sum_j a_j = tb∑j​aj​=tb and 14b<aj<12b\tfrac14 b<a_j<\tfrac12 b41​b<aj​<21​b, can {1,…,3t}\{1,\dots,3t\}{1,…,3t} be split into ttt disjoint 3-element sets SiS_iSi​ with ∑j∈Siaj=b\sum_{j\in S_i}a_j=b∑j∈Si​​aj​=b?

A problem is NP-hard in the strong sense if it remains NP-hard when every number of the instance is written in unary.

Formalization targets

Goal: Theorem 7

3-PARTITION is NP-hard in the strong sense  ⟹  P2∣res111, chain, pj=1∣Cmax⁡ is NP-hard in the strong sense.\text{3-PARTITION is NP-hard in the strong sense} \;\Longrightarrow\; P2\mid res111,\ chain,\ p_j=1\mid C_{\max}\ \text{is NP-hard in the strong sense.}3-PARTITION is NP-hard in the strong sense⟹P2∣res111, chain, pj​=1∣Cmax​ is NP-hard in the strong sense.

The hypothesis is Garey and Johnson's theorem on 3-PARTITION, which the paper cites and does not prove. The conclusion concerns the decision version: given an instance and y∈Ny\in\mathbb Ny∈N, is there a feasible schedule with Cmax⁡≤yC_{\max}\le yCmax​≤y?

Milestones

  1. Proof of Theorem 4, the saturation equivalence. For positive bbb, aja_jaj​ with ∑jaj=tb\sum_j a_j=tb∑j​aj​=tb, the P3∣res1⋅⋅P3\mid res1\cdot\cdotP3∣res1⋅⋅ instance with 3t3t3t unit jobs, resource size bbb and requirements aja_jaj​ has a feasible schedule with Cmax⁡≤tC_{\max}\le tCmax​≤t iff the 3-PARTITION instance has a solution.
  2. Theorem 4 (Garey and Johnson). Under the same hypothesis as the goal, P3∣res1⋅⋅,pj=1∣Cmax⁡P3\mid res1\cdot\cdot, p_j=1\mid C_{\max}P3∣res1⋅⋅,pj​=1∣Cmax​ is NP-hard in the strong sense.
  3. Proof of Theorem 7, "if". A 3-PARTITION solution yields a feasible schedule of the constructed two-machine instance with Cmax⁡=2tbC_{\max}=2tbCmax​=2tb.
  4. Proof of Theorem 7, "only if". A feasible schedule of the constructed instance with Cmax⁡≤2tbC_{\max}\le 2tbCmax​≤2tb yields a 3-PARTITION solution.

Significance

Theorem 7 is the sharpest hardness result of the paper's classification. Without resources, two-machine unit-time scheduling with arbitrary precedence is polynomial (Coffman and Graham, Acta Inform. 1972); without precedence, it is polynomial under arbitrary resources (Theorem 1 of the paper). The theorem shows that combining the weakest nontrivial versions of both constraints, chains and one unit resource, already crosses the borderline. The paper's §4.1 extends the same reduction to the ∑Cj\sum C_j∑Cj​ and Lmax⁡L_{\max}Lmax​ criteria.

On the formal side, the mission provides a machine-checked model of resource-constrained scheduling with real start times, a definition of NP-hardness in the strong sense on top of the platform's Turing-machine formalization of P\mathrm PP and NP\mathrm{NP}NP, and 3-PARTITION as a reusable source problem. As far as the platform's corpus shows, none of Theorems 4 and 7, 3-PARTITION, or strong NP-hardness has been formalized before. Both theorems are proved in the literature; what remains is to formalize the reductions and their polynomial running time.

Difficulty

The combinatorial heart is the "only if" direction: a schedule of length 2tb2tb2tb must be shown to be rigid. Start times are arbitrary reals, so the first obstacle is to show that both machines are busy throughout [0,2tb)[0,2tb)[0,2tb), that the chain LLL forces unit spacing, and that the primed jobs of the chains Kj′K'_jKj′​ can only run in the intervals the chain LLL leaves free of the resource. Only after this is established can the index sets SiS_iSi​ be read off. Arguing on integer time slots from the start is not enough: the model allows fractional start times, and ruling them out is part of the proof.

The second obstacle is the complexity layer. NP-hardness is stated with respect to polynomial-time many-one reductions computed by one-tape Turing machines. The reduction from 3-PARTITION therefore has to be implemented and its running time bounded on unary codes. The constructed instance has 4tb4tb4tb jobs, which is polynomial in the unary length of the 3-PARTITION instance; this is exactly why the reduction proves hardness in the strong sense.

Formalization scope

  • Model. Jobs are Fin n and machines Fin m, 0-based. Only identical machines with unit processing times are modelled. Start times are real, execution intervals are half-open, and the resource constraint is imposed at every real time. Precedence is the transitive closure of the arc list of HHH. Cmax⁡=0C_{\max}=0Cmax​=0 for an empty instance.
  • Decision version. Thresholds yyy are natural numbers; this narrower class makes the hardness statement stronger.
  • Encoding. An instance is described by its list of numbers (n,m,ln,m,ln,m,l, the sizes, the requirements row by row, the number of arcs and the arcs, then yyy). The unary language is the set of unary codes of yes-instances over a two-letter alphabet. No pairing function is used. The class conditions (two machines, one unit resource, requirements at most one, chain-like acyclic HHH) are part of the yes-predicate.
  • Strong sense. Strong NP-hardness is NP-hardness of the unary language. This is equivalent to Garey and Johnson's definition, which bounds the largest number by a polynomial in the instance length.
  • Cited hypothesis. The goal and Theorem 4 assume strong NP-hardness of 3-PARTITION (with 14b<aj<12b\tfrac14 b<a_j<\tfrac12 b41​b<aj​<21​b) and nothing else. Stating the goal as a bare reduction between the two languages, or adding P≠NP\mathrm P\ne\mathrm{NP}P=NP, would not be Theorem 7.
  • Constructions. The two scheduling instances built from a 3-PARTITION instance are explicit definitions following the page, not arbitrary instances with a property.
  • Reuse. The scheduling model and the strong-NP-hardness layer are shared with the other missions of this series; 3-PARTITION serves any strong NP-hardness proof by number partitioning.

Welcome contributions: proofs of the four milestones; a formalized polynomial-time implementation of the reduction on unary codes; general lemmas about composing polynomial-time reductions on the one-tape machine model.

Selected references

  • J. Błażewicz, J. K. Lenstra, A. H. G. Rinnooy Kan, Scheduling subject to resource constraints: classification and complexity, Discrete Applied Mathematics 5 (1983) 11–24. https://doi.org/10.1016/0166-218X(83)90012-4
  • M. R. Garey, D. S. Johnson, Complexity results for multiprocessor scheduling under resource constraints, SIAM J. Comput. 4 (1975) 397–411. https://doi.org/10.1137/0204035
  • M. R. Garey, D. S. Johnson, Computers and Intractability: A Guide to the Theory of NP-Completeness, Freeman, 1979.
  • R. L. Graham, E. L. Lawler, J. K. Lenstra, A. H. G. Rinnooy Kan, Optimization and approximation in deterministic sequencing and scheduling: a survey, Ann. Discrete Math. 5 (1979) 287–326. https://doi.org/10.1016/S0167-5060(08)70356-X
  • J. D. Ullman, Complexity of sequencing problems, in: E. G. Coffman, Jr., ed., Computer & Job/Shop Scheduling Theory, Wiley, 1976, 139–164.
  • E. G. Coffman, Jr., R. L. Graham, Optimal scheduling for two-processor systems, Acta Informatica 1 (1972) 200–213. https://doi.org/10.1007/BF00288685
  • S. Cook, The P versus NP problem, Clay Mathematics Institute official problem description.
11 thms3 active usersReviewed
CombinatoricsOperations ResearchOptimization·Captain: mikedeng1

Worst-Case Performance Bounds for Simple One-Dimensional Packing Algorithms 4: First-Fit Decreasing Uses at Most 71/60 L* + 5 Bins When No Item Exceeds 1/2Research Paper

Motivation

Bin packing asks how to place a list of items with sizes in (0,1](0,1](0,1] into as few unit-capacity bins as possible. It models the cutting of stock material, the packing of files onto tracks of a disc and the assignment of jobs to machines with a common deadline. Deciding the optimum is NP-hard, so in practice simple rules are used, and the question is how far they can stray from the optimum in the worst case.

Johnson, Demers, Ullman, Garey and Graham (SIAM J. Comput. 3(4), 1974) gave the first sharp worst-case bounds for the four classical rules. For First-Fit Decreasing (FFD), the rule that sorts the items into nonincreasing order and then places each into the first bin with room, they announced the bound FFD(L)≤119L∗+4FFD(L)\le\frac{11}{9}L^*+4FFD(L)≤911​L∗+4, whose full proof in Johnson's thesis exceeds 75 pages. To show the method, Section 4 of the paper proves a simpler bound in detail: when no item exceeds 1/21/21/2, FFD uses at most 7160L∗+5\frac{71}{60}L^*+56071​L∗+5 bins. That result is the subject of this mission.

Timeline:

  • 1973: D. S. Johnson's MIT thesis, Near-optimal bin packing algorithms, contains the complete proofs of the 11/911/911/9 and 71/6071/6071/60 bounds.
  • 1974: Johnson, Demers, Ullman, Garey and Graham publish the 71/6071/6071/60 bound for lists in (0,1/2](0,1/2](0,1/2] (Theorem 4.1) with a proof that is complete except for parts of two lemmas, and show by example that 71/6071/6071/60 cannot be lowered.
  • 1985: B. S. Baker gives a shorter proof of the 11/911/911/9 bound for FFD (J. Algorithms 6, 1985).
  • 2007: G. Dósa determines the tight additive constant 6/96/96/9 in the 11/911/911/9 bound (ESCAPE 2007, LNCS 4614).

Setting

A list is a finite sequence L=(a1,…,an)L=(a_1,\dots,a_n)L=(a1​,…,an​) of real numbers in (0,1](0,1](0,1]; values may repeat. A bin has capacity 111; its level is the sum of the numbers in it. The optimum L∗L^*L∗ is the least number of bins into which the elements of LLL can be placed with no bin level exceeding 111.

First-Fit places a1,a2,…a_1,a_2,\dotsa1​,a2​,… in order into bins B1,B2,…B_1,B_2,\dotsB1​,B2​,…, each initially at level 000: aia_iai​ goes into the bin of least index whose level β\betaβ satisfies β≤1−ai\beta\le 1-a_iβ≤1−ai​. First-Fit Decreasing first arranges LLL into nonincreasing order and then runs First-Fit. FFD(L)FFD(L)FFD(L) is the number of bins it uses.

The proof uses a weight WWW on finite sets of elements. For an integer k≥1k\ge1k≥1, xxx is a kkk-piece if x∈(1k+1,1k]x\in(\frac1{k+1},\frac1k]x∈(k+11​,k1​], and a kkk-bin is a bin whose largest element is a kkk-piece. Set w1(x)=⌊1/x⌋−1w_1(x)=\lfloor 1/x\rfloor^{-1}w1​(x)=⌊1/x⌋−1. A pair (x,y)(x,y)(x,y) obeys relation kkk if xxx is a kkk-piece and kx+y≤1kx+y\le1kx+y≤1; then w2(x,y)=w1(x)+k−1kw1(y)w_2(x,y)=w_1(x)+\frac{k-1}{k}w_1(y)w2​(x,y)=w1​(x)+kk−1​w1​(y), and otherwise w2(x,y)=w1(x)+w1(y)w_2(x,y)=w_1(x)+w_1(y)w2​(x,y)=w1​(x)+w1​(y). For a partition π\piπ of XXX into one- and two-element sets, with each pair ordered (earlier, later) in the nonincreasing order,

w12(π)=∑{x}∈πw1(x)+∑(x,y)∈πw2(x,y),W(X)=min⁡πw12(π).w_{12}(\pi)=\sum_{\{x\}\in\pi}w_1(x)+\sum_{(x,y)\in\pi}w_2(x,y),\qquad W(X)=\min_\pi w_{12}(\pi).w12​(π)={x}∈π∑​w1​(x)+(x,y)∈π∑​w2​(x,y),W(X)=πmin​w12​(π).

BASIC is the set of elements of LLL that are kkk-pieces lying in a kkk-bin of the FFD packing of LLL, for some kkk; SURPLUS is the rest of LLL.

Formalization targets

Goal: Theorem 4.1

for every list L⊆(0,12]:FFD(L)≤7160L∗+5.\text{for every list } L\subseteq(0,\tfrac12]:\qquad FFD(L)\le\frac{71}{60}L^*+5 .for every list L⊆(0,21​]:FFD(L)≤6071​L∗+5.

The constants are those printed in the paper. The multiplicative constant 71/6071/6071/60 is best possible.

Milestones

  1. Lemma 3.3 (FFD part): if FFD(L)>rL∗+dFFD(L)>rL^*+dFFD(L)>rL∗+d with r,d≥1r,d\ge1r,d≥1, the list L′L'L′ of the elements of LLL exceeding (r−1)/r(r-1)/r(r−1)/r also has FFD(L′)>rL′∗+dFFD(L')>rL'^*+dFFD(L′)>rL′∗+d.
  2. Claim 4.2.1: for N≥4N\ge4N≥4 and L⊆(1N,12]L\subseteq(\frac1N,\frac12]L⊆(N1​,21​], ∑x∈BASICw1(x)≥FFD(L)−∑j=2N−1j−1j\sum_{x\in\mathrm{BASIC}}w_1(x)\ge FFD(L)-\sum_{j=2}^{N-1}\frac{j-1}{j}∑x∈BASIC​w1​(x)≥FFD(L)−∑j=2N−1​jj−1​.
  3. Claim 4.2.2: for N≥4N\ge4N≥4, L⊆(1N,12]L\subseteq(\frac1N,\frac12]L⊆(N1​,21​] and every partition π\piπ of LLL into one- and two-element sets, w12(π)≥w1(BASIC)−∑j=3N−11jw_{12}(\pi)\ge w_1(\mathrm{BASIC})-\sum_{j=3}^{N-1}\frac1jw12​(π)≥w1​(BASIC)−∑j=3N−1​j1​.
  4. Lemma 4.2: for N≥4N\ge4N≥4 and L⊆(1N,12]L\subseteq(\frac1N,\frac12]L⊆(N1​,21​], W(L)≥FFD(L)−N+2W(L)\ge FFD(L)-N+2W(L)≥FFD(L)−N+2.
  5. Subadditivity: W(X1∪⋯∪Xk)≤∑iW(Xi)W(X_1\cup\dots\cup X_k)\le\sum_i W(X_i)W(X1​∪⋯∪Xk​)≤∑i​W(Xi​).
  6. Lemma 4.3: if X⊆(17,12]X\subseteq(\frac17,\frac12]X⊆(71​,21​] and ∑x∈Xx≤1\sum_{x\in X}x\le1∑x∈X​x≤1, then W(X)≤7160W(X)\le\frac{71}{60}W(X)≤6071​.

A companion item states the Remark after Theorem 4.1: for every N≥1N\ge1N≥1 there is a list with all elements below 1/31/31/3, L∗=60NL^*=60NL∗=60N and FFD(L)=71NFFD(L)=71NFFD(L)=71N.

Significance

Theorem 4.1 shows the weighting-function method in its simplest nontrivial form: a weight whose total is within a constant of the algorithm's bin count, and which no feasible bin can exceed by more than the target ratio. The same method, with more elaborate weights, gives the 11/911/911/9 bound for FFD, and it is the model for later worst-case analyses of packing heuristics. The Remark shows that 71/6071/6071/60 is exact for items in (0,1/2](0,1/2](0,1/2], and the Corollary on p. 322 extends the analysis to the asymptotic ratio RFFDαR^\alpha_{FFD}RFFDα​ when items are bounded by α∈(8/29,1/2]\alpha\in(8/29,1/2]α∈(8/29,1/2].

The source proof is partial. The billing argument behind Claim 4.2.2 is given only when two auxiliary conditions (G1) and (G2) hold ("The more intricate argument here omitted", p. 321), and Lemma 4.3 is checked in four of about seventy-four cases ("leaving the remaining 70-odd, more or less routine, cases to the ambitious reader", p. 321). Complete details are in Johnson's thesis. The theorem itself is established. A formalization therefore gives the first complete, checked proof in a single place. The finite case analysis of Lemma 4.3 is well suited to machine checking. No machine-checked proof of any FFD bound is known to exist.

Difficulty

The obvious weight w1w_1w1​ alone fails. Claim 4.2.1 shows that w1(BASIC)w_1(\mathrm{BASIC})w1​(BASIC) covers the FFD bins, but many sets XXX of elements with sum at most 111 have w1(X)>71/60w_1(X)>71/60w1​(X)>71/60, for example two 222-pieces, a 555-piece and a 666-piece. The pair discounts of w2w_2w2​ repair Lemma 4.3, but they must then be paid for in Lemma 4.2, for every partition. That is Claim 4.2.2: a charge from each discounted pair to distinct SURPLUS elements that are no larger. The charge is straightforward only when no member of a pair obeying relation kkk lies in a bin of type k′<kk'<kk′<k. In general a pair's larger element may already have been charged by a smaller relation, and the paper omits the argument that handles this. Lemma 4.3 is elementary but has many cases, each determined by the piece types in XXX and the relations they obey.

Formalization scope

A list is L : List ℝ with IsList L (0<a≤10<a\le10<a≤1 for each element) in every statement. L∗L^*L∗ is optBins L, the least bbb such that some map from positions to Fin b has every bin sum at most 111. The First-Fit run keeps the nonempty bins as a List (List ℝ), and opens a new bin at the end exactly when no existing bin fits, which is the paper's "least jjj". The fit test is β+a≤1\beta+a\le1β+a≤1. FFD is First-Fit on sortDesc L, the mergeSort into nonincreasing order; ties do not affect the bin count. Indices are 000-based.

W(X)W(X)W(X) sorts XXX into nonincreasing order and minimises w12w_{12}w12​ over the involutions of its positions: fixed points are singletons, and a pair i<σ(i)i<\sigma(i)i<σ(i) is oriented (larger, smaller). The minimum is over a finite nonempty set, so it is attained. BASIC is a set of positions of sortDesc L, and each position's bin is its bin in the final FFD packing. In w2w_2w2​, k=⌊1/x⌋k=\lfloor1/x\rfloork=⌊1/x⌋ is the piece type of the first element. Sums ∑j=2N−1\sum_{j=2}^{N-1}∑j=2N−1​ are over Finset.Icc 2 (N - 1) with N≥4N\ge4N≥4.

The goal's range is (0,1/2](0,1/2](0,1/2]. The restriction to (1/7,1/2](1/7,1/2](1/7,1/2] belongs only to the proof, through Lemma 3.3. Stating the goal for (1/7,1/2](1/7,1/2](1/7,1/2], weakening 71/6071/6071/60 or 555, or making WWW an unattained infimum would each change the theorem. Only the FFD half of Lemma 3.3 is stated. Claim 4.2.1 is stated with Lemma 4.2's standing hypothesis N≥4N\ge4N≥4. The Remark's printed range 0<ε≤5/870<\varepsilon\le5/870<ε≤5/87 is a misprint: its FFD packing needs ε<1/174\varepsilon<1/174ε<1/174, and the companion item states only the existence claim.

Infrastructure needed: a usable API for the First-Fit run (the invariants of the fold, bin levels, the order of bins), a lemma that FFD bins receive items in nonincreasing order, and a decision procedure for Lemma 4.3's case analysis over piece types. The model file and the weight file are reusable for the 11/911/911/9 bound (mission 3 of this series) and for the bounded-α\alphaα corollaries. Contributions of proofs of Lemma 4.3 by computer-checked case enumeration, and of the missing general case of Claim 4.2.2, are especially welcome.

Selected references

  • D. S. Johnson, A. Demers, J. D. Ullman, M. R. Garey, R. L. Graham, Worst-Case Performance Bounds for Simple One-Dimensional Packing Algorithms, SIAM J. Comput. 3(4):299–325, 1974. https://doi.org/10.1137/0203025
  • D. S. Johnson, Near-Optimal Bin Packing Algorithms, Ph.D. thesis, Massachusetts Institute of Technology, 1973 (reference [8] of the paper).
  • B. S. Baker, A new proof for the first-fit decreasing bin-packing algorithm, J. Algorithms 6, 1985.
  • G. Dósa, The tight bound of first fit decreasing bin-packing algorithm is FFD(I) ≤ 11/9 OPT(I) + 6/9, ESCAPE 2007, Lecture Notes in Computer Science 4614, 2007.
9 thms3 active usersReviewed
CombinatoricsOperations ResearchOptimization·Captain: mikedeng1

Approximation Techniques for Average Completion Time Scheduling III: From One Machine to Many with Delay ListResearch Paper

Motivation

Minimizing the sum of weighted completion times ∑jwjCj\sum_j w_jC_j∑j​wj​Cj​ is one of the standard objectives of machine scheduling: it measures the average time a job spends in the system, weighted by its importance. With release dates or precedence constraints the problem is NP-hard already on one machine, and on mmm identical parallel machines it is harder still, so the literature of the 1990s concentrated on approximation algorithms. Many of these, including LP-based ones, are naturally designed for a single machine, where an order of the jobs determines the schedule.

Chekuri, Motwani, Natarajan and Stein (SIAM J. Comput. 31(1), 2001) gave a generic way to move from one machine to many. Their §4 describes an algorithm, Delay List, that takes any one-machine schedule as a priority list and produces an mmm-machine schedule, and proves that a ρ\rhoρ-approximate one-machine schedule yields a ((1+β)ρ+1+1/β)\bigl((1+\beta)\rho+1+1/\beta\bigr)((1+β)ρ+1+1/β)-approximate mmm-machine schedule for every β>0\beta>0β>0. The guarantee holds with release dates and arbitrary precedence constraints simultaneously, which at the time gave the best bounds known for several special cases, for example a factor 4 for series-parallel precedence without release dates.

Setting

An instance has nnn jobs J0,…,Jn−1J_0,\dots,J_{n-1}J0​,…,Jn−1​. Job JjJ_jJj​ has processing time pj>0p_j>0pj​>0, release date rj≥0r_j\ge 0rj​≥0 and weight wj>0w_j>0wj​>0. Precedence constraints form a strict partial order ≺\prec≺: i≺ji\prec ji≺j means that JjJ_jJj​ may start only after JiJ_iJi​ completes.

A feasible nonpreemptive schedule on mmm machines assigns each job a start time SjS_jSj​ and a machine; each job runs uninterrupted for pjp_jpj​ time units on its machine, two jobs on one machine do not overlap, Sj≥rjS_j\ge r_jSj​≥rj​, and Si+pi≤SjS_i+p_i\le S_jSi​+pi​≤Sj​ whenever i≺ji\prec ji≺j. The completion time is Cj=Sj+pjC_j=S_j+p_jCj​=Sj​+pj​ and the value of the schedule is ∑jwjCj\sum_j w_jC_j∑j​wj​Cj​. A one-machine schedule is the case m=1m=1m=1.

The critical-path length κj\kappa_jκj​ (Definition 4.1) is pj+rjp_j+r_jpj​+rj​ for a job without predecessors and pj+max⁡{max⁡i≺jκi, rj}p_j+\max\{\max_{i\prec j}\kappa_i,\,r_j\}pj​+max{maxi≺j​κi​,rj​} otherwise; it is the earliest time JjJ_jJj​ could complete with unlimited machines.

A list is an ordering π\piπ of the jobs. Delay List with parameter β>0\beta>0β>0 processes time continuously. A job is ready once it is released and all its predecessors have completed; qjmq^m_jqjm​ is the time it becomes ready. The head is the first unscheduled job of the list. Idle machine-time is recorded as charged to jobs. Whenever a machine is idle:

  1. if the head is ready, it is started, and charged all uncharged idle time in (qjm,sjm)(q^m_j,s^m_j)(qjm​,sjm​);
  2. otherwise the first ready job JkJ_kJk​ of the list is started as soon as at least βpk\beta p_kβpk​ units of uncharged idle time have accumulated, and is charged βpk\beta p_kβpk​ of it;
  3. otherwise nothing happens.

For a job JiJ_iJi​, BiB_iBi​ is the set of jobs up to and including JiJ_iJi​ in the list, AiA_iAi​ the set after it, Oi⊆AiO_i\subseteq A_iOi​⊆Ai​ the set of jobs of AiA_iAi​ started before JiJ_iJi​, and p(A)=∑k∈Apkp(A)=\sum_{k\in A}p_kp(A)=∑k∈A​pk​. Definition 4.4 builds from the schedule a backward path Pi′P'_iPi′​ ending at JiJ_iJi​, whose length is κi′\kappa'_iκi′​.

Formalization targets

Goal: Theorem 4.13

Let S1S^1S1 be a feasible one-machine schedule of the instance with ∑jwjCj1≤ρ∑jwjCj′\sum_j w_jC^1_j\le\rho\sum_j w_jC'_j∑j​wj​Cj1​≤ρ∑j​wj​Cj′​ for every feasible one-machine schedule C′C'C′. Let m≥2m\ge 2m≥2 and β>0\beta>0β>0. Every Delay List schedule SmS^mSm built on the completion order of S1S^1S1 satisfies, for every feasible mmm-machine schedule NNN,

∑jwjCjm≤((1+β)ρ+1+1β)∑jwjCjN.\sum_j w_jC^m_j\le\Bigl((1+\beta)\rho+1+\frac1\beta\Bigr)\sum_j w_jC^N_j .j∑​wj​Cjm​≤((1+β)ρ+1+β1​)j∑​wj​CjN​.

Milestones, in the order the proof uses them

  • Fact 4.5: κi′≤κi\kappa'_i\le\kappa_iκi′​≤κi​.
  • Fact 4.6: the idle time charged to JiJ_iJi​ is at most βpi\beta p_iβpi​.
  • Lemma 4.7: no uncharged idle time remains in (qim,sim)(q^m_i,s^m_i)(qim​,sim​), and that idle time is charged only to jobs in BiB_iBi​.
  • Lemma 4.8: the idle time charged to AiA_iAi​ within (0,sim)(0,s^m_i)(0,sim​) is at most m(κi′−pi)m(\kappa'_i-p_i)m(κi′​−pi​), so p(Oi)≤m(κi′−pi)/β≤m(κi−pi)/βp(O_i)\le m(\kappa'_i-p_i)/\beta\le m(\kappa_i-p_i)/\betap(Oi​)≤m(κi′​−pi​)/β≤m(κi​−pi​)/β.
  • Theorem 4.9: Cim≤(1+β)p(Bi)/m+(1+1/β)κi′−pi/βC^m_i\le(1+\beta)p(B_i)/m+(1+1/\beta)\kappa'_i-p_i/\betaCim​≤(1+β)p(Bi​)/m+(1+1/β)κi′​−pi​/β for any list obeying precedence.
  • Lemma 4.10: COPTm≥COPT1/mC^m_{\mathrm{OPT}}\ge C^1_{\mathrm{OPT}}/mCOPTm​≥COPT1​/m.
  • Lemma 4.11: COPTm≥∑iwiκi=COPT∞C^m_{\mathrm{OPT}}\ge\sum_i w_i\kappa_i=C^\infty_{\mathrm{OPT}}COPTm​≥∑i​wi​κi​=COPT∞​.
  • Corollary 4.12: Cim≤(1+β)Ci1/m+(1+1/β)κiC^m_i\le(1+\beta)C^1_i/m+(1+1/\beta)\kappa_iCim​≤(1+β)Ci1​/m+(1+1/β)κi​ when the list is the completion order of S1S^1S1.

A further item states that a Delay List schedule exists for every instance and every list, so that the goal does not hold vacuously.

Significance

The result. Theorem 4.13 turns every one-machine approximation algorithm for weighted completion time with release dates and precedence into an mmm-machine algorithm at a bounded loss. With an optimal one-machine schedule and β=1\beta=1β=1 the factor is 444 (Corollary 4.14, for series-parallel orders), and the bounds are job-by-job (Theorem 4.9, Corollary 4.12), which the paper uses in Remark 4.15 to extend the method to other metrics and to one-machine schedules that ignore release dates. The same algorithm is the engine of the paper's 222\sqrt222​-approximation for parallel machines with release dates (§4.5).

Formalizing it. The theorem has been proved since 1997 (SODA) and 2001 (journal). There is no machine-checked version of it or of any of its lemmas, and the platform currently has no model of scheduling with release dates and precedence constraints. A formalization produces a precise specification of Delay List, whose informal description is given in discrete time and repaired in a remark; a checked proof of the charging argument; and reusable lower bounds (Lemmas 4.10 and 4.11) for any later work on parallel-machine scheduling with precedence.

Difficulty

The obvious attempt, list scheduling (start the first available job of the list whenever a machine is free), fails with non-identical processing times: a long job taken out of order can occupy a machine and delay a more valuable job that becomes ready shortly afterwards. Delay List allows out-of-order jobs only against accumulated idle time, and the analysis rests on a charging invariant. Stating it needs care about time (the paper's discrete-time exposition can over-charge by a time unit), about which idle time a charge consumes, and about many jobs being scheduled at one instant. The bound must hold simultaneously for release dates and arbitrary precedence constraints, where idle machines can be forced both by jobs that are not yet released and by chains of predecessors, and it must hold for every tie-breaking choice of the algorithm.

Formalization scope

Jobs are Fin n, machines Fin m, and times are real numbers. Processing times are positive, release dates nonnegative and weights positive, as in §1. Precedence is a strict partial order, the transitive closure of the paper's DAG; κ\kappaκ, readiness and feasibility are unchanged by taking the closure. The optimum is never a real infimum: "within a factor ρ\rhoρ of an optimal one-machine schedule" and "within a factor ccc of an optimal mmm-machine schedule" are inequalities against every feasible schedule of the same instance, with the same release dates and precedence constraints.

Delay List is formalized in the continuous-time version described in the proof of Fact 4.6, as a predicate on runs that records start times, machines, the order in which jobs are scheduled at equal times, and charge windows. A case-2 charge takes the most recent uncharged idle time, and idle time is charged by whole time slices. Every guarantee is claimed for every run satisfying the predicate. The ties in Definition 4.4 are broken arbitrarily, so statements involving κi′\kappa'_iκi′​ hold for every admissible path. Lemma 4.10 uses nonpreemptive one-machine schedules. Lemma 4.11's COPT∞C^\infty_{\mathrm{OPT}}COPT∞​ is modelled by nnn machines.

It would be trivializing to assume the conclusions of Fact 4.6 or Lemma 4.7 as properties of the run, or to measure ρ\rhoρ against a relaxation without release dates or precedence; both are ruled out. The algorithm's rules are the only hypotheses on the run.

Not stated: the running time of Delay List; the discrete-time algorithm; Corollary 4.14 (it needs a formal class of series-parallel orders and the external one-machine algorithm of Adolphson for them); Remark 4.15 (release-date-free one-machine schedules), whose hypotheses the paper does not pin down; and the extension to delays between jobs. Contributions of general infrastructure, such as idle-time accounting for step functions and lemmas about list schedules under precedence, are welcome and reusable beyond this mission.

Selected references

  • C. Chekuri, R. Motwani, B. Natarajan, C. Stein, Approximation Techniques for Average Completion Time Scheduling, SIAM Journal on Computing 31(1):146–166, 2001. https://doi.org/10.1137/S0097539797327180
  • R. L. Graham, Bounds for certain multiprocessing anomalies, Bell System Technical Journal 45:1563–1581, 1966. https://doi.org/10.1002/j.1538-7305.1966.tb01709.x
  • D. Adolphson, Single machine job sequencing with precedence constraints, SIAM Journal on Computing 6(1):40–54, 1977. https://doi.org/10.1137/0206002
12 thms3 active usersReviewed
CombinatoricsOperations ResearchOptimization·Captain: mikedeng1

Approximation Techniques for Average Completion Time Scheduling II: A 2.83-Approximation for Parallel Machines with Release DatesResearch Paper

Motivation

Minimizing the average completion time of jobs that arrive over time is a basic objective in machine scheduling. It measures how long a job spends in the system on average. With several identical machines, release dates and no preemption (written P∣rj∣∑CjP|r_j|\sum C_jP∣rj​∣∑Cj​), the problem is strongly NP-hard already on one machine. Research has therefore looked for approximation algorithms: polynomial-time rules whose total completion time is provably within a constant factor of every feasible schedule.

A common approach solves a relaxation that is easy to optimize and converts its solution into a feasible schedule. Chekuri, Motwani, Natarajan and Stein (SIAM J. Comput. 31(1), 2001) use a relaxation that needs neither linear programming nor dynamic programming: pretend that the mmm machines are one machine that is mmm times as fast, and allow preemption.

Timeline:

  • 1996, Chakrabarti, Phillips, Schulz, Shmoys, Stein and Wein (ICALP 1996, LNCS 1099, pp. 646–657): a (2.89+ϵ)(2.89+\epsilon)(2.89+ϵ)-approximation for P∣rj∣∑CjP|r_j|\sum C_jP∣rj​∣∑Cj​.
  • 2001, Chekuri, Motwani, Natarajan and Stein (SIAM J. Comput. 31(1), §3 and §4.5). §3 gives a simple (3−1/m)(3-1/m)(3−1/m)-approximation by list scheduling from the one-machine relaxation. §4.5 combines it with the Delay List conversion to obtain 22≈2.832\sqrt2\approx2.8322​≈2.83. This mission's goal is the §4.5 result.
  • 1999, Afrati, Bampis, Chekuri, Karger, Kenyon, Khanna, Milis, Queyranne, Skutella, Stein and Sviridenko (FOCS 1999, pp. 32–43): polynomial-time approximation schemes for P∣rj∣∑wjCjP|r_j|\sum w_jC_jP∣rj​∣∑wj​Cj​. These settle the approximability, but the algorithms are far more involved than the ones formalized here.

Setting

An instance has nnn jobs J0,…,Jn−1J_0,\dots,J_{n-1}J0​,…,Jn−1​ and m≥1m\ge1m≥1 identical machines. Job JjJ_jJj​ has a processing time pj>0p_j>0pj​>0 and a release date rj≥0r_j\ge0rj​≥0.

A feasible schedule gives each job a start time Sj≥rjS_j\ge r_jSj​≥rj​ and a machine. Job JjJ_jJj​ runs without interruption on its machine during [Sj,Sj+pj)[S_j,S_j+p_j)[Sj​,Sj​+pj​), and two jobs on the same machine never overlap. The completion times are Cj=Sj+pjC_j=S_j+p_jCj​=Sj​+pj​ and the objective is ∑jCj\sum_j C_j∑j​Cj​. Cj∗C^*_jCj∗​ denotes the completion times of an arbitrary feasible schedule, against which every bound is stated.

The one-machine relaxation I1I1I1 has the same jobs and a single machine. Job JjJ_jJj​ has processing time pj/mp_j/mpj​/m and release date rjr_jrj​ in I1I1I1, and may be preempted. A preemptive schedule P1P1P1 of I1I1I1 gives each job a processing rate ρj(t)≥0\rho_j(t)\ge0ρj​(t)≥0. The rates sum to at most 111 at each time, and no job is processed before its release date. Each job receives pj/mp_j/mpj​/m units in total. Its completion time CjP1C^{P1}_jCjP1​ is the first time by which all of it has been processed. P1P1P1 is optimal if ∑jCjP1\sum_j C^{P1}_j∑j​CjP1​ is minimal among all such schedules.

A list is an ordering π\piπ of the jobs, and the completion order of P1P1P1 lists the jobs by nondecreasing CjP1C^{P1}_jCjP1​. Two ways of turning a list into an mmm-machine schedule are compared.

  • Strict-order list scheduling gives the schedule NNN. The jobs start in the order of the list. Each job starts at the earliest time that is no earlier than its release date, no earlier than the previous job's start, and at which some machine is free.
  • Delay List with parameter β>0\beta>0β>0 gives the schedule DDD. When a machine is idle, Delay List starts the first unscheduled job of the list if it has been released. If that job has not been released, the first released job of the list may jump ahead, but only once at least βpj\beta p_jβpj​ units of idle time (machine × time) have accumulated that no earlier job has charged. The job then charges exactly that amount. A job started in list order charges all uncharged idle time since its release.

Formalization targets

Goal: Lemma 4.19

With P1P1P1 optimal, π\piπ its completion order, NNN the strict-order list schedule of π\piπ and DDD a Delay List schedule of π\piπ with β0=3−22\beta_0=\sqrt{3-2\sqrt2}β0​=3−22​​, every feasible schedule satisfies

min⁡(∑jCjN, ∑jCjD)≤22 ∑jCj∗.\min\Bigl(\sum_j C^N_j,\ \sum_j C^D_j\Bigr)\le 2\sqrt2\,\sum_j C^*_j .min(j∑​CjN​, j∑​CjD​)≤22​j∑​Cj∗​.

The printed lemma says 2.832.832.83. Its proof gives 22≈2.82842\sqrt2\approx2.828422​≈2.8284, which is stated here.

Milestones

In the order the proof uses them:

  1. (4.2): if ∑jpj>α∑jCj∗\sum_j p_j>\alpha\sum_j C^*_j∑j​pj​>α∑j​Cj∗​ then ∑jrj≤(1−α)∑jCj∗\sum_j r_j\le(1-\alpha)\sum_j C^*_j∑j​rj​≤(1−α)∑j​Cj∗​.
  2. Lemma 3.1: ∑jCjP1≤∑jCj∗\sum_j C^{P1}_j\le\sum_j C^*_j∑j​CjP1​≤∑j​Cj∗​ for P1P1P1 optimal.
  3. (3.3): ∑jCjN≤2∑jCjP1+(1−1/m)∑jpj\sum_j C^N_j\le 2\sum_j C^{P1}_j+(1-1/m)\sum_j p_j∑j​CjN​≤2∑j​CjP1​+(1−1/m)∑j​pj​ for any P1P1P1.
  4. Lemma 3.2: ∑jCjN≤(3−1/m)∑jCj∗\sum_j C^N_j\le(3-1/m)\sum_j C^*_j∑j​CjN​≤(3−1/m)∑j​Cj∗​.
  5. Theorem 4.9, specialised to no precedence constraints. With BiB_iBi​ the jobs at or before JiJ_iJi​ in the list,
CiD≤(1+β)p(Bi)m+(1+1β)(ri+pi)−piβ.C^D_i\le\frac{(1+\beta)p(B_i)}{m}+\Bigl(1+\frac1\beta\Bigr)(r_i+p_i)-\frac{p_i}{\beta}.CiD​≤m(1+β)p(Bi​)​+(1+β1​)(ri​+pi​)−βpi​​.
  1. Lemma 4.18: ∑jCjD≤(2+β)∑jCj∗+1β∑jrj\sum_j C^D_j\le(2+\beta)\sum_j C^*_j+\frac1\beta\sum_j r_j∑j​CjD​≤(2+β)∑j​Cj∗​+β1​∑j​rj​.
  2. The balanced bound: under (4.2)'s hypothesis, ∑jCjD≤(2+β+(1−α)/β)∑jCj∗\sum_j C^D_j\le(2+\beta+(1-\alpha)/\beta)\sum_j C^*_j∑j​CjD​≤(2+β+(1−α)/β)∑j​Cj∗​.
  3. The constants: at α=22−2\alpha=2\sqrt2-2α=22​−2 and β=3−22\beta=\sqrt{3-2\sqrt2}β=3−22​​, 2+α=2+β+(1−α)/β=222+\alpha=2+\beta+(1-\alpha)/\beta=2\sqrt22+α=2+β+(1−α)/β=22​.

Two existence statements accompany them. One says an optimal P1P1P1 exists. The other says a Delay List schedule exists for every list and every β>0\beta>0β>0.

Significance

The result gives a 222\sqrt222​-approximation for P∣rj∣∑CjP|r_j|\sum C_jP∣rj​∣∑Cj​ that is simple to state and runs in O(nlog⁡n)O(n\log n)O(nlogn) time. It improves the 2.89+ϵ2.89+\epsilon2.89+ϵ bound of Chakrabarti et al. Neither of its two algorithms achieves the ratio alone. It comes from an analysis in which each algorithm is good exactly when the other is bad. List scheduling is good when processing times are small relative to the optimum. Delay List is good when release dates are small. The inequality (4.2) connects the two cases.

The component results are reusable beyond this paper. The one-machine relaxation lower bound (Lemma 3.1) and the (3−1/m)(3-1/m)(3−1/m) bound for list scheduling from it (Lemma 3.2) apply to any conversion from a fast single machine. The per-job bound of Theorem 4.9 is the core of the Delay List technique. Its general form, with precedence constraints, drives the paper's results for precedence-constrained scheduling.

All results are proved in the paper. None of them has a machine-checked proof that this mission knows of. A formalization would check the Delay List charging argument, which the paper states only in discrete time and adapts to continuous time in one sentence. It would also produce reusable Lean definitions of parallel-machine schedules with release dates and of list scheduling.

Difficulty

The arithmetic of the goal is routine once the milestones are in place. The substance lies in two places.

The first is Lemma 3.1 together with the "standard makespan argument" behind (3.2). The one-machine relaxation must be related to the mmm-machine schedule, and to the list schedule, with care about release dates. In particular, in the list schedule every machine is busy between the last release among the first jjj jobs of the list and the start of the jjj-th job. Proving this needs the strict order.

The second, and harder, is Theorem 4.9. The obvious argument bounds the waiting time of job JiJ_iJi​ by the work of the jobs ahead of it, but Delay List lets later jobs jump ahead. The idle time before JiJ_iJi​ starts and the work of the jobs that jump ahead of it must both be controlled, and the paper's charging argument for this depends on where charged idle time lies on the time axis and on which jobs charged it. Making that bookkeeping precise for a continuous-time algorithm is the main formalization cost.

Formalization scope

Jobs are Fin n and machines Fin m with m≥1m\ge1m≥1. Times are real, processing times are positive and release dates nonnegative. There are no weights and no precedence constraints. "Optimal" is never an infimum. Every bound is stated against every feasible nonpreemptive schedule, and P1P1P1's optimality is the hypothesis that its total completion time is at most that of every preemptive schedule of I1I1I1.

Committed conventions:

  • Preemptive schedules of I1I1I1 are rate functions, so the machine of I1I1I1 may be shared. The paper's one-job-at-a-time schedules are a special case.
  • Lists are bijections Fin n ≃ Fin n. A list of P1P1P1 may break ties in completion time in any way, and every such list is covered.
  • NNN is the strict-order variant of list scheduling, which footnote 3 of the paper contrasts with the greedy variant used in §4. It is a recursive definition over list positions.
  • Delay List is the continuous-time algorithm, as adopted in the proof of Fact 4.6. It is a predicate on start times, machines, the scheduling order and charge windows. A job scheduled out of order takes its charge from the most recent uncharged idle time; the paper leaves this placement open. Theorem 4.9 and Lemma 4.18 assume m≥2m\ge2m≥2, the setting of §4.1. The goal assumes only m≥1m\ge1m≥1.
  • The printed Lemma 4.18 lacks a ∑j\sum_j∑j​ on the C∗C^*C∗ term. The summed form of its proof's last display is stated.

The statement cannot be made easy by the hypotheses. Two existence items show that an optimal P1P1P1 and a Delay List schedule always exist, so no statement is vacuous. The bound is against every feasible schedule, not against the relaxation's value.

Not stated: the O(nlog⁡n)O(n\log n)O(nlogn) running time, the on-line version of §3's algorithm, and Delay List with precedence constraints (Theorem 4.9 in general, which is the subject of mission III of this series). Contributions welcome: proofs of the milestones, and reusable lemmas on list scheduling with release dates.

Selected references

  • C. Chekuri, R. Motwani, B. Natarajan, C. Stein, Approximation Techniques for Average Completion Time Scheduling, SIAM J. Comput. 31(1):146–166, 2001. https://doi.org/10.1137/S0097539797327180
  • S. Chakrabarti, C. A. Phillips, A. S. Schulz, D. B. Shmoys, C. Stein, J. Wein, Improved scheduling algorithms for minsum criteria, in Proceedings of ICALP 1996, LNCS 1099, Springer, pp. 646–657 (reference [3] of the paper).
  • F. Afrati et al., Approximation schemes for minimizing average weighted completion time with release dates, in Proceedings of the 40th IEEE FOCS, 1999, pp. 32–43 (reference [2] of the paper).
11 thms3 active usersReviewed
CombinatoricsOperations ResearchOptimization+1·Captain: mikedeng1

Approximation Techniques for Average Completion Time Scheduling I: Best-α on One Machine with Release DatesResearch Paper

Motivation

Minimizing the average completion time of jobs that arrive over time is one of the basic objectives of machine scheduling: it measures how long, on average, a job waits in the system. On a single machine with release dates and no preemption (written 1∣rj∣∑Cj1|r_j|\sum C_j1∣rj​∣∑Cj​), the problem is strongly NP-hard, so research has focused on approximation algorithms whose guarantees are stated against every feasible schedule.

The standard route runs through the preemptive relaxation. When jobs may be interrupted and resumed, the shortest-remaining-processing-time rule (SRPT) produces an optimal schedule, and its value is a lower bound for every nonpreemptive schedule. The question is how to turn that preemptive schedule into a nonpreemptive one without losing too much.

Timeline:

  • 1995, Phillips, Stein and Wein (WADS 1995, pp. 86–97): order the jobs by their SRPT completion times and schedule them nonpreemptively in that order. This gives a 2-approximation. Later 2-approximations are by Hoogeveen and Vestjens (IPCO 1996), Stougie (1995), and Goemans (SODA 1997). Hoogeveen and Vestjens also showed that deterministic on-line algorithms cannot beat 2.
  • 2001, Chekuri, Motwani, Natarajan and Stein (SIAM J. Comput. 31(1)): order by α\alphaα-points instead of completion times, choose α\alphaα at random, and take the best α\alphaα off-line. This gives the e/(e−1)≈1.58e/(e-1)\approx1.58e/(e−1)≈1.58 bound for Best-α\alphaα that is the goal of this mission, and an optimal randomized on-line algorithm.
  • 1999, Afrati et al. (FOCS 1999): a polynomial-time approximation scheme for 1∣rj∣∑wjCj1|r_j|\sum w_jC_j1∣rj​∣∑wj​Cj​. This settled the approximability of the problem, but the resulting algorithms are far from simple.

Setting

An instance has nnn jobs J0,…,Jn−1J_0,\dots,J_{n-1}J0​,…,Jn−1​. Job JjJ_jJj​ has a processing time pj>0p_j>0pj​>0, a release date rj≥0r_j\ge0rj​≥0, and, where the objective is weighted, a weight wj>0w_j>0wj​>0. There is one machine.

A nonpreemptive schedule assigns each job a start time Sj≥rjS_j\ge r_jSj​≥rj​ such that the intervals [Sj,Sj+pj)[S_j,S_j+p_j)[Sj​,Sj​+pj​) are pairwise disjoint. Its completion times are Cj=Sj+pjC_j=S_j+p_jCj​=Sj​+pj​.

A preemptive schedule PPP specifies, for each time ttt, which job runs at ttt, if any. Job JjJ_jJj​ runs only at times t≥max⁡(0,rj)t\ge\max(0,r_j)t≥max(0,rj​), receives exactly pjp_jpj​ units of processing in total, and finishes by some finite time. Its completion time CjPC^P_jCjP​ is the first time by which all of JjJ_jJj​ has been processed. For α∈(0,1]\alpha\in(0,1]α∈(0,1], its α\alphaα-point CjP(α)C^P_j(\alpha)CjP​(α) is the first time by which αpj\alpha p_jαpj​ units have been processed.

For a job JiJ_iJi​, TiT_iTi​ denotes the idle time of PPP before CiPC^P_iCiP​. xijx_{ij}xij​ denotes the fraction of JjJ_jJj​ processed before CiPC^P_iCiP​. The paper writes SiP(β)S^P_i(\beta)SiP​(β) for the set of jobs with xij=βx_{ij}=\betaxij​=β, and also for their total processing time.

One-machine list scheduling in a given order runs the jobs nonpreemptively in that order. Each job starts at the later of its release date and the completion of the previous job in the list. An α\alphaα-schedule is list scheduling in nondecreasing order of the α\alphaα-points CjP(α)C^P_j(\alpha)CjP​(α). CjαC^\alpha_jCjα​ denotes the completion times of an α\alphaα-schedule.

Random-α\alphaα draws α\alphaα from a distribution on (0,1](0,1](0,1] and outputs the α\alphaα-schedule. Best-α\alphaα outputs the α\alphaα-schedule of smallest total completion time min⁡α∑jCjα\min_\alpha\sum_j C^\alpha_jminα​∑j​Cjα​.

Formalization targets

Goal: Corollary 2.7

Let PPP be optimal among preemptive schedules for ∑jCj\sum_j C_j∑j​Cj​. Then there is α∈(0,1]\alpha\in(0,1]α∈(0,1] such that every α\alphaα-schedule derived from PPP satisfies

∑jCjα  ≤  ee−1∑jCjfor every feasible nonpreemptive schedule (Cj)j.\sum_j C^\alpha_j\;\le\;\frac{e}{e-1}\sum_j C_j\qquad\text{for every feasible nonpreemptive schedule } (C_j)_j .j∑​Cjα​≤e−1e​j∑​Cj​for every feasible nonpreemptive schedule (Cj​)j​.

Since Best-α\alphaα returns a schedule no worse than this α\alphaα-schedule, Best-α\alphaα is an e/(e−1)e/(e-1)e/(e−1)-approximation.

Milestones

  1. The calculus behind the constant. For f(α)=eα/(e−1)f(\alpha)=e^\alpha/(e-1)f(α)=eα/(e−1) and every β∈(0,1]\beta\in(0,1]β∈(0,1],
∫0β1+α−ββf(α) dα=1e−1.\int_0^\beta\frac{1+\alpha-\beta}{\beta}f(\alpha)\,d\alpha=\frac1{e-1}.∫0β​β1+α−β​f(α)dα=e−11​.
  1. Lemma 2.2: CiP=Ti+∑0<β≤1βSiP(β)C^P_i=T_i+\sum_{0<\beta\le1}\beta S^P_i(\beta)CiP​=Ti​+∑0<β≤1​βSiP​(β).
  2. Lemma 2.3: Ciα≤Ti+(1+α)∑β≥αSiP(β)+∑β<αβSiP(β)C^\alpha_i\le T_i+(1+\alpha)\sum_{\beta\ge\alpha}S^P_i(\beta)+\sum_{\beta<\alpha}\beta S^P_i(\beta)Ciα​≤Ti​+(1+α)∑β≥α​SiP​(β)+∑β<α​βSiP​(β).
  3. Lemma 2.5: if α\alphaα has density fff on (0,1](0,1](0,1], then E[Ciα]≤(1+δ)CiPE[C^\alpha_i]\le(1+\delta)C^P_iE[Ciα​]≤(1+δ)CiP​ with δ=max⁡0<β≤1∫0β1+α−ββf(α) dα\delta=\max_{0<\beta\le1}\int_0^\beta\frac{1+\alpha-\beta}{\beta}f(\alpha)\,d\alphaδ=max0<β≤1​∫0β​β1+α−β​f(α)dα.
  4. Theorem 2.6, for the weighted objective with PPP optimal among preemptive schedules: the expected approximation ratio of Random-α\alphaα is at most 222 for uniform α\alphaα, at most 1.81.81.8 for α=1\alpha=1α=1 w.p. 3/53/53/5 and α=1/2\alpha=1/2α=1/2 w.p. 2/52/52/5, and at most e/(e−1)e/(e-1)e/(e−1) for the density eα/(e−1)e^\alpha/(e-1)eα/(e−1).

Companion statements, not milestones:

  • the upper bound of Theorem 2.1, ∑jCjα≤(1+1/α)∑jCjP\sum_jC^\alpha_j\le(1+1/\alpha)\sum_jC^P_j∑j​Cjα​≤(1+1/α)∑j​CjP​;
  • the existence of an optimal preemptive schedule.

Significance

The e/(e−1)e/(e-1)e/(e−1) bound shows that conversion from the preemptive relaxation can beat the factor 2 of the natural ordering. It does so by exploiting that no single instance is bad for many values of α\alphaα at once. The α\alphaα-point technique was also used with LP relaxations, for example by Goemans (SODA 1997) and by Schulz and Skutella. The randomized version is an optimal randomized on-line algorithm for 1∣rj∣∑Cj1|r_j|\sum C_j1∣rj​∣∑Cj​. Lemma 2.3 is a statement about any preemptive schedule, so it applies wherever a good preemptive or fractional schedule is available.

All results of the mission are proved in the paper, except that the proof of Theorem 2.6, part 2 is omitted there. No machine-checked proof of them is known. A complete development would give a verified model of preemptive one-machine schedules, α\alphaα-points and list scheduling, together with the averaging argument over α\alphaα. These are reusable for the later results of the same paper and for the α\alphaα-point literature.

Difficulty

The obvious argument bounds each job's α\alphaα-schedule completion time directly against its preemptive completion time. That argument loses a factor 1+1/α1+1/\alpha1+1/α (Theorem 2.1), which is at least 2 for every fixed α\alphaα. The improvement needs Lemma 2.3. There the charge to each job depends on how much of it was done by CiPC^P_iCiP​ relative to α\alphaα, and the idle time TiT_iTi​ is not inflated at all. Proving Lemma 2.3 requires reasoning about a preemptive schedule as a measure on time, and about how moving pieces of jobs changes completion times. A proof that treats the preemptive schedule as a finite list of pieces must first show that nothing is lost by this discretization.

The averaging step needs the expectation over α\alphaα to be an honest integral. The map α↦Ciα\alpha\mapsto C^\alpha_iα↦Ciα​ must be shown integrable, which requires a fixed rule for ties between equal α\alphaα-points.

Formalization scope

  • Model. Jobs are Fin n, time is real, pj>0p_j>0pj​>0 and rj≥0r_j\ge0rj​≥0. The paper admits pj=0p_j=0pj​=0 only in its tightness instances.
    • A preemptive schedule is a function σ:R→\sigma:\mathbb R\toσ:R→ Option (Fin n) (none = idle). Each job's run set is measurable, lies in [max⁡(0,rj),∞)[\max(0,r_j),\infty)[max(0,rj​),∞), is bounded above, and has Lebesgue measure pjp_jpj​.
    • Completion times and α\alphaα-points are infima of nonempty sets that are bounded below.
    • TiT_iTi​ is the measure of the idle set in [0,CiP)[0,C^P_i)[0,CiP​).
    • The paper's sums over β\betaβ are sums over jobs, weighted by the fraction xijx_{ij}xij​.
  • List scheduling is strict: jobs never overtake the list order, and the machine is free from time 000.
    • Lemma 2.3, Theorem 2.1, Theorem 2.6.2 and the goal hold for every tie-break among equal α\alphaα-points.
    • The expectations (Lemma 2.5, Theorem 2.6.1 and 2.6.3) use the tie-break by job index. They assert integrability as part of the conclusion.
  • Optimality. "Approximation ratio ccc" is stated as an inequality against every feasible nonpreemptive schedule, never against an infimum.
    • The optimality of PPP among preemptive schedules is the paper's standing assumption for its upper bounds (p. 151). It appears as a hypothesis of Theorem 2.6 and of the goal.
    • The lemmas hold for arbitrary PPP and do not carry it.
    • An existence statement shows the hypothesis can be met.
  • Lemma 2.5's δ\deltaδ is replaced by any upper bound of the integrals over β∈(0,1]\beta\in(0,1]β∈(0,1]. This is equivalent, and it avoids assuming that the maximum is attained.
  • Not stated:
    • the running time O(n2)O(n^2)O(n2) of Best-α\alphaα and the optimality of SRPT;
    • the tightness parts of Theorem 2.1 and Corollary 2.4, and the lower bounds of Theorem 2.9, which use zero-length jobs;
    • the on-line Theorem 2.8, which needs a model of on-line algorithms.
  • Trivializing formalization ruled out. Dropping the optimality of PPP from the goal would turn it into a statement about arbitrary preemptive schedules, which is Lemma 2.5, not Corollary 2.7. Comparing against ∑jCjP\sum_jC^P_j∑j​CjP​ instead of every nonpreemptive schedule would likewise remove the content of the corollary.

Contributions are welcome at every level. The calculus milestone and Lemma 2.2 are good first targets.

Selected references

  • C. Chekuri, R. Motwani, B. Natarajan, C. Stein, Approximation Techniques for Average Completion Time Scheduling, SIAM J. Comput. 31(1):146–166, 2001. https://doi.org/10.1137/S0097539797327180
  • C. Phillips, C. Stein, J. Wein, Scheduling jobs that arrive over time, Proc. 4th Workshop on Algorithms and Data Structures (WADS), 1995, pp. 86–97 (reference [25] of the paper; no link verified).
  • J. A. Hoogeveen, A. P. A. Vestjens, Optimal on-line algorithms for single-machine scheduling, Proc. 5th IPCO, 1996, pp. 404–414 (reference [21]; no link verified).
  • M. X. Goemans, Improved approximation algorithms for scheduling with release dates, Proc. 8th ACM-SIAM SODA, 1997, pp. 591–598 (reference [12]; no link verified).
  • F. Afrati et al., Approximation schemes for minimizing average weighted completion time with release dates, Proc. 40th FOCS, 1999 (reference [2]; no link verified).
9 thms3 active usersReviewed
CombinatoricsOperations ResearchOptimization·Captain: mikedeng1

Local Search Heuristics for k-Median and Facility Location Problems IV: Local Search with Multi-Copy Moves for Capacitated Facility Location Has Locality Gap 4Research Paper

Motivation

Facility location asks where to open service points (warehouses, plants, servers) and how to connect customers to them so that the total opening cost plus the total connection cost is minimum. In the capacitated version each facility can serve only a limited number of customers, which is the situation in most applications: a warehouse has a floor area, a server a bandwidth. The problem is NP-hard, and the algorithms used in practice for it are often simple local search heuristics: start from a solution and repeatedly apply a small change that lowers the cost, until no such change exists.

The quality of such a heuristic is measured by its locality gap: the largest possible ratio between the cost of a solution that no allowed change can improve and the cost of an optimum solution. Arya, Garg, Khandekar, Meyerson, Munagala and Pandit (SIAM J. Comput. 33(3), 2004) gave locality-gap analyses for k-median, uncapacitated facility location, and the capacitated problem in which several copies of a facility may be opened. This mission formalizes their §5, the capacitated case.

Timeline (as surveyed on pp. 545–546 of the paper). For the variant 1-CFL, where at most one facility may be opened at each location, Korupolu, Plaxton and Rajaraman (1998) showed that local search with add, drop and swap moves has locality gap at most 8 when capacities are uniform; Chudak and Williamson (IPCO 1999) refined this to 6, and Pál, Tardos and Wexler gave a local search with gap 9 for nonuniform capacities. For ∞-CFL, the variant with copies studied here, the known algorithms were LP-based: a 3-approximation of Chudak and Shmoys (1999) for uniform capacities, a 4-approximation of Jain and Vazirani for nonuniform capacities, and a 2-approximation of Mahdian, Ye and Zhang. Arya et al. (2004) analysed local search for ∞-CFL with nonuniform capacities: with a new move that drops any set of open copies and opens several copies of one facility, the locality gap is at most 4 (Theorem 5.5), and scaling the facility costs gives 2+3+ϵ2 + \sqrt3 + \epsilon2+3​+ϵ (p. 561). The tight example for uncapacitated facility location (§4.3) also shows a locally optimum solution of cost 3 times the optimum, so the locality gap of the procedure lies between 3 and 4; its exact value was left open (§6).

Setting

An instance consists of a finite set CCC of clients, a set FFF of facilities and a distance ccc on C∪FC \cup FC∪F that is nonnegative, symmetric and satisfies the triangle inequality; cjic_{ji}cji​ is the cost of serving client jjj from facility iii. Every facility iii has an opening cost fi≥0f_i \ge 0fi​≥0 and an integer capacity ui>0u_i > 0ui​>0. Any number of copies of a facility may be opened; each copy of iii costs fif_ifi​ and serves at most uiu_iui​ clients.

A solution XXX opens a finite list of copies, copy sss being a copy of facility loc(s)\mathrm{loc}(s)loc(s), and assigns every client jjj to a copy σ(j)\sigma(j)σ(j) so that each copy sss serves at most uloc(s)u_{\mathrm{loc}(s)}uloc(s)​ clients. Write NX(s)N_X(s)NX​(s) for the set of clients served by copy sss and NX(T)N_X(T)NX​(T) for the clients served by a set TTT of copies. Its costs are

costf(X)=∑sfloc(s),costs(X)=∑j∈Ccj loc(σ(j)),cost(X)=costf(X)+costs(X).\mathrm{cost}_f(X) = \sum_s f_{\mathrm{loc}(s)}, \qquad \mathrm{cost}_s(X) = \sum_{j\in C} c_{j\,\mathrm{loc}(\sigma(j))}, \qquad \mathrm{cost}(X) = \mathrm{cost}_f(X) + \mathrm{cost}_s(X).costf​(X)=s∑​floc(s)​,costs​(X)=j∈C∑​cjloc(σ(j))​,cost(X)=costf​(X)+costs​(X).

The neighbourhood (9) of a solution whose multiset of open facilities is SSS consists of

  1. S+s′S + s'S+s′: one more copy of any facility s′s's′;
  2. S−T+l⋅{s′}S - T + l\cdot\{s'\}S−T+l⋅{s′}: close any set TTT of open copies and open l≥1l \ge 1l≥1 copies of a facility s′s's′, provided l us′≥∣NS(T)∣l\,u_{s'} \ge |N_S(T)|lus′​≥∣NS​(T)∣.

XXX is locally optimum if no neighbour, with any feasible assignment of the clients, has smaller cost.

Formalization targets

Goal: Theorem 5.5

For every instance with at least one client, every locally optimum solution XXX and every solution OOO,

cost(X)≤4 cost(O).\mathrm{cost}(X) \le 4\,\mathrm{cost}(O).cost(X)≤4cost(O).

Milestones

In the order the paper's proof uses them:

  1. Lemma 5.1 (service cost): costs(X)≤costf(O)+costs(O)\mathrm{cost}_s(X) \le \mathrm{cost}_f(O) + \mathrm{cost}_s(O)costs​(X)≤costf​(O)+costs​(O).
  2. Lemma 5.2: for every set UUU of copies of XXX and every facility s′s's′,
⌈∣NX(U)∣us′⌉fs′+∑s∈U∣NX(s)∣ css′≥∑s∈Ufs.\left\lceil \frac{|N_X(U)|}{u_{s'}}\right\rceil f_{s'} + \sum_{s\in U} |N_X(s)|\, c_{ss'} \ge \sum_{s\in U} f_s .⌈us′​∣NX​(U)∣​⌉fs′​+s∈U∑​∣NX​(s)∣css′​≥s∈U∑​fs​.
  1. Lemma 5.4: in the graph with arcs vs→wov_s \to w_ovs​→wo​ of length csoc_{so}cso​ and wo→sinkw_o \to \mathrm{sink}wo​→sink of length fo/uof_o/u_ofo​/uo​, ∣NX(s)∣|N_X(s)|∣NX​(s)∣ units can be routed from every vsv_svs​ at cost at most costs(X)+costs(O)+costf(O)\mathrm{cost}_s(X) + \mathrm{cost}_s(O) + \mathrm{cost}_f(O)costs​(X)+costs​(O)+costf​(O).
  2. Inequality (10): the shortest-path flow, with ToT_oTo​ the copies routed through wow_owo​, satisfies ∑o∑s∈To∣NX(s)∣(cso+fo/uo)≤costs(X)+costs(O)+costf(O)\sum_o\sum_{s\in T_o}|N_X(s)|(c_{so} + f_o/u_o) \le \mathrm{cost}_s(X) + \mathrm{cost}_s(O) + \mathrm{cost}_f(O)∑o​∑s∈To​​∣NX​(s)∣(cso​+fo​/uo​)≤costs​(X)+costs​(O)+costf​(O).
  3. Inequality (11): ∑ofo+∑o∑s∈To∣NX(s)∣(cso+fo/uo)≥costf(X)\sum_o f_o + \sum_o \sum_{s\in T_o} |N_X(s)|(c_{so} + f_o/u_o) \ge \mathrm{cost}_f(X)∑o​fo​+∑o​∑s∈To​​∣NX​(s)∣(cso​+fo​/uo​)≥costf​(X).
  4. Lemma 5.3 (facility cost): costf(X)≤3 costf(O)+2 costs(O)\mathrm{cost}_f(X) \le 3\,\mathrm{cost}_f(O) + 2\,\mathrm{cost}_s(O)costf​(X)≤3costf​(O)+2costs​(O).

A companion item states the scaled bound of p. 561: a local optimum for facility costs (3−1)f(\sqrt3 - 1) f(3​−1)f has cost at most (2+3) cost(O)(2 + \sqrt3)\,\mathrm{cost}(O)(2+3​)cost(O) in the original instance.

Significance

The result. Theorem 5.5 gives a constant locality gap for a local search procedure for capacitated facility location with copies and nonuniform capacities, a variant previously approached through LP-based algorithms; the drop-add move it analyses is the paper's new operation for this problem. The scaled bound 2+3≈3.7322 + \sqrt3 \approx 3.7322+3​≈3.732 gives an approximation algorithm once local search is run to approximate local optimality. The paper also shows (Figure 13, the procedure T-hunt) that the exponentially large neighbourhood can be searched with a knapsack oracle, so the analysis applies to an implementable algorithm.

Formalizing it. The result is proved in the paper; to our knowledge no machine-checked version exists. The mission produces a checked model of capacitated facility location with copies (solutions, costs, the multiset neighbourhood) and of the locality-gap argument. The per-copy model and the flow comparison of Lemma 5.4 are reusable for other capacitated location problems and for local search analyses that compare a local optimum with an optimum through a flow or a matching.

Difficulty

The obvious attempt imitates the uncapacitated analysis: close one copy of XXX and send its clients to a nearby copy of OOO. With capacities this fails, since that copy of OOO may be too small to absorb them, and single-copy moves do not certify a constant bound. With the drop-add move a single copy of OOO must be charged for a whole group of copies of XXX, and the groups must be chosen so that the charges add up to a constant times cost(O)\mathrm{cost}(O)cost(O); the rounding ⌈∣NX(T)∣/us′⌉\lceil |N_X(T)|/u_{s'}\rceil⌈∣NX​(T)∣/us′​⌉ of the number of new copies costs an additional costf(O)\mathrm{cost}_f(O)costf​(O) that has to be absorbed as well.

Formalization scope

  • Solutions. A solution is a structure CFLSol Cl Fa u: a number n of open copies, a map loc : Fin n → Fa giving the facility of each copy, and an assignment σ : Cl → Fin n with the capacity constraint for every copy. Copies are separate indices because NS(s)N_S(s)NS​(s) is per copy. Its multiset of facilities is the image multiset of loc.
  • Costs. A solution's cost is computed under its own assignment. The paper's cost of a multiset is the minimum over feasible assignments. Because every neighbour is compared with every feasible assignment, and OOO ranges over every assignment, the statements are equivalent to the paper's. The move with T={s}T = \{s\}T={s}, s′=loc(s)s' = \mathrm{loc}(s)s′=loc(s), l=1l = 1l=1 makes every reassignment of XXX's clients a neighbour, so a locally optimum XXX carries a minimum-cost assignment.
  • Neighbourhood. Local optimality ranges over the whole of (9): every s′s's′, every set TTT of copies (including ∅\emptyset∅ and all copies) and every l≥1l \ge 1l≥1 with lus′≥∣NX(T)∣l u_{s'} \ge |N_X(T)|lus′​≥∣NX​(T)∣. It is not restricted to what the search procedure T-hunt examines.
  • Standing assumptions. Distances are nonnegative, symmetric and satisfy the triangle inequality on C∪FC \cup FC∪F; d(x,x)=0d(x,x) = 0d(x,x)=0 is not assumed. Capacities are natural numbers with ui>0u_i > 0ui​>0; costs are real with fi≥0f_i \ge 0fi​≥0; every client has unit demand. Ratios fo/uof_o/u_ofo​/uo​ and the ceiling of Lemma 5.2 are computed in R\mathbb RR.
  • Added hypothesis. The goal, Lemmas 5.2 and 5.3 and the companion assume at least one client. Without clients a single idle copy of a facility with f=1f = 1f=1, u=1u = 1u=1 is locally optimum at cost 1 while the empty solution costs 0, so these statements fail. The paper's instances implicitly have clients.
  • No trivialization. OOO is any solution, not a fixed optimum, and the bounds are multiplied out (cost(X)≤4 cost(O)\mathrm{cost}(X) \le 4\,\mathrm{cost}(O)cost(X)≤4cost(O), never a ratio). The empty solution is excluded only by the presence of a client, not by a default cost.
  • Out of scope. The procedure T-hunt and the knapsack oracle, running time, the ϵ\epsilonϵ of approximate local optimality, and arbitrary demands.

Contributions are welcome at every level: proofs of the milestones, alternative proofs of Lemma 5.4 or (10) (for instance through a matching argument instead of flows), and general infrastructure for multiset neighbourhoods and assignment problems.

Selected references

  • V. Arya, N. Garg, R. Khandekar, A. Meyerson, K. Munagala, V. Pandit, Local Search Heuristics for k-Median and Facility Location Problems, SIAM J. Comput. 33(3):544–562, 2004. https://doi.org/10.1137/S0097539702416402
  • M. R. Korupolu, C. G. Plaxton, R. Rajaraman, Analysis of a Local Search Heuristic for Facility Location Problems, J. Algorithms 37(1):146–188, 2000. https://doi.org/10.1006/jagm.2000.1100
10 thms3 active usersReviewed
Functional AnalysisOptimization·Captain: Lucas

The Grothendieck Constant: New Upper and Lower BoundsOpen Problem

Motivation

Given a real matrix A=(aij)∈Rm×nA=(a_{ij})\in\mathbb R^{m\times n}A=(aij​)∈Rm×n, consider maximizing the bilinear form ∑i,jaijxiyj\sum_{i,j}a_{ij}x_iy_j∑i,j​aij​xi​yj​ over sign vectors x∈{±1}mx\in\{\pm1\}^mx∈{±1}m, y∈{±1}ny\in\{\pm1\}^ny∈{±1}n. This discrete optimum, written OPT(A)\mathrm{OPT}(A)OPT(A), is closely tied to the cut norm of a matrix and is NP-hard to compute. Relaxing each sign to a unit vector and each product to an inner product gives the semidefinite value SDP(A)\mathrm{SDP}(A)SDP(A), computable in polynomial time. Grothendieck's inequality (Grothendieck, 1953) states that the relaxation overshoots by at most a universal factor: there is a finite KKK, independent of AAA, of m,nm,nm,n, and of the dimension of the vectors, with SDP(A)≤K⋅OPT(A)\mathrm{SDP}(A)\le K\cdot\mathrm{OPT}(A)SDP(A)≤K⋅OPT(A) for every AAA. The Grothendieck constant KGK_GKG​ is the least such KKK — equivalently, the worst-case integrality gap of the canonical semidefinite relaxation of this bilinear problem.

The constant is not a curiosity of one optimization problem. It originated in functional analysis, where it is central to the geometry of Banach spaces and to harmonic analysis; it governs the approximation ratio available for cut norms; and, in quantum information, it measures the maximal advantage of quantum over classical correlations in Bell-type experiments. Its exact value has been open since 1953.

A timeline of the bounds:

  • 1953, Grothendieck. Existence of a finite KKK, together with the lower bound KG≥π/2=1.5707…K_G\ge\pi/2=1.5707\ldotsKG​≥π/2=1.5707…
  • 1977, Krivine. KG≤π/(2log⁡(1+2))=1.7822…K_G\le\pi/\bigl(2\log(1+\sqrt2)\bigr)=1.7822\ldotsKG​≤π/(2log(1+2​))=1.7822…, obtained by analyzing hyperplane rounding, and conjectured to be optimal.
  • 1984/1991, Davie and Reeds (independently). KG≥1.6769…K_G\ge1.6769\ldotsKG​≥1.6769…, from an explicit high-dimensional Gaussian hard instance.
  • 2011, Braverman–Makarychev–Makarychev–Naor. Krivine's conjecture is false: KG<π/(2log⁡(1+2))K_G<\pi/(2\log(1+\sqrt2))KG​<π/(2log(1+2​)) strictly, with no quantitative gap.
  • 2014, Naor–Regev. Mixtures of Krivine schemes are asymptotically optimal: rounding schemes of this one family approach the true value of KGK_GKG​.
  • 2026, Heilman; Jones–Malavolta. The first improvements on Davie–Reeds, by 10−2610^{-26}10−26 and 10−1210^{-12}10−12 respectively; and the first explicit numerical improvements on Krivine's bound, of order 10−510^{-5}10−5 (Heilman; Li–Saha–Xue et al.).
  • 2026, Saha–Li–Xue–Chaudhuri–Klivans–Kothari–Meka. The bounds this mission targets:
6π11 ≤ KG ≤ π2log⁡(1+2)−3.47×10−4,\frac{6\pi}{11}\ \le\ K_G\ \le\ \frac{\pi}{2\log(1+\sqrt2)}-3.47\times10^{-4},116π​ ≤ KG​ ≤ 2log(1+2​)π​−3.47×10−4,

i.e. 1.7135…≤KG≤1.7818…1.7135\ldots\le K_G\le1.7818\ldots1.7135…≤KG​≤1.7818…, which fixes the tenths digit of KGK_GKG​ at 777.

Setting

Fix m,n∈Nm,n\in\mathbb Nm,n∈N and A∈Rm×nA\in\mathbb R^{m\times n}A∈Rm×n.

OPT(A):=max⁡x∈{±1}m,  y∈{±1}n∑i,jaijxiyj,SDP(A):=sup⁡d∈N sup⁡ui,vj∈Sd−1∑i,jaij⟨ui,vj⟩.\mathrm{OPT}(A):=\max_{x\in\{\pm1\}^m,\;y\in\{\pm1\}^n}\sum_{i,j}a_{ij}x_iy_j,\qquad \mathrm{SDP}(A):=\sup_{d\in\mathbb N}\ \sup_{u_i,v_j\in S^{d-1}}\sum_{i,j}a_{ij}\langle u_i,v_j\rangle .OPT(A):=x∈{±1}m,y∈{±1}nmax​i,j∑​aij​xi​yj​,SDP(A):=d∈Nsup​ ui​,vj​∈Sd−1sup​i,j∑​aij​⟨ui​,vj​⟩.

Here u1,…,umu_1,\dots,u_mu1​,…,um​ and v1,…,vnv_1,\dots,v_nv1​,…,vn​ are unit vectors of a common but arbitrary finite dimension ddd. Since a sign is a unit vector in dimension one, OPT(A)≤SDP(A)\mathrm{OPT}(A)\le\mathrm{SDP}(A)OPT(A)≤SDP(A). Call KKK a Grothendieck bound if SDP(A)≤K⋅OPT(A)\mathrm{SDP}(A)\le K\cdot\mathrm{OPT}(A)SDP(A)≤K⋅OPT(A) for every mmm, nnn and AAA, and set KG:=inf⁡{K:K is a Grothendieck bound}K_G:=\inf\{K: K\text{ is a Grothendieck bound}\}KG​:=inf{K:K is a Grothendieck bound}.

Upper bounds on KGK_GKG​ come from rounding algorithms. A Krivine scheme of dimension kkk is a pair of partitions of Rk\mathbb R^kRk into a +1+1+1 region and a −1-1−1 region, encoded by measurable odd functions f,g:Rk→{±1}f,g:\mathbb R^k\to\{\pm1\}f,g:Rk→{±1}: the algorithm maps each SDP vector to a Gaussian point in Rk\mathbb R^kRk, correlated according to the inner products, and reads off the label of the region the point lands in. Taking f=g=sgn⁡(z1)f=g=\operatorname{sgn}(z_1)f=g=sgn(z1​) recovers random hyperplane rounding. The quality of a scheme is carried by its normalized correlation function

H(t):=π2 E[f(X)g(Y)],H(t):=\frac{\pi}{2}\,\mathbb E\bigl[f(X)g(Y)\bigr],H(t):=2π​E[f(X)g(Y)],

where X,YX,YX,Y are standard Gaussian vectors in Rk\mathbb R^kRk with E[XiYi]=t\mathbb E[X_iY_i]=tE[Xi​Yi​]=t for every coordinate iii. For the half-space partition H(t)=arcsin⁡tH(t)=\arcsin tH(t)=arcsint, whose analysis gives Krivine's bound. Writing the odd expansion H(t)=b1t+b3t3+⋯H(t)=b_1t+b_3t^3+\cdotsH(t)=b1​t+b3​t3+⋯, the hyperplane scheme sits at (b1,b3)=(1,16)(b_1,b_3)=(1,\tfrac16)(b1​,b3​)=(1,61​).

Formalization targets

Goal

6π11 ≤ KG ≤ π2log⁡(1+2)−3.47×10−4\frac{6\pi}{11}\ \le\ K_G\ \le\ \frac{\pi}{2\log(1+\sqrt2)}-3.47\times10^{-4}116π​ ≤ KG​ ≤ 2log(1+2​)π​−3.47×10−4

This is the two-sided bound the source paper states as the outcome of its Theorems 2.1 and 2.2. It is the weakest statement that carries both of the paper's contributions at once; each side is also a milestone in its own right, so partial progress is recorded even if only one direction closes.

Milestones

The milestone list runs from the classical background to the two new bounds: OPT≤SDP\mathrm{OPT}\le\mathrm{SDP}OPT≤SDP; the existence of a finite Grothendieck bound; KG≥π/2K_G\ge\pi/2KG​≥π/2; Krivine's KG≤π/(2log⁡(1+2))K_G\le\pi/(2\log(1+\sqrt2))KG​≤π/(2log(1+2​)); the affine coefficient constraint b3≥2b1−116b_3\ge2b_1-\tfrac{11}{6}b3​≥2b1​−611​ valid for every Krivine scheme (Theorem 2.2, equation (1)); the transfer of a member of the affine family into a lower bound on KGK_GKG​ (Appendix A); the lower bound KG≥6π/11K_G\ge6\pi/11KG​≥6π/11 (Theorem 2.2); and the cubic–quintic upper bound (Theorem 2.1).

Significance

The two target bounds narrow an interval that had been essentially static for four decades: before 2026 the state of the art was 1.6769…≤KG≤1.7822…1.6769\ldots\le K_G\le1.7822\ldots1.6769…≤KG​≤1.7822…, wide enough that the tenths digit was unknown. The lower bound is also methodologically new. Every previous lower bound was obtained by exhibiting a hard instance; this one instead proves a ceiling on the performance of every rounding scheme in the Krivine family and converts that ceiling, through the Naor–Regev optimality theorem, into a bound on the constant. The affine constraint b3≥2b1−116b_3\ge2b_1-\tfrac{11}{6}b3​≥2b1​−611​ is the transportable core of that argument: being affine in the coefficients, it survives mixing schemes and passing to limits, which is exactly what the reduction to KGK_GKG​ requires.

On the formalization side, nothing here is machine-checked today. The upper bound (Theorem 2.1) is certified by interval arithmetic in the companion paper, and the lower bound's central one-dimensional inequality likewise rests on a computer-assisted certificate; reproducing either inside Lean means building a rigorous numeric layer on top of the analytic argument. Ahead of that, the mission needs a formal definition of KGK_GKG​ itself and of the Krivine-scheme apparatus, neither of which exists in Mathlib — these are reusable well beyond this mission, since Grothendieck's inequality feeds cut-norm approximation and Bell-inequality bounds. Contributions of intermediate lemmas about OPT\mathrm{OPT}OPT, SDP\mathrm{SDP}SDP, Gaussian correlation identities, and Hermite expansions are welcome even when the headline bounds stay open.

Difficulty

The obvious route to a lower bound is to write down a matrix and compute. That route is what Davie and Reeds exhausted; improving it has produced gains of order 10−1210^{-12}10−12 at best, because the hard instances are high-dimensional Gaussian objects whose OPT\mathrm{OPT}OPT is itself hard to bound tightly. The route taken here avoids instances entirely, and its difficulty lies elsewhere: a constraint on a single scheme is worthless unless it survives averaging over schemes and passing to limits of schemes of growing dimension, since only then does the Naor–Regev optimality theorem convert it into a statement about KGK_GKG​. Constraints that are nonlinear in the scheme do not survive that passage, which is why the target inequality is affine in (b1,b3)(b_1,b_3)(b1​,b3​). For the upper bound, the difficulty is that the improvement is genuinely asymptotic: it comes from a limit of schemes of growing dimension rather than any fixed low-dimensional partition, and the final margin of 3.47×10−43.47\times10^{-4}3.47×10−4 is certified numerically rather than in closed form.

Formalization scope

OPT(A)\mathrm{OPT}(A)OPT(A) and SDP(A)\mathrm{SDP}(A)SDP(A) are defined as suprema of explicitly described sets of reals, over matrices indexed by Fin m and Fin n with real entries; the sign vectors are real-valued functions constrained to take the values 111 and −1-1−1, and the relaxation quantifies over unit vectors of EuclideanSpace ℝ (Fin d) for an existentially quantified ddd, so no dimension bound is built in. The empty-index cases m=0m=0m=0 or n=0n=0n=0 are included and give value 000 on both sides. KGK_GKG​ is the infimum of the set of Grothendieck bounds; that set is nonempty precisely by Grothendieck's inequality, which is itself a milestone, and it is bounded below, so the infimum is not a junk value.

A Krivine scheme is a structure carrying two measurable ±1\pm1±1-valued functions on Fin k → ℝ, each odd almost everywhere. Almost-everywhere oddness is forced: no ±1\pm1±1-valued function satisfies f(−0)=−f(0)f(-0)=-f(0)f(−0)=−f(0) at the origin, so a pointwise requirement would make the structure empty and every statement about schemes vacuous. With the null-set relaxation the half-space partition is a scheme in every dimension k≥1k\ge1k≥1, and the definition file constructs it, pinning down non-vacuity; dimension k=0k=0k=0 admits no scheme. The correlation function is the explicit double Gaussian integral against the correlated-pair density, scaled by π/2\pi/2π/2, and the coefficients b1,b3b_1,b_3b1​,b3​ are read off as H′(0)H'(0)H′(0) and H′′′(0)/6H'''(0)/6H′′′(0)/6 — where HHH fails to be three times differentiable at 000 these are the ambient junk value 000, which a solver should keep in mind when reading the coefficient milestones.

No trivializing reading is available for the goal: it pins KGK_GKG​ between two explicit numerical constants, so it can be satisfied neither vacuously nor by a degenerate convention. Solvers should be aware that the source paper states its two theorems in abridged form and refers to its companion paper for the full proofs, and that the further bounds reported there — the stronger lower rungs 27π/4927\pi/4927π/49 and 51π/9251\pi/9251π/92, and the upper values 1.7818018410331.7818018410331.781801841033 and 1.78133198106256391.78133198106256391.7813319810625639 — are explicitly described as system-tested but not author-verified; they are deliberately outside this mission's milestone list.

Selected references

  • A. Grothendieck, Résumé de la théorie métrique des produits tensoriels topologiques, Bol. Soc. Mat. São Paulo 8 (1953), 1–79.
  • J.-L. Krivine, Sur la constante de Grothendieck, C. R. Acad. Sci. Paris (1977).
  • M. Braverman, K. Makarychev, Y. Makarychev, A. Naor, The Grothendieck constant is strictly smaller than Krivine's bound, FOCS 2011, 453–462. https://doi.org/10.1109/FOCS.2011.77
  • A. Naor, O. Regev, Krivine schemes are optimal, Proc. Amer. Math. Soc. 142 (2014), 4315–4320. https://doi.org/10.1090/S0002-9939-2014-12145-3
  • N. Alon, A. Naor, Approximating the cut-norm via Grothendieck's inequality, SIAM J. Comput. 35 (2006), 787–803. https://doi.org/10.1137/S0097539704441629
  • A. Li, R. Saha, A. Xue, S. Chaudhuri, A. Klivans, P. K. Kothari, R. Meka, Long-Horizon AI Research for Grothendieck Constant: A Case Study in Human–AI Mathematical Collaboration, arXiv:2608.11195v3, 2026. https://arxiv.org/abs/2608.11195
  • R. Saha, A. Li, A. Xue, S. Chaudhuri, A. Klivans, P. K. Kothari, R. Meka, New upper and lower bounds for the Grothendieck constant, 2026 (companion paper containing the full proofs).
11 thms3 active usersReviewed
Captain: wurtle

k-SAT is NP-HardResearch Paper

Prove that kkk-SAT is NP-complete for every fixed k≥3k\ge3k≥3, with at most kkk literal occurrences per clause.

Construct the reductions and certificate verifier using the existing WordRAM definitions. We reuse proved polynomial backend and Cook–Levin SAT completeness.

References:

  • Richard M. Karp. Reducibility Among Combinatorial Problems. Complexity of Computer Computations, 85–103, 1972. Main Theorem, problem 11; reduction, p. 98.
  • Stephen A. Cook and Robert A. Reckhow. Time Bounded Random Access Machines. Journal of Computer and System Sciences 7(4), 354–375, 1973.
  • Torben Hagerup. Sorting and Searching on the Word RAM. STACS 1998, 366–398.
10 thms2 active usersReviewed
Information TheoryQuantum Information·Captain: mikedeng1

Shadow Tomography of Quantum States 3: Shadow Tomography Needs Ω(min{D², log M}/ε²) CopiesResearch Paper

Why count copies of a quantum state

A mixed state of a DDD-dimensional quantum system is a D×DD\times DD×D positive semidefinite matrix ρ\rhoρ of trace 111. Writing ρ\rhoρ down takes about D2D^2D2 real numbers, and DDD is exponential in the number of qubits, so learning ρ\rhoρ in full is expensive. Holevo's theorem and the random access code bounds of Ambainis, Nayak, Ta-Shma and Vazirani say that an nnn-qubit state carries far fewer usable classical bits than its 2n2^n2n amplitudes suggest. Shadow tomography, introduced by S. Aaronson (arXiv:1711.01053), makes this quantitative: given MMM known two-outcome measurements E1,…,EME_1,\dots,E_ME1​,…,EM​, how many copies of an unknown ρ\rhoρ are needed to estimate every acceptance probability Tr⁡(Eiρ)\operatorname{Tr}(E_i\rho)Tr(Ei​ρ) to within ε\varepsilonε?

Aaronson shows that O~(log⁡4M⋅log⁡D/ε4)\widetilde O(\log^4 M\cdot\log D/\varepsilon^4)O(log4M⋅logD/ε4) copies suffice, polylogarithmic in MMM and DDD. The question this mission addresses is the converse: how many copies are necessary. Section 6 of the paper proves two lower bounds. Theorem 16 gives Ω(min⁡{D,log⁡M}/ε2)\Omega(\min\{D,\log M\}/\varepsilon^2)Ω(min{D,logM}/ε2) even when ρ\rhoρ and the EiE_iEi​ are diagonal (a classical distribution). Theorem 19, the goal here, strengthens the dimension term to D2D^2D2 for genuinely quantum states.

Timeline:

  • 2016: full tomography of a DDD-dimensional state to trace-distance accuracy ε\varepsilonε needs Θ(D2/ε2)\Theta(D^2/\varepsilon^2)Θ(D2/ε2) copies up to logarithmic factors, with upper and lower bounds by O'Donnell and Wright (arXiv:1508.01907) and Haah, Harrow, Ji, Wu and Yu (arXiv:1508.01797).
  • 2017–2018: Aaronson poses shadow tomography (Problem 1), proves the polylogarithmic upper bound (Theorem 2), and proves the lower bounds of Theorems 16 and 19.
  • 2020 onward: classical shadows (Huang, Kueng and Preskill, arXiv:2002.08953) and later shadow-tomography algorithms study the same estimation task with other measurement models and improved upper bounds.

Setting

Fix a dimension DDD. A two-outcome measurement is a D×DD\times DD×D Hermitian matrix EEE with 0⪯E⪯I0\preceq E\preceq I0⪯E⪯I; it accepts ρ\rhoρ with probability Tr⁡(Eρ)\operatorname{Tr}(E\rho)Tr(Eρ). The tensor power ρ⊗k\rho^{\otimes k}ρ⊗k is the Dk×DkD^k\times D^kDk×Dk matrix of kkk independent copies. A strategy using kkk copies is a measurement of ρ⊗k\rho^{\otimes k}ρ⊗k with finitely many outcomes ω∈Ω\omega\in\Omegaω∈Ω, given by positive semidefinite matrices Πω\Pi_\omegaΠω​ with ∑ωΠω=I\sum_\omega\Pi_\omega = I∑ω​Πω​=I, together with outputs b(ω)=(b1(ω),…,bM(ω))b(\omega)=(b_1(\omega),\dots,b_M(\omega))b(ω)=(b1​(ω),…,bM​(ω)). It succeeds on ρ\rhoρ when, with probability at least 2/32/32/3 over ω\omegaω, ∣bi(ω)−Tr⁡(Eiρ)∣≤ε|b_i(\omega)-\operatorname{Tr}(E_i\rho)|\le\varepsilon∣bi​(ω)−Tr(Ei​ρ)∣≤ε for every i∈[M]i\in[M]i∈[M].

The proof works with these further objects, all defined in the mission:

  • an orthogonal projection P\mathbb PP onto an N/2N/2N/2-dimensional subspace of CN\mathbb C^NCN (Hermitian, idempotent, trace N/2N/2N/2);
  • ρP:=2NP\rho_{\mathbb P} := \tfrac2N\mathbb PρP​:=N2​P, the maximally mixed state on that subspace;
  • σP,ε:=(1−6ε) I/N+6ε ρP\sigma_{\mathbb P,\varepsilon} := (1-6\varepsilon)\,\mathbb I/N + 6\varepsilon\,\rho_{\mathbb P}σP,ε​:=(1−6ε)I/N+6ερP​;
  • the von Neumann entropy in bits, S(ρ)=−∑xλxlog⁡2λxS(\rho) = -\sum_x\lambda_x\log_2\lambda_xS(ρ)=−∑x​λx​log2​λx​ over the eigenvalues of ρ\rhoρ;
  • for states σ1,…,σK\sigma_1,\dots,\sigma_Kσ1​,…,σK​ and ζ:=1K∑iσi⊗T\zeta := \tfrac1K\sum_i\sigma_i^{\otimes T}ζ:=K1​∑i​σi⊗T​, the quantum mutual information with the classical index, I(ζ;i):=S(ζ)−1K∑iS(σi⊗T)I(\zeta;i) := S(\zeta) - \tfrac1K\sum_i S(\sigma_i^{\otimes T})I(ζ;i):=S(ζ)−K1​∑i​S(σi⊗T​).

Formalization targets

Goal: Theorem 19 (p. 23)

There are a universal constant c>0c>0c>0 and a threshold N0N_0N0​ such that for all D≥N0D\ge N_0D≥N0​, all MMM with log⁡2M≥N02\log_2 M\ge N_0^2log2​M≥N02​ and all 0<ε≤160<\varepsilon\le\tfrac160<ε≤61​, some measurements E1,…,EME_1,\dots,E_ME1​,…,EM​ on CD\mathbb C^DCD force every strategy that succeeds on every mixed state to use

k  ≥  c min⁡{D2, log⁡2M}ε2k \;\ge\; c\,\frac{\min\{D^2,\ \log_2 M\}}{\varepsilon^2}k≥cε2min{D2, log2​M}​

copies. The goal fixes only the shape Ω(min⁡{D2,log⁡M}/ε2)\Omega(\min\{D^2,\log M\}/\varepsilon^2)Ω(min{D2,logM}/ε2), not a constant, so a sharper constant does not invalidate it.

Milestones (pp. 23–24)

The milestones follow the proof, which sets N:=⌊min⁡{D,log⁡2M}⌋N:=\lfloor\min\{D,\sqrt{\log_2 M}\}\rfloorN:=⌊min{D,log2​M​}⌋ and K:=⌊cN2⌋K:=\lfloor c^{N^2}\rfloorK:=⌊cN2⌋:

  1. Eq. (2): for some c∈(1,2)c\in(1,2)c∈(1,2) and all large even NNN there are KKK projections Pi\mathbb P_iPi​ of rank N/2N/2N/2 with ∣Tr⁡(Piρj)−12∣≤112|\operatorname{Tr}(\mathbb P_i\rho_j)-\tfrac12|\le\tfrac1{12}∣Tr(Pi​ρj​)−21​∣≤121​ for all i≠ji\ne ji=j.
  2. Tr⁡(Piσi)=12+3ε\operatorname{Tr}(\mathbb P_i\sigma_i) = \tfrac12+3\varepsilonTr(Pi​σi​)=21​+3ε.
  3. ∣Tr⁡(Pjσi)−12∣=6ε∣Tr⁡(Pjρi)−12∣≤ε2|\operatorname{Tr}(\mathbb P_j\sigma_i)-\tfrac12| = 6\varepsilon|\operatorname{Tr}(\mathbb P_j\rho_i)-\tfrac12|\le\tfrac\varepsilon2∣Tr(Pj​σi​)−21​∣=6ε∣Tr(Pj​ρi​)−21​∣≤2ε​ for i≠ji\neq ji=j.
  4. The exact entropy S(σi)=log⁡2N−[1−h(12+3ε)]S(\sigma_i) = \log_2 N - [1-h(\tfrac12+3\varepsilon)]S(σi​)=log2​N−[1−h(21​+3ε)], with hhh the binary entropy, and the bound S(σi)≥log⁡2N−Cε2S(\sigma_i)\ge\log_2 N - C\varepsilon^2S(σi​)≥log2​N−Cε2.
  5. I(ζ;i)≤T(log⁡2N−S(σi))I(\zeta;i)\le T(\log_2 N - S(\sigma_i))I(ζ;i)≤T(log2​N−S(σi​)) when all σi\sigma_iσi​ have equal entropy.

Significance

Theorem 19 shows that the log⁡M\log MlogM dependence of shadow tomography cannot be removed, and that for M≥2D2M\ge 2^{D^2}M≥2D2 shadow tomography is as hard as full tomography: as MMM grows the bound becomes the Ω(D2/ε2)\Omega(D^2/\varepsilon^2)Ω(D2/ε2) tomography lower bound, which it therefore contains. Compared with the classical Theorem 16, it shows that quantum states need quadratically more copies in the dimension term. The 1/ε21/\varepsilon^21/ε2 factor matches the upper bound of Proposition 20 for the decision version, so the ε\varepsilonε-dependence of the lower bound is tight in that setting.

The results are proved in the paper; none of them has a machine-checked proof that we know of. Formalizing the argument requires von Neumann entropy and its additivity on tensor products, the bound S≤log⁡2(dimension)S\le\log_2(\text{dimension})S≤log2​(dimension), a Holevo-plus-Fano step that turns successful estimation into mutual information, and the existence of many nearly orthogonal half-dimensional subspaces. Each is reusable well beyond this mission.

Difficulty

The obvious attempt adapts the classical argument of Theorem 16, which hides KKK subsets of [N][N][N] in a biased distribution. Quantum states allow exp⁡(Ω(N2))\exp(\Omega(N^2))exp(Ω(N2)) hidden subspaces instead of exp⁡(Ω(N))\exp(\Omega(N))exp(Ω(N)) subsets, which is where D2D^2D2 comes from, but two steps change character. First, the hiding family must be shown to exist: Eq. (2) is a concentration statement for random subspaces, and the lemma the paper cites for it (Lemma 18) is misstated, as explained below. Second, the information bound must be carried out for quantum states: the step "learning iii from ζ\zetaζ requires I(ζ;i)≥log⁡2KI(\zeta;i)\ge\log_2 KI(ζ;i)≥log2​K" needs Holevo's bound and Fano's inequality, adjusted for success probability 2/32/32/3 rather than certainty.

Formalization scope

Matrices are Matrix n n ℂ over a finite index type; the goal uses n=Fin Dn=\texttt{Fin } Dn=Fin D. Conventions committed to:

  • A mixed state is the published WildeQIT.IsDensityOperator (positive semidefinite, trace 111), reused as a reference item.
  • A strategy is a finite-outcome POVM on ρ⊗k\rho^{\otimes k}ρ⊗k, indexed by Fin k → Fin D, with deterministic outputs b(ω)∈RMb(\omega)\in\mathbb R^Mb(ω)∈RM; classical randomness can be absorbed into the outcome set.
  • Probabilities and traces are real parts of complex traces. Entropies use log⁡2\log_2log2​; Lean's log⁡20=0\log_2 0 = 0log2​0=0 gives 0log⁡0=00\log 0=00log0=0, and vnEntropy returns 000 on non-Hermitian matrices, which no statement uses.
  • Added to the goal: the threshold N0N_0N0​ on DDD and log⁡2M\sqrt{\log_2 M}log2​M​ (for D=1D=1D=1, k=0k=0k=0 succeeds) and ε≤16\varepsilon\le\tfrac16ε≤61​ (for ε≥12\varepsilon\ge\tfrac12ε≥21​, the output bi=12b_i=\tfrac12bi​=21​ succeeds with k=0k=0k=0). Problem 1's bi∈[0,1]b_i\in[0,1]bi​∈[0,1] is dropped, an equivalent statement under clipping.
  • The measurements are chosen before the strategy (for every strategy, the same EEE), which is the meaning of a lower bound.

A trivializing formalization is ruled out: the goal does not mention NNN, KKK, Pi\mathbb P_iPi​, σi\sigma_iσi​ or ζ\zetaζ, the success condition quantifies over all mixed states rather than a vacuous class, and the measurements are fixed before the strategy.

Not drafted:

  • Lemma 18 (pp. 22–23) is false as printed. Since ES[ρS]=I/N\mathbb E_S[\rho_S] = \mathbb I/NES​[ρS​]=I/N, Tr⁡(PTρS)\operatorname{Tr}(\mathbb P_T\rho_S)Tr(PT​ρS​) concentrates at 1/21/21/2, not 1/41/41/4. The proof needs only Eq. (2), which is centred correctly and is a milestone.
  • Eq. (2) is stated as existence, not as "probability 1−o(1)1-o(1)1−o(1) over Haar-random subspaces", because Mathlib has no Haar measure on the unitary group or the Grassmannian; existence is what the proof uses.
  • "I(ζ;i)I(\zeta;i)I(ζ;i) must be at least log⁡2K\log_2 Klog2​K" is not drafted: as stated it is imprecise for success probability 2/32/32/3, and the correct Holevo–Fano form is left to the solver.
  • The final combination I(ζ;i)=O(Tε2)I(\zeta;i)=O(T\varepsilon^2)I(ζ;i)=O(Tε2), T=Ω(N2/ε2)T=\Omega(N^2/\varepsilon^2)T=Ω(N2/ε2) is the goal's last step.

Contributions welcome: proofs of the milestones; a Haar-measure version of Eq. (2); von Neumann entropy infrastructure (additivity, the dimension bound, concavity); Holevo's bound and Fano's inequality for finite-dimensional states.

Selected references

  • S. Aaronson, Shadow Tomography of Quantum States, arXiv:1711.01053v2, 2018; STOC 2018. https://arxiv.org/abs/1711.01053
  • P. Hayden, D. Leung, A. Winter, Aspects of generic entanglement, Comm. Math. Phys. 265, 2006. https://arxiv.org/abs/quant-ph/0407049
  • R. O'Donnell, J. Wright, Efficient quantum tomography, STOC 2016. https://arxiv.org/abs/1508.01907
  • J. Haah, A. W. Harrow, Z. Ji, X. Wu, N. Yu, Sample-optimal tomography of quantum states, IEEE Trans. Inf. Theory 63, 2017. https://arxiv.org/abs/1508.01797
  • A. Ambainis, A. Nayak, A. Ta-Shma, U. Vazirani, Dense quantum coding and quantum finite automata, J. ACM 49, 2002. https://arxiv.org/abs/quant-ph/9804043
  • H.-Y. Huang, R. Kueng, J. Preskill, Predicting many properties of a quantum system from very few measurements, Nature Physics 16, 2020. https://arxiv.org/abs/2002.08953
16 thms2 active usersReviewed
CombinatoricsOperations Research·Captain: mikedeng1

The Online Set Cover Problem 2: Given α ≥ c(C_OPT), the Weighted Potential-Function Algorithm Never Fails and Pays at Most (6+o(1)) α log m log nResearch Paper

Motivation

Set cover is one of the basic covering problems of combinatorial optimization: given a ground set and a family of subsets with costs, choose a cheapest subfamily whose union contains every element. In many applications the elements to be covered are not known in advance but appear over time: requests for a service that must be served by opening facilities, clients that must be assigned to servers, or constraints of a covering program that are revealed one at a time. Each arriving element must be covered at once, and decisions cannot be undone. This is the online set cover problem, introduced by Alon, Awerbuch, Azar, Buchbinder and Naor (SIAM J. Comput. 39(2), 2009; conference version STOC 2003).

The quality of an online algorithm is measured by its competitive ratio: the worst case, over all arrival sequences, of the ratio between the algorithm's cost and the cost of an optimal offline cover of the elements that actually arrived. The paper gives a deterministic algorithm with ratio O(log⁡mlog⁡n)O(\log m \log n)O(logmlogn), where nnn is the number of elements and mmm the number of sets, and shows a nearly matching lower bound for deterministic algorithms. Its algorithm for the weighted case, analysed with a potential function, became a template for the online primal–dual method surveyed by Buchbinder and Naor (Found. Trends Theor. Comput. Sci. 3(2–3), 2009).

This mission formalizes the core of the weighted result: the algorithm that is given a value α\alphaα at least the optimal cost, and its guarantee (Theorem 3.4).

Setting

The ground set XXX has n=∣X∣n = |X|n=∣X∣ elements and the family S\mathcal SS has m=∣S∣m = |\mathcal S|m=∣S∣ sets; every set SSS has a cost cS>0c_S > 0cS​>0. Both are known to the algorithm in advance. For an element jjj, Sj\mathcal S_jSj​ denotes the sets containing jjj. Elements of an unknown subset of XXX arrive one at a time in a sequence σ\sigmaσ; on arrival each must be covered by a chosen set. The chosen family C\mathcal CC can only grow. COPT\mathcal C_{OPT}COPT​ is any family covering every arriving element, and c(COPT)=∑S∈COPTcSc(\mathcal C_{OPT}) = \sum_{S \in \mathcal C_{OPT}} c_Sc(COPT​)=∑S∈COPT​​cS​.

The algorithm is given α≥c(COPT)\alpha \ge c(\mathcal C_{OPT})α≥c(COPT​). It discards sets costing more than α\alphaα, buys sets costing at most α/m\alpha/mα/m outright, and rescales costs; on the resulting normalized instance 1≤cS≤m1 \le c_S \le m1≤cS​≤m and cS≤αc_S \le \alphacS​≤α for every set (p. 365).

The algorithm keeps a weight wS>0w_S > 0wS​>0 for every set, initially wS=1/m2w_S = 1/m^2wS​=1/m2; the weight of an element is wj=∑S∈SjwSw_j = \sum_{S \in \mathcal S_j} w_Swj​=∑S∈Sj​​wS​. With CCC the set of covered elements and χC\chi_{\mathcal C}χC​ the indicator of C\mathcal CC, the potential is

Φ=∑j∉Cn2wj+n⋅exp⁡(12α∑S∈S(cSχC(S)−3wScSlog⁡n)),\Phi = \sum_{j \notin C} n^{2 w_j} + n \cdot \exp\Big(\frac{1}{2\alpha} \sum_{S \in \mathcal S} \big(c_S \chi_{\mathcal C}(S) - 3 w_S c_S \log n\big)\Big),Φ=j∈/C∑​n2wj​+n⋅exp(2α1​S∈S∑​(cS​χC​(S)−3wS​cS​logn)),

with natural logarithms throughout. When jjj arrives with wj≥1w_j \ge 1wj​≥1 nothing happens; otherwise the algorithm performs weight augmentation steps while wj<1w_j < 1wj​<1. In a step, for each S∈SjS \in \mathcal S_jS∈Sj​: (a) wS←wS(1+1ncS)w_S \leftarrow w_S (1 + \frac{1}{n c_S})wS​←wS​(1+ncS​1​); (b) if S∉CS \notin \mathcal CS∈/C, add SSS to C\mathcal CC when Φ\PhiΦ does not exceed its value before (a); (c) if Φ\PhiΦ has increased, return FAIL.

In Lean, the instance is the published OnlinePrimalDual.OnlineSetCover.SetCoverInstance over finite types X (elements) and T (sets), with the published elementWeight, coveredBy and potential. The run is OnlineSetCover.Weighted.Reachable inst α σ, the set of configurations reachable from initState σ under the transition relation Step.

Formalization targets

Goal: Theorem 3.4

On the normalized instance, with COPT\mathcal C_{OPT}COPT​ covering σ\sigmaσ, c(COPT)≤αc(\mathcal C_{OPT}) \le \alphac(COPT​)≤α, and n⋅n2/m+n<n2n \cdot n^{2/m} + n < n^2n⋅n2/m+n<n2, every reachable configuration is a running state (never FAIL) in which (i) every j∈Xj \in Xj∈X with wj≥1w_j \ge 1wj​≥1 is covered, and (ii)

∑S∈CcS≤3log⁡n(1+(1+1n)αlog⁡(m2(1+1n)))+2αlog⁡n=(6+o(1)) αlog⁡mlog⁡n.\sum_{S \in \mathcal C} c_S \le 3 \log n \Big(1 + \Big(1 + \frac1n\Big)\alpha \log\Big(m^2\Big(1+\frac1n\Big)\Big)\Big) + 2\alpha \log n = (6 + o(1))\,\alpha \log m \log n.S∈C∑​cS​≤3logn(1+(1+n1​)αlog(m2(1+n1​)))+2αlogn=(6+o(1))αlogmlogn.

Milestones

  • Lemma 3.1 (p. 365): the number NNN of augmentation steps satisfies N≤∑S∈COPT(ncS+1)log⁡(m2(1+1/n))≤(n+1)αlog⁡(m2(1+1/n))N \le \sum_{S \in \mathcal C_{OPT}} (n c_S + 1)\log(m^2(1 + 1/n)) \le (n+1)\alpha\log(m^2(1+1/n))N≤∑S∈COPT​​(ncS​+1)log(m2(1+1/n))≤(n+1)αlog(m2(1+1/n)).
  • Lemma 3.2 (p. 366): throughout, ∑SwScS≤1+N/n≤1+(1+1/n)αlog⁡(m2(1+1/n))\sum_S w_S c_S \le 1 + N/n \le 1 + (1 + 1/n)\alpha\log(m^2(1+1/n))∑S​wS​cS​≤1+N/n≤1+(1+1/n)αlog(m2(1+1/n)).
  • Lemma 3.3 (p. 366): a per-set step with cS≤αc_S \le \alphacS​≤α never increases Φ\PhiΦ; in particular the algorithm never fails.

The Proved platform theorem OnlinePrimalDual.OnlineSetCover.algorithm_correctness (the last paragraph of the proof of Theorem 3.4, with the invariant Φ<n2\Phi < n^2Φ<n2 assumed) is included as a supporting reference.

Significance

Theorem 3.4 is the analysis of the subroutine; with the doubling over guesses of α\alphaα described on pp. 364–365 (which loses a factor of at most 4) it yields the paper's deterministic O(log⁡mlog⁡n)O(\log m \log n)O(logmlogn)-competitive algorithm for weighted online set cover. The lower bound of Section 4 shows that no deterministic algorithm can do much better on general instances, so the result is close to the deterministic optimum. The technique, a potential that couples a fractional multiplicative-weights solution to a deterministic rounding, reappears in online covering and packing, online facility location and related problems.

The result is proved in the paper and restated in the Buchbinder–Naor monograph. On Prove2Me, the monograph's final step (from the invariant Φ<n2\Phi < n^2Φ<n2 to the cost bound) is a Proved theorem, and its expectation form of the monotonicity lemma is Disproved because it omits the hypothesis cS≤αc_S \le \alphacS​≤α. Neither the full statement about the algorithm's run nor Lemmas 3.1, 3.2 and the corrected Lemma 3.3 are formalized on the platform. This mission produces them, with the o(1)o(1)o(1) terms replaced by explicit expressions.

Difficulty

The cost bound in the last step is short once two facts about the run are available: that Φ\PhiΦ stays below n2n^2n2, and that the fractional cost ∑SwScS\sum_S w_S c_S∑S​wS​cS​ stays logarithmic. Neither is a local fact about one state. The first requires showing that, at every per-set step, one of the two deterministic choices (add SSS or not) does not increase Φ\PhiΦ; the paper proves this by a probabilistic argument over an auxiliary randomized choice, and the bound on the exponential term depends on the cost of the set being at most α\alphaα. The platform's earlier statement of this lemma, which omits that hypothesis, is Disproved. The second requires a bound on the number of augmentation steps over the whole run, which depends on the run's history and not on any single state. In Lean both are inductions over an operational semantics with real-valued exponentials and powers n2wjn^{2 w_j}n2wj​, where the initial bound Φ<n2\Phi < n^2Φ<n2 is a genuine size condition on nnn and mmm.

Formalization scope

The run is a small-step transition relation. A state records the weights, the cover, the number of augmentation steps begun, the elements not yet given, and the position inside the current step; FAIL is a separate terminal configuration. The order in which a step visits Sj\mathcal S_jSj​ is arbitrary and may differ between steps; every statement holds for every order. "Throughout the algorithm" means every reachable configuration, including those between per-set substeps. Arrival sequences are arbitrary lists (repetitions allowed) of elements covered by COPT\mathcal C_{OPT}COPT​.

Conventions: costs, weights and α\alphaα are real; nnn and mmm are the cardinalities of the finite types cast to R\mathbb RR; log⁡\loglog is Real.log; n2wjn^{2 w_j}n2wj​ and n2/mn^{2/m}n2/m are real powers. The paper's asymptotic expressions are replaced by what its proofs establish:

  • Lemma 3.1: (2+o(1))nαlog⁡m(2 + o(1)) n\alpha\log m(2+o(1))nαlogm becomes (n+1)αlog⁡(m2(1+1/n))(n+1)\alpha\log(m^2(1+1/n))(n+1)αlog(m2(1+1/n));
  • Lemma 3.2: (2+o(1))αlog⁡m(2 + o(1))\alpha\log m(2+o(1))αlogm becomes 1+(1+1/n)αlog⁡(m2(1+1/n))1 + (1+1/n)\alpha\log(m^2(1+1/n))1+(1+1/n)αlog(m2(1+1/n)), together with the intermediate bound 1+N/n1 + N/n1+N/n;
  • Theorem 3.4 (ii): (6+o(1))αlog⁡mlog⁡n(6 + o(1))\alpha\log m\log n(6+o(1))αlogmlogn becomes 3log⁡n (1+(1+1/n)αlog⁡(m2(1+1/n)))+2αlog⁡n3\log n\,(1 + (1+1/n)\alpha\log(m^2(1+1/n))) + 2\alpha\log n3logn(1+(1+1/n)αlog(m2(1+1/n)))+2αlogn;
  • "n and m large" becomes the hypothesis n⋅n2/m+n<n2n \cdot n^{2/m} + n < n^2n⋅n2/m+n<n2 used for the initial potential (it holds, for instance, when n≥4n \ge 4n≥4 and m≥3m \ge 3m≥3).

The goal is a statement about the configurations the algorithm actually reaches from wS=1/m2w_S = 1/m^2wS​=1/m2 and the empty cover. Taking the invariant Φ<n2\Phi < n^2Φ<n2 or the fractional-cost bound as a hypothesis on an arbitrary state would trivialize it, and is ruled out: those are exactly what the milestones establish. The doubling wrapper for unknown α\alphaα is not part of this mission.

A complete development needs an invariant for reachable states (positive weights, steps of an element processed in full), the per-set potential inequality, and the step-counting argument. The per-set inequality is reusable for the monograph's version of the algorithm. Contributions of proofs of any milestone, and of auxiliary invariants as separate lemmas, are welcome.

Selected references

  • N. Alon, B. Awerbuch, Y. Azar, N. Buchbinder, J. Naor, The Online Set Cover Problem, SIAM Journal on Computing 39(2):361–370, 2009. https://doi.org/10.1137/060661946
  • N. Buchbinder, J. Naor, The Design of Competitive Online Algorithms via a Primal–Dual Approach, Foundations and Trends in Theoretical Computer Science 3(2–3):93–263, 2009. https://doi.org/10.1561/0400000024
10 thms2 active usersReviewed
Linear OptimizationOperations ResearchOptimization+1·Captain: mikedeng1

Smoothed Analysis of Algorithms: Why the Simplex Algorithm Usually Takes Polynomial Time 2: The Two-Phase Shadow-Vertex Simplex Method Has Polynomial Smoothed ComplexityResearch Paper

Motivation

The simplex method solves linear programs by moving between vertices of a feasible polyhedron. Its worst-case number of moves can grow exponentially, yet it often performs well on ordinary inputs. Worst-case examples alone therefore give an incomplete account of the method’s behavior. Spielman and Teng introduced smoothed analysis to measure expected performance after small random perturbations of an arbitrary input. Their result for a two-phase shadow-vertex simplex method gives a polynomial bound in the input dimensions and inverse perturbation scale. The pinned preprint is the source for every theorem number and constant in this mission.

The paper separates a geometric result about the expected size of a polytope’s shadow (Theorem 4.0.1) from the algorithmic result here (Theorem 5.0.1). That separation matters: a plane chosen before perturbation and a plane chosen by a running algorithm have different distributions. This mission addresses the latter. It complements the standard-form simplex theorems already formalized in the Introduction to Linear Optimization series and the worst-case Klee–Minty result in the Smale’s Ninth Problem mission; those results concern different algorithms or input models and are context rather than imported statements.

Setting

A linear program is specified by vectors a1,…,an∈Rda_1,\ldots,a_n\in\mathbb R^da1​,…,an​∈Rd, right-hand sides y1,…,yn∈Ry_1,\ldots,y_n\in\mathbb Ry1​,…,yn​∈R, and an objective vector z∈Rdz\in\mathbb R^dz∈Rd:

max⁡x⟨z,x⟩subject to⟨ai,x⟩≤yi(1≤i≤n).\max_x\langle z,x\rangle\quad\text{subject to}\quad \langle a_i,x\rangle\le y_i\qquad(1\le i\le n).xmax​⟨z,x⟩subject to⟨ai​,x⟩≤yi​(1≤i≤n).

The paper’s two-phase shadow-vertex method first draws a collection I\mathcal II of ddd-element subsets of [n][n][n] and chooses one whose constraint matrix AIA_IAI​ has the largest smallest singular value. It sets a power-of-two scale MMM from the input norm and a power-of-two scale κ\kappaκ from that singular value. These determine positive relaxed right-hand sides yi′y'_iyi′​: MMM for i∈Ii\in Ii∈I and dM2/(4κ)\sqrt d M^2/(4\kappa)d​M2/(4κ) otherwise. A coefficient vector α\alphaα is chosen uniformly from A1/d2={α:∑i∈Iαi=1, αi≥1/d2}A_{1/d^2}=\{\alpha:\sum_{i\in I}\alpha_i=1,\ \alpha_i\ge1/d^2\}A1/d2​={α:∑i∈I​αi​=1, αi​≥1/d2}. The first phase solves the relaxed program LP′ from the objective AIαA_I\alphaAI​α.

The second phase uses a lifted program LP⁺ in Rd+1\mathbb R^{d+1}Rd+1. For each original constraint it forms ai+=((yi′−yi)/2,ai)a_i^+=((y'_i-y_i)/2,a_i)ai+​=((yi′​−yi​)/2,ai​) and yi+=(yi′+yi)/2y_i^+=(y'_i+y_i)/2yi+​=(yi′​+yi​)/2, together with two artificial constraints at first coordinates 111 and −1-1−1. LP⁺ connects LP′ to the original program and makes infeasibility detectable. Its shadow is taken in the plane of (0,z)(0,z)(0,z) and z+=(1,0,…,0)z^+=(1,0,\ldots,0)z+=(1,0,…,0).

For positive right-hand sides, an optimal polar simplex is a ddd-subset of constraints whose scaled vectors ai/yia_i/y_iai​/yi​ form a facet of ConvHull⁡(0,a1/y1,…,an/yn)\operatorname{ConvHull}(0,a_1/y_1,\ldots,a_n/y_n)ConvHull(0,a1​/y1​,…,an​/yn​) and whose unscaled cone contains an objective qqq. The shadow for objectives t,zt,zt,z is the union of these simplices over all qqq in Span⁡(t,z)\operatorname{Span}(t,z)Span(t,z). Its size bounds the number of polar pivots. In Section 5 the paper writes Sz′S'_zSz′​ for the first-phase shadow size and Sz+S_z^+Sz+​ for the second-phase shadow size without the two artificial pivots.

The input is perturbed by independent Gaussians: each coordinate of aia_iai​ and each yiy_iyi​ has its prescribed center and common standard deviation σR\sigma RσR, where R=max⁡i∥(yˉi,aˉi)∥2R=\max_i\|(\bar y_i,\bar a_i)\|_2R=maxi​∥(yˉ​i​,aˉi​)∥2​. The algorithm has separate random choices of I\mathcal II and α\alphaα.

Formalization targets

The immediate targets bound the two phases: Lemma 5.2.1 gives an explicit expectation bound for Sz′S'_zSz′​ and Lemma 5.3.1 gives one for Sz+S_z^+Sz+​. Lemma 5.1.1 and its corollaries control the chance that the chosen basis has a very small singular value. Corollary 4.3.3 extends the geometric shadow bound to positive, unequal right-hand sides and general Gaussian covariance. These are the mission’s milestone targets.

The goal is the shape of Theorem 5.0.1. With C(A,y,z)=EI,α(Sz′+Sz++2)C(A,y,z)=\mathbb E_{\mathcal I,\alpha}(S'_z+S_z^++2)C(A,y,z)=EI,α​(Sz′​+Sz+​+2), there are a single polynomial P\mathcal PP and a positive constant σ0\sigma_0σ0​ such that, for all n>d≥3n>d\ge3n>d≥3 and all centers and objectives,

EA,yC(A,y,z)≤min⁡{P(d,n,1min⁡(σ,σ0)),(nd)+(nd+1)+2}.\mathbb E_{A,y}C(A,y,z)\le \min\left\{\mathcal P\left(d,n,\frac1{\min(\sigma,\sigma_0)}\right), \binom nd+\binom n{d+1}+2\right\}.EA,y​C(A,y,z)≤min{P(d,n,min(σ,σ0​)1​),(dn​)+(d+1n​)+2}.

The polynomial is uniform over the dimensions and inputs; its coefficients are not prescribed. The bound on CCC implies the corresponding result for the actual pivot count through the paper’s step-to-shadow comparison. The goal is stated with a positive center scale RRR, the case in which the paper’s Gaussian rescaling applies.

Significance

The theorem places the number of pivots of a complete simplex method under one explicit perturbation model, including the work needed to find a starting feasible basis and handle an arbitrary right-hand side. The trivial binomial bound is retained because it controls rare events in the proof and is part of the stated result. The polynomial bound says that even when the unperturbed LP is adversarial, Gaussian noise of a controlled scale makes the expected shadow-size cost polynomial.

The paper proves the mathematical result. This mission asks for machine-checked proofs of its statement and the listed milestones; the draft Lean declarations are targets with sorry, not completed proofs. The reusable formal infrastructure is the finite polar simplex and shadow construction, product Gaussian input law, smallest-singular-value events for sampled minors, and the uniform truncated-simplex coefficient law. The two shadow-size lemmas also require explicit handling of measurable finite-valued counts and their expectations.

Difficulty

The basic shadow estimate fixes its projection plane before perturbing the constraints. In LP′, the initial objective AIαA_I\alphaAI​α uses a basis selected after the perturbation, so the relevant plane depends on the random LP. The fixed-plane theorem cannot be substituted directly. For LP⁺, the normalized lifted vectors ai+/yi+a_i^+/y_i^+ai+​/yi+​ are nonlinear functions of Gaussian data; they are generally not Gaussian vectors. Thus the same shadow estimate does not apply directly to their law either. A further issue is that a poor sampled basis can make y′y'y′ very large. These are distinct obstacles, reflected in the milestone groups from Sections 5.1, 5.2, and 5.3.

Formalization scope

Vectors are EuclideanSpace ℝ (Fin d), constraints are Fin n → EuclideanSpace ℝ (Fin d), and index families are finite sets of Fin n. The paper’s [n][n][n] starts at one; Fin n starts at zero. The Gaussian constructor receives variance σ2\sigma^2σ2, not standard deviation σ\sigmaσ. The 3ndln⁡n3nd\ln n3ndlnn draws are rounded upward and are independent uniform draws with replacement. Equal singular values are resolved by the first sampled set. The uniform law on AδA_\deltaAδ​ is represented by normalized independent exponential weights followed by the affine shift that imposes αi≥δ\alpha_i\ge\deltaαi​≥δ.

The Lean definition of CCC is exactly the Section 5 shadow-size upper bound E(Sz′+Sz++2)\mathbb E(S'_z+S_z^++2)E(Sz′​+Sz+​+2), computed from the sampled LP data. It is not an arbitrary cost variable. The actual algorithmic step bound needs the paper’s polar algorithm and Lemma 3.3.5. The goal explicitly asks for inner and outer integrability so Lean’s default value for a nonintegrable Bochner integral cannot make the result vacuous. The source’s all-zero center scale is excluded because it gives zero perturbation and defeats the rescaling used in Theorem 5.0.1.

For LP⁺ the vectors live in Rd+1\mathbb R^{d+1}Rd+1, so the two LP⁺ milestone bounds use D(n,d+1,⋅)\mathcal D(n,d+1,\cdot)D(n,d+1,⋅). The preprint prints ddd in those calls even though the preceding extension theorem would be applied in dimension d+1d+1d+1. Lemma 5.2.1 is written as an inequality: its printed equality is stronger than the bound established on page 71. These corrections are visible in the theorem titles and notes. Contributions that prove the exact statements, establish the measurability and Gaussian law facts, or formalize the step-to-shadow comparison are welcome.

Selected references

  • Daniel A. Spielman and Shang-Hua Teng, Smoothed Analysis of Algorithms: Why the Simplex Algorithm Usually Takes Polynomial Time, arXiv:cs/0111050v7, 2003, preprint. The PDF used here is the 96-page version with printed and PDF page numbers aligned.
22 thms2 active usersReviewed
Operations ResearchOptimization·Captain: mikedeng1

A Simple Forward Algorithm to Solve General Dynamic Lot Sizing Models with n Periods in O(n log n) or O(n) Time: Minimal Optimal Predecessor Lists Are Characterized by Strictly Increasing BreakpointsResearch Paper

Motivation

The dynamic lot size model asks when, and how much, to order of a single item over a planning horizon of nnn periods with known, time-varying demands, setup costs, unit order costs and holding costs. It is the textbook model of production planning and the building block of material requirements planning, multi-item scheduling and many decomposition schemes for larger supply-chain problems.

Wagner and Whitin (1958) showed that some optimal policy orders only when inventory is zero, which turns the problem into a shortest-path recursion with O(n2)O(n^2)O(n2) running time. For more than thirty years this was the standard algorithm. In 1991 three groups independently reduced the complexity: Federgruen and Tzur (Management Science 37(8), 1991), Wagelmans, van Hoesel and Kolen (Operations Research 40, 1992) and Aggarwal and Park (Operations Research 41, 1993). Each obtained O(nlog⁡n)O(n \log n)O(nlogn) in general and O(n)O(n)O(n) under special cost structures. The Federgruen–Tzur algorithm is a forward algorithm: at iteration jjj it keeps a short list of periods that could still be the best last setup period for some future horizon, and updates it by local tests on neighbouring entries. This mission formalizes the theorem that justifies those tests.

Setting

For periods i=1,2,…i = 1, 2, \dotsi=1,2,… let did_idi​ be the demand, KiK_iKi​ the setup cost, cic_ici​ the variable per unit order cost and hih_ihi​ the cost of carrying a unit of inventory at the end of period iii. Write D(i)=∑k=1idkD(i) = \sum_{k=1}^{i} d_kD(i)=∑k=1i​dk​ and H(i)=∑k=1ihkH(i) = \sum_{k=1}^{i} h_kH(i)=∑k=1i​hk​, so D(0)=H(0)=0D(0) = H(0) = 0D(0)=H(0)=0. For i<ji < ji<j let cij=ci+hi+⋯+hj−1c_{ij} = c_i + h_i + \dots + h_{j-1}cij​=ci​+hi​+⋯+hj−1​, let C~(i)=ci−H(i−1)\tilde C(i) = c_i - H(i-1)C~(i)=ci​−H(i−1), and let

S(i,j)=∑r=ij−1hr (D(j)−D(r))S(i, j) = \sum_{r=i}^{j-1} h_r\,\bigl(D(j) - D(r)\bigr)S(i,j)=r=i∑j−1​hr​(D(j)−D(r))

be the carrying cost of an order placed in period iii that covers the demands of periods i,…,ji, \dots, ji,…,j.

The costs are given by the zero-inventory recursion (2): F(0)=0F(0) = 0F(0)=0 and, for 1≤l≤t1 \le l \le t1≤l≤t,

F(l,t)=F(l−1)+Kl+S(l,t)+cl [D(t)−D(l−1)],F(t)=min⁡1≤l≤tF(l,t).F(l, t) = F(l-1) + K_l + S(l, t) + c_l\,[D(t) - D(l-1)], \qquad F(t) = \min_{1 \le l \le t} F(l, t).F(l,t)=F(l−1)+Kl​+S(l,t)+cl​[D(t)−D(l−1)],F(t)=1≤l≤tmin​F(l,t).

F(l,t)F(l, t)F(l,t) is the cost of the first ttt periods when the last setup is in period lll.

For two periods k<lk < lk<l the difference Δk,l(t)=F(k,t)−F(l,t)\Delta_{k,l}(t) = F(k,t) - F(l,t)Δk,l​(t)=F(k,t)−F(l,t) is affine in D(t)D(t)D(t), with intercept A(k,l)A(k,l)A(k,l) given by (4) and slope ck,l−cl=C~(k)−C~(l)c_{k,l} - c_l = \tilde C(k) - \tilde C(l)ck,l​−cl​=C~(k)−C~(l). Its root G(k,l)G(k,l)G(k,l) is defined by (5): A(k,l)/(C~(l)−C~(k))A(k,l)/(\tilde C(l) - \tilde C(k))A(k,l)/(C~(l)−C~(k)) when the slopes differ, and +∞+\infty+∞ or −∞-\infty−∞ according to the sign of A(k,l)A(k,l)A(k,l) when they agree. It is extended symmetrically, G(l,k)=G(k,l)G(l,k) = G(k,l)G(l,k)=G(k,l).

At iteration jjj the future demands are unknown, so a future horizon has a potential cumulative demand x≥D(j)x \ge D(j)x≥D(j). The jjjth Minimal Optimal Predecessors list Ω(j)\Omega(j)Ω(j) is the set of periods l≤jl \le jl≤j that are the lowest-index optimal last setup period, among {1,…,j}\{1, \dots, j\}{1,…,j}, for every potential cumulative demand in some open interval above D(j)D(j)D(j).

Formalization targets

Goal: Theorem 1(a)

Let j≥1j \ge 1j≥1 and let S={i1,…,ir}S = \{i_1, \dots, i_r\}S={i1​,…,ir​} with Ω(j)⊆S⊆{1,…,j}\Omega(j) \subseteq S \subseteq \{1, \dots, j\}Ω(j)⊆S⊆{1,…,j}, ranked so that C~(i1)≥⋯≥C~(ir)\tilde C(i_1) \ge \dots \ge \tilde C(i_r)C~(i1​)≥⋯≥C~(ir​), with equal C~\tilde CC~-values in ascending order of index. Put g(1)=D(j)g(1) = D(j)g(1)=D(j) and g(l)=G(il,il−1)g(l) = G(i_l, i_{l-1})g(l)=G(il​,il−1​) for l=2,…,rl = 2, \dots, rl=2,…,r. Then

S=Ω(j)  ⟺  g(1)<g(2)<⋯<g(r)<∞.(6)S = \Omega(j) \iff g(1) < g(2) < \dots < g(r) < \infty. \tag{6}S=Ω(j)⟺g(1)<g(2)<⋯<g(r)<∞.(6)

Milestones

In attack order:

  • identity (1a) for the carrying costs;
  • Lemma 2(a)–(d), the linearity of Δk,l\Delta_{k,l}Δk,l​ and the sign test against its root G(k,l)G(k,l)G(k,l);
  • the claim that Ω(j)\Omega(j)Ω(j) contains an optimal last setup period for the horizon jjj;
  • the strict chains (7)–(8) of the Appendix;
  • Theorem 1(b), that under (6) the first entry i1i_1i1​ is an optimal last setup period l(j)l(j)l(j);
  • Theorem 1(c)(i)–(iii), the three elimination rules: g(2)≤D(j)g(2) \le D(j)g(2)≤D(j) removes i1i_1i1​, g(k+1)≤g(k)g(k+1) \le g(k)g(k+1)≤g(k) removes iki_kik​, and g(r)=∞g(r) = \inftyg(r)=∞ removes iri_rir​.

A supporting item potCost_spec certifies that the potential costs used to define Ω(j)\Omega(j)Ω(j) agree with the paper's F(l,t)F(l,t)F(l,t), up to a term that does not depend on lll.

Significance

Theorem 1 is what makes the forward algorithm correct. Part (a) reduces the minimality of a candidate list to a condition on consecutive pairs of a sorted list. Part (c) says which entry to delete when the condition fails. Part (b) says where to read off the optimal last setup period. With these, Ω(j)\Omega(j)Ω(j) is maintained by deletions at the ends and in the interior of a list ordered by C~\tilde CC~, and each period is inserted and deleted at most once; the O(nlog⁡n)O(n \log n)O(nlogn) bound, and the O(n)O(n)O(n) bound under the paper's special cost structures, follow from this bookkeeping. The same lower-envelope reasoning appears in the other 1991–1993 algorithms and in later extensions to backlogging and capacitated variants.

The result has a complete published proof. To our knowledge there is no machine-checked development of the Wagner–Whitin recursion or of any of the fast lot-sizing algorithms. This mission produces the model, the breakpoints and the Minimal Optimal Predecessors lists as reusable definitions, and a checked proof of the characterization. It also records two small corrections that a formal reading forces on the printed text (see Formalization scope).

Difficulty

Each piece in isolation is elementary algebra on affine functions. The difficulty is in the combinatorics of the lower envelope with ties. The natural argument "consecutive breakpoints increase, so each line owns an interval" must handle three things:

  • equal slopes, where G=±∞G = \pm\inftyG=±∞;
  • several lines meeting at one point;
  • the lowest-index tie-breaking that makes Ω(j)\Omega(j)Ω(j) minimal.

The "only if" direction needs every failure of (6) to be traced to an element that is never the unique lowest-index optimum on an interval. Ties are exactly where the printed definition of Ω(j)\Omega(j)Ω(j), read literally at a single demand value, breaks the theorem. A proof that ignores ties proves a statement that is false.

Formalization scope

  • Data and costs. The data are four functions N→R\mathbb N \to \mathbb RN→R bundled in a structure; values at index 000 are unused, and no sign conditions are imposed. FFF is defined by the recursion (2) with F(0)=0F(0) = 0F(0)=0. Its identification with the minimum cost over all feasible policies is the paper's Lemma 1 (Wagner–Whitin), which is not part of this mission. The horizon nnn is not a parameter.
  • Breakpoints. GGG and the critical values g(⋅)g(\cdot)g(⋅) take values in EReal, so ±∞\pm\infty±∞ are kept distinct from every real number. The final "<∞< \infty<∞" of (6) is part of the condition.
  • Ranked lists. A ranked set is a duplicate-free List ℕ. Lean lists are 0-based, so the paper's im+1i_{m+1}im+1​ and g(m+1)g(m+1)g(m+1) are entry mmm and gval j L m.
  • Disclosed change 1, Ω(j)\Omega(j)Ω(j). The page asks for a single potential cumulative demand D≥D(j)D \ge D(j)D≥D(j) at which lll is the lowest-index optimum. With that reading, Theorem 1(a) "only if" and Theorem 1(c) fail when two lines tie exactly at a breakpoint (an explicit five-period instance is in the definition's note). The formalization requires lll to be the lowest-index optimum on a nondegenerate open interval of potential demands above D(j)D(j)D(j). This is the paper's own description of the list on p. 915: "the unique optimal last setup period for any horizon … with potential cumulative demand g(k)<D<g(k+1)g(k) < D < g(k+1)g(k)<D<g(k+1)".
  • Disclosed change 2, Lemma 2(d). The printed hypothesis "ck,l<clc_{k,l} < c_lck,l​<cl​" duplicates part (c) and is read as "ck,l=clc_{k,l} = c_lck,l​=cl​". The equivalence "Δk,l≥0\Delta_{k,l} \ge 0Δk,l​≥0 iff D(t)≥G(k,l)D(t) \ge G(k,l)D(t)≥G(k,l)" is stated under A(k,l)≠0A(k,l) \ne 0A(k,l)=0, since A(k,l)=0A(k,l) = 0A(k,l)=0 gives G=+∞G = +\inftyG=+∞ by (5).
  • Ruling out trivial formalizations. The hypotheses of the goal are satisfiable for every j≥1j \ge 1j≥1: rank {1,…,j}\{1, \dots, j\}{1,…,j} itself. Ω(j)\Omega(j)Ω(j) is nonempty (a milestone). F(t)F(t)F(t) for t≥1t \ge 1t≥1 is a minimum over the nonempty set {1,…,t}\{1, \dots, t\}{1,…,t}, never a default value. GGG is never replaced by a real-valued junk value at equal slopes.
  • Out of scope. Lemma 1, Lemma 3, Corollaries 1–5, Theorem 2, the Algorithm's pseudo-code and its complexity analysis, and the submodularity discussion of §5.
  • Reusable infrastructure. The model, the recursion (2), AAA, GGG and Ω(j)\Omega(j)Ω(j) can be reused for the paper's algorithmic results and for related lot-sizing papers. Proofs of the milestones, in any order, are welcome.

Selected references

  • A. Federgruen and M. Tzur, A Simple Forward Algorithm to Solve General Dynamic Lot Sizing Models with n Periods in O(n log n) or O(n) Time, Management Science 37(8):909–925, 1991. https://doi.org/10.1287/mnsc.37.8.909
  • H. M. Wagner and T. M. Whitin, Dynamic Version of the Economic Lot Size Model, Management Science 5(1):89–96, 1958. https://doi.org/10.1287/mnsc.5.1.89
  • A. Wagelmans, S. van Hoesel and A. Kolen, Economic Lot-Sizing: An O(n log n) Algorithm That Runs in Linear Time in the Wagner-Whitin Case, Operations Research 40(1-supplement-1):S145–S156, 1992. https://doi.org/10.1287/opre.40.1.S145
  • A. Aggarwal and J. K. Park, Improved Algorithms for Economic Lot Size Problems, Operations Research 41(3):549–571, 1993. https://doi.org/10.1287/opre.41.3.549
16 thms2 active usersReviewed
Operations Research·Captain: mikedeng1

On the Power of Randomization in On-Line Algorithms 4: Restarting a Bounded-Cost Algorithm Is (1+ε)α-Competitive in Games of Finite DiameterResearch Paper

Motivation

Competitive analysis compares an online algorithm, which must answer each request before seeing the next, with the optimal off-line solution of the same request sequence. Ben-David, Borodin, Karp, Tardos and Wigderson (Algorithmica 11, 1994) set up a general framework, request-answer games, in which paging, the KKK-server problem and metrical task systems are all instances, and used it to compare the power of randomized algorithms against several kinds of adversaries.

One of their results (Theorem 2.1) says that if a randomized algorithm is α\alphaα-competitive against every adaptive off-line adversary, then some deterministic algorithm is already α\alphaα-competitive. The argument is a game-theoretic existence proof: it says nothing about how to compute the deterministic algorithm. Section 4 of the paper, "A Constructive Version of Theorem 2.1", answers the natural follow-up question for a large class of games: under monotonicity, locality and a finite diameter, a deterministic algorithm that loses only a factor 1+ϵ1+\epsilon1+ϵ can be assembled from a finite object.

Setting

A request-answer game FFF has a request set RRR, a finite answer set AAA, and cost functions fn:Rn×An→Rf_n : R^n \times A^n \to \mathbb{R}fn​:Rn×An→R, n≥0n \ge 0n≥0; f0f_0f0​ is the cost of the empty play. The off-line optimum of a request sequence rrr of length nnn is c(r)=min⁡a∈Anfn(r,a)c(r) = \min_{a \in A^n} f_n(r, a)c(r)=mina∈An​fn​(r,a). A deterministic online algorithm GGG answers the iii-th request by a function gi(r1,…,ri)g_i(r_1, \dots, r_i)gi​(r1​,…,ri​) of the requests so far; its cost on rrr is cG(r)=fn(r,G(r))c_G(r) = f_n(r, G(r))cG​(r)=fn​(r,G(r)). It is α\alphaα-competitive if cG(r)≤α(c(r))c_G(r) \le \alpha(c(r))cG​(r)≤α(c(r)) for every rrr.

The game is monotone if fn+1(rt,ab)≥fn(r,a)f_{n+1}(rt, ab) \ge f_n(r, a)fn+1​(rt,ab)≥fn​(r,a) always, and local if for every h>0h > 0h>0 only finitely many request sequences have c(r)≤hc(r) \le hc(r)≤h. The discrepancy of two request-answer sequences is

δ((r,a),(r′,a′))=f(rr′,aa′)−f(r,a)−f(r′,a′),\delta((r,a),(r',a')) = f(rr', aa') - f(r,a) - f(r',a'),δ((r,a),(r′,a′))=f(rr′,aa′)−f(r,a)−f(r′,a′),

and the diameter D(F)D(F)D(F) is the supremum of ∣δ∣|\delta|∣δ∣ over all pairs.

For a real HHH, the set RHR_HRH​ consists of the request sequences all of whose proper prefixes have off-line optimum at most HHH. Given a deterministic algorithm AHA_HAH​, the restart algorithm simulates AHA_HAH​ and, as soon as the request sequence leaves RHR_HRH​, starts over as if it had received no previous requests. This cuts every request sequence into segments r=r(1) r(2)⋯r(t)r = r(1)\, r(2) \cdots r(t)r=r(1)r(2)⋯r(t), each a longest prefix in RHR_HRH​ of what remains.

Formalization targets

Goal: Theorem 4.1 through its construction

Let FFF be monotone and local, with finite nonempty RRR and AAA, f0≥0f_0 \ge 0f0​≥0, and diameter at most DDD. Let α(x)=d x\alpha(x) = d\,xα(x)=dx with d≥1d \ge 1d≥1, ϵ>0\epsilon > 0ϵ>0, and

H=(2+ϵ)Dϵ.H = \frac{(2+\epsilon) D}{\epsilon}.H=ϵ(2+ϵ)D​.

Then RHR_HRH​ is finite; the restart algorithm depends on AHA_HAH​ only through its values on RHR_HRH​; and for every AHA_HAH​ with cAH(r)≤α(c(r))c_{A_H}(r) \le \alpha(c(r))cAH​​(r)≤α(c(r)) on RHR_HRH​,

cRestart(r)≤(1+ϵ) α(c(r))for all request sequences r.c_{\mathrm{Restart}}(r) \le (1+\epsilon)\,\alpha(c(r)) \qquad \text{for all request sequences } r.cRestart​(r)≤(1+ϵ)α(c(r))for all request sequences r.

Milestones (proof of Theorem 4.1, pp. 17–18)

  1. RHR_HRH​ is finite.
  2. The restart rule produces the greedy decomposition into longest prefixes in RHR_HRH​.
  3. The restart algorithm answers AH(r(1)),AH(r(2)),…,AH(r(t))A_H(r(1)), A_H(r(2)), \dots, A_H(r(t))AH​(r(1)),AH​(r(2)),…,AH​(r(t)).
  4. c(r(i))≥Hc(r(i)) \ge Hc(r(i))≥H for i=1,…,t−1i = 1, \dots, t-1i=1,…,t−1.
  5. c(r)≥c(r(1))+∑i=2t(c(r(i))−D(F))c(r) \ge c(r(1)) + \sum_{i=2}^{t} (c(r(i)) - D(F))c(r)≥c(r(1))+∑i=2t​(c(r(i))−D(F)).
  6. cRestart(r)≤α(c(1))+∑i=2t(α(c(i))+D(F))c_{\mathrm{Restart}}(r) \le \alpha(c(1)) + \sum_{i=2}^{t} (\alpha(c(i)) + D(F))cRestart​(r)≤α(c(1))+∑i=2t​(α(c(i))+D(F)).

Significance

Theorem 2.1 shows that, against adaptive off-line adversaries, randomization gives no advantage, but only as an existence statement. Theorem 4.1 turns it into a recipe: a deterministic algorithm need only be good on the finite set RHR_HRH​, which can be prepared in advance, and restarting extends it to all inputs at a loss of 1+ϵ1+\epsilon1+ϵ. The paper illustrates this with KKK-server problems on finite graphs, where AHA_HAH​ is a finite table and each step of the resulting algorithm costs one dynamic-programming evaluation of an off-line optimum.

The restart construction is of independent use: it is a general way to turn a guarantee on bounded-cost inputs into a guarantee on all inputs when the cost is nearly additive over concatenation.

To our knowledge neither the abstract request-answer game model nor this theorem has a machine-checked proof. The mission produces a formal model of request-answer games with the monotonicity, locality and diameter conditions, the restart algorithm as an explicit definition, and the full chain of inequalities of the proof.

Difficulty

The individual inequalities are elementary; the work lies in the bookkeeping of the construction. The algorithm is defined online, one request at a time, while the analysis is phrased through the decomposition of the whole sequence. Relating the two requires showing that the online rule produces exactly the decomposition into longest prefixes in RHR_HRH​, and that the answers produced on each segment are those of AHA_HAH​ run from scratch, so that the cost of the whole play can be compared with the costs on the segments. The constants must close exactly: with H=(2+ϵ)D/ϵH = (2+\epsilon)D/\epsilonH=(2+ϵ)D/ϵ the additive losses at the t−1t-1t−1 cuts, on both the algorithm's side and the optimum's side, must be absorbed by the factor 1+ϵ1+\epsilon1+ϵ, and they do so only for ratios d≥1d \ge 1d≥1.

A tempting shortcut is to conclude Theorem 4.1 from Theorem 2.1 directly: a deterministic α\alphaα-competitive algorithm is trivially (1+ϵ)α(1+\epsilon)\alpha(1+ϵ)α-competitive when costs are nonnegative. This proves the sentence of the theorem without its point, and is ruled out below.

Formalization scope

  • Request and answer sequences are Lean Lists, oldest first; fn(r,a)f_n(r,a)fn​(r,a) is F.cost r a with r.length = a.length. Costs are real-valued (the paper allows +∞+\infty+∞; real costs are a special case).
  • The answer set is a Fintype and nonempty; in the goal the request set is a Fintype and nonempty.
  • A deterministic algorithm is one function List R → A. Competitiveness of a deterministic algorithm against adaptive off-line adversaries is stated as competitiveness on every request sequence, which is equivalent for deterministic algorithms (p. 8).
  • Finite diameter is a real bound DDD with ∣δ∣≤D|\delta| \le D∣δ∣≤D for all pairs, and every statement holds for every such DDD, in particular D=D(F)D = D(F)D=D(F); no real supremum is taken.
  • f0≥0f_0 \ge 0f0​≥0 is assumed in the goal; with monotonicity it makes every cost nonnegative. It holds in the paper's examples.
  • α(x)=d x\alpha(x) = d\,xα(x)=dx with d≥1d \ge 1d≥1 in the goal; the cost bound for the restart algorithm (milestone 6) holds for an arbitrary α\alphaα.
  • HHH is fixed to the paper's value (2+ϵ)D/ϵ(2+\epsilon)D/\epsilon(2+ϵ)D/ϵ.
  • The restart algorithm is a definition (a left fold over the requests), not a hypothesis. The paper's assumption of a randomized algorithm competitive against adaptive off-line adversaries is used only, through Theorem 2.1, to obtain AHA_HAH​; the goal quantifies over every AHA_HAH​ that is α\alphaα-competitive on RHR_HRH​. "Computable" has no precise meaning for real costs; its content is the finiteness of RHR_HRH​ together with the fact that the restart algorithm reads AHA_HAH​ only on RHR_HRH​. A formalization that proves only the existence of a deterministic (1+ϵ)α(1+\epsilon)\alpha(1+ϵ)α-competitive algorithm, without the construction, does not meet the goal.
  • Milestones 5 and 6 are stated for nonempty request sequences, so that t≥1t \ge 1t≥1; milestone 5 is stated for every decomposition into consecutive pieces.

Contributions welcome: proofs of the milestones, and a connection to the other missions of this series, where the randomized model and Theorem 2.1 are formalized.

Selected references

  • S. Ben-David, A. Borodin, R. Karp, G. Tardos, A. Wigderson, On the power of randomization in on-line algorithms, Algorithmica 11 (1994). https://doi.org/10.1007/BF01294260
  • M. Chrobak, H. Karloff, T. Payne, S. Vishwanathan, New results on server problems, SIAM Journal on Discrete Mathematics 4 (1991), 172–181. https://doi.org/10.1137/0404017
10 thms2 active usersReviewed
CombinatoricsOperations ResearchOptimization·Captain: mikedeng1

A Tight Linear Time (1/2)-Approximation for Unconstrained Submodular Maximization 3: Fractional Double Greedy on the Multilinear Extension Achieves 1/2 of the OptimumResearch Paper

Motivation

Unconstrained submodular maximization (USM) asks for a subset SSS of a finite ground set N\mathcal NN maximizing a nonnegative submodular function fff. It contains Max-Cut, Max-DiCut and maximum facility location as special cases, and it is the basic subproblem of many constrained submodular maximization algorithms. Because fff is given only through a value oracle, the question is how close to the optimum a polynomial number of queries can get.

Timeline of the approximation ratio for USM in the value oracle model:

  • Feige, Mirrokni and Vondrák (FOCS 2007; SIAM J. Comput. 2011) showed that a uniformly random set achieves 1/41/41/4, local search achieves 1/31/31/3 and 2/52/52/5, and that no algorithm making polynomially many queries achieves 1/2+ε1/2 + \varepsilon1/2+ε for any fixed ε>0\varepsilon > 0ε>0.
  • Oveis Gharan and Vondrák (SODA 2011) reached 0.410.410.41 by simulated annealing; Feldman, Naor and Schwartz (ICALP 2011) reached 0.420.420.42.
  • Buchbinder, Feldman, Naor and Schwartz (FOCS 2012) closed the gap with the double greedy algorithms: a deterministic 1/31/31/3-approximation and a randomized 1/21/21/2-approximation, both linear in the number of oracle calls. Their Appendix A gives a third, fractional variant, which is the subject of this mission.

This is the third mission on the FOCS 2012 paper; the first two treat the deterministic and the randomized double greedy on sets.

Setting

Let N\mathcal NN be a finite ground set with nnn elements and f:2N→R≥0f : 2^{\mathcal N} \to \mathbb R_{\ge 0}f:2N→R≥0​. The function fff is submodular if

f(A)+f(B)≥f(A∪B)+f(A∩B)for all A,B⊆N.f(A) + f(B) \ge f(A \cup B) + f(A \cap B) \qquad \text{for all } A, B \subseteq \mathcal N .f(A)+f(B)≥f(A∪B)+f(A∩B)for all A,B⊆N.

Write f(OPT)=max⁡S⊆Nf(S)f(OPT) = \max_{S \subseteq \mathcal N} f(S)f(OPT)=maxS⊆N​f(S) and let OPTOPTOPT be a maximizing set.

The multilinear extension of fff is the function on vectors x∈[0,1]Nx \in [0,1]^{\mathcal N}x∈[0,1]N

F(x)=∑S⊆Nf(S)∏u∈Sxu∏u∉S(1−xu)=E[f(R(x))],F(x) = \sum_{S \subseteq \mathcal N} f(S) \prod_{u \in S} x_u \prod_{u \notin S} (1 - x_u) = \mathbb E\bigl[f(R(x))\bigr],F(x)=S⊆N∑​f(S)u∈S∏​xu​u∈/S∏​(1−xu​)=E[f(R(x))],

where the random set R(x)R(x)R(x) contains each element uuu independently with probability xux_uxu​. A set is identified with its characteristic vector, so FFF agrees with fff on {0,1}N\{0,1\}^{\mathcal N}{0,1}N, and {u}\{u\}{u} also denotes the unit vector at uuu. For vectors, x∨yx \vee yx∨y and x∧yx \wedge yx∧y are the coordinate-wise maximum and minimum.

Algorithm 4 (MultilinearUSM). Fix an arbitrary order u1,…,unu_1, \dots, u_nu1​,…,un​ of N\mathcal NN and start from x0=∅x_0 = \emptysetx0​=∅ and y0=Ny_0 = \mathcal Ny0​=N (the vectors 0\mathbf 00 and 1\mathbf 11). In iteration i=1,…,ni = 1, \dots, ni=1,…,n compute

ai=F(xi−1+{ui})−F(xi−1),bi=F(yi−1−{ui})−F(yi−1),a_i = F(x_{i-1} + \{u_i\}) - F(x_{i-1}), \qquad b_i = F(y_{i-1} - \{u_i\}) - F(y_{i-1}),ai​=F(xi−1​+{ui​})−F(xi−1​),bi​=F(yi−1​−{ui​})−F(yi−1​),

set ai′=max⁡{ai,0}a_i' = \max\{a_i, 0\}ai′​=max{ai​,0}, bi′=max⁡{bi,0}b_i' = \max\{b_i, 0\}bi′​=max{bi​,0}, and update

xi=xi−1+ai′ai′+bi′{ui},yi=yi−1−bi′ai′+bi′{ui},x_i = x_{i-1} + \frac{a_i'}{a_i' + b_i'} \{u_i\}, \qquad y_i = y_{i-1} - \frac{b_i'}{a_i' + b_i'} \{u_i\},xi​=xi−1​+ai′​+bi′​ai′​​{ui​},yi​=yi−1​−ai′​+bi′​bi′​​{ui​},

with the convention that the two fractions are 111 and 000 when ai′=bi′=0a_i' = b_i' = 0ai′​=bi′​=0. The output is the random set R(xn)R(x_n)R(xn​). Every choice before the output is deterministic; the algorithm queries FFF at four points per element.

For the analysis, OPTi=(OPT∨xi)∧yiOPT_i = (OPT \vee x_i) \wedge y_iOPTi​=(OPT∨xi​)∧yi​.

Formalization targets

Goal: Theorem A.1, oracle-access clause

For every nonnegative submodular fff and every order of the ground set,

xn=ynandf(OPT)≤2 F(xn)=2 E[f(R(xn))].x_n = y_n \qquad\text{and}\qquad f(OPT) \le 2\,F(x_n) = 2\,\mathbb E\bigl[f(R(x_n))\bigr].xn​=yn​andf(OPT)≤2F(xn​)=2E[f(R(xn​))].

Milestones, in the order the proof uses them

  1. ai+bi≥0a_i + b_i \ge 0ai​+bi​≥0 at every iteration (proof of Lemma A.2; the page cites Lemma II.1).
  2. Endpoints: OPT0=OPTOPT_0 = OPTOPT0​=OPT with F(OPT)=f(OPT)F(OPT) = f(OPT)F(OPT)=f(OPT), and OPTn=xn=ynOPT_n = x_n = y_nOPTn​=xn​=yn​.
  3. (4) and (5): if ai≥0a_i \ge 0ai​≥0 and bi>0b_i > 0bi​>0, then F(xi)−F(xi−1)=ai2/(ai+bi)F(x_i) - F(x_{i-1}) = a_i^2/(a_i+b_i)F(xi​)−F(xi−1​)=ai2​/(ai​+bi​) and F(yi)−F(yi−1)=bi2/(ai+bi)F(y_i) - F(y_{i-1}) = b_i^2/(a_i+b_i)F(yi​)−F(yi−1​)=bi2​/(ai​+bi​).
  4. (6): in the same case, F(OPTi−1)−F(OPTi)≤aibi/(ai+bi)F(OPT_{i-1}) - F(OPT_i) \le a_i b_i/(a_i + b_i)F(OPTi−1​)−F(OPTi​)≤ai​bi​/(ai​+bi​), whether or not ui∈OPTu_i \in OPTui​∈OPT.
  5. Lemma A.2: for every 1≤i≤n1 \le i \le n1≤i≤n,
F(OPTi−1)−F(OPTi)≤12[F(xi)−F(xi−1)+F(yi)−F(yi−1)].F(OPT_{i-1}) - F(OPT_i) \le \tfrac12\bigl[F(x_i) - F(x_{i-1}) + F(y_i) - F(y_{i-1})\bigr].F(OPTi−1​)−F(OPTi​)≤21​[F(xi​)−F(xi−1​)+F(yi​)−F(yi−1​)].
  1. Telescoped display: F(OPT0)−F(OPTn)≤12[F(xn)−F(x0)]+12[F(yn)−F(y0)]≤12(F(xn)+F(yn))F(OPT_0) - F(OPT_n) \le \tfrac12[F(x_n) - F(x_0)] + \tfrac12[F(y_n) - F(y_0)] \le \tfrac12(F(x_n) + F(y_n))F(OPT0​)−F(OPTn​)≤21​[F(xn​)−F(x0​)]+21​[F(yn​)−F(y0​)]≤21​(F(xn​)+F(yn​)).

Significance

The result. Theorem A.1 shows that the double greedy analysis survives a change of domain: the factor 1/21/21/2 is obtained by a procedure that never flips a coin until the end, and whose state is a pair of fractional points. The ratio matches the Feige–Mirrokni–Vondrák hardness bound, so it cannot be improved in the value oracle model. Its output is a fractional point together with an independent rounding, which separates the optimization from the rounding step.

Formalizing it. The result is proved on paper; no machine-checked proof of a double greedy guarantee is known. A complete development yields reusable facts about the multilinear extension of a submodular function on a finite type: FFF is affine in each coordinate, its coordinate increments are antitone in the other coordinates on [0,1]N[0,1]^{\mathcal N}[0,1]N, and FFF restricted to characteristic vectors is fff. These are the standard tools of every continuous-relaxation argument for submodular maximization.

Difficulty

The proof on the page is short, but it relies on two facts it does not prove. First, the page justifies ai+bi≥0a_i + b_i \ge 0ai​+bi​≥0 "by Lemma II.1", which is a statement about sets; for vectors it requires that the increment of FFF along a coordinate decreases as the other coordinates increase, a property of the multilinear extension of a submodular function that must be derived from the sum defining FFF. Second, inequality (6) is written out only for ui∉OPTu_i \notin OPTui​∈/OPT, and Case 2 of Lemma A.2 is omitted as analogous; the formal statements cover all cases. The main technical work is the bookkeeping of the run: that each coordinate is touched once, that xi−1(ui)=0x_{i-1}(u_i) = 0xi−1​(ui​)=0 and yi−1(ui)=1y_{i-1}(u_i) = 1yi−1​(ui​)=1 when it is touched, that xi≤OPTi≤yix_i \le OPT_i \le y_ixi​≤OPTi​≤yi​, and that every state stays in [0,1]N[0,1]^{\mathcal N}[0,1]N, where the antitonicity applies.

Formalization scope

  • The ground set is a Fintype XXX with decidable equality; sets are Finset X; fff is real-valued, with nonnegativity a hypothesis ∀ S, 0 ≤ f S wherever the page uses it (the goal and the telescoped display). Submodularity is the published NonmonotoneSubmod.Shared.Submodular, the lattice form f(S∪T)+f(S∩T)≤f(S)+f(T)f(S \cup T) + f(S \cap T) \le f(S) + f(T)f(S∪T)+f(S∩T)≤f(S)+f(T); f(OPT)f(OPT)f(OPT) is the published NonmonotoneSubmod.Shared.OPT; FFF is the published NonmonotoneSubmod.Shared.F, the sum above, defined for every x:X→Rx : X \to \mathbb Rx:X→R.
  • The order u1,…,unu_1, \dots, u_nu1​,…,un​ is a duplicate-free list containing every element; uiu_iui​ is the entry at index i−1i-1i−1, and nnn is the list's length. The state after iii iterations is obtained by folding one step over the first iii entries from (0,1)(\mathbf 0, \mathbf 1)(0,1). Statements hold for every such order.
  • The footnote's convention ai′/(ai′+bi′)=1a_i'/(a_i'+b_i') = 1ai′​/(ai′​+bi′​)=1, bi′/(ai′+bi′)=0b_i'/(a_i'+b_i') = 0bi′​/(ai′​+bi′​)=0 when ai′=bi′=0a_i' = b_i' = 0ai′​=bi′​=0 is an explicit case split; with Lean's 0/0=00/0 = 00/0=0 it would otherwise be reversed and the run would no longer end with xn=ynx_n = y_nxn​=yn​.
  • Corrected slips of the page: lines 3–4 of Algorithm 4 assign ai′,bi′a_i', b_i'ai′​,bi′​ but define ai,bia_i, b_iai​,bi​; "f:N→R+f : \mathcal N \to \mathbb R^+f:N→R+" means f:2N→R+f : 2^{\mathcal N} \to \mathbb R^+f:2N→R+; "F(x)≜E[R(x)]F(x) \triangleq \mathbb E[R(x)]F(x)≜E[R(x)]" means E[f(R(x))]\mathbb E[f(R(x))]E[f(R(x))]; "NSM" in Theorem A.1 means USM. The main text's one-line definition of submodularity, read literally, forces monotonicity; the footnote's lattice form is used.
  • Not formalized: the sampling clause of Theorem A.1 (ratio (1/2)−o(1)(1/2) - o(1)(1/2)−o(1) without oracle access to FFF, whose proof the paper refers to Calinescu, Chekuri, Pál and Vondrák) and the running time. The guarantee is stated for the algorithm as printed, so the trivial existence of a 1/21/21/2-approximation by exhaustive search does not satisfy it. A statement in which xnx_nxn​ is an arbitrary point, or the state any process with xi≤yix_i \le y_ixi​≤yi​, would not be this theorem.
  • Contributions welcome: the multilinear-extension facts above as general lemmas, the run invariants, and proofs of the milestones in any order.

Selected references

  • N. Buchbinder, M. Feldman, J. Naor, R. Schwartz, A Tight Linear Time (1/2)-Approximation for Unconstrained Submodular Maximization, FOCS 2012, 649–658. https://doi.org/10.1109/FOCS.2012.73 (journal version: SIAM J. Comput. 44(5), 2015, https://doi.org/10.1137/130929205; its numbering differs and is not used here).
  • U. Feige, V. S. Mirrokni, J. Vondrák, Maximizing Non-monotone Submodular Functions, SIAM J. Comput. 40(4), 2011, 1133–1153. https://doi.org/10.1137/090779346
  • S. Oveis Gharan, J. Vondrák, Submodular Maximization by Simulated Annealing, SODA 2011, 1098–1117. https://doi.org/10.1137/1.9781611973082.83
  • M. Feldman, J. Naor, R. Schwartz, Nonmonotone Submodular Maximization via a Structural Continuous Greedy Algorithm, ICALP 2011, 342–353. https://doi.org/10.1007/978-3-642-22006-7_29
  • G. Calinescu, C. Chekuri, M. Pál, J. Vondrák, Maximizing a Monotone Submodular Function Subject to a Matroid Constraint, SIAM J. Comput. 40(6), 2011, 1740–1766. https://doi.org/10.1137/080733991
11 thms2 active usersReviewed
PreviousPage 1 of 3Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me