Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in
← Collections

The OR Formalization Drive

Help us formalize the operations research literature in Lean.

705 completed missions

Missions

441–460 of 705
OpenCompletedAll
🏆Completed
Algorithmic Game TheoryMechanism DesignOperations Research+1·Captain: mikedeng1

Algorithmic Mechanism Design II: A Lower Bound for Truthful Task SchedulingResearch Paper

Motivation

Algorithms deployed on the Internet often take their inputs from parties who own them and who may lie when lying pays. Nisan and Ronen's Algorithmic Mechanism Design (Games and Economic Behavior 35, 2001) proposed studying optimization problems in this setting: the algorithm designer may hand out payments, and must guarantee that the intended output is produced when every participant acts in its own interest. The paper's central test case is scheduling on unrelated machines, a standard problem of combinatorial optimization, in which the machines are the selfish participants and only they know how long each job takes them.

For this problem the paper shows that incentives cost a factor of two at least: with two or more machines, no mechanism can guarantee a make-span below twice the optimum. This was the first lower bound separating what incentive-compatible mechanisms can achieve from what ordinary approximation algorithms can achieve, and it started a line of work on the "Nisan–Ronen conjecture" (that the right factor for nnn machines is nnn), with improved lower bounds by Christodoulou, Koutsoupias and Vidali (Algorithmica, 2009) and by Koutsoupias and Vidali (Algorithmica, 2013), and a resolution announced by Christodoulou, Koutsoupias and Kovács (STOC 2023).

Setting

There are nnn agents (machines) i=1,…,ni = 1,\dots,ni=1,…,n and kkk tasks j=1,…,kj = 1,\dots,kj=1,…,k. Agent iii's private type is the vector ti=(t1i,…,tki)t^i = (t^i_1,\dots,t^i_k)ti=(t1i​,…,tki​) of positive real numbers, tjit^i_jtji​ being the time agent iii needs for task jjj; a type vector is t=(t1,…,tn)t = (t^1,\dots,t^n)t=(t1,…,tn). An allocation xxx assigns every task to one agent; xix^ixi is the set of tasks given to agent iii. For a set XXX of tasks write ti(X)=∑j∈Xtjit^i(X) = \sum_{j\in X} t^i_jti(X)=∑j∈X​tji​. The objective is the make-span

g(x,t)=max⁡iti(xi),g(x,t) = \max_{i} t^i(x^i),g(x,t)=imax​ti(xi),

and an allocation rule is a ccc-approximation if its make-span is at most ccc times that of every allocation, on every type vector.

A mechanism m=(o,p)m = (o,p)m=(o,p) gives each agent iii a set AiA^iAi of strategies. On a strategy profile a=(a1,…,an)a = (a^1,\dots,a^n)a=(a1,…,an) it outputs an allocation o(a)o(a)o(a) and hands agent iii a payment pi(a)p^i(a)pi(a). An agent of type tit^iti has utility pi(a)−ti(oi(a))p^i(a) - t^i(o^i(a))pi(a)−ti(oi(a)). A strategy is dominant if it maximizes the agent's utility whatever the others play. The mechanism implements a ccc-approximation if every agent of every type has a dominant strategy and every profile of dominant strategies yields a ccc-approximate allocation.

A direct mechanism (x,p)(x,p)(x,p) has AiA^iAi equal to the set of types, and is truthful if reporting the true type is dominant. For a truthful mechanism, the price pi(X,t−i)p^i(X,t^{-i})pi(X,t−i) is the payment agent iii receives when, against the others' reports t−it^{-i}t−i, some report of its own makes it receive exactly XXX (and 000 if none does); the price difference is Δi(A,B)=pi(A∪B,t−i)−pi(A,t−i)\Delta^i(A,B) = p^i(A\cup B,t^{-i}) - p^i(A,t^{-i})Δi(A,B)=pi(A∪B,t−i)−pi(A,t−i).

Formalization targets

Goal: Theorem 4.6

For every n≥2n\ge 2n≥2, k≥3k\ge3k≥3 and c<2c<2c<2, no mechanism with any strategy sets implements a ccc-approximation:

∀ (A,o,p):¬ Implements(o,p,c).\forall\, (A, o, p):\quad \neg\ \mathrm{Implements}(o,p,c).∀(A,o,p):¬ Implements(o,p,c).

Milestones

  1. Proposition 2.1 (revelation principle): a mechanism implementing a ccc-approximation yields a truthful direct mechanism whose allocation rule is a ccc-approximation.
  2. Theorem 4.6 for truthful mechanisms (§4.3): no truthful direct mechanism has a ccc-approximate allocation rule for c<2c<2c<2. With milestone 1 it gives the goal.
  3. Proposition 4.4 (independence): for a truthful mechanism, t1−i=t2−it_1^{-i}=t_2^{-i}t1−i​=t2−i​ and xi(t1)=xi(t2)x^i(t_1)=x^i(t_2)xi(t1​)=xi(t2​) imply pi(t1)=pi(t2)p^i(t_1)=p^i(t_2)pi(t1​)=pi(t2​).
  4. Proposition 4.5 (maximization): xi(t)x^i(t)xi(t) maximizes pi(X,t−i)−ti(X)p^i(X,t^{-i}) - t^i(X)pi(X,t−i)−ti(X) over attainable XXX.
  5. Lemma 4.7: the price-difference inequalities satisfied by xi(t)x^i(t)xi(t), and the uniqueness statement for sets satisfying them strictly.
  6. Claim 4.8: for two agents, all-ones types and 0<ε<10<\varepsilon<10<ε<1, moving agent 1's times to ε\varepsilonε on its own bundle and 1+ε1+\varepsilon1+ε elsewhere leaves the allocation unchanged.
  7. The even case of the ratio: at that perturbed instance the mechanism's make-span is ∣x2(t)∣|x^2(t)|∣x2(t)∣ while some allocation achieves 12∣x2(t)∣+kε\tfrac12|x^2(t)| + k\varepsilon21​∣x2(t)∣+kε.

Significance

The result. Theorem 4.6 shows that the requirement of dominant-strategy incentive compatibility, by itself, rules out approximation ratios below 222 for scheduling on unrelated machines, a problem for which polynomial-time 222-approximation algorithms that ignore incentives exist (Lenstra, Shmoys, Tardos 1990) and for which the exact optimum is computable in exponential time. Combined with the MinWork mechanism of the same paper (an nnn-approximation), it determines the optimal ratio for two machines. It is the base case of the Nisan–Ronen conjecture and the prototype of the "characterize truthful mechanisms by prices" technique used throughout later work on the conjecture.

Formalizing it. The theorem has been proved since 1999, but no machine-checked version is known to exist. The mission produces a formal account of general mechanisms with arbitrary strategy sets, dominant-strategy implementation, the revelation principle in that generality, and the price characterization of truthful mechanisms (independence and maximization). These are reusable for every other lower bound in this paper and for the later literature on the conjecture.

Difficulty

The statement quantifies over all mechanisms, with arbitrary strategy sets and arbitrary payment functions, so no finite search settles it. The revelation principle reduces to truthful direct mechanisms, but even these are an infinite-dimensional family: the allocation rule may break ties in any way, and prices may be any functions of the other agents' reports.

The printed argument also has two places that need care. Proposition 4.5 and Lemma 4.7, as printed, range over all sets of tasks, while Definition 12 gives unattainable sets price 000; the statements hold only over attainable sets, and are formalized that way. And the case where agent 2's bundle has odd size is dispatched in one sentence ("which still yields the same allocation"), which the preceding lemma does not justify when agent 2's best bundle at the perturbed prices is not unique. A complete formal proof of the goal must supply an argument for that case.

Formalization scope

  • Agents are Fin n, tasks Fin k; an allocation is a function Fin k → Fin n; bundles may be empty. The make-span is a finite maximum and assumes n≥1n\ge1n≥1 (NeZero n).
  • Types, declarations and misreports are strictly positive reals throughout (Definition 10). Utility is quasi-linear; payments are handed to the agent and may have either sign.
  • A general mechanism has strategy sets A : Fin n → Type u (any universe), output ooo and payments ppp on dependent strategy profiles. Implements requires both that every agent of every positive type has a dominant strategy and that every profile of dominant strategies yields a ccc-approximate allocation. Dominance is against every profile of the others, not only dominant ones. Without the existence clause, a mechanism with no dominant strategies would implement vacuously; the definition excludes that.
  • Thresholds made explicit: n≥2n\ge2n≥2 and k≥3k\ge3k≥3, both taken from the proof ("We prove the theorem for the case of two agents"; "Let k≥3k\ge3k≥3"). The goal holds for each fixed nnn and kkk and every c<2c<2c<2, for every mechanism, with no restriction on tie-breaking and no requirement of strong truthfulness. At n=1n=1n=1 the claim is false.
  • Proposition 2.1 is stated for task scheduling with the ccc-approximation specification; "truthful implementation" is read as truth-telling dominant and the truthful output ccc-approximate.
  • Printed slips: Proposition 4.5 and Lemma 4.7 are stated over attainable sets; the "Moreover" of Lemma 4.7 requires YYY attainable. The odd case of the ratio step is not a milestone.
  • The reduction from n>2n>2n>2 to two agents ("having the other agents be much slower") is not a separate milestone; the goal covers every n≥2n\ge2n≥2.
  • Running time ("polynomial-time computable") is out of scope and not modelled.

Contributions of any of the milestones are welcome, as are alternative proofs of the goal that avoid the terse odd case.

Selected references

  • N. Nisan, A. Ronen, Algorithmic Mechanism Design, Games and Economic Behavior 35 (2001) 166–196. https://doi.org/10.1006/game.1999.0790
  • A. Mas-Colell, M. D. Whinston, J. R. Green, Microeconomic Theory, Oxford University Press, 1995 (revelation principle, p. 871).
  • J. K. Lenstra, D. B. Shmoys, É. Tardos, Approximation algorithms for scheduling unrelated parallel machines, Mathematical Programming 46 (1990) 259–271. https://doi.org/10.1007/BF01585745
  • G. Christodoulou, E. Koutsoupias, A. Vidali, A lower bound for scheduling mechanisms, Algorithmica 55 (2009).
  • E. Koutsoupias, A. Vidali, A lower bound of 1+φ for truthful scheduling mechanisms, Algorithmica 66 (2013).
  • G. Christodoulou, E. Koutsoupias, A. Kovács, A proof of the Nisan–Ronen conjecture, STOC 2023.
11 thms3 active usersReviewed
🏆Completed
Algorithmic Game TheoryMechanism DesignOperations Research+1·Captain: mikedeng1

Algorithmic Mechanism Design III: No Additive Truthful Mechanism Achieves a c-Approximation for Task Scheduling for Any c < nResearch Paper

Motivation

Algorithmic mechanism design studies optimization problems whose inputs are held by self-interested agents: an algorithm must not only compute a good solution but also pay the agents so that reporting their data truthfully is in their own interest. Nisan and Ronen introduced the field in Algorithmic Mechanism Design (Games Econ. Behav. 35, 2001) with task scheduling on unrelated machines as the model problem. Each machine is owned by an agent who alone knows how long it takes for each task; the designer wants a schedule of small make-span.

The paper gives a truthful mechanism, MinWork, whose make-span is within a factor nnn of optimal, and a lower bound of 222 for every truthful mechanism. It conjectures that no truthful mechanism beats nnn (Conjecture 4.9) and proves the conjecture for two natural classes. This mission is about one of them, additive mechanisms (Theorem 4.10, p. 180).

Timeline of the gap between 222 and nnn:

  • 1999/2001: Nisan and Ronen prove the lower bound 222 for all truthful mechanisms and nnn for additive and for local mechanisms.
  • 2007: Christodoulou, Koutsoupias and Vidali raise the general lower bound to 1+21+\sqrt 21+2​ for n≥3n\ge 3n≥3 (SODA 2007; Algorithmica 2009).
  • 2008: Christodoulou, Koutsoupias and Vidali characterize the truthful mechanisms for two machines (ESA 2008; arXiv 0807.3427); in parallel, Dobzinski and Sundararajan (EC 2008) characterize them and show that for two machines no truthful mechanism beats 222.
  • 2023: Christodoulou, Koutsoupias and Kovács prove the Nisan–Ronen conjecture: no truthful mechanism beats nnn (STOC 2023; arXiv 2301.11905).

Setting

There are nnn agents i=1,…,ni=1,\dots,ni=1,…,n and kkk tasks j=1,…,kj=1,\dots,kj=1,…,k. The type of agent iii is a vector ti=(t1i,…,tki)t^i=(t^i_1,\dots,t^i_k)ti=(t1i​,…,tki​) of positive reals, tjit^i_jtji​ being the time agent iii needs for task jjj; a type vector t=(t1,…,tn)t=(t^1,\dots,t^n)t=(t1,…,tn) collects all types, and t−it^{-i}t−i denotes the types of the agents other than iii. An allocation x=(x1,…,xn)x=(x^1,\dots,x^n)x=(x1,…,xn) is a partition of the tasks, xix^ixi being the set given to agent iii. For a set XXX of tasks write ti(X)=∑j∈Xtjit^i(X)=\sum_{j\in X}t^i_jti(X)=∑j∈X​tji​. The make-span is

g(x,t)=max⁡iti(xi).g(x,t)=\max_i t^i(x^i).g(x,t)=imax​ti(xi).

A direct mechanism m=(x,p)m=(x,p)m=(x,p) maps every declared type vector ttt to an allocation x(t)x(t)x(t) and to payments pi(t)p^i(t)pi(t) handed to the agents. An agent with true type tit^iti gets utility pi(t)−ti(xi(t))p^i(t)-t^i(x^i(t))pi(t)−ti(xi(t)). The mechanism is truthful if, whatever the others declare, no agent gains by declaring a type other than its true one. It is a ccc-approximation if g(x(t),t)≤c g(y,t)g(x(t),t)\le c\,g(y,t)g(x(t),t)≤cg(y,t) for every positive type vector ttt and every allocation yyy.

The price offered for a set XXX to agent iii (Definition 12) is the payment pi(t′i,t−i)p^i(t'^i,t^{-i})pi(t′i,t−i) at any declaration t′it'^it′i for which the mechanism gives agent iii exactly XXX, and 000 if there is no such declaration. For truthful mechanisms this is well defined (Proposition 4.4, Independence). The mechanism is additive (Definition 13) if

pi(X,t−i)=∑j∈Xpi({j},t−i)p^i(X,t^{-i})=\sum_{j\in X}p^i(\{j\},t^{-i})pi(X,t−i)=j∈X∑​pi({j},t−i)

for every agent iii, type vector ttt and set XXX of tasks. MinWork, which gives each task to the fastest agent and pays it the second-fastest time, is additive.

Formalization targets

Goal: Theorem 4.10

For n≥1n\ge 1n≥1 agents and k≥n2k\ge n^2k≥n2 tasks, for every truthful additive mechanism (x,p)(x,p)(x,p) and every real c<nc<nc<n,

∃ t, ∃ y:g(x(t),t)>c⋅g(y,t).\exists\,t,\ \exists\,y:\qquad g\bigl(x(t),t\bigr)>c\cdot g(y,t).∃t, ∃y:g(x(t),t)>c⋅g(y,t).

The goal leaves the mechanism, its tie-breaking and ccc completely general. It says that the ratio nnn of MinWork is optimal among additive mechanisms.

Milestones

  1. Proposition 4.4 (Independence): the payment depends on agent iii's declaration only through its allocation.
  2. Proposition 4.5 (Maximization): xi(t)x^i(t)xi(t) maximizes pi(X,t−i)−ti(X)p^i(X,t^{-i})-t^i(X)pi(X,t−i)−ti(X) over the sets XXX agent iii can obtain against t−it^{-i}t−i.
  3. Pigeonhole: with k≥n2k\ge n^2k≥n2 tasks some agent receives at least nnn tasks.
  4. Claim 4.11: at the all-ones type vector ttt, lowering agent iii's times to 1−ϵ1-\epsilon1−ϵ on xi(t)x^i(t)xi(t) and ϵ\epsilonϵ elsewhere keeps all of xi(t)x^i(t)xi(t) with agent iii, provided the empty set is attainable for agent iii.
  5. The ratio step: at that perturbed type vector, an allocation giving agent iii a fixed set of nnn tasks has make-span at least (1−ϵ)n(1-\epsilon)n(1−ϵ)n, while some allocation has make-span at most 1+kϵ1+k\epsilon1+kϵ.

Significance

Theorem 4.10 shows that the gap between MinWork's ratio nnn and the general lower bound 222 cannot be closed by any mechanism that prices tasks separately, and so any better mechanism would have to couple the prices of different tasks. It was the first class-restricted confirmation of Conjecture 4.9, which was eventually proved for all truthful mechanisms (Christodoulou–Koutsoupias–Kovács 2023). The additive case is the cleanest entry point: its proof needs only the two basic properties of truthful mechanisms, Independence and Maximization, which every later lower bound also uses.

All results here are proved on paper, and none has a machine-checked proof on Prove2Me as of this mission's drafting. The mission produces a formal model of scheduling mechanisms and prices that other lower bounds can reuse, formal statements of Independence and Maximization, and a formal proof of Theorem 4.10. Along the way the formalization corrects two points of the printed argument (see Formalization scope).

Difficulty

The work is to extract prices from an arbitrary truthful mechanism. Prices are defined through the attainable sets of Definition 12. A natural first idea replaces the mechanism by per-task prices qji(t−i)q^i_j(t^{-i})qji​(t−i) that the agent maximizes against. That gives a different class, because Definition 13 constrains the price of every set of tasks, including sets the mechanism never allocates, whose price is 000.

Claim 4.11 is the critical step, and its printed argument does not go through for an arbitrary truthful additive mechanism. It needs the empty set to be attainable with price 000. For a mechanism with a bounded ratio this holds, because a very slow agent must receive nothing, but this has to be derived from the approximation hypothesis. From that, one has to show that every task of xi(t)x^i(t)xi(t) carries a single-task price of at least 111. The final step also needs care. The paper's "w.l.o.g. ∣x1∣=n|x^1|=n∣x1∣=n" is a further reduction, and the paper's bound g≥∣x1∣g\ge|x^1|g≥∣x1∣ has to be replaced by (1−ϵ)∣x1∣(1-\epsilon)|x^1|(1−ϵ)∣x1∣.

Formalization scope

  • Representation. Agents are Fin n, tasks Fin k, type vectors Fin n → Fin k → ℝ, and an allocation is a map Fin k → Fin n sending each task to its agent. taskSet x i is xix^ixi, and the make-span is a Finset.sup' over the nonempty set of agents ([NeZero n]). A mechanism is a pair alloc, pay of arbitrary functions; nothing about its tie-breaking is fixed.
  • Standing assumptions. Types are positive. Truthfulness, additivity and approximation quantify over positive type vectors only. Utility is quasi-linear, with payments handed to the agent.
  • Prices. price follows Definition 12 literally: the payment at a Classical.choose witness declaration when the set is attainable, and 000 otherwise. Additivity (IsAdditive) is required for every set of tasks, attainable or not, as Definition 13 states. It is a condition on prices, not on the payment function.
  • Explicit threshold. The goal assumes k≥n2k\ge n^2k≥n2, the value the paper's proof starts from; the printed theorem does not mention kkk. It is stated for every n≥1n\ge1n≥1; at n=1n=1n=1 it holds because all allocations coincide.
  • Printed slips, corrected. (1) Proposition 4.5 is stated over attainable sets: over all sets, with the price 000 of unattainable sets, it fails for truthful mechanisms that never give the agent nothing and charge it. (2) Claim 4.11 carries the added hypothesis that ∅\emptyset∅ is attainable for agent iii. Without it the claim is false: a mechanism that always gives agent iii its ∣x∣|x|∣x∣ cheapest tasks and pays nothing is truthful and additive. The claim is stated for an arbitrary agent iii instead of "agent 1 after relabelling". (3) The ratio step states g≥(1−ϵ)ng\ge(1-\epsilon)ng≥(1−ϵ)n where the paper prints g≥∣x1∣≥ng\ge|x^1|\ge ng≥∣x1∣≥n, and states the paper's w.l.o.g. ∣x1∣=n|x^1|=n∣x1∣=n as a hypothesis of the step, not of the goal.
  • Out of scope. Running time and the revelation principle are not modelled; the goal is stated for truthful direct mechanisms, as §4.3 fixes.
  • Ruled out. A trivializing encoding would define additivity through the payment function instead of the prices of Definition 12, fix nnn, prove the ratio for one c<nc<nc<n only, or drop truthfulness. The last makes the claim false: an optimal allocation rule with zero payments is additive and a 111-approximation. The goal here quantifies over every nnn, every c<nc<nc<n and every truthful additive mechanism.
  • Non-vacuity. Every hypothesis of the goal except the ratio is satisfiable (a constant allocation with zero payments is truthful and additive), and the bound is tight by MinWork.
  • Contributions welcome. Proofs of the milestones, a proof that a bounded-ratio mechanism makes ∅\emptyset∅ attainable for every agent, and reuse of the model for the local-mechanism bound (Theorem 4.12).

Selected references

  • N. Nisan, A. Ronen, Algorithmic Mechanism Design, Games and Economic Behavior 35 (2001) 166–196. https://doi.org/10.1006/game.1999.0790
  • G. Christodoulou, E. Koutsoupias, A. Vidali, A lower bound for scheduling mechanisms, SODA 2007; Algorithmica 55, 2009. https://doi.org/10.1007/s00453-008-9165-3
  • G. Christodoulou, E. Koutsoupias, A. Vidali, A characterization of 2-player mechanisms for scheduling, ESA 2008. https://arxiv.org/abs/0807.3427
  • S. Dobzinski, M. Sundararajan, On characterizations of truthful mechanisms for combinatorial auctions and scheduling, EC 2008, pp. 38–47.
  • G. Christodoulou, E. Koutsoupias, A. Kovács, A proof of the Nisan–Ronen conjecture, STOC 2023. https://doi.org/10.1145/3564246.3585176 (arXiv:2301.11905)
8 thms2 active usersReviewed
🏆Completed
Algorithmic Game TheoryMechanism DesignOperations Research+1·Captain: mikedeng1

Algorithmic Mechanism Design IV: No Local Truthful Mechanism Achieves a c-Approximation for Task Scheduling for Any c < nResearch Paper

Motivation

Nisan and Ronen's Algorithmic Mechanism Design (Games and Economic Behavior 35, 2001) asks how well a computational task can be carried out when its inputs are held by self-interested agents who may lie about them. Their test case is scheduling on unrelated machines: tasks must be assigned to agents (machines), each agent privately knows how long it needs for each task, and the planner wants to minimize the time at which the last agent finishes. The paper shows that the mechanism MinWork, which gives each task to the fastest agent and pays it the second-fastest time, is truthful and loses a factor of at most nnn against the optimum, and that no truthful mechanism can do better than a factor 222. It then conjectures (Conjecture 4.9) that the factor nnn cannot be improved by any truthful mechanism.

That conjecture became the Nisan–Ronen conjecture, one of the central questions of algorithmic mechanism design. A sequence of papers raised the general lower bound from 222 to 1+21 + \sqrt 21+2​ (Christodoulou, Koutsoupias and Vidali), to 1+φ≈2.6181 + \varphi \approx 2.6181+φ≈2.618 (Koutsoupias and Vidali) and to larger constants, and Christodoulou, Koutsoupias and Kovács (STOC 2023) finally proved the conjecture for all deterministic truthful mechanisms. In the original paper, Nisan and Ronen confirm the conjecture for two restricted classes of mechanisms, with short direct arguments. This mission concerns the second class, local mechanisms (Theorem 4.12).

Setting

There are kkk tasks j∈{1,…,k}j \in \{1, \dots, k\}j∈{1,…,k} and nnn agents i∈{1,…,n}i \in \{1, \dots, n\}i∈{1,…,n}. A type vector ttt records, for every agent iii and task jjj, the positive time tjit^i_jtji​ agent iii needs for task jjj. An allocation xxx assigns every task to one agent; xix^ixi is the set of tasks of agent iii. For a set XXX of tasks write ti(X)=∑j∈Xtjit^i(X) = \sum_{j \in X} t^i_jti(X)=∑j∈X​tji​. The make-span of xxx is g(x,t)=max⁡iti(xi)g(x, t) = \max_i t^i(x^i)g(x,t)=maxi​ti(xi).

A direct mechanism (x,p)(x, p)(x,p) asks every agent for its type, computes an allocation x(t)x(t)x(t) from the declarations, and hands agent iii the payment pi(t)p^i(t)pi(t). Agent iii's utility is pi(t)−ti(xi(t))p^i(t) - t^i(x^i(t))pi(t)−ti(xi(t)) measured with its true times. The mechanism is truthful if declaring the true type maximizes each agent's utility whatever the other agents declare. The allocation rule is a ccc-approximation if g(x(t),t)≤c⋅g(y,t)g(x(t), t) \le c \cdot g(y, t)g(x(t),t)≤c⋅g(y,t) for every type vector ttt and every allocation yyy.

For a truthful mechanism the payment to agent iii depends only on the set it receives and on the declarations t−it^{-i}t−i of the others (Proposition 4.4). This gives the price offered to agent iii for a set XXX (Definition 12):

pi(X,t−i)={pi(t′i,t−i)if some t′i gives xi(t′i,t−i)=X,0otherwise.p^i(X, t^{-i}) = \begin{cases} p^i(t'^i, t^{-i}) & \text{if some } t'^i \text{ gives } x^i(t'^i, t^{-i}) = X, \\ 0 & \text{otherwise.} \end{cases}pi(X,t−i)={pi(t′i,t−i)0​if some t′i gives xi(t′i,t−i)=X,otherwise.​

A mechanism is local (Definition 14) if pi(X,t−i)p^i(X, t^{-i})pi(X,t−i) depends only on the other agents' times {tjl:l≠i,j∈X}\{t^l_j : l \ne i, j \in X\}{tjl​:l=i,j∈X} on the tasks of XXX. MinWork is local: its price for XXX is ∑j∈Xmin⁡l≠itjl\sum_{j \in X} \min_{l \ne i} t^l_j∑j∈X​minl=i​tjl​.

Formalization targets

Goal: Theorem 4.12

For every n≥1n \ge 1n≥1, every k≥n2k \ge n^2k≥n2 and every real c<nc < nc<n, no truthful local mechanism is a ccc-approximation:

∀(x,p) truthful and local, ∀c<n:∃ t, yg(x(t),t)>c⋅g(y,t).\forall (x, p) \text{ truthful and local},\ \forall c < n:\quad \exists\, t,\ y \quad g(x(t), t) > c \cdot g(y, t).∀(x,p) truthful and local, ∀c<n:∃t, yg(x(t),t)>c⋅g(y,t).

The bound holds for every c<nc < nc<n, so together with MinWork it shows that nnn is the exact best ratio for local truthful mechanisms.

Milestones

  1. Proposition 4.4 (Independence). Payments depend only on the allocated set and on t−it^{-i}t−i.
  2. Proposition 4.5 (Maximization). xi(t)x^i(t)xi(t) maximizes pi(X,t−i)−ti(X)p^i(X, t^{-i}) - t^i(X)pi(X,t−i)−ti(X) over the sets XXX that agent iii can obtain.
  3. Lemma 4.13. Every type vector has type vectors arbitrarily close to it at which each agent's maximizing set is unique.
  4. Claim 4.14, first step. If xi(t)x^i(t)xi(t) is the unique maximizer, lowering agent iii's times on xi(t)x^i(t)xi(t) keeps xi(t)x^i(t)xi(t).
  5. Ratio step. An allocation that gives one agent nnn tasks of time about 111, while every other agent's own tasks are nearly free, has make-span about nnn, while splitting those nnn tasks gives make-span about 111.

Significance

The result. Theorem 4.12 settles the Nisan–Ronen conjecture for a natural class of mechanisms. Locality captures the mechanisms in which the price for a bundle of tasks is set only by the competition for those tasks. It includes MinWork and, more generally, every mechanism that prices tasks separately using the other agents' bids on them. The theorem says that for this class the trivial per-task auction is already optimal, so any improvement over the ratio nnn must use prices that depend on the other agents' times on tasks outside the bundle.

Formalizing it. The statement is not open: it follows from the 2023 proof of the Nisan–Ronen conjecture, and Nisan and Ronen's own argument is much shorter. That argument is a sketch, though. Lemma 4.13 rests on an informal measure-theoretic appeal, and the core claim relies on a maximization property stated over all sets of tasks. A machine-checked proof pins down exactly which properties of truthful mechanisms the short argument needs. None of these results is known to have been formalized. The definitions (type vectors, truthful mechanisms, prices, locality) are shared with the other missions of this series.

Difficulty

An argument that looks at one agent at a time does not go through. Changing one agent's declaration changes the prices offered to every other agent, so an allocation that is stable for one agent can shift for another. The argument needs a type vector at which every agent's choice is strict, and only then can it lower times agent by agent and follow the allocation. Producing such a type vector is Lemma 4.13. The printed argument for it applies a "for almost every type vector" statement to sets defined by the price functions of an arbitrary mechanism, which need not be measurable. A proof must therefore work without any regularity of the mechanism. A second difficulty is Definition 12's convention that a set the agent cannot obtain has price 000. Locality constrains these zero prices too, and the argument has to account for sets that are obtainable at one type vector and not at a nearby one.

Formalization scope

Agents are Fin n, tasks Fin k. An allocation is a function Fin k → Fin n, a type vector is Fin n → Fin k → ℝ, and a mechanism is a pair of functions alloc (declarations to allocation) and pay (declarations to the payment handed to each agent). Utilities are quasi-linear. All types, declarations and misreports are positive, and every truthfulness, locality and approximation quantifier ranges over positive type vectors. The make-span is a Finset.sup' over the nonempty set of agents ([NeZero n]).

Conventions and explicit thresholds:

  • k≥n2k \ge n^2k≥n2. The theorem is printed without a bound on the number of tasks, and its proof begins "Let k≥n2k \ge n^2k≥n2". The goal carries k≥n2k \ge n^2k≥n2 as a hypothesis.
  • Truthfulness is assumed. §4.3 assumes throughout that the mechanism is truthful (by the revelation principle this is no loss). The goal quantifies over all truthful local mechanisms.
  • Prices use Definition 12 literally, including the value 000 for sets the agent cannot obtain, and locality is Definition 14 applied to that price function over all sets XXX, not only single tasks. When several declarations give the same set, the price uses one chosen witness; by Proposition 4.4 the choice does not matter for truthful mechanisms.
  • Proposition 4.5 is stated over the sets the agent can obtain. As printed, over all subsets, it is false for a truthful mechanism that never leaves an agent idle and pays it negative amounts. Uniqueness of maximizers (Lemma 4.13, Claim 4.14) refers to the same family.
  • Lemma 4.13 uses Mathlib's norm on Fin n → Fin k → ℝ, the sup norm. No measurability of the mechanism is assumed.
  • Claim 4.14 is printed at tji=1t^i_j = 1tji​=1 with 0<ε<10 < \varepsilon < 10<ε<1. The first step is stated at any type vector, with 0<ε≤tji0 < \varepsilon \le t^i_j0<ε≤tji​ on the lowered tasks.
  • Running time and computability are out of scope.

Ruled-out trivializations: locality is not restricted to single tasks; the goal does not assume that maximizers are unique at every type vector (that is Lemma 4.13's conclusion at one point, not a hypothesis); and the bound holds for every c<nc < nc<n, not for some.

Needed infrastructure: finite sums over allocation fibres, sup norms on function spaces, and a genericity argument for finitely many affine functions (Lemma 4.13). The model file and the price and locality definitions are reusable in the other missions of the series. Proofs of individual milestones are welcome independently.

Selected references

  • N. Nisan, A. Ronen, Algorithmic Mechanism Design, Games and Economic Behavior 35 (2001) 166–196. https://doi.org/10.1006/game.1999.0790
  • A. Mas-Colell, M. D. Whinston, J. R. Green, Microeconomic Theory, Oxford University Press, 1995 (pp. 876–880, basic properties of truthful mechanisms).
  • G. Christodoulou, E. Koutsoupias, A. Vidali, A lower bound for scheduling mechanisms, Algorithmica 55 (2009).
  • E. Koutsoupias, A. Vidali, A lower bound of 1+φ for truthful scheduling mechanisms, Algorithmica 66 (2013).
  • G. Christodoulou, E. Koutsoupias, A. Kovács, A proof of the Nisan–Ronen conjecture, STOC 2023.
8 thms3 active usersReviewed
🏆Completed
Algorithmic Game TheoryMechanism DesignOperations Research+2·Captain: mikedeng1

Algorithmic Mechanism Design V: The Randomly Biased Min Work Mechanism Is a Strongly Truthful 7/4-Approximation for Two AgentsResearch Paper

Motivation

Algorithmic mechanism design, introduced by Nisan and Ronen (Games Econ. Behav. 35, 2001), studies optimization problems whose input is held by self-interested agents. Each agent reports its private data to a protocol, and the protocol must choose an output and payments so that reporting the truth is in every agent's interest while the chosen output is close to optimal.

The paper's test case is task scheduling on unrelated machines: kkk tasks must be assigned to nnn agents, agent iii needs time tjit^i_jtji​ for task jjj, and the goal is to minimize the make-span. For deterministic mechanisms the paper shows that truthfulness is costly: the MinWork mechanism achieves ratio nnn, and no mechanism achieves a ratio below 222 (Theorem 4.6). Section 4.4 asks whether randomization helps and answers yes for two agents: a randomized mechanism, truthful for every outcome of its coins, achieves expected ratio 7/4<27/4 < 27/4<2.

Timeline.

  • 1979: Roberts characterizes weighted (affine) maximizers; the weighted Vickrey–Groves–Clarke (VGC) mechanisms are truthful.
  • 1999: Lehmann supplies the case analysis that improves the authors' original bound of 1.8231.8231.823 to 7/47/47/4 (acknowledged on p. 182).
  • 2001: Nisan and Ronen publish the randomly biased min work mechanism and Theorem 4.16.

Setting

There are two agents, 111 and 222, and kkk tasks. A type vector t=(t1,t2)t = (t^1, t^2)t=(t1,t2) gives, for each agent iii and task jjj, the positive time tjit^i_jtji​ agent iii needs for task jjj. An allocation xxx assigns each task to one agent; xix^ixi is the set of tasks of agent iii. The make-span of xxx is

g(x,t)=max⁡i∈{1,2}∑j∈xitji.g(x, t) = \max_{i \in \{1,2\}} \sum_{j \in x^i} t^i_j .g(x,t)=i∈{1,2}max​j∈xi∑​tji​.

A direct mechanism receives declared types ddd and returns an allocation x(d)x(d)x(d) and payments pi(d)p^i(d)pi(d) handed to the agents. Agent iii with true type tit^iti gets utility pi(d)−∑j∈xi(d)tjip^i(d) - \sum_{j \in x^i(d)} t^i_jpi(d)−∑j∈xi(d)​tji​. The mechanism is truthful if declaring the true type maximizes an agent's utility whatever the other agent declares, and strongly truthful if in addition every false declaration is strictly worse for some declaration of the other agent.

A randomized mechanism is a probability distribution over deterministic mechanisms; its objective is the expected make-span. It is universally truthful if every mechanism in its support is truthful, and universally strongly truthful if moreover truth-telling is the only strategy dominant in every mechanism of the support.

The biased min work mechanism with parameters β≥1\beta \ge 1β≥1 and s∈{1,2}ks \in \{1,2\}^ks∈{1,2}k treats each task jjj separately. With i=sji = s_ji=sj​ the favoured agent and i′=3−ii' = 3 - ii′=3−i the other: if tji≤β⋅tji′t^i_j \le \beta \cdot t^{i'}_jtji​≤β⋅tji′​, task jjj goes to iii, who is paid β⋅tji′\beta \cdot t^{i'}_jβ⋅tji′​; otherwise it goes to i′i'i′, who is paid β−1⋅tji\beta^{-1} \cdot t^i_jβ−1⋅tji​. The randomly biased min work mechanism draws sss uniformly from {1,2}k\{1,2\}^k{1,2}k and uses β=4/3\beta = 4/3β=4/3. Its expected make-span is

Es g(xs(t),t)=12k∑s∈{1,2}kg(xs(t),t).\mathbb{E}_s\, g(x_s(t), t) = \frac{1}{2^k} \sum_{s \in \{1,2\}^k} g(x_s(t), t).Es​g(xs​(t),t)=2k1​s∈{1,2}k∑​g(xs​(t),t).

Formalization targets

Goal: Theorem 4.16

For every kkk: the randomly biased min work mechanism is universally strongly truthful, and for every positive type vector ttt and every allocation yyy,

12k∑s∈{1,2}kg(xs(t),t)≤74 g(y,t).\frac{1}{2^k} \sum_{s \in \{1,2\}^k} g(x_s(t), t) \le \frac74\, g(y, t).2k1​s∈{1,2}k∑​g(xs​(t),t)≤47​g(y,t).

Milestones

  • Theorem 3.2 (Roberts): for positive weights βi\beta^iβi, a mechanism whose output maximizes ∑iβivi(ti,o)\sum_i \beta^i v^i(t^i, o)∑i​βivi(ti,o) and whose payments are pi=1βi∑j≠iβjvj(tj,o)+hi(t−i)p^i = \frac{1}{\beta^i}\sum_{j \ne i}\beta^j v^j(t^j, o) + h^i(t^{-i})pi=βi1​∑j=i​βjvj(tj,o)+hi(t−i) is truthful.
  • Lemma 4.15: for every β≥1\beta \ge 1β≥1 and every sss, the biased min work mechanism is strongly truthful.
  • Lemma 4.17: the randomly biased min work mechanism is universally strongly truthful.
  • Claim 4.19, part 5: allocating two tasks independently at random gives an expected make-span no larger than allocating their merge at random.
  • Reduced case (Fig. 2, Cases 1–3): for a,b,c,d≥0a, b, c, d \ge 0a,b,c,d≥0 with a+c=43b+da + c = \frac43 b + da+c=34​b+d,
14(max⁡(a+b+c+43d,0)+max⁡(a+b+c,d)+max⁡(a+b+43d,43c)+max⁡(a+b,43c+d))≤74(a+c).\tfrac14\Big(\max(a+b+c+\tfrac43 d, 0) + \max(a+b+c, d) + \max(a+b+\tfrac43 d, \tfrac43 c) + \max(a+b, \tfrac43 c + d)\Big) \le \tfrac74 (a+c).41​(max(a+b+c+34​d,0)+max(a+b+c,d)+max(a+b+34​d,34​c)+max(a+b,34​c+d))≤47​(a+c).
  • Lemma 4.18: the 7/47/47/4 bound on the expected make-span.

Significance

The result. Theorem 4.16 separates randomized from deterministic truthful mechanisms for scheduling two unrelated machines: 7/47/47/4 against the deterministic lower bound of 222. The notion of truthfulness it uses is the strong one, dominance for every coin outcome, so the separation does not rest on agents being risk-neutral or knowing the distribution. Later work on truthful randomized scheduling, and on the gap between deterministic and randomized truthful mechanisms, starts from this construction.

Formalizing it. The theorem is proved in the paper; no machine-checked proof of it is known. A formalization produces a checked definition of universal truthfulness for randomized mechanisms, a checked weighted VGC theorem usable for any affine-maximizer mechanism, and a checked version of the reduction argument (Claim 4.19), which the paper states in five informal instance transformations, one of them a limiting argument.

Difficulty

Truthfulness reduces to one task at a time, where the mechanism is a weighted VGC mechanism; the difficulty lies in the approximation bound. A naive task-by-task comparison with the optimum fails: the bound is on a maximum of two loads averaged over 2k2^k2k coin vectors, and the maximum does not decompose over tasks. The paper reduces an arbitrary instance to four tasks through transformations that each move the ratio in one direction, and the reduced instance still needs a three-way case analysis. Making the reduction rigorous is the main work: part 1 of Claim 4.19 replaces a ratio "arbitrarily close to β\betaβ" by β\betaβ, and under the mechanism's tie rule a task with ratio exactly β\betaβ is allocated by the coin rather than to the efficient agent.

Formalization scope

  • Agents are Fin 2 (agent 111 is 0, agent 222 is 1); the other agent is other i = 1 - i. Tasks are Fin k; allocations are functions Fin k → Fin 2. The statements hold for every kkk, including k=0k = 0k=0.
  • Types are positive: every truthfulness quantifier ranges over positive declarations, true types and misreports, and the approximation bound is stated on positive type vectors. The reduced-case and merging milestones are pure real inequalities with nonnegative times, since the paper represents missing tasks by zero times.
  • Payments are handed to the agent; utility is quasi-linear.
  • The make-span is a finite maximum (Finset.sup') over the two agents. The expected make-span is the average over all 2k2^k2k vectors sss, which is exactly the expectation of Definition 15 for the uniform distribution; no measure theory is used.
  • Universal (strong) truthfulness quantifies over all s∈{1,2}ks \in \{1,2\}^ks∈{1,2}k, the support of the uniform distribution. Truthfulness in expectation over sss is weaker and is not the notion stated.
  • The tie rule of Fig. 1 (≤\le≤: ties go to the favoured agent) is kept.
  • The goal fixes β=4/3\beta = 4/3β=4/3; only Lemma 4.15 is stated for every β≥1\beta \ge 1β≥1. The ratio is compared with every allocation yyy, not with one fixed allocation, and the average is over all sss, not the best sss.
  • Roberts' theorem is stated for arbitrary output sets, type sets and valuations, with positive weights.
  • "Polynomial time computable" in Theorem 4.16 is not formalized; running time is out of scope.
  • Claim 4.19 (the reduction to the four-task case) is not a separate item beyond its part 5, because its parts are instance transformations with a limiting step, not a single statement; a solver may formalize the reduction in any form that proves Lemma 4.18.

Contributions welcome: proofs of the milestones, and reusable lemmas on averages of maxima over product coin spaces.

Selected references

  • N. Nisan, A. Ronen, Algorithmic Mechanism Design, Games and Economic Behavior 35 (2001) 166–196. https://doi.org/10.1006/game.1999.0790
  • K. Roberts, The characterization of implementable choice rules, in J.-J. Laffont (ed.), Aggregation and Revelation of Preferences, North-Holland, 1979, pp. 321–349.
  • T. Groves, Incentives in teams, Econometrica 41 (1973) 617–631. https://doi.org/10.2307/1914085
10 thms3 active usersReviewed
🏆Completed
Algorithmic Game TheoryMechanism DesignOperations Research+1·Captain: mikedeng1

Algorithmic Mechanism Design VI: With Verification, the Compensation-and-Bonus Mechanism Is a Strongly Truthful Optimal ImplementationResearch Paper

Motivation

Scheduling tasks on machines owned by self-interested parties is the running example of Nisan and Ronen's Algorithmic Mechanism Design (Games and Economic Behavior 35, 2001), the paper that introduced the study of mechanisms whose allocation rule is an algorithm with a computational objective. Each machine (agent) privately knows how long it needs for each task; the designer wants to minimize the make-span, the completion time of the last machine, and can only influence the agents through payments.

Without further information the designer is in a weak position: the paper shows that no mechanism approximates the optimal make-span within a factor below 2 (Theorem 4.6), and that the natural truthful mechanism, MinWork, only achieves a factor nnn. Section 5 of the paper observes that in many applications the designer learns more than the agents' reports: it can pay after the work is done and observe how long each task actually took. It introduces mechanisms with verification and shows that, with this extra information, the make-span can be minimized exactly by a strongly truthful mechanism. This mission formalizes that result, Theorem 5.1, together with the steps of its proof and the participation variant, Theorem 5.4.

Setting

There are kkk tasks and nnn agents. The type of agent iii is the vector ti=(t1i,…,tki)t^i = (t^i_1,\dots,t^i_k)ti=(t1i​,…,tki​) of positive numbers, tjit^i_jtji​ being the least time in which agent iii can perform task jjj. An allocation xxx gives each task to one agent; xix^ixi is the set of tasks of agent iii. For a type vector ttt and for a vector t~\tilde tt~ of actual execution times the make-spans are

g(x,t)=max⁡i∑j∈xitji,g(x,t~)=max⁡i∑j∈xit~j.g(x,t) = \max_i \sum_{j\in x^i} t^i_j, \qquad g(x,\tilde t) = \max_i \sum_{j\in x^i} \tilde t_j .g(x,t)=imax​j∈xi∑​tji​,g(x,t~)=imax​j∈xi∑​t~j​.

A mechanism with verification is a pair (x,p)(x, p)(x,p). The allocation x(d)x(d)x(d) is computed from the agents' declarations d=(d1,…,dn)d = (d^1,\dots,d^n)d=(d1,…,dn) only. Each agent then performs its tasks, in any times t~j≥tji\tilde t_j \ge t^i_jt~j​≥tji​ it chooses, and the mechanism pays agent iii the amount pi(d,t~)p^i(d, \tilde t)pi(d,t~), which may depend on the declarations and on the observed actual times. Agent iii's utility is pi(d,t~)−∑j∈xit~jp^i(d,\tilde t) - \sum_{j \in x^i} \tilde t_jpi(d,t~)−∑j∈xi​t~j​. A strategy of agent iii therefore has two parts: a declaration did^idi and an execution plan eie^iei that says, for every allocation, how long the agent takes on each of its tasks.

A strategy is dominant if it maximizes the agent's utility against all declarations and all execution plans of the other agents. The mechanism is truthful if, for every agent and type, declaring the true type (with a suitable execution plan) is dominant, and strongly truthful if the only dominant strategy is to declare the true type and to execute every task in minimal time.

The Compensation-and-Bonus mechanism uses an optimal allocation algorithm x(⋅)x(\cdot)x(⋅) and pays

pi(d,t~)=∑j∈xi(d)t~j⏟compensation ci  − g(x(d),corri(x(d),d,t~))⏟bonus bi,p^i(d,\tilde t) = \underbrace{\sum_{j \in x^i(d)} \tilde t_j}_{\text{compensation } c^i} \;\underbrace{-\, g\big(x(d), \mathrm{corr}^i(x(d), d, \tilde t)\big)}_{\text{bonus } b^i},pi(d,t~)=compensation cij∈xi(d)∑​t~j​​​bonus bi−g(x(d),corri(x(d),d,t~))​​,

where the corrected time vector corri\mathrm{corr}^icorri lists agent iii's own tasks at their actual times and every other task at the time declared by the agent it was given to.

Formalization targets

Goal: Theorem 5.1

For n≥2n \ge 2n≥2 agents and every optimal allocation algorithm (ties broken arbitrarily), the Compensation-and-Bonus mechanism is a strongly truthful implementation of task scheduling:

strongly truthfulandg(x(D),t~)≤min⁡yg(y,t) whenever every agent plays a dominant strategy for its true type.\text{strongly truthful} \quad\text{and}\quad g\big(x(D), \tilde t\big) \le \min_y g(y, t) \text{ whenever every agent plays a dominant strategy for its true type.}strongly truthfulandg(x(D),t~)≤ymin​g(y,t) whenever every agent plays a dominant strategy for its true type.

Milestones (proof of Claim 5.2)

  1. The utility of every agent equals its bonus.
  2. For every allocation, the bonus of agent iii is maximized by executing its tasks in minimal time.
  3. With t=(d−i,ti)t = (d^{-i}, t^i)t=(d−i,ti), for every declaration t′it'^it′i,
−g(x(t),corr∗(x(t),t))≥−g(x(t′i,d−i),corr∗(x(t′i,d−i),t)).-g\big(x(t), \mathrm{corr}^*(x(t), t)\big) \ge -g\big(x(t'^i, d^{-i}), \mathrm{corr}^*(x(t'^i, d^{-i}), t)\big).−g(x(t),corr∗(x(t),t))≥−g(x(t′i,d−i),corr∗(x(t′i,d−i),t)).
  1. Declaring the true type and executing in minimal time is dominant.
  2. Claim 5.2: the mechanism is strongly truthful.

Further target: Theorem 5.4

For n≥2n \ge 2n≥2 there is a strongly truthful mechanism with an optimal allocation algorithm that satisfies participation constraints: an agent that performs its tasks in its declared times never ends with negative utility.

Significance

The result. Theorem 5.1 shows that the lower bound of 2 for task scheduling (Theorem 4.6) is an artefact of the information structure, not of incentives as such: once execution times are observable, the exact optimum is achievable in dominant strategies, and the agents have a unique rational behaviour. The construction also isolates a general principle, used again in §5.6 of the paper: an agent paid by the global objective value, computed with the others' declarations, has the designer's incentives. Theorem 5.4 shows that the bonus can be shifted to make participation individually rational, which the plain mechanism violates (its bonus is negative).

Formalizing it. The theorem is proved in the paper, in a few lines, and has no machine-checked version. A formalization has to settle what the paper leaves informal: what a strategy with an execution part is, over which strategies of the others dominance is quantified, what "the only dominant strategy" demands of the execution plan on allocations that seem never to arise, and which hypotheses on the number of agents the uniqueness needs. The model built here is also the base of two companion missions of the same series (Compensation-and-Bonus with a non-optimal allocation algorithm, and the rounding mechanism with verification).

Difficulty

Truthfulness (milestones 1–4) is short once the model is right. The difficulty is uniqueness. For a misreport or a slow execution to be excluded, one must exhibit, for every alternative strategy, declarations of the other agents under which that strategy is strictly worse. The declarations must be positive, the optimal allocation algorithm breaks ties arbitrarily, and agent iii's slower execution only hurts it when agent iii is the bottleneck. The paper's proof dismisses this step with "clearly, … there are circumstances"; the naive reading ("the others declare +∞+\infty+∞ elsewhere") is not available in a model with finite positive times, and the uniqueness clause must also cover the execution plan on every allocation, not only on the allocation produced by truthful play.

Formalization scope

  • Agents are Fin n, tasks Fin k, allocations functions Fin k → Fin n; both make-spans are Finset.sup' over the nonempty set of agents ([NeZero n]).
  • Types and declarations are positive real vectors; declarations range over this type space (Definition 18's "unrestricted" declaration is any element of it).
  • An execution plan is a function from allocations to actual times; feasibility for type tit^iti requires t~j≥tji\tilde t_j \ge t^i_jt~j​≥tji​ on the agent's own tasks only. In the dominance quantifier the other agents' plans are arbitrary.
  • Payments are amounts handed to the agent; utility is quasi-linear.
  • The optimal allocation algorithm is a parameter with the hypothesis that it minimizes g(⋅,d)g(\cdot, d)g(⋅,d) on every positive ddd; every theorem holds for every such algorithm.
  • Strong truthfulness constrains both parts of the strategy: the declaration equals the type, and the plan executes every task in minimal time under every allocation.
  • Thresholds made explicit: n≥2n \ge 2n≥2 in Claim 5.2, Theorem 5.1 and Theorem 5.4 (not printed; with one agent every declaration is dominant, and the construction of Theorem 5.4 needs a second agent).
  • Printed slips: the displayed inequality prints >=; Theorem 5.4 prints "strongly truthfulmechanism"; Definition 28 writes t~j=tj\tilde t_j = t_jt~j​=tj​ for t~j=tji\tilde t_j = t^i_jt~j​=tji​.
  • Running time is out of scope.
  • A formalization in which dominance is checked only against truthful other agents, in which the mechanism ignores executions, in which strong truthfulness constrains only the declaration, or in which the implementation clause is stated only at the truthful profile, is not the theorem and is ruled out by the statements.

Welcome contributions: proofs of the milestones, the uniqueness witnesses as reusable lemmas, and the contribution-based mechanism behind Theorem 5.4. Theorem 5.3 (generalized Compensation-and-Bonus) is not stated in this mission.

Selected references

  • N. Nisan, A. Ronen, Algorithmic Mechanism Design, Games and Economic Behavior 35 (2001) 166–196. https://doi.org/10.1006/game.1999.0790
  • T. Groves, Incentives in Teams, Econometrica 41 (1973) 617–631. https://doi.org/10.2307/1914085
  • A. Mas-Colell, M. D. Whinston, J. R. Green, Microeconomic Theory, Oxford University Press, 1995.
8 thms3 active usersReviewed
🏆Completed
Algorithmic Game TheoryMechanism DesignOperations Research+1·Captain: mikedeng1

Algorithmic Mechanism Design VII: Compensation-and-Bonus Based on a Non-Optimal Approximation Algorithm Is Not TruthfulResearch Paper

Motivation

Algorithmic mechanism design studies optimization problems whose inputs are held by self-interested agents: the algorithm must compute a good solution and, through payments, make it in each agent's interest to report its input honestly. Nisan and Ronen introduced the field with the problem of scheduling tasks on unrelated machines, where each machine is an agent that privately knows how long it needs for every task (Nisan–Ronen 2001).

The classical tool for truthfulness, the Vickrey–Groves–Clarke (VGC) family of mechanisms, requires the allocation to be exactly optimal. Exact optimization is often computationally out of reach: minimizing the make-span on unrelated machines is NP-hard, and even approximating it within a factor below 3/2 is NP-hard (Lenstra–Shmoys–Tardos 1990). A mechanism designer would therefore like to plug an approximation algorithm into a truthful mechanism and keep truthfulness. This mission formalizes a result showing that the simplest way of doing so fails in the model with verification, where the mechanism may pay after the tasks are performed and observes the actual execution times.

Timeline.

  • 1999/2001: Nisan and Ronen define mechanisms with verification and the Compensation-and-Bonus mechanism, prove it strongly truthful when its allocation algorithm is optimal (their Theorem 5.1), and prove that replacing the optimal algorithm by a non-optimal approximation algorithm destroys truthfulness (Theorem 5.6, the goal here). They remark that a similar argument applies to VGC mechanisms.
  • 2002: Lehmann, O'Callaghan and Shoham show the analogous failure for VGC payments with approximate allocation in combinatorial auctions (JACM 2002).
  • 2007: Nisan and Ronen study which approximation algorithms can be made truthful within the VGC framework (JAIR 2007).

Setting

There are n≥1n \ge 1n≥1 agents and kkk tasks. The type of agent iii is a vector ti=(t1i,…,tki)t^i = (t^i_1,\dots,t^i_k)ti=(t1i​,…,tki​) of positive reals, tjit^i_jtji​ being the minimum time agent iii needs for task jjj; a type vector is t=(t1,…,tn)t = (t^1,\dots,t^n)t=(t1,…,tn). An allocation x=(x1,…,xn)x = (x^1,\dots,x^n)x=(x1,…,xn) gives each task to one agent. The make-span is

g(x,t)=max⁡i∑j∈xitji,g(x,t) = \max_i \sum_{j\in x^i} t^i_j,g(x,t)=imax​j∈xi∑​tji​,

and xxx is optimal for ttt if g(x,t)≤g(y,t)g(x,t)\le g(y,t)g(x,t)≤g(y,t) for every allocation yyy.

In the model with verification, an agent's strategy has two parts: a declaration did^idi (any positive vector) and an execution plan that, for every allocation the mechanism may choose, fixes the actual time t~j≥tji\tilde t_j \ge t^i_jt~j​≥tji​ in which the agent performs each task jjj it receives. An allocation algorithm x(⋅)x(\cdot)x(⋅) maps the declarations to an allocation x(d)x(d)x(d); the tasks are then executed, producing actual times t~\tilde tt~.

The Compensation-and-Bonus mechanism based on x(⋅)x(\cdot)x(⋅) pays agent iii

pi(d,t~)=∑j∈xi(d)t~j  −  g(x(d),corr⁡i(x(d),d,t~)),p^i(d,\tilde t) = \sum_{j\in x^i(d)} \tilde t_j \;-\; g\bigl(x(d), \operatorname{corr}^i(x(d),d,\tilde t)\bigr),pi(d,t~)=j∈xi(d)∑​t~j​−g(x(d),corri(x(d),d,t~)),

a compensation for the time actually spent plus a bonus equal to minus the make-span computed from agent iii's actual times on its own tasks and the other agents' declared times on theirs (the corrected time vector corr⁡i\operatorname{corr}^icorri). The agent's utility is its payment minus the time it spends. A strategy is dominant if it is at least as good as every alternative whatever the other agents declare and execute; the mechanism is truthful if every agent of every type has a dominant strategy that declares its true type.

Formalization targets

Goal: Theorem 5.6

Let x(⋅)x(\cdot)x(⋅) be an allocation algorithm such that, for some real ccc,

g(x(t),t)≤c g(y,t)for every positive t and every allocation y,g\bigl(x(t),t\bigr) \le c\, g(y,t)\quad\text{for every positive } t \text{ and every allocation } y,g(x(t),t)≤cg(y,t)for every positive t and every allocation y,

and such that g(y,t)<g(x(t),t)g(y,t) < g(x(t),t)g(y,t)<g(x(t),t) for some positive ttt and some allocation yyy. Then the Compensation-and-Bonus mechanism based on x(⋅)x(\cdot)x(⋅) is not truthful.

The ratio ccc is arbitrary and existentially quantified: the theorem holds for every finite approximation ratio, so it is stated without a constant.

Milestones

  • Claim 5.7. If the mechanism based on x(⋅)x(\cdot)x(⋅) is truthful, ooo is optimal for ttt and MMM is at least every entry of ttt, then replacing one agent's type by tjit^i_jtji​ on oio^ioi and MMM elsewhere gives a type vector t′t't′ with g(x(t′),t′)≥g(x(t),t)g(x(t'),t') \ge g(x(t),t)g(x(t′),t′)≥g(x(t),t).
  • Corollary 5.8. Under the same assumptions, the type vector sss that makes this replacement for every agent satisfies g(x(s),s)≥g(x(t),t)g(x(s),s) \ge g(x(t),t)g(x(s),s)≥g(x(t),t).
  • Final step. g(o,s)=g(o,t)g(o,s) = g(o,t)g(o,s)=g(o,t), ooo is optimal for sss, and every allocation y≠oy\ne oy=o has g(y,s)≥Mg(y,s)\ge Mg(y,s)≥M.

Significance

The result. Theorem 5.1 of the same paper shows that with an optimal algorithm the Compensation-and-Bonus mechanism is a strongly truthful implementation of make-span minimization. Theorem 5.6 shows that this guarantee is tied to exact optimization: it does not survive replacing the optimizer by any non-optimal approximation algorithm, whatever its ratio. It explains why the paper then turns to a restricted problem (bounded scheduling) and a mechanism designed around a specific rounding algorithm, and it is an early instance of the general tension between approximation and incentive compatibility.

Formalizing it. The result is proved in the paper; to the best of the platform's catalog it has not been formalized. The mission produces a machine-checked model of mechanisms with verification (declarations together with execution plans that may depend on the decision), the Compensation-and-Bonus payment rule for an arbitrary allocation algorithm, and Definition 19 truthfulness, together with a checked proof of the impossibility.

Difficulty

The argument is short on paper; the difficulty lies in the model. The paper's "∞\infty∞" is not a number, and a faithful statement must replace it by a finite value that is large enough to conflict with the approximation ratio yet keeps every type positive and entrywise above the true types; both requirements refer to data fixed earlier in the argument. The incentive step compares utilities in a mechanism where an agent's strategy is a declaration and an execution plan that may depend on the decision, and where the bonus mixes the agent's actual times with the other agents' declarations, so a naive reading in which only declarations matter (the direct-revelation model of §2) does not capture the claim. Finally, Corollary 5.8 concerns a type vector modified at every agent, while Claim 5.7 modifies one agent at a time, so the claim must be applicable at type vectors that are no longer the original one.

Formalization scope

  • Agents are Fin n with [NeZero n], tasks Fin k, allocations are functions Fin k → Fin n, types and declarations are positive real vectors. Make-spans are Finset.sup' over the nonempty set of agents. With no agents no allocation algorithm meets the hypotheses, so requiring n≥1n\ge 1n≥1 loses nothing.
  • An execution plan is a function of the allocation; feasibility is t~j≥tji\tilde t_j \ge t^i_jt~j​≥tji​ on the agent's own tasks. In the dominance quantifier the other agents' declarations are positive and their execution plans arbitrary; the agent's alternative declarations are positive and its alternative plans feasible for its true type.
  • The allocation algorithm is an arbitrary function of the declarations; "approximation algorithm" is the hypothesis ∃c\exists c∃c above, "non-optimal" the hypothesis of one positive witness. The optimal allocation opt(t)\mathrm{opt}(t)opt(t) in the milestones is any optimal allocation ooo, supplied as a parameter.
  • The paper's ∞\infty∞ is a real parameter MMM with M≥tjlM \ge t^l_jM≥tjl​ for all l,jl,jl,j; extended reals are not used.
  • Claim 5.7 is stated for an arbitrary agent iii, not only for agent 1, so that Corollary 5.8 can iterate it.
  • Running time is not modelled; "algorithm" means function.
  • Dropping the approximation hypothesis makes the statement false: an allocation rule that ignores the declarations is non-optimal, yet its Compensation-and-Bonus mechanism is truthful. Stating only "not strongly truthful", or proving the theorem for a fixed instance, would be a weaker claim.

Welcome contributions: proofs of the milestones and the goal, and reusable lemmas about the corrected time vector and the monotonicity of the make-span in the time vector.

Selected references

  • N. Nisan, A. Ronen, Algorithmic Mechanism Design, Games and Economic Behavior 35 (2001) 166–196. https://doi.org/10.1006/game.1999.0790
  • J. K. Lenstra, D. B. Shmoys, É. Tardos, Approximation algorithms for scheduling unrelated parallel machines, Mathematical Programming 46 (1990) 259–271. https://doi.org/10.1007/BF01585745
  • D. Lehmann, L. I. O'Callaghan, Y. Shoham, Truth revelation in approximately efficient combinatorial auctions, Journal of the ACM 49 (2002) 577–602. https://doi.org/10.1145/585265.585266
  • N. Nisan, A. Ronen, Computationally Feasible VCG Mechanisms, Journal of Artificial Intelligence Research 29 (2007) 19–47. https://doi.org/10.1613/jair.2046
  • E. Horowitz, S. Sahni, Exact and approximate algorithms for scheduling nonidentical processors, Journal of the ACM 23 (1976) 317–327. https://doi.org/10.1145/321941.321951
5 thms2 active usersReviewed
🏆Completed
Algorithmic Game TheoryMechanism DesignOperations Research+1·Captain: mikedeng1

Algorithmic Mechanism Design VIII: A Truthful Approximation Scheme for Bounded Scheduling with VerificationResearch Paper

Motivation

Algorithmic mechanism design asks for algorithms whose inputs are held by self-interested agents: the designer can pay the agents, and must choose payments so that each agent's own interest leads it to reveal what the algorithm needs. Nisan and Ronen introduced the framework with task scheduling on unrelated machines as the running example (Nisan–Ronen 2001). In the basic model, where payments depend only on what the agents declare, they showed that no truthful mechanism approximates the optimal make-span within a factor below 2, and that the natural mechanism only reaches a factor nnn.

Their Section 5 changes the information available: in a mechanism with verification the payments may also depend on the times in which the tasks were actually performed. With this extra information, an exact optimizer becomes a strongly truthful mechanism (Theorem 5.1, the Compensation-and-Bonus mechanism). Exact scheduling on unrelated machines is NP-hard, so the question is whether an approximation algorithm can take the optimizer's place. Theorem 5.6 of the paper shows that plugging a non-optimal algorithm into Compensation-and-Bonus destroys truthfulness in general. Theorem 5.9, the subject of this mission, shows that for the bounded problem a specific approximation scheme, the rounding algorithm of Horowitz and Sahni (1976), can be combined with a modified payment rule to give a truthful mechanism whose outcome is within a factor 1+ε1+\varepsilon1+ε of optimal.

Setting

There are nnn agents and kkk tasks. Agent iii needs time tjit^i_jtji​ for task jjj; the vector t=(tji)t = (t^i_j)t=(tji​) is the type vector, and agent iii alone knows its row tit^iti. In the bounded scheduling problem (Definition 33) there are fixed numbers 0<a<b0 < a < b0<a<b with a≤tji≤ba \le t^i_j \le ba≤tji​≤b for all i,ji, ji,j, and every declaration lies in the same range. An allocation xxx assigns each task to one agent; xix^ixi is the set of tasks of agent iii.

A strategy of agent iii has two parts: a declaration di∈[a,b]kd^i \in [a,b]^kdi∈[a,b]k, and an execution, which for each decision xxx of the mechanism specifies the actual time t~j≥tji\tilde t_j \ge t^i_jt~j​≥tji​ in which agent iii performs each task j∈xij \in x^ij∈xi. The mechanism chooses x=x(d)x = x(d)x=x(d) from the declarations alone and afterwards observes the actual times t~\tilde tt~. The objective is the make-span with actual times,

g(x,t~)=max⁡i∑j∈xit~j.g(x,\tilde t) = \max_i \sum_{j \in x^i} \tilde t_j .g(x,t~)=imax​j∈xi∑​t~j​.

Agent iii receives a payment pip^ipi and has utility pi−∑j∈xit~jp^i - \sum_{j \in x^i} \tilde t_jpi−∑j∈xi​t~j​.

The corrected time vector of agent iii keeps agent iii's actual times on its own tasks and the other agents' declarations elsewhere: corri(x,d,t~)j=t~j\mathrm{corr}^i(x,d,\tilde t)_j = \tilde t_jcorri(x,d,t~)j​=t~j​ for j∈xij \in x^ij∈xi and djld^l_jdjl​ for j∈xlj \in x^lj∈xl, l≠il \ne il=i. For a step δ>0\delta > 0δ>0, r^=δ⌈r/δ⌉\hat r = \delta\lceil r/\delta\rceilr^=δ⌈r/δ⌉ rounds rrr up to a multiple of δ\deltaδ, and g^(x,τ)=g(x,τ^)\hat g(x,\tau) = g(x,\hat\tau)g^​(x,τ)=g(x,τ^).

The rounding mechanism (Definition 34) allocates with an algorithm that exactly solves the problem with rounded declarations d^\hat dd^, and pays

pi=∑j∈xit~j  −  g^(x,corri(x,d,t~)).p^i = \sum_{j\in x^i}\tilde t_j \;-\; \hat g\big(x, \mathrm{corr}^i(x, d, \tilde t)\big).pi=j∈xi∑​t~j​−g^​(x,corri(x,d,t~)).

The first term, the compensation, uses exact actual times; the second, the bonus, uses rounded quantities.

A strategy is dominant if it is a best response to every declarations and executions of the others. The mechanism is truthful if every agent has a dominant strategy that declares its true type.

Formalization targets

Goal: Theorem 5.9 without running time

For every ε>0\varepsilon > 0ε>0, every 0<δ≤εa0 < \delta \le \varepsilon a0<δ≤εa and every allocation algorithm solving the rounded problem exactly, the rounding mechanism is truthful, and at every profile of dominant strategies from the class named in the proof (declarations with the true rounded values, executions whose rounded times equal the rounded true times),

g(x(d),t~)≤(1+ε) g(y,t)for every allocation y.g\big(x(d),\tilde t\big) \le (1+\varepsilon)\, g(y,t) \quad \text{for every allocation } y .g(x(d),t~)≤(1+ε)g(y,t)for every allocation y.

Milestones

  1. The solution of the rounded problem is a (1+ε)(1+\varepsilon)(1+ε)-approximation: g(x,t^)≤g(y,t^) ∀yg(x,\hat t) \le g(y,\hat t)\ \forall yg(x,t^)≤g(y,t^) ∀y implies g(x,t)≤(1+ε)g(y,t) ∀yg(x,t) \le (1+\varepsilon) g(y,t)\ \forall yg(x,t)≤(1+ε)g(y,t) ∀y.
  2. After rounding, g^\hat gg^​ is the make-span, g^(x,corr∗(x,d))=g(x,d^)\hat g(x,\mathrm{corr}^*(x,d)) = g(x,\hat d)g^​(x,corr∗(x,d))=g(x,d^), and each agent's utility equals its rounded bonus.
  3. Every strategy with the true rounded values is dominant.
  4. When all agents follow such strategies, the outcome is a (1+ε)(1+\varepsilon)(1+ε)-approximation.
  5. Truth-telling with minimal execution is dominant; hence the mechanism is truthful.

Significance

The result shows that verification does more than make exact optimization truthful: it lets a polynomial-time approximation scheme be implemented in dominant strategies, provided the bonus is computed on the same rounded instance the algorithm optimizes. This contrasts with Theorem 5.6, where an arbitrary approximation algorithm inside Compensation-and-Bonus is not truthful, and with the factor-2 lower bound of the basic model. The principle it illustrates is that the payments must reward exactly the objective the algorithm optimizes.

The paper gives only a proof sketch. Formalizing it makes the argument's hypotheses explicit: which rounding step suffices, what the allocation algorithm must satisfy, and over which strategy profiles the approximation guarantee holds. No machine-checked version of this theorem or of the Compensation-and-Bonus argument is known to exist.

Difficulty

The sketch reduces the theorem to "arguments similar to those in 5.1", but the rounded setting departs from Theorem 5.1 in two ways. Rounding is many-to-one, so an agent's declaration and execution are pinned down only up to their rounded values, and the algorithm's optimality holds only for the rounded instance. Consequently the claim that the strategies with the true rounded values are the only dominant ones does not survive arbitrary tie-breaking: an agent that is always favoured on ties can overstate its rounded time by one step without ever losing, and two such lies at one profile can push the make-span above the (1+ε)(1+\varepsilon)(1+ε) bound. The approximation guarantee therefore has to be stated for the strategy class the proof identifies, not derived from dominance alone. The remaining steps require exact bookkeeping of rounding across sums and of the corrected time vectors, which a proof sketch leaves implicit.

Formalization scope

  • Agents are Fin n with [NeZero n], tasks Fin k; allocations are functions Fin k → Fin n; the make-span is a Finset.sup' over agents. Types and declarations satisfy a ≤ t i j ≤ b with 0 < a < b; actual times are only bounded below by the true times.
  • roundUp δ r = δ * ⌈r / δ⌉. The statement holds for every δ∈(0,εa]\delta \in (0,\varepsilon a]δ∈(0,εa], which covers the intended choice δ=εa\delta = \varepsilon aδ=εa; the paper leaves δ\deltaδ as "a function of aaa and ε\varepsilonε".
  • The Horowitz–Sahni dynamic program is not formalized. The allocation algorithm is a parameter with the hypothesis that it solves the rounded problem exactly; ties are arbitrary, and the goal holds for every such algorithm. Running time ("polynomial time") is out of scope, and with it the role of the upper bound bbb, which is kept as part of the problem.
  • An execution is a function of the decision (Definition 18). Dominance quantifies over all declarations in [a,b][a,b][a,b] and all executions of the others.
  • The payment uses the allocation x(d)x(d)x(d) in the bonus. Definition 34 prints x(t^)x(\hat t)x(t^); since the rounding algorithm rounds the declarations itself, x(d)x(d)x(d) is the allocation actually computed. The hat on corr\mathrm{corr}corr is absorbed by g^\hat gg^​.
  • The goal's approximation part is restricted to dominant profiles of the class named in the proof, because the unrestricted form (Definition 3, every dominant profile) is false for some tie-breaking rules; an explicit two-agent, one-task instance is recorded in the goal's Formalization Note.
  • A formalization that measures the approximation with declared rather than actual times, lets the allocation read the true types, or states the approximation only at the truthful profile while claiming the general form, does not formalize this theorem.

Useful infrastructure: lemmas on Int.ceil rounding of finite sums and on Finset.sup' monotonicity, and a reusable model of mechanisms with verification. Proofs of the milestones in any order are welcome.

Selected references

  • N. Nisan, A. Ronen, Algorithmic Mechanism Design, Games and Economic Behavior 35 (2001) 166–196. https://doi.org/10.1006/game.1999.0790
  • E. Horowitz, S. Sahni, Exact and Approximate Algorithms for Scheduling Nonidentical Processors, Journal of the ACM 23 (1976) 317–327. https://doi.org/10.1145/321941.321951
8 thms2 active usersReviewed
🏆Completed
CombinatoricsGraph TheoryOperations Research·Captain: mikedeng1

Odd Minimum Cut-Sets and b-Matchings 1: A Minimum-Weight Odd-Splitting Edge of the Gomory–Hu Cut-Tree Defines an Odd Minimum Cut-SetResearch Paper

Motivation

Edmonds showed that the convex hull of the matchings of a graph is described by the degree constraints together with the blossom inequalities, one for every odd set of nodes (Edmonds 1965). There are exponentially many of them, so any cutting-plane method for matching and b-matching problems must answer a separation question: given a fractional point, find a violated blossom inequality or certify that none exists. Padberg and Rao (1982) reduced this question to a purely graph-theoretic one, the odd minimum cut-set problem, and solved that problem in polynomial time with a single Gomory–Hu computation. The same subroutine underlies separation for many other odd-set constraints (for example the 2-matching and comb-type constraints of the travelling salesman polytope), and later work refined its running time (Letchford, Reinelt and Theis 2008).

This mission covers Section 1 of the paper: the combinatorial theorem about odd cuts, independent of matchings. A companion mission covers the reduction from capacitated b-matching separation (Section 3).

Setting

Let G=(V,E)G = (V, E)G=(V,E) be a finite undirected graph without loops and multiple edges, with edge weights ce≥0c_e \ge 0ce​≥0. Write cijc_{ij}cij​ for the weight of the edge [i,j][i, j][i,j], with cij=cjic_{ij} = c_{ji}cij​=cji​, and cij=0c_{ij} = 0cij​=0 if there is no such edge. For W⊆VW \subseteq VW⊆V the cut-set (W:V−W)(W : V - W)(W:V−W) is the set of edges with exactly one end in WWW, and its capacity is

c(W:V−W)=∑i∈W∑j∈V−Wcij.c(W : V - W) = \sum_{i \in W} \sum_{j \in V - W} c_{ij}.c(W:V−W)=i∈W∑​j∈V−W∑​cij​.

A nonempty set V1⊆VV_1 \subseteq VV1​⊆V of nodes is labelled odd, the rest even. For U⊆VU \subseteq VU⊆V the label λ(U)\lambda(U)λ(U) is odd if ∣U∩V1∣|U \cap V_1|∣U∩V1​∣ is odd, and even otherwise; λ(∅)\lambda(\emptyset)λ(∅) is even. The paper assumes throughout that λ(V)\lambda(V)λ(V) is even, i.e. ∣V1∣|V_1|∣V1​∣ is even. A cut-set (U:V−U)(U : V - U)(U:V−U) is odd if λ(U)\lambda(U)λ(U) is odd, and an odd minimum cut-set is a solution XXX of

c(X:V−X)=min⁡{c(U:V−U):U⊆V, λ(U) odd}.(1.1)c(X : V - X) = \min\{ c(U : V - U) : U \subseteq V,\ \lambda(U) \text{ odd} \}. \qquad (1.1)c(X:V−X)=min{c(U:V−U):U⊆V, λ(U) odd}.(1.1)

A cut-set (M:V−M)(M : V - M)(M:V−M) is a minimum cut-set with respect to all pairs of odd nodes if it separates two odd nodes and no cut-set separating two odd nodes has smaller capacity.

A cut-tree GT=(N,F)G_T = (N, F)GT​=(N,F) for the odd nodes is the output of the Gomory–Hu algorithm applied to all pairs of odd nodes (Gomory and Hu 1961). Each tree node contains exactly one odd node and possibly some even ones, so NNN is identified with V1V_1V1​, and each node vvv of GGG belongs to one tree node π(v)\pi(v)π(v). Removing a tree edge f=[r,s]f = [r, s]f=[r,s] splits GTG_TGT​ into two subtrees; the nodes of GGG in the tree nodes of the rrr-side subtree form a set MMM, and the weight of fff is df=c(M:V−M)d_f = c(M : V - M)df​=c(M:V−M). The defining property (Hu, Theorem 9.2) is that for every tree edge f=[r,s]f = [r, s]f=[r,s] the cut-set (M:V−M)(M : V - M)(M:V−M) is a minimum cut-set of GGG separating rrr and sss. The cardinality of a subtree is its number of tree nodes.

Formalization targets

Goal: Theorem 1.1 (p. 70)

For every cut-tree GTG_TGT​ of GGG for the odd nodes:

  1. some edge of GTG_TGT​ decomposes it into two subtrees of odd cardinality; and
  2. if f∗=[r,s]f^* = [r, s]f∗=[r,s] is such an edge of minimum weight among all such edges, and MMM is the rrr-side shore of f∗f^*f∗, then
c(M:V−M)=min⁡{c(U:V−U):U⊆V, λ(U) odd}.c(M : V - M) = \min\{ c(U : V - U) : U \subseteq V,\ \lambda(U) \text{ odd} \}.c(M:V−M)=min{c(U:V−U):U⊆V, λ(U) odd}.

Because ∣N∣=∣V1∣|N| = |V_1|∣N∣=∣V1​∣ is even, the two subtrees have the same parity, so the condition is checked on one side.

Milestones

  • Lemma 1.1 (p. 68). If (M:V−M)(M : V - M)(M:V−M) is a minimum cut-set with respect to all pairs of odd nodes, there is an odd minimum cut-set (X:V−X)(X : V - X)(X:V−X) with X⊆MX \subseteq MX⊆M or X⊆V−MX \subseteq V - MX⊆V−M.
  • Section 1, p. 70. If f∗f^*f∗ has minimum weight among all edges of GTG_TGT​, its shore MMM gives a minimum cut-set with respect to all pairs of odd nodes.

Significance

Theorem 1.1 turns problem (1.1), a minimization over exponentially many odd sets, into ∣V1∣−1|V_1| - 1∣V1​∣−1 maximum-flow computations followed by a scan of the tree edges. Combined with Section 3 of the paper, this gives a polynomial separation algorithm for the blossom inequalities of b-matching polytopes, and hence, by the equivalence of separation and optimization, a polynomial-time route to weighted b-matching through linear programming. The odd-cut routine is also used for separating the odd-set constraints of other polytopes.

The theorem has been proved since 1982 and is textbook material. What this mission adds is a machine-checked proof on a precise encoding of cut-trees. As far as the platform's corpus shows, neither the Gomory–Hu cut-tree property nor any odd-cut theorem has been formalized in Lean; Mathlib has trees and reachability in simple graphs but no cut-tree theory.

Difficulty

The obvious argument fails at the minimum. Every tree-edge shore separates two odd nodes, so a minimum-weight odd-splitting edge certainly yields an odd cut, but showing that no odd set UUU, however it cuts across the tree nodes, has smaller capacity requires relating an arbitrary odd UUU to a tree edge whose shore is also odd and whose endpoints UUU separates. The cut-tree only certifies minimality for cuts separating the two ends of a tree edge; an odd set UUU may split many tree nodes and cross many shores at once, and nothing in the cut-tree property speaks about parity. Parity bookkeeping between odd labels in GGG and odd cardinality of subtrees is the other place where care is needed: the two notions agree only because each tree node holds exactly one odd node.

Formalization scope

The graph is a weight function c : V → V → ℝ on a Fintype V, with hypotheses that it is symmetric and nonnegative; a missing edge has weight 0 and the diagonal never enters a cut. Node sets are Finset V and V−WV - WV−W is the complement Wᶜ. The odd nodes form a Finset odd with odd.Nonempty and Even odd.card on every statement. The cut-tree is a SimpleGraph on the subtype {v // v ∈ odd} together with a map π : V → {v // v ∈ odd}; IsOddCutTree requires that the graph is a tree, that π fixes every odd node, and the Gomory–Hu minimality for every tree edge. The tree-edge weight dfd_fdf​ is computed from the shore, not supplied as data. Minimality is always stated as ≤ against every competitor; no real infimum is taken.

The existence of a cut-tree (the Gomory–Hu theorem) is a hypothesis-side object and is not part of this mission; the theorems hold for every tree satisfying the cut-tree property. A statement in which the cut-tree assumption already says that the chosen edge's shore is an odd minimum cut, or in which "odd minimum cut" is minimized only over tree-edge shores, would make Theorem 1.1 definitional; both are ruled out, since IsOddMinCut ranges over every node set with odd label.

A complete development needs: submodularity-type identities for cut capacities (reusable for any cut problem), the structure of fundamental cuts of a tree (the two sides of a removed edge are complementary and the parities of U∩V1U \cap V_1U∩V1​ along tree edges combine), and Lemma 1.1. Proofs of the milestones, alternative arguments for the goal that avoid the recursion, and a formal Gomory–Hu existence theorem are all welcome contributions.

Selected references

  • M. W. Padberg and M. R. Rao, Odd Minimum Cut-Sets and b-Matchings, Mathematics of Operations Research 7(1), 67–80, 1982. https://doi.org/10.1287/moor.7.1.67
  • R. E. Gomory and T. C. Hu, Multi-Terminal Network Flows, Journal of the SIAM 9(4), 551–570, 1961. https://doi.org/10.1137/0109047
  • T. C. Hu, Integer Programming and Network Flows, Addison-Wesley, 1969 (Chapter 9, Theorem 9.2).
  • J. Edmonds, Maximum Matching and a Polyhedron with 0,1-Vertices, Journal of Research of the National Bureau of Standards 69B, 125–130, 1965. https://doi.org/10.6028/jres.069B.013
  • A. N. Letchford, G. Reinelt and D. O. Theis, Odd Minimum Cut Sets and b-Matchings Revisited, SIAM Journal on Discrete Mathematics 22(4), 1480–1487, 2008. https://doi.org/10.1137/060664793
7 thms2 active usersReviewed
🏆Completed
CombinatoricsGraph TheoryLinear Optimization+1·Captain: mikedeng1

Odd Minimum Cut-Sets and b-Matchings 2: A Capacitated b-Matching Blossom Inequality Is Violated iff G(x, d) Has an Odd Cut of Capacity Less Than OneResearch Paper

Motivation

A b-matching with upper bounds in a graph G=(V,E)G=(V,E)G=(V,E) assigns a nonnegative integer xe≤dex_e\le d_exe​≤de​ to every edge so that the edges at each node iii carry at most bib_ibi​ in total. Maximizing a linear objective over such assignments is an integer program that contains ordinary matching (b≡1b\equiv 1b≡1, d≡1d\equiv 1d≡1) and appears in assignment, transportation and scheduling models with capacities on both nodes and arcs. Edmonds and Johnson showed that the integer hull of this system is described by adding the blossom (matching) inequalities to the linear relaxation (Edmonds–Johnson 1970; cited in the paper as [8], [13]). There are exponentially many blossom inequalities, so a cutting-plane method needs a separation procedure: given a fractional point xˉ\bar xxˉ, find a violated blossom inequality or certify that none exists.

M. W. Padberg and M. R. Rao, Odd Minimum Cut-Sets and b-Matchings, Mathematics of Operations Research 7 (1982), gave this procedure. Section 1 of the paper computes a minimum-capacity cut with an odd number of odd-labelled nodes in polynomial time; Sections 2 and 3 reduce blossom separation to that computation. This mission formalizes Section 3, the case with upper bounds ddd. The companion mission Odd Minimum Cut-Sets and b-Matchings 1 formalizes Section 1.

Timeline: Edmonds (1965) describes the perfect matching polytope; Edmonds and Johnson (1970) extend the description to capacitated bbb-matching; Gomory and Hu (1961) give the cut-tree that Section 1 of Padberg–Rao relies on; Padberg and Rao (1982) reduce separation to odd minimum cuts. Later work (Letchford, Reinelt and Theis, 2008) shortened the resulting algorithms; the reduction itself is the one stated here.

Setting

Let G=(V,E)G=(V,E)G=(V,E) be a finite simple undirected graph, b∈Z>0Vb\in\mathbb Z_{>0}^Vb∈Z>0V​ and d∈Z>0Ed\in\mathbb Z_{>0}^Ed∈Z>0E​. The system is

Ax≤b,x≤d,x≥0,(3.1)Ax\le b,\qquad x\le d,\qquad x\ge 0, \tag{3.1}Ax≤b,x≤d,x≥0,(3.1)

with AAA the node–edge incidence matrix. For W⊆VW\subseteq VW⊆V write E(W)E(W)E(W) for the edges with both ends in WWW and (W:V−W)(W:V-W)(W:V−W) for the cut-set of WWW, the edges with exactly one end in WWW. For T⊆(W:V−W)T\subseteq (W:V-W)T⊆(W:V−W) with b(W)+d(T)=∑i∈Wbi+∑e∈Tdeb(W)+d(T)=\sum_{i\in W}b_i+\sum_{e\in T}d_eb(W)+d(T)=∑i∈W​bi​+∑e∈T​de​ odd, the blossom inequality is

x(W)+x(T)=∑e∈E(W)xe+∑e∈Txe≤12(b(W)+d(T)−1).(3.3)x(W)+x(T)=\sum_{e\in E(W)}x_e+\sum_{e\in T}x_e\le \tfrac12\bigl(b(W)+d(T)-1\bigr). \tag{3.3}x(W)+x(T)=e∈E(W)∑​xe​+e∈T∑​xe​≤21​(b(W)+d(T)−1).(3.3)

Let xˉ\bar xxˉ be a real point feasible for (3.1) and sˉ=b−Axˉ\bar s=b-A\bar xsˉ=b−Axˉ its node slacks. Let E(xˉ)E(\bar x)E(xˉ) be the edges with xˉe>0\bar x_e>0xˉe​>0. The labelled weighted graph G(xˉ,d)G(\bar x,d)G(xˉ,d) has nodes VVV, a special node SSS, and one new node iei_eie​ for each e∈E(xˉ)e\in E(\bar x)e∈E(xˉ). For each such edge e=[i,j]e=[i,j]e=[i,j], where iii is the end the construction scans first, it has an edge [i,ie][i,i_e][i,ie​] of weight de−xˉed_e-\bar x_ede​−xˉe​ and an edge [ie,j][i_e,j][ie​,j] of weight xˉe\bar x_exˉe​. Each i∈Vi\in Vi∈V is joined to SSS with weight sˉi\bar s_isˉi​. There are no other edges. A node iei_eie​ is odd iff ded_ede​ is odd; SSS is odd iff b(V)b(V)b(V) is odd; a node i∈Vi\in Vi∈V is odd iff bib_ibi​ plus the ded_ede​ of the subdivided edges scanned from iii is odd. A node set UUU is odd when it contains an odd number of odd nodes, and yˉ(U:V~−U)\bar y(U:\tilde V-U)yˉ​(U:V~−U) denotes the total weight of the edges leaving UUU (its cut capacity).

Formalization targets

Goal: Theorem 3.1

For every feasible xˉ\bar xxˉ and every scan order,

∃ W⊆V, T⊆(W:V−W): b(W)+d(T) odd, xˉ(W)+xˉ(T)>12(b(W)+d(T)−1)\exists\,W\subseteq V,\ T\subseteq (W:V-W):\ b(W)+d(T)\text{ odd},\ \bar x(W)+\bar x(T)>\tfrac12\bigl(b(W)+d(T)-1\bigr)∃W⊆V, T⊆(W:V−W): b(W)+d(T) odd, xˉ(W)+xˉ(T)>21​(b(W)+d(T)−1) ⟺∃ U⊆V~ odd: yˉ(U:V~−U)<1.\Longleftrightarrow\quad \exists\,U\subseteq \tilde V \text{ odd}:\ \bar y(U:\tilde V-U)<1 .⟺∃U⊆V~ odd: yˉ​(U:V~−U)<1.

The paper's closing sentence, that WWW and TTT can be obtained constructively from the proof of Lemma 3.2, describes the proof and is not part of the formal statement.

Milestones

  1. Eq. (3.6): 2x(W)+x(W:V−W)+x(T)+s(W)+t(T)=b(W)+d(T)2x(W)+x(W:V-W)+x(T)+s(W)+t(T)=b(W)+d(T)2x(W)+x(W:V−W)+x(T)+s(W)+t(T)=b(W)+d(T) for T⊆(W:V−W)T\subseteq(W:V-W)T⊆(W:V−W), with t=d−xt=d-xt=d−x.
  2. Eq. (3.7): xˉ\bar xxˉ violates (3.3) for (W,T)(W,T)(W,T) iff xˉ(W:V−W)+d(T)−2xˉ(T)+sˉ(W)<1\bar x(W:V-W)+d(T)-2\bar x(T)+\bar s(W)<1xˉ(W:V−W)+d(T)−2xˉ(T)+sˉ(W)<1.
  3. Lemma 3.1: if T⊆(W:V−W)∩E(xˉ)T\subseteq (W:V-W)\cap E(\bar x)T⊆(W:V−W)∩E(xˉ) and b(W)+d(T)b(W)+d(T)b(W)+d(T) is odd, some odd UUU with S∉US\notin US∈/U has yˉ(U:V~−U)\bar y(U:\tilde V-U)yˉ​(U:V~−U) equal to the left side of (3.7) (Eq. (3.8)).
  4. Lemma 3.2: every odd UUU with S∉US\notin US∈/U and capacity <1<1<1 arises this way from some (W,T)(W,T)(W,T) with b(W)+d(T)b(W)+d(T)b(W)+d(T) odd.

Significance

Theorem 3.1 is what makes the blossom inequalities of capacitated bbb-matching usable in a linear-programming based cutting-plane method: combined with the odd minimum cut algorithm of Section 1, it separates them in polynomial time. By the equivalence of separation and optimization, it also yields a polynomial-time algorithm for capacitated bbb-matching through the ellipsoid method. The paper notes the further consequence that every odd cut-set of capacity less than one, not only a minimum one, gives a violated inequality.

The results are proved in the 1982 paper; none of them has a machine-checked proof that this mission is aware of. What the mission adds is a formal statement of the graph G(xˉ,d)G(\bar x,d)G(xˉ,d) and of the reduction, and a checked proof of it. The definitions of the capacitated bbb-matching system, its blossom inequalities and the subdivided graph are reusable for later work on matching polytopes and on the uncapacitated case of Section 2.

Difficulty

The identities (3.6) and (3.7) are bookkeeping over incidences. The substance is the correspondence between node sets WWW with complemented edge sets TTT and odd node sets UUU of G(xˉ,d)G(\bar x,d)G(xˉ,d). In one direction the right UUU must pick, for every cut edge, the side of iei_eie​ that makes the edge contribute xˉe\bar x_exˉe​ or de−xˉed_e-\bar x_ede​−xˉe​ as (3.7) requires, and its parity must be computed through the orientation-dependent labels. In the other direction an arbitrary odd cut of capacity below one must be shown to have this shape; this uses de≥1d_e\ge 1de​≥1 to exclude every other position of a new node iei_eie​, and it uses the evenness of the total label to pass from an odd set containing SSS to its complement. A point xˉ\bar xxˉ whose blossom violation uses an edge e∈Te\in Te∈T with xˉe=0\bar x_e=0xˉe​=0 has no new node for eee. Such a TTT has to be ruled out, and the argument uses the capacity bound. It is not an assumption of the theorem.

Formalization scope

The graph is a Mathlib SimpleGraph V on a finite type with decidable adjacency; edges are elements of G.edgeFinset : Finset (Sym2 V). The data are b : V → ℕ and d : Sym2 V → ℕ, positive on nodes and on edges, and a real point x : Sym2 V → ℝ. Feasibility means the linear relaxation of (3.1); integrality of xˉ\bar xxˉ is not assumed. All halves and differences are computed in ℝ. When W=VW=VW=V the cut-set is empty, so the paper's convention "TTT is empty" holds automatically.

G(xˉ,d)G(\bar x,d)G(xˉ,d) is fixed by definitions from (G,b,d,xˉ)(G,b,d,\bar x)(G,b,d,xˉ) and an orientation tail choosing the end of each edge scanned first; every theorem quantifies over the orientation. The node type is Option V ⊕ {e // e ∈ E(x̄)}, with none the special node SSS. Weights are a symmetric function on nodes with 000 meaning "no edge". The labels are given in closed form. The paper assigns them by a sequential scan that flips the parity of the scanned end by ded_ede​, and addition mod 2 does not depend on the order of the scan. "The cut capacity of an odd minimum cut-set is less than one" is stated as "some odd cut has capacity less than one"; the two agree, and the formulation avoids a minimum over a possibly empty family.

Two trivializing formalizations are ruled out: G(xˉ,d)G(\bar x,d)G(xˉ,d) is constructed, not an arbitrary labelled graph assumed to satisfy (3.8); and no infimum over odd cuts is taken, since a real sInf of an empty family is 000 and would make the right side true when no odd cut exists.

Contributions welcome: proofs of the milestones, lemmas on cut capacities of symmetric weight functions on finite types, and parity bookkeeping for labelled node sets.

Selected references

  • M. W. Padberg, M. R. Rao, Odd Minimum Cut-Sets and b-Matchings, Mathematics of Operations Research 7(1), 67–80, 1982. https://doi.org/10.1287/moor.7.1.67
  • J. Edmonds, E. L. Johnson, Matching: a well-solved class of integer linear programs, in Combinatorial Structures and Their Applications, Gordon and Breach, 89–92, 1970; reprinted in Combinatorial Optimization — Eureka, You Shrink!, LNCS 2570, 27–30, 2003. https://doi.org/10.1007/3-540-36478-1_3
  • R. E. Gomory, T. C. Hu, Multi-terminal network flows, Journal of the SIAM 9(4), 551–570, 1961. https://doi.org/10.1137/0109047
  • J. Edmonds, Maximum matching and a polyhedron with 0,1-vertices, Journal of Research of the National Bureau of Standards 69B, 125–130, 1965. https://doi.org/10.6028/jres.069B.013
  • A. N. Letchford, G. Reinelt, D. O. Theis, Odd minimum cut sets and b-matchings revisited, SIAM Journal on Discrete Mathematics 22(4), 1480–1487, 2008. https://doi.org/10.1137/060664793
7 thms2 active usersReviewed
🏆Completed
Algorithmic Game TheoryOperations ResearchOptimization+1·Captain: mikedeng1

Information Sharing in a Supply Chain with a Common Retailer 1: Under Production Diseconomy the Retailer Earns More from Sequential Information Contracting and the Manufacturers from ConcurrentResearch Paper

Motivation

Retailers hold point-of-sale data that their suppliers cannot observe, and large retailers sell access to it through data-sharing programs (Costco's CRX, Walmart's Retail Link and similar programs). When one retailer carries the substitutable products of two competing manufacturers, sharing its demand information is a strategic decision: a manufacturer who knows the demand signal sets his wholesale price in response to it, which changes the retailer's margin and the rival manufacturer's order uncertainty. Whether the retailer should sell the information, to how many manufacturers, and by which protocol, is the question of Shang, Ha and Tong (Management Science 62(1):245–263, 2016).

The paper belongs to the information-sharing literature of Li (2002), Li and Zhang (2008) and Ha, Tong and Zhang (2011), which studies competing supply chains or a single chain. The common-retailer structure differs: the retailer can price-discriminate between the manufacturers through the order in which she offers the information.

Setting

Two manufacturers i∈{1,2}i \in \{1, 2\}i∈{1,2} sell substitutable products through one retailer. The demand for product iii is

qi=a+θ−(1+ϕ)pi+ϕpj,q_i = a + \theta - (1+\phi)p_i + \phi p_j,qi​=a+θ−(1+ϕ)pi​+ϕpj​,

where pip_ipi​ is the retail price, ϕ>0\phi > 0ϕ>0 measures competition, and θ\thetaθ is a random shock with mean 000 and variance σ2>0\sigma^2 > 0σ2>0. The retailer observes a demand signal YYY that is unbiased, E[Y∣θ]=θE[Y \mid \theta] = \thetaE[Y∣θ]=θ, and has linear expectation: E[θ∣Y]=βYE[\theta \mid Y] = \beta YE[θ∣Y]=βY for a weight β\betaβ (in the paper β=tσ2/(1+tσ2)\beta = t\sigma^2/(1+t\sigma^2)β=tσ2/(1+tσ2), with ttt the signal accuracy). The retailing cost is zero, and manufacturer iii produces qqq units at cost bq+cdq2bq + c_d q^2bq+cd​q2 with b,cd>0b, c_d > 0b,cd​>0: a production diseconomy.

The game has four stages.

  1. The retailer and the manufacturers contract on information sharing, which fixes each manufacturer's status Xi∈{I,U}X_i \in \{I, U\}Xi​∈{I,U} (informed or uninformed).
  2. The retailer observes YYY and discloses it truthfully to the informed manufacturers.
  3. The manufacturers set wholesale prices wiw_iwi​ simultaneously, an informed one as a function of YYY. The retailer then sets retail prices.
  4. Demand realizes and payoffs are received.

The pricing stage is a Bayesian game. Its equilibrium ex ante profits are πM(n)\pi_M(n)πM​(n), πMI(1)\pi_M^I(1)πMI​(1), πMU(1)\pi_M^U(1)πMU​(1) for the manufacturers and πR(n)\pi_R(n)πR​(n) for the retailer, where nnn is the number of informed manufacturers. They define a payoff table for the contracting stage.

Two contracting protocols are compared.

  • Concurrent contracting: the retailer offers both manufacturers the same payment TTT, and they accept or reject simultaneously; a Pareto-optimal pure equilibrium is the outcome, and the retailer chooses TTT.
  • Sequential contracting: the retailer offers one manufacturer TfT_fTf​, he accepts or rejects, then the retailer offers the other TsT_sTs​, and he decides having observed the first decision. The retailer cannot commit to Ts=TfT_s = T_fTs​=Tf​, and the solution is subgame perfect equilibrium.

Formalization targets

Goal: Proposition 4(d)

For every ϕ>0\phi > 0ϕ>0, cd>0c_d > 0cd​>0 and every signal model, the pricing stage has an equilibrium; for every pricing equilibrium, both contracting games have equilibria; and for every concurrent outcome and every sequential subgame-perfect equilibrium (either first mover),

ΠRC≤ΠRS,ΠMS≤ΠMC,\Pi_R^{C} \le \Pi_R^{S}, \qquad \Pi_M^{S} \le \Pi_M^{C},ΠRC​≤ΠRS​,ΠMS​≤ΠMC​,

with both inequalities strict when cd>(2−1)/(1+ϕ)c_d > (\sqrt2 - 1)/(1+\phi)cd​>(2​−1)/(1+ϕ). Here ΠR\Pi_RΠR​ is the retailer's profit after side payments and ΠM\Pi_MΠM​ the manufacturers' total profit net of them. The paper's word "higher" is read as ≥\ge≥ because for small cdc_dcd​ neither protocol sells information and all profits coincide.

Milestones

  1. §4.1, Eq. (1): the retailer's best response p^i=12(a+βY+wi)\hat p_i = \frac12(a + \beta Y + w_i)p^​i​=21​(a+βY+wi​) and the resulting demand.
  2. Lemma 1: the pricing equilibrium exists, is unique, and is linear in YYY.
  3. §4.2: the closed forms of the seven ex ante profits.
  4. Lemma 3: πM(2)>πMI(1)>πM(0)>πMU(1)\pi_M(2) > \pi_M^I(1) > \pi_M(0) > \pi_M^U(1)πM​(2)>πMI​(1)>πM​(0)>πMU​(1), πR(0)>πR(1)>πR(2)\pi_R(0) > \pi_R(1) > \pi_R(2)πR​(0)>πR​(1)>πR​(2), πR(1)−πR(2)>πR(0)−πR(1)\pi_R(1) - \pi_R(2) > \pi_R(0) - \pi_R(1)πR​(1)−πR​(2)>πR​(0)−πR​(1).
  5. Proposition 1(b): without contracting, no information is shared.
  6. Propositions 2 and 3: thresholds cdCc_d^CcdC​ and cdS1,cdS2c_d^{S1}, c_d^{S2}cdS1​,cdS2​, depending only on ϕ\phiϕ, at which the number of informed manufacturers changes under each protocol.
  7. Proposition 4(a): cdS1<cdC<cdS2c_d^{S1} < c_d^C < c_d^{S2}cdS1​<cdC​<cdS2​.

Significance

The result. Proposition 4(d) says that the order of the offers transfers surplus: selling information one manufacturer at a time lets the retailer exploit the manufacturers' fear of being the only uninformed firm, which raises her profit and lowers theirs. Propositions 2 and 3 show that concurrent contracting shares with both manufacturers or with neither, while sequential contracting can end with only one informed manufacturer. Together they give a complete map of the equilibrium sharing decisions in (cd,ϕ)(c_d, \phi)(cd​,ϕ) (Figure 1 of the paper).

Formalizing it. The results are proved in the paper, partly by "it can be shown" and "straightforward" steps: Lemma 3's proof is omitted, and so is the convexity of the function whose root is cdS2c_d^{S2}cdS2​. No part of the paper has a machine-checked proof. A complete formalization would check every such step and make the equilibrium notions precise, in particular the Pareto selection and the tie-breaking at the thresholds, where the retailer is exactly indifferent.

Difficulty

Most of the work is in the contracting stage, not the algebra. The pricing stage must be solved over all square-integrable strategies measurable in the signal. Uniqueness is then almost sure and rests on the linear-expectation identities E[θY]=σ2E[\theta Y] = \sigma^2E[θY]=σ2 and E[Y2]=σ2/βE[Y^2] = \sigma^2/\betaE[Y2]=σ2/β. The concurrent game has multiple equilibria for intermediate payments, and the retailer's optimum lies at a payment where two equilibria coexist. The sequential game is a three-stage game with a continuum of offers: at each threshold the retailer is indifferent, and an SPE exists only if acceptance at indifference is chosen correctly. The threshold cdS2c_d^{S2}cdS2​ has no closed form; it is the root of a convex rational function of cdc_dcd​.

Formalization scope

The Lean development lives in the namespace InfoSharing.Diseconomy. Conventions:

  • The probability space carries θ\thetaθ and YYY in L2L^2L2, with the two conditional-expectation identities holding almost everywhere. β\betaβ is a parameter fixed by E[θ∣Y]=βYE[\theta \mid Y] = \beta YE[θ∣Y]=βY; Ericson's formula for β\betaβ is not formalized.
  • Wholesale strategies are measurable, square-integrable functions of the signal value, and constants for an uninformed manufacturer. A pricing equilibrium is ex ante optimality over such strategies, which is equivalent to the paper's conditional optimization. The retailer's rule must be a best response at every wholesale-price pair.
  • The payoff table is produced by an arbitrary pricing-equilibrium family, not by the §4.2 closed forms. A formalization that takes the closed forms as the definition of the profits would reduce the goal to algebra and a 2×22 \times 22×2 game, and is ruled out.
  • Payments are nonnegative, only pure strategies are used in the contracting games, and the concurrent outcome selects, among Pareto-optimal equilibria, the one best for the retailer.
  • Threshold statements use two clauses: the printed value is attained on the closed region, and it is the only value on the region's interior. The thresholds depend only on ϕ\phiϕ.
  • Demands may be negative (θ is unbounded), as in the paper's formulas.

A complete development needs:

  • the conditional-expectation algebra behind Lemma 1 and §4.2;
  • rational-function inequalities for Lemma 3;
  • a case analysis of the two contracting games.

The model layer is shared with the companion mission on production economy.

Selected references

  • G. Shang, A. Y. Ha, S. Tong, Information Sharing in a Supply Chain with a Common Retailer, Management Science 62(1):245–263, 2016. https://doi.org/10.1287/mnsc.2014.2127
  • W. A. Ericson, A note on the posterior mean of a population mean, Journal of the Royal Statistical Society B 31(2):332–334, 1969.
  • L. Li, Information sharing in a supply chain with horizontal competition, Management Science 48(9):1196–1212, 2002. https://doi.org/10.1287/mnsc.48.9.1196.177
  • L. Li, H. Zhang, Confidentiality and information sharing in supply chain coordination, Management Science 54(8):1467–1481, 2008. https://doi.org/10.1287/mnsc.1070.0851
  • A. Y. Ha, S. Tong, H. Zhang, Sharing imperfect demand information in competing supply chains with production diseconomies, Management Science 57(3):566–581, 2011. https://doi.org/10.1287/mnsc.1100.1295
  • X. Vives, Oligopoly Pricing: Old Ideas and New Tools, MIT Press, 1999.
17 thms2 active usersReviewed
🏆Completed
Linear algebraNumerical AnalysisOperations Research+1·Captain: mikedeng1

Conjugate Gradient Methods with Inexact Searches: The Self-Scaled Direction Is a Multiple of Beale's Restart DirectionResearch Paper

Motivation

Conjugate gradient methods minimize a smooth function f:Rn→Rf:\mathbb R^n\to\mathbb Rf:Rn→R using only gradients and a handful of stored vectors. This makes them the standard choice when nnn is too large for Newton or quasi-Newton methods, which store an n×nn\times nn×n matrix. On a strictly convex quadratic with exact line searches the classical method of Hestenes and Stiefel terminates in at most nnn steps. On general functions, and with the inexact line searches used in practice, its behaviour is much less clear.

D. F. Shanno's 1978 paper in Mathematics of Operations Research (doi:10.1287/moor.3.3.244) links conjugate gradient methods to quasi-Newton methods. It writes the search direction as −H^g-\hat H g−H^g, where H^\hat HH^ is a positive definite approximation of the inverse Hessian that is never stored. The resulting "memoryless" BFGS directions give descent without exact line searches. The paper's new algorithm uses two BFGS updates: one from the last restart and one from the current step. Its first update is scaled by the Oren–Spedicato factor γt\gamma_tγt​. Shanno and Phua's CONMIN code implements the algorithm, and the memoryless BFGS direction is the one-pair case of the later limited-memory BFGS methods.

  • 1952: Hestenes and Stiefel, linear conjugate gradients.
  • 1964: Fletcher and Reeves, nonlinear conjugate gradients.
  • 1969: Polak and Ribière, a second nonlinear variant.
  • 1972: Beale, a restart procedure that keeps the computed direction dtd_tdt​.
  • 1977: Powell's restart criterion (Powell 1977).
  • 1978: Shanno's reformulation as memoryless and two-update quasi-Newton methods (this paper).

Setting

Vectors are columns in Rn\mathbb R^nRn. A prime denotes transpose: u′vu'vu′v is the inner product and uv′uv'uv′ the outer product. An iterative method produces points xkx_kxk​, steps pk=xk+1−xk=αkdkp_k = x_{k+1}-x_k = \alpha_k d_kpk​=xk+1​−xk​=αk​dk​ along search directions dkd_kdk​, gradients gk=∇f(xk)g_k = \nabla f(x_k)gk​=∇f(xk​), and gradient changes yk=gk+1−gky_k = g_{k+1}-g_kyk​=gk+1​−gk​. A line search is exact when pk′gk+1=0p_k'g_{k+1} = 0pk′​gk+1​=0.

The BFGS update of a matrix HHH with the pair (p,y)(p,y)(p,y) is

H+=H−p y′H+Hy p′p′y+(1+y′Hyp′y)pp′p′y.H^+ = H - \frac{p\,y'H + H y\,p'}{p'y} + \left(1+\frac{y'Hy}{p'y}\right)\frac{pp'}{p'y}.H+=H−p′ypy′H+Hyp′​+(1+p′yy′Hy​)p′ypp′​.

A restart cycle begins at iteration ttt. At a later iteration k>tk>tk>t, Shanno's self-scaled restart matrix is

H^k=γt(I−ptyt′+ytpt′pt′yt+yt′ytpt′ytptpt′pt′yt)+ptpt′pt′yt,γt=pt′ytyt′yt.\hat H_k = \gamma_t\left(I - \frac{p_ty_t'+y_tp_t'}{p_t'y_t} + \frac{y_t'y_t}{p_t'y_t}\frac{p_tp_t'}{p_t'y_t}\right) + \frac{p_tp_t'}{p_t'y_t}, \qquad \gamma_t = \frac{p_t'y_t}{y_t'y_t}.H^k​=γt​(I−pt′​yt​pt​yt′​+yt​pt′​​+pt′​yt​yt′​yt​​pt′​yt​pt​pt′​​)+pt′​yt​pt​pt′​​,γt​=yt′​yt​pt′​yt​​.

The matrix H^k+1\hat H_{k+1}H^k+1​ is its BFGS update with (pk,yk)(p_k,y_k)(pk​,yk​), and the self-scaled two-update direction is dk+1=−H^k+1gk+1d_{k+1} = -\hat H_{k+1}g_{k+1}dk+1​=−H^k+1​gk+1​. The unscaled variant uses the BFGS update of III in place of the first matrix.

Beale's direction is

dk+1=−gk+1+yk′gk+1dk′ykdk+yt′gk+1dt′ytdt.d_{k+1} = -g_{k+1} + \frac{y_k'g_{k+1}}{d_k'y_k}d_k + \frac{y_t'g_{k+1}}{d_t'y_t}d_t.dk+1​=−gk+1​+dk′​yk​yk′​gk+1​​dk​+dt′​yt​yt′​gk+1​​dt​.

The quadratic case has gradient g(x)=Ax+cg(x) = Ax + cg(x)=Ax+c with AAA symmetric positive definite.

Formalization targets

Goal: reduction of the self-scaled method to Beale's method

Let AAA be symmetric positive definite, gi=Axi+cg_i = Ax_i + cgi​=Axi​+c and t<kt<kt<k. Assume that for t≤i≤kt\le i\le kt≤i≤k we have xi+1=xi+pix_{i+1} = x_i + p_ixi+1​=xi​+pi​, pi=αidip_i = \alpha_i d_ipi​=αi​di​ and pi′gi+1=0p_i'g_{i+1}=0pi′​gi+1​=0, that pt′Api=0p_t'Ap_i = 0pt′​Api​=0 for t<i≤kt<i\le kt<i≤k, and that pt,pk≠0p_t, p_k \ne 0pt​,pk​=0. Then

−H^k+1gk+1=γt(−gk+1+yk′gk+1dk′ykdk+yt′gk+1dt′ytdt).-\hat H_{k+1}g_{k+1} = \gamma_t\left(-g_{k+1} + \frac{y_k'g_{k+1}}{d_k'y_k}d_k + \frac{y_t'g_{k+1}}{d_t'y_t}d_t\right).−H^k+1​gk+1​=γt​(−gk+1​+dk′​yk​yk′​gk+1​​dk​+dt′​yt​yt′​gk+1​​dt​).

This is the paper's claim that "for f(x)f(x)f(x) quadratic with exact searches each of the above methods reduces exactly to Beale's method defined by (28)", with the conclusion (44). The scale is exactly γt\gamma_tγt​.

Companion statements

  • The unscaled two-update direction equals Beale's direction exactly.
  • Both two-update directions are descent directions, gk+1′dk+1<0g_{k+1}'d_{k+1} < 0gk+1′​dk+1​<0, whenever pt′yt>0p_t'y_t > 0pt′​yt​>0 and pk′yk>0p_k'y_k > 0pk′​yk​>0. No exact search is needed.

Milestones on the path

  • (34): the expansion of −H^k+1gk+1-\hat H_{k+1}g_{k+1}−H^k+1​gk+1​.
  • (40): its form under an exact search.
  • (41): gradients along a run on a quadratic.
  • pt′gk+1=0p_t'g_{k+1} = 0pt′​gk+1​=0.
  • (38), corrected by a factor 2: the action of the self-scaled restart matrix.
  • (42): its form when pt′gk+1=0p_t'g_{k+1} = 0pt′​gk+1​=0.
  • (43): the direction after substitution.

Significance

The result. The reduction says that the new algorithm reproduces Beale's restarted conjugate gradient directions on a quadratic with exact line searches. So it keeps the finite-termination and rate-of-convergence properties behind Beale's restart. Away from that setting it behaves as a quasi-Newton method, whose directions are descent directions under any line search with p′y>0p'y>0p′y>0. The two regimes are what justify relaxing the line search, which the paper's computations exploit. The scale γt\gamma_tγt​ changes only the length of the step, not its direction.

Formalizing it. The claim is proved in the paper by a short computation, and no machine-checked version is known. This mission produces:

  • a checked statement of the claim with every hypothesis explicit, including the conjugacy the proof takes as known;
  • a corrected version of display (38), which is misprinted;
  • reusable definitions of the additive BFGS update and of Beale's direction.

Difficulty

The obvious attempt is to expand both BFGS updates symbolically and compare with Beale's formula. This fails without two facts that are not algebraic identities. The first is that the restart step stays orthogonal to every later gradient, pt′gk+1=0p_t'g_{k+1}=0pt′​gk+1​=0. It needs the affine gradient of a quadratic, the exact search at the restart step, and conjugacy of ptp_tpt​ with all later steps. The second is yk′pt=0y_k'p_t = 0yk′​pt​=0, which again comes from conjugacy. Beale's formula also has to be matched in its ddd-form: the coefficient y′gd′yd\frac{y'g}{d'y}dd′yy′g​d equals y′gp′yp\frac{y'g}{p'y}pp′yy′g​p only when the step length is nonzero. The descent statements need a different argument: the BFGS update of a positive definite matrix with p′y>0p'y>0p′y>0 must be shown to remain positive definite, and this has to be done twice.

Formalization scope

Vectors are Fin n → ℝ and matrices Matrix (Fin n) (Fin n) ℝ. The inner product u′vu'vu′v is u ⬝ᵥ v, the outer product uv′uv'uv′ is vecMulVec u v, and HvHvHv is H *ᵥ v. The quadratic enters only through its gradient A *ᵥ x + c with A.PosDef. The paper's (4) is the case c=−Ax^c = -A\hat xc=−Ax^. Iterates, steps, directions and gradients are sequences indexed by ℕ. Division is Lean's total division. Every statement that divides therefore carries hypotheses making its denominators nonzero: pt≠0p_t \ne 0pt​=0 and pk≠0p_k\ne0pk​=0 in the quadratic statements, and pt′yt≠0p_t'y_t\ne 0pt′​yt​=0 or p′y>0p'y>0p′y>0 in the generic ones.

The conjugacy pt′Api=0p_t'Ap_i=0pt′​Api​=0 for t<i≤kt<i\le kt<i≤k is a hypothesis, exactly as the paper's proof uses it. It is not derived from a full run of Beale's algorithm. The range k≤t+n−1k\le t+n-1k≤t+n−1 of Beale's formula is not assumed.

Several formalizations would make the claim easier than the paper's, and none of them is used:

  • defining the direction by the expanded formula (34), or the restart matrix by (38);
  • adding orthogonality or conjugacy hypotheses beyond those listed;
  • concluding only that the two directions are parallel;
  • dropping the restart term of Beale's direction;
  • allowing a zero denominator.

The generic milestones — (34), (40), (38), (42), (43) and the descent statements — are statements about arbitrary vectors and matrices and are reusable for any BFGS-based method. Proofs of any milestone, and alternative derivations of the goal, are welcome.

Selected references

  • D. F. Shanno, Conjugate Gradient Methods with Inexact Searches, Mathematics of Operations Research 3(3) (1978) 244–256. https://doi.org/10.1287/moor.3.3.244
  • E. M. L. Beale, A derivation of conjugate gradients, in F. A. Lootsma (ed.), Numerical Methods for Nonlinear Optimization, Academic Press, 1972, 39–43.
  • M. J. D. Powell, Restart procedures for the conjugate gradient method, Mathematical Programming 12 (1977) 241–254. https://doi.org/10.1007/BF01593790
  • M. R. Hestenes and E. Stiefel, Methods of conjugate gradients for solving linear systems, J. Res. Nat. Bur. Standards 49 (1952) 409–436. https://doi.org/10.6028/jres.049.044
  • S. S. Oren and E. Spedicato, Optimal conditioning of self-scaling variable metric algorithms, Mathematical Programming 10 (1976) 70–90. https://doi.org/10.1007/BF01580654
18 thms2 active usersReviewed
🏆Completed
Convex OptimizationNumerical AnalysisOperations Research+1·Captain: mikedeng1

A New Projection Method for Variational Inequality Problems: The Hyperplane Projection Method Converges to a Solution Under Continuity and Generalized MonotonicityResearch Paper

Motivation

A variational inequality asks for a point of a convex set at which a vector field points "inward" against every feasible direction. The format covers the first-order optimality conditions of constrained optimization, nonlinear complementarity problems, traffic and economic equilibria (Wardrop, Walrasian, Nash–Cournot), and systems of nonlinear equations; see Harker and Pang's survey (Math. Programming 48, 1990) and Facchinei and Pang's monograph (Springer, 2003).

When the map has no special structure (not strongly monotone, not Lipschitz with known constant, not affine) and the feasible set is a general closed convex set, the practical algorithms are projection methods. The oldest is Korpelevich's extragradient method (1976). Without a known Lipschitz constant, extragradient-type methods need a linesearch in which every trial point costs one projection onto the feasible set, and projection onto a general convex set is itself an optimization problem.

Solodov and Svaiter (SIAM J. Control Optim. 37 (1999) 765–776) proposed a method that spends exactly two projections per iteration, whatever the linesearch does, and proved global convergence under only continuity of the map and a generalized monotonicity condition weaker than pseudomonotonicity. The method, often called the hyperplane projection method, is a standard reference point for later projection and extragradient-type algorithms.

Timeline:

  • 1976: Korpelevich, extragradient method, Lipschitz monotone maps.
  • 1987–1994: Khobotov (1987), Iusem (1994) and others: extragradient variants with Armijo-type stepsize rules, which need one projection per trial step.
  • 1997: Iusem and Svaiter, a separating-hyperplane variant of extragradient for monotone maps (reference [9] of the paper).
  • 1999: Solodov and Svaiter, Algorithm 2.1: two projections per iteration, convergence under condition (1.2) below.

Setting

Work in Rn\mathbb{R}^nRn with the Euclidean inner product ⟨⋅,⋅⟩\langle\cdot,\cdot\rangle⟨⋅,⋅⟩ and norm ∥⋅∥\|\cdot\|∥⋅∥. Let C⊆RnC \subseteq \mathbb{R}^nC⊆Rn be closed and convex and F:Rn→RnF : \mathbb{R}^n \to \mathbb{R}^nF:Rn→Rn continuous. The problem VI(F,C)\mathrm{VI}(F, C)VI(F,C) is to find x∗x^*x∗ with

x∗∈C,⟨F(x∗),x−x∗⟩≥0for all x∈C.(1.1)x^* \in C, \qquad \langle F(x^*), x - x^*\rangle \ge 0 \quad \text{for all } x \in C. \tag{1.1}x∗∈C,⟨F(x∗),x−x∗⟩≥0for all x∈C.(1.1)

Its solution set is SSS. The projection onto a nonempty closed convex set KKK is PK[x]:=arg⁡min⁡y∈K∥y−x∥P_K[x] := \arg\min_{y \in K}\|y - x\|PK​[x]:=argminy∈K​∥y−x∥. The projected residual is r(x):=x−PC[x−F(x)]r(x) := x - P_C[x - F(x)]r(x):=x−PC​[x−F(x)]; its zeros are exactly the points of SSS.

Condition (1.2) requires, for every x∗∈Sx^* \in Sx∗∈S,

⟨F(x),x−x∗⟩≥0for all x∈C.(1.2)\langle F(x), x - x^*\rangle \ge 0 \qquad \text{for all } x \in C. \tag{1.2}⟨F(x),x−x∗⟩≥0for all x∈C.(1.2)

It holds when FFF is monotone or pseudomonotone, and in cases where FFF is neither.

Algorithm 2.1. Fix γ,σ∈(0,1)\gamma, \sigma \in (0,1)γ,σ∈(0,1) and x0∈Cx^0 \in Cx0∈C. Given xix^ixi: if r(xi)=0r(x^i) = 0r(xi)=0, stop. Otherwise let kik_iki​ be the smallest nonnegative integer kkk with

⟨F(xi−γkr(xi)),r(xi)⟩≥σ∥r(xi)∥2,(2.1)\langle F(x^i - \gamma^k r(x^i)), r(x^i)\rangle \ge \sigma\|r(x^i)\|^2, \tag{2.1}⟨F(xi−γkr(xi)),r(xi)⟩≥σ∥r(xi)∥2,(2.1)

set ηi=γki\eta_i = \gamma^{k_i}ηi​=γki​, zi=xi−ηir(xi)z^i = x^i - \eta_i r(x^i)zi=xi−ηi​r(xi), Hi={x∣⟨F(zi),x−zi⟩≤0}H_i = \{x \mid \langle F(z^i), x - z^i\rangle \le 0\}Hi​={x∣⟨F(zi),x−zi⟩≤0}, and

xi+1=PC∩Hi[xi].x^{i+1} = P_{C \cap H_i}[x^i].xi+1=PC∩Hi​​[xi].

The hyperplane ∂Hi\partial H_i∂Hi​ separates xix^ixi from SSS.

Formalization targets

Goal: Theorem 2.1

If CCC is closed and convex, FFF is continuous, S≠∅S \ne \emptysetS=∅ and (1.2) holds, then every sequence generated by Algorithm 2.1 converges to a single point of SSS:

∃ x^∈S:xi→x^(i→∞).\exists\, \hat x \in S:\quad x^i \to \hat x \quad (i \to \infty).∃x^∈S:xi→x^(i→∞).

The theorem fixes no rate and no constant; it asserts convergence of the whole sequence, not only of a subsequence.

Milestones (in attack order)

  • Lemma 2.1 (p. 768): for nonempty closed convex BBB, ⟨x−PB[x],z−PB[x]⟩≤0\langle x - P_B[x], z - P_B[x]\rangle \le 0⟨x−PB​[x],z−PB​[x]⟩≤0 for z∈Bz \in Bz∈B, and ∥PB[x]−PB[y]∥2≤∥x−y∥2−∥PB[x]−x+y−PB[y]∥2\|P_B[x]-P_B[y]\|^2 \le \|x-y\|^2 - \|P_B[x]-x+y-P_B[y]\|^2∥PB​[x]−PB​[y]∥2≤∥x−y∥2−∥PB​[x]−x+y−PB​[y]∥2.
  • Residual characterization (p. 767): x∈S  ⟺  r(x)=0x \in S \iff r(x) = 0x∈S⟺r(x)=0.
  • (2.5) (p. 769): ⟨F(x),r(x)⟩≥∥r(x)∥2\langle F(x), r(x)\rangle \ge \|r(x)\|^2⟨F(x),r(x)⟩≥∥r(x)∥2 for x∈Cx \in Cx∈C.
  • Linesearch well-definedness (p. 769): for x∈Cx \in Cx∈C with r(x)≠0r(x) \ne 0r(x)=0, some kkk satisfies (2.1).
  • Lemma 2.2 (p. 768): xi+1=PC∩Hi[xˉi]x^{i+1} = P_{C\cap H_i}[\bar x^i]xi+1=PC∩Hi​​[xˉi] with xˉi=PHi[xi]\bar x^i = P_{H_i}[x^i]xˉi=PHi​​[xi].
  • (2.6) (pp. 769–770): ∥xi+1−x∗∥2≤∥xi−x∗∥2−∥xi+1−xˉi∥2−(ηiσ/∥F(zi)∥)2∥r(xi)∥4\|x^{i+1}-x^*\|^2 \le \|x^i-x^*\|^2 - \|x^{i+1}-\bar x^i\|^2 - \big(\eta_i\sigma/\|F(z^i)\|\big)^2\|r(x^i)\|^4∥xi+1−x∗∥2≤∥xi−x∗∥2−∥xi+1−xˉi∥2−(ηi​σ/∥F(zi)∥)2∥r(xi)∥4 for every x∗∈Sx^* \in Sx∗∈S.
  • (2.8) (p. 770): ηi∥r(xi)∥→0\eta_i\|r(x^i)\| \to 0ηi​∥r(xi)∥→0.

Significance

Theorem 2.1 gives global convergence of a projection method for variational inequalities with no Lipschitz constant, no monotonicity and no knowledge of the problem beyond continuity and (1.2), at a fixed cost of two projections per iteration. Condition (1.2) covers pseudomonotone maps, which arise as gradients of pseudoconvex functions and in equilibrium models where monotonicity fails. The separating-hyperplane-and-project template of the proof is reused throughout the later literature on projection, proximal and hybrid methods for monotone inclusions.

The result has been proved since 1999. To the best of available knowledge no machine-checked proof of it, or of any convergence theorem for a projection method for variational inequalities, exists in Lean or Mathlib. This mission produces the statement and the supporting layer: a Euclidean projection onto closed convex sets with its standard inequalities, variational inequality solution sets, the projected residual, and a formal model of an Armijo-type linesearch algorithm with termination.

Difficulty

The Fejér-type inequality (2.6) quickly gives bounded iterates and ηi∥r(xi)∥→0\eta_i\|r(x^i)\| \to 0ηi​∥r(xi)∥→0. The obvious next step, concluding r(xi)→0r(x^i) \to 0r(xi)→0, fails: nothing prevents the stepsizes ηi\eta_iηi​ from tending to zero, and in that regime the product going to zero says nothing about the residual. This regime is where the minimality of kik_iki​ and the continuity of FFF enter, and it is the step a naive formalization (for instance one that drops minimality, or fixes the stepsize) cannot reach. A second subtlety is that (1.2) is needed at an accumulation point that is only known to lie in SSS at the end of the argument, which is why the condition must hold for every x∗∈Sx^* \in Sx∗∈S. Finally, subsequential convergence must be upgraded to convergence of the whole sequence to one solution; convergence of a subsequence, or of the distance to SSS, is strictly weaker.

Formalization scope

  • Rn\mathbb{R}^nRn is EuclideanSpace ℝ (Fin n) (not Fin n → ℝ, whose norm is the sup norm). The accumulation-point step needs finite dimension; no Hilbert-space generalization is intended.
  • Projection encoding. projOnto K x is a nearest point of KKK to xxx when one exists, chosen by Classical.choose, and the junk value xxx otherwise. On nonempty closed convex sets it is exactly PK[x]P_K[x]PK​[x]; the paper only projects onto such sets (CCC, HiH_iHi​, C∩HiC \cap H_iC∩Hi​), so the junk value is never reached under the hypotheses.
  • Stopping-rule encoding. A run is a sequence x : ℕ → ℝⁿ with Armijo indices k : ℕ → ℕ (predicate IsAlg21Run). If r(xi)=0r(x^i) = 0r(xi)=0 the method has stopped and the run stalls, xi+1=xix^{i+1} = x^ixi+1=xi; otherwise kik_iki​ is the least index satisfying (2.1) and xi+1=PC∩Hi[xi]x^{i+1} = P_{C \cap H_i}[x^i]xi+1=PC∩Hi​​[xi]. A stalled point is a solution, so finitely terminating runs are included in the goal.
  • Parameters γ,σ\gamma, \sigmaγ,σ are real with 0<γ<10 < \gamma < 10<γ<1, 0<σ<10 < \sigma < 10<σ<1, universally quantified; nnn, CCC, FFF and x0∈Cx^0 \in Cx0∈C are arbitrary.
  • (2.6) is stated for one generic step (x∈Cx \in Cx∈C, r(x)≠0r(x)\ne 0r(x)=0, kkk satisfying (2.1)) rather than along a run; it is the same inequality with xi,kix^i, k_ixi,ki​ abstracted.
  • Trivializing formalizations are ruled out: condition (1.2) is quantified over every solution and every x∈Cx \in Cx∈C (not replaced by monotonicity or an existential), kik_iki​ is the least index satisfying (2.1), the update projects xix^ixi onto C∩HiC \cap H_iC∩Hi​ (not onto CCC alone), the stopped case is pinned down by the stall encoding, and the conclusion is convergence of the whole sequence to one solution, not r(xi)→0r(x^i) \to 0r(xi)→0 or dist⁡(xi,S)→0\operatorname{dist}(x^i, S) \to 0dist(xi,S)→0.
  • Needed infrastructure: existence, uniqueness and variational characterization of the projection (Mathlib has exists_norm_eq_iInf_of_complete_convex and norm_eq_iInf_iff_real_inner_le_zero), firm nonexpansiveness, the explicit projection onto a halfspace, and a bounded-sequence subsequence argument in Rn\mathbb{R}^nRn. The projection lemmas are reusable for any projection-type method; contributions proving them as standalone lemmas are welcome.

Selected references

  • M. V. Solodov and B. F. Svaiter, A New Projection Method for Variational Inequality Problems, SIAM J. Control Optim. 37(3), 765–776, 1999. https://doi.org/10.1137/S0363012997317475
  • G. M. Korpelevich, The extragradient method for finding saddle points and other problems, Matecon 12, 747–756, 1976.
  • A. N. Iusem and B. F. Svaiter, A variant of Korpelevich's method for variational inequalities with a new search strategy, Optimization 42, 309–321, 1997. https://doi.org/10.1080/02331939708844365
  • P. T. Harker and J.-S. Pang, Finite-dimensional variational inequality and nonlinear complementarity problems: a survey of theory, algorithms and applications, Math. Programming 48, 161–220, 1990. https://doi.org/10.1007/BF01582255
  • F. Facchinei and J.-S. Pang, Finite-Dimensional Variational Inequalities and Complementarity Problems, Springer, 2003. https://doi.org/10.1007/b97543
16 thms2 active usersReviewed
🏆Completed
Dynamic ProgrammingOperations ResearchProbability+1·Captain: mikedeng1

Computing Optimal (s, S) Inventory Policies I: The Renewal Closed Form for the Discounted Cost of a Stationary (s, S) PolicyResearch Paper

Motivation

The periodic-review inventory problem with a fixed ordering cost is one of the basic models of operations research. A firm reviews its stock once per period, may order at a cost KKK per order plus a unit cost, and then faces a random demand; unmet demand is backlogged. Scarf (1960) and Iglehart (1963) showed that for this model an (s,S)(s, S)(s,S) policy is optimal: order up to SSS whenever the stock falls below sss, and otherwise do nothing. That result tells a manager what shape a good policy has, but not which pair (s,S)(s, S)(s,S) to use.

Veinott and Wagner, Computing Optimal (s, S) Inventory Policies (Management Science 11 (1965) 525–552), gave the first practical algorithm for computing an optimal pair when demand is discrete. The algorithm rests on a closed form, their Eq. (11), for the discounted cost of an arbitrary stationary (s,S)(s, S)(s,S) policy, obtained by a renewal argument in their Section 3. The same closed form, in the undiscounted limit, is the classical expression of the long-run average cost of an (s,S)(s, S)(s,S) policy used throughout inventory theory textbooks.

Timeline:

  • 1958: Arrow, Karlin and Scarf collect the early dynamic inventory models.
  • 1960: Scarf proves optimality of (s,S)(s, S)(s,S) policies in the finite-horizon model via KKK-convexity.
  • 1963: Iglehart extends optimality to the infinite-horizon model.
  • 1965: Veinott and Wagner derive the renewal closed form (10)–(11) and the bounds and search procedure built on it.

Setting

Demands ξ1,ξ2,…\xi_1, \xi_2, \dotsξ1​,ξ2​,… are independent random variables on {0,1,2,… }\{0, 1, 2, \dots\}{0,1,2,…} with common distribution φ\varphiφ, φ(k)=Pr⁡(ξt=k)\varphi(k) = \Pr(\xi_t = k)φ(k)=Pr(ξt​=k). Write φi\varphi^iφi for the iii-fold convolution of φ\varphiφ (φ0\varphi^0φ0 is the point mass at 000) and Φi(k)=∑t=0kφi(t)\Phi^i(k) = \sum_{t=0}^{k}\varphi^i(t)Φi(k)=∑t=0k​φi(t) for its distribution function, so Φ0≡1\Phi^0 \equiv 1Φ0≡1.

In period ttt the stock before ordering is Xt∈ZX_t \in \mathbb ZXt​∈Z and the stock after ordering is Yt≥XtY_t \ge X_tYt​≥Xt​; then Xt+1=Yt−ξtX_{t+1} = Y_t - \xi_tXt+1​=Yt​−ξt​. With the unit purchase cost eliminated as in the paper's Eq. (2), the cost of period ttt is Kδ(Yt−Xt)+Gα(Yt)K\delta(Y_t - X_t) + G_\alpha(Y_t)Kδ(Yt​−Xt​)+Gα​(Yt​), where K≥0K \ge 0K≥0 is the set-up cost, δ(0)=0\delta(0) = 0δ(0)=0, δ(z)=1\delta(z) = 1δ(z)=1 for z>0z > 0z>0, and Gα:Z→RG_\alpha : \mathbb Z \to \mathbb RGα​:Z→R is the one-period cost. Period ttt is discounted by αt−1\alpha^{t-1}αt−1 with 0≤α<10 \le \alpha < 10≤α<1.

A stationary (s,S)(s, S)(s,S) policy, for integers s≤Ss \le Ss≤S, sets Yt=SY_t = SYt​=S if Xt<sX_t < sXt​<s and Yt=XtY_t = X_tYt​=Xt​ otherwise. Its total expected discounted cost from X1=xX_1 = xX1​=x is

f(x∣s,S)=∑t=1∞αt−1E[Kδ(Yt−Xt)+Gα(Yt)],f(x \mid s, S) = \sum_{t=1}^{\infty} \alpha^{t-1} E\bigl[K\delta(Y_t - X_t) + G_\alpha(Y_t)\bigr],f(x∣s,S)=t=1∑∞​αt−1E[Kδ(Yt​−Xt​)+Gα​(Yt​)],

and its equivalent cost per period is aα(x∣s,S)=(1−α)f(x∣s,S)a_\alpha(x \mid s, S) = (1 - \alpha) f(x \mid s, S)aα​(x∣s,S)=(1−α)f(x∣s,S).

The renewal quantities are

mα(k)=∑i=1∞αiφi(k),Mα(k)=∑i=1∞αiΦi(k),m_\alpha(k) = \sum_{i=1}^{\infty}\alpha^i\varphi^i(k), \qquad M_\alpha(k) = \sum_{i=1}^{\infty}\alpha^i\Phi^i(k),mα​(k)=i=1∑∞​αiφi(k),Mα​(k)=i=1∑∞​αiΦi(k),

the latter being the discount renewal function,

Lα(x,d)=Gα(x)+∑i=1∞∑k=0dαiGα(x−k)φi(k),rα(d)=∑i=1∞αi[Φi−1(d)−Φi(d)].L_\alpha(x, d) = G_\alpha(x) + \sum_{i=1}^{\infty}\sum_{k=0}^{d}\alpha^i G_\alpha(x - k)\varphi^i(k), \qquad r_\alpha(d) = \sum_{i=1}^{\infty}\alpha^i\bigl[\Phi^{i-1}(d) - \Phi^i(d)\bigr].Lα​(x,d)=Gα​(x)+i=1∑∞​k=0∑d​αiGα​(x−k)φi(k),rα​(d)=i=1∑∞​αi[Φi−1(d)−Φi(d)].

If T(d)T(d)T(d) is the first period in which cumulative demand exceeds ddd, then Lα(x,d)L_\alpha(x, d)Lα​(x,d) is the expected discounted one-period cost over periods 1,…,T(d)1, \dots, T(d)1,…,T(d) from stock xxx without ordering, and rα(d)=E[αT(d)]r_\alpha(d) = E[\alpha^{T(d)}]rα​(d)=E[αT(d)].

Formalization targets

Goal: Eq. (11)

With D=S−sD = S - sD=S−s,

aα(x∣s,S)={Lα(S,D)+K1+Mα(D)x<s,(1−α)Lα(x,x−s)+Lα(S,D)+K1+Mα(D) rα(x−s)x≥s.a_\alpha(x \mid s, S) = \begin{cases} \dfrac{L_\alpha(S, D) + K}{1 + M_\alpha(D)} & x < s, \\[2ex] (1 - \alpha)L_\alpha(x, x - s) + \dfrac{L_\alpha(S, D) + K}{1 + M_\alpha(D)}\, r_\alpha(x - s) & x \ge s. \end{cases}aα​(x∣s,S)=⎩⎨⎧​1+Mα​(D)Lα​(S,D)+K​(1−α)Lα​(x,x−s)+1+Mα​(D)Lα​(S,D)+K​rα​(x−s)​x<s,x≥s.​

Milestones

  1. Appendix §1: Mα(k)<∞M_\alpha(k) < \inftyMα​(k)<∞ for 0≤α≤10 \le \alpha \le 10≤α≤1 with αφ(0)<1\alpha\varphi(0) < 1αφ(0)<1.
  2. Eq. (8): Lα(x,d)=Gα(x)+∑j=0dGα(x−j)mα(j)L_\alpha(x, d) = G_\alpha(x) + \sum_{j=0}^{d} G_\alpha(x - j)m_\alpha(j)Lα​(x,d)=Gα​(x)+∑j=0d​Gα​(x−j)mα​(j).
  3. Eq. (9): rα(d)=α−(1−α)Mα(d)r_\alpha(d) = \alpha - (1 - \alpha)M_\alpha(d)rα​(d)=α−(1−α)Mα​(d).
  4. The renewal equation f(S)=Lα(S,D)+Krα(D)+f(S)rα(D)f(S) = L_\alpha(S, D) + Kr_\alpha(D) + f(S)r_\alpha(D)f(S)=Lα​(S,D)+Krα​(D)+f(S)rα​(D).
  5. f(x)=K+f(S)f(x) = K + f(S)f(x)=K+f(S) for x<sx < sx<s.
  6. f(x)=Lα(x,x−s)+Krα(x−s)+f(S)rα(x−s)f(x) = L_\alpha(x, x - s) + Kr_\alpha(x - s) + f(S)r_\alpha(x - s)f(x)=Lα​(x,x−s)+Krα​(x−s)+f(S)rα​(x−s) for x≥sx \ge sx≥s.
  7. Eq. (10): the closed form of fff with denominator 1−rα(D)1 - r_\alpha(D)1−rα​(D).

Significance

Eq. (11) turns the cost of an (s,S)(s, S)(s,S) policy, an infinite series over the trajectories of a controlled Markov chain, into a finite expression in GαG_\alphaGα​, KKK and the renewal sequence mαm_\alphamα​, which the paper computes by a one-line recursion. Everything in the paper's Section 4 builds on it: the search for an optimal pair minimizes aα(⋅∣s,S)a_\alpha(\cdot \mid s, S)aα​(⋅∣s,S) over a finite box, and the undiscounted limit α→1\alpha \to 1α→1 gives the long-run average cost (L1(S,D)+K)/(1+M1(D))(L_1(S, D) + K)/(1 + M_1(D))(L1​(S,D)+K)/(1+M1​(D)).

The result is classical and proved in the paper. What this mission adds is a machine-checked derivation from the definition of the policy's expected cost, including the renewal step, which the paper states in one sentence ("a renewal of the process takes place"). It also produces a reusable Lean layer: discrete convolution powers, the discount renewal function, and the law of an (s,S)(s, S)(s,S)-controlled inventory chain. To the best of our knowledge none of these is formalized in Mathlib or on the platform.

Difficulty

The paper's argument conditions on the random time T(D)T(D)T(D) at which the process renews and uses the strong Markov property at that time. In the formalization, fff is defined as a sum over periods of expectations under the law of XtX_tXt​. Relating that sum to one that splits at the random time T(D)T(D)T(D) requires either a stopping-time decomposition of the chain or an explicit accounting of the law of XtX_tXt​ before and after the first order. Neither is a direct computation. A second difficulty is the interchange of the infinite sum over periods with the sum over states y∈Zy \in \mathbb Zy∈Z, which has infinitely many states reachable (demand is unbounded below). The renewal equation (milestone 4) alone does not determine f(S)f(S)f(S) without the fact that rα(D)<1r_\alpha(D) < 1rα​(D)<1 for α<1\alpha < 1α<1, which comes from (9).

Formalization scope

  • Namespace VeinottWagnerSS.RenewalCost. Stock levels are integers, demands natural numbers; x−sx - sx−s and D=S−sD = S - sD=S−s enter LαL_\alphaLα​, MαM_\alphaMα​, rαr_\alpharα​ through Int.toNat, which is exact because the statements assume s≤xs \le xs≤x or s≤Ss \le Ss≤S.
  • Reduced model. The primitives are GαG_\alphaGα​, KKK, α\alphaα and φ\varphiφ, as in the paper's Eq. (2): the unit purchase cost is set to 000 and the holding–penalty cost is replaced by GαG_\alphaGα​.
  • Demand is a real function φ:N→R\varphi : \mathbb N \to \mathbb Rφ:N→R, non-negative and summing to 111.
  • The cost fff is the expected discounted cost of the controlled chain: the law of XtX_tXt​ is built recursively from X1=xX_1 = xX1​=x and the transition Pr⁡(Xt+1=z∣Xt=y)=φ(Y(y)−z)\Pr(X_{t+1} = z \mid X_t = y) = \varphi(Y(y) - z)Pr(Xt+1​=z∣Xt​=y)=φ(Y(y)−z). It is not defined by (10) or by the renewal equations, and not as the solution of a fixed-point equation. A formalization in which any of milestones 4–7 or the goal holds by definition is ruled out.
  • Series are real tsums. LαL_\alphaLα​ is defined by the series (7) and rαr_\alpharα​ by the first line of (9), i.e. through the law Pr⁡[T(d)=i]=Φi−1(d)−Φi(d)\Pr[T(d) = i] = \Phi^{i-1}(d) - \Phi^i(d)Pr[T(d)=i]=Φi−1(d)−Φi(d); the paper's derivations of these series from T(d)T(d)T(d) are not formalized. For α<1\alpha < 1α<1 all series converge for every GαG_\alphaGα​, because after period 111 the stock after ordering lies in the finite set {S}∪[s,max⁡(x,S)]\{S\} \cup [s, \max(x, S)]{S}∪[s,max(x,S)].
  • Hypotheses. Milestones 1–3 assume 0≤α≤10 \le \alpha \le 10≤α≤1 and αφ(0)<1\alpha\varphi(0) < 1αφ(0)<1, the paper's standing assumption on p. 533. Milestones 4–7 and the goal assume 0≤α<10 \le \alpha < 10≤α<1, K≥0K \ge 0K≥0 and s≤Ss \le Ss≤S. The paper's standing assumptions that GαG_\alphaGα​ is convex and tends to +∞+\infty+∞ as ∣y∣→∞|y| \to \infty∣y∣→∞ are not imposed: the statements hold for every GαG_\alphaGα​ when α<1\alpha < 1α<1, and the paper's derivation does not use them. This is a disclosed generalization.
  • Printed slips. None found in the formalized statements.
  • Not formalized: the recursion (A1) for mαm_\alphamα​, the limit (12) as α→1\alpha \to 1α→1, and the stationary analysis (13)–(20).

Contributions welcome: proofs of the milestones, general lemmas on discrete renewal sequences and convolution powers, and a first-passage decomposition for integer-valued Markov chains, which is reusable beyond this mission.

Selected references

  • A. F. Veinott Jr. and H. M. Wagner, Computing Optimal (s, S) Inventory Policies, Management Science 11(5), 525–552, 1965. https://doi.org/10.1287/mnsc.11.5.525
  • H. Scarf, The Optimality of (S, s) Policies in the Dynamic Inventory Problem, in Mathematical Methods in the Social Sciences, Stanford University Press, 1960.
  • D. L. Iglehart, Optimality of (s, S) Policies in the Infinite Horizon Dynamic Inventory Problem, Management Science 9(2), 259–267, 1963. https://doi.org/10.1287/mnsc.9.2.259
  • K. J. Arrow, S. Karlin and H. Scarf, Studies in the Mathematical Theory of Inventory and Production, Stanford University Press, 1958.
11 thms2 active usersReviewed
🏆Completed
Operations ResearchOptimizationProbability·Captain: mikedeng1

Stochastic Programs with Fixed Recourse: The Equivalent Deterministic Program I: The Induced Feasibility Region Is a Closed Convex Polyhedron When T Is FixedResearch Paper

Motivation

A two-stage stochastic program with recourse is a linear program in which a decision xxx is taken before a random vector ξ\xiξ is observed, and a corrective (recourse) decision yyy is taken afterwards at a cost. It is the basic model of planning under uncertainty in operations research: capacity expansion, production planning, energy dispatch and inventory models are routinely written this way. Before any algorithm can be applied, the model has to be reduced to a deterministic equivalent program in xxx alone, and the first question is which xxx are admissible at all: the random second-stage constraints induce constraints on xxx that are not written down anywhere in the data.

Roger J.-B. Wets's survey (SIAM Review 16(3), 1974) settled this question for fixed recourse (the recourse matrix WWW is not random) under a weak moment condition on the data. Its §4 shows that the natural definitions of the induced feasibility region agree, that the region is always closed and convex, and that it is a polyhedron, described by finitely many deterministic linear inequalities, whenever the technology matrix TTT is fixed. The last fact is what makes decomposition methods such as the L-shaped method of Van Slyke and Wets (1969) terminate with finitely many feasibility cuts.

Timeline: Dantzig (1955) and Beale (1955) introduce linear programs under uncertainty, under assumptions that make every xxx feasible (relatively complete recourse). Wets (1966) and Kall (1966) begin studying the feasibility region without that assumption; Wets (1966c) introduces the polar matrix used for the polyhedrality result. Walkup and Wets (1967) treat random WWW. The 1974 survey collects these results in the form formalized here.

Setting

The data are a fixed real mˉ×nˉ\bar m \times \bar nmˉ×nˉ matrix WWW and a random vector ξ=(c,q,p,T)\xi = (c, q, p, T)ξ=(c,q,p,T) with c∈Rnc \in \mathbb{R}^nc∈Rn, q∈Rnˉq \in \mathbb{R}^{\bar n}q∈Rnˉ, p∈Rmˉp \in \mathbb{R}^{\bar m}p∈Rmˉ and TTT an mˉ×n\bar m \times nmˉ×n matrix. The law of ξ\xiξ is a probability measure μ\muμ on the product space, and its support Ξ~\tilde\XiΞ~ is the smallest closed set of measure one. The recourse function is

Q(x,ξ)=min⁡{ q(ξ)y∣Wy=p(ξ)−T(ξ)x, y≥0 },Q(x,\xi) = \min\{\, q(\xi)y \mid Wy = p(\xi) - T(\xi)x,\ y \ge 0 \,\},Q(x,ξ)=min{q(ξ)y∣Wy=p(ξ)−T(ξ)x, y≥0},

equal to +∞+\infty+∞ when the program is infeasible and −∞-\infty−∞ when it is unbounded below. The expected recourse Q(x)=Eξ{Q(x,ξ)}\mathcal Q(x) = E_\xi\{Q(x,\xi)\}Q(x)=Eξ​{Q(x,ξ)} uses the paper's integral: the sum of the positive part ∫Q+dμ∈[0,+∞]\int Q^+ d\mu \in [0,+\infty]∫Q+dμ∈[0,+∞] and the negative part −∫Q−dμ∈[−∞,0]-\int Q^- d\mu \in [-\infty,0]−∫Q−dμ∈[−∞,0], with (+∞)+(−∞)=+∞(+\infty) + (-\infty) = +\infty(+∞)+(−∞)=+∞.

The weak covariance condition (Definition 2.2) asks that cjc_jcj​, qjpiq_j p_iqj​pi​ and qjtikq_j t_{ik}qj​tik​ be integrable for all i,j,ki, j, ki,j,k. Write pos⁡W={Wy∣y≥0}\operatorname{pos} W = \{Wy \mid y \ge 0\}posW={Wy∣y≥0}. The candidate feasibility sets for the induced constraints are

  • K2μK_2^\muK2μ​: the xxx for which, with probability one, some y≥0y \ge 0y≥0 solves Wy=p(ξ)−T(ξ)xWy = p(\xi) - T(\xi)xWy=p(ξ)−T(ξ)x;
  • K2pK_2^pK2p​: the xxx for which such a yyy exists for every ξ∈Ξ~\xi \in \tilde\Xiξ∈Ξ~;
  • K2s={x∣Q(x)<+∞}K_2^s = \{x \mid \mathcal Q(x) < +\infty\}K2s​={x∣Q(x)<+∞};
  • K2=⋂ζ∈Ξ~p,TK2(ζ)K_2 = \bigcap_{\zeta \in \tilde\Xi_{p,T}} K_2(\zeta)K2​=⋂ζ∈Ξ~p,T​​K2​(ζ), where Ξ~p,T\tilde\Xi_{p,T}Ξ~p,T​ is the support of the law of (p,T)(p,T)(p,T) and K2(ζ)={x∣p−Tx∈pos⁡W}K_2(\zeta) = \{x \mid p - Tx \in \operatorname{pos} W\}K2​(ζ)={x∣p−Tx∈posW} for ζ=(p,T)\zeta = (p,T)ζ=(p,T).

A convex polyhedron is a set {x∣Gx≥α}\{x \mid Gx \ge \alpha\}{x∣Gx≥α} given by finitely many linear inequalities; ∅\emptyset∅ and Rn\mathbb{R}^nRn are polyhedra.

Formalization targets

Goal: Theorem 4.10

If TTT is fixed and ξ\xiξ satisfies the weak covariance condition, then

K2={x∈Rn∣Gx≥α}for some finite system G,α,K_2 = \{x \in \mathbb{R}^n \mid Gx \ge \alpha\} \quad \text{for some finite system } G, \alpha,K2​={x∈Rn∣Gx≥α}for some finite system G,α,

so K2K_2K2​ is a closed convex polyhedron. The number of inequalities is not fixed in advance, and K2K_2K2​ may be empty.

Milestones

  1. Theorem 4.1. Under weak covariance, K2μ=K2p=K2sK_2^\mu = K_2^p = K_2^sK2μ​=K2p​=K2s​.
  2. Corollary 4.5. Under weak covariance, K2=K2p=K2μ=K2sK_2 = K_2^p = K_2^\mu = K_2^sK2​=K2p​=K2μ​=K2s​.
  3. Theorem 4.6. For every set Σ\SigmaΣ with the same closed positive hull as Ξ~p,T\tilde\Xi_{p,T}Ξ~p,T​, K2=⋂ζ∈ΣK2(ζ)K_2 = \bigcap_{\zeta \in \Sigma} K_2(\zeta)K2​=⋂ζ∈Σ​K2​(ζ).
  4. Theorem 4.7. K2K_2K2​ is closed and convex; if the closed positive hull pos⁡(Ξ~p,T)\operatorname{pos}(\tilde\Xi_{p,T})pos(Ξ~p,T​) is a convex polyhedral cone, K2K_2K2​ is a convex polyhedron.

Significance

Theorem 4.1 and Corollary 4.5 show that three different notions of second-stage feasibility (almost sure, on the support, finite expected cost) coincide, and that feasibility depends only on the distribution of (p,T)(p, T)(p,T). This justifies computing the feasibility region from the support alone, which is what feasibility-cut algorithms do. Theorem 4.7 guarantees that the deterministic equivalent program is a convex program over a closed convex set, with no moment condition. Theorem 4.10 shows that with a fixed technology matrix the induced constraints are finitely many linear inequalities, even when p(ξ)p(\xi)p(ξ) has an unbounded continuous distribution, so the deterministic equivalent program has a polyhedral feasible region.

The results are classical and proved in the paper. None of them is formalized on Prove2Me for a general distribution. The platform has the finite-scenario analogue of Theorem 4.7's first part, StochasticProg.Recourse.thm5a_K2_closed_convex (Birge and Louveaux, Ch. 3, Thm 5(a)), for finitely many scenarios; it is related work, not a special case in the Lean sense, because its model differs. The mission produces a machine-checked account of the measure-theoretic part (supports, pushforwards, an extended-valued integral with a nonstandard convention) and of the polyhedral part (Minkowski–Weyl for cones).

Difficulty

Two steps resist the obvious approach. First, K2p⊆K2sK_2^p \subseteq K_2^sK2p​⊆K2s​ needs an integrable upper bound for the positive part of Q(x,⋅)Q(x,\cdot)Q(x,⋅) on the whole support. QQQ is only piecewise linear in ξ\xiξ, can equal −∞-\infty−∞, and qqq, ppp, TTT are not assumed integrable separately, so no single dominating function is at hand; only the products controlled by the weak covariance condition are integrable. Second, Theorem 4.10 intersects infinitely many polyhedra K2(ζ)K_2(\zeta)K2​(ζ), and an infinite intersection of polyhedra is in general only closed and convex (Theorem 4.7). Showing that finitely many inequalities suffice without any assumption on the shape of the support of ppp is the content of the goal, and the resulting system may be inconsistent, in which case K2=∅K_2 = \emptysetK2​=∅.

Formalization scope

Vectors are Fin k → ℝ and matrices are Matrix (Fin m) (Fin n) ℝ; the paper's row vectors and suppressed transposes become Matrix.mulVec. The data space is Rn×Rnˉ×Rmˉ×Rmˉ×n\mathbb{R}^n \times \mathbb{R}^{\bar n} \times \mathbb{R}^{\bar m} \times \mathbb{R}^{\bar m \times n}Rn×Rnˉ×Rmˉ×Rmˉ×n with its Borel structure, and μ\muμ is a probability measure on the whole space (the paper's sample space Ξ\XiΞ only carries μ\muμ). Readings fixed by the formalization:

  • "has first moments" (Def. 2.2) is Integrable with respect to μ\muμ.
  • The integral is the paper's: two lower Lebesgue integrals, returning +∞+\infty+∞ whenever the positive part diverges. Mathlib's EReal subtraction (⊤−⊤=⊥\top - \top = \bot⊤−⊤=⊥) and the Bochner integral of toReal (zero for non-integrable functions) would both make K2sK_2^sK2s​ wrong and are not used.
  • "support" is Mathlib's Measure.support; Ξ~p,T\tilde\Xi_{p,T}Ξ~p,T​ is the support of the pushforward under the (continuous, hence measurable) projection onto (p,T)(p,T)(p,T).
  • "TTT is fixed" means T(ξ)=T0T(\xi) = T_0T(ξ)=T0​ with probability one, a weaker hypothesis than pointwise constancy.
  • "convex polyhedron" is the solution set of finitely many weak linear inequalities, the number of them existentially quantified; "convex polyhedral cone" is the conic hull of finitely many vectors; "closed positive hull" is the closure of the conic hull.
  • Full row rank of WWW is the paper's standing assumption (p. 312) and is carried as a hypothesis of Theorem 4.1, Corollary 4.5 and Theorem 4.10; it is inessential for them.
  • Theorem 4.6 is stated as "for every Σ\SigmaΣ with the same closed positive hull as Ξ~p,T\tilde\Xi_{p,T}Ξ~p,T​". The literal statement fails: a closed half-plane has no extreme points, so the "inverse of convex closure" would give Σ=∅\Sigma = \emptysetΣ=∅ and an intersection equal to Rn\mathbb{R}^nRn.
  • The set on p. 314 (iii) is printed K2pK_2^pK2p​.

A trivializing formalization is ruled out: a polyhedron indexed by an arbitrary type or by the support would make Theorem 4.10 a restatement of the first part of Theorem 4.7, and a Bochner-integral Q\mathcal QQ would make K2s=RnK_2^s = \mathbb{R}^nK2s​=Rn. Neither is used.

A complete development needs Minkowski–Weyl for finitely generated cones (available in Mathlib as PointedCone.FG / DualFG), closedness of finitely generated cones, supports of pushforward measures, and simplicial covers of pos⁡W\operatorname{pos} WposW (Carathéodory). The support and integral lemmas are reusable for every result about recourse functions with general distributions; contributions of such lemmas as separate theorems are welcome.

Selected references

  • R. J.-B. Wets, Stochastic Programs with Fixed Recourse: The Equivalent Deterministic Program, SIAM Review 16(3):309–339, 1974. https://doi.org/10.1137/1016053
  • R. M. Van Slyke and R. J.-B. Wets, L-Shaped Linear Programs with Applications to Optimal Control and Stochastic Programming, SIAM J. Appl. Math. 17(4):638–663, 1969. https://doi.org/10.1137/0117061
  • D. W. Walkup and R. J.-B. Wets, Stochastic Programs with Recourse, SIAM J. Appl. Math. 15(5):1299–1314, 1967. https://doi.org/10.1137/0115113
  • G. B. Dantzig, Linear Programming under Uncertainty, Management Science 1(3–4):197–206, 1955. https://doi.org/10.1287/mnsc.1.3-4.197
  • J. R. Birge and F. Louveaux, Introduction to Stochastic Programming, 2nd ed., Springer, 2011, Ch. 3. https://doi.org/10.1007/978-1-4614-0237-4
8 thms2 active usersReviewed
🏆Completed
Convex OptimizationOperations ResearchOptimization+1·Captain: mikedeng1

Stochastic Programs with Fixed Recourse: The Equivalent Deterministic Program II: Stability of the Deterministic Equivalent Convex ProgramResearch Paper

Motivation

A two-stage stochastic linear program with fixed recourse chooses a first-stage decision xxx before a random vector ξ\xiξ is observed, and then pays for a cheapest corrective action yyy once ξ\xiξ is known. It is the basic model of planning under uncertainty in operations research: capacity expansion, production planning with random demand, and energy dispatch are all written in this form, and every decomposition algorithm of the field (L-shaped, stochastic decomposition, progressive hedging) works on it.

Roger J.-B. Wets' survey Stochastic Programs with Fixed Recourse: The Equivalent Deterministic Program (SIAM Review, 1974) collected the structural theory of this model: where the problem is feasible (§4), what the expected cost looks like as a function of xxx (§7), and when the resulting convex program is well behaved (§8). This mission formalizes the second chain, from the polyhedral structure of the recourse function to the stability of the deterministic equivalent program: the existence of an optimal Lagrange multiplier for the first-stage constraints. Stability is what makes the optimal value react at a bounded rate to perturbations of the first-stage right-hand side, and it is the hypothesis under which dual and decomposition methods have something to converge to.

Setting

The data are a random element ξ=(c,q,p,T)\xi=(c,q,p,T)ξ=(c,q,p,T) with c∈Rnc\in\mathbb R^nc∈Rn, q∈Rnˉq\in\mathbb R^{\bar n}q∈Rnˉ, p∈Rmˉp\in\mathbb R^{\bar m}p∈Rmˉ and TTT an mˉ×n\bar m\times nmˉ×n matrix, distributed according to a probability measure μ\muμ. The recourse matrix WWW (mˉ×nˉ\bar m\times\bar nmˉ×nˉ), the first-stage matrix AAA (m×nm\times nm×n) and b∈Rmb\in\mathbb R^mb∈Rm are fixed. The recourse function is

Q(x,ξ)=min⁡{q(ξ)y∣Wy=p(ξ)−T(ξ)x, y≥0},Q(x,\xi)=\min\{q(\xi)y \mid Wy=p(\xi)-T(\xi)x,\ y\ge0\},Q(x,ξ)=min{q(ξ)y∣Wy=p(ξ)−T(ξ)x, y≥0},

equal to +∞+\infty+∞ if the second-stage program is infeasible and −∞-\infty−∞ if it is unbounded.

The weak covariance condition (Definition 2.2) requires cjc_jcj​, qjpiq_jp_iqj​pi​ and qjtikq_jt_{ik}qj​tik​ to be integrable for all indices; it does not require qqq, ppp or TTT themselves to be integrable. The paper also assumes throughout that WWW has full row rank (p. 312).

Expectations use the paper's integral: positive part minus negative part, with each part infinite if its integral diverges or the integrand is infinite on a set of positive measure, and (+∞)+(−∞)=+∞(+\infty)+(-\infty)=+\infty(+∞)+(−∞)=+∞. The expected recourse is Q(x)=Eξ{Q(x,ξ)}\mathcal Q(x)=E_\xi\{Q(x,\xi)\}Q(x)=Eξ​{Q(x,ξ)} and the objective is

Z(x)=cˉ x+Q(x),cˉ=Eξ{c(ξ)}.Z(x)=\bar c\,x+\mathcal Q(x),\qquad \bar c=E_\xi\{c(\xi)\}.Z(x)=cˉx+Q(x),cˉ=Eξ​{c(ξ)}.

The induced constraints are K2=⋂ζ∈Ξ~p,T{x:p−Tx∈pos⁡W}K_2=\bigcap_{\zeta\in\tilde\Xi_{p,T}}\{x : p-Tx\in\operatorname{pos}W\}K2​=⋂ζ∈Ξ~p,T​​{x:p−Tx∈posW}, where pos⁡W={Wy:y≥0}\operatorname{pos}W=\{Wy:y\ge0\}posW={Wy:y≥0} and Ξ~p,T\tilde\Xi_{p,T}Ξ~p,T​ is the support of the distribution of (p,T)(p,T)(p,T). The fixed constraints are K1={x:Ax=b, x≥0}K_1=\{x: Ax=b,\ x\ge0\}K1​={x:Ax=b, x≥0}, and K=K1∩K2K=K_1\cap K_2K=K1​∩K2​. The deterministic equivalent program (8.2) is to minimize ZZZ over KKK.

A convex program of the form min⁡{f(x):Ax=b, x≥0, x∈D}\min\{f(x) : Ax=b,\ x\ge0,\ x\in D\}min{f(x):Ax=b, x≥0, x∈D} with finite value vvv is stable (Definition 8.1(iv)) if there is π∈Rm\pi\in\mathbb R^mπ∈Rm with v≤f(x)+π(b−Ax)v\le f(x)+\pi(b-Ax)v≤f(x)+π(b−Ax) for all x∈Dx\in Dx∈D, x≥0x\ge0x≥0. Equivalently, the dual obtained by perturbing bbb is solvable and has no duality gap.

Formalization targets

Goal: Theorem 8.11 (p. 337)

If the weak covariance condition holds, WWW has full row rank, K2K_2K2​ is a polyhedron and the program is finite, v=inf⁡KZ∈Rv=\inf_K Z\in\mathbb Rv=infK​Z∈R, then

∃ π∈Rm:v≤Z(x)+π (b−Ax)for all x∈K2, x≥0.\exists\,\pi\in\mathbb R^m:\quad v\le Z(x)+\pi\,(b-Ax)\quad\text{for all }x\in K_2,\ x\ge0 .∃π∈Rm:v≤Z(x)+π(b−Ax)for all x∈K2​, x≥0.

Milestones

  1. Corollary 7.3 (p. 328). The value t↦min⁡{cx∣Ax=t, x≥0}t\mapsto\min\{cx\mid Ax=t,\ x\ge0\}t↦min{cx∣Ax=t, x≥0} is a finite maximum of affine functions on pos⁡A\operatorname{pos}AposA, or −∞-\infty−∞ on all of pos⁡A\operatorname{pos}AposA.
  2. Proposition 7.5 (p. 329). Q(x,ξ)Q(x,\xi)Q(x,ξ) is convex polyhedral in xxx on K2K_2K2​ for each ξ\xiξ in the support, concave polyhedral in qqq, and convex polyhedral in (p,T)(p,T)(p,T).
  3. Theorem 7.6 (p. 329). ZZZ is convex on KKK, and it is either finite on KKK or identically −∞-\infty−∞ on KKK.
  4. Theorem 7.7 (pp. 329–330). If Z>−∞Z>-\inftyZ>−∞ on KKK, then ∣Z(x)−Z(x0)∣≤Bˉ∥x−x0∥|Z(x)-Z(x^0)|\le\bar B\|x-x^0\|∣Z(x)−Z(x0)∣≤Bˉ∥x−x0∥ on KKK (Euclidean norm).
  5. Lemma 8.9 (p. 337). A finite program min⁡{f(x):Ax=b, x≥0}\min\{f(x): Ax=b,\ x\ge0\}min{f(x):Ax=b, x≥0} whose objective is convex and Lipschitz on a polyhedral domain is stable.

Significance

Stability of (8.2) is the regularity property that the dual and sensitivity theory of two-stage programs relies on. It gives a finite Lagrange multiplier for the first-stage constraints, a supporting hyperplane of the perturbation function ϕ(u)=inf⁡{Z(x):Ax=b−u, x∈K2∩R+n}\phi(u)=\inf\{Z(x) : Ax=b-u,\ x\in K_2\cap\mathbb R^n_+\}ϕ(u)=inf{Z(x):Ax=b−u, x∈K2​∩R+n​} at u=0u=0u=0, and hence a bounded rate of change of the optimal value under perturbations of bbb. The route through Theorems 7.6 and 7.7 also yields facts that are used on their own: the objective is a convex function that is either finite or identically −∞-\infty−∞ on the feasible region, and it is Lipschitz with a constant controlled by the weak covariance moments.

The results have been proved since 1974, and Lemma 8.9 is cited there to Walkup and Wets (1969). As far as the platform's catalog shows, none of them is formalized for a general distribution. The platform has finite-scenario versions of related facts from Birge and Louveaux's textbook, Chapter 3: StochasticProg.Recourse.thm6a_Q_lipschitz_convex_finite (the expected recourse is finite, convex and Lipschitz on K2K_2K2​ for finitely many scenarios) and StochasticProg.Recourse.thm5a_K2_closed_convex. A complete development would supply the general-distribution versions, with the paper's own extended integral.

Difficulty

The obvious argument for Theorem 7.7 integrates a pointwise Lipschitz constant of Q(⋅,ξ)Q(\cdot,\xi)Q(⋅,ξ). It fails unless that constant is integrable, and the weak covariance condition, not integrability of ξ\xiξ, is what has to deliver this, uniformly over the finitely many second-stage bases.

For the goal, convexity and finiteness of the program are not enough. The paper's Example 8.5 has a finite convex deterministic equivalent with an infinite duality gap, and the counterexample under Formalization scope has a finite value and no multiplier. When the domain of ZZZ has curved boundary, the perturbation function can have infinite slope at 000; the polyhedral hypothesis on K2K_2K2​ is what excludes this.

Formalization scope

  • Types. Vectors are Fin n → ℝ; matrices are Matrix (Fin _) (Fin _) ℝ; row vectors of the paper (ccc, qqq, π\piπ) enter through dotProduct. The law μ\muμ is a probability measure on (Fin n → ℝ) × (Fin n̄ → ℝ) × (Fin m̄ → ℝ) × (Fin m̄ → Fin n → ℝ). QQQ is the platform definition KallMayer.Recourse.PointwiseRecourse, an EReal-valued infimum. Supports are MeasureTheory.Measure.support.
  • The integral. Q\mathcal QQ is written as lintegral of the positive part minus lintegral of the negative part, with +∞+\infty+∞ whenever the positive part is +∞+\infty+∞. This is the paper's (+∞)+(−∞)=+∞(+\infty)+(-\infty)=+\infty(+∞)+(−∞)=+∞; Mathlib's EReal subtraction resolves the other way. A Bochner integral of toReal would be 000 for non-integrable integrands and make every expected-cost statement trivial, and it is not used. cˉ\bar ccˉ is a Bochner integral, legitimate because Definition 2.2 makes each cjc_jcj​ integrable.
  • Readings of informal words.
    • "Has first moments" is Integrable.
    • "Convex polyhedron" means finitely many weak linear inequalities; ∅\emptyset∅ and Rn\mathbb R^nRn are included.
    • "Finite convex (concave) polyhedral function on SSS" means equal on SSS to the maximum (minimum) of finitely many affine functions. The xxx and (p,T)(p,T)(p,T) parts of Proposition 7.5 are stated as a dichotomy with the identically −∞-\infty−∞ case; the qqq part is stated, as Corollary 7.4 gives it, as finite concave polyhedral on pos⁡(WT,−WT,I)\operatorname{pos}(W^T,-W^T,I)pos(WT,−WT,I) when the recourse problem is feasible.
    • "Convex" for the extended-real ZZZ (Theorem 7.6) is ConvexOn of toReal on the finite branch.
    • "Bounded on KKK" (Theorem 7.7) is read as Z>−∞Z>-\inftyZ>−∞ on KKK, the proof's own reading. Finiteness on KKK is part of the conclusion.
    • "Convex and Lipschitz on a polyhedron" (Lemma 8.9) means the objective's domain is the polyhedron.
    • "The program is finite" means the infimum over KKK is a real number.
    • "Stable" is the Kuhn–Tucker form above: a multiplier compared against the primal value, not merely a solvable dual. The latter would allow a duality gap.
  • Standing assumptions. Full row rank of WWW appears in Theorems 7.7 and 8.11, where the proof uses square nonsingular submatrices of WWW. It is omitted from Theorem 7.6 and Corollary 7.3 (Theorem 7.2's rank assumption), where it is not needed; this makes those statements stronger.
  • Corrections to the page. Theorem 8.11 is printed with "KKK is polyhedral", K=K1∩K2K=K_1\cap K_2K=K1​∩K2​, and read literally it is false. Take T(ξ)T(\xi)T(ξ) uniform on the unit circle, p≡1p\equiv1p≡1, W=(1)W=(1)W=(1), q≡0q\equiv0q≡0, c≡(−1,0)c\equiv(-1,0)c≡(−1,0) and K1={x2=1, x≥0}K_1=\{x_2=1,\ x\ge0\}K1​={x2​=1, x≥0}. Then K2K_2K2​ is the unit disk and K={(0,1)}K=\{(0,1)\}K={(0,1)} is polyhedral with finite value 000, but no multiplier exists. The goal therefore assumes "K2K_2K2​ is polyhedral", as the sentence before Lemma 8.9 and the proof require. In the dual (8.3) the page writes ccc for cˉ\bar ccˉ.
  • Ruled out. A statement of stability as "the dual supremum is attained" without equality to the primal value is not the goal, and neither is a hypothesis making KKK empty or ZZZ identically −∞-\infty−∞: the finiteness hypothesis excludes both.
  • Infrastructure. The needed pieces are Minkowski–Weyl for polyhedra (PointedCone.FG/DualFG in Mathlib), LP duality with ±∞\pm\infty±∞ values, the paper's extended integral, and a Kuhn–Tucker theorem for convex programs with polyhedral constraints (Rockafellar, Convex Analysis, Thm 28.2). Corollary 7.3 and Lemma 8.9 contain no probability and are reusable across convex analysis. Proofs of any milestone, and lemmas on the paper's extended integral (monotonicity, subadditivity), are welcome.

Selected references

  • R. J.-B. Wets, Stochastic Programs with Fixed Recourse: The Equivalent Deterministic Program, SIAM Review 16(3):309–339, 1974. https://doi.org/10.1137/1016053
  • D. W. Walkup and R. J.-B. Wets, Stochastic programs with recourse, SIAM J. Appl. Math. 15(5):1299–1314, 1967. https://doi.org/10.1137/0115113
  • R. M. Van Slyke and R. J.-B. Wets, A duality theory for abstract mathematical programs with applications to optimal control theory, J. Math. Anal. Appl. 22(3):679–706, 1968 (cited by Wets for Definition 8.1 and the dual (8.3)).
  • R. T. Rockafellar, Convex Analysis, Princeton University Press, 1970. https://doi.org/10.1515/9781400873173
  • J. R. Birge and F. Louveaux, Introduction to Stochastic Programming, 2nd ed., Springer, 2011, Chapter 3. https://doi.org/10.1007/978-1-4614-0237-4
10 thms2 active usersReviewed
🏆Completed
Machine LearningOperations ResearchProbability+1·Captain: mikedeng1

Robustness and Generalization I: A Generalization Bound for Robust AlgorithmsResearch Paper

Why algorithmic robustness

A learning algorithm maps a training set to a hypothesis. It generalizes when the loss it incurs on the training set is close to its expected loss on fresh data. The classical way to certify this bounds the complexity of the whole hypothesis class the algorithm may output, through its VC dimension, covering numbers or Rademacher complexity. A second approach, algorithmic stability (Bousquet and Elisseeff 2002), looks instead at how the output changes when one training point is replaced.

Huan Xu and Shie Mannor proposed a third notion, algorithmic robustness. An algorithm is robust if the sample space can be cut into finitely many cells such that a test point falling in the same cell as a training point incurs nearly the same loss as that training point. The notion came out of their earlier analyses of support vector machines and the Lasso as robust optimization problems (Xu, Caramanis and Mannor 2009). The conference version appeared at COLT 2010, and the journal version, which this mission follows, is Xu and Mannor, Machine Learning 86 (2012) 391–423.

Robustness is a property of the algorithm and not of its hypothesis class, so it applies to algorithms whose class has infinite VC dimension. The paper's main result for i.i.d. data is Theorem 1 (p. 396). This mission formalizes Theorem 1 together with the steps of its proof.

Setting

Throughout, Z\mathcal ZZ is a measurable space of samples and H\mathcal HH is an arbitrary set of hypotheses. A loss l:H×Z→Rl : \mathcal H \times \mathcal Z \to \mathbb Rl:H×Z→R satisfies 0≤l(h,z)≤M0 \le l(h,z) \le M0≤l(h,z)≤M for a constant MMM. A training set is s=(s1,…,sn)∈Zn\mathbf s = (s_1, \dots, s_n) \in \mathcal Z^ns=(s1​,…,sn​)∈Zn, and a learning algorithm is a map A:Zn→H\mathcal A : \mathcal Z^n \to \mathcal HA:Zn→H, written s↦As\mathbf s \mapsto \mathcal A_{\mathbf s}s↦As​.

For a probability measure μ\muμ on Z\mathcal ZZ, the expected error and the training error of the learned hypothesis are

L(As)=Ez∼μ l(As,z),lemp(As)=1n∑i=1nl(As,si).\mathcal L(\mathcal A_{\mathbf s}) = \mathbb E_{z\sim\mu}\, l(\mathcal A_{\mathbf s}, z), \qquad l_{\mathrm{emp}}(\mathcal A_{\mathbf s}) = \frac1n \sum_{i=1}^n l(\mathcal A_{\mathbf s}, s_i).L(As​)=Ez∼μ​l(As​,z),lemp​(As​)=n1​i=1∑n​l(As​,si​).

Definition 2 (p. 396). For K∈NK \in \mathbb NK∈N and ϵ(⋅):Zn→R\epsilon(\cdot) : \mathcal Z^n \to \mathbb Rϵ(⋅):Zn→R, the algorithm A\mathcal AA is (K,ϵ(⋅))(K, \epsilon(\cdot))(K,ϵ(⋅))-robust if Z\mathcal ZZ can be partitioned into KKK disjoint sets C1,…,CKC_1, \dots, C_KC1​,…,CK​ such that for every s∈Zn\mathbf s \in \mathcal Z^ns∈Zn,

∀s∈s, ∀z∈Z, ∀i:s,z∈Ci  ⟹  ∣l(As,s)−l(As,z)∣≤ϵ(s).\forall s \in \mathbf s,\ \forall z \in \mathcal Z,\ \forall i:\quad s, z \in C_i \implies |l(\mathcal A_{\mathbf s}, s) - l(\mathcal A_{\mathbf s}, z)| \le \epsilon(\mathbf s).∀s∈s, ∀z∈Z, ∀i:s,z∈Ci​⟹∣l(As​,s)−l(As​,z)∣≤ϵ(s).

The partition is chosen once, before the training set. Only the tolerance ϵ(s)\epsilon(\mathbf s)ϵ(s) may depend on s\mathbf ss.

For a partition C1,…,CKC_1,\dots,C_KC1​,…,CK​, the cell count ∣Ni∣|N_i|∣Ni​∣ is the number of training points in CiC_iCi​. The Lean development uses expectedLoss, empiricalLoss, cellCount and IsRobust in the namespace XuMannorRobust.Standard.

Formalization targets

Goal: Theorem 1 (p. 396)

Let A\mathcal AA be (K,ϵ(⋅))(K,\epsilon(\cdot))(K,ϵ(⋅))-robust and let s\mathbf ss consist of n≥1n \ge 1n≥1 i.i.d. draws from μ\muμ. Then for every δ>0\delta > 0δ>0, with probability at least 1−δ1-\delta1−δ,

∣L(As)−lemp(As)∣≤ϵ(s)+M2Kln⁡2+2ln⁡(1/δ)n.|\mathcal L(\mathcal A_{\mathbf s}) - l_{\mathrm{emp}}(\mathcal A_{\mathbf s})| \le \epsilon(\mathbf s) + M\sqrt{\frac{2K\ln 2 + 2\ln(1/\delta)}{n}}.∣L(As​)−lemp​(As​)∣≤ϵ(s)+Mn2Kln2+2ln(1/δ)​​.

The constants are the paper's and are kept as printed. KKK, ϵ(⋅)\epsilon(\cdot)ϵ(⋅), MMM, nnn, δ\deltaδ, μ\muμ and the algorithm are all universally quantified.

Milestones (proof of Theorem 1, pp. 396–397)

  1. Bretagnolle–Huber–Carol inequality for the multinomial vector of cell counts. For every λ≥0\lambda \ge 0λ≥0,
Pr⁡{∑i=1K∣∣Ni∣n−μ(Ci)∣≥λ}≤2Kexp⁡(−nλ22).\Pr\Big\{\sum_{i=1}^K \Big|\frac{|N_i|}{n} - \mu(C_i)\Big| \ge \lambda\Big\} \le 2^K \exp\Big(\frac{-n\lambda^2}{2}\Big).Pr{i=1∑K​​n∣Ni​∣​−μ(Ci​)​≥λ}≤2Kexp(2−nλ2​).
  1. Eq. (3). With probability at least 1−δ1-\delta1−δ,
∑i=1K∣∣Ni∣n−μ(Ci)∣≤2Kln⁡2+2ln⁡(1/δ)n.\sum_{i=1}^K \Big|\frac{|N_i|}{n} - \mu(C_i)\Big| \le \sqrt{\frac{2K\ln 2 + 2\ln(1/\delta)}{n}}.i=1∑K​​n∣Ni​∣​−μ(Ci​)​≤n2Kln2+2ln(1/δ)​​.
  1. Eq. (4). For a partition witnessing robustness and for every training set s\mathbf ss, deterministically,
∣L(As)−lemp(As)∣≤ϵ(s)+M∑i=1K∣∣Ni∣n−μ(Ci)∣.|\mathcal L(\mathcal A_{\mathbf s}) - l_{\mathrm{emp}}(\mathcal A_{\mathbf s})| \le \epsilon(\mathbf s) + M\sum_{i=1}^K \Big|\frac{|N_i|}{n} - \mu(C_i)\Big|.∣L(As​)−lemp​(As​)∣≤ϵ(s)+Mi=1∑K​​n∣Ni​∣​−μ(Ci​)​.

Significance

Theorem 1 is the base result of the robustness framework. The later results of the same paper are extensions of it:

  • Corollary 1: an adaptive number of cells;
  • Corollaries 2 and 3: covering-number instances;
  • Theorem 4: a pseudo-robust version;
  • the Markovian case.

Its complexity term depends only on the number of cells KKK, not on any capacity measure of H\mathcal HH. This is why it gives bounds for algorithms such as support vector machines, Lasso, feed-forward networks and principal component analysis (Sect. 6 of the paper). For those, KKK is a covering number of the sample space. Section 8 of the paper shows that a weak form of robustness is also necessary for generalization.

Theorem 1 is a published result with a short proof. What a formalization adds:

  • a machine-checked statement of the robustness notion, pinning down which quantifier comes first;
  • a formal proof of the multinomial concentration step, which the paper takes from van der Vaart and Wellner rather than proving;
  • a reusable interface for the covering-number examples.

A search of the platform (2026-09-26) found no formal statement of Theorem 1, Definition 2, or the Bretagnolle–Huber–Carol inequality for multinomial vectors. Hoeffding's inequality is already available there in proved form.

Difficulty

The deterministic step, Eq. (4), splits the expected loss over the cells. It then compares the loss within each cell with the loss at the training points in that cell. This needs integration over a partition and some care with cells of μ\muμ-measure zero, where the conditional expectation in the paper's chain is undefined.

The main obstacle is the probabilistic step. The quantity ∑i∣∣Ni∣/n−μ(Ci)∣\sum_i ||N_i|/n - \mu(C_i)|∑i​∣∣Ni​∣/n−μ(Ci​)∣ is an ℓ1\ell_1ℓ1​ deviation of a multinomial vector. A coordinate-wise Hoeffding bound followed by a union bound over the KKK coordinates gives a bound whose deviation level grows linearly in KKK. That is not 2Ke−nλ2/22^K e^{-n\lambda^2/2}2Ke−nλ2/2, and it does not give the constant 2Kln⁡2\sqrt{2K\ln 2}2Kln2​ of Theorem 1. The difficulty is to obtain the exact exponential rate 2Ke−nλ2/22^K e^{-n\lambda^2/2}2Ke−nλ2/2 for the ℓ1\ell_1ℓ1​ deviation as a whole, with no loss in the constant.

Formalization scope

Samples are a type Z with a MeasurableSpace, training sets are Fin n → Z, the algorithm is a function (Fin n → Z) → H, and the loss is H → Z → ℝ. The partition is a family C : Fin K → Set Z that is pairwise disjoint, measurable, and covers Z. Empty cells are allowed, as in the paper. The i.i.d. sample law is Measure.pi (fun _ => μ) with μ a probability measure, and μ(Ci)\mu(C_i)μ(Ci​) enters as a real number.

"With probability at least 1−δ1-\delta1−δ" is encoded as an upper bound δ\deltaδ on the outer measure, under μn\mu^nμn, of the set of training sets where the inequality fails. This needs no measurability of s↦As\mathbf s \mapsto \mathcal A_{\mathbf s}s↦As​.

The paper ignores measurability. The formalization restores it: every l(h,⋅)l(h,\cdot)l(h,⋅) is measurable and every cell is a measurable set. Together with 0≤l≤M0 \le l \le M0≤l≤M this makes the expected error a genuine expectation.

The theorems assume n≥1n \ge 1n≥1. The Bretagnolle–Huber–Carol step assumes λ≥0\lambda \ge 0λ≥0, because the printed inequality is false for λ<0\lambda < 0λ<0. No upper bound on δ\deltaδ is imposed: for δ>2K\delta > 2^Kδ>2K the radicand is negative, the square root evaluates to 000, and the statements remain true.

Two trivializing readings of Definition 2 are ruled out:

  • The partition may not depend on the training set. In IsRobust the existential over the partition precedes the universal over training sets. If the order were swapped, every algorithm with a {0,1}\{0,1\}{0,1}-valued loss would be (2,0)(2,0)(2,0)-robust, since it could take the two level sets of its own learned loss as cells. Theorem 1 would then fail for a memorizing classifier.
  • The tolerance may not depend on the test point, and the condition is required for every z∈Zz \in \mathcal Zz∈Z, not only for zzz equal to a training point.

Beyond the paper's text, a complete development needs the integral over a finite measurable partition, a Hoeffding bound for indicator averages, and a union bound over the subsets of Fin K. The multinomial concentration inequality is reusable beyond this mission, in histogram estimators, discretization arguments and the covering-number examples of the paper. Contributions are welcome at every level: proofs of the milestones, and alternative proofs of the Bretagnolle–Huber–Carol step (for instance via the method of types).

Selected references

  • H. Xu and S. Mannor, Robustness and Generalization, Machine Learning 86 (2012) 391–423. https://doi.org/10.1007/s10994-011-5268-1
  • A. W. van der Vaart and J. A. Wellner, Weak Convergence and Empirical Processes, Springer, 1996 (Proposition A.6.6). https://doi.org/10.1007/978-1-4757-2545-2
  • O. Bousquet and A. Elisseeff, Stability and Generalization, Journal of Machine Learning Research 2 (2002) 499–526. https://www.jmlr.org/papers/v2/bousquet02a.html
  • H. Xu, C. Caramanis and S. Mannor, Robustness and Regularization of Support Vector Machines, Journal of Machine Learning Research 10 (2009) 1485–1510. https://www.jmlr.org/papers/v10/xu09b.html
  • W. Hoeffding, Probability Inequalities for Sums of Bounded Random Variables, Journal of the American Statistical Association 58 (1963) 13–30. https://doi.org/10.1080/01621459.1963.10500830
7 thms2 active usersReviewed
🏆Completed
CombinatoricsOperations ResearchOptimization·Captain: mikedeng1

Optimal Two- and Three-Stage Production Schedules with Setup Times Included 2: Johnson's Rule for Three MachinesResearch Paper

Motivation

Johnson's 1954 paper in Naval Research Logistics Quarterly is the starting point of machine scheduling theory. Its first section solves the two-machine flow shop: nnn items must pass through machine 1 and then machine 2, and an explicit ordering rule minimizes the total elapsed time. Its second section treats three machines. There the problem "loses some of the nice structure of the two-stage case" (p. 65), and the general three-machine problem was later shown to be strongly NP-hard (Garey, Johnson and Sethi, 1976). Johnson nevertheless identifies a restricted case, in which the middle machine is dominated by the first (or the last), where the two-machine rule still gives an optimal schedule. That case, and the structural facts behind it, are the content of this mission.

The three-machine results are still the reference point for polynomially solvable flow shops and for lower bounds in branch-and-bound methods for the general problem.

Timeline.

  • 1954: Johnson proves the two-machine rule (Theorem 1) and, for three machines, the reduction to a common ordering (Lemma 3), a closed form for the elapsed time, and optimality of the rule on Ai+BiA_i + B_iAi​+Bi​, Bi+CiB_i + C_iBi​+Ci​ when min⁡Ai≥max⁡Bj\min A_i \ge \max B_jminAi​≥maxBj​ (Theorem 2), with the mirror case min⁡Ci≥max⁡Bj\min C_i \ge \max B_jminCi​≥maxBj​ asserted.
  • 1976: Garey, Johnson and Sethi show that minimizing makespan in a three-machine flow shop is strongly NP-hard in general, so some restriction of Theorem 2's kind is unavoidable for an exact ordering rule.

Setting

There are nnn items and three machines. Item iii needs processing time Ai>0A_i > 0Ai​>0 on machine 1, Bi>0B_i > 0Bi​>0 on machine 2 and Ci>0C_i > 0Ci​>0 on machine 3, in that order. Each machine handles at most one item at a time, and processing is not interrupted.

A schedule assigns each item start times si1,si2,si3s^1_i, s^2_i, s^3_isi1​,si2​,si3​. It is feasible when all start times are at least 000 on machine 1, the processing intervals of distinct items on the same machine do not overlap, and si1+Ai≤si2s^1_i + A_i \le s^2_isi1​+Ai​≤si2​, si2+Bi≤si3s^2_i + B_i \le s^3_isi2​+Bi​≤si3​. The three machines may process the items in different orders. The total elapsed time (makespan) is max⁡i(si3+Ci)\max_i (s^3_i + C_i)maxi​(si3​+Ci​).

An ordering σ\sigmaσ lists the items, σ(k)\sigma(k)σ(k) being the item in position kkk. Its as-soon-as-possible schedule processes the items in the order σ\sigmaσ on every machine and starts each item on each machine as early as the rules allow. For an ordering, with positions 1,…,n1, \dots, n1,…,n, Johnson defines

Ku=∑i=1uAi−∑i=1u−1Bi,Hv=∑i=1vBi−∑i=1v−1Ci,K_u = \sum_{i=1}^{u} A_i - \sum_{i=1}^{u-1} B_i, \qquad H_v = \sum_{i=1}^{v} B_i - \sum_{i=1}^{v-1} C_i,Ku​=i=1∑u​Ai​−i=1∑u−1​Bi​,Hv​=i=1∑v​Bi​−i=1∑v−1​Ci​,

the sums running over the items in the first uuu (resp. vvv) positions.

Johnson's three-stage rule says that item iii definitely precedes item jjj when

min⁡(Ai+Bi, Cj+Bj)<min⁡(Aj+Bj, Ci+Bi)(IV)\min(A_i + B_i,\ C_j + B_j) < \min(A_j + B_j,\ C_i + B_i) \tag{IV}min(Ai​+Bi​, Cj​+Bj​)<min(Aj​+Bj​, Ci​+Bi​)(IV)

and calls them indifferent under equality. An ordering is consistent with (IV) when no item placed later is definitely preferred to an item placed earlier.

Formalization targets

Goal: Theorem 2 (p. 67)

If every AiA_iAi​ is at least every BjB_jBj​, then an ordering consistent with (IV) exists, and for every such ordering σ\sigmaσ the as-soon-as-possible schedule of σ\sigmaσ is feasible and satisfies

makespan⁡(as-soon-as-possible schedule of σ)≤makespan⁡(s)for every feasible schedule s.\operatorname{makespan}(\text{as-soon-as-possible schedule of } \sigma) \le \operatorname{makespan}(s) \quad \text{for every feasible schedule } s .makespan(as-soon-as-possible schedule of σ)≤makespan(s)for every feasible schedule s.

Milestones

  1. Lemma 3 (p. 65). Every feasible schedule is matched or beaten by the as-soon-as-possible schedule of some single ordering.
  2. Closed form (p. 66). For every ordering, the total idle time of machine 3 is ∑iYi=max⁡1≤u≤v≤n(Hv+Ku)\sum_i Y_i = \max_{1 \le u \le v \le n}(H_v + K_u)∑i​Yi​=max1≤u≤v≤n​(Hv​+Ku​), so that
makespan⁡=∑i=1nCi+max⁡1≤u≤v≤n(Ku+Hv),\operatorname{makespan} = \sum_{i=1}^{n} C_i + \max_{1 \le u \le v \le n} (K_u + H_v),makespan=i=1∑n​Ci​+1≤u≤v≤nmax​(Ku​+Hv​),

the "maximum walk" of p. 68. 3. Special case (p. 67). If min⁡Ai≥max⁡Bj\min A_i \ge \max B_jminAi​≥maxBj​ then max⁡u≤vKu=Kv\max_{u \le v} K_u = K_vmaxu≤v​Ku​=Kv​, so the makespan is ∑iCi+max⁡v(Hv+Kv)\sum_i C_i + \max_v (H_v + K_v)∑i​Ci​+maxv​(Hv​+Kv​). 4. (III) ⇔\Leftrightarrow⇔ (IV) (p. 67). Interchanging the items in positions j,j+1j, j+1j,j+1 changes HHH and KKK only at j,j+1j, j+1j,j+1, and the interchange is strictly worse for the diagonal terms exactly when (IV) holds. 5. Lemma 4 (p. 67). Relation (IV) is transitive, except when the middle item is indifferent to both others. 6. Mirror case (p. 68). The conclusion of Theorem 2 also holds when every CiC_iCi​ is at least every BjB_jBj​.

Significance

The result. Theorem 2 gives an O(nlog⁡n)O(n \log n)O(nlogn) exact method for a class of three-machine flow shops, in a problem that is strongly NP-hard in general. Lemma 3 says that, for three machines, permutation schedules are dominant; Johnson's example on p. 65 shows this fails for four machines. The closed form of milestone 2 expresses the makespan of any ordering as a longest path in a grid, the device behind most later flow-shop lower bounds.

Formalizing it. All results are proved on paper, some tersely: Lemma 3's proof is two lines and cites the wrong lemma, Lemma 4 is proved by reference to Lemma 2, and the mirror case is asserted without proof. A search of Mathlib and of the platform catalog found no machine-checked proof of any of them. The mission produces a checked account of the three-machine flow shop, including the comparison against all feasible schedules rather than only permutation schedules, and pins down the exact form of the hypotheses (see below).

Difficulty

The interchange argument of the two-machine case does not transfer directly. For a general ordering the makespan involves max⁡u≤v(Hv+Ku)\max_{u \le v}(H_v + K_u)maxu≤v​(Hv​+Ku​), and interchanging adjacent items changes terms that depend on everything placed earlier; the page notes that "the decision is not independent of what precedes the interchanged elements". The hypothesis min⁡A≥max⁡B\min A \ge \max BminA≥maxB is what makes KKK nondecreasing along the ordering, collapsing the double maximum to the diagonal. A second obstacle is that (IV) is not a total preorder: ties break transitivity, so passing from "no adjacent pair can be improved" to "optimal" needs the all-pairs consistency and the tie exception of Lemma 4. Finally, Lemma 3 is a statement about arbitrary start-time schedules, so the reduction to orderings must handle machines whose orders differ.

Formalization scope

Items are Fin n; processing times are real-valued functions A B C : Fin n → ℝ, assumed positive in each theorem that is about schedules (the paper's standing assumption, p. 61). A schedule is three start-time functions; feasibility is spelled out as above with non-overlap written as a disjunction of inequalities. The makespan is the maximum of the machine-3 completion times together with 000, so the empty instance has makespan 000. An ordering is an Equiv.Perm (Fin n) with σ k the item in position k; positions are 0-based, so the Lean K u, H v are the paper's Ku+1K_{u+1}Ku+1​, Hv+1H_{v+1}Hv+1​. Statements with maxima over positions assume n≥1n \ge 1n≥1.

Hypotheses made explicit or corrected:

  • min⁡Ai≥max⁡Bi\min A_i \ge \max B_iminAi​≥maxBi​ is read globally, Bj≤AiB_j \le A_iBj​≤Ai​ for all i,ji, ji,j, as in the section heading. The pointwise reading Bi≤AiB_i \le A_iBi​≤Ai​ makes Theorem 2 false (an instance with five items is recorded in the Formalization Note of the goal).
  • Consistency with (IV) is required for all pairs of positions, not only adjacent ones.
  • Lemma 4 carries Lemma 2's exception for an item indifferent to both others; without it the statement is false.
  • Lemma 3's proof cites "Lemma 2" where Lemma 1 is meant.
  • The interchange equivalence (milestone 4) is stated for arbitrary reals, which is stronger than the page needs.

Optimality in the goal is against every feasible schedule. A formalization that compares only orderings with each other, or that defines the objective as the closed form ∑C+max⁡(Ku+Hv)\sum C + \max(K_u + H_v)∑C+max(Ku​+Hv​), would drop Lemma 3's content and is ruled out: the makespan is the latest completion time of a start-time schedule. The existence clause keeps the optimality clause from being vacuous.

A complete development needs finite sums over initial segments of Fin n, Finset.sup', and permutation manipulations (adjacent transpositions, bubble-sort arguments). The feasibility model and the closed form are reusable for other flow-shop results; contributions of general lemmas on adjacent interchanges of permutations are welcome.

Selected references

  • S. M. Johnson, Optimal two- and three-stage production schedules with setup times included, Naval Research Logistics Quarterly 1(1):61–68, 1954. https://doi.org/10.1002/nav.3800010110
  • M. R. Garey, D. S. Johnson, R. Sethi, The complexity of flowshop and jobshop scheduling, Mathematics of Operations Research 1(2):117–129, 1976. https://doi.org/10.1287/moor.1.2.117
13 thms2 active usersReviewed
🏆Completed
Dynamic ProgrammingMachine LearningOperations Research+1·Captain: mikedeng1

Approximately Optimal Approximate Reinforcement Learning II: Near-Optimality of a Policy with Small Policy AdvantageResearch Paper

Motivation

Approximate policy iteration and policy-gradient methods stop when they can no longer find a direction of improvement. Kakade and Langford (ICML 2002) asked what such a stopping point guarantees. Their algorithm, conservative policy iteration, halts at a policy π\piπ for which no policy can improve much on π\piπ as measured under a restart distribution μ\muμ; the quantity that is small is the optimal policy advantage OPT(Aπ,μ)\mathrm{OPT}(\mathbb A_{\pi,\mu})OPT(Aπ,μ​). Theorem 6.2 of the paper translates this local condition into a global statement: the performance of π\piπ is close to optimal, with a loss controlled by how well μ\muμ covers the states an optimal policy visits.

The bound is the origin of the distribution mismatch coefficient ∥dπ∗,μ~/μ∥∞\|d_{\pi^*,\tilde\mu}/\mu\|_\infty∥dπ∗,μ~​​/μ∥∞​, which reappears in the analysis of approximate dynamic programming (concentrability coefficients, Munos 2003), of conservative and trust-region methods, and of the convergence of policy gradient methods (Agarwal, Kakade, Lee, Mahajan 2021), where it governs the rate. The performance difference lemma (Lemma 6.1) used in its proof has become a standard tool of reinforcement learning theory.

Setting

A finite Markov decision process has a finite nonempty state set SSS, a finite nonempty action set AAA, transition probabilities P(s′;s,a)P(s';s,a)P(s′;s,a) (for each s,as,as,a a probability distribution over s′s's′), a reward function R:S×A→[0,R]\mathcal R:S\times A\to[0,R]R:S×A→[0,R] with R>0R>0R>0, and a discount factor 0≤γ<10\le\gamma<10≤γ<1. A stochastic policy π(a;s)\pi(a;s)π(a;s) is, for each state sss, a probability distribution over actions. A state distribution is a probability vector μ\muμ on SSS.

The normalized value function is Vπ(s)=(1−γ)E[∑t≥0γtR(st,at)∣π,s]V_\pi(s)=(1-\gamma)E[\sum_{t\ge0}\gamma^t\mathcal R(s_t,a_t)\mid\pi,s]Vπ​(s)=(1−γ)E[∑t≥0​γtR(st​,at​)∣π,s], where s0=ss_0=ss0​=s, at∼π(⋅;st)a_t\sim\pi(\cdot;s_t)at​∼π(⋅;st​) and st+1∼P(⋅;st,at)s_{t+1}\sim P(\cdot;s_t,a_t)st+1​∼P(⋅;st​,at​). The state–action value is Qπ(s,a)=(1−γ)R(s,a)+γ∑s′P(s′;s,a)Vπ(s′)Q_\pi(s,a)=(1-\gamma)\mathcal R(s,a)+\gamma\sum_{s'}P(s';s,a)V_\pi(s')Qπ​(s,a)=(1−γ)R(s,a)+γ∑s′​P(s′;s,a)Vπ​(s′) and the advantage is Aπ(s,a)=Qπ(s,a)−Vπ(s)A_\pi(s,a)=Q_\pi(s,a)-V_\pi(s)Aπ​(s,a)=Qπ​(s,a)−Vπ​(s). The discounted future state distribution from μ\muμ is

dπ,μ(s)=(1−γ)∑t≥0γtPr⁡(st=s;π,μ),s0∼μ,d_{\pi,\mu}(s)=(1-\gamma)\sum_{t\ge0}\gamma^t\Pr(s_t=s;\pi,\mu),\qquad s_0\sim\mu,dπ,μ​(s)=(1−γ)t≥0∑​γtPr(st​=s;π,μ),s0​∼μ,

and the performance of π\piπ from μ\muμ is ημ(π)=∑sμ(s)Vπ(s)\eta_\mu(\pi)=\sum_s\mu(s)V_\pi(s)ημ​(π)=∑s​μ(s)Vπ​(s).

The policy advantage of π′\pi'π′ with respect to π\piπ and μ\muμ is Aπ,μ(π′)=∑sdπ,μ(s)∑aπ′(a;s)Aπ(s,a)\mathbb A_{\pi,\mu}(\pi')=\sum_sd_{\pi,\mu}(s)\sum_a\pi'(a;s)A_\pi(s,a)Aπ,μ​(π′)=∑s​dπ,μ​(s)∑a​π′(a;s)Aπ​(s,a): the expected advantage of π′\pi'π′ over π\piπ on the states π\piπ itself visits. Its maximum over all stochastic policies is OPT(Aπ,μ)=max⁡π′Aπ,μ(π′)\mathrm{OPT}(\mathbb A_{\pi,\mu})=\max_{\pi'}\mathbb A_{\pi,\mu}(\pi')OPT(Aπ,μ​)=maxπ′​Aπ,μ​(π′) (Definition 4.3). An optimal policy π∗\pi^*π∗ satisfies Vπ(s)≤Vπ∗(s)V_\pi(s)\le V_{\pi^*}(s)Vπ​(s)≤Vπ∗​(s) for every policy π\piπ and every state sss. For nonnegative f,gf,gf,g on SSS, ∥f/g∥∞=max⁡sf(s)/g(s)\|f/g\|_\infty=\max_sf(s)/g(s)∥f/g∥∞​=maxs​f(s)/g(s) (p. 5).

Formalization targets

Goal: Theorem 6.2 (p. 6)

If OPT(Aπ,μ)<ε\mathrm{OPT}(\mathbb A_{\pi,\mu})<\varepsilonOPT(Aπ,μ​)<ε and π∗\pi^*π∗ is optimal, then for every state distribution μ~\tilde\muμ~​

ημ~(π∗)−ημ~(π)≤ε1−γ∥dπ∗,μ~dπ,μ∥∞≤ε(1−γ)2∥dπ∗,μ~μ∥∞.\eta_{\tilde\mu}(\pi^*)-\eta_{\tilde\mu}(\pi)\le\frac{\varepsilon}{1-\gamma}\left\|\frac{d_{\pi^*,\tilde\mu}}{d_{\pi,\mu}}\right\|_\infty\le\frac{\varepsilon}{(1-\gamma)^2}\left\|\frac{d_{\pi^*,\tilde\mu}}{\mu}\right\|_\infty.ημ~​​(π∗)−ημ~​​(π)≤1−γε​​dπ,μ​dπ∗,μ~​​​​∞​≤(1−γ)2ε​​μdπ∗,μ~​​​​∞​.

The goal states both inequalities and the outer bound. The evaluation distribution μ~\tilde\muμ~​ is arbitrary and unrelated to the restart distribution μ\muμ; taking μ~=D\tilde\mu=Dμ~​=D, the start distribution, gives Corollary 4.5 (p. 5).

Milestone: Lemma 6.1 (p. 6)

For any policies π~\tilde\piπ~, π\piπ and any starting distribution μ\muμ,

ημ(π~)−ημ(π)=11−γE(a,s)∼π~dπ~,μ[Aπ(s,a)].\eta_\mu(\tilde\pi)-\eta_\mu(\pi)=\frac{1}{1-\gamma}E_{(a,s)\sim\tilde\pi d_{\tilde\pi,\mu}}\big[A_\pi(s,a)\big].ημ​(π~)−ημ​(π)=1−γ1​E(a,s)∼π~dπ~,μ​​[Aπ​(s,a)].

The states are weighted by the future state distribution of the new policy π~\tilde\piπ~, the advantage is that of the old policy π\piπ.

Significance

Theorem 6.2 is the quality guarantee for conservative policy iteration: combined with the paper's Theorem 4.4 (the algorithm stops with OPT(Aπ,μ)<2ε\mathrm{OPT}(\mathbb A_{\pi,\mu})<2\varepsilonOPT(Aπ,μ​)<2ε after polynomially many calls), it bounds the suboptimality of the returned policy for any target distribution, independently of the size of the state space except through the mismatch coefficient. It also explains the role of the restart distribution: a more uniform μ\muμ makes ∥dπ∗,μ~/μ∥∞\|d_{\pi^*,\tilde\mu}/\mu\|_\infty∥dπ∗,μ~​​/μ∥∞​ small. Lemma 6.1 is used throughout later theory, from trust-region policy optimization to the global convergence of policy gradient methods.

Both results are proved in the paper, with short arguments. The contribution of this mission is a machine-checked version of the infinite-horizon discounted statement in the paper's normalization, with the ∥⋅∥∞\|\cdot\|_\infty∥⋅∥∞​ ratios handled exactly, including states where a denominator vanishes. Neither the discounted performance difference lemma for stochastic policies nor the distribution mismatch bound is known to be formalized in Mathlib; a finite-horizon performance difference identity has been formalized separately and is a different statement.

Difficulty

The mathematics is short; the difficulty is in the infinite-horizon bookkeeping. The value function and dπ,μd_{\pi,\mu}dπ,μ​ are infinite series, and Lemma 6.1 relates the series of two different policies: its natural one-line argument uses the Bellman equation for VπV_\piVπ​, which is not the definition here, together with interchanges of infinite sums over time with finite sums over states and actions, each of which needs summability. Theorem 6.2 then needs two facts that are not stated as results in the paper: that OPT(Aπ,μ)\mathrm{OPT}(\mathbb A_{\pi,\mu})OPT(Aπ,μ​) equals ∑sdπ,μ(s)max⁡aAπ(s,a)\sum_sd_{\pi,\mu}(s)\max_aA_\pi(s,a)∑s​dπ,μ​(s)maxa​Aπ​(s,a) (the supremum over policies is attained by a greedy policy, and max⁡aAπ(s,a)≥0\max_aA_\pi(s,a)\ge0maxa​Aπ​(s,a)≥0), and that dπ,μ(s)≥(1−γ)μ(s)d_{\pi,\mu}(s)\ge(1-\gamma)\mu(s)dπ,μ​(s)≥(1−γ)μ(s). Reading the ℓ∞\ell_\inftyℓ∞​ ratio with real division would give a false statement when a denominator is zero; the statement avoids this.

Formalization scope

States and actions are finite nonempty types; policies and kernels are real-valued functions π s a (the paper's π(a;s)\pi(a;s)π(a;s)) and P s a s' (the paper's P(s′;s,a)P(s';s,a)P(s′;s,a)), with their distribution properties as explicit hypotheses. The published definitions IsTransitionKernel, IsPolicy, InducedTransition, OccupationDist, InducedReward and PolicyValue from the Foundations of Machine Learning series are reused; VπV_\piVπ​ is (1−γ)(1-\gamma)(1−γ) times PolicyValue, the defining series. OPT\mathrm{OPT}OPT is the supremum of the policy advantages over stochastic policies, which is the paper's maximum. Optimality of π∗\pi^*π∗ is relative to stationary stochastic policies, the paper's policy class; the existence of an optimal policy (the paper's "well known result", p. 2) is not part of this mission.

Every hypothesis is explicit: rewards in [0,R][0,R][0,R] with R>0R>0R>0, 0≤γ<10\le\gamma<10≤γ<1, PPP a kernel, π\piπ and π∗\pi^*π∗ stochastic policies, μ\muμ and μ~\tilde\muμ~​ state distributions. Each ∥f/g∥∞\|f/g\|_\infty∥f/g∥∞​ bound is stated multiplicatively: "X≤K∥f/g∥∞X\le K\|f/g\|_\inftyX≤K∥f/g∥∞​" is "X≤KCX\le KCX≤KC for every CCC with f(s)≤Cg(s)f(s)\le Cg(s)f(s)≤Cg(s) for all sss". When some g(s)=0<f(s)g(s)=0<f(s)g(s)=0<f(s) no such CCC exists and the bound is empty, which matches ∥f/g∥∞=+∞\|f/g\|_\infty=+\infty∥f/g∥∞​=+∞; no full-support assumption is made on μ\muμ or μ~\tilde\muμ~​. The hypothesis OPT(Aπ,μ)<ε\mathrm{OPT}(\mathbb A_{\pi,\mu})<\varepsilonOPT(Aπ,μ​)<ε is on the supremum itself, not on the closed form ∑sdπ,μ(s)max⁡aAπ(s,a)\sum_sd_{\pi,\mu}(s)\max_aA_\pi(s,a)∑s​dπ,μ​(s)maxa​Aπ​(s,a), which is a step of the proof; a formalization that assumed the closed form, or that divided by dπ,μd_{\pi,\mu}dπ,μ​ in real arithmetic, would not be this theorem. The proof of the theorem uses only that π∗\pi^*π∗ is a policy; optimality is kept as a hypothesis because the paper states it.

The proof on p. 7 twice writes dπ,μ(s)≤(1−γ)μ(s)d_{\pi,\mu}(s)\le(1-\gamma)\mu(s)dπ,μ​(s)≤(1−γ)μ(s); the inequality it uses, and the one stated on p. 5, is dπ,μ(s)≥(1−γ)μ(s)d_{\pi,\mu}(s)\ge(1-\gamma)\mu(s)dπ,μ​(s)≥(1−γ)μ(s). This slip is in the proof, not in the statement. Pages are PDF pages; the paper has no printed page numbers.

Useful reusable infrastructure: summability and Bellman equations for the normalized discounted value, dπ,μd_{\pi,\mu}dπ,μ​ as a probability distribution with dπ,μ≥(1−γ)μd_{\pi,\mu}\ge(1-\gamma)\mudπ,μ​≥(1−γ)μ, and attainment of OPT\mathrm{OPT}OPT by a greedy policy. Contributions of any of these as separate lemmas are welcome.

Selected references

  • S. Kakade, J. Langford, Approximately Optimal Approximate Reinforcement Learning, Proceedings of the 19th International Conference on Machine Learning (ICML), 2002. https://dl.acm.org/doi/10.5555/645531.656005
  • R. Munos, Error Bounds for Approximate Policy Iteration, ICML 2003. https://dl.acm.org/doi/10.5555/3041838.3041903
  • A. Agarwal, S. Kakade, J. Lee, G. Mahajan, On the Theory of Policy Gradient Methods: Optimality, Approximation, and Distribution Shift, Journal of Machine Learning Research 22(98), 2021. https://jmlr.org/papers/v22/19-736.html
  • J. Schulman, S. Levine, P. Abbeel, M. Jordan, P. Moritz, Trust Region Policy Optimization, ICML 2015. https://arxiv.org/abs/1502.05477
10 thms2 active usersReviewed
🏆Completed
CombinatoricsLinear OptimizationOperations Research+1·Captain: mikedeng1

An Efficient Approximation Scheme for the One-Dimensional Bin-Packing Problem II: Geometric Grouping with Residual LP RoundingResearch Paper

Motivation

One-dimensional bin packing asks for the fewest unit-capacity bins that hold a given list of items with sizes in (0,1)(0,1)(0,1). Deciding whether two bins suffice is NP-hard (it contains the partition problem), so no polynomial-time algorithm guarantees a ratio below 3/23/23/2 unless P = NP. The natural question is therefore asymptotic: how small can the additive error A(I)−OPT(I)A(I) - OPT(I)A(I)−OPT(I) be made, as a function of the optimum OPT(I)OPT(I)OPT(I)?

  • 1974: D. S. Johnson, A. Demers, J. D. Ullman, M. R. Garey and R. L. Graham analysed First Fit and First Fit Decreasing, with asymptotic ratios 17/1017/1017/10 and 11/911/911/9 (SIAM J. Comput. 3(4)).
  • 1981: W. Fernandez de la Vega and G. S. Lueker gave an asymptotic approximation scheme: for every ε>0\varepsilon > 0ε>0, (1+ε) OPT(I)+1(1+\varepsilon)\,OPT(I) + 1(1+ε)OPT(I)+1 bins in linear time (Combinatorica 1).
  • 1982: N. Karmarkar and R. M. Karp replaced the multiplicative error by an additive one: OPT(I)+O(log⁡2OPT(I))OPT(I) + O(\log^2 OPT(I))OPT(I)+O(log2OPT(I)) bins in polynomial time (Proc. 23rd FOCS). This mission formalizes that bound.
  • 2017: R. Hoberg and T. Rothvoss improved the additive error to O(log⁡OPT)O(\log OPT)O(logOPT) (SODA 2017). Whether OPT(I)+O(1)OPT(I) + O(1)OPT(I)+O(1) is achievable remains open.

Its main device, geometric grouping followed by rounding a linear program over bin configurations, recurs in later additive results and in cutting-stock problems.

Setting

An instance III is a finite multiset of piece sizes in the open interval (0,1)(0,1)(0,1). Write n(I)n(I)n(I) for the number of pieces, m(I)m(I)m(I) for the number of distinct sizes, SIZE(I)SIZE(I)SIZE(I) for the total size and a(I)a(I)a(I) for the smallest size. A packing is a multiset of bins whose union is III and in each of which the sizes sum to at most 111; its cost is the number of bins, and OPT(I)OPT(I)OPT(I) is the least cost.

A configuration is a nonempty multiset of sizes occurring in III that fits in one bin. The fractional bin-packing problem is the linear program

(I)min⁡ 1⋅xs.t.x≥0,Ax≥b,(I)\qquad \min\ \mathbf 1\cdot x\quad\text{s.t.}\quad x \ge 0,\quad Ax \ge b,(I)min 1⋅xs.t.x≥0,Ax≥b,

with one variable xjx_jxj​ per configuration, where AtjA_{tj}Atj​ counts the pieces of size ttt in configuration jjj and btb_tbt​ the pieces of size ttt in III. Its value is LIN(I)LIN(I)LIN(I). A basic feasible solution is an extreme point of the feasible region.

Geometric grouping with parameter kkk sorts the pieces in non-increasing order and cuts them into consecutive groups G1,G2,…,GqG_1, G_2, \dots, G_qG1​,G2​,…,Gq​, each the shortest run of pieces of total size at least kkk. Within each group GiG_iGi​ (i≥2i \ge 2i≥2) only as many of the largest pieces as Gi−1G_{i-1}Gi−1​ has are kept; they are rounded up to the largest size in GiG_iGi​, giving Gi′G_i'Gi′​. The rounded pieces form JJJ, and G1G_1G1​ together with the unrounded leftovers ΔGi\Delta G_iΔGi​ form J′J'J′.

ALGORITHM 2 with a positive integer kkk and a positive real ggg:

  1. Eliminate all pieces of size ≤g\le g≤g.
  2. While SIZE>1+11−1/kln⁡1gSIZE > 1 + \frac{1}{1-1/k}\ln\frac1gSIZE>1+1−1/k1​lng1​: group the current instance into J,J′J, J'J,J′; pack J′J'J′ in at most 2k[2+ln⁡1g]2k[2 + \ln\frac1g]2k[2+lng1​] bins; obtain a basic feasible solution xxx of the LP of JJJ with cost at most LIN(J)+1LIN(J)+1LIN(J)+1; open ⌊xj⌋\lfloor x_j\rfloor⌊xj​⌋ bins of each configuration jjj, fill them with pieces, and delete the pieces so packed.
  3. Pack the remaining pieces in at most 2+21−1/kln⁡1g2 + \frac{2}{1-1/k}\ln\frac1g2+1−1/k2​lng1​ bins.
  4. Reinsert the eliminated pieces, using a new bin only when necessary.

Its cost on III is written A(I)A(I)A(I).

Formalization targets

Goal: Theorem 4 with explicit constants

For every instance III with SIZE(I)≥2SIZE(I) \ge 2SIZE(I)≥2, every packing that ALGORITHM 2 with k=2k=2k=2 and g=1/SIZE(I)g = 1/SIZE(I)g=1/SIZE(I) can output is a packing of III with

A(I)≤OPT(I)+(1+log⁡2OPT(I))(9+4ln⁡OPT(I))+2+4ln⁡OPT(I).A(I) \le OPT(I) + \bigl(1 + \log_2 OPT(I)\bigr)\bigl(9 + 4\ln OPT(I)\bigr) + 2 + 4\ln OPT(I).A(I)≤OPT(I)+(1+log2​OPT(I))(9+4lnOPT(I))+2+4lnOPT(I).

This is the paper's A(I)≤OPT(I)+O(log⁡2OPT(I))A(I) \le OPT(I) + O(\log^2 OPT(I))A(I)≤OPT(I)+O(log2OPT(I)), with the constants that its proof yields.

The general bound for ALGORITHM 2

For integers k≥2k \ge 2k≥2, 0<g≤120 < g \le \tfrac120<g≤21​ and SIZE(I)≥1SIZE(I) \ge 1SIZE(I)≥1:

A(I)≤max⁡{(1+2g) OPT(I)+1, OPT(I)+[1+ln⁡SIZE(I)ln⁡k][1+4k+2kln⁡1g]+2+21−1kln⁡1g}.A(I) \le \max\Bigl\{(1+2g)\,OPT(I) + 1,\ OPT(I) + \Bigl[1 + \frac{\ln SIZE(I)}{\ln k}\Bigr]\Bigl[1 + 4k + 2k\ln\frac1g\Bigr] + 2 + \frac{2}{1-\frac1k}\ln\frac1g\Bigr\}.A(I)≤max{(1+2g)OPT(I)+1, OPT(I)+[1+lnklnSIZE(I)​][1+4k+2klng1​]+2+1−k1​2​lng1​}.

Milestones

In attack order: Lemmas 1–3; Theorem 2 (items 1–3, the bound on J′J'J′, item 4 corrected); the per-iteration shrinking of SIZESIZESIZE; the bound on the number ttt of iterations; the telescoping of LINLINLIN; the bin count after Step 3; the general bound.

Significance

The bound gives a polynomial-time algorithm whose additive error is polylogarithmic in the optimum, hence a fully polynomial asymptotic approximation scheme (O(log⁡2OPT)=o(OPT)O(\log^2 OPT) = o(OPT)O(log2OPT)=o(OPT)). Varying kkk and ggg trades running time for error, as the paper notes after Theorem 4. The scheme of solving the rounded LP, keeping its integer part and re-grouping the residual is reused by later additive results, including the O(log⁡OPT)O(\log OPT)O(logOPT) bound of Hoberg and Rothvoss.

The result has been proved since 1982. No machine-checked proof of it, or of any bin-packing approximation guarantee of this kind, is known to exist in Lean or Mathlib. The mission produces a formal version whose hypotheses and constants are explicit. It also corrects two printed statements whose published forms are false: Theorem 2, item 4, and the chain of inequalities in the analysis that relies on it. The corrections are disclosed in the statements.

Difficulty

Rounding a single LP solution does not suffice. A basic solution of the configuration LP has at most mmm fractional variables, and after rounding down, the leftover pieces form an instance of size at most m(J)m(J)m(J). With linear grouping that leftover is of order 1/ε21/\varepsilon^21/ε2 and costs a constant factor. The difficulty is making the residual shrink geometrically. Geometric grouping must produce an instance JJJ with m(J)≤SIZE/k+O(ln⁡(1/g))m(J) \le SIZE/k + O(\ln(1/g))m(J)≤SIZE/k+O(ln(1/g)) distinct sizes while discarding only O(kln⁡(1/g))O(k\ln(1/g))O(kln(1/g)) in J′J'J′. The residual must then be re-grouped and re-solved. Each step must be accounted for simultaneously in SIZESIZESIZE, LINLINLIN and OPTOPTOPT, with an additive loss per iteration; the harmonic-sum estimate behind SIZE(J′)SIZE(J')SIZE(J′) and the telescoping of LINLINLIN across iterations carry most of the weight.

Formalization scope

  • Model. An instance is a Multiset ℝ with sizes in the open interval (0,1)(0,1)(0,1); real sizes generalize the paper's rationals, and the interval is open because a group of size at least kkk must contain more than kkk pieces. Packings are Multiset (Multiset ℝ). OPTOPTOPT and LINLINLIN are infima over nonempty sets. LP solutions are finitely supported functions on configurations; "basic" means extreme point.
  • Subroutine contract. The Fractional Bin-Packing procedure is modelled only by its stated output: any basic feasible solution of cost at most LIN(J)+1LIN(J)+1LIN(J)+1. The ellipsoid method of §6 is not modelled.
  • Runs. ALGORITHM 2 is a relation Alg2Run k g I P, witnessed by a trace. Every bound holds for every run: every admissible subroutine output, every packing at Steps 2 and 3 within the prescribed counts, every choice of pieces for the principal bins (which must fill every available slot), and every order of the Step 4 insertion. A separate well-definedness item states that a run exists, so the bounds are not vacuous.
  • Explicit constants. O(log⁡2OPT(I))O(\log^2 OPT(I))O(log2OPT(I)) in Theorem 4 is replaced by (1+log⁡2OPT)(9+4ln⁡OPT)+2+4ln⁡OPT(1+\log_2 OPT)(9 + 4\ln OPT) + 2 + 4\ln OPT(1+log2​OPT)(9+4lnOPT)+2+4lnOPT. The asymptotic threshold is made explicit as SIZE(I)≥2SIZE(I) \ge 2SIZE(I)≥2. ln⁡\lnln is Real.log and log⁡2\log_2log2​ is Real.logb 2.
  • Corrected statements. The last group of geometric grouping may fall short of kkk, which the paper ignores. For it, ΔGq\Delta G_qΔGq​ consists of the max⁡(0,lq−lq−1)\max(0, l_q - l_{q-1})max(0,lq​−lq−1​) smallest pieces. Theorem 2, item 4 is stated as m(J)≤SIZE(J)/k+ln⁡(1/a(I))+1m(J) \le SIZE(J)/k + \ln(1/a(I)) + 1m(J)≤SIZE(J)/k+ln(1/a(I))+1; the printed version without +1+1+1 fails for I={0.95,0.95,0.95,0.9}I = \{0.95, 0.95, 0.95, 0.9\}I={0.95,0.95,0.95,0.9}, k=2k = 2k=2. Theorem 2 is stated for integers k≥2k \ge 2k≥2, which its proof needs. The iteration bound is stated for t≥1t \ge 1t≥1 and for the instance after Step 1.
  • Out of scope. Running times, polynomiality, the function T(m,n)T(m,n)T(m,n), the number of subroutine calls, §6, ALGORITHM 3 and Theorem 5.
  • Ruling out trivial versions. "There exists a packing with at most OPT(I)+…OPT(I) + \dotsOPT(I)+… bins" is trivially true and is not the goal. The goal bounds every output of the algorithm, and the existence item shows that outputs exist.

Contributions welcome: milestone proofs; a harmonic-sum bound ∑j=ab1/j≤ln⁡ba−1\sum_{j=a}^{b} 1/j \le \ln\frac{b}{a-1}∑j=ab​1/j≤lna−1b​; extreme-point facts for {x≥0:Ax≥b}\{x \ge 0 : Ax \ge b\}{x≥0:Ax≥b} (at most as many nonzero coordinates as rows; an optimal extreme point exists), reusable beyond bin packing; monotonicity of LINLINLIN and OPTOPTOPT under the piecewise order.

Selected references

  • N. Karmarkar, R. M. Karp, An Efficient Approximation Scheme for the One-Dimensional Bin-Packing Problem, Proc. 23rd Annual Symposium on Foundations of Computer Science (SFCS 1982), IEEE, pp. 312–320, 1982. https://doi.org/10.1109/SFCS.1982.61
  • W. Fernandez de la Vega, G. S. Lueker, Bin packing can be solved within 1 + ε in linear time, Combinatorica 1(4), 349–355, 1981. https://doi.org/10.1007/BF02579456
  • D. S. Johnson, A. Demers, J. D. Ullman, M. R. Garey, R. L. Graham, Worst-case performance bounds for simple one-dimensional packing algorithms, SIAM J. Comput. 3(4), 299–325, 1974. https://doi.org/10.1137/0203025
  • R. Hoberg, T. Rothvoss, A Logarithmic Additive Integrality Gap for Bin Packing, Proc. 28th ACM-SIAM SODA, 2616–2625, 2017. https://doi.org/10.1137/1.9781611974782.172
21 thms4 active usersReviewed
🏆Completed
Operations ResearchOptimization·Captain: mikedeng1

Global Convergence of Splitting Methods for Nonconvex Composite Optimization II: The Proximal ADMM Sequence Is Bounded Under CoercivityResearch Paper

Motivation

The alternating direction method of multipliers (ADMM) splits a problem of the form min⁡xh(x)+P(Mx)\min_x h(x) + P(\mathcal M x)minx​h(x)+P(Mx) into a sequence of simpler subproblems, one in which the nonsmooth term PPP enters only through its proximal map and one in which only the smooth term hhh appears. For convex problems its convergence theory is classical. In signal processing and statistics, however, the method is routinely run on nonconvex models, such as ℓ0\ell_0ℓ0​- or ℓ1/2\ell_{1/2}ℓ1/2​-regularized least squares, where PPP is nonconvex and possibly discontinuous and convex theory does not apply.

Li and Pong (arXiv:1407.0753, SIAM J. Optim. 25(4), 2015) gave a convergence analysis of a proximal variant of the ADMM for this nonconvex setting. Their Theorem 1 shows that every cluster point of the iterates is a stationary point. That statement is only informative if cluster points exist. Theorem 2, the subject of this mission, gives conditions on hhh, PPP and M\mathcal MM under which the whole sequence of iterates is bounded, so that cluster points exist and Theorem 1 applies.

Setting

Let n,m≥0n, m \ge 0n,m≥0. The data are:

  • h:Rn→Rh : \mathbb{R}^n \to \mathbb{R}h:Rn→R, twice continuously differentiable with bounded Hessian ∇2h\nabla^2 h∇2h;
  • P:Rm→(−∞,+∞]P : \mathbb{R}^m \to (-\infty, +\infty]P:Rm→(−∞,+∞], proper (never −∞-\infty−∞, finite somewhere) and closed (lower semicontinuous);
  • M:Rn→Rm\mathcal M : \mathbb{R}^n \to \mathbb{R}^mM:Rn→Rm linear, with adjoint M∗\mathcal M^*M∗;
  • a penalty β>0\beta > 0β>0 and a convex, twice continuously differentiable ϕ:Rn→R\phi : \mathbb{R}^n \to \mathbb{R}ϕ:Rn→R.

The augmented Lagrangian is

Lβ(x,y,z)=h(x)+P(y)−⟨z,Mx−y⟩+β2∥Mx−y∥2,L_\beta(x, y, z) = h(x) + P(y) - \langle z, \mathcal M x - y\rangle + \frac{\beta}{2}\|\mathcal M x - y\|^2 ,Lβ​(x,y,z)=h(x)+P(y)−⟨z,Mx−y⟩+2β​∥Mx−y∥2,

and the Bregman distance of ϕ\phiϕ is Dϕ(x1,x2)=ϕ(x1)−ϕ(x2)−⟨∇ϕ(x2),x1−x2⟩D_\phi(x_1, x_2) = \phi(x_1) - \phi(x_2) - \langle\nabla\phi(x_2), x_1 - x_2\rangleDϕ​(x1​,x2​)=ϕ(x1​)−ϕ(x2​)−⟨∇ϕ(x2​),x1​−x2​⟩. A sequence (xt,yt,zt)t≥0(x^t, y^t, z^t)_{t\ge 0}(xt,yt,zt)t≥0​ is generated by the proximal ADMM if, from arbitrary x0,z0x^0, z^0x0,z0,

yt+1∈Arg min⁡yLβ(xt,y,zt),xt+1∈Arg min⁡x{Lβ(x,yt+1,zt)+Dϕ(x,xt)},zt+1=zt−β(Mxt+1−yt+1).y^{t+1} \in \operatorname*{Arg\,min}_y L_\beta(x^t, y, z^t), \quad x^{t+1} \in \operatorname*{Arg\,min}_x \{L_\beta(x, y^{t+1}, z^t) + D_\phi(x, x^t)\}, \quad z^{t+1} = z^t - \beta(\mathcal M x^{t+1} - y^{t+1}).yt+1∈yArgmin​Lβ​(xt,y,zt),xt+1∈xArgmin​{Lβ​(x,yt+1,zt)+Dϕ​(x,xt)},zt+1=zt−β(Mxt+1−yt+1).

For a linear self-map T\mathcal TT, write ∥x∥T2=⟨x,Tx⟩\|x\|^2_{\mathcal T} = \langle x, \mathcal T x\rangle∥x∥T2​=⟨x,Tx⟩, and write ⪰\succeq⪰, ≻\succ≻ for the semidefinite and definite order of symmetric maps. Assumption 1 asks for σ>0\sigma > 0σ>0 with MM∗⪰σI\mathcal M\mathcal M^* \succeq \sigma\mathcal IMM∗⪰σI (so M\mathcal MM is surjective), bounds Q1⪰∇2h⪰Q2\mathcal Q_1 \succeq \nabla^2 h \succeq \mathcal Q_2Q1​⪰∇2h⪰Q2​, maps T1⪰T2⪰0\mathcal T_1 \succeq \mathcal T_2 \succeq 0T1​⪰T2​⪰0 with T12⪰[∇2ϕ]2⪰T22\mathcal T_1^2 \succeq [\nabla^2\phi]^2 \succeq \mathcal T_2^2T12​⪰[∇2ϕ]2⪰T22​, δ>0\delta > 0δ>0 with Q2+βM∗M+T2⪰δI\mathcal Q_2 + \beta\mathcal M^*\mathcal M + \mathcal T_2 \succeq \delta\mathcal IQ2​+βM∗M+T2​⪰δI, a bound Q3⪰[∇2h+∇2ϕ]2\mathcal Q_3 \succeq [\nabla^2 h + \nabla^2\phi]^2Q3​⪰[∇2h+∇2ϕ]2, and γ∈(0,1)\gamma \in (0,1)γ∈(0,1) with

δI+T2≻2σβ(1γQ3+11−γT12).\delta\mathcal I + \mathcal T_2 \succ \frac{2}{\sigma\beta}\Bigl(\frac1\gamma\mathcal Q_3 + \frac1{1-\gamma}\mathcal T_1^2\Bigr).δI+T2​≻σβ2​(γ1​Q3​+1−γ1​T12​).

Formalization targets

Goal: Theorem 2 (p. 11)

Suppose Assumption 1 holds and, with the same σ\sigmaσ and γ\gammaγ, there is 0<ζ<2βγ0 < \zeta < 2\beta\gamma0<ζ<2βγ with

h0:=inf⁡x{h(x)−1σζ∥∇h(x)∥2}>−∞.(29)h_0 := \inf_x\Bigl\{h(x) - \frac{1}{\sigma\zeta}\|\nabla h(x)\|^2\Bigr\} > -\infty. \tag{29}h0​:=xinf​{h(x)−σζ1​∥∇h(x)∥2}>−∞.(29)

Suppose that either (i) M\mathcal MM is invertible and lim inf⁡∥y∥→∞P(y)=∞\liminf_{\|y\|\to\infty} P(y) = \inftyliminf∥y∥→∞​P(y)=∞, or (ii) lim inf⁡∥x∥→∞h(x)=∞\liminf_{\|x\|\to\infty} h(x) = \inftyliminf∥x∥→∞​h(x)=∞ and inf⁡yP(y)>−∞\inf_y P(y) > -\inftyinfy​P(y)>−∞. Then

sup⁡t≥0 (∥xt∥+∥yt∥+∥zt∥)<∞.\sup_{t \ge 0}\ \bigl(\|x^t\| + \|y^t\| + \|z^t\|\bigr) < \infty .t≥0sup​ (∥xt∥+∥yt∥+∥zt∥)<∞.

Milestones

The milestones are the numbered displays of the paper's proof:

  • Eq. (13): M∗zt+1=∇h(xt+1)+∇ϕ(xt+1)−∇ϕ(xt)\mathcal M^* z^{t+1} = \nabla h(x^{t+1}) + \nabla\phi(x^{t+1}) - \nabla\phi(x^t)M∗zt+1=∇h(xt+1)+∇ϕ(xt+1)−∇ϕ(xt).
  • Eq. (20): the one-step estimate Lβ(wt+1)≤Lβ(wt)+12∥xt+1−xt∥2σβγQ3−δI−T22+12∥xt−xt−1∥2σβ(1−γ)T122L_\beta(w^{t+1}) \le L_\beta(w^t) + \tfrac12\|x^{t+1}-x^t\|^2_{\frac{2}{\sigma\beta\gamma}\mathcal Q_3 - \delta\mathcal I - \mathcal T_2} + \tfrac12\|x^t - x^{t-1}\|^2_{\frac{2}{\sigma\beta(1-\gamma)}\mathcal T_1^2}Lβ​(wt+1)≤Lβ​(wt)+21​∥xt+1−xt∥σβγ2​Q3​−δI−T2​2​+21​∥xt−xt−1∥σβ(1−γ)2​T12​2​ for t≥1t \ge 1t≥1.
  • Eq. (30): the merit quantity Lβ(wt)+12∥xt−xt−1∥2σβ(1−γ)T122L_\beta(w^t) + \tfrac12\|x^t - x^{t-1}\|^2_{\frac{2}{\sigma\beta(1-\gamma)}\mathcal T_1^2}Lβ​(wt)+21​∥xt−xt−1∥σβ(1−γ)2​T12​2​ stays below its value at t=1t = 1t=1.
  • Eq. (31): σ∥zt∥2≤1γ∥∇h(xt)∥2+11−γ∥xt−xt−1∥T122\sigma\|z^t\|^2 \le \frac1\gamma\|\nabla h(x^t)\|^2 + \frac1{1-\gamma}\|x^t - x^{t-1}\|^2_{\mathcal T_1^2}σ∥zt∥2≤γ1​∥∇h(xt)∥2+1−γ1​∥xt−xt−1∥T12​2​ for t≥1t \ge 1t≥1.
  • Eq. (32): a lower estimate of that value at t=1t = 1t=1 by μh(xt)+(1−μ)h0+cσ∥∇h(xt)∥2+P(yt)+β2∥Mxt−yt−zt/β∥2+…\mu h(x^t) + (1-\mu)h_0 + \frac{c}{\sigma}\|\nabla h(x^t)\|^2 + P(y^t) + \frac\beta2\|\mathcal M x^t - y^t - z^t/\beta\|^2 + \ldotsμh(xt)+(1−μ)h0​+σc​∥∇h(xt)∥2+P(yt)+2β​∥Mxt−yt−zt/β∥2+…, where c=1−μζ−12βγ>0c = \frac{1-\mu}{\zeta} - \frac{1}{2\beta\gamma} > 0c=ζ1−μ​−2βγ1​>0.

Significance

The result. Theorem 2 supplies the existence of cluster points that Theorem 1 assumes. The two together give an unconditional statement: under Assumption 1, (29) and either coercivity condition, the proximal ADMM has a cluster point and every one of them is stationary. The hypotheses cover the models that motivate the paper. Least squares with a coercive nonconvex regularizer falls under case (i) with M=I\mathcal M = \mathcal IM=I, and a strongly convex quadratic hhh with a regularizer that is bounded below and a general surjective M\mathcal MM falls under case (ii) (Examples 4–6 of the paper). Boundedness is also a standing hypothesis of the paper's Theorem 3, the Kurdyka–Łojasiewicz argument for convergence of the whole sequence.

Formalizing it. The result has been proved since 2015. As far as a search of the platform shows, neither it nor the underlying Lyapunov-type estimates for the ADMM has been machine-checked. This mission formalizes the known proof. The estimates (20), (30) and (31) are shared with the stationarity analysis of the same algorithm, so they serve any later formal work on nonconvex ADMM variants.

Difficulty

The obvious approach is to bound the iterates by the monotone quantity of Eq. (30). That quantity involves LβL_\betaLβ​, which contains −⟨z,Mx−y⟩-\langle z, \mathcal M x - y\rangle−⟨z,Mx−y⟩ and is not bounded below a priori, so its decrease alone does not bound anything. The dual term has to be absorbed. It is controlled through ∇h(xt)\nabla h(x^t)∇h(xt) and the last primal step, and the part involving ∥∇h(xt)∥2\|\nabla h(x^t)\|^2∥∇h(xt)∥2 is then paid for out of hhh itself. Condition (29) exists to make exactly this trade possible, which is why it couples ζ\zetaζ to the γ\gammaγ of Assumption 1. The two cases then extract boundedness in opposite orders: (i) goes from yty^tyt through ztz^tzt to xtx^txt using invertibility of M\mathcal MM, and (ii) goes from xtx^txt through ztz^tzt to yty^tyt. In case (i) the lower bound on PPP that the argument needs is not assumed and must itself be derived from coercivity and lower semicontinuity.

Formalization scope

  • Spaces and values. Spaces are EuclideanSpace ℝ (Fin n) and EuclideanSpace ℝ (Fin m), and M\mathcal MM is a continuous linear map with Mathlib's adjoint. PPP, LβL_\betaLβ​ and every inequality containing them live in EReal, stated additively so that no extended-real subtraction occurs.
  • Assumption 1 is one definition with its witnesses σ,δ,γ,Q1,Q2,T1,T2,Q3\sigma, \delta, \gamma, \mathcal Q_1, \mathcal Q_2, \mathcal T_1, \mathcal T_2, \mathcal Q_3σ,δ,γ,Q1​,Q2​,T1​,T2​,Q3​ as explicit parameters, and ⪰\succeq⪰ is Mathlib's Loewner order on self-maps. ∥x∥T2\|x\|^2_{\mathcal T}∥x∥T2​ is ⟨x,Tx⟩\langle x, \mathcal T x\rangle⟨x,Tx⟩ for every T\mathcal TT, including indefinite ones.
  • Condition (29) takes ζ\zetaζ and a real lower bound h0h_0h0​ as parameters, with the same σ\sigmaσ and γ\gammaγ as Assumption 1.
  • The algorithm is a relation on sequences. An argmin is a global minimizer, not necessarily unique. x0x^0x0 and z0z^0z0 are free, and y0y^0y0 is unconstrained. No existence of minimizers is asserted.
  • Coercivity is stated in its ∀r ∃R\forall r\,\exists R∀r∃R form, and "invertible" is bijectivity of M\mathcal MM.
  • Boundedness means one radius for all three blocks and all t≥0t \ge 0t≥0.

Ruling out trivial versions. A formalization that bounds only xtx^txt, fixes γ\gammaγ or ζ\zetaζ to an example's values, lets (29) use a fresh γ\gammaγ, adds a lower bound on PPP in case (i), or assumes minimizers that make the sequence constant proves a different, weaker theorem, and is not the target.

Definitions needed. Proper and closed extended-valued functions, the Hessian as fderiv of gradient, the augmented Lagrangian, the Bregman distance, the proximal-ADMM relation and Assumption 1 are all provided. They mirror the definitions of the companion mission on cluster points of the same algorithm. A solver will need standard facts beyond them: first-order optimality for a differentiable function, the mean-value bound ∥∇ϕ(a)−∇ϕ(b)∥2≤∥a−b∥T122\|\nabla\phi(a) - \nabla\phi(b)\|^2 \le \|a-b\|^2_{\mathcal T_1^2}∥∇ϕ(a)−∇ϕ(b)∥2≤∥a−b∥T12​2​ from the Hessian sandwich, and strong convexity of the xxx-subproblem. Proofs of individual milestones are welcome independently.

Selected references

  • G. Li and T. K. Pong, Global Convergence of Splitting Methods for Nonconvex Composite Optimization, SIAM J. Optim. 25(4), 2015; preprint arXiv:1407.0753v6. https://arxiv.org/abs/1407.0753 (DOI 10.1137/140998135)
  • S. Boyd, N. Parikh, E. Chu, B. Peleato and J. Eckstein, Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers, Found. Trends Mach. Learn. 3(1), 2011. https://doi.org/10.1561/2200000016
  • H. Attouch, J. Bolte and B. F. Svaiter, Convergence of descent methods for semi-algebraic and tame problems, Math. Program. 137, 2013. https://doi.org/10.1007/s10107-011-0484-9
9 thms2 active usersReviewed
PreviousNext

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me