Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Operations Research

1,339 missions · 655 completed

The discipline of applying mathematical analysis to complex decision problems in operations: allocating scarce resources, scheduling, routing, inventory, and the design of service and production systems. Drawing on mathematical programming, stochastic modeling, queueing, simulation, and game-theoretic reasoning, it seeks policies that perform provably well in systems shaped by constraints, congestion, and uncertainty.

Missions

Open684Completed655All1339
ProbabilityStatistics·Captain: mikedeng1

Residual Life Time at Great Age 2: The Domain of Residual Life Time Attraction of the Exponential Law Is D(Λ) ∩ D₀Research Paper

Motivation

A lifetime observed only after it has survived to a high age is described by its residual life: the additional time until failure, conditional on survival so far. Reliability analysis asks whether these conditional distributions settle into a stable shape after scaling and shifting. Extreme-value theory asks a related question about the largest observation in a large independent sample. Balkema and de Haan identify an exact connection between these questions for the exponential residual-life limit and the Gumbel maxima limit in Theorem 3 of their 1974 article. The connection lets one recognize the asymptotic form of old-age lifetimes from the domain of attraction of sample maxima, provided the lifetime distribution has no finite upper endpoint.

The article studies several residual-life limits. This mission isolates its exponential case, where the limiting conditional excess has distribution function Π(x)=1−e−x\Pi(x)=1-e^{-x}Π(x)=1−e−x for x≥0x\ge0x≥0. The other continuous family Γα\Gamma_\alphaΓα​ and the paper's discrete limits have separate hypotheses and attraction domains; they are outside this theorem.

Setting

Let XXX have a probability distribution function FFF on R\mathbb RR, and let its survival function be R(x)=Pr⁡(X>x)=1−F(x)R(x)=\Pr(X>x)=1-F(x)R(x)=Pr(X>x)=1−F(x). For a threshold ttt with R(t)>0R(t)>0R(t)>0, the residual-life distribution function is

Ft(x)=Pr⁡(X−t≤x∣X>t)=Pr⁡(t<X≤t+x)R(t).F_t(x)=\Pr(X-t\le x\mid X>t)=\frac{\Pr(t<X\le t+x)}{R(t)}.Ft​(x)=Pr(X−t≤x∣X>t)=R(t)Pr(t<X≤t+x)​.

It is zero for x<0x<0x<0. The class D0D_0D0​ consists of the distributions with R(x)>0R(x)>0R(x)>0 for every real xxx. This says that the upper endpoint is infinite and makes FtF_tFt​ meaningful at every threshold.

A law FFF belongs to the domain of residual-life attraction Dr(G)D_r(G)Dr​(G) when F∈D0F\in D_0F∈D0​ and there are a positive scale a(t)a(t)a(t) and a shift b(t)b(t)b(t) such that Ft(b(t)+xa(t))F_t(b(t)+xa(t))Ft​(b(t)+xa(t)) converges weakly to G(x)G(x)G(x) as t→∞t\to\inftyt→∞. The shift here acts on X−tX-tX−t, the residual lifetime. Weak convergence means convergence at every continuity point of the limiting distribution function; it does not require convergence at a jump.

For maxima, FFF belongs to the domain of attraction D(G)D(G)D(G) if there are sequences an>0a_n>0an​>0 and bnb_nbn​ for which F(anx+bn)nF(a_nx+b_n)^nF(an​x+bn​)n converges weakly to G(x)G(x)G(x) as n→∞n\to\inftyn→∞. The power is the distribution function of the maximum of nnn independent observations after the indicated normalization. The relevant limit laws are the exponential residual-life law and the Gumbel law:

Π(x)={0,x<0,1−e−x,x≥0,Λ(x)=e−e−x(x∈R).\Pi(x)=\begin{cases}0,&x<0,\\1-e^{-x},&x\ge0,\end{cases}\qquad \Lambda(x)=e^{-e^{-x}}\quad(x\in\mathbb R).Π(x)={0,1−e−x,​x<0,x≥0,​Λ(x)=e−e−x(x∈R).

These definitions and formulas come from the introduction and §2 of the published article, printed pages 792–793 and 798.

Formalization targets

Theorem 3: the exact domain identity

The goal is the identity stated on printed page 798:

Dr(Π)=D(Λ)∩D0.D_r(\Pi)=D(\Lambda)\cap D_0.Dr​(Π)=D(Λ)∩D0​.

Both inclusions are required. In particular, membership in the maxima domain alone is insufficient: the maximum of a sample can have a Gumbel limit even when the underlying distribution has a finite upper endpoint, while residual life cannot be conditioned on survival beyond that endpoint. The D0D_0D0​ condition is therefore part of the mathematical claim.

Supporting targets

The milestone list follows the statements used in the article's treatment of Theorem 3: the convergence-of-types remark on page 795; Lemma 3's asymptotic ratio R(x−0)/R(x+0)→1R(x-0)/R(x+0)\to1R(x−0)/R(x+0)→1; the tail criterion nR(bn+xan)→e−xnR(b_n+xa_n)\to e^{-x}nR(bn​+xan​)→e−x associated with Gumbel attraction; the inclusion D(Λ)∩D0⊆Dr(Π)D(\Lambda)\cap D_0\subseteq D_r(\Pi)D(Λ)∩D0​⊆Dr​(Π); and the passage from this tail limit on x>0x>0x>0 to all x∈Rx\in\mathbb Rx∈R. The last step retains the same normalization sequences. The article presents the criterion in one direction and relies on its converse at the end; the formal milestone records both directions with the same sequences.

Significance

The identity translates a conditional limit at a moving high threshold into a classical maxima-domain statement. A theorem about sample extremes can therefore characterize whether normalized remaining lifetime is asymptotically exponential. Conversely, observing exponential residual-life attraction determines a Gumbel maxima limit once the tail normalization is extended across the real line. The condition D0D_0D0​ marks exactly where the conditional lifetime exists; omitting it would misstate the equivalence.

The article proves the result mathematically. The Lean targets here provide a precise representation of its distributions, normalizations, and limiting claims, with Theorem 3 still posed for formal proof. A complete development would add proofs of the supporting tail and convergence-of-types statements, then establish both inclusions. The definitions of weak convergence at continuity points, survival functions, and attraction domains can also support later formalizations of the paper's Pareto and discrete cases.

Difficulty

The simple comparison F(anx+bn)n≈e−nR(anx+bn)F(a_nx+b_n)^n\approx e^{-nR(a_nx+b_n)}F(an​x+bn​)n≈e−nR(an​x+bn​) only relates the two limits after a suitable normalization is already available. The reverse direction starts with conditional residual-life convergence indexed by real thresholds, whereas maxima attraction needs a sequence indexed by integers. Sampling thresholds must preserve the tail asymptotics despite possible atoms. More seriously, the residual-life statement initially yields the required scaled-tail convergence only for positive arguments. The maxima limit must hold on the whole real line. A proof confined to that half-line cannot establish D(Λ)D(\Lambda)D(Λ); the continuation across its left boundary is the central difficulty highlighted by the article on printed pages 798–799.

Formalization scope

Lean represents FFF as the cumulative distribution function of a probability measure on R\mathbb RR and uses real-valued probabilities of intervals for RRR and FtF_tFt​. The residual-life denominator is positive wherever DrD_rDr​ is asserted. The extrema normalization is indexed by natural numbers, while the residual-life normalization is indexed by real thresholds. The scale is positive at every index; only large indices affect the limit. Weak convergence is encoded at every continuity point of the limit. As Π\PiΠ and Λ\LambdaΛ are continuous, their particular domain conditions amount to convergence at every real argument.

The paper uses two shift conventions: Ft(b(t)+xa(t))F_t(b(t)+xa(t))Ft​(b(t)+xa(t)) shifts X−tX-tX−t, while the scaled-tail expressions R(bn+xan)R(b_n+xa_n)R(bn​+xan​) shift XXX. Each statement uses the convention of its source passage. The convergence-of-types remark makes explicit the antitonicity and right-continuity of its limiting tails and states its identity where both arguments lie in the half-line on which convergence is known. Gnedenko's criterion is formalized as an equivalence: the printed sentence states the forward implication, and the conclusion of Theorem 3 uses the converse. The page-799 expression R(b(t)+xa(t))/(t)R(b(t)+xa(t))/(t)R(b(t)+xa(t))/(t) has a missing RRR in the denominator; the formal statement uses the intended R(t)R(t)R(t), consistent with conditional probability and with equation (11). These choices prevent a zero-denominator quotient or an out-of-domain limit identity from trivializing a target. In particular, D0D_0D0​ is part of the definition of Dr(G)D_r(G)Dr​(G): without it a law with a finite upper endpoint would have R(t)=0R(t)=0R(t)=0 for large ttt, the conditional distribution would be the junk quotient 0/0=00/0=00/0=0, and the domain would be mis-specified. In Lemma 3 the limit GGG is the distribution function of a probability measure, assumed continuous on all of R\mathbb RR.

The development needs measure-theoretic cumulative distributions and interval probabilities, filters for limits, and real exponential identities. The domain definitions and scaled-tail predicate are reusable beyond this theorem. Contributions that prove the stated milestones, or supply general lemmas about weak convergence and normalized tails, fit the scope.

Selected references

  • A. A. Balkema and L. de Haan, Residual Life Time at Great Age, The Annals of Probability 2(5), 792–804 (1974). DOI: 10.1214/aop/1176996548.
  • B. Gnedenko, Sur la distribution limite du terme maximum d'une série aléatoire, Annals of Mathematics 44(3), 423–453 (1943). DOI: 10.2307/1968974.
11 thms1 active userReviewed
ProbabilityStatistics·Captain: mikedeng1

Residual Life Time at Great Age 3: F Is in the Domain of Residual Life Time Attraction of Π_{p,c} iff It Is Tail Equivalent to a Discrete Law with Gap Ratios → e^{pc} and Tail Ratios → e^{−p}Research Paper

Residual life at great age

A component that has survived to age ttt has a residual life time X−tX - tX−t, and in reliability, actuarial work and the analysis of excesses over high thresholds the question is what its conditional law looks like when ttt is large. Balkema and de Haan (Ann. Probab. 2 (1974), 792–804) answered this in full generality: after an affine normalization, the only possible limit laws are the exponential law Π\PiΠ, the Pareto-type laws Γα\Gamma_\alphaΓα​, and a two-parameter family of discrete laws Πp,c\Pi_{p,c}Πp,c​. The continuous half of their classification became the Pickands–Balkema–de Haan theorem behind the peaks-over-threshold method of extreme-value statistics. The discrete half is less known, and this mission treats it: Theorem 5 of the paper (§3, p. 800) describes exactly which lifetimes are attracted to Πp,c\Pi_{p,c}Πp,c​.

Discrete limits appear only when the normalization is allowed both a scale and a shift. They describe lifetimes that live, asymptotically, on a lattice-like set of ages whose spacing grows geometrically, with a fixed fraction of survivors failing at each lattice point.

The source is the published article in The Annals of Probability (DOI 10.1214/aop/1176996548); page numbers below are the journal's.

Setting

Let XXX be a real random variable with law μ\muμ, distribution function FFF and tail R(x)=1−F(x)=P{X>x}R(x) = 1 - F(x) = P\{X > x\}R(x)=1−F(x)=P{X>x}, and assume F(x)<1F(x) < 1F(x)<1 for every xxx. The residual life distribution function at age ttt is (1), p. 792,

Ft(x)=P{X−t≤x∣X>t}=μ((t,t+x])μ((t,∞)).F_t(x) = P\{X - t \le x \mid X > t\} = \frac{\mu((t, t+x])}{\mu((t,\infty))}.Ft​(x)=P{X−t≤x∣X>t}=μ((t,∞))μ((t,t+x])​.

A family of distribution functions HtH_tHt​ converges weakly to GGG if Ht(x)→G(x)H_t(x) \to G(x)Ht​(x)→G(x) at every continuity point xxx of GGG. The domain of residual life time attraction Dr(G)D_r(G)Dr​(G) (p. 798) is the set of FFF with F(x)<1F(x) < 1F(x)<1 for all xxx for which some a(t)>0a(t) > 0a(t)>0 and b(t)b(t)b(t) give

Ft(b(t)+xa(t))→G(x)weakly as t→∞.F_t(b(t) + x a(t)) \to G(x) \quad \text{weakly as } t \to \infty.Ft​(b(t)+xa(t))→G(x)weakly as t→∞.

For p>0p > 0p>0 and c≥0c \ge 0c≥0 the discrete limit law is (p. 793), for x≥0x \ge 0x≥0,

Πp,c(x)=1−exp⁡(−p[1+log⁡(1+cx)cp]) (c>0),Πp,0(x)=1−exp⁡(−p[1+xp]),\Pi_{p,c}(x) = 1 - \exp\Big(-p\Big[1 + \frac{\log(1+cx)}{cp}\Big]\Big) \ (c > 0), \qquad \Pi_{p,0}(x) = 1 - \exp\Big(-p\Big[1 + \frac{x}{p}\Big]\Big),Πp,c​(x)=1−exp(−p[1+cplog(1+cx)​]) (c>0),Πp,0​(x)=1−exp(−p[1+px​]),

and Πp,c(x)=0\Pi_{p,c}(x) = 0Πp,c​(x)=0 for x<0x < 0x<0; [ ⋅ ][\,\cdot\,][⋅] is the integer part. Its tail takes the values e−p,e−2p,…e^{-p}, e^{-2p}, \dotse−p,e−2p,… and jumps at (ekpc−1)/c(e^{kpc} - 1)/c(ekpc−1)/c, k=0,1,…k = 0, 1, \dotsk=0,1,… (at kpkpkp if c=0c = 0c=0).

A distribution function F0=1−R0F_0 = 1 - R_0F0​=1−R0​ is discrete with jump sequence t0<t1<⋯t_0 < t_1 < \cdotst0​<t1​<⋯ if the tnt_ntn​ are unbounded, each carries positive mass and there is no other mass. Two distribution functions with Fi(x)<1F_i(x) < 1Fi​(x)<1 for all xxx are tail equivalent if 1−F1(x)∼1−F2(x)1 - F_1(x) \sim 1 - F_2(x)1−F1​(x)∼1−F2​(x) as x→∞x \to \inftyx→∞. The conditions of §3 are

(12a)  tn+1−tntn−tn−1→epc,(12b)  R0(tn+1)R0(tn)→e−p.\text{(12a)}\ \ \frac{t_{n+1} - t_n}{t_n - t_{n-1}} \to e^{pc}, \qquad \text{(12b)}\ \ \frac{R_0(t_{n+1})}{R_0(t_n)} \to e^{-p}.(12a)  tn​−tn−1​tn+1​−tn​​→epc,(12b)  R0​(tn​)R0​(tn+1​)​→e−p.

Formalization targets

Goal: Theorem 5 (p. 800)

For p>0p > 0p>0 and c≥0c \ge 0c≥0,

F∈Dr(Πp,c)  ⟺  F is tail equivalent to a discrete F0 whose jumps satisfy (12a) and whose tail satisfies (12b).F \in D_r(\Pi_{p,c}) \iff F \text{ is tail equivalent to a discrete } F_0 \text{ whose jumps satisfy (12a) and whose tail satisfies (12b).}F∈Dr​(Πp,c​)⟺F is tail equivalent to a discrete F0​ whose jumps satisfy (12a) and whose tail satisfies (12b).

Milestones

  1. (§3, pp. 799–800) A discrete FFF satisfying (12a) and (12b) lies in Dr(Πp,c)D_r(\Pi_{p,c})Dr​(Πp,c​).
  2. (§3, p. 800) If F1F_1F1​ is tail equivalent to F2∈Dr(Πp,c)F_2 \in D_r(\Pi_{p,c})F2​∈Dr​(Πp,c​), then F1∈Dr(Πp,c)F_1 \in D_r(\Pi_{p,c})F1​∈Dr​(Πp,c​). Milestones 1 and 2 give the "if" half.
  3. (Proof of Theorem 5, p. 800) If F∈Dr(Πp,c)F \in D_r(\Pi_{p,c})F∈Dr​(Πp,c​), there are bn↑∞b_n \uparrow \inftybn​↑∞ with R(bn+1)/R(bn)→e−pR(b_{n+1})/R(b_n) \to e^{-p}R(bn+1​)/R(bn​)→e−p and a discrete F0F_0F0​, tail equivalent to FFF, with R0(tn)=R(bn)R_0(t_n) = R(b_n)R0​(tn​)=R(bn​) at its jumps.
  4. (Proof of Theorem 5, pp. 800–801) Such an F0F_0F0​ satisfies (12b) and (12a). Milestones 3 and 4 give the "only if" half.

Significance

Theorem 5, together with Theorems 1, 3 and 4 of the paper, completes the description of residual-life attraction: every nondegenerate limit is of one of the listed types, and each type's domain of attraction is identified. For the discrete types the answer is a statement purely about the geometry of the atoms of an approximating law, which makes membership checkable for concrete lifetimes (geometric-type laws on {0,1,2,… }\{0, 1, 2, \dots\}{0,1,2,…} fall under c=0c = 0c=0, laws on a geometric grid {λn}\{\lambda^n\}{λn} under c>0c > 0c>0). It also explains why discrete limits are invisible when only a scale normalization is allowed.

The theorem has been proved since 1974; it has not been formalized. A machine-checked development would supply weak convergence of distribution functions at continuity points, residual-life normalizations and tail equivalence as reusable objects, and would check a proof that the paper compresses into a page, including a convergence-of-types step on a half line that the paper cites from its own §1.

Difficulty

The "if" half is close to a computation, but the computation is about weak convergence to a step function: the normed tails converge only off the jumps, and the normalization must be extended from the jump times tnt_ntn​ to all real ages ttt.

The "only if" half is the core. From F∈Dr(Πp,c)F \in D_r(\Pi_{p,c})F∈Dr​(Πp,c​) alone one has to manufacture the atoms tnt_ntn​ of a discrete law that FFF itself need not have. The obvious attempt, reading the atoms off the jumps of FFF, fails because FFF may be continuous: membership in Dr(Πp,c)D_r(\Pi_{p,c})Dr​(Πp,c​) only says that FFF drops by a factor close to e−pe^{-p}e−p over short stretches, relative to the normalization, and never by an intermediate factor. Making "never by an intermediate factor" precise uniformly in the age ttt, with normalizations a(t),b(t)a(t), b(t)a(t),b(t) about which nothing but their existence is known, is where the work lies; the same lack of control over a(t)a(t)a(t) is what makes the gap ratio (12a) hard to extract.

Formalization scope

A law is a measure μ : Measure ℝ with IsProbabilityMeasure μ; the tail R(x)R(x)R(x) is (μ (Set.Ioi x)).toReal, and Ft(x)F_t(x)Ft​(x) is μ((t, t+x]) / μ((t,∞)). Dr(G)D_r(G)Dr​(G) (InDr) includes F(x)<1F(x) < 1F(x)<1 for all xxx, normalizations a(t)>0a(t) > 0a(t)>0 for all real ttt, and "weakly" means convergence at every continuity point of GGG and nowhere else; requiring convergence at the jumps of Πp,c\Pi_{p,c}Πp,c​ would make Dr(Πp,c)D_r(\Pi_{p,c})Dr​(Πp,c​) empty. Πp,c\Pi_{p,c}Πp,c​ (piPC) is defined by cases c=0c = 0c=0 / c>0c > 0c>0 with Int.floor, so that c=0c = 0c=0 is not the junk value of a division by zero; it is used only with p>0p > 0p>0, c≥0c \ge 0c≥0. A discrete law with jump sequence ttt (IsDiscreteWithJumps) has ttt strictly increasing and tending to ∞\infty∞, positive mass at each tnt_ntn​ and no mass elsewhere. (12a) is indexed from n=1n = 1n=1. Tail equivalence (TailEquiv) includes Fi(x)<1F_i(x) < 1Fi​(x)<1 for both laws.

Conventions and disclosed readings:

  • The page proves the "if" direction by showing convergence to a function of the type of 1−Πp,c1 - \Pi_{p,c}1−Πp,c​; since DrD_rDr​ lets a,ba, ba,b be chosen freely, milestone 1 is stated with Πp,c\Pi_{p,c}Πp,c​ itself.
  • The proof of Theorem 5 uses the normalization (2)–(3) of p. 794, where b(t)b(t)b(t) shifts XXX rather than X−tX - tX−t; milestone 3 only asserts the existence of the sequence bnb_nbn​ with R(bn+1)/R(bn)→e−pR(b_{n+1})/R(b_n) \to e^{-p}R(bn+1​)/R(bn​)→e−p, so no convention enters its statement.
  • "F0F_0F0​ only takes the values F(bn)F(b_n)F(bn​)" is formalized as R0(tn)=R(bn)R_0(t_n) = R(b_n)R0​(tn​)=R(bn​) for all nnn, the form the next paragraph of the page uses. This identity is a hypothesis of milestone 4, as on the page, and cannot be dropped: a law tail equivalent to FFF may carry extra atoms of vanishing relative mass, at which (12a) and (12b) fail.
  • The page identifies the limit of the gap ratios as the scale constant AAA of a functional equation; milestone 4 states it as epce^{pc}epc, the gap ratio of the jumps of Πp,c\Pi_{p,c}Πp,c​.
  • Theorem 5 prints "distribution fuction"; this typo is kept in the quoted text only.

No statement is trivialized: Dr(Πp,c)D_r(\Pi_{p,c})Dr​(Πp,c​) is nonempty (the geometric law on {0,1,2,… }\{0,1,2,\dots\}{0,1,2,…} lies in Dr(Πp,0)D_r(\Pi_{p,0})Dr​(Πp,0​)), and Theorem 5 is not a definitional unfolding, since DrD_rDr​ is defined by weak convergence and the right-hand side by discrete approximation.

A complete development needs: weak convergence of distribution functions at continuity points, a convergence-of-types lemma on a half line (the Remark after Lemma 1 of the paper, p. 795), and elementary facts on step functions. The first two are reusable across the whole paper and across extreme-value theory. Contributions of either half of the theorem, or of the convergence-of-types lemma, are welcome.

Selected references

  • A. A. Balkema, L. de Haan, Residual Life Time at Great Age, The Annals of Probability 2 (1974), no. 5, 792–804. https://doi.org/10.1214/aop/1176996548
  • J. Pickands III, Statistical Inference Using Extreme Order Statistics, The Annals of Statistics 3 (1975), 119–131. https://doi.org/10.1214/aos/1176343003
  • B. V. Gnedenko, Sur la distribution limite du terme maximum d'une série aléatoire, Annals of Mathematics 44 (1943), 423–453. https://doi.org/10.2307/1968974
  • L. de Haan, On Regular Variation and Its Application to the Weak Convergence of Sample Extremes, Mathematical Centre Tracts 32, Amsterdam, 1970.
9 thms1 active userReviewed
CombinatoricsGraph TheoryProbability+1·Captain: mikedeng1

Inapproximability of Edge-Disjoint Paths and Low Congestion Routing on Undirected Graphs: A Random Hypergraph Instance Gives the Flow Relaxation an Integrality Gap of β₁/(4c) at Congestion c − 1Research Paper

Motivation

In the edge-disjoint paths problem (EDP) one is given an undirected graph and a list of source–sink pairs, and asks how many pairs can be connected simultaneously by paths that share no edge. Its relaxation EDP with congestion (EDPwC) allows every edge to carry up to a fixed number of paths. Both are central problems of network routing and of approximation algorithms, and the standard algorithmic tool for them is the multicommodity flow relaxation: a linear program that may split each pair's unit of demand fractionally over many paths. Rounding this LP is how most approximation algorithms for routing work, so the ratio between its optimum and the best integral routing, the integrality gap, bounds what any LP-based algorithm can achieve.

Without congestion the gap of this relaxation can be as large as Ω(V)\Omega(\sqrt V)Ω(V​) (Chekuri–Khanna–Shepherd 2006), and the question is how much a small congestion helps. Andrews, Chuzhoy, Guruswami, Khanna, Talwar and Zhang (Combinatorica 2010) proved hardness of approximation for EDPwC (their Theorems 1 and 2) and, independently and unconditionally, that the gap of the relaxation remains (log⁡V)Ω(1/c)(\log V)^{\Omega(1/c)}(logV)Ω(1/c) even when the integral solution may use congestion c−1c-1c−1 (their Theorem 5). In particular, for every fixed integer iii the gap between (1/i)(1/i)(1/i)-integral and fractional multicommodity flow in undirected graphs is superconstant. This mission formalizes Theorem 5 for EDPwC.

Setting

Fix integers n≥1n\ge1n≥1 and c≥2c\ge2c≥2. Write log⁡\loglog for log⁡2\log_2log2​ and ln⁡\lnln for the natural logarithm, and set

β1=14(log⁡n150(log⁡log⁡n)2)1/c,β2=6(2β1)c−1ln⁡β1.\beta_1=\frac14\Big(\frac{\log n}{150(\log\log n)^2}\Big)^{1/c},\qquad \beta_2=6(2\beta_1)^{c-1}\ln\beta_1 .β1​=41​(150(loglogn)2logn​)1/c,β2​=6(2β1​)c−1lnβ1​.

A random ccc-uniform hypergraph HHH on the vertex set {0,…,n−1}\{0,\dots,n-1\}{0,…,n−1} has m=⌊β2n⌋m=\lfloor\beta_2 n\rfloorm=⌊β2​n⌋ hyperedges h0,…,hm−1h_0,\dots,h_{m-1}h0​,…,hm−1​, chosen independently, each uniformly among the ccc-element subsets of the vertices.

From HHH one builds a graph G=G(H)G=G(H)G=G(H). For every hyperedge hih_ihi​ it has two vertices ℓi,ri\ell_i,r_iℓi​,ri​ joined by a special edge; for every vertex vvv of HHH it has a source s(v)s(v)s(v) and a sink t(v)t(v)t(v). If vvv lies in the hyperedges hi1,…,hikh_{i_1},\dots,h_{i_k}hi1​​,…,hik​​ with i1<⋯<iki_1<\dots<i_ki1​<⋯<ik​, the regular edges (s(v),ℓi1)(s(v),\ell_{i_1})(s(v),ℓi1​​), (rij,ℓij+1)(r_{i_j},\ell_{i_{j+1}})(rij​​,ℓij+1​​) for 1≤j<k1\le j<k1≤j<k, and (rik,t(v))(r_{i_k},t(v))(rik​​,t(v)) are added. The canonical path of vvv is P(v)=(s(v),ℓi1,ri1,…,ℓik,rik,t(v))P(v)=(s(v),\ell_{i_1},r_{i_1},\dots,\ell_{i_k},r_{i_k},t(v))P(v)=(s(v),ℓi1​​,ri1​​,…,ℓik​​,rik​​,t(v)); it crosses the special edge of every hyperedge containing vvv. The EDP instance has one pair (s(v),t(v))(s(v),t(v))(s(v),t(v)) for each vvv.

A feasible fractional solution puts flow f(P)∈[0,1]f(P)\in[0,1]f(P)∈[0,1] on s(v)s(v)s(v)–t(v)t(v)t(v) paths PPP, with routed amount xv=∑Pf(P)≤1x_v=\sum_P f(P)\le1xv​=∑P​f(P)≤1 for each pair and at most one unit of flow through each edge; its value is ∑vxv\sum_v x_v∑v​xv​. An integral routing with congestion at most c−1c-1c−1 connects a set of pairs, each by one path, so that every edge lies on at most c−1c-1c−1 of these paths; its value is the number of connected pairs.

The analysis uses three events of HHH: E1\mathcal E_1E1​, that some set of n/β1n/\beta_1n/β1​ vertices contains no hyperedge; E2\mathcal E_2E2​, that more than n/β1n/\beta_1n/β1​ vertices lie in more than 10β2c10\beta_2c10β2​c hyperedges; and E3(g)\mathcal E_3(g)E3​(g), that the graph G′G'G′ obtained from GGG by contracting every special edge has more than (6β2c2)g+1(6\beta_2c^2)^{g+1}(6β2​c2)g+1 cycles of length at most ggg.

Formalization targets

Goal: Theorem 5 for EDPwC, in the explicit form of Section 2

There are absolute constants α>0\alpha>0α>0 and N0N_0N0​ such that for all n≥N0n\ge N_0n≥N0​ and all integers ccc with 2≤c≤αlog⁡log⁡n/log⁡log⁡log⁡n2\le c\le\alpha\log\log n/\log\log\log n2≤c≤αloglogn/logloglogn some hypergraph HHH as above satisfies

∃ fractional solution of G(H) of value ncandevery congestion-(c−1) routing of G(H) routes ≤4nβ1 pairs,\exists\ \text{fractional solution of } G(H)\ \text{of value } \frac nc\qquad\text{and}\qquad \text{every congestion-}(c-1)\text{ routing of } G(H)\ \text{routes}\ \le\frac{4n}{\beta_1}\ \text{pairs},∃ fractional solution of G(H) of value cn​andevery congestion-(c−1) routing of G(H) routes ≤β1​4n​ pairs,

so the integrality gap is at least β1/(4c)\beta_1/(4c)β1​/(4c). The paper's Theorem 5 states this as Ω(1c(log⁡V/(log⁡log⁡V)2)1/(c+1))\Omega\big(\frac1{c}(\log V/(\log\log V)^2)^{1/(c+1)}\big)Ω(c1​(logV/(loglogV)2)1/(c+1)) for congestion ccc and VVV vertices; the goal keeps the paper's own Section 2 parameters, which fix the instance and leave the constants α,N0\alpha,N_0α,N0​ open.

Milestones

Lemma 6, Lemma 7 and Lemma 8 (Pr⁡[E1],Pr⁡[E2],Pr⁡[E3(g)]≤14\Pr[\mathcal E_1],\Pr[\mathcal E_2],\Pr[\mathcal E_3(g)]\le\frac14Pr[E1​],Pr[E2​],Pr[E3​(g)]≤41​); the joint good event of Section 2.4; the fractional solution of value n/cn/cn/c; and the three bounds of the gap analysis, ∣P1∣≤n/β1|\mathcal P_1|\le n/\beta_1∣P1​∣≤n/β1​ (canonical paths), ∣P2∣≤n/β1|\mathcal P_2|\le n/\beta_1∣P2​∣≤n/β1​ (long non-canonical paths), ∣P3∣≤n/β1+2gc(6β2c2)2g+2|\mathcal P_3|\le n/\beta_1+2gc(6\beta_2c^2)^{2g+2}∣P3​∣≤n/β1​+2gc(6β2​c2)2g+2 (short non-canonical paths), combined into ∣P′∣≤4n/β1|\mathcal P'|\le4n/\beta_1∣P′∣≤4n/β1​.

Significance

The result shows that the multicommodity flow relaxation cannot certify a constant-factor approximation for undirected EDPwC with any constant congestion: against integral solutions of congestion c−1c-1c−1 its gap is at least (log⁡V)Ω(1/c)(\log V)^{\Omega(1/c)}(logV)Ω(1/c). Any algorithm that compares its output with this LP inherits the bound. It complements the paper's hardness results, which hold only under a complexity assumption. The instance is a short explicit construction from a random hypergraph, so the theorem is also a statement in probabilistic combinatorics: random sparse uniform hypergraphs are, with constant probability, simultaneously "covering" (no large hyperedge-free set), of bounded degree, and nearly free of short cycles.

The result is proved in the paper; to our knowledge it has no machine-checked proof. The mission produces one: a formal model of the path LP and of congestion-bounded integral routings on simple graphs, reusable for other routing gaps; a formal random-hypergraph model with first-moment and Chernoff-type estimates; and the deterministic gap analysis. Variants with better constants, or the stronger statement that at least a quarter of all hypergraphs work, are welcome as additional results.

Difficulty

The fractional side and the bound on canonical routings are short. The difficulty lies in two places. First, Lemma 8 bounds the expected number of short cycles of G′G'G′; the adjacency of G′G'G′ depends on all hyperedges at once (consecutiveness along each vertex's sequence), and the obvious estimate through the intersection graph of HHH fails, because many hyperedges through a common vertex form a clique there. What keeps the count small is the order structure of each vertex's hyperedge sequence, which the intersection graph forgets. Second, the bound on short non-canonical paths requires turning two distinct routing paths of a pair into a short cycle of the contracted graph and charging it with the congestion constraint. Finally, the closing estimate 2gc(6β2c2)2g+2≤n/β12gc(6\beta_2c^2)^{2g+2}\le n/\beta_12gc(6β2​c2)2g+2≤n/β1​ holds only for large nnn in the stated range of ccc, and the printed chain for it is not literally correct, so the asymptotics have to be done afresh.

Formalization scope

Vertices of HHH are Fin n, hyperedges are indexed by Fin m with m=⌊β2n⌋m=\lfloor\beta_2n\rfloorm=⌊β2​n⌋, and HHH is an element of Fin m → {s : Finset (Fin n) // s.card = c}; probabilities are normalized counts over this finite set (uniform measure, which is independence of the hyperedges). The conventions are:

  • log⁡=log⁡2\log=\log_2log=log2​ and ln⁡\lnln is natural; β1\beta_1β1​ uses a real 1/c1/c1/c-th power.
  • The paper's integers β2n\beta_2nβ2​n, n/β1n/\beta_1n/β1​ (bad-set size) and g=3β1β2c2g=3\beta_1\beta_2c^2g=3β1​β2​c2 are ⌊β2n⌋\lfloor\beta_2n\rfloor⌊β2​n⌋, ⌈n/β1⌉\lceil n/\beta_1\rceil⌈n/β1​⌉ and ⌈3β1β2c2⌉\lceil3\beta_1\beta_2c^2\rceil⌈3β1​β2​c2⌉; the thresholds n/β1n/\beta_1n/β1​, 4n/β14n/\beta_14n/β1​, 10β2c10\beta_2c10β2​c, (6β2c2)g+1(6\beta_2c^2)^{g+1}(6β2​c2)g+1 stay real.
  • "For sufficiently large nnn" and c≤O(log⁡log⁡n/log⁡log⁡log⁡n)c\le O(\log\log n/\log\log\log n)c≤O(loglogn/logloglogn) become absolute constants N0N_0N0​ and α\alphaα, quantified before nnn and ccc. Lemma 8 and the deterministic bounds carry instead the explicit inequalities on β1,β2\beta_1,\beta_2β1​,β2​ their arguments use.
  • G(H)G(H)G(H) is a simple graph (coinciding regular edges are one edge). A vertex in no hyperedge gets the edge (s(v),t(v))(s(v),t(v))(s(v),t(v)), the k=0k=0k=0 case of its canonical path; the page leaves this case out.
  • KgK_gKg​ counts cycles of G′G'G′, each once as an edge set; the paper's definition says "in GGG", its proof and use say G′G'G′.
  • Routing paths are paths (no repeated vertex); lengths count edges of G(H)G(H)G(H); canonicity is equality of vertex sequences.

The goal cannot be met by an unrelated graph: the instance must be G(H)G(H)G(H) for a hypergraph with exactly ⌊β2n⌋\lfloor\beta_2n\rfloor⌊β2​n⌋ hyperedges of size ccc on nnn vertices, the fractional solution must respect xv≤1x_v\le1xv​≤1 and capacity 111, and the integral bound is over all routings of congestion c−1c-1c−1.

Not in scope: the ANFwC half of Theorem 5, the remark on a superconstant gap at c=Θ(log⁡log⁡V/(log⁡log⁡log⁡V)2)c=\Theta(\log\log V/(\log\log\log V)^2)c=Θ(loglogV/(logloglogV)2), and the hardness results of Sections 3–5 (Theorems 1 and 2, Corollaries 3 and 4).

A complete development needs Chernoff and Markov bounds for counting measures, binomial-coefficient estimates, cycle extraction from two distinct paths in a simple graph, and the asymptotic estimates for β1,β2\beta_1,\beta_2β1​,β2​. The routing and LP definitions and the cycle-extraction lemma are reusable beyond this mission.

Selected references

  • M. Andrews, J. Chuzhoy, V. Guruswami, S. Khanna, K. Talwar, L. Zhang, Inapproximability of Edge-Disjoint Paths and Low Congestion Routing on Undirected Graphs, Combinatorica 30(5), 485–520, 2010. https://doi.org/10.1007/s00493-010-2455-9
  • C. Chekuri, S. Khanna, F. B. Shepherd, An O(n)O(\sqrt n)O(n​) approximation and integrality gap for disjoint paths and unsplittable flow, Theory of Computing 2, 137–146, 2006. https://doi.org/10.4086/toc.2006.v002a007
12 thms1 active userReviewed
ProbabilityStatistics·Captain: mikedeng1

Simulation Output Analysis Using Standardized Time Series 2: Every STS Interval Has liminf n^{1/2} E Lₙ ≥ 2σΦ⁻¹(1 − δ/2)Research Paper

Why expected interval length matters

A simulation run often estimates a steady-state mean without producing independent observations. A confidence interval must account for dependence in the output, and the relevant variance constant may be unknown. Standardized time series (STS) methods use the shape of an integrated output path to cancel that constant rather than estimating it separately. The resulting interval can be computed from one run, but its length can vary substantially with the chosen standardizing functional. Glynn and Iglehart introduced a common functional framework for these methods and asked how short their expected intervals can be as the run grows. Their 1990 paper identifies a universal lower bound.

The comparison is operational. A shorter confidence interval conveys a more precise estimate at the same nominal coverage. The authors also compare STS with procedures that consistently estimate the variance constant. They state that the lower bound is attained by the latter procedures and approached, but not attained, by STS intervals. The present mission isolates the bound for STS itself, Corollary 4.16. It does not make the claim that a particular STS rule attains it. This distinction follows the paper's introduction and §4.

The stochastic setting

Let Y(t)Y(t)Y(t) be a real simulation output process for t≥0t\ge0t≥0. Its integrated average path at run length nnn is Y‾n(t)=n−1∫0ntY(s) ds\overline Y_n(t)=n^{-1}\int_0^{nt}Y(s)\,dsYn​(t)=n−1∫0nt​Y(s)ds for 0≤t≤10\le t\le10≤t≤1. The unknown steady-state mean is μ\muμ. The paper assumes a functional central limit theorem in the space C[0,1]C[0,1]C[0,1] of continuous real paths:

Xn(t):=n(Y‾n(t)−μt) ⇒ σB(t),σ>0,X_n(t):=\sqrt n\bigl(\overline Y_n(t)-\mu t\bigr) \ \Rightarrow\ \sigma B(t),\qquad \sigma>0,Xn​(t):=n​(Yn​(t)−μt) ⇒ σB(t),σ>0,

where BBB is standard Brownian motion. Convergence is weak convergence of random continuous paths in the uniform topology. This is Assumption (2.1), rather than a claim that every output process satisfies it. The paper lists several classes of processes for which such a theorem is available under further conditions (§2, pp. 2–3).

An STS scale functional g:C[0,1]→Rg:C[0,1]\to\mathbb Rg:C[0,1]→R belongs to M\mathcal MM when it is measurable, positively homogeneous, unchanged by subtracting any multiple of the identity path k(t)=tk(t)=tk(t)=t, positive at BBB almost surely, and continuous at BBB almost surely. The last two conditions ensure that the Brownian ratio is a meaningful distributional limit. The paper also describes these functionals through the bridge map (Γx)(t)=x(t)−tx(1)(\Gamma x)(t)=x(t)-t x(1)(Γx)(t)=x(t)−tx(1): a member of M\mathcal MM can be written as b∘Γb\circ\Gammab∘Γ for a suitable bbb. Thus the scale is determined by a Brownian bridge while the endpoint B(1)B(1)B(1) is independent of it (Propositions 2.7–2.8).

Define H(x)=P{B(1)/g(B)≤x}H(x)=P\{B(1)/g(B)\le x\}H(x)=P{B(1)/g(B)≤x}. For a confidence level 1−δ1-\delta1−δ, choose endpoints α,β\alpha,\betaα,β with H(β)−H(α)=1−δH(\beta)-H(\alpha)=1-\deltaH(β)−H(α)=1−δ. The STS confidence interval from equation (2.10) has endpoints Y‾n(1)−g(Y‾n)β\overline Y_n(1)-g(\overline Y_n)\betaYn​(1)−g(Yn​)β and Y‾n(1)−g(Y‾n)α\overline Y_n(1)-g(\overline Y_n)\alphaYn​(1)−g(Yn​)α. Its length is Ln=g(Y‾n)(β−α)L_n=g(\overline Y_n)(\beta-\alpha)Ln​=g(Yn​)(β−α). Here δ\deltaδ lies strictly between zero and one; the endpoint equation is part of the construction, not an arbitrary choice.

Formalization target

The goal is Corollary 4.16 for every nonnegative g∈Mg\in\mathcal Mg∈M under Assumption (2.1). Write Φ\PhiΦ for the standard normal distribution function and p=Φ−1(1−δ/2)p=\Phi^{-1}(1-\delta/2)p=Φ−1(1−δ/2). Then

lim inf⁡n→∞n E[Ln] ≥ 2σp=2σΦ−1(1−δ/2).\liminf_{n\to\infty}\sqrt n\,E[L_n] \ \ge\ 2\sigma p =2\sigma\Phi^{-1}(1-\delta/2).n→∞liminf​n​E[Ln​] ≥ 2σp=2σΦ−1(1−δ/2).

The expectation and liminf admit +∞+\infty+∞. The statement does not impose an integrability assumption that would remove that case. It quantifies over every admissible STS functional and every interval whose endpoints have the specified Brownian confidence mass (Corollary 4.16, p. 12).

Three substantial targets precede the corollary. Proposition 4.1(a) relates scaled expected length to σE[g(B)](β−α)\sigma E[g(B)](\beta-\alpha)σE[g(B)](β−α). Proposition 4.3 says a symmetric choice of α,β\alpha,\betaα,β minimizes β−α\beta-\alphaβ−α. Theorem 4.8 gives E[g(B)]Φg−1(1−δ/2)≥Φ−1(1−δ/2)E[g(B)]\Phi^{-1}_g(1-\delta/2)\ge\Phi^{-1}(1-\delta/2)E[g(B)]Φg−1​(1−δ/2)≥Φ−1(1−δ/2), where Φg−1\Phi^{-1}_gΦg−1​ denotes the quantile of HHH. The milestone list also includes the cited Brownian independence, mixture distribution, scale invariance, and continuous mapping statements that put these targets in context.

What the bound establishes

The corollary supplies a benchmark for the asymptotic expected length of any interval in this STS class. A proposed standardizing functional cannot beat the normal-quantile constant while retaining the stated functional limit and confidence construction. It also identifies the quantity against which the paper's other interval procedures can be compared. The bound applies uniformly to the class M\mathcal MM, not to a chosen batch size or a particular form of ggg (Glynn–Iglehart 1990, §4).

The mathematical result has been proved in the source paper. This mission supplies formal statements and their shared definitions as proof targets; it does not claim that their Lean proofs already exist. A complete development would formalize the known arguments for the milestones and corollary, including the Brownian path representation, weak convergence, quantile properties, and expectation inequalities. Those components could be reused in other work on simulation output analysis and ratios of weakly convergent processes.

Where the formal proof is demanding

Weak convergence alone does not imply convergence of expectations. In particular, a continuous mapping limit for g(Xn)g(X_n)g(Xn​) cannot simply be integrated as an ordinary finite real expectation when the family is not uniformly integrable. Proposition 4.1(a) asks only for a lower bound, and its statement must still account for E[g(B)]=+∞E[g(B)]=+\inftyE[g(B)]=+∞. This is why the goal is expressed with a liminf and extended nonnegative expectations rather than a real-valued limit. A separate difficulty is that the interval width depends jointly on a distributional scale and a choice of two quantiles. Bounding either one in isolation does not state the corollary.

Formalization scope and conventions

Paths are Mathlib's C([0,1],R)C([0,1],\mathbb R)C([0,1],R) with its uniform metric and Borel sigma algebra. A standard Brownian motion is a measurable random continuous path agreeing with an R≥0\mathbb R_{\ge0}R≥0​-indexed real Brownian motion on [0,1][0,1][0,1]. The paper's discontinuity set D(g)D(g)D(g) is the set where ggg is not continuous. Assumption (2.1) includes joint measurability of YYY and finite-interval pathwise integrability so that each integrated average is defined. The path Y‾n\overline Y_nYn​ is supplied together with its defining integral equation, which determines it pointwise. Its values are not free parameters.

Indices nnn are natural numbers. At n=0n=0n=0, the average uses Lean's total division and is zero; this initial value does not affect an asymptotic statement. The positive Brownian scale σ\sigmaσ is finite. The parameters satisfy 0<δ<10<\delta<10<δ<1, and H(β)−H(α)=1−δH(\beta)-H(\alpha)=1-\deltaH(β)−H(α)=1−δ. The normal and STS quantiles appear as real parameters pinned by their distribution-function equations, avoiding an unbounded or empty real infimum. Expected nonnegative lengths and scales are integrals valued in R≥0∪{+∞}\mathbb R_{\ge0}\cup\{+\infty\}R≥0​∪{+∞}. The class N\mathcal NN explicitly requires measurability of bbb, the standing convention needed for its equality with M\mathcal MM.

The corollary retains the entire class M\mathcal MM and Assumption (2.1), with g≥0g\ge0g≥0 on all continuous paths. It cannot be replaced by a statement about a single easy functional or by assuming the bound on an auxiliary criterion. Useful contributions include the Brownian bridge independence theorem, the normal scale-mixture identity, distribution-function regularity, and the asymptotic expectation result.

Selected references

  • P. W. Glynn and D. L. Iglehart, Simulation output analysis using standardized time series, Mathematics of Operations Research 15(1):1–16, 1990. DOI: 10.1287/moor.15.1.1.
11 thms1 active userReviewed
Algorithmic Game TheoryConvex OptimizationOptimization·Captain: mikedeng1

Cooperative Fuzzy Games 2: A Game with Side Payments Has a Nonempty Core Iff It Is Balanced, and Then Its Core Is the Core of Its Concave Fuzzy ExtensionResearch Paper

Why cores of games with side payments

A cooperative game with side payments assigns to each coalition of players the total payoff it can secure on its own and share freely among its members. The core is the set of ways of dividing the payoff of the grand coalition that no coalition can improve upon. It is the basic stability notion of cooperative game theory and of its applications in operations research: cost allocation for shared facilities, network design, inventory pooling and linear production games all ask whether a core allocation exists and what it looks like.

The core can be empty, and the question of when it is not was answered independently by Bondareva (1963) and Shapley (1967): the core is nonempty exactly when the game is balanced, a linear-programming condition on weighted families of coalitions. Scarf (1967) extended the existence half to games without side payments, and Billera (1970) recast balancedness for those games.

Aubin's Cooperative Fuzzy Games (Math. Oper. Res. 6(1), 1981) reads these results through fuzzy coalitions, in which each player participates at a rate between 0 and 1. In §6 every game on a family of coalitions is extended to a concave positively homogeneous function of fuzzy coalitions, and the Bondareva–Shapley theorem becomes a statement about that extension. This mission formalizes §2 and §6 of the paper: the core of a fuzzy game with side payments, its superdifferential description, and Proposition 6.1.

Setting

Let N={1,…,n}N=\{1,\dots,n\}N={1,…,n} be the set of players. A coalition A⊆NA\subseteq NA⊆N is identified with its characteristic vector τA∈{0,1}n\tau^A\in\{0,1\}^nτA∈{0,1}n, and τN=(1,…,1)\tau^N=(1,\dots,1)τN=(1,…,1). A fuzzy coalition is a vector τ∈[0,1]n\tau\in[0,1]^nτ∈[0,1]n, where τi\tau_iτi​ is the rate at which player iii participates.

A fuzzy game with side payments is a worth function vvv with v(0)=0v(0)=0v(0)=0 that is positively homogeneous, v(tτ)=t v(τ)v(t\tau)=t\,v(\tau)v(tτ)=tv(τ) for t>0t>0t>0. Homogeneity extends vvv from [0,1]n[0,1]^n[0,1]n to the orthant R+n\mathbb R^n_+R+n​. Its core is

core⁡(v)={c∈Rn: ∑i∈Nci=v(τN),  ∑i∈Nτici≥v(τ) for all τ∈[0,1]n},\operatorname{core}(v)=\Big\{c\in\mathbb R^n:\ \sum_{i\in N}c_i=v(\tau^N),\ \ \sum_{i\in N}\tau_ic_i\ge v(\tau)\ \text{for all }\tau\in[0,1]^n\Big\},core(v)={c∈Rn: i∈N∑​ci​=v(τN),  i∈N∑​τi​ci​≥v(τ) for all τ∈[0,1]n},

the allocations that no fuzzy coalition blocks. The superdifferential of vvv at τ\tauτ is ∂v(τ)={c: v(τ)−v(σ)≥∑ici(τi−σi) for all σ∈R+n}\partial v(\tau)=\{c:\ v(\tau)-v(\sigma)\ge\sum_i c_i(\tau_i-\sigma_i)\ \text{for all }\sigma\in\mathbb R^n_+\}∂v(τ)={c: v(τ)−v(σ)≥∑i​ci​(τi​−σi​) for all σ∈R+n​}.

A usual game with side payments is given by a family C\mathscr CC of nonempty coalitions that contains NNN and every singleton {i}\{i\}{i}, and by a worth v(A)∈Rv(A)\in\mathbb Rv(A)∈R for each A∈CA\in\mathscr CA∈C. Its core is the set of c∈Rnc\in\mathbb R^nc∈Rn with ∑i∈Nci=v(N)\sum_{i\in N}c_i=v(N)∑i∈N​ci​=v(N) and ∑i∈Aci≥v(A)\sum_{i\in A}c_i\ge v(A)∑i∈A​ci​≥v(A) for every A∈CA\in\mathscr CA∈C. For τ∈R+n\tau\in\mathbb R^n_+τ∈R+n​, C(τ)\mathscr C(\tau)C(τ) is the set of nonnegative weights m(A)m(A)m(A), A∈CA\in\mathscr CA∈C, with ∑A∋im(A)=τi\sum_{A\ni i}m(A)=\tau_i∑A∋i​m(A)=τi​ for each player iii, and

πv(τ)=sup⁡m∈C(τ) ∑A∈Cm(A) v(A).\pi v(\tau)=\sup_{m\in\mathscr C(\tau)}\ \sum_{A\in\mathscr C}m(A)\,v(A).πv(τ)=m∈C(τ)sup​ A∈C∑​m(A)v(A).

The game is balanced if πv(τN)=v(N)\pi v(\tau^N)=v(N)πv(τN)=v(N).

Formalization targets

Goal: Proposition 6.1

core⁡(v)≠∅  ⟺  πv(τN)=v(N),and thencore⁡(v)=core⁡(πv).\operatorname{core}(v)\neq\emptyset\iff \pi v(\tau^N)=v(N),\qquad\text{and then}\qquad \operatorname{core}(v)=\operatorname{core}(\pi v).core(v)=∅⟺πv(τN)=v(N),and thencore(v)=core(πv).

The first half is the Bondareva–Shapley theorem for an arbitrary family C\mathscr CC. The second identifies the core of the discrete game with the core of the fuzzy game πv\pi vπv.

Milestones

  1. §2 (4)–(5). For a positively homogeneous vvv with v(0)=0v(0)=0v(0)=0, core⁡(v)=∂v(τN)\operatorname{core}(v)=\partial v(\tau^N)core(v)=∂v(τN).
  2. Remark 2.1. Such a vvv is concave on R+n\mathbb R^n_+R+n​ if and only if it is superadditive, v(τ+σ)≥v(τ)+v(σ)v(\tau+\sigma)\ge v(\tau)+v(\sigma)v(τ+σ)≥v(τ)+v(σ).
  3. Proposition 2.1. If vvv is moreover concave, its core is convex, compact and nonempty; if vvv is differentiable at τN\tau^NτN, the core is {Dv(τN)}\{Dv(\tau^N)\}{Dv(τN)}.
  4. §6 (5). If m∈C(τ)m\in\mathscr C(\tau)m∈C(τ) and m(A)>0m(A)>0m(A)>0, then A⊆Aτ={i:τi>0}A\subseteq A_\tau=\{i:\tau_i>0\}A⊆Aτ​={i:τi​>0}.
  5. §6 (2). πv\pi vπv is the smallest concave positively homogeneous function on R+n\mathbb R^n_+R+n​ with πv(τA)≥v(A)\pi v(\tau^A)\ge v(A)πv(τA)≥v(A) for every A∈CA\in\mathscr CA∈C.
  6. §6, after (6). The core of the fuzzy game πv\pi vπv is nonempty, convex and compact, whether or not vvv is balanced.

Significance

Proposition 6.1 is the standard criterion for the existence of core allocations in transferable-utility games. In operations research it is the tool behind core results for linear production games, flow games, facility location and inventory games: one exhibits a family of balancing weights, or the absence of one, and reads off whether a stable cost or profit allocation exists. Aubin's version adds that a balanced game's core is the superdifferential of a concave function, so it is described by convex analysis and, when πv\pi vπv is smooth at τN\tau^NτN, reduces to a single point given by the gradient.

The result is classical and proved in the literature. To our knowledge, no machine-checked proof of the Bondareva–Shapley theorem exists in Mathlib or on this platform: the platform has results on cores of convex (supermodular) games, which are a different hypothesis. The mission therefore produces a first formal proof of the theorem for a general family C\mathscr CC of coalitions, the superdifferential description of the fuzzy core, and the minimality of the concave extension πv\pi vπv. The definitions (fuzzy coalitions, balances, πv\pi vπv) are reusable by later missions on games without side payments and on values of fuzzy games.

Difficulty

The inclusion core⁡(v)⊆core⁡(πv)\operatorname{core}(v)\subseteq\operatorname{core}(\pi v)core(v)⊆core(πv) and the necessity of balancedness are short computations with the balancing weights. The difficulty is sufficiency: from πv(τN)=v(N)\pi v(\tau^N)=v(N)πv(τN)=v(N), a core allocation has to be produced. This is an existence statement for a system of linear inequalities, and it needs a duality or separation argument. Mathlib's finite-dimensional linear programming duality and separation theorems do not apply off the shelf, because πv\pi vπv is a supremum over a polytope of weights indexed by coalitions, and its attainment and finiteness must be established first. Proposition 2.1 similarly needs the existence of supergradients of a concave function at an interior point and their compactness, which are not packaged for functions defined only on an orthant.

Formalization scope

Players are Fin n; multiutilities and fuzzy coalitions are Fin n → ℝ with the coordinatewise order, and the cube is Set.Icc 0 1. The commitments are:

  • A fuzzy game is a function on Rn\mathbb R^nRn whose values off the orthant are never used; v(0)=0v(0)=0v(0)=0 and homogeneity for every t>0t>0t>0 and τ≥0\tau\ge0τ≥0 are hypotheses of every §2 statement, because §2 states them once for the whole section. Concavity is concavity on R+n\mathbb R^n_+R+n​.
  • In the superdifferential (5), σ\sigmaσ ranges over R+n\mathbb R^n_+R+n​, the domain of the extended vvv; the paper leaves this implicit.
  • "Differentiable at τN\tau^NτN" is DifferentiableAt at the interior point (1,…,1)(1,\dots,1)(1,…,1), and Dv(τN)Dv(\tau^N)Dv(τN) is the vector of partial derivatives.
  • The family C\mathscr CC contains NNN and all singletons and excludes ∅\emptyset∅; the core and πv\pi vπv use only coalitions in C\mathscr CC, so v(∅)=0v(\emptyset)=0v(∅)=0 plays no role. Because N∈CN\in\mathscr CN∈C and ∅∉C\emptyset\notin\mathscr C∅∈/C, the family exists only for n≥1n\ge1n≥1.
  • πv\pi vπv is a real supremum. For τ≥0\tau\ge0τ≥0 the set of values is nonempty and bounded above, so the value is the paper's; off the orthant the set is empty and the value is never used.
  • The printed v(C)v(\mathscr C)v(C) and τC\tau^{\mathscr C}τC in §6 (2)–(3) are read as v(A)v(A)v(A) and τA\tau^AτA, as §6 (4) settles.

Balancedness is the equation πv(τN)=v(N)\pi v(\tau^N)=v(N)πv(τN)=v(N) with πv\pi vπv built from the balances of §6 (3)–(4); a formalization that defines "balanced" through the core, or takes πv\pi vπv to be an envelope already known to agree with the core, makes the goal empty and is ruled out. Contributions welcome: proofs of the milestones, a general Bondareva–Shapley lemma for finite families of coalitions, and supergradient existence for concave functions on convex sets with nonempty interior.

Selected references

  • J.-P. Aubin, Cooperative Fuzzy Games, Mathematics of Operations Research 6(1), 1981, 1–13. https://doi.org/10.1287/moor.6.1.1
  • O. N. Bondareva, Some applications of linear programming methods to the theory of cooperative games, Problemy Kibernetiki 10, 1963, 119–139 (in Russian; no stable online copy).
  • L. S. Shapley, On balanced sets and cores, Naval Research Logistics Quarterly 14(4), 1967, 453–460. https://doi.org/10.1002/nav.3800140404
  • H. E. Scarf, The core of an N person game, Econometrica 35(1), 1967, 50–69. https://doi.org/10.2307/1909703
  • L. J. Billera, Some theorems on the core of an n-person game without side-payments, SIAM Journal on Applied Mathematics 18(3), 1970, 567–579. https://doi.org/10.1137/0118007
  • R. T. Rockafellar, Convex Analysis, Princeton University Press, 1970. https://doi.org/10.1515/9781400873173
9 thms1 active userReviewed
CombinatoricsGraph Theory·Captain: mikedeng1

Paths, Trees, and Flowers II: Invariance of the Dual — the Outer Vertices O(G) Are Exactly the Vertices Left Exposed by Some Maximum MatchingResearch Paper

Motivation

A maximum matching of a graph is a largest set of edges no two of which share a vertex. Maximum matchings are rarely unique, and a basic question is which features of them are forced by the graph. J. Edmonds' paper Paths, trees, and flowers (Canad. J. Math. 17 (1965), 449–467) gave the first polynomial-time algorithm for maximum matching in general graphs. Its Section 6, Invariance of the dual, uses the output of that algorithm to answer this question. The vertices that some maximum matching leaves uncovered, their neighbours, and the rest form a decomposition of the graph that does not depend on the matching chosen or on any choice made by the algorithm.

This decomposition is now called the Gallai–Edmonds structure theorem. T. Gallai obtained it independently (Gallai 1963, 1964; see Selected references). It is a standard tool in matching theory (Lovász–Plummer, Matching Theory, 1986): it determines the minimum odd-set cover of Section 5 of the same paper canonically (6.7), and it underlies the Tutte–Berge formula and the analysis of factor-critical graphs.

Timeline. Berge (1957) characterized maximum matchings by the absence of augmenting paths. Gallai (1963–1964) and Edmonds (1965, §6) proved the structure theorem; Edmonds' proof goes through the trees and shrunken blossoms of his algorithm. Witzgall's argument, reported in 6.6, simplifies the converse half.

Setting

A graph GGG has a finite set of vertices and a finite set of edges, each edge meeting exactly two distinct vertices; parallel edges are allowed. A vertex is exposed for a set of edges MMM if no edge of MMM meets it.

An alternating tree JJJ is a tree (a connected graph with one more vertex than edges) whose vertices are split into inner and outer vertices, so that every edge joins an inner vertex to an outer one and every inner vertex meets exactly two edges of JJJ. A planted tree for MMM with root rrr is an alternating tree such that M∩JM \cap JM∩J is a maximum matching of JJJ and rrr, the vertex of JJJ left exposed by M∩JM \cap JM∩J, is exposed for MMM.

Shrinking a vertex set UUU replaces UUU by a single pseudovertex. Edges inside UUU disappear; edges leaving UUU keep their identity and now meet the pseudovertex. The set UUU is the pseudovertex's complete expansion. A blossom for MMM is an odd circuit BBB for which M∩BM \cap BM∩B is a maximum matching of BBB. Shrinking blossoms repeatedly, inside graphs already shrunk, gives the graph G∗=G/PG^* = G/\mathcal PG∗=G/P, where P\mathcal PP is a partition of the vertices into blossom sets.

Construction 6.0. Let MMM be a maximum matching. Run the matching algorithm on (G,M)(G, M)(G,M) without augmenting. It grows planted trees J1,…,JnJ_1, \dots, J_nJ1​,…,Jn​ in G∗G^*G∗, one from each exposed vertex, and shrinks blossoms as they appear. The output satisfies:

  1. the trees are disjoint and planted for M∗=M/PM^* = M/\mathcal PM∗=M/P;
  2. every exposed vertex of G∗G^*G∗ lies in some tree;
  3. JiJ_iJi​ is Hungarian in G∗−J1−⋯−Ji−1G^* - J_1 - \dots - J_{i-1}G∗−J1​−⋯−Ji−1​: its outer vertices are joined only to its own inner vertices or to earlier trees;
  4. every pseudovertex is an outer vertex of some JiJ_iJi​.

The outer vertices O(G)O(G)O(G) are the vertices whose part is a one-vertex outer vertex of some JiJ_iJi​, together with all vertices of pseudovertex expansions. The inner vertices I(G)I(G)I(G) are the vertices whose part is an inner vertex of some JiJ_iJi​.

Formalization targets

Goal: Theorem 6.2 (a)–(c)

For every maximum matching MMM and every output of construction 6.0:

(a)v∈O(G)  ⟺  ∃ M′ maximum matching of G with v exposed for M′,\text{(a)}\quad v \in O(G) \iff \exists\, M' \text{ maximum matching of } G \text{ with } v \text{ exposed for } M',(a)v∈O(G)⟺∃M′ maximum matching of G with v exposed for M′, (b)v∈I(G)  ⟺  v∉O(G) and v is adjacent to a vertex of O(G),\text{(b)}\quad v \in I(G) \iff v \notin O(G) \text{ and } v \text{ is adjacent to a vertex of } O(G),(b)v∈I(G)⟺v∈/O(G) and v is adjacent to a vertex of O(G), (c)u,v in the same part of P  ⟺  u=v or u,v in the same component of O(G)+,\text{(c)}\quad u,v \text{ in the same part of } \mathcal P \iff u = v \text{ or } u, v \text{ in the same component of } O(G)^+,(c)u,v in the same part of P⟺u=v or u,v in the same component of O(G)+,

where O(G)+O(G)^+O(G)+ is the subgraph induced on O(G)O(G)O(G).

Milestones

  • 4.1–4.2: the maximum matchings of an alternating tree.
  • 4.14: lifting a matching through the complete expansion of a pseudovertex, with a free choice of the exposed vertex.
  • 4.15, extension, in the forest form of 4.20.
  • 6.4: adjacency of outer and inner vertices.
  • 6.2 (b) and 6.2 (c) separately.
  • 6.5: every outer vertex is exposable.
  • 6.6: for non-outer vvv meeting e∈Me \in Me∈M, M−eM - eM−e is maximum in G−vG - vG−v.
  • 6.6: only outer vertices are ever exposed.

A companion item states that construction 6.0 succeeds for every maximum matching.

Significance

The result. Part (a) characterizes, without reference to any algorithm, the vertices that a maximum matching can miss. Parts (b) and (c) then make I(G)I(G)I(G) and G∗G^*G∗ invariants of GGG, as 6.1 announces: "the graph G∗G^*G∗ is uniquely determined by GGG alone". Several consequences rest on this invariance: the unique preferred minimum odd-set cover (6.7), the Tutte–Berge deficiency formula read off from ∣I(G)∣|I(G)|∣I(G)∣ and the components of O(G)+O(G)^+O(G)+, and the classification of graphs into those with and without perfect matchings in terms of a canonical barrier.

Formalizing it. The theorem has been proved since 1964, but the proof in this paper has not been machine-checked. A formalization requires the paper's own objects: multigraphs with edge identity preserved under contraction, nested blossom shrinking, and alternating and planted trees. These are the objects of Edmonds' blossom algorithm, and they are reusable for any formal treatment of it. Mathlib contains Tutte's theorem for simple graphs but neither shrinking nor the Gallai–Edmonds decomposition.

Difficulty

The statement is about one particular output of a nondeterministic process. The partition into trees depends on the order in which they were grown, and the non-matching tree edges and the blossoms chosen are arbitrary (6.1). An outer vertex of a later tree may be joined to an inner vertex of an earlier one, so the individual trees are not Hungarian in G∗G^*G∗. The tempting argument "each tree is Hungarian, so apply the tree lemma tree by tree" therefore fails. Only the ordered condition, applied in both directions as in 6.4, shows that the outer vertices of all trees together are adjacent only to inner vertices. Moving between GGG and G∗G^*G∗ requires lifting matchings through nested blossoms, which means an induction over the nesting rather than over a single odd circuit.

Formalization scope

Graphs are the published EdmondsMatching65.Polyhedron.Graph V E: finite vertex and edge types, an unordered pair of distinct ends for each edge, parallel edges allowed. Matchings are its IsMatching, and "maximum" means maximum cardinality. A matching of a subgraph is a matching of GGG contained in the subgraph's edges. Paths are not needed.

Shrinking is contraction along a Finpartition of the vertex set. The vertices of G∗G^*G∗ are the parts, and the edges of G∗G^*G∗ are the edges of GGG joining different parts. Blossom sets are an inductive predicate recording the nested odd circuits directly; there is no tower of types.

The output of 6.0 is the structure Config60. It records exactly the invariants the construction establishes and nothing more, and the goal is stated for every such configuration. The configuration must not be weakened. Dropping density, the ordered Hungarian condition, the outerness of pseudovertices or the blossom condition on the parts makes (a) or (b) false. Taking the JiJ_iJi​ to be arbitrary trees, or P\mathcal PP an arbitrary partition, would state a different and false theorem. The goal is not vacuous: exists_config_6_0 asserts that a configuration exists for every maximum matching. Shrinking is defined in 4.9 only for connected sets, so the forest form of 4.15 assumes connected parts.

Welcome contributions: the general theory of alternating trees and Hungarian forests (4.2, 4.17 and their forest forms), the lifting lemma 4.14 for nested odd circuits, and a proof of exists_config_6_0.

Selected references

  • J. Edmonds, Paths, trees, and flowers, Canadian Journal of Mathematics 17 (1965), 449–467. https://doi.org/10.4153/CJM-1965-045-4
  • C. Berge, Two theorems in graph theory, Proceedings of the National Academy of Sciences USA 43 (1957), 842–844. https://doi.org/10.1073/pnas.43.9.842
  • T. Gallai, Kritische Graphen II, Publ. Math. Inst. Hungar. Acad. Sci. 8 (1963), 373–395; Maximale Systeme unabhängiger Kanten, ibid. 9 (1964), 401–413.
  • L. Lovász and M. D. Plummer, Matching Theory, North-Holland, 1986 (reprinted AMS Chelsea, 2009). https://doi.org/10.1090/chel/367
  • A. Schrijver, Combinatorial Optimization: Polyhedra and Efficiency, Springer, 2003, Chapter 24.
16 thms1 active userReviewed
Algorithmic Game TheoryConvex OptimizationOptimization·Captain: mikedeng1

Cooperative Fuzzy Games 4: The Fuzzy Core of an Exchange Economy Coincides with Its Set of Walras EquilibriaResearch Paper

Motivation

The core of an exchange economy is the set of allocations that no group of consumers can improve upon by trading only among themselves. The Walras equilibria (competitive equilibria) are the allocations supported by a price system at which every consumer maximizes preference on a budget set. Every Walras equilibrium is in the core, but for a fixed finite economy the core is usually much larger. Edgeworth (1881) conjectured that the core shrinks to the competitive allocations as the number of traders grows; Debreu and Scarf (1963) proved this for replica economies, and Aumann (1964) proved exact equality for an atomless continuum of traders.

Jean-Pierre Aubin's Cooperative Fuzzy Games (Math. Oper. Res. 6 (1981) 1–13) gives a third route to the same conclusion, with a fixed finite number of consumers. Coalitions are allowed to be fuzzy: a consumer may join with any rate of participation between 0 and 1. Once all fuzzy coalitions may block, the core of the economy, now called the fuzzy core, is exactly the set of Walras equilibria (Theorem 4.1, p. 6). The paper presents this as a slight modification of the Debreu–Scarf theorem; in Remark 4.2 it observes that Debreu–Scarf's replica coalitions correspond to the rational points of the cube [0,1]n[0,1]^n[0,1]n.

This mission formalizes §4 of the paper. It is the fourth mission of a series on the paper; the others treat the cores of fuzzy games with and without side payments and the values of smooth fuzzy games.

Setting

There are nnn consumers i∈N={1,…,n}i \in N = \{1,\dots,n\}i∈N={1,…,n} and lll commodities. Consumer iii consumes bundles in R+l\mathbb{R}^l_+R+l​, ranks them by a preference relation ≽i\succcurlyeq_i≽i​ (with strict part ≻i\succ_i≻i​), and owns a set Y(i)⊂RlY(i) \subset \mathbb{R}^lY(i)⊂Rl of possible initial endowments. Each Y(i)Y(i)Y(i) is closed, convex and comprehensive: whenever y∈Y(i)y \in Y(i)y∈Y(i) and z≥0z \ge 0z≥0, also y−z∈Y(i)y - z \in Y(i)y−z∈Y(i).

A fuzzy coalition is a vector τ∈[0,1]n\tau \in [0,1]^nτ∈[0,1]n; τi\tau_iτi​ is the rate at which consumer iii participates, and Aτ={i:τi>0}A_\tau = \{i : \tau_i > 0\}Aτ​={i:τi​>0} is the set of participants. The coalition τ\tauτ disposes of the endowments

Y(τ)=∑i∈Nτi Y(i),Y(\tau) = \sum_{i \in N} \tau_i\, Y(i),Y(τ)=i∈N∑​τi​Y(i),

and its allocations are the families xτ=(xτi)i∈Aτx_\tau = (x_\tau^i)_{i \in A_\tau}xτ​=(xτi​)i∈Aτ​​ of bundles xτi∈R+lx_\tau^i \in \mathbb{R}^l_+xτi​∈R+l​ with ∑iτixτi∈Y(τ)\sum_i \tau_i x_\tau^i \in Y(\tau)∑i​τi​xτi​∈Y(τ); this set is X(τ)X(\tau)X(τ). The allocations of the whole economy are X(N)=X(τN)X(N) = X(\tau^N)X(N)=X(τN), τN=(1,…,1)\tau^N = (1,\dots,1)τN=(1,…,1).

An allocation x∈X(N)x \in X(N)x∈X(N) is in the fuzzy core if there is no nonzero fuzzy coalition τ\tauτ and allocation xτ∈X(τ)x_\tau \in X(\tau)xτ​∈X(τ) with xτi≻ixix_\tau^i \succ_i x^ixτi​≻i​xi for every i∈Aτi \in A_\taui∈Aτ​.

The income of consumer iii at prices p∈Rlp \in \mathbb{R}^lp∈Rl is ri(p)=sup⁡y∈Y(i)p⋅yr_i(p) = \sup_{y \in Y(i)} p\cdot yri​(p)=supy∈Y(i)​p⋅y, and the budget set is Bi(p)={x∈R+l:p⋅x≤ri(p)}B_i(p) = \{x \in \mathbb{R}^l_+ : p \cdot x \le r_i(p)\}Bi​(p)={x∈R+l​:p⋅x≤ri​(p)}. An allocation xˉ∈X(N)\bar x \in X(N)xˉ∈X(N) is a Walras equilibrium if some price pˉ∈Rl\bar p \in \mathbb{R}^lpˉ​∈Rl satisfies, for every iii,

pˉ⋅xˉi=ri(pˉ)andxˉi≽ix  for all x∈Bi(pˉ).\bar p \cdot \bar x^i = r_i(\bar p) \qquad\text{and}\qquad \bar x^i \succcurlyeq_i x \ \text{ for all } x \in B_i(\bar p).pˉ​⋅xˉi=ri​(pˉ​)andxˉi≽i​x  for all x∈Bi​(pˉ​).

Assumption (1) of §4 requires each preference to be continuous and convex, with x≻iy⇒αx+(1−α)y≻iyx \succ_i y \Rightarrow \alpha x + (1-\alpha) y \succ_i yx≻i​y⇒αx+(1−α)y≻i​y for α∈ ]0,1[\alpha \in\, ]0,1[α∈]0,1[; no consumer to be satiated; and each Y(i)Y(i)Y(i) to contain a vector with all coordinates strictly positive.

Formalization targets

Goal: Theorem 4.1

Under assumption (1),

fuzzy core  =  {Walras equilibria}.\text{fuzzy core} \;=\; \{\text{Walras equilibria}\}.fuzzy core={Walras equilibria}.

Milestones, from the proof of Theorem 4.1

  1. Every Walras equilibrium belongs to the fuzzy core.
  2. For an allocation xˉ∈X(N)\bar x \in X(N)xˉ∈X(N), each set Q(i)=Y(i)−{x∈R+l:x≻ixˉi}Q(i) = Y(i) - \{x \in \mathbb{R}^l_+ : x \succ_i \bar x^i\}Q(i)=Y(i)−{x∈R+l​:x≻i​xˉi} is nonempty.
  3. If xˉ\bar xxˉ belongs to the fuzzy core, then
0∉co⁡(⋃i=1nQ(i)).0 \notin \operatorname{co}\Big(\bigcup_{i=1}^n Q(i)\Big).0∈/co(i=1⋃n​Q(i)).

The remaining step of the paper, from milestone 3 to the existence of the equilibrium price, is stated there only as "by known arguments" and is left to the solver as part of the goal.

Significance

The result. Theorem 4.1 is a core equivalence theorem for an economy with finitely many consumers and no replication or continuum of traders. It identifies the competitive allocations as exactly the allocations that are stable against partial coalitions. It also makes visible which coalitions matter: Remark 4.1 attributes the equivalence to the fact that all fuzzy coalitions are allowed to form, so that the set of coalitions is convex. The same fuzzy-coalition device underlies the nonemptiness results for cores of fuzzy games in §5–§7 of the paper.

Formalizing it. The theorem is proved in the paper, in one paragraph that defers its final step to "known arguments". To our knowledge neither the theorem nor the Debreu–Scarf or Aumann core equivalence theorems have been formalized in Lean. A complete development provides a reusable model of an exchange economy with preference relations and comprehensive endowment sets, a checked argument from separation to equilibrium prices, and a template for the classical core equivalence theorems.

Difficulty

The inclusion of the Walras equilibria in the fuzzy core is a budget computation. The converse is the content of the theorem: from the mere absence of improving fuzzy coalitions, a single price vector must be produced that works for all consumers simultaneously. Separating consumer by consumer gives one price per consumer, not a common one, so the coalitional structure has to enter before any price exists. Once a candidate price is available, it still has to be shown nonnegative, each equilibrium bundle has to exhaust its owner's income, and no bundle in a budget set may be strictly preferred; each of these uses a different part of assumption (1), and the paper leaves all three to "known arguments". The incomes ri(p)r_i(p)ri​(p) may be +∞+\infty+∞ for prices with negative coordinates, so finiteness at the equilibrium price is part of the conclusion, not an assumption.

Formalization scope

Consumers are Fin n, commodities Fin l; an allocation is a function Fin n → Fin l → ℝ, a price a vector Fin l → ℝ, and p⋅y=∑kpkykp \cdot y = \sum_k p_k y_kp⋅y=∑k​pk​yk​. A single definitions file (FuzzyGames.Walras.Basic) holds the economy, its assumptions, Y(τ)Y(\tau)Y(τ), X(τ)X(\tau)X(τ), the fuzzy core, incomes, budget sets, Walras equilibria and the sets Q(i)Q(i)Q(i).

The formalization commits to the following readings, each recorded in the items' Formalization Notes:

  • Complete preferences. The paper's "preference preordering" is read, as in Debreu's usage, as a reflexive, transitive and complete relation on R+l\mathbb{R}^l_+R+l​. The relation is a predicate on Rl\mathbb{R}^lRl, but every assumption and every use is restricted to R+l\mathbb{R}^l_+R+l​.
  • Continuity means closed upper and lower contour sets in R+l\mathbb{R}^l_+R+l​; convexity means convex upper contour sets, plus the condition of (1)(i).
  • Assumption (1)(i) is printed with x≽yx \succcurlyeq yx≽y in the premise, which fails at x=yx = yx=y; it is stated with x≻yx \succ yx≻y.
  • Blocking is strict and by nonzero coalitions. The fuzzy-core definition is printed with xτi≽xix_\tau^i \succcurlyeq x^ixτi​≽xi; the proof uses ≻\succ≻, and the weak version would let every allocation block itself. The coalition τ=0\tau = 0τ=0 is excluded, since its condition over Aτ=∅A_\tau = \emptysetAτ​=∅ is vacuous.
  • Dummy coordinates. An allocation of τ\tauτ is a full family of nnn bundles; those with τi=0\tau_i = 0τi​=0 are multiplied by 000, unconstrained and never compared.
  • Y(τ)Y(\tau)Y(τ) is Mathlib's pointwise Minkowski sum of scaled sets.
  • Incomes take values in the extended reals (EReal), so that ri(p)=+∞r_i(p) = +\inftyri​(p)=+∞ is represented and never replaced by a default value.

A trivializing formalization is ruled out: the assumptions are satisfiable, and a sorry-free check (one consumer, one commodity, x≽y  ⟺  x≥yx \succcurlyeq y \iff x \ge yx≽y⟺x≥y, Y(1)=(−∞,1]Y(1) = (-\infty, 1]Y(1)=(−∞,1]) verifies them together with a Walras equilibrium, so neither side of the goal is empty by construction.

Contributions welcome: proofs of the milestones, a separation-to-prices lemma for comprehensive endowment sets, and general facts about complete continuous convex preferences on R+l\mathbb{R}^l_+R+l​, which are reusable for any general equilibrium development.

Selected references

  • J.-P. Aubin, Cooperative fuzzy games, Mathematics of Operations Research 6(1) (1981) 1–13. https://doi.org/10.1287/moor.6.1.1
  • G. Debreu, H. Scarf, A limit theorem on the core of an economy, International Economic Review 4(3) (1963) 235–246. https://doi.org/10.2307/2525290
  • R. J. Aumann, Markets with a continuum of traders, Econometrica 32 (1964) 39–50. https://doi.org/10.2307/1913732
  • G. Debreu, Theory of Value, Cowles Foundation Monograph 17, Yale University Press, 1959.
6 thms1 active userReviewed
Machine LearningOptimization·Captain: mikedeng1

Smart "Predict, then Optimize": Under a Continuous, Centrally Symmetric Cost Law Every Minimizer of the SPO+ Risk Equals E[c|x] and Minimizes the SPO RiskResearch Paper

Motivation

Many decisions are made before their objective coefficients are known. A planner may know the feasible decisions and the form of a linear optimization problem, but must predict its cost vector from available features. Squared prediction error measures how close a forecast is to the eventual coefficients; it need not measure the quality of the decision chosen with that forecast. Elmachtoub and Grigas define a loss based on the excess realized cost of the resulting decision, then introduce a convex surrogate, SPO+, for training prediction rules Elmachtoub and Grigas, 2020, §§2–3.

The central population question is whether minimizing the surrogate still selects predictions that minimize the decision loss when the full data distribution is available. Their Theorem 1 answers this under conditions on the feasible region and the conditional distribution of costs Elmachtoub and Grigas, 2020, p. 21. The result concerns the loss itself, before sample size, model capacity, or an algorithm for fitting a predictor enter the picture.

Setting

A feasible region S⊆RdS\subseteq\mathbb R^dS⊆Rd is nonempty, compact, and convex. Given a cost vector c∈Rdc\in\mathbb R^dc∈Rd, a decision w∈Sw\in Sw∈S incurs cost c⊤wc^\top wc⊤w. The nominal value, optimal-decision set, and support function are

z∗(c)=min⁡w∈Sc⊤w,W∗(c)=arg⁡min⁡w∈Sc⊤w,ξS(c)=max⁡w∈Sc⊤w.z^*(c)=\min_{w\in S}c^\top w,\qquad W^*(c)=\arg\min_{w\in S}c^\top w,\qquad \xi_S(c)=\max_{w\in S}c^\top w.z∗(c)=w∈Smin​c⊤w,W∗(c)=argw∈Smin​c⊤w,ξS​(c)=w∈Smax​c⊤w.

An optimization oracle w∗w^*w∗ returns one element of W∗(c)W^*(c)W∗(c) for each ccc, without a tie-breaking rule. For a predicted cost c^\hat cc^ and realized cost ccc, the unambiguous SPO loss uses the worst realized decision among all decisions optimal for the prediction:

ℓSPO(c^,c)=max⁡w∈W∗(c^)c⊤w−z∗(c).\ell_{\mathrm{SPO}}(\hat c,c) =\max_{w\in W^*(\hat c)}c^\top w-z^*(c).ℓSPO​(c^,c)=w∈W∗(c^)max​c⊤w−z∗(c).

This is Definition 2 of the paper. Its SPO+ loss, Definition 3, is

ℓSPO+(c^,c)=ξS(c−2c^)+2c^⊤w∗(c)−z∗(c).\ell_{\mathrm{SPO+}}(\hat c,c) =\xi_S(c-2\hat c)+2\hat c^\top w^*(c)-z^*(c).ℓSPO+​(c^,c)=ξS​(c−2c^)+2c^⊤w∗(c)−z∗(c).

The factor 222 is fixed by the paper's surrogate. Proposition 3 states that SPO+ upper-bounds SPO, is convex in c^\hat cc^, and has the explicit subgradient 2(w∗(c)−w∗(2c^−c))2(w^*(c)-w^*(2\hat c-c))2(w∗(c)−w∗(2c^−c)) Elmachtoub and Grigas, 2020, pp. 17–18.

Let xxx denote an observed feature, ν\nuν its probability law, and κx\kappa_xκx​ the conditional law of ccc given xxx. Their joint law is D=ν⊗κD=\nu\otimes\kappaD=ν⊗κ. A measurable predictor fff maps each xxx to a cost prediction f(x)f(x)f(x). The population risks RSPO(f)R_{\mathrm{SPO}}(f)RSPO​(f) and RSPO+(f)R_{\mathrm{SPO+}}(f)RSPO+​(f) are expectations over (x,c)∼D(x,c)\sim D(x,c)∼D of the corresponding losses at (f(x),c)(f(x),c)(f(x),c), as in displays (11) and (12) Elmachtoub and Grigas, 2020, p. 20. There is no prescribed parametric predictor class.

Formalization targets

Theorem 1: Fisher consistency of SPO+

Write m(x)=E[c∣x]m(x)=\mathbb E[c\mid x]m(x)=E[c∣x]. Under Assumption 1, the optimal-decision set W∗(m(x))W^*(m(x))W∗(m(x)) is a singleton for almost every xxx; each conditional law is centrally symmetric about m(x)m(x)m(x) and continuous on all of Rd\mathbb R^dRd; and SSS has nonempty interior. The goal says that every measurable minimizer fff of SPO+ population risk satisfies

f(x)=m(x)for ν-almost every x,RSPO(f)≤RSPO(g)for every measurable g.f(x)=m(x)\quad\text{for }\nu\text{-almost every }x, \qquad R_{\mathrm{SPO}}(f)\le R_{\mathrm{SPO}}(g) \quad\text{for every measurable }g.f(x)=m(x)for ν-almost every x,RSPO​(f)≤RSPO​(g)for every measurable g.

This is the paper's Fisher-consistency statement, including its stronger identification of every SPO+ minimizer with the conditional mean Elmachtoub and Grigas, 2020, Theorem 1. The goal does not assert that a minimizer exists.

Supporting propositions

The milestone list follows the paper's numbered results: Proposition 3's pointwise upper bound, convexity, and subgradient; Proposition 6's mean minimizer and uniqueness claims for a single cost law; and both directions of Proposition 5, which relate SPO risk minimizers to decisions optimal at the mean Elmachtoub and Grigas, 2020, pp. 18, 22–23. The single-law propositions have no feature variable.

Significance

Theorem 1 identifies a condition under which a convex training objective preserves the population target of the decision loss. Its identification statement is stronger than merely saying that one selected SPO+ minimizer is SPO-optimal: all SPO+ minimizers agree almost surely with conditional mean cost. The propositions isolate what this depends on. Proposition 6 concerns the surrogate risk, while Proposition 5 connects a prediction's optimal-decision set to the true risk.

The result was proved in the cited preprint and published in Management Science in 2022; this mission asks for a Lean proof of that known result, not a new consistency theorem. A completed development would provide reusable definitions for cost-based decision losses and a checked account of the distributional assumptions needed for uniqueness. The published oracle predicate is already available on the platform; the two losses, risks, and distributional predicates are introduced here.

Difficulty

The SPO loss may jump when a predicted cost admits more than one optimal decision. Its definition takes the maximum realized cost over that whole decision set. Consequently, showing that a prediction selects one mean-optimal decision does not by itself control the SPO loss; Proposition 5's converse requires a singleton set. The surrogate is convex but generally not differentiable, because the support function of SSS need not be differentiable. Establishing the unique population minimizer also depends on how the cost law covers the space: absolute continuity by itself permits a bounded-support law for which nearby predictions tie. These are substantive issues in moving from the single-cost-law statements to an almost-sure claim about measurable predictors Elmachtoub and Grigas, 2020, §4 and Appendix B.

Formalization scope

The code represents Rd\mathbb R^dRd by EuclideanSpace ℝ (Fin d) and c⊤wc^\top wc⊤w by its standard inner product. Every theorem assumes the paper's nonempty compact convex SSS. Real infima and suprema encode the attained minima and maxima on SSS. An oracle is an explicit parameter satisfying the published SPOBounds.Natarajan.IsOracle predicate; it is not given an extra measurability or tie-breaking assumption. The SPO loss is the paper's unambiguous Definition 2, which differs from the oracle-dependent loss in the published module.

Expected losses are extended nonnegative integrals, so an infinite risk remains infinite. Conditional costs are represented by a Markov kernel κ\kappaκ, and the joint law by ν⊗κ\nu\otimes\kappaν⊗κ. Integrability of costs makes the conditional and joint means finite. Central symmetry means equality of the conditional law with its reflection c↦2m(x)−cc\mapsto 2m(x)-cc↦2m(x)−c. Assumption 1.3, “continuous on all of Rd\mathbb R^dRd,” is pinned to absolute continuity with respect to Lebesgue measure and full support, meaning every nonempty open set has positive probability. This full-support condition is needed for Proposition 6(b)'s uniqueness claim: a continuous law confined to a small ball supplies a counterexample to the weaker reading.

The risks range over all measurable predictors, as display (12) requires. A Bochner integral for an arbitrary nonintegrable loss, a restricted hypothesis class, the oracle-dependent SPO loss of Definition 1, or absolute continuity without full support would change or trivialize the target. Contributions to the support-function, measurable-risk, and conditional-law infrastructure are useful beyond this mission; the seven numbered proposition parts provide its immediate formalization targets.

Selected references

  • A. N. Elmachtoub and P. Grigas, Smart “Predict, then Optimize”, arXiv:1710.08005v5, 2020; published in Management Science 68(1), 2022. Preprint
10 thms1 active userReviewed
Algorithmic Game TheoryOptimizationTheoretical Computer Science·Captain: mikedeng1

Assortment Optimisation Under a General Discrete Choice Model: A Tight Analysis of Revenue-Ordered Assortments IV: Uniform Pricing Earns OPT/(1 + ln(v_m/v_1)) in Unit-Demand Min-PricingResearch Paper

Pricing with unit-demand consumers

A seller with nnn distinct items faces mmm consumers, each of whom wants at most one item. Choosing item prices to maximise revenue in this setting is the unit-demand envy-free pricing problem, introduced by Rusmevichientong and studied in algorithmic game theory and revenue management since the mid-2000s. Optimal prices are hard to compute in general, so the guarantees of simple pricing rules matter. The simplest such rule is uniform pricing: put one price qqq on every item and choose qqq to maximise revenue.

Aggarwal, Feder, Motwani and Zhu (ICALP 2004) and Guruswami, Hartline, Karlin, Kempe, Kenyon and McSherry (SODA 2005) analysed uniform pricing; in the min-buying model it recovers a 1/(1+ln⁡m)1/(1+\ln m)1/(1+lnm) fraction of the optimum, a bound Berbeglia and Joret attribute to Aggarwal et al. Berbeglia and Joret (arXiv:1606.01371, Algorithmica 2020) observed that the min-buying problem is a special case of assortment optimisation under a regular discrete choice model, and that uniform pricing then coincides with the revenue-ordered assortments heuristic. Their general guarantee for that heuristic yields a second bound for uniform pricing, in terms of the spread of the valuations rather than the number of consumers. This mission formalizes that bound (Corollary 4.7) together with the reduction it rests on (Theorem 4.6).

Setting

Unit-demand min-pricing (UDPmin⁡\mathrm{UDP}_{\min}UDPmin​). There are items [n][n][n] and consumers [m][m][m], m≥1m\ge 1m≥1. Consumer iii is interested in a set Bi⊆[n]B_i\subseteq[n]Bi​⊆[n] and has a valuation vi>0v_i>0vi​>0. Given a price assignment p:[n]→R>0p:[n]\to\mathbb R_{>0}p:[n]→R>0​, consumer iii buys a cheapest item of BiB_iBi​ if its price is at most viv_ivi​, and nothing otherwise. The seller's revenue is

revUDP(p)=∑i: Bi≠∅, min⁡x∈Bip(x)≤vi min⁡x∈Bip(x),\mathrm{rev}_{\mathrm{UDP}}(p)=\sum_{i:\ B_i\ne\emptyset,\ \min_{x\in B_i}p(x)\le v_i}\ \min_{x\in B_i}p(x),revUDP​(p)=i: Bi​=∅, minx∈Bi​​p(x)≤vi​∑​ x∈Bi​min​p(x),

the optimum is OPTUDP=sup⁡p>0revUDP(p)\mathrm{OPT}_{\mathrm{UDP}}=\sup_{p>0}\mathrm{rev}_{\mathrm{UDP}}(p)OPTUDP​=supp>0​revUDP​(p), and uniform pricing earns UP=sup⁡q>0revUDP(q,…,q)\mathrm{UP}=\sup_{q>0}\mathrm{rev}_{\mathrm{UDP}}(q,\dots,q)UP=supq>0​revUDP​(q,…,q). Write vmax⁡=vmv_{\max}=v_mvmax​=vm​ and vmin⁡=v1v_{\min}=v_1vmin​=v1​ for the extreme valuations.

Regular choice models. A finite product set C\mathcal CC carries choice probabilities P(x,S)\mathcal P(x,S)P(x,S) for x∈Cx\in\mathcal Cx∈C, S⊆CS\subseteq\mathcal CS⊆C, with no-purchase probability P(0,S)=1−∑x∈SP(x,S)\mathcal P(0,S)=1-\sum_{x\in S}\mathcal P(x,S)P(0,S)=1−∑x∈S​P(x,S). The model is regular if (i) all probabilities are nonnegative, (ii) P(x,S)=0\mathcal P(x,S)=0P(x,S)=0 for x∉Sx\notin Sx∈/S, (iii) ∑x∈SP(x,S)≤1\sum_{x\in S}\mathcal P(x,S)\le1∑x∈S​P(x,S)≤1, and (iv) P(x,S)≥P(x,S′)\mathcal P(x,S)\ge\mathcal P(x,S')P(x,S)≥P(x,S′) for S⊆S′S\subseteq S'S⊆S′ and every x∈S∪{0}x\in S\cup\{0\}x∈S∪{0}. With revenues r:C→R>0r:\mathcal C\to\mathbb R_{>0}r:C→R>0​, an assortment earns rev(S)=∑x∈SP(x,S)r(x)\mathrm{rev}(S)=\sum_{x\in S}\mathcal P(x,S)r(x)rev(S)=∑x∈S​P(x,S)r(x) and OPT=max⁡Srev(S)\mathrm{OPT}=\max_S\mathrm{rev}(S)OPT=maxS​rev(S). If r1<⋯<rkr_1<\dots<r_kr1​<⋯<rk​ are the distinct revenues and Si={x:r(x)≥ri}S_i=\{x: r(x)\ge r_i\}Si​={x:r(x)≥ri​}, revenue-ordered assortments earn RO=max⁡irev(Si)\mathrm{RO}=\max_i\mathrm{rev}(S_i)RO=maxi​rev(Si​).

The reduction. From a UDPmin⁡\mathrm{UDP}_{\min}UDPmin​ instance the paper builds C=[n]×{v1,…,vm}\mathcal C=[n]\times\{v_1,\dots,v_m\}C=[n]×{v1​,…,vm​}, r((x,v))=m vr((x,v))=m\,vr((x,v))=mv, and P=1m∑iPi\mathcal P=\frac1m\sum_i\mathcal P_iP=m1​∑i​Pi​, where Pi\mathcal P_iPi​ spreads probability one over the set Qi(S)Q_i(S)Qi​(S) of pairs (x,v)∈S(x,v)\in S(x,v)∈S with x∈Bix\in B_ix∈Bi​, v≤viv\le v_iv≤vi​ and vvv minimal among the pairs of SSS whose item lies in BiB_iBi​.

Formalization targets

Goal: Corollary 4.7

OPTUDP ≤ (1+ln⁡vmax⁡vmin⁡)⋅UP.\mathrm{OPT}_{\mathrm{UDP}}\ \le\ \Big(1+\ln\frac{v_{\max}}{v_{\min}}\Big)\cdot\mathrm{UP}.OPTUDP​ ≤ (1+lnvmin​vmax​​)⋅UP.

The bound is the paper's "approximates the optimum revenue to within a factor of 1/(1+ln⁡ρ)1/(1+\ln\rho)1/(1+lnρ), ρ:=vm/v1\rho:=v_m/v_1ρ:=vm​/v1​", stated in product form.

Milestones

  1. Lemma 4.5. Some optimal price assignment takes only valuations as prices; in particular OPTUDP\mathrm{OPT}_{\mathrm{UDP}}OPTUDP​ is attained.
  2. Regularity of the reduction's choice model (proof of Theorem 4.6, pp. 17–18).
  3. Assortments to prices: rev(S)=revUDP(pS)\mathrm{rev}(S)=\mathrm{rev}_{\mathrm{UDP}}(p_S)rev(S)=revUDP​(pS​) with pS(x)=min⁡{v:(x,v)∈S}p_S(x)=\min\{v:(x,v)\in S\}pS​(x)=min{v:(x,v)∈S} (p. 19).
  4. Prices to assortments: for valuation-valued ppp, rev(Sp)=revUDP(p)\mathrm{rev}(S_p)=\mathrm{rev}_{\mathrm{UDP}}(p)rev(Sp​)=revUDP​(p) with Sp={(x,v):v≥p(x)}S_p=\{(x,v): v\ge p(x)\}Sp​={(x,v):v≥p(x)} (p. 19).
  5. Theorem 4.6 for the explicit instance: regularity, positive revenues, equal optima, and the two-way correspondence between threshold sets and uniform valuation prices.
  6. Theorem 3.2 for an arbitrary regular model:
OPT≤(∑i=1kri−ri−1ri)RO,∑i=1kri−ri−1ri≤1+ln⁡rkr1,r0:=0.\mathrm{OPT}\le\Big(\sum_{i=1}^k\frac{r_i-r_{i-1}}{r_i}\Big)\mathrm{RO},\qquad \sum_{i=1}^k\frac{r_i-r_{i-1}}{r_i}\le 1+\ln\frac{r_k}{r_1},\qquad r_0:=0.OPT≤(i=1∑k​ri​ri​−ri−1​​)RO,i=1∑k​ri​ri​−ri−1​​≤1+lnr1​rk​​,r0​:=0.

Significance

The corollary gives a uniform-pricing guarantee that is independent of the number of consumers and items: when valuations lie within a factor ρ\rhoρ of each other, a single price recovers a 1/(1+ln⁡ρ)1/(1+\ln\rho)1/(1+lnρ) fraction of the optimum, which improves on 1/(1+ln⁡m)1/(1+\ln m)1/(1+lnm) whenever ρ<m\rho<mρ<m. More broadly, Theorem 4.6 places UDPmin⁡\mathrm{UDP}_{\min}UDPmin​ inside the class of regular choice models, so every guarantee proved for revenue-ordered assortments under regularity transfers to uniform pricing.

All results here are proved in the paper. Nothing in this mission is formalized elsewhere as far as a search of the platform shows: there is no regular choice model, no UDPmin⁡\mathrm{UDP}_{\min}UDPmin​ problem and no revenue-ordered guarantee on Prove2Me. The mission produces the reduction as reusable infrastructure, a machine-checked version of the paper's Lemma 4.5 (whose appendix proof is an informal repair argument), and the first formal guarantee for uniform pricing.

Difficulty

The reduction is where the work sits. Regularity hinges on the no-purchase case of axiom (iv): enlarging an assortment can only make QiQ_iQi​ nonempty, never empty, and this must be checked for the specific sets Qi(S)Q_i(S)Qi​(S) whose definition depends on the whole of SSS. The revenue identities require tracking the minimum over BiB_iBi​ of a price function obtained from an assortment, including items absent from SSS, which receive the paper's "+∞+\infty+∞" price. Lemma 4.5 is needed to make the optimum of the uncountable pricing problem coincide with that of a finite assortment problem, and the statement is about a supremum over a continuum of price vectors whose attainment is not obvious. Theorem 3.2 has to relate the optimum to threshold sets of an arbitrary regular model, where products may share revenues and the optimal assortment need not be a threshold set.

The naive route of comparing uniform pricing to the optimum directly, consumer by consumer, does not give a bound in terms of vm/v1v_m/v_1vm​/v1​; the reduction to a regular model is what supplies it.

Formalization scope

  • Items and consumers are finite types X and M, with Nonempty M (m≥1m\ge1m≥1). Valuations satisfy vi>0v_i>0vi​>0 as a field of the instance; the paper says "non-negative", but its reduction (r=m v>0r=m\,v>0r=mv>0) and its ratio vm/v1v_m/v_1vm​/v1​ need positivity.
  • A consumer with Bi=∅B_i=\emptysetBi​=∅ pays 000. Ties among cheapest items do not affect payments, so payments are defined directly.
  • OPTUDP\mathrm{OPT}_{\mathrm{UDP}}OPTUDP​ and UP\mathrm{UP}UP are real suprema over positive price assignments and positive uniform prices; both index sets are nonempty and the revenues are bounded by ∑ivi\sum_i v_i∑i​vi​. Uniform pricing ranges over all q>0q>0q>0, not only valuations.
  • The no-purchase option is not a product: it is P(0,S)=1−∑x∈SP(x,S)\mathcal P(0,S)=1-\sum_{x\in S}\mathcal P(x,S)P(0,S)=1−∑x∈S​P(x,S), and regularity includes axiom (iv) for it. OPT is a maximum over all Finset C; RO is a maximum over the kkk threshold sets only. Distinct revenues are sorted 0-based (Fin k), with r0=0r_0=0r0​=0 handled as a separate case.
  • The paper's +∞+\infty+∞ price for pSp_SpS​ is the real 1+∑ivi1+\sum_i v_i1+∑i​vi​, which exceeds every valuation, as its Remark on p. 18 allows. The valuation set collapses equal valuations.
  • Approximation factors are in product form, OPT≤D⋅RO\mathrm{OPT}\le D\cdot\mathrm{RO}OPT≤D⋅RO; ln⁡\lnln is Real.log applied to ratios ≥1\ge1≥1.
  • Trivializing readings are excluded: Theorem 4.6 is stated for the explicit instance of its proof, not as the bare existence of a regular instance with the same optimum (a single product of revenue OPTUDP\mathrm{OPT}_{\mathrm{UDP}}OPTUDP​ would satisfy that); OPTUDP\mathrm{OPT}_{\mathrm{UDP}}OPTUDP​ ranges over all positive price assignments, not uniform ones; valuations are positive, so no logarithm takes a junk value.
  • Theorem 3.2 is restated here for this mission's copy of the regular model; it is also the goal of mission I of this series. Reusable pieces: the regular choice model and revenue-ordered value, and the UDPmin⁡\mathrm{UDP}_{\min}UDPmin​ model. Contributions of any milestone, and alternative proofs of Lemma 4.5, are welcome.

Selected references

  • G. Berbeglia and G. Joret, Assortment Optimisation Under a General Discrete Choice Model: A Tight Analysis of Revenue-Ordered Assortments, arXiv:1606.01371v3, 2019; Algorithmica 82 (2020). https://arxiv.org/abs/1606.01371
  • G. Aggarwal, T. Feder, R. Motwani and A. Zhu, Algorithms for multi-product pricing, ICALP 2004. https://doi.org/10.1007/978-3-540-27836-8_8
  • V. Guruswami, J. D. Hartline, A. R. Karlin, D. Kempe, C. Kenyon and F. McSherry, On profit-maximizing envy-free pricing, SODA 2005. https://dl.acm.org/doi/10.5555/1070432.1070598
  • P. Rusmevichientong, B. Van Roy and P. W. Glynn, A nonparametric approach to multiproduct pricing, Operations Research 54(1), 2006. https://doi.org/10.1287/opre.1050.0236
  • A. Aouad, V. Farias, R. Levi and D. Segev, The approximability of assortment optimization under ranking preferences, Operations Research 66(6), 2018. https://doi.org/10.1287/opre.2018.1754
12 thms1 active userReviewed
Bandit AlgorithmsMachine LearningProbability·Captain: mikedeng1

MNL-Bandit: A Dynamic Learning Approach to Assortment Selection II: Under a K-Cardinality Constraint Every Policy Has Regret at Least C√(NT/K)Research Paper

Motivation

A retailer with a large catalogue but a limited display (a web page, a shelf, a search result) must decide which assortment of products to show each arriving customer. Customers choose among the displayed products or leave without buying, and the retailer does not know their preferences in advance; it learns them only from the purchases it observes. This is the MNL-Bandit problem of Agrawal, Avadhanula, Goyal and Zeevi (arXiv:1706.03880v2; Operations Research 67(5), 2019), in which customer choices follow the multinomial logit model, the workhorse of revenue management and marketing.

The same paper gives an epoch-based upper-confidence-bound policy whose regret is at most of order NTlog⁡NT\sqrt{NT\log NT}NTlogNT​ (its Theorem 1). This mission formalizes the matching lower bound, the paper's Theorem 2: under a constraint that at most KKK products be displayed, no policy can have regret smaller than order NT/K\sqrt{NT/K}NT/K​ on every instance. Lower bounds of this kind are what certify that an algorithm is near-optimal rather than merely good.

Timeline. The square-root lower bound for NNN-armed bandits goes back to Auer, Cesa-Bianchi, Freund and Schapire (2002), presented in the survey of Bubeck and Cesa-Bianchi (arXiv:1204.5721, 2012). Rusmevichientong, Shen and Shmoys (2010) and Sauré and Zeevi (2013) minimized regret under MNL choice with explore-then-exploit policies, obtaining O(N2log⁡2T)O(N^2\log^2T)O(N2log2T) and O(Nlog⁡T)O(N\log T)O(NlogT) bounds for instances whose best and second-best assortments are well separated. Agrawal et al. (2017–2019) proved the instance-independent Ω(NT/K)\Omega(\sqrt{NT/K})Ω(NT/K​) lower bound formalized here; Chen and Wang (2017) later obtained Ω(NT)\Omega(\sqrt{NT})Ω(NT​) when K<N/4K<N/4K<N/4.

Setting

There are nnn products. An instance consists of a no-purchase weight v0>0v_0>0v0​>0, attraction parameters v1,…,vnv_1,\dots,v_nv1​,…,vn​ with 0≤vi≤v00\le v_i\le v_00≤vi​≤v0​, and revenues ri∈[0,1]r_i\in[0,1]ri​∈[0,1]. At each period t=1,…,Tt=1,\dots,Tt=1,…,T the seller offers an assortment St⊆{1,…,n}S_t\subseteq\{1,\dots,n\}St​⊆{1,…,n} and observes a choice ct∈St∪{0}c_t\in S_t\cup\{0\}ct​∈St​∪{0}, where 000 means no purchase. Under the multinomial logit (MNL) model,

pi(S)=viv0+∑j∈Svj(i∈S∪{0}),pi(S)=0 otherwise,p_i(S)=\frac{v_i}{v_0+\sum_{j\in S}v_j}\quad(i\in S\cup\{0\}),\qquad p_i(S)=0\ \text{otherwise},pi​(S)=v0​+∑j∈S​vj​vi​​(i∈S∪{0}),pi​(S)=0 otherwise,

and choices are independent across periods given the offered sets. The expected revenue of SSS is R(S,v)=∑i∈Srivi/(v0+∑j∈Svj)R(S,v)=\sum_{i\in S}r_iv_i/(v_0+\sum_{j\in S}v_j)R(S,v)=∑i∈S​ri​vi​/(v0​+∑j∈S​vj​).

A policy chooses StS_tSt​ from the past assortments and choices, possibly at random. It satisfies the KKK-cardinality constraint if ∣St∣≤K|S_t|\le K∣St​∣≤K always. Its regret over TTT periods is

Regπ(T,v)=Eπ(∑t=1TR(S∗,v)−R(St,v)),\mathrm{Reg}_\pi(T,v)=\mathbb E_\pi\Big(\sum_{t=1}^{T}R(S^*,v)-R(S_t,v)\Big),Regπ​(T,v)=Eπ​(t=1∑T​R(S∗,v)−R(St​,v)),

where S∗S^*S∗ maximizes R(⋅,v)R(\cdot,v)R(⋅,v) over assortments of at most KKK products.

A randomized instance is a probability distribution over instances with common known revenues and a common no-purchase weight; the regret against it is averaged over the hidden attraction parameters, the choices and the policy's randomization.

Formalization targets

Goal: Theorem 2 (p. 14)

There is an absolute constant C>0C>0C>0 such that for all n≥2n\ge2n≥2, 1≤K≤n1\le K\le n1≤K≤n and T≥nT\ge nT≥n there is a finitely supported randomized instance, chosen before the policy, such that every policy π\piπ respecting the KKK-cardinality constraint satisfies

Ev[Regπ(T,v)]≥CnTK.\mathbb E_{v}\big[\mathrm{Reg}_\pi(T,v)\big]\ge C\sqrt{\frac{nT}{K}} .Ev​[Regπ​(T,v)]≥CKnT​​.

The constant is not fixed; any positive value suffices.

Milestones

The paper proves Theorem 2 in two cases.

  1. Lemma E.1 (p. 57): the Bernoulli divergence bound kl(α,α+ϵ)≤4ϵ2/α\mathrm{kl}(\alpha,\alpha+\epsilon)\le 4\epsilon^2/\alphakl(α,α+ϵ)≤4ϵ2/α in the direction used by Lemma E.2.
  2. Lemma E.2 (p. 57): for a guessing algorithm on N≥12N\ge12N≥12 coins and t≤Nα/(60ϵ2)t\le N\alpha/(60\epsilon^2)t≤Nα/(60ϵ2), at least N/3N/3N/3 hiding places jjj of the biased coin have Pj(at=j)≤1/2\mathcal P_j(a_t=j)\le 1/2Pj​(at​=j)≤1/2.
  3. Lemma 5.1 (p. 15): on the Bernoulli instance IMABI_{\mathrm{MAB}}IMAB​ with ϵ=1100Nα/T\epsilon=\frac1{100}\sqrt{N\alpha/T}ϵ=1001​Nα/T​, every online algorithm has expected regret at least ϵT/6\epsilon T/6ϵT/6.
  4. Lemma E.4 (p. 60): one period of MNL feedback on the instance I^MNL\hat I_{\mathrm{MNL}}I^MNL​, where ϵ=1/(32T)\epsilon=\sqrt{1/(32T)}ϵ=1/(32T)​, has divergence at most 4ϵ24\epsilon^24ϵ2.
  5. Lemma E.5 (p. 61): over TTT periods the two choice laws of that instance have divergence at most 4Tϵ24T\epsilon^24Tϵ2.

Items 1–3 serve the case K<nK<nK<n, which the paper reduces to a multi-armed bandit through the instance IMNLI_{\mathrm{MNL}}IMNL​ of Definition 5.2 (NKNKNK products in NNN groups of KKK, one hidden group with larger attraction). Items 4–5 serve the case K=nK=nK=n through the two-point instance I^MNL\hat I_{\mathrm{MNL}}I^MNL​ of Definition E.1.

Significance

The theorem shows that the T\sqrt{T}T​ growth of regret in assortment learning cannot be improved, and that the dependence on the number of products is polynomial: when the display size KKK is fixed, the UCB policy of the same paper is optimal up to logarithmic factors (Remark 4). It separates what learning under the MNL model costs from what the combinatorics of the assortment adds, and the reduction it uses, simulating an assortment algorithm inside a bandit algorithm, is reusable for other choice-model bandits.

The result is proved in the paper, with its proof in Appendix E. To our knowledge neither the theorem nor its lemmas have been machine-checked. A formal proof has to repair several printed slips: Lemma 5.1's hypotheses do not exclude α\alphaα close to 111, where the bound fails; the proof of Lemma E.2 uses a form of Pinsker's inequality with a wrong constant; Lemma E.1 states one direction of the divergence and computes the other; and the constants of the K=NK=NK=N case do not match. The formal statements here carry the corrected hypotheses, each disclosed in its note.

Difficulty

The obvious argument fails at the reduction. The bandit lower bound is a statement about algorithms that pull one arm per round, while an assortment policy offers KKK products at once and sees a choice among them. Transferring the bound requires simulating MNL feedback from Bernoulli coins (Algorithm 2 of the paper), whose loop has a random length, and then relating the regret of the simulated assortment algorithm over a random number of calls to the bandit regret over TTT pulls. The paper does this in expectation, and the constants have to be tracked through the random horizon.

A second difficulty is that the lower bound must hold for every policy, including randomized ones, against a single randomized instance fixed in advance. Bounding the regret of each deterministic policy separately is not enough unless the instance does not depend on the policy, which the statement requires. The change-of-measure steps (Lemmas E.2 and E.5) need a chain rule for the divergence between laws of adaptively generated histories.

Formalization scope

Products, periods and arms are 0-based (Fin n); a choice is Option (Fin n) with none the no-purchase alternative. Histories have finite length TTT, laws of histories are explicit products of policy weights and MNL (or Bernoulli) probabilities, and every expectation is a finite sum, so no measurability or integrability side conditions arise. The no-purchase weight v0v_0v0​ is explicit (Definition 5.2 has v0=Kv_0=Kv0​=K). R(S∗,v)R(S^*,v)R(S∗,v) is a maximum over the finite, nonempty family {S:∣S∣≤K}\{S:|S|\le K\}{S:∣S∣≤K}.

Policies are behavioural: at every history they give a probability vector over assortments, which by Kuhn's theorem covers the paper's admissible policies with external randomization. The randomized instance is a finite list of instances with nonnegative weights summing to one; every support point has the same revenues and no-purchase weight, which are known to the seller. The quantifiers are in the paper's order: the constant first, then n,K,Tn,K,Tn,K,T, then the randomized instance, then every policy. A formalization with the policy quantified before the instance, with C=0C=0C=0 allowed, with varying known revenues across hidden support points, or with only deterministic policies, would be weaker and is ruled out.

Hypotheses added to the printed statements: n≥2n\ge2n≥2 and K≥1K\ge1K≥1 in Theorem 2 (the claim fails for n=1n=1n=1 and K=0K=0K=0); 0<α0<\alpha0<α, 0<ϵ0<\epsilon0<ϵ, α+ϵ≤3/4\alpha+\epsilon\le3/4α+ϵ≤3/4 in Lemma E.1; 0<α0<\alpha0<α, 0<ϵ0<\epsilon0<ϵ, 2α+ϵ≤12\alpha+\epsilon\le12α+ϵ≤1 in Lemma E.2; 0<α0<\alpha0<α, 2α+ϵ≤12\alpha+\epsilon\le12α+ϵ≤1, T≥1T\ge1T≥1 in Lemma 5.1. Lemmas E.4 and E.5 use Definition E.1's ϵ=1/(32T)\epsilon=\sqrt{1/(32T)}ϵ=1/(32T)​, with T≥1T\ge1T≥1 and n≥2n\ge2n≥2 so the instance is defined. Lemma E.5 is stated, as in its proof, for deterministic policies.

The development reuses three published definitions: the MNL revenue ChoiceCDLP.MNL.mnlObjective, the Bernoulli divergence RegretBandits.Stochastic.klBern, and the discrete Kullback–Leibler divergence FoundationsRL.GeneralDM.klDivDiscrete (valued in [0,∞][0,\infty][0,∞]). Proved platform results useful to solvers include Pinsker's inequality (BanditAlgorithm.pinsker_inequality_total_variation), the Bernoulli bound d(p,q)≤(q−p)2/(p(2−p−q))d(p,q)\le(q-p)^2/(p(2-p-q))d(p,q)≤(q−p)2/(p(2−p−q)) (BanditAlgorithm.bernoulli_relative_entropy_le_sq_div_of_add_le_one) and a divergence decomposition for bandits. A chain rule for the divergence of finite adaptive histories, and a formal version of the simulation of Algorithm 2, would be reusable beyond this mission; both are welcome as supporting lemmas.

Selected references

  • S. Agrawal, V. Avadhanula, V. Goyal, A. Zeevi, MNL-Bandit: A Dynamic Learning Approach to Assortment Selection, Operations Research 67(5):1453–1485, 2019; preprint arXiv:1706.03880v2. https://arxiv.org/abs/1706.03880 — DOI https://doi.org/10.1287/opre.2018.1832
  • S. Bubeck, N. Cesa-Bianchi, Regret Analysis of Stochastic and Nonstochastic Multi-armed Bandit Problems, Foundations and Trends in Machine Learning 5(1), 2012. https://arxiv.org/abs/1204.5721
  • P. Auer, N. Cesa-Bianchi, Y. Freund, R. E. Schapire, The Nonstochastic Multiarmed Bandit Problem, SIAM Journal on Computing 32(1), 2002. https://doi.org/10.1137/S0097539701398375
  • D. Sauré, A. Zeevi, Optimal Dynamic Assortment Planning with Demand Learning, Manufacturing & Service Operations Management 15(3), 2013. https://doi.org/10.1287/msom.2013.0429
  • X. Chen, Y. Wang, A Note on a Tight Lower Bound for MNL-Bandit Assortment Selection Models, arXiv:1709.06109, 2017. https://arxiv.org/abs/1709.06109
12 thms1 active userReviewed
Dynamic ProgrammingLinear OptimizationOptimization·Captain: mikedeng1

Economic Lot Sizing: An O(n log n) Algorithm That Runs in Linear Time in the Wagner-Whitin Case 2: The Greedy Forward Dual Solution Is Optimal and Its Value Is the Lot-Sizing CostResearch Paper

Motivation

Economic lot sizing asks when to produce goods across a finite planning horizon when demand in each period is known. Producing in a period incurs a fixed setup charge and a marginal cost per unit, while goods may be produced before the period in which they are needed. Such a decision has to balance paying another setup charge against producing more units earlier. The model is a standard setting for studying how dynamic programming and linear optimization describe the same planning decision. Wagelmans, Van Hoesel and Kolen study faster algorithms for this model and, in Section 4, connect the optimal lot-sizing cost to a greedy solution of a dual program Wagelmans et al. (1992).

The dual connection is useful in its own right. It supplies a certificate for the cost returned by the forward dynamic program: a feasible dual vector attains that cost. The paper allows demand to vanish in some periods, which makes the dual values at those periods free and forces care in defining the dynamic program. The mission targets precisely that case.

Setting

There are periods 1,…,n1,\ldots,n1,…,n. Demand dtd_tdt​ and setup cost fif_ifi​ are nonnegative for the periods in the horizon. The marginal production cost cic_ici​ is any real number. Write di,j=∑t=ijdtd_{i,j}=\sum_{t=i}^j d_tdi,j​=∑t=ij​dt​ for cumulative demand from iii through jjj. Values at period zero and beyond the horizon are bookkeeping only; every optimization constraint concerns periods 1,…,n1,\ldots,n1,…,n.

The forward lot-sizing cost F(j)F(j)F(j) describes the least cost of serving periods 1,…,j1,\ldots,j1,…,j under the zero-inventory property cited by the paper. Its recursion starts with F(0)=0F(0)=0F(0)=0. If dj=0d_j=0dj​=0, no new production is needed and F(j)=F(j−1)F(j)=F(j-1)F(j)=F(j−1). If dj>0d_j>0dj​>0, the last production setup may occur at some i≤ji\le ji≤j, giving

F(j)=min⁡1≤i≤j(fi+cidi,j+F(i−1)).F(j)=\min_{1\le i\le j}\bigl(f_i+c_i d_{i,j}+F(i-1)\bigr).F(j)=1≤i≤jmin​(fi​+ci​di,j​+F(i−1)).

This piecewise definition matters even when only one period has zero demand. Taking the displayed minimum at dj=0d_j=0dj​=0 would charge a setup that need not occur.

Program D′ chooses free real values v1,…,vnv_1,\ldots,v_nv1​,…,vn​ to maximize ∑t=1ndtvt\sum_{t=1}^n d_tv_t∑t=1n​dt​vt​, subject to

∑t=indtmax⁡{0,vt−ci}≤fi(1≤i≤n).\sum_{t=i}^n d_t\max\{0,v_t-c_i\}\le f_i \qquad(1\le i\le n).t=i∑n​dt​max{0,vt​−ci​}≤fi​(1≤i≤n).

“Free” means there is no nonnegativity constraint on vtv_tvt​. The paper obtains D′ from the dual of the linear relaxation of its simple plant location formulation, using the variables of Formulation III Wagelmans et al., pp. S147, S152–S153. The mission takes D′ as the defined optimization problem.

The greedy forward rule visits periods in increasing order. At a period with dj>0d_j>0dj​>0, the chosen value is the minimum of the upper bounds left by the constraints indexed i≤ji\le ji≤j:

vj=min⁡1≤i≤j(ci+fi−∑t=ij−1dtmax⁡{0,vt−ci}dj).v_j=\min_{1\le i\le j} \left(c_i+\frac{f_i-\sum_{t=i}^{j-1}d_t\max\{0,v_t-c_i\}}{d_j}\right).vj​=1≤i≤jmin​(ci​+dj​fi​−∑t=ij−1​dt​max{0,vt​−ci​}​).

When dj=0d_j=0dj​=0, the rule places no restriction on vjv_jvj​. This matches the paper's statement that it may be assigned an arbitrary value. One concrete recursive vector in the definitions sets each such value to zero, but the goal covers every assignment.

Formalization targets

The goal says that every vector satisfying the greedy rule is feasible for D′, agrees with the dynamic-programming cost at every prefix, and is optimal among all feasible D′ vectors:

∑t=1jdtvt=F(j)(1≤j≤n),∑t=1ndtut≤∑t=1ndtvtfor every feasible u.\sum_{t=1}^j d_tv_t=F(j)\quad(1\le j\le n), \qquad \sum_{t=1}^n d_tu_t\le\sum_{t=1}^n d_tv_t \quad\text{for every feasible }u.t=1∑j​dt​vt​=F(j)(1≤j≤n),t=1∑n​dt​ut​≤t=1∑n​dt​vt​for every feasible u.

The milestone path follows the Section 4 statements: feasibility of the greedy vector; decreasing greedy values across positive-demand periods; the prefix upper bound for any feasible dual vector; and Equation (2), which expresses a greedy prefix value using a minimizing production period. Equation (2) is stated with the induction hypothesis that appears immediately before it in the paper. The goal combines these claims without treating the desired value identity as a hypothesis.

Significance

The result identifies a dual certificate whose value matches the forward lot-sizing cost. It also explains why a greedy forward assignment can solve D′ despite each constraint linking the current value with all later periods. The full-horizon identity recovers the cost F(n)F(n)F(n), and the comparison with every feasible vector makes the word “optimal” precise. The paper additionally says that this dual computation directly provides an optimal primal solution; this mission does not encode that reconstruction because it would require the primal formulation and its correspondence to FFF Wagelmans et al., p. S153.

A formal proof would provide a reusable finite-horizon certificate theorem for this dual formulation and a careful treatment of empty and zero-demand prefixes. The paper's result is already proved mathematically. The Lean files in this proposal state the goal and its milestones; their theorem proofs remain to be supplied by solvers. Related platform goals about the convex hull of other lot-sizing formulations and the Federgruen–Tzur forward algorithm concern different objects, so they are credited as neighboring work rather than imported as this theorem.

Difficulty

A current greedy value is limited by every earlier production index, and feasibility must still hold for the entire horizon, not merely for the constraints truncated at the current period. Equality with F(j)F(j)F(j) also has to survive periods with zero demand, where the dual coordinate is unrestricted but its weighted contribution vanishes. The forward recurrence has a separate branch at exactly those periods. A formulation that assumes every demand is strictly positive would avoid the delicate case and would miss a feature the authors explicitly retain.

Formalization scope

Lean represents the horizon by natural-number indices 1,…,n1,\ldots,n1,…,n and the demand, setup, marginal-cost and dual sequences by functions N→R\mathbb N\to\mathbb RN→R. Finite sums use closed intervals; the sum before period jjj uses [i,j)[i,j)[i,j), so it is empty when i=ji=ji=j. Minima are over the nonempty finite set {1,…,j}\{1,\ldots,j\}{1,…,j}, only when j≥1j\ge1j≥1. The horizon n=0n=0n=0 has empty sums and no constraints. The cost and dual values are real, with no sign condition on cic_ici​ or viv_ivi​.

Several informal phrases are made explicit. “The solution is feasible” means every D′ constraint through nnn holds. “Optimal” includes feasibility, every prefix identity, and comparison with every feasible dual vector. “Can be given an arbitrary value” is represented by no greedy-rule condition at zero demand; the theorem quantifies over all vectors that satisfy the positive-demand conditions. The paper states monotonicity for consecutive nonzero-demand periods; the milestone uses any two positive-demand periods, skipping zero-demand positions so it holds for every choice of their dual values. The weak-duality milestone spells out the paper's reference to “duality and the structure of D′” as an inequality for each feasible vector and prefix.

The identification of FFF with the optimum of the primal lot-sizing model relies on the zero-inventory property cited by the authors and is not separately formalized. Neither the equivalence of Program D and D′ nor the recovery of a primal production plan is an item here. The paper's running-time claims, including O(n2)O(n^2)O(n2) for the greedy forward algorithm and O(nlog⁡n)O(n\log n)O(nlogn) for its backward algorithm, are outside the scope: the paper does not fix a machine model or constants for them. A definition of FFF as the optimum of D′ would make the value identity circular; the proposal defines it by the paper's forward recursion instead. The backward algorithm of pp. S153–S155 belongs to a separate development.

Selected references

  • A. Wagelmans, S. Van Hoesel and A. Kolen, Economic Lot Sizing: An O(n log n) Algorithm That Runs in Linear Time in the Wagner-Whitin Case, Operations Research 40, Supplement 1, 1992, S145–S156. DOI
7 thms1 active userReviewed
Computational GeometryDynamic ProgrammingOptimization·Captain: mikedeng1

Economic Lot Sizing: An O(n log n) Algorithm That Runs in Linear Time in the Wagner-Whitin Case 1: The Threshold Rule on Efficient Periods Picks an Optimal Next Production PeriodResearch Paper

Motivation

Economic lot sizing asks how to meet a known sequence of demands while deciding when to set up production and how much to carry forward. It is a basic deterministic inventory problem: a setup has a fixed cost, production has a per-unit cost, and inventory may be held for later demand. Recomputing every possible next production period in the standard backward dynamic program takes a quadratic number of candidate comparisons. Wagelmans, Van Hoesel and Kolen use the geometry of cumulative-demand points to identify which candidates can affect the minimum. Their Section 2 gives the threshold rule targeted here. Wagelmans, Van Hoesel and Kolen (1992)

The paper notes independent related work by Aggarwal and Park and by Federgruen and Tzur. The published Prove2Me items for Federgruen and Tzur formalize a forward recursion and its minimal optimal predecessor lists. They address the same planning problem through different state variables; the backward value and efficient periods of this mission are new objects. Wagelmans, Van Hoesel and Kolen (1992), p. S145

Setting

A planning horizon consists of periods 1,…,n1,\dots,n1,…,n, with n≥1n\ge1n≥1, and an extra terminal period n+1n+1n+1. In period iii, a known demand di≥0d_i\ge0di​≥0 must be met without backlogging. The final demand is positive, dn>0d_n>0dn​>0; a trailing zero-demand period could otherwise be deleted. A production setup costs fi≥0f_i\ge0fi​≥0, and every unit produced in that period has a marginal cost ci∈Rc_i\in\mathbb Rci​∈R. The sign of cic_ici​ is unrestricted. Holding costs have been absorbed into these transformed marginal costs, as in Section 1 of the paper. Define the remaining demand D(t)=∑j=tndjD(t)=\sum_{j=t}^{n}d_jD(t)=∑j=tn​dj​, with D(n+1)=0D(n+1)=0D(n+1)=0. If production at iii covers demand until the next production period ttt, then D(i)−D(t)D(i)-D(t)D(i)−D(t) units are produced. Wagelmans, Van Hoesel and Kolen (1992), pp. S146–S147

The backward value G(t)G(t)G(t) starts at G(n+1)=0G(n+1)=0G(n+1)=0 and follows Equation (1). At positive demand, it minimizes fi+ci[D(i)−D(t)]+G(t)f_i+c_i[D(i)-D(t)]+G(t)fi​+ci​[D(i)−D(t)]+G(t) over i<t≤n+1i<t\le n+1i<t≤n+1. When di=0d_i=0di​=0, skipping setup and using G(i+1)G(i+1)G(i+1) is an additional choice. The paper identifies G(t)G(t)G(t) with the optimal cost from ttt onward using the cited zero-inventory property. This mission takes Equation (1) as the definition of GGG; it does not formalize the separate equivalence with the original production-plan formulations. Wagelmans, Van Hoesel and Kolen (1992), p. S147

For a fixed iii, plot the finite points (D(t),G(t))(D(t),G(t))(D(t),G(t)) for i<t≤n+1i<t\le n+1i<t≤n+1. Their lower convex envelope is a piecewise linear graph. Its endpoints and places where its slope changes are breakpoints; the corresponding period indexes form the efficient set EiE_iEi​. Write succ⁡i(t)\operatorname{succ}_i(t)succi​(t) for the next larger index in EiE_iEi​. The consecutive-point ratio is ri(t)=[G(t)−G(succ⁡i(t))]/[D(t)−D(succ⁡i(t))]r_i(t)=[G(t)-G(\operatorname{succ}_i(t))]/[D(t)-D(\operatorname{succ}_i(t))]ri​(t)=[G(t)−G(succi​(t))]/[D(t)−D(succi​(t))]. These objects have no optimization over production policies hidden in their definitions. Wagelmans, Van Hoesel and Kolen (1992), pp. S147–S150

Formalization targets

Efficient candidates

Proposition 1 says every candidate outside EiE_iEi​ can be removed without changing the minimum:

min⁡i<t≤n+1{ci[D(i)−D(t)]+G(t)}=min⁡t∈Ei{ci[D(i)−D(t)]+G(t)}.\min_{i<t\le n+1}\{c_i[D(i)-D(t)]+G(t)\}=\min_{t\in E_i}\{c_i[D(i)-D(t)]+G(t)\}.i<t≤n+1min​{ci​[D(i)−D(t)]+G(t)}=t∈Ei​min​{ci​[D(i)−D(t)]+G(t)}.

The endpoint and slope claims establish the geometry used in this reduction. Proposition 2 compares neighboring efficient periods using ri(t)r_i(t)ri​(t) and cic_ici​. Wagelmans, Van Hoesel and Kolen (1992), pp. S147–S149

Threshold rule and backward value

The selected period is the first efficient index whose ratio falls below the current marginal cost, with the terminal period as fallback:

q(i)=min⁡({n+1}∪{t∈Ei:t<n+1, ri(t)<ci}).q(i)=\min\bigl(\{n+1\}\cup\{t\in E_i:t<n+1,\ r_i(t)<c_i\}\bigr).q(i)=min({n+1}∪{t∈Ei​:t<n+1, ri​(t)<ci​}).

The goal asserts that the full candidate minimum is attained there and that the algorithm's resulting assignment equals G(i)G(i)G(i):

min⁡i<t≤n+1{ci[D(i)−D(t)]+G(t)}=ci[D(i)−D(q(i))]+G(q(i)),\min_{i<t\le n+1}\{c_i[D(i)-D(t)]+G(t)\}=c_i[D(i)-D(q(i))]+G(q(i)),i<t≤n+1min​{ci​[D(i)−D(t)]+G(t)}=ci​[D(i)−D(q(i))]+G(q(i)), G(i)={fi+ci[D(i)−D(q(i))]+G(q(i)),di>0,min⁡{G(i+1),fi+ci[D(i)−D(q(i))]+G(q(i))},di=0.G(i)=\begin{cases}f_i+c_i[D(i)-D(q(i))]+G(q(i)),&d_i>0,\\ \min\{G(i+1),f_i+c_i[D(i)-D(q(i))]+G(q(i))\},&d_i=0.\end{cases}G(i)={fi​+ci​[D(i)−D(q(i))]+G(q(i)),min{G(i+1),fi​+ci​[D(i)−D(q(i))]+G(q(i))},​di​>0,di​=0.​

This states the mathematical choice and value; it does not assert a time bound. Wagelmans, Van Hoesel and Kolen (1992), pp. S149–S150

Significance

The result reduces a finite dynamic-programming minimum to the vertices of a lower envelope and gives an explicit threshold for choosing a minimizing vertex. It explains which future production period the backward recursion may select even when marginal costs are negative or some intermediate demands are zero. The paper uses ordered slopes to implement the selection efficiently; a solver proving the statements here establishes the mathematical correctness of that selection independently of a particular list representation. Wagelmans, Van Hoesel and Kolen (1992), pp. S148–S150

The paper's result is proved in print. The Lean statements are open proof obligations in this proposal. A complete development would add reusable finite lower-envelope facts, including vertex dominance and the order of adjacent slopes, as well as a machine-checked treatment of the zero-demand tie convention. The previously published forward-algorithm items do not supply these backward-recursion facts.

Difficulty

A candidate point can have a smaller value G(t)G(t)G(t) than a neighboring point yet still fail to minimize ci[D(i)−D(t)]+G(t)c_i[D(i)-D(t)]+G(t)ci​[D(i)−D(t)]+G(t) for a given cic_ici​. Comparing raw values alone therefore cannot identify the selected period. The lower envelope must retain exactly the points that can support a line of slope cic_ici​, and their consecutive ratios must be ordered. Zero demand creates repeated abscissae; without a representative rule, a ratio may have denominator zero and the successor is ambiguous. Wagelmans, Van Hoesel and Kolen (1992), pp. S147–S150

Formalization scope

Periods are natural numbers starting at 111; n+1n+1n+1 is the terminal sentinel. Demands, setup costs, marginal costs and values are real numbers. Finite minima use attained Finset.inf', with nonempty domains. The effective score omits the common setup cost fif_ifi​. No sign restriction is imposed on cic_ici​. The efficient set is determined by a finite chord test for lower-envelope vertices: points on a chord are excluded, and at identical abscissa and height the earliest period is retained. This makes explicit the paper's zero-demand replacement convention on p. S150. The successor is used only on nonsentinel efficient periods; there its denominator is positive. Wagelmans, Van Hoesel and Kolen (1992), pp. S147–S150

The algorithm's printed Iterations use d1nd_{1n}d1n​ where dind_{in}din​ is required; the Lean statement uses D(i)−D(q(i))=di,q(i)−1D(i)-D(q(i))=d_{i,q(i)-1}D(i)−D(q(i))=di,q(i)−1​, matching the preceding display and the numerical table. The zero-demand branch explicitly includes skipping setup. The selector is the ratio-threshold rule, rather than an argmin, and the efficient set is the actual lower-envelope vertex set rather than all periods. A finite zero-demand example and Tables I–II are used as verification data. The paper's O(nlog⁡n)O(n\log n)O(nlogn) bound, the binary-search implementation, the amortized list updates, the O(n)O(n)O(n) Wagner–Whitin specialization and the final production-plan construction are outside this mission: they require additional algorithm-state and cost-model statements. Wagelmans, Van Hoesel and Kolen (1992), pp. S149–S152

Selected references

  • A. Wagelmans, S. Van Hoesel and A. Kolen, Economic Lot Sizing: An O(n log n) Algorithm That Runs in Linear Time in the Wagner-Whitin Case, Operations Research 40, Supplement 1 (1992), S145–S156. DOI: 10.1287/opre.40.1.S145
8 thms1 active userReviewed
OptimizationStochastic Systems·Captain: mikedeng1

Finding Optimal (s, S) Policies Is About As Simple As Evaluating a Single Policy: The Zheng–Federgruen Algorithm Terminates with an Optimal (s, S) Policy and c⁰ = c*Research Paper

Motivation

The (s, S) policy is the standard control rule for a single item reviewed periodically: when the inventory position reaches or drops below a reorder level sss, order enough to bring it up to the order-up-to level SSS. Under a fixed ordering cost and fairly general holding and shortage costs, some (s, S) policy minimizes the long-run average cost among all policies (Veinott 1966). That makes computing the best (s, S) pair a routine subproblem in inventory software, in multi-echelon heuristics, and in textbooks.

Before 1991 the available methods searched a box of candidate pairs. Veinott and Wagner (1965) bounded the optimal sss and SSS and compared policies within the bounds. Later methods (Johnson, Management Science 15, 1968; Bell, SIAM J. Applied Mathematics 18, 1970; Federgruen and Zipkin 1984) used policy iteration or partial enumeration. Zheng and Federgruen (1991) gave an exact search that walks a monotone staircase path through the (s,S)(s,S)(s,S) grid, and showed it costs about as much as evaluating a single policy. The procedure is the one presented in standard inventory texts such as Zipkin's Foundations of Inventory Management (2000).

Setting

One-period demands DDD are i.i.d. and integer valued, with pj=Pr⁡{D=j}p_j=\Pr\{D=j\}pj​=Pr{D=j}, j≥0j\ge0j≥0, and p0<1p_0<1p0​<1. An order costs K>0K>0K>0. G(y)G(y)G(y) is the one-period expected cost when a period starts at inventory position y∈Zy\in\mathbb Zy∈Z. The paper assumes only:

  • −G-G−G is unimodal: for some integer mmm, GGG is nonincreasing on y≤my\le my≤m and nondecreasing on y≥my\ge my≥m;
  • lim⁡∣y∣→∞G(y)>min⁡yG(y)+K\lim_{|y|\to\infty}G(y)>\min_yG(y)+Klim∣y∣→∞​G(y)>miny​G(y)+K.

Write y1∗y_1^*y1∗​ and y2∗y_2^*y2∗​ for the smallest and largest minimizers of GGG. The renewal density mmm and renewal function MMM are

m(0)=(1−p0)−1,m(j)=∑l=0jpl m(j−l) (j≥1),M(0)=0,M(j)=M(j−1)+m(j−1).m(0)=(1-p_0)^{-1},\quad m(j)=\sum_{l=0}^{j}p_l\,m(j-l)\ (j\ge1),\qquad M(0)=0,\quad M(j)=M(j-1)+m(j-1).m(0)=(1−p0​)−1,m(j)=l=0∑j​pl​m(j−l) (j≥1),M(0)=0,M(j)=M(j−1)+m(j−1).

For integers s<Ss<Ss<S, the long-run average cost of the (s, S) policy is

c(s,S)=K+∑j=0S−s−1m(j) G(S−j)M(S−s).c(s,S)=\frac{K+\sum_{j=0}^{S-s-1}m(j)\,G(S-j)}{M(S-s)}.c(s,S)=M(S−s)K+∑j=0S−s−1​m(j)G(S−j)​.

A pair (s,S)(s,S)(s,S) is an optimal policy if c(s,S)≤c(s′,S′)c(s,S)\le c(s',S')c(s,S)≤c(s′,S′) for all integers s′<S′s'<S's′<S′. The optimal cost c∗c^*c∗ is the value of any optimal policy. For fixed SSS, sss is an optimal reorder level if c(s,S)≤c(s′,S)c(s,S)\le c(s',S)c(s,S)≤c(s′,S) for all s′<Ss'<Ss′<S.

The algorithm (§3, p. 659) starts at any minimizer y∗y^*y∗ of GGG.

  • Step 0. Decrease sss from y∗y^*y∗ until c(s,y∗)≤G(s)c(s,y^*)\le G(s)c(s,y∗)≤G(s). Set S0:=y∗S^0:=y^*S0:=y∗, c0:=c(s,S0)c^0:=c(s,S^0)c0:=c(s,S0) and S:=y∗+1S:=y^*+1S:=y∗+1.
  • Step 1. While G(S)≤c0G(S)\le c^0G(S)≤c0: if c(s,S)<c0c(s,S)<c^0c(s,S)<c0, set S0:=SS^0:=SS0:=S, increase sss while c(s,S0)≤G(s+1)c(s,S^0)\le G(s+1)c(s,S0)≤G(s+1), and set c0:=c(s,S0)c^0:=c(s,S^0)c0:=c(s,S0). In either case, S:=S+1S:=S+1S:=S+1.

Formalization targets

Goal: Theorem 1(a)

For every demand law with p0<1p_0<1p0​<1, every K>0K>0K>0, every GGG satisfying the two assumptions, and every minimizer y∗y^*y∗ of GGG, the algorithm terminates. On termination, with final values s,S0,c0s,S^0,c^0s,S0,c0,

c(s,S0)≤c(s′,S′)  for all integers s′<S′,c0=c(s,S0)=c∗.c(s,S^0)\le c(s',S')\ \text{ for all integers } s'<S',\qquad c^0=c(s,S^0)=c^*.c(s,S0)≤c(s′,S′)  for all integers s′<S′,c0=c(s,S0)=c∗.

Milestones

The milestones are the results the paper's justification of the algorithm (p. 659) rests on, in the order it uses them:

  1. the weighted-average identity (6), c(s−1,S)=αnc(s,S)+(1−αn)G(s)c(s-1,S)=\alpha_nc(s,S)+(1-\alpha_n)G(s)c(s−1,S)=αn​c(s,S)+(1−αn​)G(s) with αn=M(n)/M(n+1)\alpha_n=M(n)/M(n+1)αn​=M(n)/M(n+1) and n=S−sn=S-sn=S−s, and Lemma 0 on the comparisons it implies;
  2. Lemma 1(a): a reorder level s0<y1∗s^0<y_1^*s0<y1∗​ with G(s0)≥c(s0,S)≥G(s0+1)G(s^0)\ge c(s^0,S)\ge G(s^0+1)G(s0)≥c(s0,S)≥G(s0+1) (condition (7)) is optimal for SSS;
  3. Corollary 1, the stopping rule of Step 0;
  4. Lemma 2(a)–(c), the bounds y2∗≤S∗y_2^*\le S^*y2∗​≤S∗ and S∗≤Sˉ∗=max⁡{y≥y2∗:G(y)≤c∗}S^*\le\bar S^*=\max\{y\ge y_2^*:G(y)\le c^*\}S∗≤Sˉ∗=max{y≥y2∗​:G(y)≤c∗}, which give the stopping rule of Step 1;
  5. Lemma 3(a), the single-comparison test for improvement, and Corollary 2(b) with Lemma 3(b), which justify the inner loop.

Significance

The result. Theorem 1(a) makes the exact optimum of the (s, S) problem as cheap to compute as the cost of one policy, for any GGG with −G-G−G unimodal. No convexity is needed, and lead times, random lead times of the Zipkin type, and linear purchase costs are allowed. Its bounds (Lemma 2) and the monotone staircase structure of the search also underlie later work on continuous review, discounting and approximation.

Formalizing it. The theorem is proved on paper. As far as we know, none of the results in this mission has a machine-checked proof: the platform's Veinott–Wagner items concern a different (discounted, convex) model. Formalizing it produces a verified correctness proof of a widely implemented algorithm, and checks the paper's lemmas at their edge cases. Two of the printed statements need repair: Lemma 1(b) and Lemma 3(a) (see the scope section).

Difficulty

Optimality is claimed over all pairs s′<S′s'<S's′<S′, an infinite set, but the algorithm visits only a monotone path. The proof therefore has to show that every pair it skips is no better. For a fixed SSS, the skipped reorder levels are handled by the unimodality of c(⋅,S)c(\cdot,S)c(⋅,S) (Lemma 1). The skipped order-up-to levels are handled by the one-comparison test of Lemma 3(a), and those above the stopping point by the bound of Lemma 2(b). An argument from joint convexity or joint unimodality of ccc in (s,S)(s,S)(s,S) is not available. The paper uses no structure of ccc beyond what Lemmas 0–3 state, and these hold only under the side conditions written in them.

Lemma 2(b)'s printed proof leaves the class of (s, S) policies (it uses a randomized order-up-to level). The limit at −∞-\infty−∞ may be finite, so min⁡s<Sc(s,S)\min_{s<S}c(s,S)mins<S​c(s,S) need not be attained for every SSS. Lattice demands, for which mmm vanishes somewhere, create ties between adjacent reorder levels. Each of these breaks a naive transcription of the paper's argument.

Formalization scope

  • Levels s,S,ys,S,ys,S,y are integers. Demand values are natural numbers, and the demand law is the published VeinottWagnerSS.RenewalCost.DemandDist with the extra hypothesis p0<1p_0<1p0​<1. All costs are real.
  • The cost is the ratio above. Equation (1) on p. 655 is misprinted as M(S−s)K+∑⋯M(S-s)K+\sum\cdotsM(S−s)K+∑⋯, and the ratio is the form fixed by (3) and (5). The Lean value c(s,S)c(s,S)c(s,S) for s≥Ss\ge Ss≥S is a junk 000, so every quantifier over reorder levels carries s<Ss<Ss<S.
  • mmm is defined by the solved recursion m(j)=(1−p0)−1∑l=1jpl m(j−l)m(j)=(1-p_0)^{-1}\sum_{l=1}^{j}p_l\,m(j-l)m(j)=(1−p0​)−1∑l=1j​pl​m(j−l) (p. 660), and M(j)=∑i<jm(i)M(j)=\sum_{i<j}m(i)M(j)=∑i<j​m(i).
  • The growth assumption is encoded as: GGG has a minimizer y0y_0y0​ and G(y)>G(y0)+KG(y)>G(y_0)+KG(y)>G(y0​)+K for all but finitely many yyy. Under unimodality this is equivalent to the page's limit condition. It is not strengthened to G→+∞G\to+\inftyG→+∞.
  • Optimality is among (s, S) policies. That an (s, S) policy is optimal among all policies is Veinott (1966) and is neither stated nor used. c∗c^*c∗, c∗(S)c^*(S)c∗(S), yi∗y_i^*yi∗​, Sˉ∗\bar S^*Sˉ∗, Sˉc\bar S_cSˉc​ and s′s's′ are never real infima: they are the cost of a given optimal pair, ∃\exists∃-statements, or binders characterised as least or greatest elements.
  • The algorithm is a step function on the state (s,S,S0,c0,phase)(s,S,S^0,c^0,\text{phase})(s,S,S0,c0,phase) that keeps the paper's order of tests and its weak and strict inequalities. The run with nnn steps returns an output only if the algorithm has terminated.
  • Ruled out as trivializing: comparing only with the pairs the algorithm visits or with a bounded box; assuming termination, or a budget that returns the current state; assuming G→+∞G\to+\inftyG→+∞; leaving c(s,S)c(s,S)c(s,S) unguarded for s≥Ss\ge Ss≥S.
  • Repaired statements. Lemma 3(a) is stated with condition (7) at S0S^0S0 as an extra hypothesis. With s0s^0s0 merely optimal it fails when mmm has a zero: for p=(1/5,0,1/5,3/5)p=(1/5,0,1/5,3/5)p=(1/5,0,1/5,3/5), m(1)=0m(1)=0m(1)=0 and adjacent reorder levels tie. The algorithm always has (7). Lemma 1(b), "an optimal reorder level satisfying (7) exists for every SSS", is false when lim⁡y→−∞G(y)\lim_{y\to-\infty}G(y)limy→−∞​G(y) is finite. An example is D≡2D\equiv2D≡2, K=1K=1K=1, G(0)=5G(0)=5G(0)=5, G(y)=10−0.1⋅2−∣y∣G(y)=10-0.1\cdot2^{-|y|}G(y)=10−0.1⋅2−∣y∣ (y≠0y\neq0y=0), S=1S=1S=1, where no optimal reorder level exists. It is not posed here, and the goal does not depend on it.
  • Not formalized: Theorem 1(b)–(c), the operation counts, which depend on a bookkeeping model described in words; Corollary 3, which the paper notes is not needed for the algorithm; and the variant for a general starting level S0S_0S0​.
  • Welcome contributions: general facts about the discrete renewal density (m≥0m\ge0m≥0, M>0M>0M>0), the identity (6), and lemmas on c(⋅,S)c(\cdot,S)c(⋅,S) that are reusable for related (s, S) and (r, Q) work.

Selected references

  • Y.-S. Zheng and A. Federgruen, Finding Optimal (s, S) Policies Is About As Simple As Evaluating a Single Policy, Operations Research 39(4):654–665, 1991. https://doi.org/10.1287/opre.39.4.654
  • A. F. Veinott Jr. and H. M. Wagner, Computing Optimal (s, S) Inventory Policies, Management Science 11(5):525–552, 1965. https://doi.org/10.1287/mnsc.11.5.525
  • A. F. Veinott Jr., On the Optimality of (s, S) Inventory Policies: New Conditions and a New Proof, SIAM J. Applied Mathematics 14(5):1067–1083, 1966. https://doi.org/10.1137/0114086
  • A. Federgruen and P. Zipkin, An Efficient Algorithm for Computing Optimal (s, S) Policies, Operations Research 32(6):1268–1285, 1984. https://doi.org/10.1287/opre.32.6.1268
  • A. Federgruen and Y.-S. Zheng, An Efficient Algorithm for Computing an Optimal (r, Q) Policy in Continuous Review Stochastic Inventory Systems, Operations Research 40(4):808–813, 1992. https://doi.org/10.1287/opre.40.4.808
14 thms1 active userReviewed
ProbabilityStochastic Systems·Captain: mikedeng1

Poisson Arrivals See Time Averages: Under Lack of Anticipation, the Fraction of Time in B Converges a.s. iff the Fraction of Arrivals Finding B Does, to the Same LimitResearch Paper

Why arrival averages and time averages agree

Queueing analysis constantly moves between two kinds of long-run averages: the fraction of time a system spends in some set of states, and the fraction of arriving customers who find it there. Waiting-time formulas for the M/G/1 queue, blocking probabilities in loss systems and many decomposition arguments rest on the claim that, when arrivals form a Poisson process, the two coincide. This property is known as PASTA, Poisson Arrivals See Time Averages. It is used throughout queueing theory, inventory theory and the analysis of communication networks, usually without proof.

Before 1982 the property had been proved under strong extra structure:

  • Strauch (1970) proved an instantaneous version, at a fixed time point, which does not by itself give limit theorems.
  • Wolff (1970) proved a limit theorem for a stationary observed process, using particular properties of its interaction with the Poisson stream.
  • Stidham (1972) proved a limit theorem for regenerative processes, under restrictions on how regeneration points relate to the arrivals.
  • Wolff (1982), the source of this mission, proved the limit theorem with no stationarity, regeneration or ergodicity at all. The only link assumed between system and arrivals is that the system does not anticipate future arrivals. The proof uses Watanabe's (1964) martingale characterization of the Poisson process.
  • Melamed and Whitt (1990) recast the result as one instance of a general "arrivals see time averages" (ASTA) principle for arbitrary point processes.

Setting

Let (Ω,F,P)(\Omega,\mathcal F,P)(Ω,F,P) be a probability space. On it live a process N={N(t),t≥0}N=\{N(t),t\ge0\}N={N(t),t≥0}, the state of a system, with values in an arbitrary measurable space, and a Poisson process A={A(t),t≥0}A=\{A(t),t\ge0\}A={A(t),t≥0} at rate λ>0\lambda>0λ>0, counting customer arrivals in (0,t](0,t](0,t]. The interaction between AAA and NNN is unspecified: arrivals may change the state.

Fix a set BBB of states with {N(t)∈B}∈F\{N(t)\in B\}\in\mathcal F{N(t)∈B}∈F for every t≥0t\ge0t≥0, and define

U(t)=1{N(t)∈B},V(t)=t−1∫0tU(s) ds,Y(t)=∫0tU(s) dA(s),Z(t)=Y(t)A(t).U(t)=\mathbf 1\{N(t)\in B\},\qquad V(t)=t^{-1}\int_0^tU(s)\,ds,\qquad Y(t)=\int_0^tU(s)\,dA(s),\qquad Z(t)=\frac{Y(t)}{A(t)}.U(t)=1{N(t)∈B},V(t)=t−1∫0t​U(s)ds,Y(t)=∫0t​U(s)dA(s),Z(t)=A(t)Y(t)​.

V(t)V(t)V(t) is the fraction of time in [0,t][0,t][0,t] that NNN is in BBB. Y(t)Y(t)Y(t) is the number of arrivals up to ttt who find NNN in BBB, and Z(t)Z(t)Z(t) is the fraction of arrivals who do.

The paths of UUU are assumed left continuous with right-hand limits w.p. 1, so that an arrival is not counted as already present at its own arrival epoch. UUU is assumed jointly measurable in (ω,t)∈Ω×[0,∞)(\omega,t)\in\Omega\times[0,\infty)(ω,t)∈Ω×[0,∞). The single structural assumption is the Lack of Anticipation Assumption (LAA):

for each t≥0t\ge0t≥0, {A(t+u)−A(t),u≥0}\{A(t+u)-A(t),u\ge0\}{A(t+u)−A(t),u≥0} and {U(s),0≤s≤t}\{U(s),0\le s\le t\}{U(s),0≤s≤t} are independent.

The paper's proof of (6) uses this independence for every event of Ft\mathcal F_tFt​, the σ-field generated by {A(s),U(s);0≤s≤t}\{A(s),U(s);0\le s\le t\}{A(s),U(s);0≤s≤t}. The mission therefore states Theorems 1–2, (6), Lemma 1, (10) and Lemma 2 under lack of anticipation with respect to Ft\mathcal F_tFt​: for each t≥0t\ge0t≥0, {A(t+u)−A(t),u≥0}\{A(t+u)-A(t),u\ge0\}{A(t+u)−A(t),u≥0} is independent of Ft\mathcal F_tFt​. This implies the printed LAA. The printed LAA together with independent increments does not give (6) or Lemma 1, because pairwise independence of the future from the past of AAA and from the past of UUU is not independence from their joint past.

Formalization targets

Goal: Theorem 1 (p. 225)

Under lack of anticipation (with respect to Ft\mathcal F_tFt​, see above), for every random variable V(∞)V(\infty)V(∞),

V(t)→V(∞) w.p. 1⟺Z(t)→V(∞) w.p. 1,t→∞.V(t)\to V(\infty)\ \text{w.p. 1}\quad\Longleftrightarrow\quad Z(t)\to V(\infty)\ \text{w.p. 1},\qquad t\to\infty.V(t)→V(∞) w.p. 1⟺Z(t)→V(∞) w.p. 1,t→∞.

The limit may be random, and the theorem asserts nothing about whether either average converges. It asserts only that the two converge together, to the same limit.

Milestones

The proof in §2 passes through the following statements, which form the milestone list:

  1. (2), (3): E{Y(t)}=λtE{V(t)}=λE{∫0tU(s) ds}E\{Y(t)\}=\lambda tE\{V(t)\}=\lambda E\{\int_0^tU(s)\,ds\}E{Y(t)}=λtE{V(t)}=λE{∫0t​U(s)ds}.
  2. (6): E{Y(t+h)−Y(t)∣Ft}=λE{∫tt+hU(s) ds∣Ft}E\{Y(t+h)-Y(t)\mid\mathcal F_t\}=\lambda E\{\int_t^{t+h}U(s)\,ds\mid\mathcal F_t\}E{Y(t+h)−Y(t)∣Ft​}=λE{∫tt+h​U(s)ds∣Ft​}.
  3. Lemma 1: R(t)=Y(t)−λtV(t)R(t)=Y(t)-\lambda tV(t)R(t)=Y(t)−λtV(t) is a martingale.
  4. (7): the second-moment bound E{R2(t)}≤λt+2λ2t2E\{R^2(t)\}\le\lambda t+2\lambda^2t^2E{R2(t)}≤λt+2λ2t2.
  5. (10): the grid strong law R(nh)/n→0R(nh)/n\to0R(nh)/n→0 w.p. 1.
  6. (11): the pathwise interpolation bound between grid points.
  7. Lemma 2: R(t)/t→0R(t)/t\to0R(t)/t→0 w.p. 1.
  8. The strong law A(t)/t→λA(t)/t\to\lambdaA(t)/t→λ for the Poisson process.

Companion: Theorem 2 (p. 228)

For a Poisson process with bounded, integrable rate λ(t)\lambda(t)λ(t) and Λ(t)/t→λˉ∈(0,∞)\Lambda(t)/t\to\bar\lambda\in(0,\infty)Λ(t)/t→λˉ∈(0,∞), where Λ(t)=∫0tλ(s) ds\Lambda(t)=\int_0^t\lambda(s)\,dsΛ(t)=∫0t​λ(s)ds, the same equivalence holds with V(t)V(t)V(t) replaced by the rate-weighted average Vˉ(t)=Λ(t)−1∫0tU(s)λ(s) ds\bar V(t)=\Lambda(t)^{-1}\int_0^tU(s)\lambda(s)\,dsVˉ(t)=Λ(t)−1∫0t​U(s)λ(s)ds. Display (12), E{Y(t)}=∫0tE{U(s)}λ(s) dsE\{Y(t)\}=\int_0^tE\{U(s)\}\lambda(s)\,dsE{Y(t)}=∫0t​E{U(s)}λ(s)ds, is its analogue of (3).

Significance

Theorem 1 justifies replacing customer averages by time averages, and conversely, in any model where arrivals are Poisson and the system does not anticipate them. Examples are queue-length distributions seen by arrivals in M/G/c systems, blocking probabilities in Erlang loss models, and state probabilities at arrival epochs in networks with Poisson external input. It needs no ergodic theory of the observed process: convergence of one average has to be established separately, by whatever means suit the model, and the theorem transfers it to the other. Lemma 2 also implies versions of PASTA under weaker modes of convergence (Remark 6).

The result has been proved for four decades and is textbook material. What this mission adds is a machine-checked proof. No formalization of Theorem 1 in a proof assistant is known. A complete development would also contain machine-checked versions of several standard facts not yet available in Mathlib:

  • the strong law for the Poisson process;
  • a strong law for square-integrable martingale differences;
  • Stieltjes integration against a counting path.

Difficulty

The naive argument conditions on the arrival epochs and claims that each arrival "samples" the state at a uniformly random time. This fails because arrivals influence the state: after an arrival, a queue-length process is no longer independent of the arrival stream. LAA only says that the future increments of AAA are independent of the past of UUU. The difficulty is to turn this one-sided independence into an almost-sure statement about long-run averages, along every path and at all times rather than only at fixed ones.

On the technical side, the expected-value identity (3) needs a limit of grid sums. That limit relies on left continuity: without it, U(t)=1{A jumps at t}U(t)=\mathbf 1\{A \text{ jumps at } t\}U(t)=1{A jumps at t} satisfies LAA with V≡0V\equiv0V≡0 but Z≡1Z\equiv1Z≡1. The passage from expectations to a strong law needs a martingale structure and a second-moment bound, and the interpolation between grid times needs a pathwise argument.

Formalization scope

  • Time and paths. Time is R\mathbb RR, and every hypothesis concerns t≥0t\ge0t≥0 only. Processes are maps R→Ω→(⋅)\mathbb R\to\Omega\to(\cdot)R→Ω→(⋅). A Poisson process with intensity function λ(⋅)\lambda(\cdot)λ(⋅) is a counting process A:R→Ω→NA:\mathbb R\to\Omega\to\mathbb NA:R→Ω→N with A(0)=0A(0)=0A(0)=0, every path non-decreasing and right-continuous, Poisson-distributed increments with mean ∫stλ\int_s^t\lambda∫st​λ, and independent increments over any finite increasing sequence of times. The constant-rate case is Theorem 1's setting.
  • The averages. Y(t)Y(t)Y(t) is encoded as ∑k=1A(t)U(Tk)\sum_{k=1}^{A(t)}U(T_k)∑k=1A(t)​U(Tk​) over the arrival epochs Tk=inf⁡{s≥0:A(s)≥k}T_k=\inf\{s\ge0:A(s)\ge k\}Tk​=inf{s≥0:A(s)≥k}, which is the Lebesgue–Stieltjes integral ∫(0,t]U dA\int_{(0,t]}U\,dA∫(0,t]​UdA with multiplicities. Z(t)=0Z(t)=0Z(t)=0 when A(t)=0A(t)=0A(t)=0, and V(0)=0V(0)=0V(0)=0; limits do not see these values.
  • The standing hypotheses. These are carried as binders of the goal: measurability of {N(t)∈B}\{N(t)\in B\}{N(t)∈B} for t≥0t\ge0t≥0, path regularity w.p. 1 (left continuity at t>0t>0t>0, right limits at t≥0t\ge0t≥0), joint measurability on Ω×[0,∞)\Omega\times[0,\infty)Ω×[0,∞), and lack of anticipation as independence of the σ-field of future increments of AAA from Ft\mathcal F_tFt​. The milestones (2), (3), (7) and (11) need less: (2) and (3) are stated under the printed LAA, and (7) and (11) under no independence assumption at all.
  • The limit and the expectations. V(∞)V(\infty)V(∞) is an arbitrary function Ω→R\Omega\to\mathbb RΩ→R, shared by both sides of the equivalence. Expectations in the milestones come with integrability conclusions, or are lower integrals in [0,∞][0,\infty][0,∞], so that no identity holds through Lean's junk value 000 for non-integrable functions.
  • Ruled out. A formalization in which V(∞)V(\infty)V(∞) is quantified separately on each side, which loses "to the same limit". A goal that assumes Lemma 2, (3) or the strong law A(t)/t→λA(t)/t\to\lambdaA(t)/t→λ as a hypothesis. A definition of YYY that counts distinct jump times and not arrivals.

Welcome contributions:

  • a reusable Poisson-process library: the strong law, square moments, independence of increments from a past σ-field;
  • a martingale strong law of Feller's type;
  • Stieltjes sums against counting paths.

All of these are useful well beyond this mission.

Selected references

  • R. W. Wolff, Poisson Arrivals See Time Averages, Operations Research 30(2):223–231, 1982. https://doi.org/10.1287/opre.30.2.223
  • S. Watanabe, On discontinuous additive functionals and Lévy measures of a Markov process, Japanese Journal of Mathematics 34:53–70, 1964. https://doi.org/10.4099/jjm1924.34.0_53
  • B. Melamed and W. Whitt, On arrivals that see time averages, Operations Research 38(1):156–172, 1990. https://doi.org/10.1287/opre.38.1.156
  • P. Brémaud and J. Jacod, Processus ponctuels et martingales: résultats récents sur la modélisation et le filtrage, Advances in Applied Probability 9(2):362–416, 1977. https://doi.org/10.2307/1426091
  • S. Stidham, Regenerative processes in the theory of queues, with applications to the alternating-priority queue, Advances in Applied Probability 4(3):542–577, 1972.
  • W. Feller, An Introduction to Probability Theory and Its Applications, Vol. II, 2nd ed., Wiley, 1971.
11 thms1 active userReviewed
Bandit AlgorithmsDynamic ProgrammingProbability·Captain: mikedeng1

Multi-armed Bandits and the Gittins Index: With Per-Project Horizons the Maximal M-Process Reward Is K − ∫_M^K ∏ᵢ ∂φᵢ/∂m dm and the Gittins Index Rule Attains ItResearch Paper

Motivation

The multi-armed bandit problem asks how to allocate effort sequentially among NNN independent projects, only one of which can be worked on at a time, so as to maximise expected total discounted reward. It is the model behind research planning, clinical-trial allocation and job scheduling, and it is the prototypical example of a Markov decision problem whose state space grows exponentially in NNN yet whose optimal policy is simple. Gittins and Jones (1974) and Gittins (1979) showed that each project can be given an index computed from that project alone, and that it is optimal always to engage a project of largest index. P. Whittle's 1980 paper gave a short proof of this theorem by attaching a retirement option to the process, and extended it to projects with individual horizons.

Timeline:

  • 1974–1979. Gittins and Jones introduce the dynamic allocation index; Gittins (1979, JRSS B) proves its optimality by an interchange argument.
  • 1980. Whittle (JRSS B 42, 143–149) introduces the MMM-process, proves the finite-horizon formula (Theorem 1 below), derives the infinite-horizon identity (12), and extends the result to superprocesses (Theorem 2).
  • 1980s–2010s. Weber (1992) and Tsitsiklis (1994) give further short proofs; the index theory is collected in Gittins, Glazebrook and Weber, Multi-armed Bandit Allocation Indices (Wiley, 2011).

Setting

There are NNN projects. Project iii has a state xix_ixi​ in a measurable space XiX_iXi​. Engaging project iii in state xix_ixi​ earns the expected reward Ri(xi)R_i(x_i)Ri​(xi​) and moves its state by a Markov kernel PiP_iPi​; the other projects' states do not change. Rewards are discounted by β\betaβ, 0≤β<10 \le \beta < 10≤β<1, and bounded:

k(1−β)≤Ri(xi)≤K(1−β).(1)k(1-\beta) \le R_i(x_i) \le K(1-\beta). \qquad (1)k(1−β)≤Ri​(xi​)≤K(1−β).(1)

The operator Liθ(x)=Ri(xi)+β E[θ(x(t+1))∣x(t)=x,i(t)=i]L_i\theta(x) = R_i(x_i) + \beta\,\mathbb E[\theta(x(t+1)) \mid x(t) = x, i(t) = i]Li​θ(x)=Ri​(xi​)+βE[θ(x(t+1))∣x(t)=x,i(t)=i] evaluates engaging project iii for one step.

In the MMM-process one may also retire at any time for the reward MMM. Its value F(x,M)F(x, M)F(x,M) solves F=max⁡(M,max⁡iLiF)F = \max(M, \max_i L_i F)F=max(M,maxi​Li​F) (4), and the value φi(xi,M)\varphi_i(x_i, M)φi​(xi​,M) of the single-project MMM-process solves φi=max⁡(M,Liφi)\varphi_i = \max(M, L_i\varphi_i)φi​=max(M,Li​φi​) (9).

With per-project horizons, project iii may be operated at most sis_isi​ more times. A project with si>0s_i > 0si​>0 is active, and DisD_i sDi​s lowers sis_isi​ by one. The single-project value φi(xi,si,M)\varphi_i(x_i, s_i, M)φi​(xi​,si​,M) satisfies φi(xi,0,M)=M\varphi_i(x_i, 0, M) = Mφi​(xi​,0,M)=M and

φi(xi,si,M)=max⁡[M, Ri(xi)+β E φi(xi(t+1),si−1,M)].(14)\varphi_i(x_i, s_i, M) = \max\big[M,\ R_i(x_i) + \beta\,\mathbb E\,\varphi_i(x_i(t+1), s_i - 1, M)\big]. \qquad (14)φi​(xi​,si​,M)=max[M, Ri​(xi​)+βEφi​(xi​(t+1),si​−1,M)].(14)

F(x,s,M)F(x, s, M)F(x,s,M) is the maximal expected reward of the MMM-process under these limits. The index Mi(xi,si)M_i(x_i, s_i)Mi​(xi​,si​) is the infimal MMM with φi(xi,si,M)=M\varphi_i(x_i, s_i, M) = Mφi​(xi​,si​,M)=M, and vi=(1−β)Miv_i = (1-\beta)M_ivi​=(1−β)Mi​ is the Gittins index. Finally

F^(x,s,M)=K−∫MK∏i∂φi(xi,si,m)∂m dm.(13)\hat F(x, s, M) = K - \int_M^K \prod_i \frac{\partial \varphi_i(x_i, s_i, m)}{\partial m}\, dm. \qquad (13)F^(x,s,M)=K−∫MK​i∏​∂m∂φi​(xi​,si​,m)​dm.(13)

Formalization targets

Goal: Theorem 1 (p. 147)

F(x,s,M)=F^(x,s,M),F(x, s, M) = \hat F(x, s, M),F(x,s,M)=F^(x,s,M),

and FFF is attained by the policy that, at (x,s)(x, s)(x,s), engages a project iii maximising Mi(xi,si)M_i(x_i, s_i)Mi​(xi​,si​) when this maximum exceeds MMM, and otherwise retires. The Lean goal has three conjuncts: F=F^F = \hat FF=F^, every measurable index rule (any tie-breaking) earns FFF, and no feasible measurable Markov policy earns more than FFF.

Milestones (the steps of the proof)

  • Lemma 1 (p. 144): F(x,M)F(x, M)F(x,M) is non-decreasing and convex in MMM, equals Φ(x)\Phi(x)Φ(x) for M≤kM \le kM≤k and MMM for M≥KM \ge KM≥K.
  • (18) (p. 147): Pi(x,s,M)=∏j≠i∂φj/∂MP_i(x,s,M) = \prod_{j \ne i}\partial\varphi_j/\partial MPi​(x,s,M)=∏j=i​∂φj​/∂M is a distribution function in MMM, equal to 111 for M≥M(i)=max⁡j≠iMjM \ge M_{(i)} = \max_{j\ne i} M_jM≥M(i)​=maxj=i​Mj​.
  • (19) (p. 147): F^=φiPi+∫M∞φi dmPi\hat F = \varphi_i P_i + \int_M^\infty \varphi_i\, d_m P_iF^=φi​Pi​+∫M∞​φi​dm​Pi​.
  • (21) (p. 148): F^≥LiF^\hat F \ge L_i\hat FF^≥Li​F^, with equality if Mi=max⁡jMj≥MM_i = \max_j M_j \ge MMi​=maxj​Mj​≥M.
  • Retirement case (p. 148): if max⁡jMj≤M\max_j M_j \le Mmaxj​Mj​≤M then F^=M\hat F = MF^=M.
  • (16) (p. 147): F^=max⁡(M,max⁡iLiF^)\hat F = \max(M, \max_i L_i\hat F)F^=max(M,maxi​Li​F^) and F^(x,0,M)=M\hat F(x, 0, M) = MF^(x,0,M)=M.

Further item

  • Infinite horizon (p. 148, formula (12) of p. 146): F(x,M)=K−∫MK∏i∂φi(xi,m)/∂m dmF(x, M) = K - \int_M^K \prod_i \partial\varphi_i(x_i, m)/\partial m\, dmF(x,M)=K−∫MK​∏i​∂φi​(xi​,m)/∂mdm, with the index rule optimal.

Significance

Theorem 1 reduces an NNN-project problem, whose state space is a product, to NNN one-dimensional retirement problems. The formula (13) shows more than optimality of the index rule: the derivative of the multi-project value in MMM is the product of the single-project derivatives, so the multi-project value is computable from the projects separately. The finite-horizon version gives an inductive argument that avoids the interchange arguments of earlier proofs, and the infinite-horizon identity (12) follows from it.

The result is classical and proved. What this mission adds is a machine-checked version in a generality not yet on the platform: heterogeneous projects (each with its own kernel and reward on its own measurable space), a retirement option, and per-project horizons. The platform already has a proved index theorem for identical arms sharing one kernel and reward without retirement, BanditAlgorithm.gittins_index_theorem (Lattimore–Szepesvári, Theorem 35.9), single-arm retirement values in charge form (GittinsFiniteRetirementValue), and open Beta–Bernoulli special cases from Bäuerle–Rieder (MDPFinance.InfiniteHorizonApplications.proposition_7_6_7, proposition_7_6_9, theorem_7_6_10). None of these states Theorem 1, formula (13) or formula (12).

Difficulty

The obvious approach, value iteration on the product state space, gives existence of an optimal policy but says nothing about its structure. The content of Theorem 1 lies in the identity of a multi-dimensional value with an integral of a product of one-dimensional derivatives. Verifying it requires differentiating single-project values in MMM (they are convex, but have a kink exactly at the index, where the choice of one-sided derivative matters), an integration by parts against a Stieltjes measure in MMM, and an exchange of the expectation over the next state with the MMM-integral. The exhausted projects (si=0s_i = 0si​=0) and the boundary M=MiM = M_iM=Mi​ need separate care in every step.

Formalization scope

  • Projects are indexed by Fin N (0-based; the paper uses 1,…,N1, \dots, N1,…,N). State spaces are arbitrary measurable spaces; no finiteness or countability is assumed. Kernels are Markov, rewards measurable and bounded as in (1), and 0≤β<10 \le \beta < 10≤β<1 (β = 0 is allowed). kkk and KKK are any constants satisfying (1).
  • Budgets are s : Fin N → ℕ; DisD_i sDi​s is Function.update s i (s i - 1) and is only applied to active projects.
  • F(x,s,M)F(x, s, M)F(x,s,M), the "maximal reward", is the backward-induction value: F(x,0,M)=MF(x, 0, M) = MF(x,0,M)=M and F=max⁡(M,max⁡i activeLiF)F = \max(M, \max_{i\ \text{active}} L_iF)F=max(M,maxi active​Li​F), defined by recursion on ∑isi\sum_i s_i∑i​si​. It is not defined through F^\hat FF^, the index, or a policy. φi(xi,si,M)\varphi_i(x_i, s_i, M)φi​(xi​,si​,M) is defined by (14) with φi(xi,0,M)=M\varphi_i(x_i, 0, M) = Mφi​(xi​,0,M)=M.
  • ∂/∂m\partial/\partial m∂/∂m is the right derivative. Since the φi\varphi_iφi​ are convex in mmm, this changes (13) at no point, and it makes (18) hold at the kink M=M(i)M = M_{(i)}M=M(i)​.
  • The index of an exhausted project is the paper's −∞-\infty−∞. In Lean index takes the junk value 0 there; every use (the index rule, M(i)M_{(i)}M(i)​, max⁡jMj\max_j M_jmaxj​Mj​) ranges over active projects only.
  • Policies are Markov in (x,s,M)(x, s, M)(x,s,M), valued in Option (Fin N) (none = retire), feasible (they engage only active projects) and measurable (each decision set is measurable), so that their expected rewards are well defined. The index rule allows arbitrary tie-breaking; the goal quantifies over every such rule.
  • Infinite-horizon values (Lemma 1, the further item) are any bounded measurable solutions of (2), (4), (9); such solutions exist and are unique by the contraction property.
  • (19) uses the Stieltjes measure of any monotone right-continuous function agreeing with PiP_iPi​, and integrates over m>Mm > Mm>M.
  • Trivializing formalizations are excluded: FFF is not F^\hat FF^ by definition, exhausted projects cannot be engaged by the index rule, and maxima over iii are seeded with MMM rather than taken as a junk real supremum.

A complete development needs measurability of the recursive values, convexity of φi\varphi_iφi​ in MMM with one-sided derivatives, Lebesgue–Stieltjes integration by parts, and Fubini for kernels. Convexity of finite-horizon retirement values and the integration-by-parts identity are reusable beyond this mission. Contributions to any milestone, and sorry-free lemmas on these ingredients, are welcome.

Selected references

  • P. Whittle, Multi-armed Bandits and the Gittins Index, J. R. Statist. Soc. B 42(2), 143–149, 1980. https://doi.org/10.1111/j.2517-6161.1980.tb01111.x
  • J. C. Gittins, Bandit Processes and Dynamic Allocation Indices, J. R. Statist. Soc. B 41(2), 148–177, 1979. https://doi.org/10.1111/j.2517-6161.1979.tb01068.x
  • D. Blackwell, Discounted Dynamic Programming, Ann. Math. Statist. 36(1), 226–235, 1965. https://doi.org/10.1214/aoms/1177700285
  • J. Gittins, K. Glazebrook, R. Weber, Multi-armed Bandit Allocation Indices, 2nd ed., Wiley, 2011. https://doi.org/10.1002/9780470980033
  • T. Lattimore, Cs. Szepesvári, Bandit Algorithms, Cambridge University Press, 2020, Chapter 35. https://doi.org/10.1017/9781108571401
8 thms1 active userReviewed
CombinatoricsGraph Theory·Captain: mikedeng1

An Introduction to Timetabling 3: Course Scheduling with Unavailabilities and Preassignments in p Periods Is Equivalent to p-Coloring the Nodes of a GraphResearch Paper

Motivation

Universities schedule lectures and examinations every term. When students choose their courses freely, with no fixed curriculum, the basic requirement is that no student is asked to attend two lectures at the same time. On top of this come local constraints: a course cannot take place at some periods (its teacher or a suitable room is unavailable), and some lectures are fixed in advance at a given period. D. de Werra's invited review An introduction to timetabling (Eur. J. Oper. Res. 19 (1985) 151–162) surveys the graph models of these problems. Its §3.1 shows that course scheduling, with unavailabilities and preassignments, is exactly a node colouring problem. This reduction is the standard starting point for graph colouring heuristics in timetabling, including the examination timetabling literature.

Setting

A course scheduling instance has qqq courses KbK_bKb​, course KbK_bKb​ consisting of kbk_bkb​ lectures lal_ala​, and rrr students; student iii takes a set TiT_iTi​ of courses. There are ppp periods.

The lecture graph GGG has one lecture-node mabm_{ab}mab​ for each lecture lal_ala​ of each course KbK_bKb​. Two lecture-nodes of the same course are adjacent. Two lecture-nodes of distinct courses KbK_bKb​, KbˉK_{\bar b}Kbˉ​ are adjacent whenever some student takes both courses.

A feasible course schedule in ppp periods assigns a period s(l)∈{1,…,p}s(l) \in \{1,\dots,p\}s(l)∈{1,…,p} to each lecture so that two lectures of one course are at different periods and no student has two lectures at the same period.

A course scheduling problem with unavailabilities and preassignments (CSUP) adds, for each course KbK_bKb​, a set UbU_bUb​ of forbidden periods, and for some lectures lll a prescribed period kˉ(l)\bar k(l)kˉ(l). A solution is a feasible schedule with s(l)∉Ubs(l) \notin U_bs(l)∈/Ub​ for every lecture lll of KbK_bKb​ and s(l)=kˉ(l)s(l) = \bar k(l)s(l)=kˉ(l) for every preassigned lecture.

The graph G^\hat GG^ of a CSUP adds one period-node kkk per period to GGG. All pairs of period-nodes are adjacent. A lecture-node of KbK_bKb​ is adjacent to period-node kkk if k∈Ubk \in U_bk∈Ub​. A lecture-node of a lecture preassigned to kˉ\bar kkˉ is adjacent to every period-node k≠kˉk \neq \bar kk=kˉ.

A node colouring with ppp colours assigns one of ppp colours to each node so that adjacent nodes get different colours.

Formalization targets

Goal: Proposition 3.1

the CSUP P has a solution in p periods  ⟺  G^(P) has a node colouring with p colours.\text{the CSUP } P \text{ has a solution in } p \text{ periods} \iff \hat G(P) \text{ has a node colouring with } p \text{ colours.}the CSUP P has a solution in p periods⟺G^(P) has a node colouring with p colours.

Milestones

  1. §3.1 (p. 157). Without unavailabilities and preassignments, the feasible schedules in ppp periods are exactly the node colourings of GGG with ppp colours.
  2. Figure 4 (p. 157). For courses K1,K2,K3K_1,K_2,K_3K1​,K2​,K3​ with 1,2,21,2,21,2,2 lectures, student 1 taking K1,K2K_1,K_2K1​,K2​ and student 2 taking K2,K3K_2,K_3K2​,K3​, the printed schedule in 444 periods is feasible.
  3. Proof of Proposition 3.1 (p. 158). Every colouring of G^\hat GG^ with ppp colours gives a solution in which lecture lal_ala​ of KbK_bKb​ is at period kkk exactly when mabm_{ab}mab​ has the colour of period-node kkk, and every solution arises in this way from some colouring.
  4. Proposition 3.2 (p. 158). Let HHH be a graph on lecture-nodes and a clique of ppp period-nodes, with some lecture-nodes precoloured consistently with the colours of period-nodes. Removing the precoloured nodes and joining their neighbours to the matching period-nodes gives a graph G^′\hat G'G^′ with
H has a p-colouring respecting the precolouring  ⟺  G^′ is p-colourable.H \text{ has a } p\text{-colouring respecting the precolouring} \iff \hat G' \text{ is } p\text{-colourable.}H has a p-colouring respecting the precolouring⟺G^′ is p-colourable.

Significance

The result. Proposition 3.1 turns a family of constrained timetabling problems into one well-studied problem. Any exact or heuristic method for node colouring (sequential colouring, DSATUR, implicit enumeration; §3.2 of the paper) applies directly to course scheduling with forbidden and fixed periods, and lower bounds on the chromatic number become lower bounds on the number of periods. Proposition 3.2 adds that preassignments cost nothing for node colouring: a precoloured instance is again a plain colouring instance. For edge colouring the paper contrasts this with the NP-completeness of precoloured edge colouring.

The formalization. The results are proved on the page in a few lines and are not machine-checked anywhere. This mission makes the reduction precise. It writes out the graph G^\hat GG^ as a definition, isolates the consistency condition that Proposition 3.2 needs, and states the correspondence between colourings and schedules in a form other formal timetabling and scheduling developments can use. The definitions of course instances, CSUP and G^\hat GG^ can serve formal work on examination timetabling and on the complexity of timetabling problems.

Difficulty

The forward direction of Proposition 3.1 is direct: colour each lecture-node with its period and each period-node with itself. The converse is where care is needed. A colouring of G^\hat GG^ need not give period-node kkk the colour kkk; the colours of the period-nodes can be any permutation of the palette. The schedule must therefore be read through the colours of the period-nodes, and the fact that the ppp period-nodes form a clique is what makes this well defined.

For Proposition 3.2, the obvious reading of the page is false. If two adjacent lecture-nodes are precoloured with the same colour, no colouring respects the precolouring, yet removing both nodes deletes the edge between them and the reduced graph may still be colourable. The same happens when a node is precoloured with the colour of a period-node it is adjacent to. The proposition therefore needs a consistency condition the page leaves implicit. The page's "1–1 correspondence" between colourings fails when precolours are fixed colours of the palette, since G^′\hat G'G^′'s colourings can permute the colours of the period clique; the target is the equivalence of the proposition.

Formalization scope

Courses, students, lectures of a course and periods are indexed from 000 (Fin q, Fin r, Fin (lectures b), Fin p). A lecture is a dependent pair Σ b, Fin (lectures b), and the nodes of G^\hat GG^ are Lecture ⊕ Fin p. Graphs and colourings are Mathlib's SimpleGraph, SimpleGraph.Coloring and SimpleGraph.Colorable. Unavailability is per course and preassignment per lecture, as on the page. The set-valued constraint of the Figure 5 example ("1 lecture of K3K_3K3​ at period 1 or 2") is not modelled. Feasibility includes the clique on the lectures of each course even when no student takes the course, because the page's graph contains it. p=0p = 0p=0 is allowed.

The paper states Proposition 3.1 as "one can construct a graph G^\hat GG^ such that …". The existential form is trivially true (pick a complete graph on p+1p+1p+1 nodes or an edgeless graph according to the answer), so the goal is stated about the specific graph csupGraph P built in the proof.

Proposition 3.2 is stated for any graph whose period-nodes form a clique, with two disclosed consistency hypotheses: no precoloured node is adjacent to its own period-node, and no two adjacent nodes are precoloured with the same period-node's colour. A sanity file shows that the equivalence fails without them. "Precoloured" means "receives the colour of period-node kkk", the reading of the proof of Proposition 3.1.

Not targeted: the NP-completeness remarks (cited, not proved), the heuristics of §3.2–§3.4, and the hypergraph classroom model of §3.5, whose "1–1 correspondence" has the same palette-permutation issue as Proposition 3.2.

Contributions welcome: proofs of the milestones and the goal, and general lemmas about colourings of graphs containing a clique of size equal to the number of colours.

Selected references

  • D. de Werra, An introduction to timetabling, European Journal of Operational Research 19 (1985) 151–162. https://doi.org/10.1016/0377-2217(85)90167-5
  • M. R. Garey, D. S. Johnson, Computers and Intractability: A Guide to the Theory of NP-Completeness, W. H. Freeman, 1979 (NP-completeness of graph ppp-colourability, reference [13] of the paper).
  • D. Brélaz, New methods to color the vertices of a graph, Communications of the ACM 22 (1979) 251–256. https://doi.org/10.1145/359094.359101
7 thms1 active userReviewed
ProbabilityReinforcement LearningStochastic Systems·Captain: mikedeng1

Asynchronous Stochastic Approximation and Q-Learning 2: Asynchronous Stochastic Approximation with Outdated Information Converges with Probability 1 Under a Weighted Maximum Norm ContractionResearch Paper

Motivation

Many iterative algorithms update only part of a vector at a time. In a parallel implementation, one processor may read a value written several rounds earlier by another processor. Random observations also perturb each update. John N. Tsitsiklis's 1994 paper gives conditions under which such an asynchronous stochastic iteration still converges. The paper develops the result to analyze Q-learning, where state-action values are revised from sampled costs and successor states. Its general theorem also applies to iterative fixed-point calculations beyond that application.

The central issue is that a processor can choose which component to update after seeing the past, and its input can be stale. A convergence theorem that presumes a fixed update schedule or current data would miss both features. The paper's Assumptions 1–3 describe when delays, sampling noise, and random step sizes remain compatible with almost-sure convergence. Assumption 5 gives a weighted maximum norm contraction for the iteration map. Theorem 3 combines these conditions into the target of this mission.

Setting

Fix a positive integer nnn and write x(t)∈Rnx(t)\in\mathbb R^nx(t)∈Rn for the vector after round t≥0t\ge0t≥0. Let F:Rn→RnF:\mathbb R^n\to\mathbb R^nF:Rn→Rn be the map whose fixed point the iteration seeks. For component iii, the step size αi(t)\alpha_i(t)αi​(t) lies in [0,1][0,1][0,1], the noise is wi(t)w_i(t)wi​(t), and τji(t)≤t\tau^i_j(t)\le tτji​(t)≤t is the time from which component jjj was read. Thus xi(t)x^i(t)xi(t) has coordinates xj(τji(t))x_j(\tau^i_j(t))xj​(τji​(t)). With αi(t)=0\alpha_i(t)=0αi​(t)=0 when component iii is idle, all rounds obey the single update equation

xi(t+1)=xi(t)+αi(t)(Fi(xi(t))−xi(t)+wi(t)).x_i(t+1)=x_i(t)+\alpha_i(t)\bigl(F_i(x^i(t))-x_i(t)+w_i(t)\bigr).xi​(t+1)=xi​(t)+αi​(t)(Fi​(xi(t))−xi​(t)+wi​(t)).

All quantities live on a probability space with law P\mathsf PP. The increasing filtration F(t)\mathcal F(t)F(t) represents information available when the step sizes and delays are selected, before the round's noise is observed. Assumption 1 says every timestamp τji(t)\tau^i_j(t)τji​(t) tends to infinity almost surely: no fixed old value remains in use forever. Assumption 2 makes the initial state, chosen step sizes, delays, and noise measurable at the specified times; the noise has conditional mean zero, and its conditional second moment is bounded by a deterministic affine function of the largest squared iterate seen so far. Assumption 3 requires, for each component, divergent total step size and a square-summable step-size sequence, with a deterministic bound on all squared partial sums.

For a vector vvv with strictly positive coordinates, the weighted maximum norm is ∥z∥v=max⁡i∣zi∣/vi\|z\|_v=\max_i |z_i|/v_i∥z∥v​=maxi​∣zi​∣/vi​. Assumption 5 provides x∗∈Rnx^*\in\mathbb R^nx∗∈Rn and β∈[0,1)\beta\in[0,1)β∈[0,1) such that ∥F(x)−x∗∥v≤β∥x−x∗∥v\|F(x)-x^*\|_v\le\beta\|x-x^*\|_v∥F(x)−x∗∥v​≤β∥x−x∗∥v​ for every xxx. Assumption 6, used in the boundedness milestone, requires the related growth bound ∥F(x)∥v≤β∥x∥v+D\|F(x)\|_v\le\beta\|x\|_v+D∥F(x)∥v​≤β∥x∥v​+D for some real DDD. The weighted norm permits different component scales.

Formalization targets

Boundedness under a weighted growth bound

Theorem 1 is the main intermediate target. Under Assumptions 1, 2, 3, and 6, it asserts

P ⁣(∃M∈R  ∀t,i, ∣xi(t)∣≤M)=1.\mathsf P\!\left(\exists M\in\mathbb R\;\forall t,i,\ |x_i(t)|\le M\right)=1.P(∃M∈R∀t,i, ∣xi​(t)∣≤M)=1.

The bound MMM may depend on the sample path. Lemmas 1–3 of the paper are milestones in its analysis: a scalar noisy recursion converges, its tails become uniformly small, and the pathwise bounds in the contradiction step hold.

Almost-sure convergence under a weighted contraction

The goal is Theorem 3, under Assumptions 1, 2, 3, and 5:

P ⁣(lim⁡t→∞x(t)=x∗)=1.\mathsf P\!\left(\lim_{t\to\infty}x(t)=x^*\right)=1.P(t→∞lim​x(t)=x∗)=1.

This theorem does not assume bounded iterates or Assumption 6 separately. Its proof uses Theorem 1 after deriving the needed growth bound from the contraction condition. Lemma 8 is the remaining milestone, comparing the coordinate iterates to an auxiliary deterministic recursion and a noise tail.

Significance

The result gives a fixed-point convergence guarantee when coordinates update at different times, delays can vary, and update choices can depend on past observations. In the paper's Q-learning application, these features describe exploratory sampling and possible parallel computation with old state-action values. For discounted problems, the associated Q-learning map contracts in the maximum norm, so Theorem 3 supplies the convergence step once the stochastic assumptions are checked (Tsitsiklis 1994, §7).

The mathematical results were proved in 1994; this mission asks for machine-checked proofs of their formal statements. Its reusable output would include a model of asynchronous noisy iteration, a scalar martingale-noise convergence lemma with random conditional variance bounds, and a precise interface between weighted contractions and pathwise convergence. The goal and milestone theorem files are currently statements with proof holes, while the definition file compiles without one.

Difficulty

A coordinate's next value depends on a vector assembled from observations at several earlier times. A direct estimate against the current error therefore does not close: the stale coordinates can reflect larger past errors. The noise condition is also tied to the largest iterate seen so far, so a deterministic global variance bound is unavailable before boundedness has been established. These two dependencies make the ordinary synchronous contraction argument insufficient. The scalar noise result and the pathwise comparison lemmas isolate the conditions needed for the boundedness and convergence statements.

Formalization scope

Vectors are functions Fin n → ℝ, with n>0n>0n>0; the source labels coordinates 1,…,n1,\ldots,n1,…,n, while Fin n starts at zero. Function order is componentwise. The model sets αi(t)=0\alpha_i(t)=0αi​(t)=0 on idle rounds and uses the paper's unified update equation. It does not store the sets of update times separately. The delay values on idle rounds are left arbitrary because they do not affect the update; the source chooses the current time there. All step sizes lie in [0,1][0,1][0,1], and all delays are at most the current time, on every sample path.

The probability law is a probability measure. The filtration consists of increasing sub-σ-algebras. The iterate sequence is explicitly assumed adapted in the main theorems, matching the paper's use of x(t)x(t)x(t) and its running maximum as F(t)\mathcal F(t)F(t)-measurable random variables. Conditional moment assumptions use integral inequalities over measurable sets, allowing generalized conditional expectations when the noise need not have a finite unconditional second moment. The conditional upper bound is required nonnegative almost surely, as the original inequality entails. Divergence and square summability use partial sums, so a non-summable series cannot receive a default value.

The maximum norm is the finite supremum of coordinate absolute values, and the weighted norm divides by the strictly positive coordinates of vvv. Almost-sure boundedness means a path-dependent finite bound on every coordinate and time. Pathwise Lemmas 3 and 8 are stated on a retained sample path, with the auxiliary quantities and hypotheses established at their locations in the paper; Lemma 8 uses the proof's translated and rescaled coordinates. These conventions rule out an empty coordinate type, junk integrals, and a vacuous boundedness claim. Contributions to the stated lemmas, their probabilistic infrastructure, and the final convergence proof are within scope.

Selected references

  • John N. Tsitsiklis, Asynchronous Stochastic Approximation and Q-Learning, Machine Learning 16 (1994), 185–202. DOI: 10.1023/A:1022689125041.
7 thms1 active userReviewed
ProbabilityReinforcement LearningStochastic Systems·Captain: mikedeng1

Asynchronous Stochastic Approximation and Q-Learning 1: Bounded Asynchronous Stochastic Approximation Iterates Converge with Probability 1 to the Unique Fixed Point of a Monotone Continuous MapResearch Paper

Motivation

Q-learning (Watkins, 1989) learns the optimal action values of a Markov decision problem from sampled transitions, without a model of the transition probabilities. At each step only one state–action pair is updated, with a noisy estimate of the Bellman operator evaluated at possibly outdated values of the other pairs. Watkins and Dayan (1992) gave a first convergence proof for discounted problems. Tsitsiklis (1994) and, independently, Jaakkola, Jordan and Singh (1994) placed Q-learning inside the theory of stochastic approximation: the Robbins–Monro scheme of iterating x←x+α (F(x)−x+w)x \leftarrow x + \alpha\,(F(x) - x + w)x←x+α(F(x)−x+w) with decreasing stepsizes and zero-mean noise, here in an asynchronous form where different components are updated at different times using delayed information, as in the distributed iterations of Bertsekas and Tsitsiklis (1989).

Tsitsiklis's paper proves convergence with probability 1 under two structural hypotheses on the iteration mapping FFF: a weighted maximum-norm contraction (Theorem 3), which covers discounted Q-learning, and monotonicity (Theorem 2), which covers undiscounted (stochastic shortest path) problems, whose Bellman operator is monotone but in general not a contraction. This mission formalizes the monotone case.

Setting

A mapping F:Rn→RnF:\mathbb R^n\to\mathbb R^nF:Rn→Rn with components F1,…,FnF_1,\dots,F_nF1​,…,Fn​ is given, and the goal is to solve F(x)=xF(x)=xF(x)=x. Time is discrete, t=0,1,2,…t=0,1,2,\dotst=0,1,2,…. The iterate x(t)∈Rnx(t)\in\mathbb R^nx(t)∈Rn evolves by

xi(t+1)=xi(t)+αi(t)(Fi(xi(t))−xi(t)+wi(t)),xi(t)=(x1(τ1i(t)),…,xn(τni(t))),x_i(t+1)=x_i(t)+\alpha_i(t)\bigl(F_i(x^i(t))-x_i(t)+w_i(t)\bigr),\qquad x^i(t)=\bigl(x_1(\tau^i_1(t)),\dots,x_n(\tau^i_n(t))\bigr),xi​(t+1)=xi​(t)+αi​(t)(Fi​(xi(t))−xi​(t)+wi​(t)),xi(t)=(x1​(τ1i​(t)),…,xn​(τni​(t))),

where αi(t)∈[0,1]\alpha_i(t)\in[0,1]αi​(t)∈[0,1] is a stepsize (αi(t)=0\alpha_i(t)=0αi​(t)=0 when component iii is not updated), wi(t)w_i(t)wi​(t) is noise, and 0≤τji(t)≤t0\le\tau^i_j(t)\le t0≤τji​(t)≤t are delays: the update of component iii may read component jjj as it was at an earlier time. All quantities are random variables on a probability space (Ω,F,P)(\Omega,\mathcal F,P)(Ω,F,P) with an increasing sequence of σ-fields {F(t)}\{\mathcal F(t)\}{F(t)}, the history up to the choice of the stepsizes at time ttt.

Vector inequalities are componentwise and eee is the vector of ones. The paper's assumptions are:

  • Assumption 1: every delay index τji(t)\tau^i_j(t)τji​(t) tends to infinity, with probability 1.
  • Assumption 2: x(0)x(0)x(0), αi(t)\alpha_i(t)αi​(t), τji(t)\tau^i_j(t)τji​(t) are F(t)\mathcal F(t)F(t)-measurable and wi(t)w_i(t)wi​(t) is F(t+1)\mathcal F(t+1)F(t+1)-measurable; E[wi(t)∣F(t)]=0E[w_i(t)\mid\mathcal F(t)]=0E[wi​(t)∣F(t)]=0; and E[wi2(t)∣F(t)]≤A+Bmax⁡jmax⁡τ≤t∣xj(τ)∣2E[w_i^2(t)\mid\mathcal F(t)]\le A+B\max_j\max_{\tau\le t}|x_j(\tau)|^2E[wi2​(t)∣F(t)]≤A+Bmaxj​maxτ≤t​∣xj​(τ)∣2 for deterministic constants A,BA,BA,B.
  • Assumption 3: ∑tαi(t)=∞\sum_t\alpha_i(t)=\infty∑t​αi​(t)=∞ and ∑tαi2(t)≤C\sum_t\alpha_i^2(t)\le C∑t​αi2​(t)≤C with probability 1, for a deterministic CCC.
  • Assumption 4: FFF is monotone (x≤y⇒F(x)≤F(y)x\le y\Rightarrow F(x)\le F(y)x≤y⇒F(x)≤F(y)), continuous, has a unique fixed point x∗x^*x∗, and F(x)−re≤F(x−re)≤F(x+re)≤F(x)+reF(x)-re\le F(x-re)\le F(x+re)\le F(x)+reF(x)−re≤F(x−re)≤F(x+re)≤F(x)+re for all xxx and all r>0r>0r>0.

In Lean the algorithm is the structure AsyncSA.Monotone.Algorithm with fields F, x, α, w, τ, and the assumptions are Assumption1–Assumption4.

Formalization targets

Goal: Theorem 2 (p. 189)

Under Assumptions 1–4, if x(t)x(t)x(t) is bounded with probability 1, then

lim⁡t→∞x(t)=x∗with probability 1.\lim_{t\to\infty}x(t)=x^*\qquad\text{with probability 1.}t→∞lim​x(t)=x∗with probability 1.

Boundedness is a hypothesis, not a conclusion: for monotone FFF it must be established separately (the paper does so for Q-learning in §7). The bound may differ between sample paths.

Milestones

  1. Lemma 1 (p. 190): for a scalar recursion W(t+1)=(1−α(t))W(t)+α(t)w(t)W(t+1)=(1-\alpha(t))W(t)+\alpha(t)w(t)W(t+1)=(1−α(t))W(t)+α(t)w(t) with martingale-difference noise whose conditional variance is bounded by an a.s. bounded B(t)B(t)B(t), and stepsizes with ∑α=∞\sum\alpha=\infty∑α=∞, ∑α2≤C\sum\alpha^2\le C∑α2≤C, W(t)→0W(t)\to0W(t)→0 with probability 1.
  2. Lemma 4 (p. 193): the sequences Uk+1=(Uk+F(Uk))/2U^{k+1}=(U^k+F(U^k))/2Uk+1=(Uk+F(Uk))/2, U0=x∗+reU^0=x^*+reU0=x∗+re, and Lk+1=(Lk+F(Lk))/2L^{k+1}=(L^k+F(L^k))/2Lk+1=(Lk+F(Lk))/2, L0=x∗−reL^0=x^*-reL0=x∗−re, satisfy F(Uk)≤Uk+1≤UkF(U^k)\le U^{k+1}\le U^kF(Uk)≤Uk+1≤Uk and F(Lk)≥Lk+1≥LkF(L^k)\ge L^{k+1}\ge L^kF(Lk)≥Lk+1≥Lk.
  3. Lemma 5 (p. 193): Uk→x∗U^k\to x^*Uk→x∗ and Lk→x∗L^k\to x^*Lk→x∗.
  4. Lemma 6 (p. 194): on a sample path where Lk≤x(t)≤UkL^k\le x(t)\le U^kLk≤x(t)≤Uk from time tkt_ktk​ on and all delays exceed tkt_ktk​ from time tk′t'_ktk′​ on, xi(t)≤Xi(t)+Wi(t;tk′)x_i(t)\le X_i(t)+W_i(t;t'_k)xi​(t)≤Xi​(t)+Wi​(t;tk′​), where XiX_iXi​ relaxes from UikU^k_iUik​ towards Fi(Uk)F_i(U^k)Fi​(Uk) and Wi(t;tk′)W_i(t;t'_k)Wi​(t;tk′​) accumulates the noise from tk′t'_ktk′​.
  5. Lemma 7 (p. 195): under the choices of δk\delta_kδk​ and tk′′t''_ktk′′​ made on pp. 194–195, xi(t)≤Uik+1x_i(t)\le U^{k+1}_ixi​(t)≤Uik+1​ for all t≥tk′′t\ge t''_kt≥tk′′​.

Significance

Theorem 2 is the convergence result for asynchronous stochastic approximation driven by a monotone mapping whose fixed point is unique. Its main application is Q-learning for stochastic shortest path problems with improper policies excluded, and more generally any learning scheme whose expected update is a monotone, sup-norm nonexpansive operator in the sense of (7) (dynamic programming operators are the standard examples). The same pattern, an a.s. bounded iterate plus a monotone mean map, recurs in later analyses of asynchronous and distributed learning algorithms.

The result has a published proof but, as far as the platform's catalog shows, no machine-checked one: there is no formalized asynchronous stochastic approximation theorem, and no formal Lemma 1 for random stepsizes and random conditional-variance bounds. A complete development provides the scalar almost-sure convergence lemma, the deterministic envelope argument for monotone maps, and the pathwise comparison steps, each of which is reusable.

Difficulty

The noise has a conditional variance that grows with the iterate, so it is neither bounded nor integrable a priori, and the stepsizes are random and chosen adaptively. The classical deterministic-bound argument for Lemma 1 does not apply directly. The iteration is not a contraction in any norm, so there is no Lyapunov function giving a geometric decrease, and the delays mean that the mapping is evaluated at a vector no single time index describes. Convergence has to be propagated from the deterministic envelopes Uk,LkU^k,L^kUk,Lk to the random iterate through a sequence of random times, one envelope at a time, and each step requires the noise accumulated after a random time to be small uniformly in the remaining horizon.

Formalization scope

  • Components are Fin n (0-based); vectors are Fin n → ℝ with the componentwise order, so Monotone F is Assumption 4(a) exactly. rerere is r • 1.
  • The update is stated in the paper's unified form for every ttt, with αi(t)=0\alpha_i(t)=0αi​(t)=0 off the update times; the update sets TiT^iTi are not represented. The paper sets τji(t)=t\tau^i_j(t)=tτji​(t)=t off TiT^iTi; the formalization leaves τji(t)\tau^i_j(t)τji​(t) free there, which is more general. αi(t)∈[0,1]\alpha_i(t)\in[0,1]αi​(t)∈[0,1] and τji(t)≤t\tau^i_j(t)\le tτji​(t)≤t hold on every sample path.
  • Conditional expectations are generalized, written with set integrals (CondMeanZero, CondSqLe): ∫Sw dP=0\int_S w\,dP=0∫S​wdP=0 for every F(t)\mathcal F(t)F(t)-set SSS on which www is integrable, and ∫Sw2 dP≤∫Sg+ dP\int_S w^2\,dP\le\int_S g^+\,dP∫S​w2dP≤∫S​g+dP in [0,∞][0,\infty][0,∞]. Mathlib's condExp is not used: it is 000 for non-integrable functions and would make the noise assumptions vacuous.
  • Series conditions use partial sums (divergence to +∞+\infty+∞; every partial sum at most CCC), never tsum, which is 000 for non-summable sequences. The constants A,B,CA,B,CA,B,C are chosen before the almost-sure quantifier; the bound on x(t)x(t)x(t) is chosen after it.
  • The paper treats x(t)x(t)x(t) as determined by F(t)\mathcal F(t)F(t) and uses this implicitly; Theorem 2 assumes it explicitly (Adapted).
  • Lemma 1 leaves W(0)W(0)W(0) unconstrained, as on the page. Lemmas 4 and 5 hold for every r>0r>0r>0. Lemmas 6 and 7 are pathwise: they fix one sample path and take the induction's objects (kkk, tkt_ktk​, tk′t'_ktk′​, tk′′t''_ktk′′​, XXX, δk\delta_kδk​) as given with exactly the properties the paper has established for them; they are not existential statements about these times.
  • A trivializing formalization (junk conditional expectations, tsum for the series, a deterministic bound on x(t)x(t)x(t), or a second unrelated x∗x^*x∗) is ruled out by the choices above.

Contributions welcome: a general almost-sure convergence theorem for Robbins–Monro recursions with generalized conditional moments (Lemma 1 and its tail version W(t;t0)W(t;t_0)W(t;t0​)), and lemmas on monotone maps satisfying (7).

Selected references

  • J. N. Tsitsiklis, Asynchronous Stochastic Approximation and Q-Learning, Machine Learning 16 (1994) 185–202. https://doi.org/10.1023/A:1022689125041
  • C. J. C. H. Watkins and P. Dayan, Q-learning, Machine Learning 8 (1992) 279–292. https://doi.org/10.1007/BF00992698
  • T. Jaakkola, M. I. Jordan and S. P. Singh, On the Convergence of Stochastic Iterative Dynamic Programming Algorithms, Neural Computation 6 (1994) 1185–1201. https://doi.org/10.1162/neco.1994.6.6.1185
  • D. P. Bertsekas and J. N. Tsitsiklis, Parallel and Distributed Computation: Numerical Methods, Prentice Hall, 1989. https://hdl.handle.net/1721.1/3719
  • B. T. Poljak and Ya. Z. Tsypkin, Pseudogradient adaptation and training algorithms, Automation and Remote Control 34 (1973) 377–397.
  • H. Robbins and S. Monro, A Stochastic Approximation Method, Annals of Mathematical Statistics 22 (1951) 400–407. https://doi.org/10.1214/aoms/1177729586
7 thms1 active userReviewed
Dynamic ProgrammingOptimizationProbability·Captain: mikedeng1

Negative Dynamic Programming IV: Switching at Each Stage to the Policy with the Better Continuation Return Does at Least as Well as Both PoliciesResearch Paper

Motivation

Policy improvement is one of the two classical ways of solving a Markov decision problem: start from a policy, compute its return, and change the decision wherever another action looks better against that return. Howard (1960, Dynamic Programming and Markov Processes) introduced it for finite state and action spaces, and Blackwell (1965) proved it for discounted problems on Borel spaces. A related routine combines two given policies instead of improving one: at each state, follow whichever policy has the larger return there. Eaton and Zadeh (1962, J. Basic Eng. Ser. D 84, 23–29) proved that this combination of two stationary policies is at least as good as both in the negative case with finite state and action spaces (as credited on p. 889 of Strauch's paper).

Strauch's paper Negative Dynamic Programming (Ann. Math. Statist. 37 (1966) 871–890) treats the negative case: all one-stage returns are non-positive (costs) and there is no discounting. This case covers stochastic shortest-path and optimal-stopping problems with positive costs, where expected total returns may be −∞-\infty−∞ and the contraction arguments of the discounted case are not available. Section 9 of the paper shows that both improvement routines remain valid there, for arbitrary randomized history-dependent policies on Borel spaces, and that they fail in the positive case (Examples 4.2 and 9.1 of the paper).

Timeline:

  • 1960, Howard: policy iteration for finite state and action spaces.
  • 1962, Eaton and Zadeh: the two-policy combination for finite negative problems.
  • 1965, Blackwell: both routines for discounted problems with Borel state and action spaces.
  • 1966, Strauch, §9: Howard's routine (Theorem 9.2), the history-dependent switching theorem (Theorem 9.3) and its Markov and stationary forms (Corollaries 9.1, 9.2) in the negative case on Borel spaces.

Setting

The state space SSS and the action space AAA are non-empty Borel sets. The law of motion q(⋅∣s,a)q(\cdot\mid s,a)q(⋅∣s,a) is a probability kernel from S×AS\times AS×A to SSS, and the return r(s,a,t)r(s,a,t)r(s,a,t) is a Borel function with −∞<r≤0-\infty<r\le 0−∞<r≤0 whose one-step expectation ∫r(s,a,t) q(dt∣s,a)\int r(s,a,t)\,q(dt\mid s,a)∫r(s,a,t)q(dt∣s,a) is finite at every (s,a)(s,a)(s,a). There is no discounting (β=1\beta=1β=1).

A policy π=(π1,π2,… )\pi=(\pi_1,\pi_2,\dots)π=(π1​,π2​,…) chooses the nnn-th action ana_nan​ from a probability kernel πn(⋅∣h)\pi_n(\cdot\mid h)πn​(⋅∣h) that may depend on the whole history h=(s1,a1,…,an−1,sn)h=(s_1,a_1,\dots,a_{n-1},s_n)h=(s1​,a1​,…,an−1​,sn​). The expected return from the initial state sss is

I(π)(s)=∑n=1∞π1q⋯πnqr (s)∈[−∞,0],I(\pi)(s)=\sum_{n=1}^{\infty}\pi_1q\cdots\pi_nqr\,(s)\in[-\infty,0],I(π)(s)=n=1∑∞​π1​q⋯πn​qr(s)∈[−∞,0],

the sum of the expected one-stage returns. For a terminal reward w≤0w\le 0w≤0 that depends on the history (s1,a1,…,sn+1)(s_1,a_1,\dots,s_{n+1})(s1​,a1​,…,sn+1​), In(π,w)I_n(\pi,w)In​(π,w) is the expected return of following π\piπ for nnn stages and then receiving www.

Given two policies σ\sigmaσ and τ\tauτ, their continuation returns at a history h=(s1,…,sn)h=(s_1,\dots,s_n)h=(s1​,…,sn​) are

un(h)=∑j=n∞σnq⋯σjqr (h),vn(h)=∑j=n∞τnq⋯τjqr (h),u_n(h)=\sum_{j=n}^{\infty}\sigma_nq\cdots\sigma_jqr\,(h),\qquad v_n(h)=\sum_{j=n}^{\infty}\tau_nq\cdots\tau_jqr\,(h),un​(h)=j=n∑∞​σn​q⋯σj​qr(h),vn​(h)=j=n∑∞​τn​q⋯τj​qr(h),

the expected returns from stage nnn on if σ\sigmaσ, respectively τ\tauτ, is used from hhh on with its own kernels fed the full history. The switching policy π\piπ uses σn\sigma_nσn​ on Bn={un>vn}B_n=\{u_n>v_n\}Bn​={un​>vn​} and τn\tau_nτn​ on its complement. In Lean these objects are contReturn, IsSwitch, wmax (for wn=max⁡(un,vn)w_n=\max(u_n,v_n)wn​=max(un​,vn​)), InH (for In(π,w)I_n(\pi,w)In​(π,w)) and I, in the namespace NegativeDP.Switching.

Formalization targets

Goal: Theorem 9.3 (negative case)

For all policies σ,τ\sigma,\tauσ,τ, the switching rule defines a policy π\piπ, and every such π\piπ satisfies

I(π)≥max⁡(I(σ),I(τ))at every initial state.I(\pi)\ge\max\big(I(\sigma),I(\tau)\big)\quad\text{at every initial state.}I(π)≥max(I(σ),I(τ))at every initial state.

Milestones (proof of Theorem 9.3, p. 888)

With wn=max⁡(un,vn)w_n=\max(u_n,v_n)wn​=max(un​,vn​) and π\piπ the switching policy:

I0(π,w1)=w1=max⁡(I(σ),I(τ)),I_0(\pi,w_1)=w_1=\max(I(\sigma),I(\tau)),I0​(π,w1​)=w1​=max(I(σ),I(τ)), wn=πn(r+un+1) on Bn,wn=πn(r+vn+1) on Bnc,w_n=\pi_n(r+u_{n+1})\text{ on }B_n,\qquad w_n=\pi_n(r+v_{n+1})\text{ on }B_n^c,wn​=πn​(r+un+1​) on Bn​,wn​=πn​(r+vn+1​) on Bnc​, wn≤πn(r+wn+1),In−1(π,wn)≤In(π,wn+1),In−1(π,wn)≥max⁡(I(σ),I(τ)).w_n\le\pi_n(r+w_{n+1}),\qquad I_{n-1}(\pi,w_n)\le I_n(\pi,w_{n+1}),\qquad I_{n-1}(\pi,w_n)\ge\max(I(\sigma),I(\tau)).wn​≤πn​(r+wn+1​),In−1​(π,wn​)≤In​(π,wn+1​),In−1​(π,wn​)≥max(I(σ),I(τ)).

Further results (not milestones)

Theorem 9.2 (Howard): if I(f,π)≥I(π)I(f,\pi)\ge I(\pi)I(f,π)≥I(π) then I(f(∞))≥I(π)I(f^{(\infty)})\ge I(\pi)I(f(∞))≥I(π). Corollary 9.1: the switching theorem for Markov policies, comparing I(n−1σ)I(^{n-1}\sigma)I(n−1σ) and I(n−1τ)I(^{n-1}\tau)I(n−1τ) at the current state. Corollary 9.2 (Eaton–Zadeh): for stationary f(∞),g(∞)f^{(\infty)},g^{(\infty)}f(∞),g(∞), the rule h=fh=fh=f where I(f(∞))≥I(g(∞))I(f^{(\infty)})\ge I(g^{(\infty)})I(f(∞))≥I(g(∞)) and h=gh=gh=g elsewhere satisfies I(h(∞))≥max⁡(I(f(∞)),I(g(∞)))I(h^{(\infty)})\ge\max(I(f^{(\infty)}),I(g^{(\infty)}))I(h(∞))≥max(I(f(∞)),I(g(∞))).

Significance

Theorem 9.3 yields an improvement step that needs only the returns of two policies, not an optimality equation or a value function. Its Markov and stationary forms give policy-combination results usable for stochastic shortest-path and positive-cost problems, and together with Theorem 9.2 they justify policy-iteration schemes in the negative case on general state spaces. Example 9.1 of the paper shows that no comparable routine exists in the positive case, so the sign assumption is essential.

The results are proved in the paper. No machine-checked version of any of them exists, for the negative case or on Borel spaces; the related items on Prove2Me treat finite or discounted models. This mission produces the statements in Lean over Blackwell's published model of history-dependent plans, a construction of continuation returns from an arbitrary history, and terminal rewards that depend on the whole history.

Difficulty

The argument of the discounted case, which passes to the limit through the vanishing tail βnwn\beta^n w_nβnwn​, is not available: with β=1\beta=1β=1 the terminal term does not vanish, and returns may be −∞-\infty−∞. Comparing unu_nun​ and vnv_nvn​ at the current state only is not enough either: for history-dependent policies the continuation returns depend on the whole history, and the switching set BnB_nBn​ must be shown to be Borel in the history before the switching rule is even a policy. The induction also requires integrating extended-real terminal rewards against the history law and identifying the integral of the one-step operator with the next-stage expected return.

Formalization scope

  • Borel sets are non-empty standard Borel types; Baire functions are measurable functions. Policies are Blackwell's DiscountedDP.Stationary.Plan (one Markov kernel per decision, on Hist S A n). Decisions are numbered from 000 in Lean, so Lean's index nnn is the paper's stage n+1n+1n+1.
  • Only the negative case is formalized (r≤0r\le0r≤0 real-valued, qqq-integrable at every (s,a)(s,a)(s,a), β=1\beta=1β=1). The paper states Theorem 9.3 for the discounted and negative cases; the discounted case is not part of this mission.
  • Returns lie in [−∞,0][-\infty,0][−∞,0] and are EReal values computed as minus the lintegral of the loss −r-r−r; Bochner integrals and toReal are never used, so a return of −∞-\infty−∞ is not silently turned into 000. I(π)I(\pi)I(π) is the sum of stage expectations, equal to eπρe_\pi\rhoeπ​ρ by monotone convergence.
  • Terminal rewards are read through their negative parts; they are applied only to wn≤0w_n\le 0wn​≤0.
  • The switching policy is characterized by the predicate IsSwitch, not constructed. A statement "every switching policy satisfies the bound" would hold vacuously if no plan satisfied the rule; the goal therefore also asserts that a switching plan exists, which is the content of the paper's "define π\piπ by". The same pattern is used in Corollaries 9.1 and 9.2 (the rule defines a measurable decision rule).
  • Ties un=vnu_n=v_nun​=vn​ go to τ\tauτ in Theorem 9.3, and I(n−1σ)=I(n−1τ)I(^{n-1}\sigma)=I(^{n-1}\tau)I(n−1σ)=I(n−1τ) to gng_ngn​ in Corollary 9.1 (strict >>> as printed); in Corollary 9.2 ties go to fff (non-strict ≥\ge≥ as printed).
  • Lemma 3.1 (In(π,0)↓I(π)I_n(\pi,0)\downarrow I(\pi)In​(π,0)↓I(π)), used in the last step of the proof, is posed in mission I of this series and not repeated here.

Contributions welcome: measurability of continuation returns in the history (needed for the existence part), the identification of the history law with the continuation law from the initial state, and a Chapman–Kolmogorov identity for the continuation kernels. These are reusable in any development on history-dependent policies over Borel spaces.

Selected references

  • R. E. Strauch, Negative Dynamic Programming, Ann. Math. Statist. 37(4) (1966) 871–890. https://doi.org/10.1214/aoms/1177699369
  • D. Blackwell, Discounted Dynamic Programming, Ann. Math. Statist. 36(1) (1965) 226–235. https://doi.org/10.1214/aoms/1177700285
  • J. H. Eaton and L. A. Zadeh, Optimal pursuit strategies in discrete-state probabilistic systems, J. Basic Eng. Ser. D 84 (1962) 23–29 (reference [7] of Strauch's paper).
  • R. A. Howard, Dynamic Programming and Markov Processes, MIT Press, 1960.
9 thms1 active userReviewed
Dynamic ProgrammingOptimizationProbability·Captain: mikedeng1

Negative Dynamic Programming I: With Non-Positive Rewards, If an Optimal Policy Exists Then an Optimal Stationary Policy ExistsResearch Paper

Motivation

Many sequential decision problems accumulate costs that are never recovered: inventory holding and shortage costs, waiting times, the expected number of steps until a target is reached. Written as rewards, these are non-positive rewards summed over an infinite horizon without discounting. Ralph Strauch's paper Negative Dynamic Programming (Ann. Math. Statist. 37 (1966), doi:10.1214/aoms/1177699369) is the foundational treatment of this negative case on general Borel state and action spaces. It complements Blackwell's treatment of the discounted case (Blackwell 1965) and of the positive bounded case (Blackwell 1964, mimeographed), and it sets out which conclusions of the discounted theory survive when rewards are non-positive and undiscounted.

A central question in that theory is how simple an optimal policy can be taken to be. A policy may in principle randomize and consult the entire past history. Strauch showed that in the negative case, whenever an optimal policy exists, an optimal stationary one exists, using one measurable decision rule at every stage. This mission formalizes that result together with the reduction from general policies to semi-Markov ones on which its proof rests.

Timeline. Blackwell (1965) proved that in the discounted case a stationary optimal policy exists whenever an optimal policy does, and gave an example showing that Markov policies need not suffice on Borel spaces. Strauch (1966) proved the corresponding statement for the negative case and proved that semi-Markov policies, which remember the initial state as well as the current one, are enough.

Setting

A negative dynamic programming problem consists of non-empty Borel sets SSS (states) and AAA (actions), a law of motion q(⋅∣s,a)q(\cdot\mid s,a)q(⋅∣s,a), which is a probability kernel from S×AS\times AS×A to SSS, and a Borel return function r(s,a,t)r(s,a,t)r(s,a,t) with

r≤0,r>−∞,∫r(s,a,t) dq(t∣s,a)>−∞  for all (s,a).r\le 0,\qquad r>-\infty,\qquad \int r(s,a,t)\,dq(t\mid s,a)>-\infty\ \ \text{for all }(s,a).r≤0,r>−∞,∫r(s,a,t)dq(t∣s,a)>−∞  for all (s,a).

There is no discounting. A policy π=(π1,π2,… )\pi=(\pi_1,\pi_2,\dots)π=(π1​,π2​,…) chooses the action ana_nan​ at stage nnn from a probability kernel πn(⋅∣hn)\pi_n(\cdot\mid h_n)πn​(⋅∣hn​), where hn=(s1,a1,…,an−1,sn)h_n=(s_1,a_1,\dots,a_{n-1},s_n)hn​=(s1​,a1​,…,an−1​,sn​) is the history. A policy is Markov if an=fn(sn)a_n=f_n(s_n)an​=fn​(sn​) for Borel maps fn:S→Af_n:S\to Afn​:S→A, semi-Markov if an=gn(s1,sn)a_n=g_n(s_1,s_n)an​=gn​(s1​,sn​) for Borel gng_ngn​, and stationary, written f(∞)f^{(\infty)}f(∞), if an=f(sn)a_n=f(s_n)an​=f(sn​) for one Borel rule fff. Random Markov and random semi-Markov policies draw ana_nan​ from kernels in sns_nsn​, respectively (s1,sn)(s_1,s_n)(s1​,sn​).

The expected total return from the initial state sss is

I(π)(s)=∑n=1∞Esπ r(sn,an,sn+1)∈[−∞,0],I(\pi)(s)=\sum_{n=1}^{\infty}\mathbb E^{\pi}_{s}\,r(s_n,a_n,s_{n+1})\in[-\infty,0],I(π)(s)=n=1∑∞​Esπ​r(sn​,an​,sn+1​)∈[−∞,0],

the optimal return is v∗(s)=sup⁡πI(π)(s)v^*(s)=\sup_\pi I(\pi)(s)v∗(s)=supπ​I(π)(s) over all policies, and π∗\pi^*π∗ is optimal if I(π∗)(s)≥v∗(s)I(\pi^*)(s)\ge v^*(s)I(π∗)(s)≥v∗(s) for every sss. For a Borel rule fff, the operator TTT acts on non-positive Borel functions uuu by

Tu(s)=∫r(s,f(s),t)+u(t) dq(t∣s,f(s)).Tu(s)=\int r(s,f(s),t)+u(t)\,dq(t\mid s,f(s)).Tu(s)=∫r(s,f(s),t)+u(t)dq(t∣s,f(s)).

The namespace is NegativeDP.Stationary. The objects above are Problem, Plan, I, In, vstar, IsOptimal and T.

Formalization targets

Goal: Theorem 8.3 (negative case), p. 886

(∃ π∗  I(π∗)≥v∗) ⟹ ∃ f Borel,  I(f(∞))≥v∗.\big(\exists\,\pi^*\ \ I(\pi^*)\ge v^*\big)\ \Longrightarrow\ \exists\,f\ \text{Borel},\ \ I(f^{(\infty)})\ge v^* .(∃π∗  I(π∗)≥v∗) ⟹ ∃f Borel,  I(f(∞))≥v∗.

Milestones

  1. Lemma 2.1: for a kernel q(⋅∣x)q(\cdot\mid x)q(⋅∣x) and a Borel u≤0u\le 0u≤0 on X×YX\times YX×Y there is a Borel fff with u(x,f(x))≥∫u(x,y) dq(y∣x)u(x,f(x))\ge\int u(x,y)\,dq(y\mid x)u(x,f(x))≥∫u(x,y)dq(y∣x).
  2. Lemma 3.1 (N): In(π)↓I(π)I_n(\pi)\downarrow I(\pi)In​(π)↓I(π).
  3. Lemma 4.1 (a), (b): policies built from the conditional laws of ana_nan​ given (s1,sn)(s_1,s_n)(s1​,sn​), respectively given sns_nsn​ under an initial law ppp, reproduce the laws of (s1,sn,an,sn+1)(s_1,s_n,a_n,s_{n+1})(s1​,sn​,an​,sn+1​), respectively the ppp-averaged laws of (sn,an,sn+1)(s_n,a_n,s_{n+1})(sn​,an​,sn+1​).
  4. Theorem 4.1: for every policy π\piπ and initial law ppp there are a random semi-Markov π∗\pi^*π∗ and a random Markov π∗∗\pi^{**}π∗∗ with I(π)=I(π∗)I(\pi)=I(\pi^*)I(π)=I(π∗) and pI(π)=pI(π∗∗)pI(\pi)=pI(\pi^{**})pI(π)=pI(π∗∗) for every return function.
  5. Theorem 4.2 (N): if I(πnσ)≥I(σ)I(\pi^n\sigma)\ge I(\sigma)I(πnσ)≥I(σ) for all large nnn, then I(π)≥I(σ)I(\pi)\ge I(\sigma)I(π)≥I(σ).
  6. Theorem 4.3 (N): a semi-Markov τ\tauτ with I(τ)≥I(π)I(\tau)\ge I(\pi)I(τ)≥I(π) and a Markov σ\sigmaσ with pI(σ)≥pI(π)pI(\sigma)\ge pI(\pi)pI(σ)≥pI(π).
  7. Theorem 5.1 (N), parts (a)–(g): the properties of TTT, including TI(π)=I(f,π)TI(\pi)=I(f,\pi)TI(π)=I(f,π), TI(f(∞))=I(f(∞))=lim⁡nTn0TI(f^{(\infty)})=I(f^{(\infty)})=\lim_n T^n0TI(f(∞))=I(f(∞))=limn​Tn0 and In(π,v)=T1⋯TnvI_n(\pi,v)=T_1\cdots T_nvIn​(π,v)=T1​⋯Tn​v for Markov π\piπ.

Significance

Theorem 8.3 reduces a search over all randomized, history-dependent policies to a search over single measurable decision rules, whenever an optimal policy exists at all. It underlies policy iteration and the stationary-policy conclusions of the later negative-programming literature, and it shows that the negative case behaves like the discounted case on this point. In the positive case only a weaker statement holds. The reduction of §4 (Theorems 4.1–4.3) is reused throughout the paper: Theorem 8.1 on (p,ε)(p,\varepsilon)(p,ε)-optimal Markov policies starts from Theorem 4.3, and the value-iteration results of §9 use Lemma 3.1 and Theorem 5.1.

All results in this mission are proved in the paper. None of them has a machine-checked proof that we know of. The closest formal result is part 2 of Bertsekas's Proposition 7, formalized in an abstract monotone-mapping model (MonotoneDP.Increase.prop7_optimal_stationary_criterion). There, policies are sequences of selectors, so it contains neither the measure-theoretic reduction from randomized history-dependent policies nor Borel state spaces. The formal work here is to build the law of the controlled process on Borel spaces, carry out the conditional-distribution argument of Theorem 4.1, and combine it with the operator calculus of §5.

Difficulty

The obvious argument starts from an optimal π∗\pi^*π∗, takes its first decision rule fff, and shows that f(∞)f^{(\infty)}f(∞) is optimal. That fails for a general π∗\pi^*π∗, because its first action may be randomized and its later actions may depend on the entire history. One first needs Theorem 4.3, which says a non-random semi-Markov policy is at least as good. That theorem needs two things. One is Theorem 4.1, which replaces a history-dependent policy by one built from conditional distributions of actions, and this requires disintegration of measures on Borel spaces. The other is the measurable selection of Lemma 2.1, which the paper takes from Theorem 2 of Blackwell and Ryll-Nardzewski 1963, applied stage by stage, with Theorem 4.2 to pass to the limit. On Borel spaces Markov policies are not enough (Blackwell's example, Example 4.1 of the paper), so the semi-Markov step cannot be skipped. Returns can equal −∞-\infty−∞, and every limit exchange has to respect that.

Formalization scope

Borel sets are non-empty standard Borel types and Baire functions are measurable functions. The return rrr is real-valued, non-positive and integrable under q(⋅∣s,a)q(\cdot\mid s,a)q(⋅∣s,a) for every (s,a)(s,a)(s,a). Returns live in the extended reals. I(π)I(\pi)I(π), In(π,v)I_n(\pi,v)In​(π,v), TTT and all integrals of non-positive functions are computed as minus lower Lebesgue integrals of the corresponding losses in [0,∞][0,\infty][0,∞], so a return of −∞-\infty−∞ is never collapsed to 000. I(π)I(\pi)I(π) is the sum of stage expectations, which equals the paper's expectation of the total return by monotone convergence. v∗v^*v∗ is the supremum over every randomized history-dependent plan. Restricting it to Markov or stationary policies would make the goal weaker, and that encoding is ruled out. Only the negative case (r≤0r\le 0r≤0, β=1\beta=1β=1) is formalized. Results the paper labels "D, P, N" or "D, N" appear here in their N form.

Explicit choices:

  • Lean numbers decisions from 000. Hist S A n is the paper's Hn+1H_{n+1}Hn+1​ and the plan's kernel κ n is πn+1\pi_{n+1}πn+1​.
  • The objects π∗\pi^*π∗ and π∗∗\pi^{**}π∗∗ of Lemma 4.1 are defined in the paper's proof as conditional distributions. Here their defining property is a hypothesis: for every initial state, or after averaging over ppp, the joint law of (sn,an)(s_n,a_n)(sn​,an​) is the law of sns_nsn​ followed by the kernel.
  • In Theorem 4.1, "for any return function rrr" is a quantifier over every negative problem with the same law of motion, placed after the choice of π∗\pi^*π∗ and π∗∗\pi^{**}π∗∗.
  • In Theorem 5.1 (b), u+cu+cu+c is required to lie in M(S)M(S)M(S). In (d), the increasing part holds only on {sup⁡jTuj>−∞}\{\sup_jTu_j>-\infty\}{supj​Tuj​>−∞}.
  • In Theorem 5.1 (f), TTT is applied to I(π)I(\pi)I(π) for a general plan with no measurability hypothesis. The lower integral is defined for every function.

Infrastructure needed: the law of the controlled process (built here by iterated kernel composition, as in the published DiscountedDP.Stationary model), disintegration of kernels on standard Borel spaces, a measurable selection theorem of Blackwell–Ryll-Nardzewski type, and monotone convergence for lower integrals. The disintegration and selection results are reusable well beyond this paper. Contributions to Theorems 4.1 and 4.3 are especially welcome, since missions II–IV of this series build on them.

Selected references

  • R. E. Strauch, Negative Dynamic Programming, Ann. Math. Statist. 37(4) (1966) 871–890. https://doi.org/10.1214/aoms/1177699369
  • D. Blackwell, Discounted Dynamic Programming, Ann. Math. Statist. 36(1) (1965) 226–235. https://doi.org/10.1214/aoms/1177700285
  • D. Blackwell and C. Ryll-Nardzewski, Non-existence of everywhere proper conditional distributions, Ann. Math. Statist. 34(1) (1963) 223–225. https://doi.org/10.1214/aoms/1177704259
16 thms1 active userReviewed
CombinatoricsGraph Theory·Captain: mikedeng1

An Introduction to Timetabling 1: Every Class–Teacher Requirement Matrix Has a Timetable over Any p Days with Every Daily Load and Pair Count Between ⌊r/p⌋ and ⌈r/p⌉Research Paper

Motivation

School and university timetabling is one of the oldest applications of combinatorial optimization. In his invited review An introduction to timetabling (European Journal of Operational Research, 1985), D. de Werra opens with the class–teacher model: classes meet teachers for a prescribed number of one-period lectures, and the lectures must be placed into periods or days so that no class and no teacher is overloaded. Every richer timetabling model of the review (preassignments, unavailabilities, course scheduling) is built on top of this one, and the review keeps returning to its graph-theoretic reading as an edge-colouring problem in a bipartite multigraph.

The model comes in three levels of demand. The daily problem asks for a clash-free timetable. The weekly problem asks for an assignment of lectures to days within daily load limits. The balanced weekly problem asks, in addition, that the load of every class and every teacher be spread as evenly as possible over the week, and that the lectures of each class–teacher pair be spread evenly too. The last one is the practical requirement that a teacher should not have all four lectures with one class on Monday.

Timeline (as cited in the review).

  • 1916. D. König proves that a bipartite multigraph of maximum degree Δ\DeltaΔ can be edge-coloured with Δ\DeltaΔ colours. The review states it as Proposition 2.1, citing Berge's Graphes [1].
  • 1975. D. de Werra, "A few remarks on chromatic scheduling" (reference [37] of the review), gives the balanced version: for every ppp the edges of a bipartite multigraph can be ppp-coloured so that every node and every bundle of parallel edges is balanced. This is Proposition 2.3.
  • 1978. D. de Werra, "Some comments on a note about timetabling" (INFOR, reference [38]), gives the weekly version with daily load limits, Proposition 2.2.
  • 1985. The review collects the three results in matrix form as problems CT1, CT2 and CT3 and sketches a network-flow construction for CT3, citing Krarup [19].

Setting

There are mmm classes c1,…,cmc_1,\dots,c_mc1​,…,cm​ and nnn teachers t1,…,tnt_1,\dots,t_nt1​,…,tn​. The requirement matrix R=(rij)R=(r_{ij})R=(rij​) is an m×nm\times nm×n matrix of nonnegative integers: rijr_{ij}rij​ is the number of lectures class cic_ici​ must have with teacher tjt_jtj​. Write ri⋅=∑jrijr_{i\cdot}=\sum_j r_{ij}ri⋅​=∑j​rij​ for the total load of class cic_ici​ and r⋅j=∑irijr_{\cdot j}=\sum_i r_{ij}r⋅j​=∑i​rij​ for that of teacher tjt_jtj​. For nonnegative integers sss and p≥1p\ge1p≥1, ⌊s/p⌋\lfloor s/p\rfloor⌊s/p⌋ and ⌈s/p⌉\lceil s/p\rceil⌈s/p⌉ are the floor and ceiling of the rational s/ps/ps/p.

A schedule over ppp periods or days is an array x=(xijk)x=(x_{ijk})x=(xijk​) of nonnegative integers (i≤mi\le mi≤m, j≤nj\le nj≤n, k≤pk\le pk≤p) that places every lecture exactly once:

∑k=1pxijk=rijfor all i,j.(1)\sum_{k=1}^p x_{ijk}=r_{ij}\quad\text{for all } i,j. \tag{1}k=1∑p​xijk​=rij​for all i,j.(1)
  • CT1 asks in addition that xijk∈{0,1}x_{ijk}\in\{0,1\}xijk​∈{0,1} and that ∑jxijk≤1\sum_j x_{ijk}\le1∑j​xijk​≤1, ∑ixijk≤1\sum_i x_{ijk}\le1∑i​xijk​≤1: no class and no teacher has two lectures in one period.
  • CT2, given positive integers aia_iai​, bjb_jbj​, asks that ∑jxijk≤ai\sum_j x_{ijk}\le a_i∑j​xijk​≤ai​ and ∑ixijk≤bj\sum_i x_{ijk}\le b_j∑i​xijk​≤bj​ on every day kkk.
  • CT3 asks that on every day kkk
⌊ri⋅p⌋≤∑jxijk≤⌈ri⋅p⌉,⌊r⋅jp⌋≤∑ixijk≤⌈r⋅jp⌉,⌊rijp⌋≤xijk≤⌈rijp⌉.(8–10)\Big\lfloor \tfrac{r_{i\cdot}}{p}\Big\rfloor\le\sum_j x_{ijk}\le\Big\lceil \tfrac{r_{i\cdot}}{p}\Big\rceil,\quad \Big\lfloor \tfrac{r_{\cdot j}}{p}\Big\rfloor\le\sum_i x_{ijk}\le\Big\lceil \tfrac{r_{\cdot j}}{p}\Big\rceil,\quad \Big\lfloor \tfrac{r_{ij}}{p}\Big\rfloor\le x_{ijk}\le\Big\lceil \tfrac{r_{ij}}{p}\Big\rceil. \tag{8–10}⌊pri⋅​​⌋≤j∑​xijk​≤⌈pri⋅​​⌉,⌊pr⋅j​​⌋≤i∑​xijk​≤⌈pr⋅j​​⌉,⌊prij​​⌋≤xijk​≤⌈prij​​⌉.(8–10)

In the Lean development these are IsCT1 R p x, IsCT2 R p a b x and IsCT3 R p x, with the floor and ceiling written lo s p and hi s p and the totals rowSum R i, colSum R j.

Formalization targets

Goal: Proposition 2.3

∀ R∈Nm×n, ∀ p≥1:∃ x,  x solves CT3 for R over p days.\forall\,R\in\mathbb N^{m\times n},\ \forall\,p\ge1:\quad \exists\,x,\ \ x \text{ solves CT3 for } R \text{ over } p \text{ days}.∀R∈Nm×n, ∀p≥1:∃x,  x solves CT3 for R over p days.

The statement fixes no constant: it asserts that perfectly balanced weekly timetables always exist.

Milestones

  1. One balanced day (flow sketch, p. 153): for p≥1p\ge1p≥1 there is a matrix yyy satisfying the bounds (8), (9), (10) at once.
  2. The remaining days stay balanced (same sketch): if p≥2p\ge2p≥2 and ⌊s/p⌋≤y≤⌈s/p⌉\lfloor s/p\rfloor\le y\le\lceil s/p\rceil⌊s/p⌋≤y≤⌈s/p⌉, then ⌊s/p⌋≤⌊(s−y)/(p−1)⌋\lfloor s/p\rfloor\le\lfloor (s-y)/(p-1)\rfloor⌊s/p⌋≤⌊(s−y)/(p−1)⌋ and ⌈(s−y)/(p−1)⌉≤⌈s/p⌉\lceil (s-y)/(p-1)\rceil\le\lceil s/p\rceil⌈(s−y)/(p−1)⌉≤⌈s/p⌉.
  3. Proposition 2.1 (König): CT1 is solvable iff r⋅j≤pr_{\cdot j}\le pr⋅j​≤p and ri⋅≤pr_{i\cdot}\le pri⋅​≤p for all i,ji,ji,j.
  4. Proposition 2.2: CT2 is solvable iff r⋅j≤p bjr_{\cdot j}\le p\,b_jr⋅j​≤pbj​ and ri⋅≤p air_{i\cdot}\le p\,a_iri⋅​≤pai​.
  5. Minimum number of days: CT2 is solvable over ppp days iff p≥max⁡(max⁡j⌈r⋅j/bj⌉,max⁡i⌈ri⋅/ai⌉)p\ge\max\big(\max_j\lceil r_{\cdot j}/b_j\rceil,\max_i\lceil r_{i\cdot}/a_i\rceil\big)p≥max(maxj​⌈r⋅j​/bj​⌉,maxi​⌈ri⋅​/ai​⌉).
  6. Figure 1: the printed timetable for R=(124302)R=\begin{pmatrix}1&2&4\\3&0&2\end{pmatrix}R=(13​20​42​), p=3p=3p=3, solves CT3.

Significance

The result. Proposition 2.3 says that the balancing requirement costs nothing: whatever the requirement matrix, the week can be organised so that each class and each teacher has an essentially constant daily load and each class–teacher pair is spread evenly. It contains König's edge-colouring theorem (take ppp at least the maximum degree, so every daily load is at most one) and the weekly Proposition 2.2 as special cases. Combined with Proposition 2.1 applied to each day, it reduces weekly timetabling to independent daily problems, which is the decomposition the review recommends ("one may start by solving the weekly problem … and then solve separately the resulting daily problems", p. 154). In graph language it is the existence of equitable edge colourings of bipartite multigraphs, a standard tool in scheduling and in the theory of edge colourings.

Formalizing it. All results of this mission are classical and proved in the literature; none of them is formalized on the platform. Mathlib contains Hall's marriage theorem but not König's edge-colouring theorem for bipartite multigraphs, and not balanced or equitable colourings. A complete development gives a machine-checked König edge-colouring theorem in matrix form, the matrix-rounding step with simultaneous row, column and entry bounds, and the balanced-colouring theorem itself.

Difficulty

Each family of constraints alone is easy: spreading a single number rijr_{ij}rij​ evenly over ppp days, or a single row total, is a matter of division with remainder. The difficulty is that one array must satisfy (1), (8), (9) and (10) simultaneously, so that the per-entry roundings must add up to correct roundings of every row total and every column total on every day. Rounding each entry independently breaks the row and column constraints, and greedy day-by-day choices can leave a remainder that no longer fits the bounds. The crux is integrality: the rational average rij/pr_{ij}/prij​/p satisfies every bound on every day, but the problem asks for integers, and an integral one-day slice must round all entries, all row totals and all column totals consistently.

Formalization scope

Classes, teachers and days are Fin m, Fin n, Fin p; RRR and xxx are natural-number valued, which is the paper's "xijk≥0x_{ijk}\ge0xijk​≥0 integer". Constraint (4) of CT1 is written xijk≤1x_{ijk}\le1xijk​≤1. Floors and ceilings are Nat.floor and Nat.ceil of the rational quotient. In (8) and (9) they are applied to the row and column totals, never summed entrywise. The minimum number of days uses Finset.sup, whose empty value is 000, and is stated as an equivalence ("solvable over ppp days iff p≥pmin⁡p\ge p_{\min}p≥pmin​") rather than as an infimum.

Disclosed choices:

  • The goal and the one-day milestone assume p≥1p\ge1p≥1; the paper's "for any ppp" means any number of days, and for p=0p=0p=0 Lean's division returns 000.
  • The remaining-days milestone assumes p≥2p\ge2p≥2 so that p−1p-1p−1 days remain.
  • Propositions 2.1, 2.2 and the minimum-days statement hold for every ppp, including p=0p=0p=0, and assume nothing more than the page: ai,bja_i,b_jai​,bj​ positive.
  • The edge-colouring and network-flow readings of the paper are stated in prose only; the formal statements are in matrix form, which is how the propositions are stated.

The formalization does not admit a trivial reading: CT3 requires all four constraint families at once, (1) is an equality, and the sanity checks show both that the Figure 1 data satisfy CT3 and that CT1 is not satisfiable for R=(2)R=(2)R=(2) and p=1p=1p=1.

Useful infrastructure, reusable beyond this mission: integral flows with lower bounds, or total unimodularity of bipartite incidence matrices; König's edge-colouring theorem for bipartite multigraphs; floor and ceiling arithmetic for natural-number quotients. Proofs of any milestone, alternative proofs of the goal, and a sorry-free proof of the Figure 1 instance are all welcome.

Selected references

  • D. de Werra, An introduction to timetabling, European Journal of Operational Research 19 (1985) 151–162. https://doi.org/10.1016/0377-2217(85)90167-5
  • D. König, Über Graphen und ihre Anwendung auf Determinantentheorie und Mengenlehre, Mathematische Annalen 77 (1916) 453–465. https://doi.org/10.1007/BF01456961
  • C. Berge, Graphes, Gauthier-Villars, Paris, 1983 (reference [1] of the review).
  • D. de Werra, A few remarks on chromatic scheduling, in B. Roy (ed.), Combinatorial Programming: Methods and Applications, Reidel, Dordrecht, 1975, 337–342.
  • D. de Werra, Some comments on a note about timetabling, INFOR 16 (1978) 90–92.
  • J. Krarup, Chromatic optimisation: Limitations, objectives, uses, references, European Journal of Operational Research 11 (1982) 1–19.
8 thms1 active userReviewed
AnalysisOptimization·Captain: mikedeng1

Vertical Integration and Antitrust Policy: Integrating Successive Monopolies Lowers the Final Price and Raises Output, Joint Profit and Consumer SurplusResearch Paper

Motivation

In 1950 the United States Supreme Court appeared to be moving toward treating corporate integration, horizontal or vertical, as illegal per se under the antitrust laws. Joseph J. Spengler's note in the Journal of Political Economy argued that this conflates two different things: horizontal integration can suppress competition, but vertical integration, the joining of successive stages of production under one owner, can lower prices when the stages are already imperfectly competitive. The note is the standard origin of what industrial organization now calls double marginalization: when a monopolist upstream sells to a monopolist downstream, each adds its own markup, and the final price is higher than a single integrated monopolist would charge.

The argument underlies the modern economics of vertical mergers and vertical restraints (resale price maintenance, two-part tariffs, franchise fees) and the supply-chain coordination literature in operations research, where a wholesale-price contract between a supplier and a retailer reproduces the same distortion.

A short timeline: Cournot (1838, Chapter IX) analysed complementary monopolists selling inputs to a common product; Spengler (1950) gave the successive-monopoly version and drew the antitrust conclusion; Tirole's textbook (1988, §4.2) made it the canonical example of vertical externalities; Cachon and Lariviere (2005) and the coordination literature studied the same inefficiency in newsvendor supply chains.

Setting

A product passes through three successive stages A→B→CA\to B\to CA→B→C before reaching consumers. Production uses fixed proportions: one unit of stage A's product goes into one unit of B's, and one unit of B's into one unit of C's, so all stages handle the same quantity. Each stage has a constant unit variable cost Va,Vb,VcV_a,V_b,V_cVa​,Vb​,Vc​ (marginal cost equal to average variable cost at every relevant output).

Final demand is a function D:R→RD:\mathbb R\to\mathbb RD:R→R: D(p)D(p)D(p) units of CCC are bought at price ppp. A firm with constant unit cost ccc that sells at price ppp earns the profit (return above variable outlay)

πc(p)=(p−c) D(p),\pi_c(p)=(p-c)\,D(p),πc​(p)=(p−c)D(p),

and ppp is a profit-maximizing price at cost ccc when πc(x)≤πc(p)\pi_c(x)\le\pi_c(p)πc​(x)≤πc​(p) for every xxx.

Unintegrated chain. Stage A sells to B at a transfer price PaP_aPa​, B sells to C at PbP_bPb​. Their per-unit profits are Ra=Pa−VaR_a=P_a-V_aRa​=Pa​−Va​ and Rb=Pb−(Vb+Pa)R_b=P_b-(V_b+P_a)Rb​=Pb​−(Vb​+Pa​); horizontal integration within each stage lets these be positive "monopolistic surcharges". Stage C's unit cost is Cc=Vc+PbC_c=V_c+P_bCc​=Vc​+Pb​; it charges a profit-maximizing price PcP_cPc​ at that cost and sells Q=D(Pc)Q=D(P_c)Q=D(Pc​). The chain's aggregate profit is RaQ+RbQ+RcQR_aQ+R_bQ+R_cQRa​Q+Rb​Q+Rc​Q with Rc=Pc−(Vc+Pb)R_c=P_c-(V_c+P_b)Rc​=Pc​−(Vc​+Pb​).

Integrated firm. One firm owns all three stages. Its unit cost is Cc′=Va+Vb+VcC'_c=V_a+V_b+V_cCc′​=Va​+Vb​+Vc​; it charges a profit-maximizing price Pc′P'_cPc′​ at that cost and sells Q′=D(Pc′)Q'=D(P'_c)Q′=D(Pc′​), earning (Pc′−Cc′) Q′(P'_c-C'_c)\,Q'(Pc′​−Cc′​)Q′.

The price elasticity of demand at ppp is e(p)=−p D′(p)/D(p)e(p)=-p\,D'(p)/D(p)e(p)=−pD′(p)/D(p) (positive for a downward-sloping curve) and the marginal revenue is r(p)=p+D(p)/D′(p)r(p)=p+D(p)/D'(p)r(p)=p+D(p)/D′(p). The consumers' surplus gained when the price falls from PcP_cPc​ to Pc′P'_cPc′​ is ∫Pc′PcD(x) dx\int_{P'_c}^{P_c}D(x)\,dx∫Pc′​Pc​​D(x)dx.

Formalization targets

Goal: vertical integration benefits producer and consumer

For every non-increasing demand curve DDD, all unit costs Va,Vb,VcV_a,V_b,V_cVa​,Vb​,Vc​, and all transfer prices with Ra>0R_a>0Ra​>0, Rb>0R_b>0Rb​>0, if PcP_cPc​ is profit-maximizing at cost Vc+PbV_c+P_bVc​+Pb​, Pc′P'_cPc′​ is profit-maximizing at cost Va+Vb+VcV_a+V_b+V_cVa​+Vb​+Vc​, DDD is differentiable at PcP_cPc​ and Q=D(Pc)>0Q=D(P_c)>0Q=D(Pc​)>0, then

Pc′<Pc,D(Pc)<D(Pc′),RaQ+RbQ+RcQ<(Pc′−Cc′) Q′,P'_c<P_c,\qquad D(P_c)<D(P'_c),\qquad R_aQ+R_bQ+R_cQ<(P'_c-C'_c)\,Q',Pc′​<Pc​,D(Pc​)<D(Pc′​),Ra​Q+Rb​Q+Rc​Q<(Pc′​−Cc′​)Q′, 0<∫Pc′PcD(x) dx,Q (Pc−Pc′)≤∫Pc′PcD(x) dx.0<\int_{P'_c}^{P_c}D(x)\,dx,\qquad Q\,(P_c-P'_c)\le\int_{P'_c}^{P_c}D(x)\,dx.0<∫Pc′​Pc​​D(x)dx,Q(Pc​−Pc′​)≤∫Pc′​Pc​​D(x)dx.

The goal fixes no functional form and no numbers; it is the general statement behind the paper's "under all cases conceivable … within the framework here employed".

Milestones

  1. Footnote 6, equilibrium identities. At a profit-maximizing price, r=cr=cr=c, e=p/(p−r)=p/(p−c)e=p/(p-r)=p/(p-c)e=p/(p−r)=p/(p−c), and p=c e/(e−1)p=c\,e/(e-1)p=ce/(e−1) when c≠0c\ne0c=0.
  2. Section III, unitary elasticity. At zero cost, e=1e=1e=1; at positive cost, p>cp>cp>c and e>1e>1e>1.
  3. Section III, cost raises price. For c1<c2c_1<c_2c1​<c2​, profit-maximizing prices satisfy D(p2)≤D(p1)D(p_2)\le D(p_1)D(p2​)≤D(p1​), and p1<p2p_1<p_2p1​<p2​ under the goal's regularity hypotheses.
  4. Footnote 6, straight-line demand. For D(p)=b(a−p)D(p)=b(a-p)D(p)=b(a−p): p∗(c)=(a+c)/2p^*(c)=(a+c)/2p∗(c)=(a+c)/2, Δr=2Δp\Delta r=2\Delta pΔr=2Δp, e(p∗(c))=(a+c)/(a−c)e(p^*(c))=(a+c)/(a-c)e(p∗(c))=(a+c)/(a−c), the elasticity rises relatively more than the price, and the relative rise grows with ccc.
  5. Figure 1. With Dc(p)=85(140−p)D_c(p)=\tfrac85(140-p)Dc​(p)=58​(140−p) and Va=Vb=Vc=20V_a=V_b=V_c=20Va​=Vb​=Vc​=20: Pc=115P_c=115Pc​=115, Q=40Q=40Q=40, aggregate profit 2,2002{,}2002,200; Pc′=100P'_c=100Pc′​=100, Q′=64Q'=64Q′=64, profit 2,5602{,}5602,560; consumers' surplus rises by 780780780.

Significance

The result. The theorem shows that removing an upstream markup can only lower the final price and raise output, so that producers and consumers gain together. This is the economic content of the rule that vertical integration is not anticompetitive as such, and it is the reason modern merger guidelines credit the "elimination of double marginalization" as an efficiency of vertical mergers. Milestone 3, monotonicity of the monopoly price in cost, is the general comparative-statics fact used in tax incidence and cost pass-through.

Formalizing it. The result is classical and proved in every industrial-organization textbook, usually for linear demand. The mission states it for an arbitrary non-increasing demand curve, without concavity, continuity or uniqueness of the profit maximizer, which makes explicit which hypotheses the strict conclusions actually need. Related items on the platform formalize double marginalization in a different model, the newsvendor wholesale-price contract of Cachon and Lariviere, where the supplier-induced order quantity falls short of the integrated one; this mission covers the price-setting, deterministic-demand version.

Difficulty

The weak inequalities (Pc′≤PcP'_c\le P_cPc′​≤Pc​, Q≤Q′Q\le Q'Q≤Q′, profit ≤\le≤) follow from comparing the two maximization problems (the price comparison also uses Q>0Q>0Q>0: if D≡0D\equiv 0D≡0, every price is profit-maximizing). The strict inequalities do not: a demand curve with a kink can have the same profit-maximizing price at two different costs, so integration need not change the price at all. The strict claims therefore need a first-order condition at PcP_cPc​, and the argument has to combine global optimality (all prices) with local information (a derivative at one point) without assuming the profit function is concave or the maximizer unique. The consumers'-surplus clause requires a lower bound on an integral of a monotone, possibly discontinuous function.

Formalization scope

  • Prices, costs and quantities are real numbers; maximization is over all prices p∈Rp\in\mathbb Rp∈R. Demand is a function D:R→RD:\mathbb R\to\mathbb RD:R→R; the goal assumes only that it is non-increasing (Antitone D).
  • Profit-maximizing prices are hypotheses (IsProfitMax D c p), never closed forms; the closed form (a+c)/2(a+c)/2(a+c)/2 appears only for straight-line demand.
  • The transfer prices Pa,PbP_a,P_bPa​,Pb​ are arbitrary data with positive markups; they need not be profit-maximizing for Da,DbD_a,D_bDa​,Db​, which the paper draws only in its figure.
  • Explicit readings of the paper's prose. "Benefits both producer and consumer" and "will lower the price" become the four strict inequalities of the goal. "Aggregate profit" is the sum over the three stages, Q[Pc−(Va+Vb+Vc)]Q[P_c-(V_a+V_b+V_c)]Q[Pc​−(Va​+Vb​+Vc​)], not stage C's profit alone. Consumers' surplus "in the Marshallian sense" is the interval integral of DDD between the two prices; footnote 5's trapezoid formula is used only for the straight line of Figure 1. Elasticity is a positive number −pD′(p)/D(p)-pD'(p)/D(p)−pD′(p)/D(p). "Relatively greater increment in the elasticity" is made exact for straight-line demand as e(p∗(c′))/e(p∗(c))>p∗(c′)/p∗(c)e(p^*(c'))/e(p^*(c))>p^*(c')/p^*(c)e(p∗(c′))/e(p∗(c))>p∗(c′)/p∗(c); the literal Δe/e>Δc/c\Delta e/e>\Delta c/cΔe/e>Δc/c is false for small ccc. Footnote 6's e′=(p+Δp)/(p−2Δp)e'=(p+\Delta p)/(p-2\Delta p)e′=(p+Δp)/(p−2Δp) and "approximating 3Δp/p3\Delta p/p3Δp/p" are a printed slip; the exact e(p∗(c))=(a+c)/(a−c)e(p^*(c))=(a+c)/(a-c)e(p∗(c))=(a+c)/(a−c) is stated instead, and no approximation is formalized. Figure 1's demand line Dc(p)=85(140−p)D_c(p)=\tfrac85(140-p)Dc​(p)=58​(140−p) is the line through the three points the text gives.
  • Added hypotheses. Differentiability of DDD at PcP_cPc​ and D(Pc)>0D(P_c)>0D(Pc​)>0, which the paper's marginal-revenue reasoning presupposes. Every statement involving elasticity or marginal revenue carries differentiability and positive demand, because Lean's deriv and division return 000 on bad input.
  • Ruled out. Formalizations that hard-code linear demand in the goal, compare the integrated profit with stage C's profit alone, or prove only the weak (≤\le≤) inequalities do not capture the result.
  • Sections IV and the policy remarks of Section III (rent evasion, taxes, co-operatives) are not formalized.
  • Only Mathlib is needed: Fermat's rule (IsLocalMax.hasDerivAt_eq_zero), interval integrals of monotone functions, and real arithmetic. Proofs of the general milestones are reusable for any monopoly-pricing comparative statics.

Selected references

  • J. J. Spengler, Vertical integration and antitrust policy, Journal of Political Economy 58(4), 1950, 347–352. https://doi.org/10.1086/256964
  • A. A. Cournot, Recherches sur les principes mathématiques de la théorie des richesses, Hachette, 1838, Chapter IX.
  • J. Tirole, The Theory of Industrial Organization, MIT Press, 1988, §4.2.
  • G. P. Cachon and M. A. Lariviere, Supply chain coordination with revenue-sharing contracts: strengths and limitations, Management Science 51(1), 2005, 30–44. https://doi.org/10.1287/mnsc.1040.0215
7 thms1 active userReviewed
Dynamic ProgrammingProbability·Captain: mikedeng1

Optimal Inventory Policies for Assembly Systems Under Random Demands 1: In Long-Run Balance, an Assembly System Has the Optimal Policies of an Equivalent Series SystemResearch Paper

Motivation

An assembly system must coordinate the production of components that meet at a common downstream item. A shortage of any required component can delay the finished product, while producing a component too early incurs holding cost. In Rosling's 1989 study, the central question is whether optimal decisions for such a tree can be understood using the simpler theory of a pure series inventory system. The paper proves an equivalence when the initial inventory positions are in a condition it calls long-run balance. That equivalence gives a precise route from an assembly network to serial inventory control without discarding its lead times or its discounted costs.

Setting

There are items 1,…,N1,\ldots,N1,…,N in a tree rooted at end item 111. Every item i>1i>1i>1 has one immediate successor s(i)<is(i)<is(i)<i; one unit of each component is needed for an end unit. Let lil_ili​ be the production or delivery lead time of item iii. The total lead time MiM_iMi​ is the sum of lead times on the path from iii to the end item, with M0=0M_0=0M0​=0, and the equivalent lead time is Li=Mi−Mi−1L_i=M_i-M_{i-1}Li​=Mi​−Mi−1​. Items are indexed so that MiM_iMi​ is nondecreasing. These definitions and indexing conditions are in §§1–2 of the paper.

At the beginning of each period ttt, outstanding orders arrive, the controller chooses the post-order echelon position YitY_{it}Yit​, and then demand ξt\xi_tξt​ for the end item occurs. The pre-order position is XitX_{it}Xit​, while XktlX^l_{kt}Xktl​ is the position of predecessor kkk from orders old enough to arrive after its lead time. A decision is feasible when Xit≤Yit≤XktlX_{it}\le Y_{it}\le X^l_{kt}Xit​≤Yit​≤Xktl​ for every immediate predecessor kkk of iii. Decisions depend only on demands already observed. The demands are independent and identically distributed, nonnegative, and have a density and a finite positive mean.

The discounted Problem P charges echelon holding cost hih_ihi​ for item iii and a shortage coefficient p+H1p+H_1p+H1​ for the end item. Its discount factor is α\alphaα. The objective is the expectation of the sum over periods of the holding charges and the expected end-item shortfall over l1+1l_1+1l1​+1 demands, with a constant independent of the policy. The paper's Assumption requires every hi>0h_i>0hi​>0 and ∑ihiα−Ms(i)<p+H1\sum_i h_i\alpha^{-M_{s(i)}}<p+H_1∑i​hi​α−Ms(i)​<p+H1​. The system is in long-run balance in period ttt when positions of adjacent items, compared at the same age relative to total lead time, satisfy equation (5):

XitMi−μ≤Xi+1,tMi+1−μ(1≤i<N, 0≤μ<Mi).X^{M_i-\mu}_{it}\le X^{M_{i+1}-\mu}_{i+1,t} \quad(1\le i<N,\ 0\le\mu<M_i).XitMi​−μ​≤Xi+1,tMi+1​−μ​(1≤i<N, 0≤μ<Mi​).

Formalization targets

Equivalent series optimal policies

The equivalent series system has successor i−1i-1i−1, lead time LiL_iLi​, the same demand law and shortage coefficient, and holding coefficient hiαli−Lih_i\alpha^{l_i-L_i}hi​αli​−Li​. Theorem 2 states that its optimal policies and those of the assembly system agree when the assembly system is initially in long-run balance. In the formal statement, the first inclusion is unconditional; the reverse inclusion is conditional on Problem P attaining an optimum:

Opt⁡(P)⊆Opt⁡(Pseries),Opt⁡(P)≠∅⟹Opt⁡(Pseries)⊆Opt⁡(P).\operatorname{Opt}(P)\subseteq\operatorname{Opt}(P_{\mathrm{series}}), \qquad \operatorname{Opt}(P)\ne\varnothing \Longrightarrow \operatorname{Opt}(P_{\mathrm{series}})\subseteq\operatorname{Opt}(P).Opt(P)⊆Opt(Pseries​),Opt(P)=∅⟹Opt(Pseries​)⊆Opt(P).

The target includes Lemmas 1 and 2, Theorem 1, Corollary 1, and the cost identity displayed in the proof of Theorem 2. Lemma 1 limits excess production, Lemma 2 gives a production lower bound, Theorem 1 describes when long-run balance is reached and preserved, and Corollary 1 uses the adjacent series position in that result. Each is stated at the strength given on pp. 568–569 of the paper.

Significance

Theorem 2 identifies the same policy choices in a tree assembly problem and a series problem whose stages have modified lead times and holding coefficients. It makes the serial interpretation exact for initially balanced systems and supports the paper's later discussion of series-system calculations. The statement is an equivalence of optimal policies, rather than just an equality of numerical values, so both the feasible-policy comparison and the cost comparison matter.

The theorem and its supporting results are proved in the 1989 paper; they have not been machine-checked in this development. A complete formalization would supply a reusable account of finite-history inventory policies, random demand histories, echelon positions, and extended-real discounted objectives. The published serial model SupplyChainTheory_multiechelon represents a different stage-indexed system; the assembly tree, its initial pipeline, and Problem P still need their own definitions. The paper's order-up-to Corollary 2 relies on an extension of earlier serial results and is outside this target.

Difficulty

The first natural comparison is to replace the tree's predecessor constraints with adjacent-item constraints. Those feasible sets are not equal for arbitrary states: positions at different total lead times can cross, and initial orders placed before period 1 affect the earliest periods. Long-run balance controls the necessary position comparisons, but equation (5) is empty for an item with Mi=0M_i=0Mi​=0. The printed proof also uses a middle inequality outside the range covered by equation (5) when an equivalent lead time vanishes. A faithful statement must account for these boundary cases without defining the series problem through the assembly problem's optimal policies.

Formalization scope

Items use the paper's indices 1,…,N1,\ldots,N1,…,N, with N≥1N\ge1N≥1 and s(1)=0s(1)=0s(1)=0. Lean period kkk is paper period t=k+1t=k+1t=k+1; the policy sees exactly kkk earlier demands. The common demand law ν\nuν is a probability measure on the reals, concentrated on nonnegative values, absolutely continuous with respect to Lebesgue measure, integrable, and of positive mean. The law of demand over l1+1l_1+1l1​+1 periods is the pushforward of a finite product law under summation. Feasibility and the optimal-policy bounds are almost-sure statements, so changes on null histories do not alter them. Pathwise balance results quantify over one nonnegative demand path.

Initial positions include the orders placed before period 1. Their ages are monotone and obey the predecessor constraints inherited from that past. In addition to the paper's initial long-run balance, a separate boundary condition carries the missing comparison when Mi=0M_i=0Mi​=0. Discounting is restricted to 0<α<10<\alpha<10<α<1: at α=1\alpha=1α=1 the paper specifies average cost through a separate limiting prescription. The formal cost lies in the extended reals and is computed from its positive and negative parts; under the Assumption, feasible policies have a finite negative part. The policy-independent constant of equation (2) is omitted from both systems. “Optimal” means feasible and no more costly than every feasible policy, never a default value of an empty infimum.

The series system is built as a second instance of the same model, using the paper's successor, lead-time, and holding-coefficient transformations. Its cost and constraint (3) are then computed by the shared definitions. Contributions toward the lead-time identities, almost-sure policy comparisons, finite-time balance theorem, and extended-real cost identity are all part of the scope.

Selected references

  • Kaj Rosling, Optimal Inventory Policies for Assembly Systems under Random Demands, Operations Research 37(4):565–579, 1989. DOI: 10.1287/opre.37.4.565.
10 thms1 active userReviewed
🏆Completed
Algorithmic Game TheoryCombinatorics·Captain: mikedeng1

On Cores and Indivisibility 1: The Housing Market's Game Without Side Payments Is BalancedResearch Paper

Motivation

A market in which each trader owns one indivisible good has a basic coordination question: can all goods be reassigned so that no group of traders can withdraw its own goods and improve every member's outcome? Houses are the paper's running example. Monetary transfers and fractional houses are absent, so ordinary convex allocation arguments do not describe the setting. Shapley and Scarf use games without side payments to express what each coalition of owners can achieve, and identify a balance property of this game in their Section 4 theorem (Shapley and Scarf, 1974).

The paper states that a general balanced-game theorem gives a nonempty core once balance has been established. Its Section 4 contribution is the classification of this particular housing market game. The separate top-trading-cycles construction in Section 6 gives another route to a core allocation and is the subject of the second mission in this series (Shapley and Scarf, 1974).

Setting

Let NNN be a nonempty finite set of traders. Trader jjj brings one indivisible item jjj. Trader iii's ranking of item jjj is represented by a real number aija_{ij}aij​. Only comparisons within one trader's row matter: aij>aika_{ij}>a_{ik}aij​>aik​ means that iii prefers jjj to kkk, while equality represents indifference. No strict-preference or positivity assumption is imposed on the preference matrix A=(aij)A=(a_{ij})A=(aij​).

A coalition S⊆NS\subseteq NS⊆N can redistribute the items brought by its members. Its allocation matrix PPP has Pij=1P_{ij}=1Pij​=1 when trader iii receives item jjj, and zero otherwise. An SSS-allocation puts exactly one 1 in each column indexed by SSS and has zeros in rows and columns outside SSS. An SSS-permutation is an SSS-allocation with row sums at most one, so every member of SSS receives exactly one of the coalition's items. Rows index traders and columns index items.

For a proposed payoff vector x∈RNx\in\mathbb R^Nx∈RN, define the acceptability matrix

bS∣ij(x)={1,i∈S and xi≤aij,0,otherwise.b_{S|ij}(x)= \begin{cases} 1,& i\in S\text{ and }x_i\le a_{ij},\\ 0,&\text{otherwise}. \end{cases}bS∣ij​(x)={1,0,​i∈S and xi​≤aij​,otherwise.​

The coalition payoff set is

V(S)={x∈RN:some S-permutation P satisfies Pij≤bS∣ij(x) for all i,j}.V(S)=\{x\in\mathbb R^N:\text{some }S\text{-permutation }P \text{ satisfies }P_{ij}\le b_{S|ij}(x)\text{ for all }i,j\}.V(S)={x∈RN:some S-permutation P satisfies Pij​≤bS∣ij​(x) for all i,j}.

Thus a coalition can reach a payoff threshold if it can give each member an item that member values at least as highly. The comparison is weak, so ties count as acceptable. This is the characteristic function used in the paper's Section 4 (Shapley and Scarf, 1974, pp. 109–110 of the source printing).

A balanced family TTT is a family of nonempty coalitions with nonnegative real weights δS\delta_SδS​, zero outside TTT, such that every trader has total covering weight one:

∑S∈Tj∈SδS=1(j∈N).\sum_{\substack{S\in T\\j\in S}}\delta_S=1 \quad(j\in N).S∈Tj∈S​∑​δS​=1(j∈N).

The weights may be zero even for a coalition listed in TTT. A balanced game is a game without side payments whose feasible payoff sets obey

⋂S∈TV(S)⊆V(N)\bigcap_{S\in T}V(S)\subseteq V(N)S∈T⋂​V(S)⊆V(N)

for every balanced family TTT. This includes overlapping families, not merely partitions (Shapley and Scarf, 1974, pp. 108–109).

Formalization targets

The goal is the paper's Section 4 theorem:

For every finite nonempty N and every A:N×N→R,VA is a balanced game.\text{For every finite nonempty }N\text{ and every }A:N\times N\to\mathbb R,\quad V_A\text{ is a balanced game}.For every finite nonempty N and every A:N×N→R,VA​ is a balanced game.

It contains four requirements. For each nonempty SSS, VA(S)V_A(S)VA​(S) is closed; it is downward closed in the coordinates of SSS; and its payoff slice after removing the interiors of singleton payoff sets is bounded and nonempty. The fourth requirement is the balanced-family inclusion displayed above.

The milestones name the paper's intervening claims in their order: the three game conditions, the identity BN(x)=∑S∈TδSBS(x)B_N(x)=\sum_{S\in T}\delta_SB_S(x)BN​(x)=∑S∈T​δS​BS​(x), the doubly stochastic character of a balanced mixture D=∑S∈TδSPSD=\sum_{S\in T}\delta_SP_SD=∑S∈T​δS​PS​, and the existence of a grand-coalition permutation PN≤BN(x)P_N\le B_N(x)PN​≤BN​(x) when D≤BN(x)D\le B_N(x)D≤BN​(x). The final milestone states the matrix existence claim made at the end of Section 4, without committing the theorem statement to a particular construction.

Significance

The result establishes that the finite housing market falls under the paper's general balance framework. In the paper, the cited theorem that balanced games have nonempty cores then yields a core existence conclusion for this market. That general existence theorem is external to the Section 4 proof and is not asserted by this mission's goal (Shapley and Scarf, 1974, pp. 109–110).

The formal development supplies reusable definitions of games without side payments and balanced families alongside the market-specific allocation and acceptability matrices. It also gives precise targets for the matrix claims used in the paper. The source result is proved in print; these Lean statements are proposed formalization targets and their proof bodies remain open. Nearby platform items about transferable-utility games, including the Bondareva–Shapley goal, use a real value for each coalition and do not define this paper's payoff-set game. They are not substituted for these objects.

Difficulty

The challenge is the passage from coalition-wise feasibility to feasibility for all traders together. A balancing family can overlap: choosing one feasible permutation for each coalition does not immediately give a single permutation of NNN. Their weighted mixture has fractional matrix entries. The condition BN(x)≥DB_N(x)\ge DBN​(x)≥D also has to survive the move from such a mixture to an actual zero-one permutation matrix. Without that last assertion, the balancing equations alone do not prove the inclusion V(S)V(S)V(S) requires. Separately, the bounded nonempty payoff-slice condition must be checked for every nonempty coalition; merely proving closedness and downward closure would define a weaker class of games.

Formalization scope

Traders are an arbitrary finite nonempty Lean type, and payoffs live in N→RN\to\mathbb RN→R. The paper's ESE^SES is encoded as the coordinate subspace of vectors zero outside SSS; interiors are taken in the product topology on N→RN\to\mathbb RN→R. The boundedness and nonemptiness test applies to the intersection of that subspace with V(S)V(S)V(S) after removing the singleton interiors. All conditions defining a game quantify over nonempty coalitions. The market formula is also defined at S=∅S=\varnothingS=∅, where it yields all of RN\mathbb R^NRN.

Allocation matrices are real zero-one matrices. An SSS-permutation retains the paper's column, support, and row conditions; it is not replaced by an unconstrained permutation of all traders. The inequality between matrices is entrywise. The acceptability matrix has a 1 exactly when i∈Si\in Si∈S and xi≤aijx_i\le a_{ij}xi​≤aij​; its columns are not independently restricted to SSS. Balancing weights are nonnegative, may vanish inside the family, and cover every trader in NNN. These choices exclude the trivializations V(N)=RNV(N)=\mathbb R^NV(N)=RN, balance tested only on partitions, and coalitions using outsiders' items.

The definitions need finite-sum and matrix support from Mathlib, while the eventual proof can use Mathlib's doubly stochastic matrix and permutation-matrix library. Contributions that establish the stated game conditions or any of the four sourced matrix milestones are within scope. The paper's Section 8 counterexample and the optional superadditivity observation are outside this mission's attack path.

Selected references

  • Lloyd S. Shapley and Herbert Scarf, On cores and indivisibility, Journal of Mathematical Economics 1 (1974), 23–37. DOI: 10.1016/0304-4068(74)90033-0. The supplied scan has printed folios 104–123; Section 4 is on folios 109–111.
8 thms1 active userReviewed
ProbabilityStochastic Systems·Captain: mikedeng1

METRIC: A Multi-Echelon Technique for Recoverable Item Control 2: Under Poisson Demand Expected Backorders Are Strictly Convex in the Mean, So a Point Estimate Understates ThemResearch Paper

Motivation

Spare-parts provisioning for repairable ("recoverable") items is a classical inventory problem: aircraft components fail, are sent to repair, and a stock of spares covers the units in the repair pipeline. Sherbrooke's METRIC model (Sherbrooke 1968), developed at RAND for the U.S. Air Force, measures the performance of a stock level by the expected number of backorders, the average number of unfilled demands outstanding at a random time. Every allocation computed by METRIC is driven by this quantity, and in particular by how it depends on the mean demand of each item.

For a new item that mean is not known. Air Force practice at the time produced a single engineering estimate of mean demand and computed backorders from it as if it were exact. In the section Demand Prediction (pp. 138–139) Sherbrooke argues that this practice is biased in one direction: under Poisson demand and any positive spare stock, the point estimate always understates expected backorders whenever the true mean is genuinely uncertain. This is his reason why a Bayesian treatment of demand is "of fundamental importance for all items, not merely low-demand items". The mission formalizes that claim and the computation behind it.

Setting

Fix one item. Its spare stock s∈{0,1,2,… }s \in \{0, 1, 2, \dots\}s∈{0,1,2,…} is stock on hand plus on order plus in repair, minus backorders; under one-for-one replenishment it is constant. Let the number of units in resupply at a random time be Poisson distributed with mean λ>0\lambda > 0λ>0:

p(x∣λ)=e−λλxx!,x=0,1,2,…p(x \mid \lambda) = e^{-\lambda}\frac{\lambda^x}{x!}, \qquad x = 0, 1, 2, \dotsp(x∣λ)=e−λx!λx​,x=0,1,2,…

The expected backorders at spare stock sss are, by the paper's eq. (2),

B(s∣λ)=∑x=s+1∞(x−s) p(x∣λ).B(s \mid \lambda) = \sum_{x=s+1}^{\infty} (x - s)\, p(x \mid \lambda).B(s∣λ)=x=s+1∑∞​(x−s)p(x∣λ).

In eq. (2) the mean is λT\lambda TλT (customer rate times mean resupply time); on p. 138 it is the mean demand over a unit time interval. Only the mean enters, so it is written as one parameter λ\lambdaλ. In Lean this is SherbrookeMetric.PointEstimate.backorders s lam, built on the published Poisson probabilities ServiceParts.StockLevels.poissonPmf.

Uncertain mean demand. The true mean takes the values λk>0\lambda_k > 0λk​>0, k∈Kk \in Kk∈K (KKK finite), with probabilities wk≥0w_k \ge 0wk​≥0, ∑kwk=1\sum_k w_k = 1∑k​wk​=1. The point estimate is the mean of this distribution, λˉ=∑kwkλk\bar\lambda = \sum_k w_k \lambda_kλˉ=∑k​wk​λk​, and the expected backorders accounting for the uncertainty are ∑kwkB(s∣λk)\sum_k w_k B(s \mid \lambda_k)∑k​wk​B(s∣λk​). The paper's example (p. 138) takes λ∈{0.5,1.5}\lambda \in \{0.5, 1.5\}λ∈{0.5,1.5} with probability 0.50.50.5 each, so λˉ=1\bar\lambda = 1λˉ=1; its procedure (p. 139) discretizes a gamma prior to five to ten values.

Formalization targets

Goal: the point estimate understates backorders (pp. 138–139)

If two distinct values λk≠λk′\lambda_k \ne \lambda_{k'}λk​=λk′​ both carry positive probability, then for every spare stock s≥1s \ge 1s≥1

B(s∣λˉ)<∑kwk B(s∣λk),B(s \mid \bar\lambda) < \sum_k w_k\, B(s \mid \lambda_k),B(s∣λˉ)<k∑​wk​B(s∣λk​),

and for s=0s = 0s=0 the two sides are equal for every prior. The goal fixes no constants and no particular prior.

Milestones

  1. Eq. (10), p. 139: for λ>0\lambda > 0λ>0, B(s∣⋅)B(s \mid \cdot)B(s∣⋅) is twice differentiable at λ\lambdaλ with
∂2B(s∣λ)∂λ2=e−λλs−1(s−1)!>0(s≥1),\frac{\partial^2 B(s \mid \lambda)}{\partial\lambda^2} = \frac{e^{-\lambda}\lambda^{s-1}}{(s-1)!} > 0 \quad (s \ge 1),∂λ2∂2B(s∣λ)​=(s−1)!e−λλs−1​>0(s≥1),

and second derivative 000 for s=0s = 0s=0. 2. Strict convexity, p. 139: for s≥1s \ge 1s≥1, λ↦B(s∣λ)\lambda \mapsto B(s \mid \lambda)λ↦B(s∣λ) is strictly convex on (0,∞)(0, \infty)(0,∞). 3. The worked example, p. 138 (off the goal's path): B(2∣1)=3e−1−1≈0.1036B(2 \mid 1) = 3e^{-1} - 1 \approx 0.1036B(2∣1)=3e−1−1≈0.1036 and 0.5 B(2∣0.5)+0.5 B(2∣1.5)≈0.14860.5\,B(2 \mid 0.5) + 0.5\,B(2 \mid 1.5) \approx 0.14860.5B(2∣0.5)+0.5B(2∣1.5)≈0.1486.

Significance

The result. Expected backorders are the objective METRIC minimizes, item by item, subject to a budget. If the objective is evaluated at a point estimate, every item with uncertain demand looks better stocked than it is, and since the size of the error varies by item, the marginal comparisons that drive the allocation are distorted. The inequality is the quantitative statement behind the paper's recommendation to compute backorders as a posterior mixture over possible mean demands. It also says that an underestimate of demand costs more than an overestimate of the same size when backorders are the objective. For s=0s = 0s=0 the bias vanishes because B(0∣λ)=λB(0 \mid \lambda) = \lambdaB(0∣λ)=λ is linear.

Formalizing it. The paper proves the statement in one line ("it is easy to show") by differentiating twice. No machine-checked version exists. A formal proof needs termwise differentiation of the Poisson backorder series, a closed form for its second derivative, and the passage from a positive second derivative to strict convexity and then to a strict finite Jensen inequality under a nondegenerate prior. The resulting facts about λ↦B(s∣λ)\lambda \mapsto B(s \mid \lambda)λ↦B(s∣λ) are reusable in any Poisson inventory model (base-stock, (s−1,s)(s-1, s)(s−1,s) policies, METRIC and VARI-METRIC). Convexity of BBB in the stock level sss, the paper's eq. (3), is a different statement; it is already posed on the platform as ServiceParts.StockLevels.backorder_differences (compound Poisson demand) and is not repeated here. The definition of the Poisson probabilities is the published ServiceParts.StockLevels.Basic (Muckstadt 2005).

Difficulty

Each step is classical, but none is a one-liner in Lean. The series B(s∣λ)B(s \mid \lambda)B(s∣λ) is an infinite sum whose terms depend on λ\lambdaλ both through e−λe^{-\lambda}e−λ and through λx\lambda^xλx, so differentiating it twice under the summation sign requires a uniform summability bound for the derivative series on a neighbourhood of λ\lambdaλ. The tempting shortcut of reasoning with deriv alone fails: deriv returns 000 at points of non-differentiability, so a formula for deriv (deriv B) says nothing about smoothness, and the milestone is stated with HasDerivAt for this reason. The strict inequality further needs strict convexity, not just convexity, and a hypothesis that the prior is not concentrated on one value: with a one-point prior both sides coincide.

Formalization scope

  • B(s∣λ)B(s \mid \lambda)B(s∣λ) is a real-valued tsum over x∈Nx \in \mathbb Nx∈N of (x−s) p(x∣λ)(x - s)\,p(x \mid \lambda)(x−s)p(x∣λ) for x>sx > sx>s and 000 otherwise. The family is summable for every real λ\lambdaλ; no statement relies on the tsum junk value.
  • Spare stock is a natural number; mean demand is real. Convexity and the second-derivative formula are stated for λ>0\lambda > 0λ>0, the paper's "for any positive λ\lambdaλ".
  • Explicit readings of the paper's phrases: "backorders computed from a point estimate" is B(s∣λˉ)B(s \mid \bar\lambda)B(s∣λˉ) with λˉ\bar\lambdaλˉ the prior mean (the paper assumes "the initial estimate is the mean of the true mean demand distribution"); "the correct value" is the prior expectation ∑kwkB(s∣λk)\sum_k w_k B(s \mid \lambda_k)∑k​wk​B(s∣λk​); "mean demand can assume more than one value" means two distinct values each of positive probability; "positive spare stock" means s≥1s \ge 1s≥1; "understate" is strict.
  • The prior is a finite distribution with positive support points. This covers the paper's two-point example and its five-to-ten-point discretization of a gamma prior; a general prior on (0,∞)(0, \infty)(0,∞) would need integrability hypotheses and is not part of the mission.
  • The printed value B∗(2)=0.1485B^*(2) = 0.1485B∗(2)=0.1485 is a rounding slip; the exact value is 0.14864…0.14864\ldots0.14864…, and the worked example states 0.14860.14860.1486.
  • A formalization that fixes sss, uses ≤\le≤ in place of <<<, drops the nondegeneracy hypothesis (making the strict statement false), or states the second derivative with deriv alone (vacuous at non-differentiable points) does not meet the target.
  • Not formalized: the remark that the understatement "is also true for probability distributions like the negative binomial, though difficult to prove analytically" (unproved on the page), the gamma prior and Bayes updating (a procedure), and the comment that the resulting allocation "will produce inferior results" (not a mathematical statement).
  • Contributions welcome: termwise differentiation lemmas for Poisson-weighted series, the closed form B(s∣λ)=λ−s+∑x<s(s−x)p(x∣λ)B(s \mid \lambda) = \lambda - s + \sum_{x<s}(s - x)p(x \mid \lambda)B(s∣λ)=λ−s+∑x<s​(s−x)p(x∣λ), and a strict finite Jensen inequality in the form used here.

Selected references

  • C. C. Sherbrooke, METRIC: A Multi-Echelon Technique for Recoverable Item Control, Operations Research 16(1) (1968), 122–141. https://doi.org/10.1287/opre.16.1.122
  • G. J. Feeney and C. C. Sherbrooke, The (s−1, s) Inventory Policy under Compound Poisson Demand, Management Science 12(5) (1966), 391–411. https://doi.org/10.1287/mnsc.12.5.391
  • J. A. Muckstadt, Analysis and Algorithms for Service Parts Supply Chains, Springer, 2005. https://doi.org/10.1007/0-387-27288-8
6 thms1 active userReviewed
PreviousPage 43 of 54Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me