Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in
← Collections

The OR Formalization Drive

Help us formalize the operations research literature in Lean.

510 open missions

Missions

21–40 of 510
OpenCompletedAll
Control TheoryOperations ResearchOptimization+1·Captain: mikedeng1

Resource Allocation and Cross-Layer Control in Wireless Networks III: Lyapunov Optimization for Utility and FairnessTextbook

Motivation

Chapters 3-4 of Georgiadis, Neely & Tassiulas's survey Resource Allocation and Cross-Layer Control in Wireless Networks (Foundations and Trends in Networking, 2006) answer "can the network stay stable?" — the backpressure algorithm's throughput optimality (Theorem 4.5) says yes, for any arrival rate inside the capacity region. But networks are usually operated with plenty of unused capacity precisely so that they can also serve a second goal: maximizing some concave utility (throughput, fairness, revenue) of the rates actually delivered. Answering "how close to utility-optimal can a stable policy get, and at what congestion cost?" needs a single theorem that treats stability and utility optimization in one drift analysis. Theorem 5.4, adapted from Neely, Modiano & Li [108], Georgiadis, Neely & Tassiulas [115] and Neely [116], is that theorem, and it is the technique — "Lyapunov optimization" or "drift-plus-penalty" — behind a large fraction of the cross-layer control literature that followed this book.

Setting

A network of NNN queues has backlog vector U(t)=(U1(t),…,UN(t))U(t)=(U_1(t),\dots,U_N(t))U(t)=(U1​(t),…,UN​(t)), and a KKK-dimensional control process R(t)=(R1(t),…,RK(t))R(t)=(R_1(t),\dots,R_K(t))R(t)=(R1​(t),…,RK​(t)) influencing the system's dynamics (e.g. admitted data rates). For any nonnegative function LLL of the backlog vector, the one-step Lyapunov drift is Δ(U(t)):=E{L(U(t+1))−L(U(t))∣U(t)}\Delta(U(t)):=\mathbb E\{L(U(t{+}1))-L(U(t))\mid U(t)\}Δ(U(t)):=E{L(U(t+1))−L(U(t))∣U(t)}, the expected one-slot change in LLL conditioned on the current backlog. Given any scalar-valued concave utility function ggg of a KKK-dimensional rate vector and an arbitrary target value g∗g^*g∗, the goal is to stabilize U(t)U(t)U(t) while making the time-average utility of R(t)R(t)R(t) close to g∗g^*g∗. The time-average rate vector is r(t):=1t∑τ=0t−1E{R(τ)}r(t):=\frac1t\sum_{\tau=0}^{t-1}\mathbb E\{R(\tau)\}r(t):=t1​∑τ=0t−1​E{R(τ)} (5.18), and the achieved long-run utility is gˉ:=lim sup⁡t→∞1t∑τ=0t−1E{g(R(τ))}\bar g:=\limsup_{t\to\infty}\frac1t\sum_{\tau=0}^{t-1}\mathbb E\{g(R(\tau))\}gˉ​:=limsupt→∞​t1​∑τ=0t−1​E{g(R(τ))}.

Formalization targets

Milestone — Lemma 5.3 (Lyapunov Drift)

Δ(U(t))≤E{y(t)∣U(t)}−E{x(t)∣U(t)} ∀t ⟹ lim sup⁡(avg x)≤lim sup⁡(avg y), lim inf⁡(avg x)≤lim inf⁡(avg y).\Delta(U(t))\le\mathbb E\{y(t)\mid U(t)\}-\mathbb E\{x(t)\mid U(t)\}\ \forall t \ \Longrightarrow\ \limsup(\text{avg }x)\le\limsup(\text{avg }y),\ \liminf(\text{avg }x) \le\liminf(\text{avg }y).Δ(U(t))≤E{y(t)∣U(t)}−E{x(t)∣U(t)} ∀t ⟹ limsup(avg x)≤limsup(avg y), liminf(avg x)≤liminf(avg y).

The most abstract drift lemma in the whole book: x(t),y(t)x(t),y(t)x(t),y(t) are arbitrary scalar processes, not necessarily linear or even a function of U(t)U(t)U(t).

Goal — Theorem 5.4 (Lyapunov Optimization)

Δ(U(t))−V E{g(R(t))∣U(t)}≤B−ε∑i=1NUi(t)−Vg∗ ∀t\Delta(U(t))-V\,\mathbb E\{g(R(t))\mid U(t)\}\le B-\varepsilon\sum_{i=1}^N U_i(t)-Vg^*\ \forall tΔ(U(t))−VE{g(R(t))∣U(t)}≤B−εi=1∑N​Ui​(t)−Vg∗ ∀t ⟹lim sup⁡t→∞1t∑τ∑iE{Ui(τ)}≤B+V(gˉ−g∗)ε,lim inf⁡t→∞g(r(t))≥g∗−BV.\Longrightarrow\quad \limsup_{t\to\infty}\tfrac1t\sum_\tau\sum_i\mathbb E\{U_i(\tau)\}\le\frac{B+V(\bar g-g^*)}\varepsilon, \qquad \liminf_{t\to\infty}g(r(t))\ge g^*-\frac BV.⟹t→∞limsup​t1​τ∑​i∑​E{Ui​(τ)}≤εB+V(gˉ​−g∗)​,t→∞liminf​g(r(t))≥g∗−VB​.

This is the weakest, most general level — a drift-minus-utility condition, checked against an arbitrary target g∗g^*g∗, with no reference to any specific control policy.

Significance

Theorem 5.4 is the abstract engine that every concrete utility-maximizing algorithm in the rest of the chapter (the CLC1 joint flow-control/routing/scheduling algorithm of Theorem 5.1, and its robustness variant under approximate scheduling, Corollary 5.2) instantiates by exhibiting a control rule whose per-slot decision satisfies (5.19) for some V,ε,BV,\varepsilon,BV,ε,B — the drift condition does the work of turning a per-slot optimization rule into a global performance guarantee. Its [O(1/V),O(V)][O(1/V),O(V)][O(1/V),O(V)] tradeoff (utility gap shrinks like 1/V1/V1/V, congestion grows like VVV) is the quantitative signature of every "Lyapunov optimization"/"drift-plus-penalty" algorithm in the cross-layer control literature that followed this book, making Theorem 5.4 the single result a reader needs to understand that entire family of algorithms at once, independent of which specific control problem it is applied to.

Formalizing it. No result in this mission has a machine-checked proof anywhere; nothing adjacent exists on the platform (searched for Lyapunov optimization, drift-plus-penalty, utility fairness, concave utility — no hits at all, not even an adjacent object). This mission is the first formalization of the book's utility-optimization engine.

Difficulty

The central subtlety, flagged explicitly by the book's own notation, is that (5.20) and (5.21) compare two different kinds of quantity that are easy to conflate: gˉ\bar ggˉ​ is a limsup of an expectation of utility, E{g(R(τ))}\mathbb E\{g(R(\tau))\}E{g(R(τ))}, while g(r(t))g(r(t))g(r(t)) in (5.21) is the utility evaluated at the time-averaged expected rate. Jensen's inequality (using ggg's concavity) is exactly what would relate g(E{R(t)})g(\mathbb E\{R(t)\})g(E{R(t)}) to E{g(R(t))}\mathbb E\{g(R(t))\}E{g(R(t))} — and it is not proved or needed by this theorem's own statement, only by later results that connect the two more tightly. A formalization that silently merges these into one "utility" quantity would be proving something the book does not claim. The second trap is the target g∗g^*g∗: it is a free parameter of the hypothesis, not the true optimal utility — the theorem's strength is exactly that it says nothing special about how g∗g^*g∗ was chosen, so a formalization must not add a hidden side condition forcing g∗g^*g∗ to equal a genuine optimum.

Formalization scope

∆(U(t)) is restated locally in this chunk's own sub-namespace (drafts cannot import chunk 04-backpressure's copy), via Mathlib's condExp on the σ-algebra generated by the current backlog vector, exactly as in Chapter 4. Explicit Measurable/Integrable guards on U, R, g∘R and every drift term prevent condExp/∫ from silently defaulting to 0 (a trivializing formalization this mission rules out: without these guards, a non-integrable process would satisfy the hypotheses vacuously and "prove" a stability/utility conclusion for a process that is not actually controlled). r(t) and \bar g are written inline as their defining Cesàro averages rather than as separate named definitions, since each is used exactly once. Out of scope for this mission: Theorem 5.1 (the CLC1 algorithm's concrete instantiation), Corollary 5.2 (the robustness-to-suboptimal-scheduling variant), and Lemma 5.5 (continuity of near-optimal solutions, which needs the capacity region Λ as a hypothesis object). All three need substantially more setup (a named algorithm, or the capacity-region machinery of Chapter 3) than this session's time budget allowed without approximating either — left for a future mission rather than approximated.

Selected references

  • Georgiadis, Neely & Tassiulas, Resource Allocation and Cross-Layer Control in Wireless Networks, Foundations and Trends in Networking, Vol. 1, No. 1 (2006), pp. 1-144. https://doi.org/10.1561/1300000001
  • Neely, Modiano & Li, "Fairness and optimal stochastic control for heterogeneous networks", IEEE/ACM Transactions on Networking, 16(2), 2008. https://doi.org/10.1109/TNET.2007.900405
  • Neely, "Energy optimal control for time-varying wireless networks", IEEE Transactions on Information Theory, 52(7), 2006. https://doi.org/10.1109/TIT.2006.876219
5 thms3 active users
Control TheoryOperations ResearchOptimization+1·Captain: mikedeng1

Resource Allocation and Cross-Layer Control in Wireless Networks IV: The Energy-Constrained Control AlgorithmTextbook

Motivation

Battery-powered and energy-harvesting wireless devices cannot treat transmission power as free: a control algorithm that maximizes throughput without regard to energy will drain a device long before the network's other resources are exhausted. Chapter 6 of Georgiadis, Neely & Tassiulas's survey Resource Allocation and Cross-Layer Control in Wireless Networks (Foundations and Trends in Networking, 2006) extends the drift-plus-penalty framework of Chapter 5 to problems with an explicit average-resource-budget constraint, and works out the Energy Constrained Control Algorithm (ECCA) of Neely [116] as its flagship example: a joint flow-control and power-allocation policy that keeps every data queue and a virtual "excess energy" queue bounded by an explicit, finite constant on every single time slot — not merely in expectation or in the long run.

Setting

A multi-user wireless downlink serves LLL users over LLL channels with a time-varying collective topology state S(t)S(t)S(t) and link rate function Ci(P,S(t))C_i(P,S(t))Ci​(P,S(t)) under power allocation P=(P1,…,PL)P=(P_1,\dots,P_L)P=(P1​,…,PL​), subject to a per-slot power budget ∑iPi(t)≤Pmax\sum_i P_i(t)\le P_{max}∑i​Pi​(t)≤Pmax​ and a target average power constraint Pav<PmaxP_{av}<P_{max}Pav​<Pmax​. Exogenous arrivals Ai(t)≤R^A_i(t)\le\hat RAi​(t)≤R^ are entirely admitted or entirely dropped each slot (no transport-layer storage). The ECCA algorithm runs, every slot: flow control — admit Ai(t)A_i(t)Ai​(t) into queue iii if Ui(t)≤VU_i(t)\le VUi​(t)≤V (a fixed parameter), otherwise drop it entirely; power allocation — choose P(t)P(t)P(t) to maximize ∑i[Ui(t)Ci(P,S(t))−D(t)Pi(t)]\sum_i[U_i(t)C_i(P,S(t))-D(t)P_i(t)]∑i​[Ui​(t)Ci​(P,S(t))−D(t)Pi​(t)] subject to the power budget, where D(t)D(t)D(t) is a virtual power queue tracking accumulated excess energy expenditure, updated by D(t+1)=max⁡[D(t)−Pav,0]+∑iPi(t)D(t{+}1)=\max[D(t)-P_{av},0]+\sum_i P_i(t)D(t+1)=max[D(t)−Pav​,0]+∑i​Pi​(t).

Formalization targets

Goal — Theorem 6.3 (ECCA Performance)

Ui(t)≤Umax:=V+R^  ∀i,t,D(t)≤Dmax:=βV+βR^+Pmax  ∀t,U_i(t)\le U_{max}:=V+\hat R\ \ \forall i,t,\qquad D(t)\le D_{max}:=\beta V+\beta\hat R+P_{max}\ \ \forall t,Ui​(t)≤Umax​:=V+R^  ∀i,t,D(t)≤Dmax​:=βV+βR^+Pmax​  ∀t,

and consequently, for every T-slot interval, ∑τ∑iPi(τ)≤Pav⋅T+Dmax,\text{and consequently, for every $T$-slot interval, } \sum_{\tau} \textstyle\sum_i P_i(\tau) \le P_{av}\cdot T+D_{max},and consequently, for every T-slot interval, ∑τ​∑i​Pi​(τ)≤Pav​⋅T+Dmax​, where β>0\beta>0β>0 is the constant in the rate function's marginal-benefit inequality Ci(P,S)≤Ci(P[i],S)+βPiC_i(P,S)\le C_i(P^{[i]},S)+\beta P_iCi​(P,S)≤Ci​(P[i],S)+βPi​ (P[i]P^{[i]}P[i] being PPP with its iii-th entry zeroed). These bounds hold for every topology state process S(t)S(t)S(t) and every admissible arrival process A(t)A(t)A(t), on every sample path — the weakest, most general level, with no distributional assumption whatsoever on either process.

Significance

Theorem 6.3 gives a hard, deterministic worst-case guarantee — every queue in the system, actual or virtual, is bounded by an explicit closed-form constant on every single slot, not merely on average or asymptotically — which is exactly the kind of guarantee a resource-constrained embedded or battery-powered device needs: a device can be provisioned with buffer and battery-reserve capacity of the theorem's own UmaxU_{max}Umax​, DmaxD_{max}Dmax​ and know, with certainty rather than in expectation, that it will never overflow. The corollary that no TTT-slot interval spends more than Pav⋅T+DmaxP_{av}\cdot T+D_{max}Pav​⋅T+Dmax​ in energy translates directly into a battery-lifetime guarantee. This is also, methodologically, the one point in the whole book's drift-plus-penalty method where an elementary induction — not a probabilistic Lyapunov drift argument — suffices, because ECCA's flow control rule directly caps Ui(t)U_i(t)Ui​(t) regardless of what the channel or arrivals do.

Formalizing it. No result in this mission has a machine-checked proof anywhere; nothing adjacent exists on the platform (searched for virtual queue, energy-constrained control, power allocation — no faithful hits; one unrelated coincidental keyword match in a neural-coding combinatorics item was checked and is not relevant). This mission is the first formalization of the ECCA performance guarantee.

Difficulty

The obvious first idea is to bound Ui(t)U_i(t)Ui​(t) and D(t)D(t)D(t) by unrolling their recursions and applying a probabilistic drift argument, as in every other capstone in this series. This is unnecessary and would in fact obscure the actual mechanism: Ui(t)≤UmaxU_i(t)\le U_{max}Ui​(t)≤Umax​ follows from a two-case induction that needs no probability at all — if Ui(t)≤VU_i(t)\le VUi​(t)≤V, the flow control rule admits at most R^\hat RR^ more, giving Ui(t+1)≤V+R^U_i(t{+}1)\le V+\hat RUi​(t+1)≤V+R^; if Ui(t)>VU_i(t)>VUi​(t)>V, flow control drops everything, so Ui(t+1)≤Ui(t)≤UmaxU_i(t{+}1)\le U_i(t)\le U_{max}Ui​(t+1)≤Ui​(t)≤Umax​ by the induction hypothesis. The harder part is D(t)≤DmaxD(t)\le D_{max}D(t)≤Dmax​: it requires connecting the virtual queue's own accumulation to the fact that the power-allocation optimization (6.14) will stop spending power on link iii once D(t)D(t)D(t) grows past Ui(t)⋅βU_i(t)\cdot\betaUi​(t)⋅β — a consequence of P(t)P(t)P(t)'s optimality for (6.14) together with the β\betaβ-inequality on CiC_iCi​, not a property one can read off the DDD-recursion alone.

Formalization scope

The power-allocation rule is stated as an explicit optimality hypothesis (hPopt): for every competing power vector P′P'P′ respecting the budget, the objective (6.14) at the chosen P(t)P(t)P(t) is at least as large — the faithful rendering of "P(t)P(t)P(t) is chosen to maximize (6.14)" without needing Lean's argmax/IsMaxOn machinery. The rate function's β\betaβ-inequality is stated exactly as the book gives it, using Function.update P i 0 for P[i]P^{[i]}P[i]. Out of scope for this mission: the throughput conclusion under i.i.d. A(t),S(t)A(t), S(t)A(t),S(t) (an expectation/liminf statement, unlike the rest of this theorem, needing the same conditional-expectation machinery as the other chapters' capstones) and Theorem 6.2 (the general GCLC framework this specializes, which needs Assumptions 1-4's four simultaneous existential clauses over an "S-only" policy) — both left for a future mission. A trivializing formalization to rule out: weakening the two sample-path conclusions to a limsup/expectation-style bound (the convention used elsewhere in this series) would misstate this theorem, whose entire distinguishing content is that the bounds hold for every time slot and every sample path, not merely in the long run.

Selected references

  • Georgiadis, Neely & Tassiulas, Resource Allocation and Cross-Layer Control in Wireless Networks, Foundations and Trends in Networking, Vol. 1, No. 1 (2006), pp. 1-144. https://doi.org/10.1561/1300000001
  • Neely, "Energy optimal control for time-varying wireless networks", IEEE Transactions on Information Theory, 52(7), 2006. https://doi.org/10.1109/TIT.2006.876219
4 thms3 active users
Operations ResearchProbability·Captain: naimengye

Fundamentals of Supply Chain Theory VII: Multiechelon Inventory ModelsTextbook

One stage at a time

A serial supply chain is the simplest multiechelon system: a retailer orders from a warehouse, which orders from a plant, which orders from an outside supplier with unlimited stock. Only the retailer sees customer demand, only the retailer pays a stockout penalty, and every stage pays to hold inventory. Choosing how much each stage should hold looks like a joint optimization over all stages at once, because an upstream stockout delays every downstream replenishment. Clark and Scarf (1960) showed that it is not: measured in echelon terms, the optimal policy is a base-stock policy at every stage, and the optimal levels can be found one stage at a time from the customer upward, each step a single-variable convex minimization. Chapter 6 of Snyder and Shen's Fundamentals of Supply Chain Theory (2019) presents the infinite-horizon form of that result as its Theorem 6.3, the bounds of Shang and Song (2003) that make the levels cheap to approximate, and the contrasting guaranteed-service model of Graves and Willems (2000), in which stages quote delivery times rather than fill rates and the optimal safety stocks are all-or-nothing. This mission formalizes the chapter's numbered results, with Theorem 6.3 as its goal.

Setting

Stages are numbered 1,…,N1, \dots, N1,…,N from the customer upward. Stage jjj has a local holding cost hj′h'_jhj′​ per unit per period; its echelon holding cost is hj=hj′−hj+1′h_j = h'_j - h'_{j+1}hj​=hj′​−hj+1′​ with hN+1′=0h'_{N+1} = 0hN+1′​=0, so that hj′=∑i≥jhih'_j = \sum_{i \ge j} h_ihj′​=∑i≥j​hi​ (localHolding, echelonHolding). Stage jjj's echelon consists of stages j,j−1,…,1j, j-1, \dots, 1j,j−1,…,1, and its echelon on-hand inventory IjI_jIj​ (echelonOnHand) is all on-hand and in-transit stock in that echelon. Stage 1 pays a stockout cost ppp per unit per period. Orders placed by stage jjj arrive after a lead time LjL_jLj​ if stage j+1j+1j+1 can ship them; DjD_jDj​ denotes the lead-time demand at stage jjj.

An echelon base-stock policy gives each stage a level SjS_jSj​ and orders to keep its echelon inventory position at SjS_jSj​. The chapter derives, from conservation of flow, a recursion that evaluates the expected cost of any echelon base-stock vector SSS (csBar, csHat, csG):

gˉ0(x)=(p+h1′)x−,g^j(x)=hjx+gˉj−1(x),gj(y)=E[g^j(y−Dj)],gˉj(x)=gj(min⁡{Sj,x}),\bar g_0(x) = (p + h'_1)x^-, \qquad \hat g_j(x) = h_j x + \bar g_{j-1}(x), \qquad g_j(y) = \mathbb{E}[\hat g_j(y - D_j)], \qquad \bar g_j(x) = g_j(\min\{S_j, x\}),gˉ​0​(x)=(p+h1′​)x−,g^​j​(x)=hj​x+gˉ​j−1​(x),gj​(y)=E[g^​j​(y−Dj​)],gˉ​j​(x)=gj​(min{Sj​,x}),

and the expected cost of the system under SSS is gN(SN)g_N(S_N)gN​(SN​). The term gˉj\bar g_jgˉ​j​ is the implicit penalty function: it charges stage j+1j+1j+1 for the downstream consequences of running short. A vector is sequentially optimal (CSSequential) when each SjS_jSj​ minimizes gjg_jgj​, which depends only on S1,…,Sj−1S_1, \dots, S_{j-1}S1​,…,Sj−1​.

The Shang-Song bounds compare gjg_jgj​ with the cost of the jjj-stage truncated system when all its local holding costs are set to one value, hjh_jhj​ for the lower bound and ∑k≤jhk\sum_{k \le j} h_k∑k≤j​hk​ for the upper (ssLower, ssUpper). With equal holding costs all stock is held at stage 1, so each bound is a single-stage newsvendor cost for the demand D~j=D1+⋯+Dj\tilde D_j = D_1 + \dots + D_jD~j​=D1​+⋯+Dj​ over the cumulative lead time (tildeLaw) with stockout cost p+hj+1′p + h'_{j+1}p+hj+1′​, plus the holding cost of the stock in transit to stages 1,…,j−11, \dots, j-11,…,j−1, whose mean is E[D1]+⋯+E[Dj−1]\mathbb{E}[D_1] + \dots + \mathbb{E}[D_{j-1}]E[D1​]+⋯+E[Dj−1​] (pipelineMean).

In the guaranteed-service model each stage iii has a processing time TiT_iTi​, quotes a committed service time SiS_iSi​ to its customer, and receives an inbound time SIi=Si+1SI_i = S_{i+1}SIi​=Si+1​ from its supplier (gsInbound), SINSI_NSIN​ being external. Demand is bounded, so the stage can meet every order within SiS_iSi​ by holding safety stock kSIi+Ti−Sik\sqrt{SI_i + T_i - S_i}kSIi​+Ti​−Si​​ with k=zασk = z_\alpha\sigmak=zα​σ, and the holding cost is g(S)=∑ihikSIi+Ti−Sig(S) = \sum_i h_i k \sqrt{SI_i + T_i - S_i}g(S)=∑i​hi​kSIi​+Ti​−Si​​ (gsCost) over the feasible times 0≤Si≤SIi+Ti0 \le S_i \le SI_i + T_i0≤Si​≤SIi​+Ti​ (GSFeasible).

Formalization targets

Goal: Theorem 6.3

For echelon holding costs hj≥0h_j \ge 0hj​≥0, stockout cost p≥0p \ge 0p≥0 and lead-time demands of finite mean, if S∗S^*S∗ is sequentially optimal then for every echelon base-stock vector SSS,

gN(SN∗∣S∗)  ≤  gN(SN∣S),g_N(S^*_N \mid S^*) \;\le\; g_N(S_N \mid S),gN​(SN∗​∣S∗)≤gN​(SN​∣S),

and gN(SN∗∣S∗)g_N(S^*_N \mid S^*)gN​(SN∗​∣S∗) is the optimal cost. This is clark_scarf_sequential.

Supporting targets

Proposition 6.1, ∑jhjIj=∑jhj′(Ij′+ITj−1)\sum_j h_j I_j = \sum_j h'_j (I'_j + IT_{j-1})∑j​hj​Ij​=∑j​hj′​(Ij′​+ITj−1​); the stage-1 identities (6.29) and (6.30), that g1g_1g1​ is a newsvendor cost with penalty p+h2′p + h'_2p+h2′​ and its minimizer solves F1(S1∗)=(p+h2′)/(h1+p+h2′)F_1(S^*_1) = (p + h'_2)/(h_1 + p + h'_2)F1​(S1∗​)=(p+h2′​)/(h1​+p+h2′​); convexity of every gjg_jgj​ under sequential optimality; existence of a sequentially optimal vector when hj>0h_j > 0hj​>0 and p>0p > 0p>0; Theorem 6.4, gjl≤gj≤gjug^l_j \le g_j \le g^u_jgjl​≤gj​≤gju​, and Sjl≤Sj∗≤SjuS^l_j \le S^*_j \le S^u_jSjl​≤Sj∗​≤Sju​ where SjuS^u_jSju​ minimizes gjlg^l_jgjl​ and SjlS^l_jSjl​ minimizes gjug^u_jgju​ (the book's pairing, p. 200); and Theorem 6.5, that in the guaranteed-service serial system with s1=0s_1 = 0s1​=0 every optimal Si∗S^*_iSi∗​ is 000 or Si+1∗+TiS^*_{i+1} + T_iSi+1∗​+Ti​.

Theorem 6.2, the optimality of echelon base-stock policies among all policies, is stated in the book without a model of the policy space and is not a target here; Theorem 6.3 is the optimization it licenses.

Significance

Theorem 6.3 is what Zipkin calls the fundamental equations of supply chain theory. It reduces a joint optimization over NNN coupled levels to NNN one-dimensional convex problems, and every exact method and most heuristics for serial and assembly systems, Rosling's reduction of assembly systems to serial ones included, run through it. Theorem 6.4 turns the recursion into closed-form bounds and the Shang-Song heuristic, which the book reports as accurate to within a fraction of a percent. Theorem 6.5 explains the shape of optimal safety stock placement under guaranteed service and why its dynamic program only needs to examine endpoints.

None of these results has a machine-checked proof. The book proves none of them in full: Theorem 6.3 is asserted after an informal derivation, Theorem 6.4 is cited, and Proposition 6.1 and Theorem 6.5 are left as exercises. Formalizing the recursion's convexity and the exchange argument behind Theorem 6.3 produces a reusable treatment of the implicit penalty function; the concavity-on-a-polytope argument for Theorem 6.5 is reusable for the tree systems of Sect. 6.3.5.

Difficulty

The obvious attack on Theorem 6.3, differentiating the system cost in each SjS_jSj​, fails immediately: the cost depends on SjS_jSj​ through min⁡{Sj,x}\min\{S_j, x\}min{Sj​,x} inside nested expectations and is not convex in SSS jointly. The argument that works is an induction along the recursion, comparing gj(⋅∣S)g_j(\cdot \mid S)gj​(⋅∣S) with gj(⋅∣S∗)g_j(\cdot \mid S^*)gj​(⋅∣S∗) pointwise. Its key step is that, for the convex gj(⋅∣S∗)g_j(\cdot \mid S^*)gj​(⋅∣S∗) minimized at Sj∗S^*_jSj∗​, the value gj(min⁡{Sj∗,x})g_j(\min\{S^*_j, x\})gj​(min{Sj∗​,x}) is the least value of gjg_jgj​ on (−∞,x](-\infty, x](−∞,x], so that any other truncation point can only cost more. That step needs convexity of gj(⋅∣S∗)g_j(\cdot \mid S^*)gj​(⋅∣S∗), which needs gˉj−1(⋅∣S∗)\bar g_{j-1}(\cdot \mid S^*)gˉ​j−1​(⋅∣S∗) convex, which needs Sj−1∗S^*_{j-1}Sj−1∗​ to be a minimizer; for an arbitrary SSS the functions gˉj(⋅∣S)\bar g_j(\cdot \mid S)gˉ​j​(⋅∣S) are not convex, and the induction must carry both vectors at once.

Integrability is a second, silent obstacle. Each gjg_jgj​ is an expectation of translates of g^j\hat g_jg^​j​; the recursion preserves Lipschitz continuity with a constant growing with the costs, and finite means are exactly what make every integral in the recursion a genuine expectation rather than Lean's default value zero.

Theorem 6.4 requires relating the recursion, in which demands enter one stage at a time, to a single newsvendor cost in the sum D~j\tilde D_jD~j​, which is a convolution; the inequalities come from the structure of (6.31) in the two extreme holding-cost profiles and are not obvious from the recursion's formulas. Theorem 6.5 is a statement about every minimizer, not the existence of an extreme one, so the proof must show the cost is strictly concave along every feasible direction that changes a net lead time and then classify the vertices of the feasible region.

Formalization scope

Stages are indexed by natural numbers 1,…,N1, \dots, N1,…,N; the cost functions take total functions on N\mathbb{N}N and never read values outside that range. The recursion is defined for every vector SSS, so the theorem compares values of one family of functions rather than a separately defined system cost; the identification of gN(SN∣S)g_N(S_N \mid S)gN​(SN​∣S) with the steady-state expected cost of the physical system is the book's derivation and is not restated. Expectations are Lebesgue integrals under the lead-time demand laws, assumed to be probability measures on R\mathbb{R}R with finite means. Sequential optimality is a hypothesis of the goal; a separate target shows it is satisfiable when hj>0h_j > 0hj​>0 and p>0p > 0p>0, so the goal is not vacuous.

The bounding functions of Theorem 6.4 keep the holding cost of pipeline stock that the truncated cost (6.31) charges. The book omits that constant when it writes their minimizers, which it does not affect, but part (a) compares values, and without the constant the upper bound fails already in the book's own Example 6.1. For part (b) the minimizers of the bounding functions are asserted to exist and to bracket Sj∗S^*_jSj∗​; when the fractiles of D~j\tilde D_jD~j​ are unique these are the book's quantile values. Theorem 6.5 is stated over real service times; because the feasible region's vertices are integral when the data are, every integer-optimal vector is optimal over the reals, so the real statement contains the book's integer program (6.38) to (6.42). Proposition 6.1 is stated with IT0=0IT_0 = 0IT0​=0 built into the echelon sum.

The definition module is shared by all nine items. The dynamic program (6.43) to (6.44) for guaranteed-service serial systems and the tree-system algorithm of Sect. 6.3.6 are natural extensions on the same definitions.

Selected references

  • L. V. Snyder and Z.-J. M. Shen, Fundamentals of Supply Chain Theory, 2nd ed., Wiley, 2019, Chapter 6. https://doi.org/10.1002/9781119584445
  • A. J. Clark and H. Scarf, Optimal policies for a multi-echelon inventory problem, Management Science 6(4), 1960. https://doi.org/10.1287/mnsc.6.4.475
  • F. Chen and Y.-S. Zheng, Lower bounds for multi-echelon stochastic inventory systems, Management Science 40(11), 1994. https://doi.org/10.1287/mnsc.40.11.1426
  • K. H. Shang and J.-S. Song, Newsvendor bounds and heuristic for optimal policies in serial supply chains, Management Science 49(5), 2003. https://doi.org/10.1287/mnsc.49.5.618.15147
  • S. C. Graves and S. P. Willems, Optimizing strategic safety stock placement in supply chains, Manufacturing & Service Operations Management 2(1), 2000. https://doi.org/10.1287/msom.2.1.68.23267
11 thms3 active users
Bandit AlgorithmsOperations ResearchOptimization+1·Captain: naimengye

Multi-armed Bandit Allocation Indices III: Superprocesses, Condition D and the Index Theorem for a SFASTextbook

Motivation

The index theorem says that among several Markov reward processes, of which one may be advanced at each decision time, the right one to advance is the one of greatest Gittins index. Chapter 4 of Gittins, Glazebrook and Weber, Multi-armed Bandit Allocation Indices (2nd ed., doi:10.1002/9780470980033), asks how far this extends when the constituents are not reward processes but decision processes, each with its own controls: a research project that can be run in several ways, a job that can be processed at different speeds, a sampling process that may be stopped and exploited. A family of such superprocesses requires two choices at every decision time, which superprocess to continue and with which control, and an index policy in the sense of Chapter 2 need not be optimal (Example 4.1). Whittle (1980) identified the condition under which it is: Condition D, that when a superprocess is played against a standard bandit process paying a constant rent, the control one should apply to it does not depend on the rent. Under that condition the index theorem survives (Theorem 4.3), the index is characterized (Note 4.2), stoppable bandit processes with improving stopping options satisfy the condition (Lemma 4.4), and the chapter adds two results about indices themselves: any index that works for all bandit processes is a strictly increasing function of the Gittins index (Theorem 4.8), and a policy that is within ε\varepsilonε of the index policy loses at most εγ−1(1−e−γ)−1\varepsilon\gamma^{-1}(1-e^{-\gamma})^{-1}εγ−1(1−e−γ)−1 (Theorem 4.18).

Setting

A decision process DDD on a countable state space SSS has in each state xxx a nonempty finite set Γ(x)\Gamma(x)Γ(x) of controls; applying uuu yields the reward r(x,u)r(x, u)r(x,u) and moves the state by P(⋅∣x,u)P(\cdot \mid x, u)P(⋅∣x,u). Adding the freeze control, which leaves the state unchanged and yields nothing, makes DDD a superprocess SSS. Operating DDD under a feasible deterministic stationary Markov policy ggg (that is, g(x)∈Γ(x)g(x) \in \Gamma(x)g(x)∈Γ(x)) gives an ordinary bandit process DgD_gDg​, and the superprocess index is

ν(S,x,u)=sup⁡g:g(x)=uν(Dg,x),ν(S,x)=max⁡u∈Γ(x)ν(S,x,u),(4.1)\nu(S, x, u) = \sup_{g : g(x) = u} \nu(D_g, x), \qquad \nu(S, x) = \max_{u \in \Gamma(x)} \nu(S, x, u), \tag{4.1}ν(S,x,u)=g:g(x)=usup​ν(Dg​,x),ν(S,x)=u∈Γ(x)max​ν(S,x,u),(4.1)

with ν(Dg,x)\nu(D_g, x)ν(Dg​,x) the Gittins index of the Bandit Algorithms model. A simple family of alternative superprocesses (SFAS) is nnn superprocesses on a common (S,U)(S, U)(S,U); at each decision time 0,1,2,…0, 1, 2, \dots0,1,2,… exactly one is continued, with a control from its control set, the others being frozen, and rewards are discounted by ata^tat. A policy is a Markov kernel per decision time from the history to the pair (superprocess, control); it is optimal if it is feasible and attains the supremum of the discounted payoff over feasible policies from every initial state-vector, and it is an index policy if it always continues a superprocess and control of maximal ν(Si,xi,u)\nu(S_i, x_i, u)ν(Si​,xi​,u).

Condition D. Let Λ\LambdaΛ be a standard bandit process with parameter λ\lambdaλ (one state, reward λ\lambdaλ). SSS satisfies Condition D if there is a function ggg such that, for every xxx and λ\lambdaλ for which it is optimal in the family {S,Λ}\{S, \Lambda\}{S,Λ} to select SSS in state xxx, it is optimal to apply the control g(x)g(x)g(x). A stoppable bandit process is a bandit process with a stop control that makes it behave as a standard bandit process with parameter μ(x)\mu(x)μ(x); its stopping option is improving if μ(x(t))\mu(x(t))μ(x(t)) is almost surely nondecreasing in process time.

Formalization targets

Goal: Theorem 4.3

For a decision process with bounded rewards and a Condition-D control ggg, every index policy with respect to ν(D,⋅,⋅)\nu(D, \cdot, \cdot)ν(D,⋅,⋅) that applies g(xi)g(x_i)g(xi​) to the superprocess iii it continues is optimal for the family of nnn superprocesses:

index policy π  ⟹  π feasible and Rπ(x)=sup⁡π′ feasibleRπ′(x)  for every x∈Sn.\text{index policy } \pi \implies \pi \text{ feasible and } R_\pi(x) = \sup_{\pi' \text{ feasible}} R_{\pi'}(x)\ \text{ for every } x \in S^n.index policy π⟹π feasible and Rπ​(x)=π′ feasiblesup​Rπ′​(x)  for every x∈Sn.

Milestones

Note 4.2 (under Condition D, SSS is selected in {S,Λ(λ)}\{S, \Lambda(\lambda)\}{S,Λ(λ)} iff ν(S,x)≥λ\nu(S, x) \ge \lambdaν(S,x)≥λ, and at λ=ν(S,x)\lambda = \nu(S, x)λ=ν(S,x) a control uuu is optimal iff ν(S,x,u)=ν(S,x)\nu(S, x, u) = \nu(S, x)ν(S,x,u)=ν(S,x); the printed equivalence fails for λ<ν(S,x)\lambda < \nu(S, x)λ<ν(S,x)); Lemma 4.4 (Condition D for stoppable bandit processes with improving stopping options); Theorem 4.8 (an index for the bandit processes with discount factor aaa is strictly increasing in ν\nuν); Theorem 4.18 (the ε\varepsilonε-index bound, ε/(1−a)2\varepsilon/(1-a)^2ε/(1−a)2 for the discrete-time index).

Significance

Theorem 4.3 is the widest form in which the index theorem holds without further structure, and Condition D is exactly the right hypothesis: it says the superprocess has a canonical control, and once it does the family reduces to a family of bandit processes and the prevailing-charge argument goes through. Lemma 4.4 gives the model where the condition is known to hold, a research project that may be exploited at any time; the buyer's problem of Bergman and Bather is the case where it fails. Theorem 4.8 explains why every index theorem in the book is about the Gittins index: any function that orders bandit processes optimally must order them as ν\nuν does. Theorem 4.18 is the quantitative version of the index theorem that heuristics and computations rely on.

Nothing here is machine-checked. The mission builds the first controlled multi-armed model on the platform, a run law for families of decision processes with an explicit feasibility constraint, and states Whittle's condition as a property of the two-member family, which is how the literature uses it. Theorems 4.8 and 4.18 are statements about the existing Bandit Algorithms model and are usable by any later work on that model.

Difficulty

The obvious attack on Theorem 4.3, "replace each superprocess by the bandit process DgD_{g}Dg​ for its Condition-D policy ggg and apply the index theorem", is the second half of the book's proof; the first half is to show that an optimal policy never gains by applying a control other than g(xi)g(x_i)g(xi​) to a superprocess it continues, and that uses the prevailing-stake accounting of §4.3 with the other superprocesses treated as one bandit process, plus the observation that the class of policies deviating at most kkk times is ε\varepsilonε-exhaustive. Both halves require the whole run law of the family to be related to the run laws of its constituents, which is where a formalization spends its effort. Note 4.2 is short on the page but needs the optimal-stopping characterization of Chapter 2 for the bandit process DgD_gDg​ under charge λ\lambdaλ. Theorem 4.8 is elementary given the value of {B,Λ}\{B, \Lambda\}{B,Λ} under a freezing rule, Rf(B)+λγ−1−λWf(B)R_f(B) + \lambda\gamma^{-1} - \lambda W_f(B)Rf​(B)+λγ−1−λWf​(B), but that identity is itself a computation on the run law. Theorem 4.18 has no proof in the book (Glazebrook 1982c); the natural route is the prevailing-charge upper bound with the charges perturbed by ε\varepsilonε.

Formalization scope

Decision processes carry their control sets as finsets with a nonemptiness proof and their kernels as Markov kernels; the state space is countable with measurable singletons (so stationary kernels and control-dependent maps are measurable without side conditions) and the control type is finite with measurable singletons. The family's run law is built decision time by decision time as the Bandit Algorithms model builds markovBanditMeasure, with the policy's kernel producing the pair (superprocess, control). Feasibility is an almost-sure condition on the policy kernel, and optimality is the book's: feasible, and the supremum from every initial state-vector. The superprocess index is a real supremum over feasible stationary policies with g(x)=ug(x) = ug(x)=u, bounded by the reward bound and nonempty for u∈Γ(x)u \in \Gamma(x)u∈Γ(x); for an unavailable uuu it is a default value that no index policy consults. Condition D is stated on the family {S,Λ}\{S, \Lambda\}{S,Λ} on S⊕UnitS \oplus \mathrm{Unit}S⊕Unit, where the standard state has every control available, all equivalent. A stoppable bandit process is the decision process with control type Bool. Theorem 4.8 quantifies over index functions defined on every measurable state space and takes as hypothesis only what its proof uses, optimality of μ\muμ-index policies for the families {B,Λ}\{B, \Lambda\}{B,Λ}. Theorem 4.18 is on the kkk-armed Bandit Algorithms model with ε≥0\varepsilon \ge 0ε≥0 and the bound ε/(1−a)2\varepsilon/(1-a)^2ε/(1−a)2: the book's εγ−1(1−e−γ)−1\varepsilon\gamma^{-1}(1 - e^{-\gamma})^{-1}εγ−1(1−e−γ)−1 is in continuous-time index units, γ/(1−a)\gamma/(1-a)γ/(1−a) times the discrete-time index used here, and read with the discrete index it is false for a<1/ea < 1/ea<1/e. Theorem 4.3's index policy applies the Condition-D control ggg to the superprocess it continues, as the book's proof does; an index policy that breaks ties among controls otherwise need not be optimal.

Trivializing readings are excluded: index policies must be feasible, optimality is required from every initial state, and Condition D is a statement about optimal policies of a genuine two-member family, not about a chosen policy. Welcome contributions: the relation between the family's run law and the constituents' chain laws, the freezing-rule value identity behind Theorem 4.8, and the prevailing-stake accounting of §4.3.

Selected references

  • J. Gittins, K. Glazebrook, R. Weber, Multi-armed Bandit Allocation Indices, 2nd ed., Wiley, 2011, Chapter 4. doi:10.1002/9780470980033
  • P. Whittle, Multi-armed bandits and the Gittins index, Journal of the Royal Statistical Society B 42(2), 1980. doi:10.1111/j.2517-6161.1980.tb01111.x
  • K. D. Glazebrook, Stoppable families of alternative bandit processes, Journal of Applied Probability 16(4), 1979. doi:10.2307/3213152
  • K. D. Glazebrook, On the evaluation of suboptimal strategies for families of alternative bandit processes, Journal of Applied Probability 19(3), 1982. doi:10.2307/3213524
  • T. Lattimore, C. Szepesvári, Bandit Algorithms, Cambridge University Press, 2020, Chapter 35. doi:10.1017/9781108571401
10 thms4 active usersReviewed
Dynamic ProgrammingOperations ResearchProbability·Captain: mikedeng1

Coherent Multiperiod Risk Adjusted Values and Bellman's Principle: Stability of the Test Probabilities Is Equivalent to Bellman's PrincipleResearch Paper

Motivation

A coherent risk measure assigns to a future financial position the smallest amount of capital that makes it acceptable to a supervisor. Artzner, Delbaen, Eber and Heath characterised the one-period version: every coherent risk measure has the form π(X)=inf⁡Q∈PEQ[X]\pi(X)=\inf_{\mathbb Q\in\mathcal P}\mathbb E_{\mathbb Q}[X]π(X)=infQ∈P​EQ​[X] for a set P\mathcal PP of test probabilities (ADEH 1999). Regulators, insurers and banks, however, assess positions that evolve over several periods and whose risk is re-evaluated as information arrives. A multiperiod measurement should then be time consistent: the value assigned today should agree with the values the same method assigns tomorrow, so that it can be computed by backward induction, as in dynamic programming.

Artzner, Delbaen, Eber, Heath and Ku (Ann. Oper. Res. 2007) identify exactly which sets of test probabilities give time-consistent multiperiod risk-adjusted values. The condition, stability under pasting, also appears as "rectangularity" in the recursive multiple-priors model of decision theory (Epstein and Schneider 2003), and as m-stability in the theory of risk-neutral measures (Delbaen, The structure of m-stable sets, Séminaire de Probabilités XXXIX, 2006). Riedel treated dynamic coherent risk measures on finite state spaces (Riedel 2004); the continuous-time case is in Delbaen's m-stable paper and Cheridito, Delbaen and Kupper 2004.

Setting

Let (Ω,F,P0)(\Omega,\mathcal F,\mathbb P_0)(Ω,F,P0​) be a probability space with a filtration (Fn)n≥0(\mathcal F_n)_{n\ge0}(Fn​)n≥0​ and a horizon NNN. A value process is an adapted process X=(Xn)0≤n≤NX=(X_n)_{0\le n\le N}X=(Xn​)0≤n≤N​ with every XnX_nXn​ essentially bounded; the class of value processes is G\mathcal GG. All stopping times take values in {0,…,N}\{0,\dots,N\}{0,…,N}, and Fσ\mathcal F_\sigmaFσ​ is the σ-algebra of the stopping time σ\sigmaσ.

A set P\mathcal PP of test probabilities is a closed convex set of probabilities on (Ω,FN)(\Omega,\mathcal F_N)(Ω,FN​), each absolutely continuous with respect to P0\mathbb P_0P0​. Its elements are identified with their densities f=dQ/dP0f=d\mathbb Q/d\mathbb P_0f=dQ/dP0​, and "closed" refers to L1(P0)L^1(\mathbb P_0)L1(P0​). Pe\mathcal P^ePe denotes the elements equivalent to P0\mathbb P_0P0​. Each Q∈P\mathbb Q\in\mathcal PQ∈P has the density martingale ZnQ=EP0[dQ/dP0∣Fn]Z^{\mathbb Q}_n=\mathbb E_{\mathbb P_0}[d\mathbb Q/d\mathbb P_0\mid\mathcal F_n]ZnQ​=EP0​​[dQ/dP0​∣Fn​].

Pasting. For Q0,Q∈Pe\mathbb Q^0,\mathbb Q\in\mathcal P^eQ0,Q∈Pe with density martingales Z0,ZZ^0,ZZ0,Z and a stopping time τ\tauτ, the pasted martingale is Ln=Zn0L_n=Z^0_nLn​=Zn0​ for n≤τn\le\taun≤τ and Ln=Zτ0Zn/ZτL_n=Z^0_\tau Z_n/Z_\tauLn​=Zτ0​Zn​/Zτ​ for n≥τn\ge\taun≥τ: the pasted probability follows Q0\mathbb Q^0Q0 up to τ\tauτ and Q\mathbb QQ afterwards. P\mathcal PP is stable (Definition 3.1) if every such pasting is again in P\mathcal PP.

Two risk-adjusted values. For a value process XXX and a stopping time σ\sigmaσ,

Ψσ(X)=ess.inf⁡{EQ[Xτ∣Fσ] ∣ τ≥σ a stopping time, Q∈Pe},\Psi_\sigma(X)=\operatorname*{ess.inf}\bigl\{\mathbb E_{\mathbb Q}[X_\tau\mid\mathcal F_\sigma]\ \bigm|\ \tau\ge\sigma\text{ a stopping time},\ \mathbb Q\in\mathcal P^e\bigr\},Ψσ​(X)=ess.inf{EQ​[Xτ​∣Fσ​] ​ τ≥σ a stopping time, Q∈Pe},

the worst conditional expected value over all test probabilities and all later stopping times. The generalized Snell envelope is the backward recursion

ΨˉN(X)=XN,Ψˉn(X)=Xn∧ess.inf⁡Q∈PeEQ[Ψˉn+1(X)∣Fn].\bar\Psi_N(X)=X_N,\qquad \bar\Psi_n(X)=X_n\wedge\operatorname*{ess.inf}_{\mathbb Q\in\mathcal P^e}\mathbb E_{\mathbb Q}\bigl[\bar\Psi_{n+1}(X)\mid\mathcal F_n\bigr].ΨˉN​(X)=XN​,Ψˉn​(X)=Xn​∧Q∈Peess.inf​EQ​[Ψˉn+1​(X)∣Fn​].

For a stopping time τ\tauτ let Xnτ−=XnX^{\tau-}_n=X_nXnτ−​=Xn​ for n<τn<\taun<τ and Xτ−1X_{\tau-1}Xτ−1​ for n≥τn\ge\taun≥τ, and τXn=0{}^\tau X_n=0τXn​=0 for n<τn<\taun<τ and Xn−Xτ−1X_n-X_{\tau-1}Xn​−Xτ−1​ for n≥τn\ge\taun≥τ.

Formalization targets

Goal: Theorem 4.2

Assume F0\mathcal F_0F0​ is P0\mathbb P_0P0​-trivial and Pe≠∅\mathcal P^e\neq\emptysetPe=∅. Then the following are equivalent:

  1. P\mathcal PP is stable.
  2. For every Q∈P\mathbb Q\in\mathcal PQ∈P and X∈GX\in\mathcal GX∈G, Ψ(X)\Psi(X)Ψ(X) is a Q\mathbb QQ-submartingale.
  3. Ψ(X)=Ψˉ(X)\Psi(X)=\bar\Psi(X)Ψ(X)=Ψˉ(X) for every X∈GX\in\mathcal GX∈G.
  4. Bellman's principle holds: for every X∈GX\in\mathcal GX∈G and all stopping times σ≤τ\sigma\le\tauσ≤τ,
Ψσ(X)=Ψσ(Xτ−+Ψτ(τX)1[τ,N]).\Psi_\sigma(X)=\Psi_\sigma\bigl(X^{\tau-}+\Psi_\tau({}^\tau X)\mathbf 1_{[\tau,N]}\bigr).Ψσ​(X)=Ψσ​(Xτ−+Ψτ​(τX)1[τ,N]​).

Milestones

In attack order, all stated for any set P\mathcal PP with Pe≠∅\mathcal P^e\neq\emptysetPe=∅ unless stability is named:

  • Theorem 4.1. Ψˉ(X)\bar\Psi(X)Ψˉ(X) is the largest process in G\mathcal GG that lies below XXX and is a Q\mathbb QQ-submartingale for every Q∈P\mathbb Q\in\mathcal PQ∈P.
  • Step (1) of the proof of Theorem 4.2. Ψn(X)≥Ψˉn(X)\Psi_n(X)\ge\bar\Psi_n(X)Ψn​(X)≥Ψˉn​(X).
  • Theorem 4.2, first sentence. The family (Ψσ(X))σ(\Psi_\sigma(X))_\sigma(Ψσ​(X))σ​ is a process: Ψσ(X)=Ψσ(ω)(X)(ω)\Psi_\sigma(X)=\Psi_{\sigma(\omega)}(X)(\omega)Ψσ​(X)=Ψσ(ω)​(X)(ω) a.s.
  • Remark after Theorem 4.2. Ψτ(X)=Ψτ(τX)+Xτ−1\Psi_\tau(X)=\Psi_\tau({}^\tau X)+X_{\tau-1}Ψτ​(X)=Ψτ​(τX)+Xτ−1​.
  • Lemma 3.1 (stable P\mathcal PP). For τ≤σ≤ν\tau\le\sigma\le\nuτ≤σ≤ν, {(Zν/Zσ,Zσ/Zτ)∣Z∈Pe}={(Zν′/Zσ′,Zσ/Zτ)∣Z,Z′∈Pe}\{(Z_\nu/Z_\sigma,Z_\sigma/Z_\tau)\mid Z\in\mathcal P^e\}=\{(Z'_\nu/Z'_\sigma,Z_\sigma/Z_\tau)\mid Z,Z'\in\mathcal P^e\}{(Zν​/Zσ​,Zσ​/Zτ​)∣Z∈Pe}={(Zν′​/Zσ′​,Zσ​/Zτ​)∣Z,Z′∈Pe}.
  • Lemma 4.1 (stable P\mathcal PP). The family defining Ψσ(X)\Psi_\sigma(X)Ψσ​(X) is closed under minima and maxima.
  • Corollary of Lemma 4.1 (stable P\mathcal PP). Eμ[Ψσ(X)]=inf⁡{Eμ[EQ[Xτ∣Fσ]]∣Q∈Pe, τ≥σ}\mathbb E_\mu[\Psi_\sigma(X)]=\inf\{\mathbb E_\mu[\mathbb E_{\mathbb Q}[X_\tau\mid\mathcal F_\sigma]]\mid\mathbb Q\in\mathcal P^e,\ \tau\ge\sigma\}Eμ​[Ψσ​(X)]=inf{Eμ​[EQ​[Xτ​∣Fσ​]]∣Q∈Pe, τ≥σ} for every probability μ≪P0\mu\ll\mathbb P_0μ≪P0​.

A supporting item states that the essential infimum defining Ψσ(X)\Psi_\sigma(X)Ψσ​(X) exists.

Significance

The result. Theorem 4.2 characterises the sets of test probabilities for which the natural worst-case risk-adjusted value is computable by dynamic programming. Stability is thereby the structural condition behind time-consistent coherent risk measurement, recursive multiple-priors utility and backward-induction pricing under ambiguity. Without it, the worst-case value computed today may disagree with the value obtained by first computing tomorrow's worst case and then today's. The equivalence with the submartingale property says that stability is also exactly what makes Ψ(X)\Psi(X)Ψ(X) the largest submartingale minorant of Theorem 4.1. Theorem 4.3 and the recursivity results for final values in Section 5 are corollaries.

Formalizing it. The paper's proof is complete apart from Lemma 4.1 and its Corollary, whose proofs are left to the reader. No machine-checked version of this result, of the generalized Snell envelope or of essential infima of families of random variables is known to exist. A formal proof would provide a reusable development of discrete-time optimal stopping under a set of probabilities, the essential-infimum calculus of Neveu, and density-martingale pasting — infrastructure that many results on robust optimal stopping, dynamic risk measures and robust Markov decision processes need.

Difficulty

The direction from stability to Bellman's principle needs an essential infimum to be exchanged with a conditional expectation under another probability (step (3) of the proof). This is false for a general family: an essential infimum of conditional expectations is not the conditional expectation of an essential infimum. The exchange works only because stability makes the family closed under minima (Lemma 4.1), so that it is directed downward and its essential infimum is the limit of a decreasing sequence, and because Lemma 3.1 lets the test probabilities used before and after τ\tauτ be chosen independently. The converse, from the submartingale property to stability, is not a computation: it uses the separation theorem in L1L^1L1 against a pasted density assumed outside P\mathcal PP, which is where convexity and L1L^1L1-closedness of P\mathcal PP are used. Dropping either hypothesis breaks that direction.

Formalization scope

Lean represents P\mathcal PP by its set of densities in P0\mathbb P_0P0​: FN\mathcal F_NFN​-measurable, a.s. nonnegative, integrable, of mass one, convex, sequentially closed in the L1(P0)L^1(\mathbb P_0)L1(P0​) seminorm and saturated under a.s. equality. Test probabilities are Qf=f⋅P0\mathbb Q_f=f\cdot\mathbb P_0Qf​=f⋅P0​, and EQ[⋅∣Fσ]\mathbb E_{\mathbb Q}[\cdot\mid\mathcal F_\sigma]EQ​[⋅∣Fσ​] is Mathlib's conditional expectation under Qf\mathbb Q_fQf​. Time is N\mathbb NN, and every stopping time is bounded by NNN. A Q\mathbb QQ-submartingale on 0,…,N0,\dots,N0,…,N is Mathlib's Submartingale of the process frozen after NNN. The essential infimum of a family is defined in the mission (Mathlib has only that of a single function); a supporting item shows that it exists, so its fallback value is never used. All identities between risk-adjusted values hold P0\mathbb P_0P0​-almost surely.

Conventions made explicit:

  • the goal assumes that F0\mathcal F_0F0​ is P0\mathbb P_0P0​-trivial, which the proof uses when it treats Ψ0(X)\Psi_0(X)Ψ0​(X) as a number (without it, stability is not implied by (2)–(3));
  • Pe≠∅\mathcal P^e\neq\emptysetPe=∅ replaces the paper's convenience assumption P0∈P\mathbb P_0\in\mathcal PP0​∈P;
  • X−1=0X_{-1}=0X−1​=0;
  • the Corollary's printed essential infimum over Q\mathbb QQ alone is read over Q\mathbb QQ and τ≥σ\tau\ge\sigmaτ≥σ, as its right-hand side and its use require.

Bellman's principle must be stated with Ψ\PsiΨ on both sides and for all stopping times σ≤τ\sigma\le\tauσ≤τ. Replacing Ψ\PsiΨ by Ψˉ\bar\PsiΨˉ, or restricting to deterministic times, turns the goal into a property of the recursion and is not the theorem.

Needed infrastructure, reusable beyond this mission: existence and directedness of essential infima of families; conditional expectations under equivalent measures and the Bayes formula; optional sampling for bounded stopping times under each Q\mathbb QQ; the L1L^1L1–L∞L^\inftyL∞ separation theorem. Contributions of any of these, and proofs of the milestones in any order, are welcome.

Selected references

  • P. Artzner, F. Delbaen, J.-M. Eber, D. Heath, H. Ku, Coherent multiperiod risk adjusted values and Bellman's principle, Annals of Operations Research 152 (2007) 5–22. https://doi.org/10.1007/s10479-006-0132-6
  • P. Artzner, F. Delbaen, J.-M. Eber, D. Heath, Coherent measures of risk, Mathematical Finance 9 (1999) 203–228. https://doi.org/10.1111/1467-9965.00068
  • L. G. Epstein, M. Schneider, Recursive multiple-priors, Journal of Economic Theory 113 (2003) 1–31. https://doi.org/10.1016/S0022-0531(03)00097-8
  • F. Riedel, Dynamic coherent risk measures, Stochastic Processes and their Applications 112 (2004) 185–200. https://doi.org/10.1016/j.spa.2004.03.004
  • P. Cheridito, F. Delbaen, M. Kupper, Coherent and convex monetary risk measures for bounded càdlàg processes, Stochastic Processes and their Applications 112 (2004) 1–22. https://doi.org/10.1016/j.spa.2004.01.009
  • F. Delbaen, The structure of m-stable sets and in particular of the set of risk neutral measures, Séminaire de Probabilités XXXIX, Lecture Notes in Mathematics 1874 (2006) 215–258. https://doi.org/10.1007/978-3-540-35513-7_17
  • J. Neveu, Discrete-Parameter Martingales, North-Holland, 1975 (French original: Martingales à temps discret, Masson, 1972).
  • Y. S. Chow, H. Robbins, D. Siegmund, Great Expectations: The Theory of Optimal Stopping, Houghton Mifflin, 1971; Dover reprint, 1991.
12 thms2 active usersReviewed
Machine LearningOperations ResearchOptimization+1·Captain: mikedeng1

Generalization Bounds in the Predict-then-Optimize Framework II: Margin-Based Generalization Bound for the SPO Loss under the Strength PropertyResearch Paper

Motivation

In the predict-then-optimize paradigm a model first predicts the cost vector of a linear optimization problem from contextual features, and the prediction is then fed to an optimization solver that returns a decision. Examples include routing with predicted travel times and portfolio choice with predicted returns. The quality of a prediction is judged by the decision it produces. The Smart Predict-then-Optimize (SPO) loss of Elmachtoub and Grigas (Management Science 2022) measures exactly that: the excess cost of acting on the prediction instead of on the true cost vector.

El Balghiti, Elmachtoub, Grigas and Tewari (arXiv:1905.11488v3) ask when a model with small empirical SPO loss also has small expected SPO loss. The SPO loss is non-convex and discontinuous, so standard Lipschitz-contraction arguments do not apply to it directly. Their Section 4 introduces a margin version of the SPO loss, in the spirit of the margin theory of Koltchinskii and Panchenko (Ann. Statist. 2002) for classification. They show that it is Lipschitz under a geometric condition on the feasible region, and derive a generalization bound in terms of the multivariate Rademacher complexity of the hypothesis class. This mission formalizes that bound.

Setting

Decisions live in Rd\mathbb R^dRd with a norm ∥⋅∥\|\cdot\|∥⋅∥; cost vectors are linear functionals with the dual norm ∥c∥∗=max⁡∥w∥≤1c⊤w\|c\|_*=\max_{\|w\|\le1}c^\top w∥c∥∗​=max∥w∥≤1​c⊤w. The feasible region S⊆RdS\subseteq\mathbb R^dS⊆Rd is nonempty, compact and convex, and throughout Section 4 it is not a singleton. An optimization oracle w∗w^*w∗ maps each cost vector ccc to some minimizer w∗(c)∈arg⁡min⁡w∈Sc⊤ww^*(c)\in\arg\min_{w\in S}c^\top ww∗(c)∈argminw∈S​c⊤w. The SPO loss of a prediction c^\hat cc^ against the realized cost ccc is

ℓSPO(c^,c)=c⊤w∗(c^)−c⊤w∗(c),\ell_{\rm SPO}(\hat c,c)=c^\top w^*(\hat c)-c^\top w^*(c),ℓSPO​(c^,c)=c⊤w∗(c^)−c⊤w∗(c),

and the linear optimization gap is ωS(c)=max⁡w∈Sc⊤w−min⁡w∈Sc⊤w\omega_S(c)=\max_{w\in S}c^\top w-\min_{w\in S}c^\top wωS​(c)=maxw∈S​c⊤w−minw∈S​c⊤w, with ωS(C)=sup⁡c∈CωS(c)\omega_S(\mathcal C)=\sup_{c\in\mathcal C}\omega_S(c)ωS​(C)=supc∈C​ωS​(c) and ρ2(C)=sup⁡c∈C∥c∥2\rho_2(\mathcal C)=\sup_{c\in\mathcal C}\|c\|_2ρ2​(C)=supc∈C​∥c∥2​ for the set C\mathcal CC of possible true costs.

A cost vector is degenerate if min⁡w∈Sc^⊤w\min_{w\in S}\hat c^\top wminw∈S​c^⊤w has more than one optimal solution; C∘\mathcal C^\circC∘ is the set of degenerate costs. The distance to degeneracy is νS(c^)=inf⁡c∈C∘∥c−c^∥∗\nu_S(\hat c)=\inf_{c\in\mathcal C^\circ}\|c-\hat c\|_*νS​(c^)=infc∈C∘​∥c−c^∥∗​. The region SSS has the strength property with parameter μ>0\mu>0μ>0 if

c^⊤(w−w∗(c^))≥μ νS(c^)2 ∥w−w∗(c^)∥2for all w∈S and all c^.\hat c^\top\big(w-w^*(\hat c)\big)\ge\frac{\mu\,\nu_S(\hat c)}{2}\,\|w-w^*(\hat c)\|^2\qquad\text{for all }w\in S\text{ and all }\hat c .c^⊤(w−w∗(c^))≥2μνS​(c^)​∥w−w∗(c^)∥2for all w∈S and all c^.

For γ>0\gamma>0γ>0 the γ\gammaγ-margin SPO loss ℓSPOγ(c^,c)\ell^\gamma_{\rm SPO}(\hat c,c)ℓSPOγ​(c^,c) equals ℓSPO(c^,c)\ell_{\rm SPO}(\hat c,c)ℓSPO​(c^,c) when νS(c^)>γ\nu_S(\hat c)>\gammaνS​(c^)>γ and νS(c^)γℓSPO(c^,c)+(1−νS(c^)γ)ωS(c)\frac{\nu_S(\hat c)}{\gamma}\ell_{\rm SPO}(\hat c,c)+\big(1-\frac{\nu_S(\hat c)}{\gamma}\big)\omega_S(c)γνS​(c^)​ℓSPO​(c^,c)+(1−γνS​(c^)​)ωS​(c) otherwise. It dominates the SPO loss.

Data (x,c)(x,c)(x,c) are drawn from a distribution D\mathcal DD on features X\mathcal XX and costs in C\mathcal CC, and H\mathcal HH is a class of prediction functions f:X→Rdf:\mathcal X\to\mathbb R^df:X→Rd. The SPO risk is RSPO(f)=ED[ℓSPO(f(x),c)]R_{\rm SPO}(f)=\mathbb E_{\mathcal D}[\ell_{\rm SPO}(f(x),c)]RSPO​(f)=ED​[ℓSPO​(f(x),c)] and the empirical margin risk is R^SPOγ(f)=1n∑iℓSPOγ(f(xi),ci)\hat R^\gamma_{\rm SPO}(f)=\frac1n\sum_i\ell^\gamma_{\rm SPO}(f(x_i),c_i)R^SPOγ​(f)=n1​∑i​ℓSPOγ​(f(xi​),ci​). The multivariate empirical Rademacher complexity is R^n(H)=Eσ[sup⁡f∈H1n∑iσi⊤f(xi)]\hat{\mathfrak R}^n(\mathcal H)=\mathbb E_{\boldsymbol\sigma}\big[\sup_{f\in\mathcal H}\frac1n\sum_i\boldsymbol\sigma_i^\top f(x_i)\big]R^n(H)=Eσ​[supf∈H​n1​∑i​σi⊤​f(xi​)] with i.i.d. Rademacher vectors σi∈{±1}d\boldsymbol\sigma_i\in\{\pm1\}^dσi​∈{±1}d, and Rn(H)\mathfrak R^n(\mathcal H)Rn(H) is its expectation over the sample.

Formalization targets

Goal: Theorem 4, second display (pp. 19–20)

In the ℓ2\ell_2ℓ2​ set-up, under the strength property with μ>0\mu>0μ>0 and for fixed γ>0\gamma>0γ>0, for every δ>0\delta>0δ>0, with probability at least 1−δ1-\delta1−δ over an i.i.d. sample of size nnn, for all f∈Hf\in\mathcal Hf∈H:

RSPO(f)≤R^SPOγ(f)+(22ρ2(C)+22μ ωS(C)γμ)Rn(H)+ωS(C)log⁡(1/δ)2n.R_{\rm SPO}(f)\le\hat R^\gamma_{\rm SPO}(f)+\Big(\frac{2\sqrt2\rho_2(\mathcal C)+2\sqrt2\mu\,\omega_S(\mathcal C)}{\gamma\mu}\Big)\mathfrak R^n(\mathcal H)+\omega_S(\mathcal C)\sqrt{\frac{\log(1/\delta)}{2n}} .RSPO​(f)≤R^SPOγ​(f)+(γμ22​ρ2​(C)+22​μωS​(C)​)Rn(H)+ωS​(C)2nlog(1/δ)​​.

Milestones

  1. Theorem 3(a): ∥w∗(c^1)−w∗(c^2)∥≤∥c^1−c^2∥∗μmin⁡{νS(c^1),νS(c^2)}\|w^*(\hat c_1)-w^*(\hat c_2)\|\le\frac{\|\hat c_1-\hat c_2\|_*}{\mu\min\{\nu_S(\hat c_1),\nu_S(\hat c_2)\}}∥w∗(c^1​)−w∗(c^2​)∥≤μmin{νS​(c^1​),νS​(c^2​)}∥c^1​−c^2​∥∗​​.
  2. Theorem 3(b): the same Lipschitz-like bound for ℓSPO(⋅,c)\ell_{\rm SPO}(\cdot,c)ℓSPO​(⋅,c), with an extra factor ∥c∥∗\|c\|_*∥c∥∗​.
  3. Theorem 3(c): ℓSPOγ(⋅,c)\ell^\gamma_{\rm SPO}(\cdot,c)ℓSPOγ​(⋅,c) is ∥c∥∗+μ ωS(c)γμ\frac{\|c\|_*+\mu\,\omega_S(c)}{\gamma\mu}γμ∥c∥∗​+μωS​(c)​-Lipschitz for the dual norm.
  4. Eq. (7) with C=2C=\sqrt2C=2​ (Maurer's vector contraction inequality): for LLL-Lipschitz Φi\Phi_iΦi​ on Euclidean Rd\mathbb R^dRd,
Eσ[sup⁡f∈H1n∑iσiΦi(f(xi))]≤2L R^n(H).\mathbb E_\sigma\Big[\sup_{f\in\mathcal H}\frac1n\sum_i\sigma_i\Phi_i(f(x_i))\Big]\le\sqrt2L\,\hat{\mathfrak R}^n(\mathcal H).Eσ​[f∈Hsup​n1​i∑​σi​Φi​(f(xi​))]≤2​LR^n(H).
  1. Theorem 4, first display: for any fixed sample with costs in C\mathcal CC,
R^γSPOn(H)≤(2ρ2(C)+2μ ωS(C)γμ)R^n(H).\hat{\mathfrak R}^n_{\gamma\rm SPO}(\mathcal H)\le\Big(\frac{\sqrt2\rho_2(\mathcal C)+\sqrt2\mu\,\omega_S(\mathcal C)}{\gamma\mu}\Big)\hat{\mathfrak R}^n(\mathcal H).R^γSPOn​(H)≤(γμ2​ρ2​(C)+2​μωS​(C)​)R^n(H).

Theorem 3 is stated for a general norm, as in the paper. Eq. (7), Theorem 4 and the goal are Euclidean. The paper's Theorem 5 (p. 20), a version of the goal uniform over γ∈(0,γˉ]\gamma\in(0,\bar\gamma]γ∈(0,γˉ​], is not part of this mission.

Significance

The bound replaces the loss-class complexity of the SPO loss, which is controlled only through combinatorial dimensions (Natarajan dimension in the polyhedral case, Section 3 of the paper), by the multivariate Rademacher complexity of H\mathcal HH itself. For norm-bounded linear hypothesis classes this complexity has mild, even logarithmic, dependence on the dimensions ppp and ddd (Section 4.4). The result applies to every feasible region with the strength property. By Section 5 of the paper these include strongly convex sets and polytopes, where νS\nu_SνS​ can also be computed. When most predictions stay far from degeneracy, R^SPOγ≈R^SPO\hat R^\gamma_{\rm SPO}\approx\hat R_{\rm SPO}R^SPOγ​≈R^SPO​ and the bound is much sharper than the combinatorial one. It is also a strict generalization of margin bounds for binary classification (Example 7).

The theorem is proved in the paper, which imports two external tools without proof: the Rademacher generalization bound of Bartlett and Mendelson, applied to the margin loss, and Maurer's inequality. To our knowledge none of these results has a machine-checked proof. The mission produces a checked proof of the margin bound and a Lean statement of Maurer's inequality. It also formalizes the strength property and the Lipschitz estimates of Theorem 3, which the companion missions on strongly convex sets and polytopes rely on.

Difficulty

The SPO loss is discontinuous in c^\hat cc^ at degenerate predictions. The standard route, scalar Ledoux–Talagrand contraction applied to the loss class, therefore fails at the first step. It would fail even for a Lipschitz loss, because it relates the loss class only to a scalar class, and H\mathcal HH is vector valued. Lipschitz continuity of the margin loss needs the oracle to be stable away from C∘\mathcal C^\circC∘. Convexity and compactness of SSS alone do not give that: for an ℓp\ell_pℓp​ ball with 2<p<∞2<p<\infty2<p<∞ the strength property fails for every μ>0\mu>0μ>0 (p. 14). The vector contraction inequality of Maurer (2016) is a nontrivial probabilistic inequality, and its constant 2\sqrt22​ must not depend on the dimension ddd. The final concentration step is McDiarmid's inequality for a supremum over a possibly uncountable class, which in a formal proof needs measurability of that supremum.

Formalization scope

The decision space is a finite-dimensional real normed space E. Cost vectors and predictions are continuous linear functionals, StrongDual ℝ E, whose operator norm is the paper's dual norm. In the ℓ2\ell_2ℓ2​ statements E = EuclideanSpace ℝ (Fin d), where the dual norm is Euclidean. Every statement carries the standing assumptions: SSS nonempty, compact, convex and not a singleton, an arbitrary oracle (no tie-breaking rule), and μ>0\mu>0μ>0, γ>0\gamma>0γ>0. The Lipschitz-like bounds of Theorem 3(a)–(b) are stated multiplied out, because the paper reads 1/01/01/0 as +∞+\infty+∞. Expectations over signs are finite averages over sign patterns. ωS(C)\omega_S(\mathcal C)ωS​(C) and ρ2(C)\rho_2(\mathcal C)ρ2​(C) are suprema over a nonempty bounded C\mathcal CC containing the cost almost surely. "With probability at least 1−δ1-\delta1−δ" is the statement that the outer Dn\mathcal D^nDn-measure of the failure event is at most δ\deltaδ.

Added hypotheses, all disclosed in the statements: the multivariate Rademacher sums are bounded above (almost surely in the goal) and R^n(H)\hat{\mathfrak R}^n(\mathcal H)R^n(H) is integrable, since otherwise Lean's junk value 000 would replace an infinite complexity and make the bound false rather than vacuous. Hypotheses fff and ℓSPO(f(x),c)\ell_{\rm SPO}(f(x),c)ℓSPO​(f(x),c) measurable, and the uniform deviation and margin Rademacher suprema a.e.-measurable, are also added; the paper is silent on measurability. A singleton SSS would make C∘\mathcal C^\circC∘ empty and the strength property hold for free; this is excluded explicitly, so the strength property is not vacuous.

A complete development needs the Bartlett–Mendelson symmetrization bound for bounded losses, McDiarmid's inequality, Maurer's inequality, and the Lipschitz and distance-to-degeneracy facts of Section 4.1. Maurer's inequality and the multivariate Rademacher complexity are reusable across vector-valued learning theory. Proofs of any milestone, and of Maurer's inequality in particular, are welcome.

Selected references

  • O. El Balghiti, A. N. Elmachtoub, P. Grigas, A. Tewari, Generalization Bounds in the Predict-then-Optimize Framework, Mathematics of Operations Research, 2023; preprint arXiv:1905.11488v3, 2022. https://arxiv.org/abs/1905.11488
  • A. N. Elmachtoub, P. Grigas, Smart "Predict, then Optimize", Management Science 68(1), 2022. https://doi.org/10.1287/mnsc.2020.3922
  • A. Maurer, A Vector-Contraction Inequality for Rademacher Complexities, Algorithmic Learning Theory (ALT), 2016. https://arxiv.org/abs/1605.00251
  • P. L. Bartlett, S. Mendelson, Rademacher and Gaussian Complexities: Risk Bounds and Structural Results, Journal of Machine Learning Research 3, 2002. https://www.jmlr.org/papers/v3/bartlett02a.html
  • V. Koltchinskii, D. Panchenko, Empirical Margin Distributions and Bounding the Generalization Error of Combined Classifiers, Annals of Statistics 30(1), 2002. https://doi.org/10.1214/aos/1015362183
9 thms3 active usersReviewed
Markov ChainOperations ResearchProbability+1·Captain: mikedeng1

Open, Closed, and Mixed Networks of Queues with Different Classes of Customers: The Product-Form Equilibrium DistributionResearch Paper

Motivation

Networks of queues model computer systems, communication networks and manufacturing lines: customers (jobs, packets, parts) move between service centers, wait, receive service and move on. Their equilibrium behaviour determines throughputs, utilizations and response times, and for most networks it can only be computed by solving the full balance equations of a continuous-time Markov chain whose state space grows combinatorially with the number of centers and customers. A product-form network is one whose equilibrium distribution factorizes over the centers; for such networks performance measures can be computed exactly by efficient algorithms (convolution, mean value analysis), and this is the basis of much of classical computer-performance modelling.

Timeline of the main product-form results:

  • 1957–1963, Jackson (Oper. Res. 5, 1957; Manag. Sci. 10, 1963): open networks of exponential FCFS queues, one customer class, Poisson arrivals.
  • 1967, Gordon and Newell (Oper. Res. 15): the closed single-class exponential case.
  • 1975, Baskett, Chandy, Muntz and Palacios (J. ACM 22): several customer classes with class switching, four service disciplines (FCFS, processor sharing, infinite server, preemptive-resume LCFS), service times with rational Laplace transforms at the last three, and open, closed or mixed networks with state-dependent Poisson arrivals. This is the BCMP theorem, the subject of this mission.
  • 1975–1979, Kelly (J. Appl. Prob. 12, 1975; Reversibility and Stochastic Networks, Wiley 1979): symmetric queues and quasi-reversibility, a general framework containing the BCMP disciplines.

Setting

A network has NNN service centers and RRR customer classes. A class-rrr customer finishing service at center iii next requires center jjj in class sss with probability pi,r;j,sp_{i,r;j,s}pi,r;j,s​ and leaves the network with probability 1−∑j,spi,r;j,s1-\sum_{j,s}p_{i,r;j,s}1−∑j,s​pi,r;j,s​. The pairs (i,r)(i,r)(i,r) are partitioned into subchains E1,…,EmE_1,\dots,E_mE1​,…,Em​ that routing never leaves. Each center has one of four types:

  1. FCFS, with an exponential service time of rate μi\mu_iμi​ common to all classes;
  2. a single processor-sharing server (each of nnn customers is served at rate 1/n1/n1/n);
  3. an infinite-server center;
  4. a single preemptive-resume LCFS server.

At types 2–4 the class-rrr service time is Coxian: uir≥1u_{ir}\ge1uir​≥1 exponential stages of rates μirl\mu_{irl}μirl​, and after stage lll the customer continues with probability airla_{irl}airl​ or finishes with probability birl=1−airlb_{irl}=1-a_{irl}birl​=1−airl​. The state S=(x1,…,xN)S=(x_1,\dots,x_N)S=(x1​,…,xN​) records the FCFS order of classes at type 1, the number mirlm_{irl}mirl​ of class-rrr customers in stage lll at types 2 and 3, and the LCFS order of (class, stage) pairs at type 4. External arrivals are Poisson, either with rate λ(M(S))\lambda(M(S))λ(M(S)) depending on the total population M(S)M(S)M(S) (process A) or with one stream per subchain of rate λk(M(S/Ek))\lambda_k(M(S/E_k))λk​(M(S/Ek​)) (process B); an arrival joins center jjj in class sss with probability qjsq_{js}qjs​. A subchain with q≡0q\equiv0q≡0 is closed and keeps a fixed population KkK_kKk​.

With relative arrival rates eir≥0e_{ir}\ge0eir​≥0 solving the traffic equations ∑(i,r)eirpi,r;j,s+qjs=ejs\sum_{(i,r)}e_{ir}p_{i,r;j,s}+q_{js}=e_{js}∑(i,r)​eir​pi,r;j,s​+qjs​=ejs​ and Airl=∏j<lairjA_{irl}=\prod_{j<l}a_{irj}Airl​=∏j<l​airj​ (the probability of reaching stage lll, stages numbered from 0), the paper defines fi(xi)f_i(x_i)fi​(xi​) per center type and a factor d(S)d(S)d(S) from the arrival rates.

Formalization targets

Goal: the BCMP theorem (§3.2, pp. 253–254)

π(S)=d(S) f1(x1) f2(x2)⋯fN(xN)\pi(S)=d(S)\,f_1(x_1)\,f_2(x_2)\cdots f_N(x_N)π(S)=d(S)f1​(x1​)f2​(x2​)⋯fN​(xN​)

satisfies the global balance equations of the network, and, under the paper's assumption that the equilibrium distribution is unique, every equilibrium distribution equals π/Z\pi/Zπ/Z whenever Z=∑Sπ(S)Z=\sum_S\pi(S)Z=∑S​π(S) is finite and positive. The goal covers all four center types, open, closed and mixed networks, and both arrival processes.

Milestones

  • §3.1 (p. 252): independent balance implies global balance.
  • §3.2 (p. 254): the product form satisfies the independent balance equations.
  • §4.1 (p. 254): the aggregate-state probabilities are C d(S) g1(y1)⋯gN(yN)C\,d(S)\,g_1(y_1)\cdots g_N(y_N)Cd(S)g1​(y1​)⋯gN​(yN​).

A further supporting item, also from §4.1 (p. 254), states that summing fif_ifi​ over local states with fixed class counts gives gig_igi​. So gig_igi​ depends on the service times only through their means 1/μir=∑lAirl/μirl1/\mu_{ir}=\sum_lA_{irl}/\mu_{irl}1/μir​=∑l​Airl​/μirl​.

Significance

The theorem places the four disciplines, class switching and mixed open/closed populations under one formula. Its corollary in §4.1, that aggregate probabilities depend on service time distributions only through their means (insensitivity), is what makes the model usable with measured mean service times, and it underlies the convolution and mean value analysis algorithms for normalizing constants.

The result is classical and proved on paper. As far as the platform's catalogue shows, it is not formalized: the platform has Kelly's single-class migration process with exponential service, a special case. A machine-checked BCMP theorem would provide a verified multiclass queueing-network model (states, event-driven transition rates, balance equations) on which later results can build: mean value analysis, the state-dependent rates of §5, and the open-network marginals of §4.2.

The printed statement contains an error. The paper defines Airl=∏j=1lairjA_{irl}=\prod_{j=1}^{l}a_{irj}Airl​=∏j=1l​airj​ (p. 253). With the branching of its Figs. 1 and 3, this product includes the branch out of stage lll. For exponential service (uir=1u_{ir}=1uir​=1) it gives Air1=air1=0A_{ir1}=a_{ir1}=0Air1​=air1​=0, so every fif_ifi​ of a type 2–4 center with a customer present vanishes, and a closed network of such centers would have no normalizable solution. The mission states the corrected theorem with Airl=∏j<lairjA_{irl}=\prod_{j<l}a_{irj}Airl​=∏j<l​airj​, which the mean-service-time identity of §4.1 also requires. The type-2 factor 1/mikl!1/m_{ikl}!1/mikl​! is read as 1/mirl!1/m_{irl}!1/mirl​!.

Difficulty

The algebra of the paper's proof is local: each independent balance equation reduces to the traffic equations. The difficulty is in making that statement precise for a real state space. The independent balance equations need a consistent labelling of each moving customer by the "stage" it leaves and enters. That labelling has to cover FCFS centers, where per-class labels are inconsistent (p. 253), the outside world of each open subchain, and LCFS preemption. Every in-flow into a state is a sum over predecessor states, and those states differ by list operations (appending at an FCFS tail, pushing on an LCFS head) or by stage-count updates. The factorials in the processor-sharing and infinite-server factors, and the telescoping identity ∑lAirlbirl=1\sum_lA_{irl}b_{irl}=1∑l​Airl​birl​=1 for departures, must line up exactly with the rates. The obvious shortcut is to check global balance directly for a single class with exponential service. That covers neither class switching, nor Coxian stages, nor mixed networks.

Formalization scope

Centers are Fin N, classes Fin R and subchains Fin m. The class-rrr stages at center iii are Fin (u i r) with u i r : ℕ+, numbered from 0. A local state is an inductive type with three shapes (FCFS list, stage-count array, LCFS list of (class, stage) pairs). The state space is the subtype of configurations whose shapes match the center types and whose closed subchains hold their fixed populations. Transition rates are the sums of the rates of explicit events (arrivals, FCFS completions, stage moves and completions, LCFS moves and completions). Global balance uses tsum; every state has finitely many successors and predecessors with nonzero rate, so these sums are finite. The standing assumptions (substochastic routing closed on subchains, closed subchains with no arrivals and no departures, positive rates, continuation probabilities in [0,1][0,1][0,1] vanishing at the last stage) are collected in Network.IsValid. Irreducibility of subchains is not assumed, and any nonnegative solution of the traffic equations is allowed. Under process B the product in d(S)d(S)d(S) runs over open subchains only. Uniqueness of the equilibrium is a hypothesis, as in the paper. The type-1 rate is constant, and the state-dependent rates of Condition 1 and §5 are not covered.

The following formalizations would trivialize the mission and are ruled out: stating only global balance of π\piπ (satisfied by π≡0\pi\equiv0π≡0), quantifying over arbitrary rate functions instead of the rates built from the network data, and restricting the goal to exponential service or to a single class.

Needed infrastructure: finite-support tsum manipulations, multinomial identities for the §4.1 sums over orderings and stage assignments, and bookkeeping for list and array updates. The model and the balance-equation layer can be reused for later queueing missions. Contributions are welcome on each milestone, on the per-center-type pieces of the independent balance check, and on helper lemmas about the event system.

Selected references

  • F. Baskett, K. M. Chandy, R. R. Muntz, F. G. Palacios, Open, Closed, and Mixed Networks of Queues with Different Classes of Customers, J. ACM 22(2):248–260, 1975. https://doi.org/10.1145/321879.321887
  • J. R. Jackson, Networks of Waiting Lines, Operations Research 5(4):518–521, 1957. https://doi.org/10.1287/opre.5.4.518
  • J. R. Jackson, Jobshop-like Queueing Systems, Management Science 10(1):131–142, 1963. https://doi.org/10.1287/mnsc.10.1.131
  • W. J. Gordon, G. F. Newell, Closed Queuing Systems with Exponential Servers, Operations Research 15(2):254–265, 1967. https://doi.org/10.1287/opre.15.2.254
  • F. P. Kelly, Reversibility and Stochastic Networks, Wiley, 1979. http://www.statslab.cam.ac.uk/~frank/rsn.html
  • D. R. Cox, A Use of Complex Probabilities in the Theory of Stochastic Processes, Proc. Cambridge Phil. Soc. 51:313–319, 1955. https://doi.org/10.1017/S0305004100030231
9 thms2 active usersReviewed
CombinatoricsDiscrete GeometryLinear Optimization+1·Captain: mikedeng1

On Sub-determinants and the Diameter of Polyhedra: A Polynomial Diameter Bound in the Largest SubdeterminantResearch Paper

Motivation

The combinatorial diameter of a polyhedron is the largest distance, in its vertex-edge graph, between two vertices. It is a lower bound on the number of pivots any edge-following method such as the simplex method needs in the worst case, which is why the polynomial Hirsch conjecture — the diameter of P={x∈Rn:Ax≤b}P = \{x \in \mathbb{R}^n : Ax \le b\}P={x∈Rn:Ax≤b} is bounded by a polynomial in mmm and nnn — is a central open question of linear optimization and discrete geometry. The best general upper bound is quasi-polynomial, m1+log⁡nm^{1+\log n}m1+logn (Kalai–Kleitman 1992); the original Hirsch bound m−nm - nm−n is false for polytopes (Santos 2012).

A different line of work bounds the diameter by the arithmetic of the constraint matrix instead of its size. For an integer matrix AAA let Δ\DeltaΔ be the largest absolute value of a sub-determinant of AAA. Dyer and Frieze (1994) showed that for totally unimodular AAA (Δ=1\Delta = 1Δ=1) the diameter is polynomial, O(m16n3(log⁡mn)3)O(m^{16} n^3 (\log mn)^3)O(m16n3(logmn)3). Bonifas, Di Summa, Eisenbrand, Hähnle and Niemeier (SoCG 2012; Discrete Comput Geom 52, 2014) improved and generalized this to O(Δ2n4log⁡nΔ)O(\Delta^2 n^4 \log n\Delta)O(Δ2n4lognΔ) for all polyhedra and O(Δ2n3.5log⁡nΔ)O(\Delta^2 n^{3.5} \log n\Delta)O(Δ2n3.5lognΔ) for polytopes, bounds that do not depend on the number mmm of inequalities. This mission formalizes the polytope case.

Setting

Let A∈Zm×nA \in \mathbb{Z}^{m\times n}A∈Zm×n with rows a1,…,ama_1,\dots,a_ma1​,…,am​, let b∈Rmb \in \mathbb{R}^mb∈Rm, and let P={x∈Rn:Ax≤b}P = \{x \in \mathbb{R}^n : Ax \le b\}P={x∈Rn:Ax≤b}. A vertex of PPP is an extreme point; for a polyhedron this is a point of PPP at which nnn linearly independent inequalities are tight. Two vertices u≠vu \ne vu=v are adjacent if the segment [u,v][u,v][u,v] is an edge (a one-dimensional face) of PPP. This gives the polyhedral graph GP=(V,E)G_P = (V, E)GP​=(V,E), and the diameter of PPP is at most BBB if every two vertices are joined by a walk of at most BBB edges.

AAA has sub-determinants bounded by Δ\DeltaΔ if every k×kk\times kk×k submatrix, for every k≥1k \ge 1k≥1, has determinant in [−Δ,Δ][-\Delta, \Delta][−Δ,Δ]. In particular every entry is at most Δ\DeltaΔ in absolute value.

For a vertex vvv the normal cone CvC_vCv​ is the set of objectives ccc for which vvv maximizes cTxc^T xcTx over PPP. With BnB_nBn​ the closed unit ball, the volume of a set U⊆VU \subseteq VU⊆V of vertices is

vol(U)=vol(⋃v∈UCv∩Bn),\mathrm{vol}(U) = \mathrm{vol}\Big(\bigcup_{v\in U} C_v \cap B_n\Big),vol(U)=vol(v∈U⋃​Cv​∩Bn​),

and the neighbourhood N(I)\mathcal N(I)N(I) of I⊆VI \subseteq VI⊆V is the set of vertices outside III adjacent to a vertex of III. A spherical cone is S=C∩BnS = C \cap B_nS=C∩Bn​ with CCC closed under non-negative scaling; its dockable surface D(S)D(S)D(S) is the (n−1)(n-1)(n−1)-dimensional measure of the part of its boundary inside the open ball. A cone of revolution of angle 0<θ≤π/20<\theta\le\pi/20<θ≤π/2 is {x∈Bn:vTx≥cos⁡θ ∥v∥ ∥x∥}\{x \in B_n : v^T x \ge \cos\theta\,\|v\|\,\|x\|\}{x∈Bn​:vTx≥cosθ∥v∥∥x∥}. PPP is non-degenerate if every vertex has exactly nnn tight inequalities.

Formalization targets

Goal: Theorem 2 (p. 105)

If A∈Zm×nA \in \mathbb{Z}^{m\times n}A∈Zm×n has all sub-determinants bounded by Δ\DeltaΔ and PPP is bounded, then

diam⁡(P)≤2⌊2π Δ2n5/2ln⁡ ⁣(2n n! nn/2 Δn)⌋+2  =  O(Δ2n3.5log⁡nΔ).\operatorname{diam}(P) \le 2\Big\lfloor \sqrt{2\pi}\,\Delta^2 n^{5/2}\ln\!\big(2^n\, n!\, n^{n/2}\,\Delta^n\big)\Big\rfloor + 2 \;=\; O(\Delta^2 n^{3.5}\log n\Delta).diam(P)≤2⌊2π​Δ2n5/2ln(2nn!nn/2Δn)⌋+2=O(Δ2n3.5lognΔ).

No non-degeneracy, full-dimensionality or rank condition is assumed, and the bound is uniform in mmm and bbb.

Milestones

  1. Lemma 3 (p. 108): for a vertex vvv of a non-degenerate polytope, D(Sv)≤Δ2n3 vol(Sv)D(S_v) \le \Delta^2 n^3\,\mathrm{vol}(S_v)D(Sv​)≤Δ2n3vol(Sv​), where Sv=Cv∩BnS_v = C_v \cap B_nSv​=Cv​∩Bn​.
  2. Lemma 4 (p. 109): among spherical cones of a given volume, a cone of revolution has minimum dockable surface.
  3. Lemma 5 (p. 110): for a cone of revolution, D(S)≥2n/π vol(S)D(S) \ge \sqrt{2n/\pi}\,\mathrm{vol}(S)D(S)≥2n/π​vol(S).
  4. Lemma 6 (p. 111): for every measurable spherical cone with vol(S)≤12vol(Bn)\mathrm{vol}(S) \le \frac12 \mathrm{vol}(B_n)vol(S)≤21​vol(Bn​), D(S)≥2n/π vol(S)D(S) \ge \sqrt{2n/\pi}\,\mathrm{vol}(S)D(S)≥2n/π​vol(S).
  5. Lemma 1 (p. 105): for a non-degenerate polytope and I⊆VI \subseteq VI⊆V with vol(I)≤12vol(Bn)\mathrm{vol}(I) \le \frac12\mathrm{vol}(B_n)vol(I)≤21​vol(Bn​),
vol(N(I))≥2π 1Δ2n2.5 vol(I).\mathrm{vol}(\mathcal N(I)) \ge \sqrt{\tfrac{2}{\pi}}\,\frac{1}{\Delta^2 n^{2.5}}\,\mathrm{vol}(I).vol(N(I))≥π2​​Δ2n2.51​vol(I).
  1. Eq. (1) (p. 105): if IjI_jIj​ is the set of vertices at graph distance at most jjj from a vertex vvv and vol(Ij)≤12vol(Bn)\mathrm{vol}(I_j) \le \frac12\mathrm{vol}(B_n)vol(Ij​)≤21​vol(Bn​), then j≤2π Δ2n2.5ln⁡(2n/vol(I0))j \le \sqrt{2\pi}\,\Delta^2 n^{2.5}\ln(2^n/\mathrm{vol}(I_0))j≤2π​Δ2n2.5ln(2n/vol(I0​)).

Significance

The result. Theorem 2 bounds the diameter of every integral polytope by a polynomial in the dimension and the largest sub-determinant, independently of the number of facets. For totally unimodular matrices, which cover network-flow, bipartite matching and transportation polytopes, it gives O(n3.5log⁡n)O(n^{3.5}\log n)O(n3.5logn), improving the Dyer–Frieze bound by a large polynomial factor. It shows that the obstruction to a polynomial Hirsch bound, if any, must come from matrices with large sub-determinants. The volume-expansion method — measuring breadth-first search by the volume of the normal fan it has covered — was later refined, for instance in the shadow-vertex analysis of Dadush–Hähnle, which improves the dependence on nnn.

Formalizing it. The theorem is proved (2012/2014); no machine-checked proof is known. A formal development needs, on top of Mathlib, the normal fan of a polytope and its relation to the vertex-edge graph, a Hausdorff-measure calculus for cones (surface of a cone in terms of its base), Lévy's isoperimetric inequality on the sphere in a measure-theoretic form, and explicit Gamma-function estimates. Each of these is reusable well beyond this paper.

Difficulty

The combinatorial side is short; the geometry is not. Lemma 4 is the spherical isoperimetric inequality of Lévy, which Mathlib does not have in any form, and which the paper cites rather than proves; the relations between the volume of a spherical cone, the area of its base, its lateral surface and the length of the base's boundary (Eq. (3), "basic integration") are also absent. Lemma 3 depends on the structure of the normal cone of a vertex of a non-degenerate polytope (full-dimensional, simplicial, generated by rows of AAA), none of which is available for Mathlib's extreme points. Lemma 1 depends on the normal fan of a polytope: the normal cones have pairwise disjoint interiors, cover Rn\mathbb{R}^nRn, and share a facet exactly when their vertices are adjacent. The step from non-degenerate to arbitrary polytopes perturbs bbb and needs the diameter not to decrease, a statement about the vertex-edge graph under perturbation. A shortcut through a finite graph abstraction is not available: the constant depends on the geometry of the normal cones, not only on the graph.

Formalization scope

The polyhedron is Hirsch.Hpoly (rowVec A) b, with rowVec A i the iii-th row of A∈A \inA∈ Matrix (Fin m) (Fin n) ℤ as a vector of EuclideanSpace ℝ (Fin n). Vertices are Set.extremePoints ℝ P, adjacency is Hirsch.Adj, "diameter at most BBB" is Hirsch.DiamLE P B, all from the published Hirsch_model. The normal cone is the published FirstOrderOpt.ConvexTheory.normalCone. Volumes are Lebesgue measure with values in [0,∞][0,\infty][0,∞]; the dockable surface uses μHE[n-1], the Hausdorff measure normalized to agree with Lebesgue measure on hyperplanes, applied to frontier S ∩ Metric.ball 0 1. Δ\DeltaΔ is a natural number and the sub-determinant bound ranges over all sizes k≥1k \ge 1k≥1.

Explicit constants. The paper writes O(Δ2n3.5log⁡nΔ)O(\Delta^2 n^{3.5}\log n\Delta)O(Δ2n3.5lognΔ) in Theorem 2; the proof on pp. 105–106 yields 2⌊K⌋+22\lfloor K\rfloor + 22⌊K⌋+2 with K=2π Δ2n5/2ln⁡(2nn! nn/2Δn)K = \sqrt{2\pi}\,\Delta^2 n^{5/2}\ln(2^n n!\, n^{n/2}\Delta^n)K=2π​Δ2n5/2ln(2nn!nn/2Δn), from Eq. (1), the bound vol(I0)≥1/(n! nn/2Δn)\mathrm{vol}(I_0) \ge 1/(n!\,n^{n/2}\Delta^n)vol(I0​)≥1/(n!nn/2Δn) and the fact that the diameter is at most twice the number of breadth-first-search iterations needed to cover more than half of BnB_nBn​. This explicit bound is the goal. The ratios D/volD/\mathrm{vol}D/vol of Lemmas 3, 5, 6 are stated in multiplicative form.

Non-degeneracy is a hypothesis of Lemma 3, Lemma 1 and Eq. (1) only, as in the paper's §1.1, and never of Theorem 2. The neighbourhood N(I)\mathcal N(I)N(I) excludes III; including it would make Lemma 1 trivial, since its constant is below 111. Lemma 4 is stated against every competitor: for every measurable spherical cone SSS and every cone of revolution S∗S^*S∗ of the same volume, D(S∗)≤D(S)D(S^*) \le D(S)D(S∗)≤D(S); it does not assert existence of a cone of a prescribed volume. The goal is Theorem 2 about the polytope and its graph, not an abstract statement about set families with a volume-expansion property; integrality of AAA and the bound on minors of every size are both essential (scaling a real matrix down makes Δ\DeltaΔ arbitrarily small), and the raw Hausdorff measure μH[n-1] would put Lemmas 3 and 6 on incompatible scales.

Contributions are welcome at every level: the normal fan and its adjacency structure, cone surface formulas, the Gamma estimate Γ(x+12)/Γ(x)≥x−14\Gamma(x+\frac12)/\Gamma(x) \ge \sqrt{x-\frac14}Γ(x+21​)/Γ(x)≥x−41​​, and a formal Lévy inequality.

Selected references

  • N. Bonifas, M. Di Summa, F. Eisenbrand, N. Hähnle, M. Niemeier, On Sub-determinants and the Diameter of Polyhedra, Discrete Comput Geom 52 (2014) 102–115. https://doi.org/10.1007/s00454-014-9601-x
  • M. Dyer, A. Frieze, Random walks, totally unimodular matrices, and a randomised dual simplex algorithm, Math. Program. 64 (1994) 1–16. https://doi.org/10.1007/BF01582563
  • G. Kalai, D. J. Kleitman, A quasi-polynomial bound for the diameter of graphs of polyhedra, Bull. Amer. Math. Soc. 26 (1992) 315–316. https://doi.org/10.1090/S0273-0979-1992-00285-9
  • F. Santos, A counterexample to the Hirsch conjecture, Annals of Math. 176 (2012) 383–412. https://doi.org/10.4007/annals.2012.176.1.7
  • T. Figiel, J. Lindenstrauss, V. Milman, The dimension of almost spherical sections of convex bodies, Acta Math. 139 (1977) 53–94 (Lévy's isoperimetric inequality, Theorem 2.1). https://doi.org/10.1007/BF02392234
  • D. Dadush, N. Hähnle, On the shadow simplex method for curved polyhedra, Discrete Comput Geom 56 (2016). https://arxiv.org/abs/1412.6705
11 thms2 active usersReviewed
Operations ResearchOptimizationProbability+1·Captain: mikedeng1

An Optimal On-Line Algorithm for Metrical Task System 2: The Randomized Competitive Ratio of the Uniform Task System Lies Between H(n) and 2H(n)Research Paper

Motivation

Metrical task systems, introduced by Borodin, Linial and Saks (J. ACM 39(4), 1992), are a common abstraction of on-line problems in which a server occupies one of finitely many states, pays a cost for each task depending on its current state, and may pay a transition cost to change state first. Paging, list update and the kkk-server problem all fit into this framework. The paper's first main result is that every deterministic on-line algorithm on an nnn-state metrical task system has competitive ratio at least 2n−12n-12n−1, and that 2n−12n-12n−1 is attained. The lower bound comes from an adversary that always charges the state the algorithm currently occupies. That adversary needs to know the algorithm's state, which suggests that randomization can help.

Section 7 of the paper makes this precise for the simplest system, the uniform task system, in which all transitions cost 111. There the randomized competitive ratio against an oblivious adversary is between H(n)H(n)H(n) and 2H(n)2H(n)2H(n), where H(n)=1+12+⋯+1nH(n)=1+\tfrac12+\cdots+\tfrac1nH(n)=1+21​+⋯+n1​ is between ln⁡n\ln nlnn and 1+ln⁡n1+\ln n1+lnn. This was the first logarithmic bound for a task system.

Timeline:

  • 1985: Sleator and Tarjan introduce competitive analysis for list update and paging (CACM 28(2)).
  • 1987/1992: Borodin, Linial and Saks define metrical task systems, prove the deterministic ratio 2n−12n-12n−1, and prove H(n)≤wˉ≤2H(n)H(n)\le\bar w\le 2H(n)H(n)≤wˉ≤2H(n) for the uniform system (conference version STOC 1987; journal version cited above).
  • 1991: Fiat, Karp, Luby, McGeoch, Sleator and Young prove the analogous 2Hk2H_k2Hk​ upper bound for randomized paging (J. Algorithms 12(4)).

Setting

A task system (S,d)(S,d)(S,d) is a finite set SSS of nnn states with a transition-cost matrix ddd: d(i,i)=0d(i,i)=0d(i,i)=0, d(i,j)>0d(i,j)>0d(i,j)>0 for i≠ji\ne ji=j, and d(i,k)≤d(i,j)+d(j,k)d(i,k)\le d(i,j)+d(j,k)d(i,k)≤d(i,j)+d(j,k). In the uniform task system, d(i,j)=1d(i,j)=1d(i,j)=1 for all i≠ji\neq ji=j. A task is a vector T∈R≥0ST\in\mathbb R_{\ge0}^ST∈R≥0S​ of processing costs. Given an initial state s0s_0s0​ and tasks T=T1⋯Tm\mathbf T=T^1\cdots T^mT=T1⋯Tm, a schedule is σ:{0,…,m}→S\sigma:\{0,\dots,m\}\to Sσ:{0,…,m}→S with σ(0)=s0\sigma(0)=s_0σ(0)=s0​, of cost

c(T;σ)=∑i=1md(σ(i−1),σ(i))+∑i=1mTi(σ(i)).c(\mathbf T;\sigma)=\sum_{i=1}^m d(\sigma(i-1),\sigma(i))+\sum_{i=1}^m T^i(\sigma(i)).c(T;σ)=i=1∑m​d(σ(i−1),σ(i))+i=1∑m​Ti(σ(i)).

The off-line optimum c0(T)c_0(\mathbf T)c0​(T) is the least cost over all schedules.

A deterministic on-line algorithm chooses σ(i)\sigma(i)σ(i) from s0s_0s0​ and T1,…,TiT^1,\dots,T^iT1,…,Ti. A randomized on-line algorithm RRR chooses σ(i)\sigma(i)σ(i) at random, with a distribution that depends on s0s_0s0​, on T1,…,TiT^1,\dots,T^iT1,…,Ti and on the states σ(0),…,σ(i−1)\sigma(0),\dots,\sigma(i-1)σ(0),…,σ(i−1) already visited. The task sequence is fixed before any random choice is made (an oblivious adversary). With pr(σ∣T)\mathrm{pr}(\sigma\mid\mathbf T)pr(σ∣T) the probability that RRR follows σ\sigmaσ, the expected cost is cˉR(T)=∑σc(T;σ) pr(σ∣T)\bar c_R(\mathbf T)=\sum_\sigma c(\mathbf T;\sigma)\,\mathrm{pr}(\sigma\mid\mathbf T)cˉR​(T)=∑σ​c(T;σ)pr(σ∣T). For w>0w>0w>0, RRR is expected www-competitive if there is a constant KKK with

cˉR(T)≤w c0(T)+K\bar c_R(\mathbf T)\le w\,c_0(\mathbf T)+KcˉR​(T)≤wc0​(T)+K

for every finite task sequence and every initial state. The randomized competitive ratio wˉ(S,d)\bar w(S,d)wˉ(S,d) is the infimum of all such www over all RRR.

Formalization targets

Goal: Theorem 7.1

For the uniform task system on n≥1n\ge1n≥1 states,

H(n)  ≤  wˉ(S,d)  ≤  2H(n).H(n)\;\le\;\bar w(S,d)\;\le\;2H(n).H(n)≤wˉ(S,d)≤2H(n).

Milestones

  1. Upper bound (p. 759). Some randomized on-line algorithm is expected 2H(n)2H(n)2H(n)-competitive on the uniform task system.
  2. Lemma 7.2 (p. 759). Let DDD be a distribution on infinite task sequences over a finite task alphabet, with E(c0(Tj))→∞E(c_0(\mathbf T^j))\to\inftyE(c0​(Tj))→∞, and let mj=inf⁡AE(cA(Tj))m_j=\inf_A E(c_A(\mathbf T^j))mj​=infA​E(cA​(Tj)) over deterministic on-line algorithms. Then every achievable www satisfies
lim sup⁡j→∞mjE(c0(Tj))≤w.\limsup_{j\to\infty}\frac{m_j}{E(c_0(\mathbf T^j))}\le w .j→∞limsup​E(c0​(Tj))mj​​≤w.
  1. mj≥j/nm_j\ge j/nmj​≥j/n (p. 760) when the tasks are independent uniformly random unit elementary tasks UsU_sUs​ (cost 111 in sss, 000 elsewhere).
  2. Coupon collector (p. 760). For i.i.d. uniform states on SSS, the expected number of draws until every state has appeared is nH(n)nH(n)nH(n).
  3. Off-line cost (p. 760). Under the same distribution, E(c0(Tj))≤j/(nH(n))+CE(c_0(\mathbf T^j))\le j/(nH(n))+CE(c0​(Tj))≤j/(nH(n))+C for a constant CCC independent of jjj.

Significance

The theorem shows that randomization reduces the competitive ratio of the uniform task system from 2n−12n-12n−1 to Θ(log⁡n)\Theta(\log n)Θ(logn). That is an exponential improvement, and it identifies the adversary's knowledge of the algorithm's state as the source of the deterministic lower bound. Lemma 7.2 is a form of Yao's principle adapted to the additive-constant definition of competitiveness. It is the standard tool for randomized lower bounds in on-line computation, and the same argument shape reappears for paging and kkk-server lower bounds.

On the formalization side, the result is proved but, as far as is known, has not been machine-checked. A complete development yields a reusable model of randomized on-line algorithms with oblivious adversaries, a Yao-type lemma usable for other on-line problems, and a coupon-collector expectation in the product-measure setting. The upper half additionally needs the continuous-time reduction of the paper's Lemma 3.1 in randomized form, or a direct discrete-time algorithm.

Difficulty

For the upper bound, the natural algorithm is continuous-time. It proceeds in phases, and inside a phase it stays in a state until that state has accumulated cost 111. A discrete task can saturate several states at once and straddle a phase boundary. So a discrete algorithm must either simulate the continuous one or be analyzed directly, and the expected transition count per phase must be controlled with the first phase starting in a deterministic state.

For the lower bound, the first obstacle is that the natural statement "wˉ≥lim sup⁡mj/E(c0)\bar w\ge\limsup m_j/E(c_0)wˉ≥limsupmj​/E(c0​)" silently assumes that a randomized algorithm's expected cost, averaged over random inputs, is at least that of the best deterministic algorithm. With the behavioural (kernel) definition used here, this requires converting a kernel into a mixture of deterministic algorithms, which is Kuhn's theorem on each finite horizon. The second obstacle is that the paper's claim E(c0(Tj))≤j/(nH(n))+O(1)E(c_0(\mathbf T^j))\le j/(nH(n))+O(1)E(c0​(Tj))≤j/(nH(n))+O(1) is supported only by the elementary renewal theorem, which gives a limit of ratios; the additive bound needs a sharper renewal estimate. Mathlib has no renewal theory. The hypothesis E(c0(Tj))→∞E(c_0(\mathbf T^j))\to\inftyE(c0​(Tj))→∞ of Lemma 7.2 must also be established for the uniform distribution; the paper does not prove it separately.

Formalization scope

  • States form a finite nonempty type S, and nnn = Fintype.card S; no n≥2n\ge2n≥2 assumption is made (at n=1n=1n=1 the goal reads 1≤wˉ≤21\le\bar w\le21≤wˉ≤2, and wˉ=1\bar w=1wˉ=1). H(n)H(n)H(n) is Mathlib's harmonic n, cast to R\mathbb RR. The uniform system has unit transition cost.
  • Tasks are finite and nonnegative. The paper also allows +∞+\infty+∞ entries; these are excluded. Task sequences are Fin m → S → ℝ and schedules are Fin (m+1) → S with σ 0 = s₀. c0c_0c0​ is a finite minimum.
  • A randomized algorithm is a kernel S → List (S → ℝ) → List S → PMF S. This is the paper's scheduler–taskmaster description (p. 758), equivalent to a distribution over deterministic algorithms on every finite task sequence. pr(σ∣T)\mathrm{pr}(\sigma\mid\mathbf T)pr(σ∣T) is the product of kernel probabilities, and cˉR\bar c_RcˉR​ is a finite sum. That pr(⋅∣T)\mathrm{pr}(\cdot\mid\mathbf T)pr(⋅∣T) sums to 111 has been checked locally.
  • wˉ(S,d)\bar w(S,d)wˉ(S,d) is the real sInf of {w:∃R, R expected w-competitive}\{w : \exists R,\ R \text{ expected } w\text{-competitive}\}{w:∃R, R expected w-competitive}. On the empty set this would be 000, so the upper bound is stated as the existence of an expected 2H(n)2H(n)2H(n)-competitive algorithm, and Lemma 7.2 is stated for every achievable www. The goal's lower half forces the set to be nonempty. Statements of the form "wˉ≤c\bar w\le cwˉ≤c" alone are therefore not acceptable substitutes for milestones 1 and 2.
  • Lemma 7.2 is restricted to task sequences over a finite alphabet, with the product σ\sigmaσ-algebra and measurable singletons. This makes every E(cA(Tj))E(c_A(\mathbf T^j))E(cA​(Tj)) a genuine integral for every deterministic AAA, and it covers the paper's application. The lim sup⁡\limsuplimsup of Lemma 7.2 is taken in EReal.
  • The coupon-collector time takes values in [0,∞][0,\infty][0,∞] and its expectation is a lower Lebesgue integral. Milestone 5 renders the paper's O(1)O(1)O(1) as an explicit constant CCC chosen before jjj.

Contributions welcome: proofs of any milestone; a discrete-time randomized phase algorithm; a general Kuhn-type conversion from kernels to mixtures of deterministic algorithms; renewal-theoretic lemmas.

Selected references

  • A. Borodin, N. Linial, M. Saks, An Optimal On-Line Algorithm for Metrical Task System, J. ACM 39(4):745–763, 1992. https://doi.org/10.1145/146585.146588
  • D. D. Sleator, R. E. Tarjan, Amortized Efficiency of List Update and Paging Rules, Commun. ACM 28(2):202–208, 1985. https://doi.org/10.1145/2786.2793
  • A. Fiat, R. M. Karp, M. Luby, L. A. McGeoch, D. D. Sleator, N. E. Young, Competitive Paging Algorithms, J. Algorithms 12(4):685–699, 1991. https://doi.org/10.1016/0196-6774(91)90041-V
  • A. C.-C. Yao, Probabilistic Computations: Toward a Unified Measure of Complexity, FOCS 1977, 222–227. https://doi.org/10.1109/SFCS.1977.24
  • S. M. Ross, Applied Probability Models with Optimization Applications, Holden-Day, 1970 (the elementary renewal theorem cited as [20] in the paper).
9 thms1 active userReviewed
CombinatoricsGraph TheoryLinear Optimization+1·Captain: mikedeng1

On Certain Polytopes Associated with Graphs V: Zero-One Optima of the Odd-Cycle Relaxation on Series-Parallel GraphsResearch Paper

Motivation

The stable set problem asks for a largest set of pairwise non-adjacent vertices in a graph; its size is the stability number α(G)\alpha(G)α(G). It is NP-hard in general, and a standard way to attack it in integer programming is to write down linear inequalities valid for all stable sets and solve the resulting linear program. The weakest such relaxation uses only the edge inequalities xv+xw≤1x_v+x_w\le 1xv​+xw​≤1; its optimum can be as large as ∣V∣/2|V|/2∣V∣/2 on graphs with small α(G)\alpha(G)α(G). Adding, for every odd circuit CCC, the inequality ∑u∈Cxu≤12(∣C∣−1)\sum_{u\in C}x_u\le\frac12(|C|-1)∑u∈C​xu​≤21​(∣C∣−1) gives the odd-cycle relaxation, the first strengthening that cuts off the fractional point x≡12x\equiv\frac12x≡21​ on odd cycles.

Section 7 of V. Chvátal, On certain polytopes associated with graphs (J. Combin. Theory Ser. B 18 (1975) 138–154, doi:10.1016/0095-8956(75)90041-6) identifies a graph class on which this relaxation is exact for the all-ones objective, with an integral certificate on the dual side: the series-parallel networks. The paper conjectures (Conjecture 7.3) that for these graphs the odd-cycle inequalities describe the whole stable set polytope; graphs with that property were later called t-perfect.

Timeline:

  • 1960: G. A. Dirac, in "In abstrakten Graphen vorhandene vollständige 4-Graphen und ihre Unterteilungen" (Math. Nachr. 22), proves that graphs containing no subdivided K4K_4K4​ have at least two vertices of degree at most two.
  • 1975: Chvátal introduces the system (7.1) and proves Theorem 7.1 (this mission): on series-parallel networks, max⁡∑uxu\max\sum_u x_umax∑u​xu​ subject to (7.1) and its dual both have zero–one optima. He conjectures the full polyhedral statement.
  • 1979: M. Boulala and J.-P. Uhry, "Polytope des indépendants d'un graphe série-parallèle" (Discrete Math. 27), prove the conjecture: (7.1) defines the stable set polytope of every series-parallel graph.
  • 1986: A. M. H. Gerards and A. Schrijver, "Matrices with the Edmonds–Johnson property" (Combinatorica 6), extend this to graphs with no odd-K4K_4K4​ subdivision.

Setting

All graphs G=(V,E)G=(V,E)G=(V,E) are finite, undirected and loopless, with no parallel edges. A stable set is a set of vertices no two of which are adjacent. We write d(u)d(u)d(u) for the degree of uuu.

A set C⊆VC\subseteq VC⊆V induces an odd circuit if the induced subgraph G[C]G[C]G[C] is a cycle of length 2k+12k+12k+1 with k≥1k\ge1k≥1; triangles count, and such a cycle has no chords. Z(G)Z(G)Z(G) is the set of all such CCC. The odd-cycle system of GGG is

0≤xu≤1(u∈V),xv+xw≤1(vw∈E),∑u∈Cxu≤12(∣C∣−1)(C∈Z(G)).(7.1)\begin{aligned} 0\le x_u&\le 1 && (u\in V),\\ x_v+x_w&\le 1 && (vw\in E),\\ \textstyle\sum_{u\in C}x_u&\le \tfrac12(|C|-1) && (C\in Z(G)). \end{aligned}\tag{7.1}0≤xu​xv​+xw​∑u∈C​xu​​≤1≤1≤21​(∣C∣−1)​​(u∈V),(vw∈E),(C∈Z(G)).​(7.1)

Its linear programming dual for the objective ∑uxu\sum_u x_u∑u​xu​, with x≥0x\ge0x≥0 read as sign constraints, has variables yu≥0y_u\ge0yu​≥0, ze≥0z_e\ge0ze​≥0, wC≥0w_C\ge0wC​≥0 and reads

min⁡ ∑uyu+∑eze+∑C∈Z(G)12(∣C∣−1) wCs.t.yu+∑e∋uze+∑C∋uwC≥1  (u∈V).\min\ \sum_{u}y_u+\sum_{e}z_e+\sum_{C\in Z(G)}\tfrac12(|C|-1)\,w_C\quad\text{s.t.}\quad y_u+\sum_{e\ni u}z_e+\sum_{C\ni u}w_C\ge 1\ \ (u\in V).min u∑​yu​+e∑​ze​+C∈Z(G)∑​21​(∣C∣−1)wC​s.t.yu​+e∋u∑​ze​+C∋u∑​wC​≥1  (u∈V).

A homeomorph of K4K_4K4​ is a graph obtained from K4K_4K4​ by subdividing its edges into paths through new vertices of degree two. GGG is a series-parallel network if no subgraph of GGG is a homeomorph of K4K_4K4​.

Formalization targets

Goal: Theorem 7.1

For every series-parallel network GGG,

∃ x∈{0,1}V feasible for (7.1):  ∑uxu=max⁡{∑uxu′:x′∈RV satisfies (7.1)},\exists\,x\in\{0,1\}^V\ \text{feasible for (7.1)}:\ \ \sum_u x_u=\max\Big\{\sum_u x'_u : x'\in\mathbb R^V\text{ satisfies (7.1)}\Big\},∃x∈{0,1}V feasible for (7.1):  u∑​xu​=max{u∑​xu′​:x′∈RV satisfies (7.1)},

and there is a zero–one dual feasible (y,z,w)(y,z,w)(y,z,w) whose dual objective equals the minimum over all real dual feasible points. Both optimality claims are against real points. Chvátal's statement has no constants to improve; the formal goal is his theorem as printed.

Milestones

  1. Dirac's theorem (§7, p. 150): a series-parallel network with at least two vertices has two distinct vertices of degree at most two.
  2. Case 4 closure (p. 151): if d(u)=2d(u)=2d(u)=2 and the neighbours v,wv,wv,w of uuu are non-adjacent, deleting uuu and identifying vvv with www yields a series-parallel network.
  3. The combinatorial core (p. 151, (i)–(ii)): there are a stable set SSS and a spanning subgraph F≤GF\le GF≤G whose components are isolated vertices, isolated edges and odd circuits, such that with aaa isolated vertices, bbb isolated edges and ckc_kck​ circuits of length 2k+12k+12k+1,
a+b+∑kk ck=∣S∣.a+b+\sum_k k\,c_k=|S|.a+b+k∑​kck​=∣S∣.

Significance

The result. Theorem 7.1 says that on series-parallel networks the odd-cycle relaxation computes α(G)\alpha(G)α(G) exactly, and that the optimum is certified by a covering of the vertex set by single vertices, edges and chordless odd circuits whose total weight equals ∣S∣|S|∣S∣. This is a min–max theorem of König type for a non-bipartite, non-perfect class: odd cycles of length at least five are series-parallel and not perfect, so the clique inequalities of the perfect-graph theory (mission I of this series) do not suffice here. The statement is the unweighted case of the later polyhedral results of Boulala–Uhry and Gerards–Schrijver, and the combinatorial core (milestone 3) is the basis of a polynomial algorithm for α(G)\alpha(G)α(G) on this class, as the paper remarks.

Formalizing it. The theorem has been proved since 1975; neither Mathlib nor the Prove2Me library contains a formal proof of it. A formal proof needs a working notion of graph subdivision (topological minor), which Mathlib does not have, Dirac's degree theorem, the induction of the paper with its four cases, and the passage from the combinatorial core to a pair of LP optima through weak duality. Each of these is reusable: topological minors and the K4K_4K4​-subdivision-free class appear throughout structural graph theory.

Difficulty

The combinatorial core is proved by induction on ∣V∣|V|∣V∣ removing a vertex of degree at most two, and three of the four cases are routine. The obstacle is Case 4 (d(u)=2d(u)=2d(u)=2, neighbours non-adjacent): deleting uuu alone loses the information needed to recover SSS and FFF, so the proof identifies the two neighbours. That requires the class to be closed under this identification, a statement about subdivisions that is not a local edge count, and a lifting of (S′,F′)(S',F')(S′,F′) from the reduced graph with a case split on the component of F′F'F′ containing the merged vertex. A second gap is between FFF and the dual: an odd-circuit component of FFF may have chords in GGG and so need not lie in Z(G)Z(G)Z(G), and the zero–one dual solution must be extracted from it. Finally, Dirac's theorem itself is the one place where the absence of K4K_4K4​ subdivisions is used positively, and it is not a consequence of a degree-counting argument.

Formalization scope

Graphs are SimpleGraph V on a Fintype V with decidable equality and decidable adjacency. Z(G)Z(G)Z(G) is a Finset (Finset V) whose members induce a subgraph isomorphic to Mathlib's cycleGraph (2k+1), k≥1k\ge1k≥1. The dual variables are indexed by V, by the edge set G.edgeSet, and by the subtype of Z(G)Z(G)Z(G); x≥0x\ge0x≥0 is a sign constraint with no dual variable. "Contains a homeomorph of K4K_4K4​" is encoded by four distinct branch vertices and six paths (Walk.IsPath) that avoid other branch vertices and meet only at common endpoints; it is not the K4K_4K4​-minor notion and not the series–parallel composition notion, whose equivalence with it is not part of the paper.

Conventions and implicit hypotheses made explicit:

  • Dirac's theorem is stated with ∣V∣≥2|V|\ge 2∣V∣≥2; as printed it fails for graphs with fewer than two vertices.
  • In Case 4 the identified graph has vertex set V∖{u,w}V\setminus\{u,w\}V∖{u,w}, with vvv representing v≡wv\equiv wv≡w; parallel edges merge.
  • Optimality in the goal is against every real feasible point of each program. A statement comparing the zero–one points only with other zero–one points would reduce the primal half to α(G)≤α(G)\alpha(G)\le\alpha(G)α(G)≤α(G) and is ruled out.
  • In milestone 3 the sum a+b+∑kkcka+b+\sum_k k c_ka+b+∑k​kck​ is written as a sum over the connected components of FFF of 111 (one or two vertices) or (n−1)/2(n-1)/2(n−1)/2 (n≥3n\ge3n≥3 vertices).

Corollary 7.2 (stated without proof) and Conjecture 7.3 are not part of this mission. Contributions welcome: a general topological-minor library, Dirac's theorem, and a proof of the combinatorial core.

Selected references

  • V. Chvátal, On certain polytopes associated with graphs, J. Combin. Theory Ser. B 18 (1975) 138–154. https://doi.org/10.1016/0095-8956(75)90041-6
  • G. A. Dirac, In abstrakten Graphen vorhandene vollständige 4-Graphen und ihre Unterteilungen, Math. Nachr. 22 (1960) 61–85 (reference [6], Satz 5, of the paper).
  • R. J. Duffin, Topology of series-parallel networks, J. Math. Anal. Appl. 10 (1965) 303–318 (reference [7] of the paper).
  • M. Boulala, J.-P. Uhry, Polytope des indépendants d'un graphe série-parallèle, Discrete Math. 27 (1979) 225–243.
  • A. M. H. Gerards, A. Schrijver, Matrices with the Edmonds–Johnson property, Combinatorica 6 (1986) 365–379.
8 thms2 active usersReviewed
Algorithmic Game TheoryOperations ResearchTopology·Captain: mikedeng1

A Social Equilibrium Existence Theorem: Equilibrium Points Exist When Actions Are Contractible Polyhedra and Constrained Best Responses Are ContractibleResearch Paper

Motivation

Nash's equilibrium existence theorem assumes that each player's set of available strategies is fixed. Many social and economic systems do not work that way: a consumer's budget set depends on prices, which are the choices of another agent, and a firm's feasible production may depend on what other firms do. Gerard Debreu's A Social Equilibrium Existence Theorem (PNAS 38(10), 1952) proves that an equilibrium exists in such a system, called a social system or abstract economy (today also a generalized game). Here each agent's feasible actions depend on the actions of all the others.

Arrow and Debreu used this theorem to prove the existence of a competitive equilibrium (Econometrica 22(3), 1954). It is the standard existence result for generalized Nash equilibrium problems in operations research, where the feasible sets are coupled by shared constraints.

Timeline.

  • 1928: von Neumann proves the minimax theorem for matrix games.
  • 1941: Kakutani proves a fixed-point theorem for convex-valued maps with closed graphs on compact convex sets (Duke Math. J. 8, 1941).
  • 1946: Eilenberg and Montgomery extend fixed-point theory to acyclic-valued maps on acyclic absolute neighbourhood retracts (Amer. J. Math. 68, 1946).
  • 1950: Nash proves the existence of equilibrium points for finite games (PNAS 36, 1950).
  • 1952: Debreu proves the theorem of this mission. He requires contractibility instead of convexity, and his payoffs take values in the completed real line.

Setting

There are finitely many agents ι=1,…,ν\iota=1,\dots,\nuι=1,…,ν. Agent ι\iotaι chooses an action aιa_\iotaaι​ in a set Aι\mathfrak A_\iotaAι​, a subset of a finite-dimensional real space. A profile a=(a1,…,aν)a=(a_1,\dots,a_\nu)a=(a1​,…,aν​) lies in A=A1×⋯×Aν\mathfrak A=\mathfrak A_1\times\cdots\times\mathfrak A_\nuA=A1​×⋯×Aν​. For each agent, aˉι\bar a_\iotaaˉι​ denotes the actions of the others, ranging over Aˉι=∏j≠ιAj\bar{\mathfrak A}_\iota=\prod_{j\ne\iota}\mathfrak A_jAˉι​=∏j=ι​Aj​.

Given aˉι\bar a_\iotaaˉι​, agent ι\iotaι may only choose from a nonempty set Aι(aˉι)⊆AιA_\iota(\bar a_\iota)\subseteq\mathfrak A_\iotaAι​(aˉι​)⊆Aι​, a multi-valued function of the others' actions. Its graph is Gι={(aˉι,aι)∣aι∈Aι(aˉι)}G_\iota=\{(\bar a_\iota,a_\iota)\mid a_\iota\in A_\iota(\bar a_\iota)\}Gι​={(aˉι​,aι​)∣aι​∈Aι​(aˉι​)}. The payoff fι(aˉι,aι)f_\iota(\bar a_\iota,a_\iota)fι​(aˉι​,aι​) takes values in the completed real line R‾=R∪{−∞,+∞}\overline{\mathbb R}=\mathbb R\cup\{-\infty,+\infty\}R=R∪{−∞,+∞}. The best value available to agent ι\iotaι and the set of constrained best responses are

φι(aˉι)=max⁡aι∈Aι(aˉι)fι(aˉι,aι),Maˉι={aι∈Aι(aˉι)∣fι(aˉι,aι)=φι(aˉι)}.\varphi_\iota(\bar a_\iota)=\max_{a_\iota\in A_\iota(\bar a_\iota)}f_\iota(\bar a_\iota,a_\iota),\qquad M_{\bar a_\iota}=\{a_\iota\in A_\iota(\bar a_\iota)\mid f_\iota(\bar a_\iota,a_\iota)=\varphi_\iota(\bar a_\iota)\}.φι​(aˉι​)=aι​∈Aι​(aˉι​)max​fι​(aˉι​,aι​),Maˉι​​={aι​∈Aι​(aˉι​)∣fι​(aˉι​,aι​)=φι​(aˉι​)}.

An equilibrium point is a profile a∗a^*a∗ such that, for every ι\iotaι, aι∗∈Aι(aˉι∗)a^*_\iota\in A_\iota(\bar a^*_\iota)aι∗​∈Aι​(aˉι∗​) and fι(a∗)=φι(aˉι∗)f_\iota(a^*)=\varphi_\iota(\bar a^*_\iota)fι​(a∗)=φι​(aˉι∗​).

The topological vocabulary is Debreu's §1:

  • a convex cell is the convex hull of finitely many points;
  • a geometric polyhedron is a finite union of convex cells;
  • a polyhedron is a set homeomorphic to a geometric polyhedron;
  • a nonempty set ZZZ is contractible if there is a continuous H:[0,1]×Z→ZH:[0,1]\times Z\to ZH:[0,1]×Z→Z with H(0,z)=zH(0,z)=zH(0,z)=z and H(1,z)=z0H(1,z)=z^0H(1,z)=z0 for a fixed z0∈Zz^0\in Zz0∈Z.

A multi-valued function is semicontinuous if its graph is closed.

Formalization targets

Goal: the THEOREM (p. 888)

Assume that for every ι\iotaι, Aι\mathfrak A_\iotaAι​ is a contractible polyhedron, GιG_\iotaGι​ is closed, fιf_\iotafι​ is continuous on GιG_\iotaGι​, φι\varphi_\iotaφι​ is continuous on Aˉι\bar{\mathfrak A}_\iotaAˉι​, and MaˉιM_{\bar a_\iota}Maˉι​​ is contractible for every aˉι\bar a_\iotaaˉι​. Then

∃ a∗∈A  ∀ι:aι∗∈Aι(aˉι∗)  and  fι(aˉι∗,b)≤fι(a∗)  for all b∈Aι(aˉι∗).\exists\,a^*\in\mathfrak A\ \ \forall\iota:\quad a^*_\iota\in A_\iota(\bar a^*_\iota)\ \text{ and }\ f_\iota(\bar a^*_\iota,b)\le f_\iota(a^*)\ \text{ for all } b\in A_\iota(\bar a^*_\iota).∃a∗∈A  ∀ι:aι∗​∈Aι​(aˉι∗​)  and  fι​(aˉι∗​,b)≤fι​(a∗)  for all b∈Aι​(aˉι∗​).

Milestones on the path of the proof

  1. §1: products of two convex cells, of two geometric polyhedra, of two polyhedra and of two contractible sets are of the same kind.
  2. A\mathfrak AA is a contractible polyhedron, and ϕ(a)=Maˉ1×⋯×Maˉν\phi(a)=M_{\bar a_1}\times\cdots\times M_{\bar a_\nu}ϕ(a)=Maˉ1​​×⋯×Maˉν​​ is contractible for every aaa.
  3. The LEMMA (p. 889): a semicontinuous multi-valued function ϕ:Z→Z\phi:Z\to Zϕ:Z→Z on a contractible polyhedron with contractible values has a fixed point z∗∈ϕ(z∗)z^*\in\phi(z^*)z∗∈ϕ(z∗).
  4. The set Mι={(aˉι,aι)∣aι∈Maˉι}M_\iota=\{(\bar a_\iota,a_\iota)\mid a_\iota\in M_{\bar a_\iota}\}Mι​={(aˉι​,aι​)∣aι​∈Maˉι​​} is closed, and so is the graph Γ\GammaΓ of ϕ\phiϕ.
  5. a∗∈ϕ(a∗)a^*\in\phi(a^*)a∗∈ϕ(a∗) holds exactly when a∗a^*a∗ is an equilibrium point.

Further results of the paper

  • The Remark (p. 889) and its steps (α) and (β) (p. 890). If GιG_\iotaGι​ is compact and fιf_\iotafι​ is continuous on it, then φι\varphi_\iotaφι​ is upper semicontinuous. If AιA_\iotaAι​ is moreover continuous at a point, φι\varphi_\iotaφι​ is lower semicontinuous, and hence continuous, there.
  • The COROLLARY (p. 890). A continuous f:X×Y→R‾f:X\times Y\to\overline{\mathbb R}f:X×Y→R on contractible polyhedra whose argmin sets Ux0U_{x^0}Ux0​ and argmax sets Vy0V_{y^0}Vy0​ are contractible has a saddle point, min⁡yf(x0,y)=f(x0,y0)=max⁡xf(x,y0)\min_y f(x^0,y)=f(x^0,y^0)=\max_x f(x,y^0)miny​f(x0,y)=f(x0,y0)=maxx​f(x,y0).

Significance

The result. The theorem gives an equilibrium for games in which one agent's choices constrain another's. This is the step that makes competitive equilibrium an equilibrium of a game: the market participant's price choice constrains the consumers' budget sets. The same result gives existence for generalized Nash equilibrium problems, including games with shared constraints. Replacing convexity by contractibility also admits non-convex best-response sets: a contractible set such as a star-shaped region or an arc qualifies. Nash's theorem for finite games and von Neumann's minimax theorem are special cases. With values in R‾\overline{\mathbb R}R, payoffs may take infinite values.

The formalization. The theorem was proved in 1952. None of it is formalized on the platform: neither the theorem itself, nor the LEMMA, nor the topological vocabulary of polyhedra and contractible sets used here. Brouwer's theorem is available on the platform as AGT.brouwer_fixed_point. Nash's existence theorem for finite games (AGT.nash_existence) and Sion's minimax theorem are also formalized. All of these assume convexity. The mission produces a machine-checked existence theorem for generalized games, together with a fixed-point theorem for set-valued maps with contractible values on polyhedra.

Difficulty

Most of the argument reduces to the LEMMA, which is a particular case of the Eilenberg–Montgomery fixed-point theorem. The usual route to Kakutani's theorem does not carry over: it approximates a convex-valued map by continuous selections and applies Brouwer's theorem on a convex set. Contractible values do not admit convex combinations of nearby values, and a contractible polyhedron need not be convex, so neither the selection step nor Brouwer on a simplex applies directly. Debreu cites the LEMMA without proof, and Mathlib has no fixed-point theorem for set-valued maps and none of the algebraic topology of polyhedra that the classical results rest on.

The remaining steps are point-set topology. The product milestones require building homeomorphisms and deformations on products of subspaces, and the closed-graph steps require care with continuity on GιG_\iotaGι​ as opposed to continuity everywhere.

Formalization scope

  • Spaces and agents. Each Aι\mathfrak A_\iotaAι​ is a subset of a finite-dimensional real normed space EιE_\iotaEι​, standing in for Debreu's "finite Euclidean spaces". The agents form a Fintype. Profiles live in ∏ιAι\prod_\iota\mathfrak A_\iota∏ι​Aι​. The others' actions aˉι\bar a_\iotaaˉι​ range over the product over the subtype {j∣j≠ι}\{j\mid j\ne\iota\}{j∣j=ι}, so AιA_\iotaAι​ cannot depend on agent ι\iotaι's own action. With a single agent this product is a point, and the theorem becomes the one-agent statement.
  • Payoffs. The completed real line is Mathlib's EReal with its order topology. φι\varphi_\iotaφι​ is a supremum (sSup) in EReal; under the hypotheses it is attained, so it is Debreu's Max. No arithmetic in EReal is used anywhere.
  • Polyhedra and contractible sets. A polyhedron is a subspace homeomorphic to a finite union of convex hulls of nonempty finite sets in some Rm\mathbb R^mRm; polyhedra are therefore compact. Contractibility is Debreu's definition verbatim, and it includes nonemptiness.
  • Hypotheses. Non-void values of AιA_\iotaAι​ are Debreu's standing assumption and are stated explicitly. Continuity of fιf_\iotafι​ is required on GιG_\iotaGι​ only, and continuity of φι\varphi_\iotaφι​ on all of Aˉι\bar{\mathfrak A}_\iotaAˉι​.

Three formalizations would be easier but are not this theorem: one that replaces contractible by convex (that is the Kakutani–Nash setting), one that maximizes over all of Aι\mathfrak A_\iotaAι​ instead of Aι(aˉι)A_\iota(\bar a_\iota)Aι​(aˉι​), and one that assumes a fixed point of ϕ\phiϕ or states only the closed-graph step. None of these is acceptable, and the LEMMA may not be weakened to convex domains or convex values.

The work needed includes a small library of polyhedra and contractible subsets, and closed-graph correspondences on products. The largest piece is a proof of the LEMMA, a fixed-point theorem that is reusable well beyond this mission. Proofs of any milestone, alternative routes to the LEMMA, and supporting lemmas on polyhedra, such as compactness, triangulation or being absolute neighbourhood retracts, are all welcome.

Selected references

  • G. Debreu, A Social Equilibrium Existence Theorem, Proc. Natl. Acad. Sci. USA 38(10), 886–893, 1952. https://doi.org/10.1073/pnas.38.10.886
  • S. Eilenberg and D. Montgomery, Fixed Point Theorems for Multi-Valued Transformations, Amer. J. Math. 68(2), 214–222, 1946. https://doi.org/10.2307/2371832
  • E. G. Begle, A Fixed Point Theorem, Ann. of Math. 51(3), 544–550, 1950. https://doi.org/10.2307/1969367
  • S. Kakutani, A Generalization of Brouwer's Fixed Point Theorem, Duke Math. J. 8(3), 457–459, 1941. https://doi.org/10.1215/S0012-7094-41-00838-4
  • J. F. Nash, Equilibrium Points in N-Person Games, Proc. Natl. Acad. Sci. USA 36(1), 48–49, 1950. https://doi.org/10.1073/pnas.36.1.48
  • K. J. Arrow and G. Debreu, Existence of an Equilibrium for a Competitive Economy, Econometrica 22(3), 265–290, 1954. https://doi.org/10.2307/1907353
19 thms3 active usersReviewed
CombinatoricsGraph TheoryLinear Optimization+1·Captain: mikedeng1

Optimum Branchings: The Vertices of the Branching Polyhedron Are Exactly the BranchingsResearch Paper

Motivation

A branching in a directed graph is a set of edges that contains no cycle (even ignoring directions) and in which no two edges point to the same node; a connected branching is an arborescence, a tree rooted at one node with all edges directed away from the root. The optimum branching problem asks, for real weights on the edges, for a branching of maximum total weight. It contains the minimum-cost spanning arborescence problem (the directed analogue of the minimum spanning tree), which appears in network design, in the analysis of broadcast and routing structures, in phylogenetics, and in dependency parsing in computational linguistics, where maximum spanning arborescences are the standard decoding step of graph-based parsers.

J. Edmonds solved the problem in Optimum branchings (J. Res. Nat. Bur. Standards 71B (1967) 233–240). The paper gives an algorithm (the shrinking algorithm usually attributed to Chu–Liu and Edmonds) and, proved together with it, a polyhedral theorem: the linear system that every branching obviously satisfies has no other vertices. This was one of the first integral polyhedron theorems beyond bipartite matching and network flows, and together with Edmonds' matching polytope (1965) it set the pattern of polyhedral combinatorics: describe the convex hull of the combinatorial objects by linear inequalities, and prove optimality by a linear programming dual.

Timeline:

  • 1965: Y. J. Chu and T. H. Liu describe the shrinking algorithm for the maximum arborescence.
  • 1965: Edmonds, Paths, trees, and flowers and Maximum matching and a polyhedron with 0,1-vertices: the matching polytope.
  • 1967: Edmonds, Optimum branchings: the algorithm, Theorem 2 (vertices of the branching polyhedron), and the dual certificate built along the algorithm.
  • 1970–1971: Edmonds' matroid intersection theorem, which contains the branching polyhedron theorem as the intersection of a graphic matroid and a partition matroid.
  • 1977–1986: faster implementations (Tarjan; Gabow, Galil, Spencer and Tarjan).

Setting

A graph GGG consists of a finite set VVV of nodes and a finite set EEE of edges. Each edge eee is directed toward a node front(e)\mathrm{front}(e)front(e), its front end, and away from a different node rear(e)\mathrm{rear}(e)rear(e), its rear end. Parallel edges are allowed; loops are not.

For F⊆EF\subseteq EF⊆E, a node vvv meets kkk edges of FFF if #{e∈F:front(e)=v}+#{e∈F:rear(e)=v}=k\#\{e\in F:\mathrm{front}(e)=v\}+\#\{e\in F:\mathrm{rear}(e)=v\}=k#{e∈F:front(e)=v}+#{e∈F:rear(e)=v}=k. A set B⊆EB\subseteq EB⊆E is a forest if it contains no polygon, i.e. no nonempty F⊆BF\subseteq BF⊆B in which every node meets zero or two edges of FFF; it is a branching if in addition distinct edges of BBB have distinct front ends. The incidence vector xB∈REx^B\in\mathbb R^ExB∈RE of BBB has xeB=1x^B_e=1xeB​=1 for e∈Be\in Be∈B and 000 otherwise.

The branching polyhedron PG⊆REP_G\subseteq\mathbb R^EPG​⊆RE is the set of xxx with

  • (L1)(L_1)(L1​) xe≥0x_e\ge0xe​≥0 for every edge eee;
  • (L2)(L_2)(L2​) ∑e: front(e)=vxe≤1\sum_{e:\,\mathrm{front}(e)=v}x_e\le1∑e:front(e)=v​xe​≤1 for every node vvv;
  • (L3)(L_3)(L3​) ∑e: front(e),rear(e)∈Sxe≤∣S∣−1\sum_{e:\,\mathrm{front}(e),\mathrm{rear}(e)\in S}x_e\le|S|-1∑e:front(e),rear(e)∈S​xe​≤∣S∣−1 for every set SSS of two or more nodes.

A vertex of a set P⊆REP\subseteq\mathbb R^EP⊆RE is a point of PPP that is the unique maximizer over PPP of some linear function x↦∑ecexex\mapsto\sum_e c_ex_ex↦∑e​ce​xe​.

For weights c∈REc\in\mathbb R^Ec∈RE, the dual variables are yhy_hyh​ for each node vhv_hvh​ and ySy_SyS​ for each SSS with ∣S∣≥2|S|\ge2∣S∣≥2; write we=∑S∋front(e),rear(e)ySw_e=\sum_{S\ni\mathrm{front}(e),\mathrm{rear}(e)}y_Swe​=∑S∋front(e),rear(e)​yS​ and (b,y)=∑hyh+∑S(∣S∣−1)yS(b,y)=\sum_hy_h+\sum_S(|S|-1)y_S(b,y)=∑h​yh​+∑S​(∣S∣−1)yS​. Edmonds' conditions are (15) yh≥0y_h\ge0yh​≥0, (16) yS≥0y_S\ge0yS​≥0, (17) yfront(e)+we≥cey_{\mathrm{front}(e)}+w_e\ge c_eyfront(e)​+we​≥ce​ for every edge, and, for a branching BBB, (18) yh≠0⇒y_h\ne0\Rightarrowyh​=0⇒ some edge of BBB enters vhv_hvh​, (19) yS≠0⇒y_S\ne0\RightarrowyS​=0⇒ exactly ∣S∣−1|S|-1∣S∣−1 edges of BBB lie inside SSS, (20) yfront(e)+we=cey_{\mathrm{front}(e)}+w_e=c_eyfront(e)​+we​=ce​ for e∈Be\in Be∈B.

Formalization targets

Goal: Theorem 2 (p. 235)

{x: x is a vertex of PG}  =  {xB: B is a branching of G}.\{x:\ x\text{ is a vertex of }P_G\}\;=\;\{x^B:\ B\text{ is a branching of }G\}.{x: x is a vertex of PG​}={xB: B is a branching of G}.

Both inclusions, for every finite loopless directed multigraph.

Milestones

  1. §5, p. 236: for every branching BBB, xB∈PGx^B\in P_GxB∈PG​.
  2. §5, p. 236: for every branching BBB, xBx^BxB is a vertex of PGP_GPG​.
  3. §6, (12)–(14): if BBB is a branching and yyy satisfies (15)–(20), then (c,xB)=(b,y)(c,x^B)=(b,y)(c,xB)=(b,y), xBx^BxB maximizes (c,x)(c,x)(c,x) over PGP_GPG​, and yyy minimizes (b,y)(b,y)(b,y) subject to (15)–(17).
  4. §7, p. 237: for every c∈REc\in\mathbb R^Ec∈RE there are a branching BBB and a yyy satisfying (15)–(20).
  5. Lemma 1, p. 236: for every c∈REc\in\mathbb R^Ec∈RE some branching vector lies in PGP_GPG​ and maximizes ∑ecexe\sum_ec_ex_e∑e​ce​xe​ over PGP_GPG​.

Significance

Theorem 2 says that the linear program max⁡{(c,x):x∈PG}\max\{(c,x):x\in P_G\}max{(c,x):x∈PG​} always has an optimal solution that is a branching, and that every vertex of PGP_GPG​ is one. Consequently optimum branchings, and after the reductions of the paper's §2 optimum spanning and rooted arborescences, can be computed by linear programming, and their optimality is certified by a dual vector satisfying (15)–(20). The same statement underlies the separation-based treatment of arborescence constraints in integer programming formulations of network design and of the asymmetric travelling salesman problem. The integrality of the dual for integer weights (the paper's §8) yields min–max theorems of König type for branchings.

The result is proved and classical; no machine-checked proof of it in a proof assistant is known. The mission asks for the paper's own proof chain: branching vectors are points and vertices of PGP_GPG​, linear programming optimality from complementary slackness, existence of a dual certificate for every weight vector, and the deduction of Theorem 2. Proofs through matroid intersection or total dual integrality would also establish the goal and are welcome as alternative routes.

Difficulty

The inclusion "branching vectors are vertices" and the certificate criterion are short. The substance is Milestone 4: for arbitrary real weights, a branching and a dual vector satisfying the complementary slackness conditions must exist simultaneously. Finiteness gives an optimum branching at once, but that says nothing about optimality over the fractional points of PGP_GPG​; the difficulty is the dual. The natural attempt, taking yS=0y_S=0yS​=0 for all sets and yhy_hyh​ the largest positive weight entering vhv_hvh​, violates (20) as soon as the greedy choice closes a circuit: the (L3)(L_3)(L3​) duals of nested node sets, arising from repeatedly shrinking circuits, are needed, and they must be kept nonnegative through weight changes of the form c3+c0−c4c_3+c_0-c_4c3​+c0​−c4​ on edges entering a shrunk circuit.

Formalization scope

A graph is a structure Graph V E with front rear : E → V and a proof that front e ≠ rear e; V and E carry Fintype and DecidableEq. Edge sets are Finset E; vectors are E → ℝ; the linear function with weights c is ∑ e, c e * x e. A branching is defined combinatorially (no nonempty edge subset in which every node meets zero or two edges, and distinct front ends), never by counting edges inside node sets, and PGP_GPG​ is the solution set of (L1)(L_1)(L1​)–(L3)(L_3)(L3​), never a convex hull; either shortcut would make half of Theorem 2 true by definition. A vertex is a unique maximizer of a linear function, as on p. 236 (Mathlib's Set.exposedPoints has the same content); the set variables of the dual are a function Finset V → ℝ whose values on sets of fewer than two nodes are ignored. The right side of (L3)(L_3)(L3​) is the real number ∣S∣−1|S|-1∣S∣−1.

Implicit conventions made explicit: the no-loop condition is part of the graph (with a loop eee, the vector of {e}\{e\}{e} is a vertex of PGP_GPG​ but not a branching); parallel edges are allowed; weights have arbitrary sign and the empty branching is allowed. The mission does not model the algorithm of §4 or Theorem 1's notion of a "good" algorithm; Milestone 4 states only the existence of a certificate, which is what Lemma 1 uses.

Useful reusable infrastructure: finite directed multigraphs with an edge type, forests via polygons, and a finite LP duality lemma for max⁡{c⊤x:x≥0, Ax≤b}\max\{c^\top x: x\ge0,\ Ax\le b\}max{c⊤x:x≥0, Ax≤b}; contributions of either are welcome.

Selected references

  • J. Edmonds, Optimum branchings, J. Res. Nat. Bur. Standards Sect. B 71B (1967), 233–240. https://doi.org/10.6028/jres.071b.032
  • Y. J. Chu and T. H. Liu, On the shortest arborescence of a directed graph, Scientia Sinica 14 (1965), 1396–1400.
  • J. Edmonds, Maximum matching and a polyhedron with 0,1-vertices, J. Res. Nat. Bur. Standards 69B (1965), 125–130. https://doi.org/10.6028/jres.069B.013
  • R. E. Tarjan, Finding optimum branchings, Networks 7 (1977), 25–35. https://doi.org/10.1002/net.3230070103
  • H. N. Gabow, Z. Galil, T. Spencer and R. E. Tarjan, Efficient algorithms for finding minimum spanning trees in undirected and directed graphs, Combinatorica 6 (1986), 109–122. https://doi.org/10.1007/BF02579168
  • A. Schrijver, Combinatorial Optimization: Polyhedra and Efficiency, Springer (2003), Chapter 52.
9 thms2 active usersReviewed
Dynamic ProgrammingOperations ResearchProbability+1·Captain: mikedeng1

On the optimality equation for average cost Markov decision processes and its validity for inventory control: The Average-Cost Optimality Equation for Setup-Cost Inventory ControlResearch Paper

Motivation

Average-cost criteria are standard in inventory, queueing and maintenance models that run indefinitely. For a Markov decision process (MDP), the central object is the average-cost optimality equation (ACOE). It couples a constant www (the optimal long-run cost per period) with a relative value function u~\tilde uu~. A stationary policy that attains the minimum in the ACOE is average-cost optimal. When the state space is uncountable, the one-step cost is unbounded and the transition probability is only weakly continuous, the ACOE is not automatically available.

Feinberg, Kasyanov and Zadoianchuk (2012) proved that under their Assumptions W* and B the weaker average-cost optimality inequality (ACOI) holds. For setwise continuous transition probabilities, Hernández-Lerma and Lasserre (1996, Theorem 5.5.4) gave conditions for the ACOE via equicontinuity. Feinberg and Lewis (2015) established the ACOI and optimality of (s,S)(s,S)(s,S) policies for periodic-review inventory control with setup costs and general demand. Feinberg and Liang (2022, online 2017) extended the equicontinuity condition to weakly continuous transitions and used it to show that the inventory problem satisfies the full equation, not just the inequality.

Setting

An MDP has a state space X\mathbb XX and an action space A\mathbb AA (Borel subsets of Polish spaces). It has a one-step cost c:X×A→R∪{+∞}c:\mathbb X\times\mathbb A\to\mathbb R\cup\{+\infty\}c:X×A→R∪{+∞}, bounded below, and a transition probability q(dy∣x,a)q(dy\mid x,a)q(dy∣x,a). A policy chooses actions from the observed history, possibly at random. A stationary policy is a measurable map ϕ:X→A\phi:\mathbb X\to\mathbb Aϕ:X→A. For a discount factor α∈[0,1)\alpha\in[0,1)α∈[0,1):

  • vα(x)v_\alpha(x)vα​(x) is the infimum over all policies of the expected total discounted cost from xxx;
  • mα=inf⁡xvα(x)m_\alpha=\inf_x v_\alpha(x)mα​=infx​vα​(x);
  • uα=vα−mαu_\alpha=v_\alpha-m_\alphauα​=vα​−mα​ is the discounted relative value function.

The average cost of a policy is wπ(x)=lim sup⁡N1NExπ∑t<Nc(xt,at)w^\pi(x)=\limsup_N \frac1N\mathbb E^\pi_x\sum_{t<N}c(x_t,a_t)wπ(x)=limsupN​N1​Exπ​∑t<N​c(xt​,at​), and w(x)=inf⁡πwπ(x)w(x)=\inf_\pi w^\pi(x)w(x)=infπ​wπ(x). Set w‾=lim inf⁡α↑1(1−α)mα\underline w=\liminf_{\alpha\uparrow1}(1-\alpha)m_\alphaw​=liminfα↑1​(1−α)mα​. For a sequence αn↑1\alpha_n\uparrow1αn​↑1, define

u~(x)=lim inf⁡n→∞, y→xuαn(y).\tilde u(x)=\liminf_{n\to\infty,\ y\to x}u_{\alpha_n}(y).u~(x)=n→∞, y→xliminf​uαn​​(y).

Assumption EC for {αn}\{\alpha_n\}{αn​} has two parts:

  1. the family {uαn}\{u_{\alpha_n}\}{uαn​​} is equicontinuous;
  2. some measurable U≥uαnU\ge u_{\alpha_n}U≥uαn​​ has ∫U dq(⋅∣x,a)<∞\int U\,dq(\cdot\mid x,a)<\infty∫Udq(⋅∣x,a)<∞ for all x,ax,ax,a.

The inventory problem has inventory level x∈Rx\in\mathbb Rx∈R (negative means backlog) and order quantity a≥0a\ge0a≥0. Inventory evolves by xt+1=xt+at−Dt+1x_{t+1}=x_t+a_t-D_{t+1}xt+1​=xt​+at​−Dt+1​, with i.i.d. nonnegative demands DDD. The cost is

c(x,a)=K I{a>0}+cˉ a+E[h(x+a−D)],c(x,a)=K\,I_{\{a>0\}}+\bar c\,a+\mathbb E[h(x+a-D)],c(x,a)=KI{a>0}​+cˉa+E[h(x+a−D)],

with setup cost K≥0K\ge0K≥0, unit cost cˉ>0\bar c>0cˉ>0, and convex hhh with h(x)→∞h(x)\to\inftyh(x)→∞ as ∣x∣→∞|x|\to\infty∣x∣→∞. Let α∗=1+lim⁡x→−∞h(x)/(cˉx)\alpha^*=1+\lim_{x\to-\infty}h(x)/(\bar cx)α∗=1+limx→−∞​h(x)/(cˉx) and H(x)=cˉx+E[h(x−D)]+E[u~(x−D)]H(x)=\bar cx+\mathbb E[h(x-D)]+\mathbb E[\tilde u(x-D)]H(x)=cˉx+E[h(x−D)]+E[u~(x−D)]. A function fff is KKK-convex if f((1−λ)x+λy)≤(1−λ)f(x)+λf(y)+λKf((1-\lambda)x+\lambda y)\le(1-\lambda)f(x)+\lambda f(y)+\lambda Kf((1−λ)x+λy)≤(1−λ)f(x)+λf(y)+λK for x≤yx\le yx≤y and λ∈(0,1)\lambda\in(0,1)λ∈(0,1). An (s,S)(s,S)(s,S) policy orders up to SSS whenever the inventory is below sss.

Formalization targets

Goal: Theorem 4.5

For every sequence of nonnegative discount factors αn↑1\alpha_n\uparrow1αn​↑1 with α1>α∗\alpha_1>\alpha^*α1​>α∗, the inventory MDP satisfies Assumption EC. Along a subsequence, uαnk→u~u_{\alpha_{n_k}}\to\tilde uuαnk​​​→u~, and some stationary ϕ\phiϕ satisfies

w+u~(x)=KI{ϕ(x)>0}+H(x+ϕ(x))−cˉx=min⁡{min⁡a≥0[K+H(x+a)], H(x)}−cˉx.w+\tilde u(x)=K I_{\{\phi(x)>0\}}+H(x+\phi(x))-\bar cx=\min\Big\{\min_{a\ge0}[K+H(x+a)],\,H(x)\Big\}-\bar cx .w+u~(x)=KI{ϕ(x)>0}​+H(x+ϕ(x))−cˉx=min{a≥0min​[K+H(x+a)],H(x)}−cˉx.

Moreover:

  • u~\tilde uu~ and HHH are KKK-convex, continuous and inf-compact;
  • the (s,S)(s,S)(s,S) policy built from a minimizer of HHH satisfies the equation;
  • so do the limits (s∗,S∗)(s^*,S^*)(s∗,S∗) of discount-optimal thresholds.

Milestones

  1. Lemma 3.3: for equicontinuous families, the pointwise and joint lower limits coincide.
  2. Theorem 3.2: Assumptions W*, B and EC imply the ACOE for a general MDP.
  3. The cited facts used in §4:
    • Assumptions W* and B hold for the inventory problem;
    • the sets Xα\mathbb X_\alphaXα​ of minimizers of vαv_\alphavα​ lie in a bounded interval (4.4);
    • discount-optimal (sα,Sα)(s_\alpha,S_\alpha)(sα​,Sα​) policies (Theorem 4.3);
    • their average-cost limits (Theorem 4.4);
    • the renewal bounds (4.11)–(4.12).
  4. Lemma 4.6: an explicit dominating function UUU.
  5. Lemma 4.7: equicontinuity of {uαn}\{u_{\alpha_n}\}{uαn​​} for the inventory problem.

Significance

The ACOE is stronger than the ACOI. It identifies the optimal actions of an average-cost problem as the minimizers of a one-step lookahead with u~\tilde uu~, and it makes u~\tilde uu~ a genuine relative value function: u~\tilde uu~ is the pointwise limit of the discounted relative values along a subsequence. For inventory control, Theorem 4.5 gives three further conclusions:

  • the KKK-convexity and continuity of the average-cost relative value function;
  • that an optimal (s,S)(s,S)(s,S) policy can be computed from HHH by the same argmin rule that works for discounted costs;
  • that limits of discount-optimal thresholds solve the average-cost problem.

The results are proved in the paper, and in the cited works of Feinberg and coauthors for the cited milestones. None is formalized. There is no formal library of MDPs on Borel spaces with history-dependent randomized policies. This mission builds that layer (strategic measures via Ionescu Tulcea, discounted and average costs, Assumptions W*, B and EC) and states the general ACOE theorem on it. A proof of the goal would also require formal proofs of the cited inventory results of Feinberg–Lewis (2015) and Feinberg–Liang (2017a), which are milestones here.

Difficulty

One obvious route is to pass to the limit in the discounted optimality equation vα=min⁡a[c+α∫vα dq]v_\alpha=\min_a[c+\alpha\int v_\alpha\,dq]vα​=mina​[c+α∫vα​dq]. After subtracting mαm_\alphamα​, this needs two things: convergence of uαnu_{\alpha_n}uαn​​, and exchanging limit and integral. Pointwise lower limits give only the inequality (ACOI). The reverse inequality needs actual convergence of a subsequence and a dominating function. For weakly continuous qqq, convergence of ∫uαn dq\int u_{\alpha_n}\,dq∫uαn​​dq additionally requires uniform convergence on compacts, which is where equicontinuity enters.

For the inventory problem the hard step is equicontinuity itself. The functions uαu_\alphauα​ are not uniformly Lipschitz. It must be shown that costs from two nearby starting inventories stay close uniformly in α\alphaα. This comparison runs through the time until inventory falls below the reorder point, and it is controlled by renewal-theoretic bounds on the number of demand arrivals.

Formalization scope

The Lean development lives in the namespace FeinbergLiang.ACOE. It commits to the following conventions.

  • Spaces. X,A\mathbb X,\mathbb AX,A are separable metric spaces with standard Borel σ-algebras. This is the paper's "Borel subsets of Polish spaces", up to homeomorphism. The inventory case is X=R\mathbb X=\mathbb RX=R, A=R≥0\mathbb A=\mathbb R_{\ge0}A=R≥0​. The integer case X=Z\mathbb X=\mathbb ZX=Z, A=N0\mathbb A=\mathbb N_0A=N0​ is out of scope, as are Corollary 4.8 and Theorem 4.9.
  • Costs and infinities. The cost is stored as a real lower bound plus a [0,∞][0,\infty][0,∞]-valued part. Every value function (vαv_\alphavα​, mαm_\alphamα​, uαu_\alphauα​, www, w‾\underline ww​, u~\tilde uu~) is the [0,∞][0,\infty][0,∞]-valued part, with the explicit real shift described in the definitions. uαu_\alphauα​ equals vα−mαv_\alpha-m_\alphavα​−mα​ whenever mα<∞m_\alpha<\inftymα​<∞, which Assumption B guarantees. α∗\alpha^*α∗ is an extended real and may be −∞-\infty−∞. GαG_\alphaGα​ and HHH are extended-real valued, and each theorem using them concludes their finiteness. Likewise the ACOE conclusions include w‾<∞\underline w<\inftyw​<∞ and u~<∞\tilde u<\inftyu~<∞, so an equation of the form ∞=∞\infty=\infty∞=∞ can never satisfy them.
  • Policies. vαv_\alphavα​ and www are infima over all history-dependent randomized policies, with trajectory laws given by Mathlib's Ionescu Tulcea kernel Kernel.trajMeasure. They are never defined as solutions of an optimality equation.
  • Readings of informal words.
    1. "αn↑1\alpha_n\uparrow1αn​↑1" means values in [0,1)[0,1)[0,1), nondecreasing, with limit 111; "nonnegative discount factors" is the lower end of [0,1)[0,1)[0,1).
    2. The paper's α1\alpha_1α1​ is Lean's α 0.
    3. "Equicontinuous" is Mathlib's Equicontinuous, applied to the real values of uαnu_{\alpha_n}uαn​​ together with their finiteness.
    4. "lim inf⁡n→∞,y→x\liminf_{n\to\infty,y\to x}liminfn→∞,y→x​" is the lower limit along the product filter atTop ×ˢ 𝓝 x.
    5. "Uniform on each compact subset" is TendstoUniformlyOn on every compact set.
    6. "=min⁡=\min=min" in (3.3) and (4.10) means the middle term is attained and is a lower bound for all actions.
    7. "Assumption EC for the sequence" is a property of a given sequence.
    8. "Can be selected as an (s∗,S∗)(s^*,S^*)(s∗,S∗) policy" is stated for every limit of discount-optimal thresholds along a further subsequence, with u~\tilde uu~ that of Theorem 3.2(i).
    9. "Can be selected as an (s,S)(s,S)(s,S) policy" is stated for every minimizer SSS of HHH.
    10. Theorem 4.4's "optimality inequality (4.8)" is read as the ACOI (3.1) for the (s∗,S∗)(s^*,S^*)(s∗,S∗) policy.
  • Standing assumptions. The paper's "without loss of generality h≥0h\ge0h≥0 and h(0)=0h(0)=0h(0)=0" is a pair of hypotheses of the inventory model. This is the paper's normalization, not an addition.
  • Not trivializable. Defining vαv_\alphavα​ through its optimality equation, restricting policies to stationary ones, or dropping the finiteness conclusions would make the goal a different, weaker statement. The definitions rule each of these out.

Contributions welcome: proofs of the milestones, especially the general Theorem 3.2 and the renewal estimates behind Lemmas 4.6–4.7. The Borel-space MDP definitions are reusable by later average-cost and discounted MDP missions.

Selected references

  • E. A. Feinberg and Y. Liang, On the optimality equation for average cost Markov decision processes and its validity for inventory control, Annals of Operations Research 317 (2022) 569–586. https://doi.org/10.1007/s10479-017-2561-9
  • E. A. Feinberg, P. O. Kasyanov and N. V. Zadoianchuk, Average cost Markov decision processes with weakly continuous transition probability, Mathematics of Operations Research 37(4) (2012) 591–607. https://doi.org/10.1287/moor.1120.0555
  • E. A. Feinberg and M. E. Lewis, On the convergence of optimal actions for Markov decision processes and the optimality of (s, S) policies for inventory control, preprint arXiv:1507.05125, 2015. https://arxiv.org/abs/1507.05125
  • E. A. Feinberg and Y. Liang, Structure of optimal policies to periodic-review inventory models with convex costs and backorders for all values of discount factors, Annals of Operations Research (2017a). https://doi.org/10.1007/s10479-017-2548-6
  • O. Hernández-Lerma and J. B. Lasserre, Discrete-Time Markov Control Processes: Basic Optimality Criteria, Springer, 1996. https://doi.org/10.1007/978-1-4612-0729-0
12 thms2 active usersReviewed
Bandit AlgorithmsMachine LearningOperations Research+1·Captain: mikedeng1

Online Network Revenue Management Using Thompson Sampling: Bayesian Regret of TS-fixedResearch Paper

Motivation

A retailer who sells several products from shared, non-replenishable inventory over a finite season must set prices without knowing how demand responds to them. Every price posted is both a sale and an experiment. This is the network revenue management problem with demand learning, and it sits between two literatures: dynamic pricing with inventory, where demand is known and the fluid linear program of Gallego and van Ryzin (1997) is the standard benchmark, and multi-armed bandits, where learning is the whole problem but there are no resource constraints.

Ferreira, Simchi-Levi and Wang (Oper. Res. 2018) combine Thompson sampling with a linear-programming step: sample a demand model from the posterior, solve the fluid LP for that model, and randomize prices according to its solution. The same paper extends the scheme to continuous price sets, contextual pricing and bandits with knapsacks.

Timeline of the relevant results:

  • 1997: Gallego and van Ryzin introduce the fluid LP upper bound for network revenue management with known demand.
  • 2012: Besbes and Zeevi give a non-Bayesian network pricing algorithm with worst-case regret O(K5/3T2/3log⁡T)O(K^{5/3}T^{2/3}\sqrt{\log T})O(K5/3T2/3logT​).
  • 2013: Badanidiyuru, Kleinberg and Slivkins (bandits with knapsacks) give worst-case regret O(KTlog⁡T)O(\sqrt{KT\log T})O(KTlogT​).
  • 2013–2014: Bubeck and Liu and Russo and Van Roy give prior-free Bayesian regret bounds for Thompson sampling in unconstrained bandits.
  • 2018: Ferreira, Simchi-Levi and Wang prove the O(TKlog⁡K)O(\sqrt{TK\log K})O(TKlogK​) Bayesian regret bound for TS-fixed (Theorem 1), the target of this mission.

Setting

There are NNN products and MMM resources. One unit of product iii consumes aij≥0a_{ij}\ge0aij​≥0 units of resource jjj, and resource jjj starts with inventory Ij≥0I_j\ge0Ij​≥0 that is never replenished. The season has TTT periods. In each period the retailer posts one of KKK price vectors pk=(p1k,…,pNk)p_k=(p_{1k},\dots,p_{Nk})pk​=(p1k​,…,pNk​) or a shut-off price p∞p_\inftyp∞​ under which demand is zero.

Given the posted price pkp_kpk​, the demand vector D(t)∈R+ND(t)\in\mathbb R^N_+D(t)∈R+N​ has law F(⋅ ;pk,θ)F(\cdot\,;p_k,\theta)F(⋅;pk​,θ), where θ∈Θ\theta\in\Thetaθ∈Θ is unknown and drawn from a known, arbitrary prior μ0\mu_0μ0​. Demand is independent of the past given the posted price and θ\thetaθ, and is bounded: Di(t)∈[0,dˉi]D_i(t)\in[0,\bar d_i]Di​(t)∈[0,dˉi​]. Write dik(ρ)d_{ik}(\rho)dik​(ρ) for the mean demand of product iii under pkp_kpk​ and parameter ρ\rhoρ, and d=d(θ)d=d(\theta)d=d(θ).

When inventory covers all demand, all demand is sold. Otherwise the satisfied demand D~(t)\tilde D(t)D~(t) satisfies 0≤D~i(t)≤Di(t)0\le\tilde D_i(t)\le D_i(t)0≤D~i​(t)≤Di​(t), leaves every inventory nonnegative, and leaves at least one resource at zero; no other rule is imposed. Revenue is Rev(T)=∑t∑iD~i(t)Pi(t)\mathrm{Rev}(T)=\sum_t\sum_i\tilde D_i(t)P_i(t)Rev(T)=∑t​∑i​D~i​(t)Pi​(t).

For a mean-demand matrix ddd and capacities cj=Ij/Tc_j=I_j/Tcj​=Ij​/T, the linear program LP(d)\mathrm{LP}(d)LP(d) is

max⁡x≥0 ∑k=1K(∑i=1Npikdik)xks.t.∑k=1K(∑i=1Naijdik)xk≤cj  ∀j,∑k=1Kxk≤1,\max_{x\ge0}\ \sum_{k=1}^K\Bigl(\sum_{i=1}^N p_{ik}d_{ik}\Bigr)x_k\quad\text{s.t.}\quad\sum_{k=1}^K\Bigl(\sum_{i=1}^N a_{ij}d_{ik}\Bigr)x_k\le c_j\ \ \forall j,\qquad\sum_{k=1}^K x_k\le1,x≥0max​ k=1∑K​(i=1∑N​pik​dik​)xk​s.t.k=1∑K​(i=1∑N​aij​dik​)xk​≤cj​  ∀j,k=1∑K​xk​≤1,

with optimal value OPT(d)\mathrm{OPT}(d)OPT(d).

TS-fixed (Algorithm 1): in each period, sample θ(t)\theta(t)θ(t) from the posterior of θ\thetaθ given the history of posted prices and observed demands; let x(t)x(t)x(t) be an optimal solution of LP(d(θ(t)))\mathrm{LP}(d(\theta(t)))LP(d(θ(t))); post pkp_kpk​ with probability xk(t)x_k(t)xk​(t) and p∞p_\inftyp∞​ with the remaining probability; observe demand and update the posterior.

Finally pmax⁡=max⁡k∑ipikdˉip_{\max}=\max_k\sum_ip_{ik}\bar d_ipmax​=maxk​∑i​pik​dˉi​ and pmax⁡j=max⁡i:aij≠0, kpik/aijp^j_{\max}=\max_{i:a_{ij}\neq0,\,k}p_{ik}/a_{ij}pmaxj​=maxi:aij​=0,k​pik​/aij​.

Formalization targets

Goal: Theorem 1 against the LP benchmark

For K≥2K\ge2K≥2, T≥1T\ge1T≥1, every prior, every bounded demand family, every admissible fulfilment rule and every run of TS-fixed,

E[OPT(d)]⋅T−E[Rev(T)] ≤ (18 pmax⁡+37∑i=1N∑j=1Mpmax⁡jaijdˉi)TKlog⁡K.\mathbb E\bigl[\mathrm{OPT}(d)\bigr]\cdot T-\mathbb E\bigl[\mathrm{Rev}(T)\bigr]\ \le\ \Bigl(18\,p_{\max}+37\sum_{i=1}^N\sum_{j=1}^M p^j_{\max}a_{ij}\bar d_i\Bigr)\sqrt{TK\log K}.E[OPT(d)]⋅T−E[Rev(T)] ≤ (18pmax​+37i=1∑N​j=1∑M​pmaxj​aij​dˉi​)TKlogK​.

The paper prints this bound for BayesRegret(T)=E[Rev∗(T)]−E[Rev(T)]\mathrm{BayesRegret}(T)=\mathbb E[\mathrm{Rev}^*(T)]-\mathbb E[\mathrm{Rev}(T)]BayesRegret(T)=E[Rev∗(T)]−E[Rev(T)], where Rev∗\mathrm{Rev}^*Rev∗ is the revenue of the optimal policy that knows θ\thetaθ; see Formalization scope for why the LP benchmark is stated instead.

Milestones

The article states Theorem 1 and says that its proof is in the online appendix (Supplemental Material at the DOI). The article itself contains no numbered lemma. The milestone list is therefore empty; the appendix's lemmas will be added as milestones once the appendix is held.

Significance

The bound is prior-free and has explicit constants that depend only on prices, consumption rates and demand bounds. Its dependence on TTT matches the Ω(KT)\Omega(\sqrt{KT})Ω(KT​) lower bound for Bayesian regret in unconstrained bandits with rewards in [0,1][0,1][0,1], a special case of the model with no inventory constraints (Bubeck and Cesa-Bianchi 2012, Theorem 3.5). It shows that the posterior-sampling principle survives the addition of resource constraints, lost sales and randomized LP-based pricing, and it is the template for the paper's later results (TS-update, contextual pricing, bandits with knapsacks).

The theorem is proved on paper but, as far as a platform search shows, not formalized anywhere. The platform has a formal proof of the unconstrained Bayesian Thompson sampling bound knlog⁡k/2\sqrt{kn\log k/2}knlogk/2​ (BanditAlgorithm.thompson_sampling_bayesian_regret, Lattimore–Szepesvári Theorem 36.5) and an open single-product deterministic upper bound in revenue management (RevenueManagement.deterministic_upper_bound). Neither has inventory, an LP subroutine, or lost sales. A formal proof here would supply the first machine-checked analysis of Thompson sampling under resource constraints and would check the paper's constants.

Difficulty

In an unconstrained bandit, Thompson sampling's regret reduces to a sum of per-period gaps between an upper confidence bound and the sampled reward, because the sampled optimal arm and the true optimal arm are identically distributed given the history. Here the action is a randomized mixture x(t)x(t)x(t) from an LP, the reward is not additive in the prices chosen, and revenue is lost when inventory runs out. Two quantities must be controlled: the revenue the algorithm would collect if all demand could be served, and the revenue lost to stock-outs. The second depends on the random time at which each resource is exhausted under a pricing rule that was optimized for a sampled, not the true, demand, and on an arbitrary fulfilment rule once some resource is empty. Standard bandit arguments do not bound such lost sales, which are a nonlinear function of the whole trajectory.

Formalization scope

Lean representation. Products, resources and price vectors are indexed by Fin N, Fin M, Fin K; the posted price is an Option (Fin K) with none the shut-off price. Periods are 0-based (t=0,…,T−1t=0,\dots,T-1t=0,…,T−1 stands for the paper's 1,…,T1,\dots,T1,…,T). Θ\ThetaΘ is a standard Borel space with a probability measure μ0\mu_0μ0​; demand is a Markov kernel FFF from Θ×\Theta\timesΘ×Fin K to RN\mathbb R^NRN, bounded in [0,dˉi][0,\bar d_i][0,dˉi​] for every parameter. A run of TS-fixed is a family of random variables on a probability space satisfying, almost surely and via conditional expectations: θ∼μ0\theta\sim\mu_0θ∼μ0​; the posterior-sampling property of θ(t)\theta(t)θ(t) given everything before period ttt; the price draw with probabilities x(θ(t))x(\theta(t))x(θ(t)) for a measurable optimal LP selection xxx; the demand law given the past, θ(t)\theta(t)θ(t) and the posted price; and fulfilment rules (a)/(b). The logarithm is natural. Prices, consumption and inventory are nonnegative (implicit in the paper). OPT(d)\mathrm{OPT}(d)OPT(d) is a supremum over a nonempty bounded feasible set, so it has no junk value.

Corrections to the printed statement.

  1. K≥2K\ge2K≥2 is added. At K=1K=1K=1 the printed right-hand side is 000, yet on a one-price instance with Bernoulli(0.8)(0.8)(0.8) demand, I=T/2I=T/2I=T/2 and a point-mass prior, TS-fixed loses about 0.2pT0.2p\sqrt T0.2pT​ in expectation.
  2. The LP benchmark replaces E[Rev∗(T)]\mathbb E[\mathrm{Rev}^*(T)]E[Rev∗(T)]. Section 3.1.1 bounds E[Rev∗(T)∣d]\mathbb E[\mathrm{Rev}^*(T)\mid d]E[Rev∗(T)∣d] by OPT(d)⋅T\mathrm{OPT}(d)\cdot TOPT(d)⋅T, citing Gallego–van Ryzin. Under the paper's fulfilment rule this fails when products use disjoint resources: with two products, I=(T,1)I=(T,1)I=(T,1), p1=(1,0)p_1=(1,0)p1​=(1,0), p2=(1/2,0)p_2=(1/2,0)p2​=(1/2,0) and deterministic demand (1,1)(1,1)(1,1), the known-θ\thetaθ policy earns at least TTT while OPT(d)⋅T=1\mathrm{OPT}(d)\cdot T=1OPT(d)⋅T=1. The paper states that its proof bounds the gap to "the LP benchmark defined in Section 3.1.1" (p. 1594), and the last display of Section 3.1.1 bounds BayesRegret(T)\mathrm{BayesRegret}(T)BayesRegret(T) by exactly E[OPT(d)]⋅T−E[Rev(T)]\mathbb E[\mathrm{OPT}(d)]\cdot T-\mathbb E[\mathrm{Rev}(T)]E[OPT(d)]⋅T−E[Rev(T)]. Wherever the Gallego–van Ryzin bound holds, the corrected goal implies the printed one.

Ruled out. A bound for the "ideal" revenue ∑iDi(t)Pi(t)\sum_iD_i(t)P_i(t)∑i​Di​(t)Pi​(t) instead of the satisfied revenue, or for an arbitrary policy whose prices are merely close to the LP solution, is not Theorem 1; the goal carries the full TS-fixed run and the lost-sales accounting.

Infrastructure needed. Posterior-sampling identities for general (standard Borel) priors, a Hoeffding/Azuma-type concentration for bounded demand along the price-selection process, LP sensitivity with respect to the mean-demand matrix, and a pathwise bound on lost sales under an arbitrary fulfilment rule. The LP and fluid-benchmark definitions are reusable for later missions on TS-update (Theorem 2), contextual pricing (Theorem 4) and bandits with knapsacks (Theorem 5). Contributions welcome: proofs of the goal, and formal statements of the online appendix's lemmas.

Selected references

  • K. J. Ferreira, D. Simchi-Levi, H. Wang, Online Network Revenue Management Using Thompson Sampling, Operations Research 66(6):1586–1602, 2018. https://doi.org/10.1287/opre.2018.1755
  • G. Gallego, G. van Ryzin, A Multiproduct Dynamic Pricing Problem and Its Applications to Network Yield Management, Operations Research 45(1):24–41, 1997. https://doi.org/10.1287/opre.45.1.24
  • O. Besbes, A. Zeevi, Blind Network Revenue Management, Operations Research 60(6):1537–1550, 2012. https://doi.org/10.1287/opre.1120.1057
  • A. Badanidiyuru, R. Kleinberg, A. Slivkins, Bandits with Knapsacks, FOCS 2013. https://arxiv.org/abs/1305.2545
  • S. Bubeck, C.-Y. Liu, Prior-free and Prior-dependent Regret Bounds for Thompson Sampling, NeurIPS 2013. https://arxiv.org/abs/1311.0466
  • D. Russo, B. Van Roy, Learning to Optimize via Posterior Sampling, Mathematics of Operations Research 39(4):1221–1243, 2014. https://doi.org/10.1287/moor.2014.0650
  • S. Bubeck, N. Cesa-Bianchi, Regret Analysis of Stochastic and Nonstochastic Multi-armed Bandit Problems, Foundations and Trends in Machine Learning 5(1), 2012. https://arxiv.org/abs/1204.5721
  • T. Lattimore, C. Szepesvári, Bandit Algorithms, Cambridge University Press, 2020, Chapter 36. https://doi.org/10.1017/9781108571401
3 thms1 active userReviewed
Graph TheoryLinear OptimizationOperations Research+1·Captain: mikedeng1

Finding Minimum-Cost Circulations by Canceling Negative Cycles: Polynomial Termination of Minimum-Mean Cycle CancelingResearch Paper

Motivation

The minimum-cost circulation problem is a central problem of network optimization: transportation, assignment, shortest-path and maximum-flow problems are all special cases, and it is one of the few classes of linear programs with fast combinatorial algorithms. The oldest algorithm for it, the cycle-canceling algorithm of Klein (1967), repeatedly finds a residual cycle of negative cost and pushes as much flow as possible around it. With an arbitrary choice of cycle it can take exponentially many iterations even on integer data, and it need not terminate at all when capacities are irrational.

Goldberg and Tarjan (J. ACM 36(4), 1989) showed that one simple selection rule repairs this: always cancel a residual cycle whose mean cost (cost divided by number of arcs) is as small as possible. The resulting algorithm is strongly polynomial: its number of iterations is bounded by a polynomial in the number of vertices and arcs alone, independent of the magnitudes of capacities and costs. This mission formalizes that bound.

Timeline:

  • 1967, Klein: the cycle-canceling algorithm, without an iteration bound.
  • 1972, Edmonds and Karp: the first polynomial algorithm for minimum-cost flow (capacity scaling), polynomial in the bit length of the capacities.
  • 1985, Tardos: the first strongly polynomial algorithm, introducing the arc-fixing idea that Theorem 3.8 generalizes.
  • 1987–1989, Goldberg and Tarjan: generalized cost scaling and ε-optimality; in this paper, minimum-mean cycle canceling terminates after O(nm² log n) iterations for real costs (Theorem 3.9) and O(nm log(nC)) for integer costs bounded by C (Theorem 3.7).

Setting

A circulation network is a finite directed graph G=(V,E)G=(V,E)G=(V,E) with n=∣V∣n=|V|n=∣V∣ vertices and m=∣E∣m=|E|m=∣E∣ arcs, which is symmetric ((v,w)∈E(v,w)\in E(v,w)∈E iff (w,v)∈E(w,v)\in E(w,v)∈E, so mmm counts both directions), together with real capacities u(v,w)u(v,w)u(v,w) and real costs c(v,w)c(v,w)c(v,w), the cost being antisymmetric: c(v,w)=−c(w,v)c(v,w)=-c(w,v)c(v,w)=−c(w,v).

A circulation is a real function fff on arcs satisfying f(v,w)≤u(v,w)f(v,w)\le u(v,w)f(v,w)≤u(v,w), f(v,w)=−f(w,v)f(v,w)=-f(w,v)f(v,w)=−f(w,v) on every arc, and conservation ∑v:(w,v)∈Ef(v,w)=0\sum_{v:(w,v)\in E} f(v,w)=0∑v:(w,v)∈E​f(v,w)=0 at every vertex www. Its cost is cost⁡(f)=12∑(v,w)∈Ec(v,w)f(v,w)\operatorname{cost}(f)=\tfrac12\sum_{(v,w)\in E}c(v,w)f(v,w)cost(f)=21​∑(v,w)∈E​c(v,w)f(v,w), and fff is minimum-cost (optimal) if no circulation has smaller cost.

The residual capacity of an arc is uf(v,w)=u(v,w)−f(v,w)u_f(v,w)=u(v,w)-f(v,w)uf​(v,w)=u(v,w)−f(v,w); arcs with uf>0u_f>0uf​>0 are residual arcs. A residual cycle is a simple cycle of residual arcs; its capacity is the minimum residual capacity along it, its cost c(Γ)c(\Gamma)c(Γ) is the sum of its arc costs, and its mean cost is c(Γ)/∣Γ∣c(\Gamma)/|\Gamma|c(Γ)/∣Γ∣. Canceling a residual cycle raises the flow on each of its arcs by its capacity (and lowers the flow on each reverse arc by the same amount).

The minimum-mean cycle-canceling algorithm starts from any circulation and, while some residual cycle has negative cost, cancels a residual cycle whose mean cost is minimum among all residual cycles. Ties are broken arbitrarily, so the algorithm is a nondeterministic process; a run of length KKK is any sequence f0,…,fKf_0,\dots,f_Kf0​,…,fK​ of circulations produced by KKK such iterations.

The analysis uses a price function p:V→Rp:V\to\mathbb Rp:V→R, the reduced cost cp(v,w)=c(v,w)+p(v)−p(w)c_p(v,w)=c(v,w)+p(v)-p(w)cp​(v,w)=c(v,w)+p(v)−p(w), and ε-optimality: for ε≥0\varepsilon\ge0ε≥0, fff is ε-optimal if some ppp gives cp(v,w)≥−εc_p(v,w)\ge-\varepsiloncp​(v,w)≥−ε on every residual arc. The quantity ε(f)\varepsilon(f)ε(f) is the least such ε\varepsilonε, and an arc is ε-fixed if all ε-optimal circulations carry the same flow on it.

Formalization targets

Goal: Theorem 3.9, with the proof's constant

For every circulation network with n≥2n\ge2n≥2 vertices, mmm arcs, arbitrary real capacities and arbitrary real antisymmetric costs, every run of the minimum-mean cycle-canceling algorithm has length

K ≤ n m2 ⌈ln⁡n+1⌉.K\ \le\ n\,m^2\,\lceil \ln n+1\rceil .K ≤ nm2⌈lnn+1⌉.

The statement quantifies over all starting circulations, all tie-breaking choices and all real data; it is the paper's O(nm2log⁡n)O(nm^2\log n)O(nm2logn) with the constant its proof establishes.

Milestones

In the order the proof uses them: Theorem 2.1 (optimal iff no negative residual cycle), Theorem 3.1 (optimal iff some price function has cp≥0c_p\ge0cp​≥0 on residual arcs), Theorem 3.3 (ε(f)=−μ(f)\varepsilon(f)=-\mu(f)ε(f)=−μ(f) for nonoptimal fff, where μ(f)\mu(f)μ(f) is the minimum cycle mean of the residual graph), Lemma 3.5 (a minimum-mean cancellation does not increase ε(f)\varepsilon(f)ε(f)), Lemma 3.6 (mmm cancellations shrink ε(f)\varepsilon(f)ε(f) by a factor 1−1/n1-1/n1−1/n), and Theorem 3.8 (an arc with ∣cp(v,w)∣≥2nε|c_p(v,w)|\ge2n\varepsilon∣cp​(v,w)∣≥2nε is ε-fixed).

Significance

Theorem 3.9 shows that a classical, natural algorithm is strongly polynomial: its iteration count depends only on the combinatorial size of the network. Combined with Karp's O(nm)O(nm)O(nm) minimum-mean cycle algorithm it yields an O(n2m3log⁡n)O(n^2m^3\log n)O(n2m3logn) strongly polynomial algorithm (Theorem 3.10), and its method, measuring progress by the minimum cycle mean and fixing arcs once ε(f)\varepsilon(f)ε(f) is small, underlies the faster cancel-and-tighten algorithm of Section 4 and later strongly polynomial analyses of network-flow and related algorithms.

The theorem has been proved since 1989; this mission's contribution is a machine-checked proof. To the best of the platform's catalogue, no cycle-canceling bound, minimum cycle mean or ε-optimality statement has been formalized. The platform does hold the negative-cycle optimality criterion in a different model (LinearOptimization.network_no_negative_cycle_optimal, Bertsimas–Tsitsiklis Theorem 7.6, with nonnegative flows and supplies) and a flow decomposition theorem (LinearOptimization.network_flow_decomposition); both are related to milestones here but are stated for a different network model.

Difficulty

The obvious potential function, the cost of the circulation, decreases at every iteration but by amounts that depend on the data, so it yields no bound independent of the capacities and costs. The analysis instead has to track ε(f)\varepsilon(f)ε(f), an infimum over price functions, and relate it to the minimum cycle mean of a residual graph that changes after each cancellation, including arcs that appear only because of earlier cancellations. The strongly polynomial part needs a second ingredient: showing that the flow on some arc never changes again, which requires comparing the current circulation with all other ε-optimal circulations of the network, not only those the algorithm visits.

Formalization scope

Vertices form a finite type V; the arc set is E : Finset (V × V); capacities, costs and flows are real functions V → V → ℝ read only on E. nnn is Fintype.card V and mmm is E.card, counting (v,w)(v,w)(v,w) and (w,v)(w,v)(w,v) separately, as in the paper. Cycles are nonempty duplicate-free vertex lists, whose arcs are the cyclically consecutive pairs; one- and two-vertex cycles are allowed and have cost 000. Minimum mean is taken over all residual simple cycles of the current circulation. ε(f)\varepsilon(f)ε(f) is an infimum (sInf) over a set that is nonempty and bounded below for every circulation; its attainment is to be proved, never assumed.

Explicit constants replacing the paper's O(⋅)O(\cdot)O(⋅):

  • Theorem 3.9: the paper prints O(nm2log⁡n)O(nm^2\log n)O(nm2logn); its proof uses groups of k=m n⌈ln⁡n+1⌉k=m\,n\lceil\ln n+1\rceilk=mn⌈lnn+1⌉ iterations, at most mmm of them, so the goal states K≤n m2⌈ln⁡n+1⌉K\le n\,m^2\lceil\ln n+1\rceilK≤nm2⌈lnn+1⌉ with the natural logarithm.
  • The standing assumption n≥2n\ge2n≥2 (p. 874) is kept on the goal; the standing assumption m≥nm\ge nm≥n is not used by the proof and is omitted.

"Terminates after at most BBB iterations" means that every run has length at most BBB. Asserting only that some run is short, or that the process eventually stops, does not formalize the theorem; nor does a step relation that drops negativity, simplicity of the cycle, minimality of the mean over all residual cycles, or the update by exactly the cycle's capacity.

A complete development needs cycle decomposition of the difference of two circulations, LP duality for circulations (Theorem 3.1), and bookkeeping for the residual graph under cancellation. These are reusable for any cycle-canceling or cost-scaling analysis, and contributions of that infrastructure as separate lemmas are welcome. Theorem 3.7 (the integer-cost bound) and Section 4 are outside this mission.

Selected references

  • A. V. Goldberg, R. E. Tarjan, Finding Minimum-Cost Circulations by Canceling Negative Cycles, J. ACM 36(4):873–886, 1989. https://doi.org/10.1145/76359.76368
  • M. Klein, A primal method for minimal cost flows with applications to the assignment and transportation problems, Management Science 14(3):205–220, 1967. https://doi.org/10.1287/mnsc.14.3.205
  • É. Tardos, A strongly polynomial minimum cost circulation algorithm, Combinatorica 5(3):247–255, 1985. https://doi.org/10.1007/BF02579369
  • A. V. Goldberg, R. E. Tarjan, Finding minimum-cost circulations by successive approximation, Mathematics of Operations Research 15(3):430–466, 1990. https://doi.org/10.1287/moor.15.3.430
  • R. M. Karp, A characterization of the minimum cycle mean in a digraph, Discrete Mathematics 23(3):309–311, 1978. https://doi.org/10.1016/0012-365X(78)90011-0
  • J. Edmonds, R. M. Karp, Theoretical improvements in algorithmic efficiency for network flow problems, J. ACM 19(2):248–264, 1972. https://doi.org/10.1145/321694.321699
10 thms2 active usersReviewed
Operations ResearchOptimizationProbability·Captain: mikedeng1

Optimizing Strategic Safety Stock Placement in Supply Chains: Binding Base Stocks Are Optimal in a Serial System without Guaranteed Internal ServiceResearch Paper

Motivation

Where to hold safety stock in a multi-stage supply chain is a basic question of inventory planning. Graves and Willems (MSOM 2(1), 2000) optimize safety-stock placement under the guaranteed-service assumption: each stage quotes a service time to its customers and always meets it. That assumption makes the placement problem tractable, and it is the basis of the dynamic program in the body of the paper and of later work built on it. It also has a price. A stage that promises a service time must hold enough stock to keep the promise even when it would be cheaper to let a downstream stage absorb an occasional delay.

The paper's Appendix measures that price in the simplest setting where it can be computed exactly. The setting is a serial chain in which internal stages promise nothing and only the external customer is guaranteed 100% service. Its one theorem, called the Result, characterizes the optimal base stocks of this relaxed model in closed form. The paper then compares that policy with the guaranteed-service optimum on 36 test instances. The guaranteed-service counterpart of this serial model, Simpson's all-or-nothing property of optimal service times, is on Prove2Me as a separate statement (SupplyChainTheory.gs_all_or_nothing, from Snyder and Shen's textbook). This mission formalizes the other side of the comparison.

Setting

A serial supply chain has NNN stages. Stage 111 is the demand node and stage iii supplies stage i−1i-1i−1 for i=2,…,Ni = 2, \dots, Ni=2,…,N. Time is discrete, with periods t∈Zt \in \mathbb{Z}t∈Z. Stage iii has a deterministic lead time Ti∈NT_i \in \mathbb{N}Ti​∈N and a base stock Bi∈RB_i \in \mathbb{R}Bi​∈R. It follows a base-stock policy: in each period it observes end-item demand and orders that amount from its supplier.

The end-item demand in period ttt is d(t)d(t)d(t). The window demand is d(a,b]=d(a+1)+⋯+d(b)d(a, b] = d(a+1) + \dots + d(b)d(a,b]=d(a+1)+⋯+d(b), which is 000 when a≥ba \ge ba≥b. The demand bound D:N→RD : \mathbb{N} \to \mathbb{R}D:N→R gives D(τ)D(\tau)D(τ), the maximum possible end-item demand over τ\tauτ periods, with D(0)=0D(0) = 0D(0)=0.

The backlog Qi(t)Q_i(t)Qi​(t) is the amount the customer of stage iii has ordered but not yet received. It satisfies the recursion (A1):

Qi(t)=[d(t−Ti,t]+Qi+1(t−Ti)−Bi]+,QN+1≡0.Q_i(t) = \bigl[d(t - T_i, t] + Q_{i+1}(t - T_i) - B_i\bigr]^+, \qquad Q_{N+1} \equiv 0 .Qi​(t)=[d(t−Ti​,t]+Qi+1​(t−Ti​)−Bi​]+,QN+1​≡0.

Unrolling it gives the closed max-form (A2). The external customer receives 100% service when Q1(t)=0Q_1(t) = 0Q1​(t)=0 for all ttt. When demand never exceeds its bound, this is ensured by the service constraints

B1+⋯+Bi≥D(T1+⋯+Ti),i=1,…,N.(A3)B_1 + \dots + B_i \ge D(T_1 + \dots + T_i), \qquad i = 1, \dots, N. \tag{A3}B1​+⋯+Bi​≥D(T1​+⋯+Ti​),i=1,…,N.(A3)

Let hih_ihi​ be the holding cost at stage iii and ei=hi−hi+1e_i = h_i - h_{i+1}ei​=hi​−hi+1​ the echelon holding cost. After constant terms are dropped, the expected holding cost gives program P∗\mathbf P^*P∗:

min⁡B ∑i=1NhiBi−∑i=2Nei−1E[Qi]s.t. (A3) and Bi≥0.\min_B\ \sum_{i=1}^N h_i B_i - \sum_{i=2}^N e_{i-1} E[Q_i] \quad\text{s.t. (A3) and } B_i \ge 0 .Bmin​ i=1∑N​hi​Bi​−i=2∑N​ei−1​E[Qi​]s.t. (A3) and Bi​≥0.

Demand is random, and E[Qi]E[Q_i]E[Qi​] is the expected backlog at stage iii in a period ttt.

Formalization targets

Goal: the Result, Eq. (A6)

If the echelon holding costs are nonnegative and DDD is nondecreasing, then an optimal solution of P∗\mathbf P^*P∗ is

B1=D(T1),Bi=D(T1+⋯+Ti)−D(T1+⋯+Ti−1),i=2,…,N.(A6)B_1 = D(T_1), \qquad B_i = D(T_1 + \dots + T_i) - D(T_1 + \dots + T_{i-1}), \quad i = 2, \dots, N. \tag{A6}B1​=D(T1​),Bi​=D(T1​+⋯+Ti​)−D(T1​+⋯+Ti−1​),i=2,…,N.(A6)

Formally, (A6) is feasible, and for every period ttt its objective value is at most that of every feasible vector. The goal names this vector and compares it with every feasible BBB. The weaker claim that "some optimal solution binds all of (A3)" would not be enough.

Milestones

  1. Eq. (A2). The closed max-form of Qi(t)Q_i(t)Qi​(t), derived from the recursion (A1).
  2. Eq. (A3). Under the demand bound d(a,a+s]≤D(s)d(a, a+s] \le D(s)d(a,a+s]≤D(s), the constraints (A3) force Q1≡0Q_1 \equiv 0Q1​≡0 (sufficiency).
  3. (A6) is feasible and is the unique binding solution of (A3).
  4. Backlog bounds under a transfer. Moving Δ≥0\Delta \ge 0Δ≥0 units of base stock from stage kkk to stage k+1k+1k+1 leaves E[Qi]E[Q_i]E[Qi​] unchanged for i>k+1i > k+1i>k+1 and raises it by at most Δ\DeltaΔ for i≤ki \le ki≤k. It lowers E[Qk+1]E[Q_{k+1}]E[Qk+1​] by at most Δ\DeltaΔ.
  5. Eqs. (A7)–(A8). For k<Nk < Nk<N, the transfer that makes the kkk-th constraint binding keeps the vector feasible and does not raise the objective.
  6. The case k=Nk = Nk=N. Lowering BNB_NBN​ until the NNN-th constraint binds does not raise the objective.

Significance

The Result shows that, without guaranteed internal service, the optimal base stocks do not depend on the holding costs, provided the echelon costs are nonnegative. Each stage then covers exactly the increment of maximal demand that its own lead time adds. This closed form is the benchmark against which the paper measures the cost of guaranteed service: 26% more safety-stock holding cost on average over its test problems. The paper also remarks, without proof, that Rosling's transformation extends the Result to assembly systems.

The Result is proved in the paper. As far as is known, neither it nor the backlog identity (A2) has been machine-checked. A complete development would yield a verified model of serial base-stock backlogs under bounded demand. It would also verify an exchange argument that recurs in multi-echelon inventory theory: moving stock toward the customer, with echelon costs controlling the sign of the change.

Difficulty

The objective is not linear in BBB. Each E[Qi]E[Q_i]E[Qi​] is a convex, nonsmooth function of Bi,…,BNB_i, \dots, B_NBi​,…,BN​ through the maximum in (A2), and the objective subtracts these terms, so P∗\mathbf P^*P∗ minimizes a concave function over a polyhedron. The obvious approaches are linear-programming duality and convex first-order optimality conditions on P∗\mathbf P^*P∗, and neither applies. The result is a comparison of objective values between arbitrary feasible vectors and (A6). It has to hold pathwise under every demand distribution, and it then has to be carried through expectations. The hypotheses the Result leaves implicit must be recovered from the rest of the paper. Two of them, stated below, are necessary.

Formalization scope

Stages are natural numbers read on the range {1,…,N}\{1, \dots, N\}{1,…,N}. Lead times are natural numbers cast to Z\mathbb{Z}Z. Base stocks, holding costs and the demand bound are real-valued. A base-stock vector is a function N→R\mathbb{N} \to \mathbb{R}N→R, and only indices 1,…,N1, \dots, N1,…,N are read. The backlog is defined by the recursion (A1), computed in N+1−iN + 1 - iN+1−i steps, with Qi≡0Q_i \equiv 0Qi​≡0 for i>Ni > Ni>N. The closed form (A2) is a theorem. Randomness is a probability space (Ω,μ)(\Omega, \mu)(Ω,μ) with a demand path d(ω,⋅)d(\omega, \cdot)d(ω,⋅) whose value in each period is integrable. The integrability of the backlog is not assumed; it follows from the integrability of demand.

The page's informal words are read as follows:

  • "The echelon holding costs are nonnegative" means hi−hi+1≥0h_i - h_{i+1} \ge 0hi​−hi+1​≥0 for 1≤i<N1 \le i < N1≤i<N, and hN≥0h_N \ge 0hN​≥0, i.e. eN≥0e_N \ge 0eN​≥0 with hN+1:=0h_{N+1} := 0hN+1​:=0. The case k=Nk = Nk=N of the proof uses hN≥0h_N \ge 0hN​≥0. Without it the Result is false (N=1N = 1N=1, h1<0h_1 < 0h1​<0).
  • D(0)=0D(0) = 0D(0)=0 is the paper's convention (§2, p. 70) and is added as a hypothesis. Without it (A6) can be infeasible (D≡−1D \equiv -1D≡−1 is nondecreasing).
  • "D( )D(\,)D() is a nondecreasing function" means Monotone D on N\mathbb{N}N.
  • "An optimal solution to P∗\mathbf P^*P∗" means feasible, with objective at most that of every feasible vector.
  • "E[Qi]E[Q_i]E[Qi​]" means the expectation of Qi(t)Q_i(t)Qi​(t) at a fixed period ttt. Every statement holds for all ttt, and stationarity is not assumed. The paper writes E[Qi]E[Q_i]E[Qi​] without ttt because its demand is stationary, and this reading is at least as strong.
  • The demand bound d(a,a+s]≤D(s)d(a, a+s] \le D(s)d(a,a+s]≤D(s) appears only in milestone 2. The Result does not use it, so it is not a hypothesis of the goal.
  • Eq. (A3) is formalized in the sufficiency direction only. The page's necessity remark ("as we assume that the demand bounds can be realized") is not stated.

A non-integrable backlog would make its Bochner integral 000 and erase the backlog terms of the objective. The formalization rules this out by assuming integrable demand, which makes the backlogs integrable; it does not assume the backlogs themselves integrable. Out of scope: the spanning-tree dynamic program of §5, the unproved remarks of §§3–4, the Rosling extension, the Kodak application and the computational study.

Useful contributions include a proof of (A2) by downward induction on stages, the integrability of Qi(t)Q_i(t)Qi​(t), the pathwise version of milestone 4, and the iteration argument that assembles milestones 3, 5 and 6 into the goal.

Selected references

  • S. C. Graves and S. P. Willems, Optimizing Strategic Safety Stock Placement in Supply Chains, Manufacturing & Service Operations Management 2(1):68–83, 2000. https://doi.org/10.1287/msom.2.1.68.23267
  • K. F. Simpson, In-Process Inventories, Operations Research 6(6):863–873, 1958. https://doi.org/10.1287/opre.6.6.863
  • K. Rosling, Optimal Inventory Policies for Assembly Systems under Random Demands, Operations Research 37(4):565–579, 1989. https://doi.org/10.1287/opre.37.4.565
  • L. V. Snyder and Z.-J. M. Shen, Fundamentals of Supply Chain Theory, Wiley, 2nd ed., 2019. https://doi.org/10.1002/9781119584445
9 thms3 active usersReviewed
CombinatoricsOperations ResearchOptimization+1·Captain: mikedeng1

Worst-Case Performance Bounds for Simple One-Dimensional Packing Algorithms 1: First-Fit and Best-Fit Have Asymptotic Worst-Case Ratio 17/10Research Paper

Motivation

Bin packing asks for the fewest unit-capacity bins that hold a given list of item sizes. It is one of the first problems studied through the worst-case analysis of approximation algorithms, and it models storage allocation, paging and file placement on tracks, as well as cutting-stock problems in operations research. Deciding the optimum exactly is NP-hard, so the practical question is how badly simple rules can do. The two simplest on-line rules, First-Fit and Best-Fit, are still the baseline against which every later bin-packing heuristic is measured.

Timeline:

  • 1972. Garey, Graham and Ullman announce that First-Fit uses at most about 1.71.71.7 times the optimal number of bins (Proc. 4th ACM STOC, 1972); Johnson's thesis (MIT, 1973) develops the analysis.
  • 1974. Johnson, Demers, Ullman, Garey and Graham prove FF(L)≤1.7L∗+2FF(L)\le 1.7L^*+2FF(L)≤1.7L∗+2 and BF(L)≤1.7L∗+2BF(L)\le 1.7L^*+2BF(L)≤1.7L∗+2 for every list, and give lists with FF(L)=BF(L)>1.7L∗−8FF(L)=BF(L)>1.7L^*-8FF(L)=BF(L)>1.7L∗−8 for every optimum L∗=kL^*=kL∗=k, so the asymptotic worst-case ratio of both rules is exactly 1710\tfrac{17}{10}1017​ (SIAM J. Comput. 3(4)). This paper is the source of the mission.
  • 1976–2014. The additive constant is lowered: Garey, Graham, Johnson and Yao (1976) show FF(L)≤⌈1.7L∗⌉FF(L)\le\lceil 1.7L^*\rceilFF(L)≤⌈1.7L∗⌉, and Dósa and Sgall prove the tight bound FF(L)≤⌊1.7L∗⌋FF(L)\le\lfloor 1.7L^*\rfloorFF(L)≤⌊1.7L∗⌋ (STACS 2013) and the same bound for Best-Fit (ICALP 2014).

Setting

A list is a finite sequence L=(a1,a2,…,an)L=(a_1,a_2,\dots,a_n)L=(a1​,a2​,…,an​) of real numbers in (0,1](0,1](0,1]; values may repeat. A bin has capacity 111, and its level is the sum of the numbers in it. The optimum L∗L^*L∗ is the minimum number of bins into which the elements of LLL can be placed so that no bin contains numbers whose sum exceeds 111.

Both rules place a1,…,ana_1,\dots,a_na1​,…,an​ in this order into bins B1,B2,…B_1,B_2,\dotsB1​,B2​,…, each initially at level 000, and never move an element once placed.

  1. First-Fit (FF) places aia_iai​ into the bin BjB_jBj​ of least index whose level β\betaβ satisfies β≤1−ai\beta\le 1-a_iβ≤1−ai​.
  2. Best-Fit (BF) places aia_iai​ into a bin whose level β\betaβ satisfies β≤1−ai\beta\le 1-a_iβ≤1−ai​ and is as large as possible, taking the least index among ties.

FF(L)FF(L)FF(L) and BF(L)BF(L)BF(L) are the numbers of nonempty bins at the end. The worst-case ratio at optimum kkk is

RFF(k)=sup⁡{FF(L)L∗:L∗=k},RBF(k)=sup⁡{BF(L)L∗:L∗=k}.R_{FF}(k)=\sup\Bigl\{\frac{FF(L)}{L^*}:L^*=k\Bigr\},\qquad R_{BF}(k)=\sup\Bigl\{\frac{BF(L)}{L^*}:L^*=k\Bigr\}.RFF​(k)=sup{L∗FF(L)​:L∗=k},RBF​(k)=sup{L∗BF(L)​:L∗=k}.

The analysis also uses a weighting function W:[0,1]→[0,1]W:[0,1]\to[0,1]W:[0,1]→[0,1], piecewise linear with W(α)=65αW(\alpha)=\tfrac65\alphaW(α)=56​α on [0,16][0,\tfrac16][0,61​], 95α−110\tfrac95\alpha-\tfrac1{10}59​α−101​ on (16,13](\tfrac16,\tfrac13](61​,31​], 65α+110\tfrac65\alpha+\tfrac1{10}56​α+101​ on (13,12](\tfrac13,\tfrac12](31​,21​] and 111 on (12,1](\tfrac12,1](21​,1], and the coarseness of a bin of a completed packing: the largest 1−level⁡(B′)1-\operatorname{level}(B')1−level(B′) over the bins B′B'B′ of smaller index, and 000 for the first bin.

Formalization targets

Goal: the asymptotic ratio (Corollary of Section 2, p. 306)

lim⁡k→∞RFF(k)=1.7andlim⁡k→∞RBF(k)=1.7.\lim_{k\to\infty}R_{FF}(k)=1.7\qquad\text{and}\qquad\lim_{k\to\infty}R_{BF}(k)=1.7.k→∞lim​RFF​(k)=1.7andk→∞lim​RBF​(k)=1.7.

The goal fixes only the asymptotic ratio and leaves the additive constants free, so it is the statement that survives the later improvements of the constants.

Milestones, in the order the proof uses them

  • Claim 2.2.1 (p. 304): a bin with total size at most 111 has ∑iW(bi)≤1710\sum_i W(b_i)\le\tfrac{17}{10}∑i​W(bi​)≤1017​.
  • Claim 2.2.2 (p. 305): in an FF or BF packing, every element placed into a bin before the bin was more than half full exceeds the bin's coarseness.
  • Claim 2.2.3 (p. 305): a bin of coarseness α<12\alpha<\tfrac12α<21​ whose level exceeds 1−α1-\alpha1−α has weight at least 111.
  • Claim 2.2.4 (p. 306): a bin of coarseness α<12\alpha<\tfrac12α<21​ with weight 1−β1-\beta1−β, β>0\beta>0β>0, either holds a single element at most 12\tfrac1221​ or has level at most 1−α−59β1-\alpha-\tfrac59\beta1−α−95​β.
  • Theorem 2.2 (p. 304): FF(L)≤1.7L∗+2FF(L)\le 1.7L^*+2FF(L)≤1.7L∗+2 and BF(L)≤1.7L∗+2BF(L)\le 1.7L^*+2BF(L)≤1.7L∗+2 for every list.
  • Theorem 2.1 (p. 301): for every k≥1k\ge1k≥1 there is a list with L∗=kL^*=kL∗=k and FF(L)=BF(L)>1.7L∗−8FF(L)=BF(L)>1.7L^*-8FF(L)=BF(L)>1.7L∗−8.

A companion item, not a milestone, records the explicit list of Fig. 3 (p. 307) with L∗=10L^*=10L∗=10 and FF(L)=BF(L)=17FF(L)=BF(L)=17FF(L)=BF(L)=17.

Significance

The result fixes the worst-case behaviour of the two simplest bin-packing heuristics: neither ever uses more than about 70%70\%70% more bins than an optimal packing, and both can be forced to. The weighting-function technique introduced for this bound became the standard method for analysing bin-packing heuristics, including First-Fit Decreasing, Harmonic-type algorithms and on-line lower bounds, and the constant 1710\tfrac{17}{10}1017​ is the reference point for later on-line algorithms.

The theorem is proved, and its constants have since been sharpened. No machine-checked proof of any of these results is known. This mission produces a Lean model of on-line bin packing (the optimum, the First-Fit and Best-Fit runs with their placement history, and the worst-case ratio) that the other missions of this paper and later bin-packing formalizations can reuse. It also produces formal proofs of the weighting-function bounds, of the 1.7L∗+21.7L^*+21.7L∗+2 upper bound and of the lower-bound construction.

Difficulty

The first idea, charging each bin its level, gives only FF(L)≤2L∗+1FF(L)\le 2L^*+1FF(L)≤2L∗+1: at most one bin is at most half full. The ratio 1710\tfrac{17}{10}1017​ comes from bins that are more than half full but far from full, and a bound on the total size of the elements cannot see them. No property of the final packing alone suffices: the bins that are far from full can only be controlled through the order in which the rule opened and filled them, so the argument depends on the dynamics of the run. On the lower-bound side, the natural periodic list (sizes near 16,13,12\tfrac16,\tfrac13,\tfrac1261​,31​,21​, p. 301) gives only the ratio 53\tfrac5335​; reaching 1710\tfrac{17}{10}1017​ needs a list on which both rules waste space in every medium bin, for every kkk, while L∗L^*L∗ is still known exactly.

Formalization scope

A list is L : List ℝ with the hypothesis IsList L (every element in (0,1](0,1](0,1]), and every statement assumes it. L∗L^*L∗ is optBins L, the least b : ℕ for which some assignment Fin L.length → Fin b has every bin sum at most 111. A run is a fold over the list that keeps only the nonempty bins, in index order, each with its contents in placement order. A new bin is opened at the end exactly when no nonempty bin fits, which is the paper's "least jjj" over infinitely many initially empty bins, since elements are positive. The fit test is the non-strict β+ai≤1\beta+a_i\le1β+ai​≤1, and Best-Fit breaks ties by least index. The placement history (the bin chosen for each element and that bin's level just before) is read off the run on the prefix of the list. Indices are 000-based. Coarseness is computed in the completed packing. WWW is a function ℝ → ℝ and is only ever applied to elements of (0,1](0,1](0,1]. RFF(k)R_{FF}(k)RFF​(k) and RBF(k)R_{BF}(k)RBF​(k) are suprema in the extended nonnegative reals [0,∞][0,\infty][0,∞], and the limit is taken there.

A real-valued supremum would be 000 on an empty or unbounded family, and the limit statement would then say nothing about the algorithms. The extended-real supremum rules this trivialization out. Every claim is stated for the concrete First-Fit run and the concrete Best-Fit run, not for an abstract rule with the properties used in the proof.

Claim 2.2.4 is printed with alternative (i) "m=1m=1m=1 and b1<12b_1<\tfrac12b1​<21​", which is false: First-Fit on (0.6,0.5)(0.6,0.5)(0.6,0.5) gives a counterexample. The mission states it with b1≤12b_1\le\tfrac12b1​≤21​, which is what the paper's proof establishes and what the main proof uses. The milestone text keeps the printed version.

The model definitions are reusable for any on-line bin-packing rule, since the run is parameterized by the choice rule. Contributions welcome: proofs of the milestones, general lemmas about the runs (levels stay at most 111, at most one bin is at most half full, the history determines the final packing), and the computation of L∗L^*L∗ for the explicit lists of Theorem 2.1 and Fig. 3.

Selected references

  • D. S. Johnson, A. Demers, J. D. Ullman, M. R. Garey, R. L. Graham, Worst-Case Performance Bounds for Simple One-Dimensional Packing Algorithms, SIAM Journal on Computing 3(4):299–325, 1974. https://doi.org/10.1137/0203025
  • M. R. Garey, R. L. Graham, J. D. Ullman, Worst-case analysis of memory allocation algorithms, Proc. 4th ACM STOC, 1972.
  • D. S. Johnson, Near-Optimal Bin Packing Algorithms, PhD thesis, MIT, 1973.
  • M. R. Garey, R. L. Graham, D. S. Johnson, A. C. Yao, Resource constrained scheduling as generalized bin packing, J. Combinatorial Theory Ser. A 21, 1976.
  • G. Dósa, J. Sgall, First Fit bin packing: A tight analysis, STACS 2013, LIPIcs 20:538–549. https://doi.org/10.4230/LIPIcs.STACS.2013.538
  • G. Dósa, J. Sgall, Optimal analysis of Best Fit bin packing, ICALP 2014, LNCS 8572.
9 thms3 active usersReviewed
CombinatoricsOperations ResearchOptimization+1·Captain: mikedeng1

Worst-Case Performance Bounds for Simple One-Dimensional Packing Algorithms 3: First-Fit Decreasing and Best-Fit Decreasing Use at Most 11/9 L* + 4 BinsResearch Paper

Motivation

Bin packing asks for the fewest unit-capacity bins that hold a given list of item sizes. It models table formatting, the placement of program segments on pages, and the allocation of files to disc tracks, and it is NP-complete, so exact solutions require search in general. Johnson, Demers, Ullman, Garey and Graham (SIAM J. Comput. 3 (1974)) therefore studied four simple placement heuristics and bounded how far each can be from the optimum in the worst case. Their paper is one of the founding results of the worst-case analysis of approximation algorithms.

This mission concerns the two decreasing heuristics, which sort the items from largest to smallest before placing them. For them the paper proves that at most 119\tfrac{11}{9}911​ of the optimum, plus an additive constant, is ever used, and that the factor 119\tfrac{11}{9}911​ cannot be improved.

Timeline.

  • 1973: D. S. Johnson's MIT thesis proves FFD(L)≤119L∗+4FFD(L)\le \tfrac{11}{9}L^*+4FFD(L)≤911​L∗+4; the argument exceeds 75 pages.
  • 1974: Johnson, Demers, Ullman, Garey and Graham publish the bound for FFD and BFD, with a complete proof of the reduction from BFD to FFD and an outline of the FFD argument.
  • 1985: B. S. Baker gives a shorter proof of FFD(L)≤119L∗+3FFD(L)\le\tfrac{11}{9}L^*+3FFD(L)≤911​L∗+3 (J. Algorithms 6).
  • 1991: M. Yue publishes a proof of FFD(L)≤119L∗+1FFD(L)\le\tfrac{11}{9}L^*+1FFD(L)≤911​L∗+1.
  • 2007: G. Dósa determines the tight additive constant, FFD(L)≤119L∗+69FFD(L)\le\tfrac{11}{9}L^*+\tfrac{6}{9}FFD(L)≤911​L∗+96​ (ESCAPE 2007, LNCS 4614).

Setting

A list is a finite sequence L=(a1,a2,…,an)L=(a_1,a_2,\dots,a_n)L=(a1​,a2​,…,an​) of real numbers in (0,1](0,1](0,1]; values may repeat. A bin has capacity 111; its level is the sum of the numbers placed in it. The optimum L∗L^*L∗ is the least number of bins into which the elements of LLL can be distributed so that no bin has level exceeding 111.

The bins B1,B2,…B_1,B_2,\dotsB1​,B2​,… start empty and the elements are placed one at a time, in list order.

  • First-Fit (FF) places aia_iai​ into the bin BjB_jBj​ of least index whose level β\betaβ satisfies β≤1−ai\beta\le 1-a_iβ≤1−ai​.
  • Best-Fit (BF) places aia_iai​ into a bin whose level β\betaβ satisfies β≤1−ai\beta\le 1-a_iβ≤1−ai​ and is as large as possible, the one of least index among ties.
  • First-Fit Decreasing (FFD) and Best-Fit Decreasing (BFD) first arrange LLL into nonincreasing order and then apply FF, respectively BF.

FFD(L)FFD(L)FFD(L) and BFD(L)BFD(L)BFD(L) are the numbers of bins that receive at least one element.

Two auxiliary notions from the paper's proof also appear among the milestones. The position (j,k)(j,k)(j,k) of an element in a packing means that it is the kkk-th element placed into bin jjj. The weight W(X)W(X)W(X) of a collection of elements is defined through kkk-pieces, the elements in (1k+1,1k](\tfrac1{k+1},\tfrac1k](k+11​,k1​]. Each element has the weight w1(x)=⌊1/x⌋−1w_1(x)=\lfloor 1/x\rfloor^{-1}w1​(x)=⌊1/x⌋−1. A pair (x,y)(x,y)(x,y) with xxx a kkk-piece and kx+y≤1kx+y\le1kx+y≤1 has the discounted weight w2(x,y)=w1(x)+k−1kw1(y)w_2(x,y)=w_1(x)+\tfrac{k-1}{k}w_1(y)w2​(x,y)=w1​(x)+kk−1​w1​(y), and any other pair has w1(x)+w1(y)w_1(x)+w_1(y)w1​(x)+w1​(y). W(X)W(X)W(X) is the least total weight over all ways of grouping XXX into singletons and pairs.

Formalization targets

Goal: Theorem 3.2

For every list LLL,

FFD(L)≤119L∗+4andBFD(L)≤119L∗+4.FFD(L)\le \frac{11}{9}L^*+4\qquad\text{and}\qquad BFD(L)\le\frac{11}{9}L^*+4 .FFD(L)≤911​L∗+4andBFD(L)≤911​L∗+4.

The constants are the paper's. Both halves are part of the goal.

Milestones, in the order the argument uses them

  1. Lemma 3.3. If FFD(L)>rL∗+dFFD(L)>rL^*+dFFD(L)>rL∗+d with r,d≥1r,d\ge1r,d≥1, the list L′L'L′ keeping only the elements exceeding (r−1)/r(r-1)/r(r−1)/r also has FFD(L′)>rL′∗+dFFD(L')>rL'^*+dFFD(L′)>rL′∗+d; the same for BFD. With r=119r=\tfrac{11}{9}r=911​ this reduces the goal to lists in (211,1](\tfrac2{11},1](112​,1].
  2. Claims 3.4.5 and 3.4.6, two steps of the proof of Theorem 3.4 that concern only the FFD packing PFPFPF and the BFD run. On [16,1][\tfrac16,1][61​,1], BFD places every element exceeding 13\tfrac1331​ exactly where FFD does. Among the remaining positions of PFPFPF, the lexicographic order of positions respects the order of the sorted list.
  3. Theorem 3.4. If L⊆[16,1]L\subseteq[\tfrac16,1]L⊆[61​,1], then BFD(L)≤FFD(L)BFD(L)\le FFD(L)BFD(L)≤FFD(L). This transfers the bound from FFD to BFD on (211,1](\tfrac2{11},1](112​,1].
  4. Lemma 4.2. For every integer N≥4N\ge4N≥4 and L⊆(1N,12]L\subseteq(\tfrac1N,\tfrac12]L⊆(N1​,21​],
W(L)≥FFD(L)−N+2.W(L)\ge FFD(L)-N+2 .W(L)≥FFD(L)−N+2.
  1. The reduced assertion (Section 4, p. 314). If L⊆(211,1]L\subseteq(\tfrac2{11},1]L⊆(112​,1], then
FFD(L)≤119L∗+4.FFD(L)\le\frac{11}{9}L^*+4 .FFD(L)≤911​L∗+4.
  1. Theorem 3.1, the matching lower bound: for each k≥1k\ge1k≥1 there is a list with L∗=kL^*=kL∗=k and FFD(L)=BFD(L)>119L∗−2FFD(L)=BFD(L)>\tfrac{11}{9}L^*-2FFD(L)=BFD(L)>911​L∗−2.

Significance

The bound makes FFD and BFD, which run in O(nlog⁡n)O(n\log n)O(nlogn) time, the reference heuristics for off-line bin packing. The 119\tfrac{11}{9}911​ bound and its proof technique of weighting functions were the model for the analysis of many later packing and scheduling heuristics. Theorem 3.1 shows that the factor is exact, so together with the goal it determines lim⁡k→∞RFFD(k)=lim⁡k→∞RBFD(k)=119\lim_{k\to\infty}R_{FFD}(k)=\lim_{k\to\infty}R_{BFD}(k)=\tfrac{11}{9}limk→∞​RFFD​(k)=limk→∞​RBFD​(k)=911​, where RA(k)R_A(k)RA​(k) is the largest ratio A(L)/L∗A(L)/L^*A(L)/L∗ over lists with L∗=kL^*=kL∗=k.

The result is proved, but the source proves it only in part. The paper gives complete proofs of Lemma 3.3, Theorem 3.4 and Theorem 3.1. For the reduced assertion it gives only an outline, whose central inequalities involve maps the paper never defines, and it refers to the thesis for the details. Lemma 4.2 is proved in the paper through two claims. A formal proof of the goal must therefore either formalize one of the later complete proofs (Baker 1985, Yue 1991, Dósa 2007) or reconstruct the thesis argument. No machine-checked proof of the 119\tfrac{11}{9}911​ bound is present in Mathlib or on the platform.

Difficulty

The obvious approach, used for First-Fit in Section 2 of the same paper, assigns each element a weight depending only on its size, so that every bin of the algorithm's packing weighs at least 111 and every bin of an optimal packing weighs at most the target ratio. For FFD no weighting of single elements works at ratio 119\tfrac{11}{9}911​. Summing w1w_1w1​ over the elements overcharges the FFD packing: a set of elements fitting into one bin can carry total w1w_1w1​-weight well above 119\tfrac{11}{9}911​. The paper's remedy is a weight defined on pairs, W(X)W(X)W(X), which discounts elements that could share a bin with a larger one. Even with WWW, the bins of FFD whose largest element exceeds 12\tfrac1221​ do not fit the scheme. Handling them requires a case analysis that the paper only sketches and that runs to more than 75 pages in the thesis.

The BFD half cannot be obtained by bounding BFD by FFD in general: there are lists with BFD(L)=109FFD(L)BFD(L)=\tfrac{10}{9}FFD(L)BFD(L)=910​FFD(L). Theorem 3.4 works only because Lemma 3.3 first removes all elements below 211\tfrac2{11}112​.

Formalization scope

Lists are L : List ℝ with the predicate IsList L (0<a≤10<a\le10<a≤1 for every element), assumed by every statement. L∗L^*L∗ is optBins L, the least b : ℕ admitting a map from the items to Fin b with every bin sum at most 111. A run keeps the nonempty bins as a List (List ℝ) in index order and opens a new bin at the end exactly when no nonempty bin fits, which matches the paper's "least jjj" over infinitely many empty bins. The fit test is non-strict. FFD and BFD are FF and BF applied to sortDesc L, a stable merge sort into nonincreasing order. They are defined for every list, so the goal is stated for arbitrary, unsorted LLL. Positions are 000-based pairs (bin, place in bin) read off the run.

WWW sorts its argument into nonincreasing order, so index is the position in that order. It then minimizes over involutions of the positions, which encode the partitions into one- and two-element sets. Weights are real-valued; the paper's use of rationals is incidental. The range hypotheses are exactly the paper's: [16,1][\tfrac16,1][61​,1] is closed in Theorem 3.4, (211,1](\tfrac2{11},1](112​,1] is open at 211\tfrac2{11}112​, and Lemma 4.2 has 1N<a≤12\tfrac1N<a\le\tfrac12N1​<a≤21​.

A weakened goal, such as FFD(L)≤119L∗+cFFD(L)\le\tfrac{11}{9}L^*+cFFD(L)≤911​L∗+c with a larger ccc, a bound for sorted lists only, or the FFD half alone, is a different theorem and does not close the mission. Claims 3.4.1–3.4.4 and 3.4.7 and the inequalities (∗)(*)(∗), (∗∗)(**)(∗∗) of the outline are not stated: they concern the paper's step-by-step construction and the undefined maps fff, ggg.

A complete development needs basic lemmas about FF and BF runs (levels stay at most 111, a new bin opens only when nothing fits, runs on prefixes). It also needs invariance of FFD and BFD under permutations of equal elements, the monotonicity of L∗L^*L∗ under deletion, and L∗≥∑iaiL^*\ge\sum_i a_iL∗≥∑i​ai​. These are reusable in the other missions of this series. Proofs of individual milestones, alternative complete proofs of the goal, and sharper additive constants are all welcome.

Selected references

  • D. S. Johnson, A. Demers, J. D. Ullman, M. R. Garey, R. L. Graham, Worst-Case Performance Bounds for Simple One-Dimensional Packing Algorithms, SIAM Journal on Computing 3(4):299–325, 1974. https://doi.org/10.1137/0203025
  • D. S. Johnson, Near-Optimal Bin Packing Algorithms, Ph.D. thesis, Massachusetts Institute of Technology, 1973 (reference [8] of the paper above).
  • B. S. Baker, A new proof for the first-fit decreasing bin-packing algorithm, Journal of Algorithms 6(1):49–70, 1985. https://doi.org/10.1016/0196-6774(85)90018-5
  • M. Yue, A simple proof of the inequality FFD(L) ≤ 11/9 OPT(L) + 1, ∀L, for the FFD bin-packing algorithm, Acta Mathematicae Applicatae Sinica 7(4):321–331, 1991.
  • G. Dósa, The tight bound of first fit decreasing bin-packing algorithm is FFD(I) ≤ 11/9 OPT(I) + 6/9, ESCAPE 2007, LNCS 4614:1–11, 2007. https://doi.org/10.1007/978-3-540-74450-4_1
10 thms3 active usersReviewed
CombinatoricsOperations ResearchOptimization+1·Captain: mikedeng1

Worst-Case Performance Bounds for Simple One-Dimensional Packing Algorithms 4: First-Fit Decreasing Uses at Most 71/60 L* + 5 Bins When No Item Exceeds 1/2Research Paper

Motivation

Bin packing asks how to place a list of items with sizes in (0,1](0,1](0,1] into as few unit-capacity bins as possible. It models the cutting of stock material, the packing of files onto tracks of a disc and the assignment of jobs to machines with a common deadline. Deciding the optimum is NP-hard, so in practice simple rules are used, and the question is how far they can stray from the optimum in the worst case.

Johnson, Demers, Ullman, Garey and Graham (SIAM J. Comput. 3(4), 1974) gave the first sharp worst-case bounds for the four classical rules. For First-Fit Decreasing (FFD), the rule that sorts the items into nonincreasing order and then places each into the first bin with room, they announced the bound FFD(L)≤119L∗+4FFD(L)\le\frac{11}{9}L^*+4FFD(L)≤911​L∗+4, whose full proof in Johnson's thesis exceeds 75 pages. To show the method, Section 4 of the paper proves a simpler bound in detail: when no item exceeds 1/21/21/2, FFD uses at most 7160L∗+5\frac{71}{60}L^*+56071​L∗+5 bins. That result is the subject of this mission.

Timeline:

  • 1973: D. S. Johnson's MIT thesis, Near-optimal bin packing algorithms, contains the complete proofs of the 11/911/911/9 and 71/6071/6071/60 bounds.
  • 1974: Johnson, Demers, Ullman, Garey and Graham publish the 71/6071/6071/60 bound for lists in (0,1/2](0,1/2](0,1/2] (Theorem 4.1) with a proof that is complete except for parts of two lemmas, and show by example that 71/6071/6071/60 cannot be lowered.
  • 1985: B. S. Baker gives a shorter proof of the 11/911/911/9 bound for FFD (J. Algorithms 6, 1985).
  • 2007: G. Dósa determines the tight additive constant 6/96/96/9 in the 11/911/911/9 bound (ESCAPE 2007, LNCS 4614).

Setting

A list is a finite sequence L=(a1,…,an)L=(a_1,\dots,a_n)L=(a1​,…,an​) of real numbers in (0,1](0,1](0,1]; values may repeat. A bin has capacity 111; its level is the sum of the numbers in it. The optimum L∗L^*L∗ is the least number of bins into which the elements of LLL can be placed with no bin level exceeding 111.

First-Fit places a1,a2,…a_1,a_2,\dotsa1​,a2​,… in order into bins B1,B2,…B_1,B_2,\dotsB1​,B2​,…, each initially at level 000: aia_iai​ goes into the bin of least index whose level β\betaβ satisfies β≤1−ai\beta\le 1-a_iβ≤1−ai​. First-Fit Decreasing first arranges LLL into nonincreasing order and then runs First-Fit. FFD(L)FFD(L)FFD(L) is the number of bins it uses.

The proof uses a weight WWW on finite sets of elements. For an integer k≥1k\ge1k≥1, xxx is a kkk-piece if x∈(1k+1,1k]x\in(\frac1{k+1},\frac1k]x∈(k+11​,k1​], and a kkk-bin is a bin whose largest element is a kkk-piece. Set w1(x)=⌊1/x⌋−1w_1(x)=\lfloor 1/x\rfloor^{-1}w1​(x)=⌊1/x⌋−1. A pair (x,y)(x,y)(x,y) obeys relation kkk if xxx is a kkk-piece and kx+y≤1kx+y\le1kx+y≤1; then w2(x,y)=w1(x)+k−1kw1(y)w_2(x,y)=w_1(x)+\frac{k-1}{k}w_1(y)w2​(x,y)=w1​(x)+kk−1​w1​(y), and otherwise w2(x,y)=w1(x)+w1(y)w_2(x,y)=w_1(x)+w_1(y)w2​(x,y)=w1​(x)+w1​(y). For a partition π\piπ of XXX into one- and two-element sets, with each pair ordered (earlier, later) in the nonincreasing order,

w12(π)=∑{x}∈πw1(x)+∑(x,y)∈πw2(x,y),W(X)=min⁡πw12(π).w_{12}(\pi)=\sum_{\{x\}\in\pi}w_1(x)+\sum_{(x,y)\in\pi}w_2(x,y),\qquad W(X)=\min_\pi w_{12}(\pi).w12​(π)={x}∈π∑​w1​(x)+(x,y)∈π∑​w2​(x,y),W(X)=πmin​w12​(π).

BASIC is the set of elements of LLL that are kkk-pieces lying in a kkk-bin of the FFD packing of LLL, for some kkk; SURPLUS is the rest of LLL.

Formalization targets

Goal: Theorem 4.1

for every list L⊆(0,12]:FFD(L)≤7160L∗+5.\text{for every list } L\subseteq(0,\tfrac12]:\qquad FFD(L)\le\frac{71}{60}L^*+5 .for every list L⊆(0,21​]:FFD(L)≤6071​L∗+5.

The constants are those printed in the paper. The multiplicative constant 71/6071/6071/60 is best possible.

Milestones

  1. Lemma 3.3 (FFD part): if FFD(L)>rL∗+dFFD(L)>rL^*+dFFD(L)>rL∗+d with r,d≥1r,d\ge1r,d≥1, the list L′L'L′ of the elements of LLL exceeding (r−1)/r(r-1)/r(r−1)/r also has FFD(L′)>rL′∗+dFFD(L')>rL'^*+dFFD(L′)>rL′∗+d.
  2. Claim 4.2.1: for N≥4N\ge4N≥4 and L⊆(1N,12]L\subseteq(\frac1N,\frac12]L⊆(N1​,21​], ∑x∈BASICw1(x)≥FFD(L)−∑j=2N−1j−1j\sum_{x\in\mathrm{BASIC}}w_1(x)\ge FFD(L)-\sum_{j=2}^{N-1}\frac{j-1}{j}∑x∈BASIC​w1​(x)≥FFD(L)−∑j=2N−1​jj−1​.
  3. Claim 4.2.2: for N≥4N\ge4N≥4, L⊆(1N,12]L\subseteq(\frac1N,\frac12]L⊆(N1​,21​] and every partition π\piπ of LLL into one- and two-element sets, w12(π)≥w1(BASIC)−∑j=3N−11jw_{12}(\pi)\ge w_1(\mathrm{BASIC})-\sum_{j=3}^{N-1}\frac1jw12​(π)≥w1​(BASIC)−∑j=3N−1​j1​.
  4. Lemma 4.2: for N≥4N\ge4N≥4 and L⊆(1N,12]L\subseteq(\frac1N,\frac12]L⊆(N1​,21​], W(L)≥FFD(L)−N+2W(L)\ge FFD(L)-N+2W(L)≥FFD(L)−N+2.
  5. Subadditivity: W(X1∪⋯∪Xk)≤∑iW(Xi)W(X_1\cup\dots\cup X_k)\le\sum_i W(X_i)W(X1​∪⋯∪Xk​)≤∑i​W(Xi​).
  6. Lemma 4.3: if X⊆(17,12]X\subseteq(\frac17,\frac12]X⊆(71​,21​] and ∑x∈Xx≤1\sum_{x\in X}x\le1∑x∈X​x≤1, then W(X)≤7160W(X)\le\frac{71}{60}W(X)≤6071​.

A companion item states the Remark after Theorem 4.1: for every N≥1N\ge1N≥1 there is a list with all elements below 1/31/31/3, L∗=60NL^*=60NL∗=60N and FFD(L)=71NFFD(L)=71NFFD(L)=71N.

Significance

Theorem 4.1 shows the weighting-function method in its simplest nontrivial form: a weight whose total is within a constant of the algorithm's bin count, and which no feasible bin can exceed by more than the target ratio. The same method, with more elaborate weights, gives the 11/911/911/9 bound for FFD, and it is the model for later worst-case analyses of packing heuristics. The Remark shows that 71/6071/6071/60 is exact for items in (0,1/2](0,1/2](0,1/2], and the Corollary on p. 322 extends the analysis to the asymptotic ratio RFFDαR^\alpha_{FFD}RFFDα​ when items are bounded by α∈(8/29,1/2]\alpha\in(8/29,1/2]α∈(8/29,1/2].

The source proof is partial. The billing argument behind Claim 4.2.2 is given only when two auxiliary conditions (G1) and (G2) hold ("The more intricate argument here omitted", p. 321), and Lemma 4.3 is checked in four of about seventy-four cases ("leaving the remaining 70-odd, more or less routine, cases to the ambitious reader", p. 321). Complete details are in Johnson's thesis. The theorem itself is established. A formalization therefore gives the first complete, checked proof in a single place. The finite case analysis of Lemma 4.3 is well suited to machine checking. No machine-checked proof of any FFD bound is known to exist.

Difficulty

The obvious weight w1w_1w1​ alone fails. Claim 4.2.1 shows that w1(BASIC)w_1(\mathrm{BASIC})w1​(BASIC) covers the FFD bins, but many sets XXX of elements with sum at most 111 have w1(X)>71/60w_1(X)>71/60w1​(X)>71/60, for example two 222-pieces, a 555-piece and a 666-piece. The pair discounts of w2w_2w2​ repair Lemma 4.3, but they must then be paid for in Lemma 4.2, for every partition. That is Claim 4.2.2: a charge from each discounted pair to distinct SURPLUS elements that are no larger. The charge is straightforward only when no member of a pair obeying relation kkk lies in a bin of type k′<kk'<kk′<k. In general a pair's larger element may already have been charged by a smaller relation, and the paper omits the argument that handles this. Lemma 4.3 is elementary but has many cases, each determined by the piece types in XXX and the relations they obey.

Formalization scope

A list is L : List ℝ with IsList L (0<a≤10<a\le10<a≤1 for each element) in every statement. L∗L^*L∗ is optBins L, the least bbb such that some map from positions to Fin b has every bin sum at most 111. The First-Fit run keeps the nonempty bins as a List (List ℝ), and opens a new bin at the end exactly when no existing bin fits, which is the paper's "least jjj". The fit test is β+a≤1\beta+a\le1β+a≤1. FFD is First-Fit on sortDesc L, the mergeSort into nonincreasing order; ties do not affect the bin count. Indices are 000-based.

W(X)W(X)W(X) sorts XXX into nonincreasing order and minimises w12w_{12}w12​ over the involutions of its positions: fixed points are singletons, and a pair i<σ(i)i<\sigma(i)i<σ(i) is oriented (larger, smaller). The minimum is over a finite nonempty set, so it is attained. BASIC is a set of positions of sortDesc L, and each position's bin is its bin in the final FFD packing. In w2w_2w2​, k=⌊1/x⌋k=\lfloor1/x\rfloork=⌊1/x⌋ is the piece type of the first element. Sums ∑j=2N−1\sum_{j=2}^{N-1}∑j=2N−1​ are over Finset.Icc 2 (N - 1) with N≥4N\ge4N≥4.

The goal's range is (0,1/2](0,1/2](0,1/2]. The restriction to (1/7,1/2](1/7,1/2](1/7,1/2] belongs only to the proof, through Lemma 3.3. Stating the goal for (1/7,1/2](1/7,1/2](1/7,1/2], weakening 71/6071/6071/60 or 555, or making WWW an unattained infimum would each change the theorem. Only the FFD half of Lemma 3.3 is stated. Claim 4.2.1 is stated with Lemma 4.2's standing hypothesis N≥4N\ge4N≥4. The Remark's printed range 0<ε≤5/870<\varepsilon\le5/870<ε≤5/87 is a misprint: its FFD packing needs ε<1/174\varepsilon<1/174ε<1/174, and the companion item states only the existence claim.

Infrastructure needed: a usable API for the First-Fit run (the invariants of the fold, bin levels, the order of bins), a lemma that FFD bins receive items in nonincreasing order, and a decision procedure for Lemma 4.3's case analysis over piece types. The model file and the weight file are reusable for the 11/911/911/9 bound (mission 3 of this series) and for the bounded-α\alphaα corollaries. Contributions of proofs of Lemma 4.3 by computer-checked case enumeration, and of the missing general case of Claim 4.2.2, are especially welcome.

Selected references

  • D. S. Johnson, A. Demers, J. D. Ullman, M. R. Garey, R. L. Graham, Worst-Case Performance Bounds for Simple One-Dimensional Packing Algorithms, SIAM J. Comput. 3(4):299–325, 1974. https://doi.org/10.1137/0203025
  • D. S. Johnson, Near-Optimal Bin Packing Algorithms, Ph.D. thesis, Massachusetts Institute of Technology, 1973 (reference [8] of the paper).
  • B. S. Baker, A new proof for the first-fit decreasing bin-packing algorithm, J. Algorithms 6, 1985.
  • G. Dósa, The tight bound of first fit decreasing bin-packing algorithm is FFD(I) ≤ 11/9 OPT(I) + 6/9, ESCAPE 2007, Lecture Notes in Computer Science 4614, 2007.
9 thms3 active usersReviewed
Convex OptimizationLinear algebraLinear Optimization+2·Captain: mikedeng1

Path-Finding Methods for Linear Programming II: Properties of the Regularized D-Optimal-Design Weight FunctionResearch Paper

Motivation

Interior point methods for a linear program min⁡{c⊤x:Ax≥b}\min\{c^\top x : Ax\ge b\}min{c⊤x:Ax≥b} with A∈Rm×nA\in\mathbb R^{m\times n}A∈Rm×n follow the central path of the logarithmic barrier −∑ilog⁡si-\sum_i\log s_i−∑i​logsi​, where s=Ax−bs=Ax-bs=Ax−b is the slack vector. Renegar's path-following analysis (1988) gives O(m L)O(\sqrt m\,L)O(m​L) iterations, and for decades this was the best bound for methods whose iterations cost a linear system solve. Vaidya's volumetric barrier −log⁡det⁡(A⊤S−2A)-\log\det(A^\top S^{-2}A)−logdet(A⊤S−2A) and the hybrid volumetric barriers of Vaidya and of Anstreicher (references [45] and [2] of the paper) reached O((m rank(A))1/4L)O((m\,\mathrm{rank}(A))^{1/4}L)O((mrank(A))1/4L) iterations at the price of more expensive linear algebra. Nesterov and Nemirovski showed that a universal barrier gives O(n L)O(\sqrt n\,L)O(n​L) iterations, but that barrier cannot be evaluated efficiently.

Lee and Sidford (FOCS 2014; full version arXiv:1312.6677) obtained O~(rank(A) L)\tilde O(\sqrt{\mathrm{rank}(A)}\,L)O~(rank(A)​L) iterations, each costing O~(1)\tilde O(1)O~(1) linear system solves, by following a weighted central path whose weights are recomputed from the slacks. The weights come from a weight function ggg, defined as the minimizer of a regularized D-optimal-design problem. This mission is about that weight function and the theorem (Theorem 1 of the paper) certifying its properties. The companion mission, Path-Finding Methods for Linear Programming I, formalizes the path-following framework (Theorem 5 of §IV.C) that consumes these properties.

Setting

Fix A∈Rm×nA\in\mathbb R^{m\times n}A∈Rm×n with full column rank, rank(A)=n\mathrm{rank}(A)=nrank(A)=n, and 1≤n<m1\le n<m1≤n<m. For vectors s,w∈R>0ms,w\in\mathbb R^m_{>0}s,w∈R>0m​ write S=diag(s)S=\mathrm{diag}(s)S=diag(s), W=diag(w)W=\mathrm{diag}(w)W=diag(w), Wα=diag(wiα)W^\alpha=\mathrm{diag}(w_i^\alpha)Wα=diag(wiα​), and As=S−1AA_s=S^{-1}AAs​=S−1A. For a matrix MMM let ∥v∥M=v⊤Mv\|v\|_M=\sqrt{v^\top Mv}∥v∥M​=v⊤Mv​.

Projection matrix and slack sensitivity (Definition 2, p. 428). The projection matrix is PS−1A(w)=W1/2S−1A (A⊤S−1WS−1A)−1A⊤S−1W1/2P_{S^{-1}A}(w)=W^{1/2}S^{-1}A\,(A^\top S^{-1}WS^{-1}A)^{-1}A^\top S^{-1}W^{1/2}PS−1A​(w)=W1/2S−1A(A⊤S−1WS−1A)−1A⊤S−1W1/2, and the slack sensitivity is

γ(s,w)=max⁡i∈[m]∥W−1/21i∥PS−1A(w).\gamma(s,w)=\max_{i\in[m]}\big\|W^{-1/2}\mathbb 1_i\big\|_{P_{S^{-1}A}(w)} .γ(s,w)=i∈[m]max​​W−1/21i​​PS−1A​(w)​.

Weight function (Definition 4, p. 428). A map g:R>0m→R>0mg:\mathbb R^m_{>0}\to\mathbb R^m_{>0}g:R>0m​→R>0m​ is a weight function with constants c1,cγ,crc_1,c_\gamma,c_rc1​,cγ​,cr​ if it is differentiable and, for every s>0s>0s>0, with G(s)=diag(g(s))G(s)=\mathrm{diag}(g(s))G(s)=diag(g(s)), G′(s)G'(s)G′(s) the Jacobian of ggg at sss, and ∥y∥G(s)=∑igi(s)yi2\|y\|_{G(s)}=\sqrt{\sum_ig_i(s)y_i^2}∥y∥G(s)​=∑i​gi​(s)yi2​​:

  1. Size: ∥g(s)∥1≤c1\|g(s)\|_1\le c_1∥g(s)∥1​≤c1​;
  2. Slack sensitivity: cγ≥1c_\gamma\ge1cγ​≥1 and γ(s,g(s))≤cγ\gamma(s,g(s))\le c_\gammaγ(s,g(s))≤cγ​;
  3. Step consistency: cr≥1c_r\ge1cr​≥1 and for all r≥crr\ge c_rr≥cr​, y∈Rmy\in\mathbb R^my∈Rm: ∥(I+r−1G−1G′S)y∥G(s)≤∥y∥G(s)\|(I+r^{-1}G^{-1}G'S)y\|_{G(s)}\le\|y\|_{G(s)}∥(I+r−1G−1G′S)y∥G(s)​≤∥y∥G(s)​ and ∥y+r−1G−1G′Sy∥∞≤∥y∥∞+cr∥y∥G(s)\|y+r^{-1}G^{-1}G'Sy\|_\infty\le\|y\|_\infty+c_r\|y\|_{G(s)}∥y+r−1G−1G′Sy∥∞​≤∥y∥∞​+cr​∥y∥G(s)​;
  4. Uniformity: ∥g(s)∥∞≤2\|g(s)\|_\infty\le2∥g(s)∥∞​≤2.

The regularized objective (6), p. 429. For α,β∈R\alpha,\beta\in\mathbb Rα,β∈R,

f^(s,w)=1⊤w−1αlog⁡det⁡(As⊤WαAs)−β∑i∈[m]log⁡wi,g(s)=arg⁡min⁡w∈R>0mf^(s,w).\hat f(s,w)=\mathbb 1^\top w-\frac1\alpha\log\det\big(A_s^\top W^\alpha A_s\big)-\beta\sum_{i\in[m]}\log w_i ,\qquad g(s)=\arg\min_{w\in\mathbb R^m_{>0}}\hat f(s,w).f^​(s,w)=1⊤w−α1​logdet(As⊤​WαAs​)−βi∈[m]∑​logwi​,g(s)=argw∈R>0m​min​f^​(s,w).

At α=1,β=0\alpha=1,\beta=0α=1,β=0 this is the D-optimal design problem, dual to computing the John ellipsoid of the polytope {y:∣[A(y−x)]i∣≤si}\{y:|[A(y-x)]_i|\le s_i\}{y:∣[A(y−x)]i​∣≤si​} (§V.B).

Formalization targets

Goal: Theorem 1 (Properties of Weight Function), §V.A, p. 429

With

α=1−(log⁡22mrank(A))−1,β=rank(A)2m,\alpha=1-\Big(\log_2\frac{2m}{\mathrm{rank}(A)}\Big)^{-1},\qquad \beta=\frac{\mathrm{rank}(A)}{2m},α=1−(log2​rank(A)2m​)−1,β=2mrank(A)​,

the objective f^(s,⋅)\hat f(s,\cdot)f^​(s,⋅) has a unique minimizer over R>0m\mathbb R^m_{>0}R>0m​ for every s>0s>0s>0, and the resulting ggg is a weight function with

c1(g)=2 rank(A),cγ(g)=2,cr(g)=2log⁡22mrank(A).c_1(g)=2\,\mathrm{rank}(A),\qquad c_\gamma(g)=2,\qquad c_r(g)=2\log_2\frac{2m}{\mathrm{rank}(A)} .c1​(g)=2rank(A),cγ​(g)=2,cr​(g)=2log2​rank(A)2m​.

Milestones: the three bullets of Theorem 1

  • Size: every minimizer www of f^(s,⋅)\hat f(s,\cdot)f^​(s,⋅) satisfies ∥w∥1≤2 rank(A)\|w\|_1\le2\,\mathrm{rank}(A)∥w∥1​≤2rank(A).
  • Slack sensitivity: every minimizer www satisfies γ(s,w)≤2\gamma(s,w)\le2γ(s,w)≤2.
  • Step consistency: any map ggg selecting a minimizer at every s>0s>0s>0 is differentiable on R>0m\mathbb R^m_{>0}R>0m​ and satisfies the two step-consistency inequalities for every r≥2log⁡22mrank(A)r\ge2\log_2\frac{2m}{\mathrm{rank}(A)}r≥2log2​rank(A)2m​.

A supporting (non-milestone) item states the existence and uniqueness of the minimizer on its own.

Significance

The result. Theorem 1 is the input that turns the weighted path-following framework into an O~(rank(A) L)\tilde O(\sqrt{\mathrm{rank}(A)}\,L)O~(rank(A)​L)-iteration method: the framework needs O(cγ−1cr−3c1−1/2)O(c_\gamma^{-1}c_r^{-3}c_1^{-1/2})O(cγ−1​cr−3​c1−1/2​)-sized steps in ttt (p. 428), and Theorem 1 makes that Ω~(1/rank(A))\tilde\Omega(1/\sqrt{\mathrm{rank}(A)})Ω~(1/rank(A)​). The step consistency bound is what allows the weights to be recomputed after each Newton step without losing centrality. The same construction underlies later work on Lewis-weight barriers and on fast approximate John ellipsoids and maximum flow (§VIII of the paper).

Formalizing it. The theorem is proved in the full version of the paper (arXiv:1312.6677); the FOCS extended abstract contains no proofs. No part of it has a machine-checked proof. A complete formalization would give a verified account of leverage-score calculus (sums of leverage scores equal the rank; derivatives of projection matrices), of the convexity of w↦−log⁡det⁡(A⊤WαA)w\mapsto-\log\det(A^\top W^\alpha A)w↦−logdet(A⊤WαA) for α∈(0,1)\alpha\in(0,1)α∈(0,1), and of differentiability of an argmin via the implicit function theorem, none of which is currently packaged in Mathlib in this form.

Difficulty

Size and slack sensitivity are statements about the minimizer, which is only characterized implicitly; they require precise matrix calculus for log⁡det⁡(As⊤WαAs)\log\det(A_s^\top W^\alpha A_s)logdet(As⊤​WαAs​) and a comparison between the matrices A⊤WAA^\top WAA⊤WA (which defines γ\gammaγ) and A⊤WαAA^\top W^\alpha AA⊤WαA (which defines ggg). The specific values of α\alphaα and β\betaβ matter here: the unregularized choice α=1\alpha=1α=1, β=0\beta=0β=0 makes the problem degenerate (p. 429).

The hard part is step consistency. The Jacobian G′G'G′ of an argmin is available only implicitly, as the solution of a linear system obtained by differentiating the optimality condition. A bound on ∥G′∥\|G'\|∥G′∥ that depends on mmm is easy to get and useless: the theorem needs the operator norm of I+r−1G−1G′SI+r^{-1}G^{-1}G'SI+r−1G−1G′S in the G(s)G(s)G(s)-norm to be at most 111 as soon as rrr exceeds 2log⁡2(2m/rank(A))2\log_2(2m/\mathrm{rank}(A))2log2​(2m/rank(A)), and an ℓ∞\ell_\inftyℓ∞​ bound with only an additive cr∥y∥G(s)c_r\|y\|_{G(s)}cr​∥y∥G(s)​ loss.

Existence and differentiability of the minimizer are conclusions, not hypotheses. The minimization is over an open orthant on which the objective is not obviously coercive or strictly convex for α<1\alpha<1α<1, and differentiability of ggg requires the Hessian of f^\hat ff^​ at the minimizer to be invertible.

Formalization scope

Vectors are Fin m → ℝ, matrices Matrix (Fin m) (Fin n) ℝ; inverses are Matrix.inv, log⁡det⁡\log\detlogdet is Real.log (Matrix.det …), wiαw_i^\alphawiα​ is Real.rpow, log⁡2\log_2log2​ is Real.logb 2, the Jacobian is fderiv ℝ g s, and ∥⋅∥∞\|\cdot\|_\infty∥⋅∥∞​ is Mathlib's sup norm on Fin m → ℝ.

Conventions and pinned hypotheses:

  • Full column rank A.rank = n is assumed in every theorem. The paper never states it, but without it As⊤WαAsA_s^\top W^\alpha A_sAs⊤​WαAs​ is singular and every formula is undefined (in Lean, Matrix.inv and Real.log would return junk 000).
  • 1≤n<m1\le n<m1≤n<m. β=rank(A)/(2m)\beta=\mathrm{rank}(A)/(2m)β=rank(A)/(2m) and log⁡2(2m/rank(A))\log_2(2m/\mathrm{rank}(A))log2​(2m/rank(A)) need rank(A)≥1\mathrm{rank}(A)\ge1rank(A)≥1; at m=rank(A)m=\mathrm{rank}(A)m=rank(A) the page's α\alphaα is 000 and 1/α1/\alpha1/α in (6) is undefined.
  • Reading of α\alphaα: the exponent −1-1−1 is the reciprocal of log⁡22mrank(A)\log_2\frac{2m}{\mathrm{rank}(A)}log2​rank(A)2m​, giving α∈(0,1)\alpha\in(0,1)α∈(0,1).
  • Size is an upper bound ∥g(s)∥1≤c1\|g(s)\|_1\le c_1∥g(s)∥1​≤c1​ (the paper's weight function has ∥g(s)∥1=32rank(A)\|g(s)\|_1=\tfrac32\mathrm{rank}(A)∥g(s)∥1​=23​rank(A), while Theorem 1 reports c1=2 rank(A)c_1=2\,\mathrm{rank}(A)c1​=2rank(A)).
  • The first step-consistency bullet (an operator-norm bound) is stated for every vector yyy.
  • ggg is any map Rm→Rm\mathbb R^m\to\mathbb R^mRm→Rm whose value at each positive sss minimizes f^(s,⋅)\hat f(s,\cdot)f^​(s,⋅) over R>0m\mathbb R^m_{>0}R>0m​. Only its values on the open orthant matter. The goal also asserts that such minimizers exist and are unique, so it is not vacuous.

Ruling out trivializations: the goal does not assume ggg to be a weight function or to be differentiable, and it does not replace ggg by an arbitrary weight function; differentiability is a conclusion (a predicate using fderiv without it would make step consistency hold vacuously wherever ggg fails to be differentiable).

Useful infrastructure, reusable beyond this mission: leverage scores and their sum; derivatives of w↦log⁡det⁡(A⊤WA)w\mapsto\log\det(A^\top WA)w↦logdet(A⊤WA) and of projection matrices; convexity of −log⁡det⁡(A⊤WαA)-\log\det(A^\top W^\alpha A)−logdet(A⊤WαA) in www (related to the published ConvexOptimization.log_det_concaveOn); differentiability of the argmin of a strictly convex smooth function. Contributions of these as separate theorems are welcome, as is a proof of any single bullet of Theorem 1.

Selected references

  • Y. T. Lee, A. Sidford, Path Finding Methods for Linear Programming: Solving Linear Programs in Õ(√rank) Iterations and Faster Algorithms for Maximum Flow, FOCS 2014, pp. 424–433. https://doi.org/10.1109/FOCS.2014.52
  • Y. T. Lee, A. Sidford, Path Finding I: Solving Linear Programs with Õ(√rank) Linear System Solves, arXiv, 2013. https://arxiv.org/abs/1312.6677
  • J. Renegar, A polynomial-time algorithm, based on Newton's method, for linear programming, Mathematical Programming 40 (1988). https://doi.org/10.1007/BF01580724
7 thms2 active usersReviewed
PreviousNext

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me