Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in
← Collections

The OR Formalization Drive

Help us formalize the operations research literature in Lean.

1094 missions

Missions

481–500 of 1094
OpenCompletedAll
🏆Completed
Algorithmic Game TheoryOperations ResearchOptimization·Captain: mikedeng1

Approximation Algorithms for Combinatorial Auctions with Complement-Free Bidders III: A Greedy Price-Update Algorithm Is a 2-Approximation for XOS BiddersResearch Paper

Motivation

In a combinatorial auction a set of mmm items is sold to nnn bidders who value bundles of items rather than single items. Spectrum auctions, procurement of transportation lanes and the allocation of cloud resources all have this form, and the central algorithmic question is how to allocate the items so as to maximize the social welfare, the sum of the bidders' values for what they receive. Even to describe a general valuation takes 2m2^m2m numbers, so algorithms access the bidders through queries, and the achievable approximation depends on the class of valuations allowed.

Dobzinski, Nisan and Schapira (Math. Oper. Res. 35(1), 2010) study bidders without complementarities. For the class of XOS valuations, maxima of additive valuations, which strictly contains the submodular valuations, they give LP-based algorithms and, in §3.3, a purely combinatorial algorithm: bidders arrive one at a time, take their demanded bundle at the current item prices, and raise the prices of what they took. Its analysis charges the welfare of any allocation to the item prices the algorithm sets, an argument that uses only the demand and XOS oracles.

Setting

The items are M={1,…,m}M=\{1,\dots,m\}M={1,…,m} and the bidders 1,…,n1,\dots,n1,…,n.

  • An additive valuation (a clause) www assigns nonnegative values w(1),…,w(m)w(1),\dots,w(m)w(1),…,w(m) to the items and w(S)=∑j∈Sw(j)w(S)=\sum_{j\in S}w(j)w(S)=∑j∈S​w(j) to a bundle S⊆MS\subseteq MS⊆M.
  • An XOS valuation vvv is given by a nonempty finite set of clauses {w1,…,wt}\{w_1,\dots,w_t\}{w1​,…,wt​} (its XOS expression) through v(S)=max⁡kwk(S)v(S)=\max_k w_k(S)v(S)=maxk​wk​(S). A clause wkw_kwk​ with wk(S)=v(S)w_k(S)=v(S)wk​(S)=v(S) is a maximizing clause for SSS. Every XOS valuation is normalized, v(∅)=0v(\emptyset)=0v(∅)=0, and monotone.
  • An allocation is a tuple of pairwise disjoint bundles O1,…,OnO_1,\dots,O_nO1​,…,On​; items may stay unallocated. Its welfare is ∑ivi(Oi)\sum_i v_i(O_i)∑i​vi​(Oi​).
  • A demand oracle for bidder iii answers, given item prices p∈Rmp\in\mathbb R^mp∈Rm, a bundle maximizing vi(T)−∑j∈Tpjv_i(T)-\sum_{j\in T}p_jvi​(T)−∑j∈T​pj​. An XOS oracle answers, given a bundle SSS, a maximizing clause for SSS in viv_ivi​.

The greedy price-update algorithm. Start with all bundles empty and all prices pj=0p_j=0pj​=0. For i=1,…,ni=1,\dots,ni=1,…,n: let SiS_iSi​ be bidder iii's demand at the current prices; remove the items of SiS_iSi​ from the bundles of the earlier bidders; let qiq^iqi be the maximizing clause for SiS_iSi​ in viv_ivi​; set pj=qjip_j=q^i_jpj​=qji​ for j∈Sij\in S_ij∈Si​. Write pkp^kpk for the prices after stage kkk (p0=0p^0=0p0=0), pk(T)=∑j∈Tpjkp^k(T)=\sum_{j\in T}p^k_jpk(T)=∑j∈T​pjk​, and A1,…,AnA_1,\dots,A_nA1​,…,An​ for the final bundles.

In the Lean development these objects are XOSExpr, XOSExpr.val, IsAllocation, welfare, IsDemandOracle, IsXOSOracle, greedyState, greedyPrices and greedyAlloc in the namespace ComplementFreeCA.XOSGreedy.

Formalization targets

Goal: Theorem 3.3

For XOS valuations v1,…,vnv_1,\dots,v_nv1​,…,vn​, every demand oracle and every XOS oracle, and every allocation O1,…,OnO_1,\dots,O_nO1​,…,On​,

∑i=1nvi(Oi)  ≤  2∑i=1nvi(Ai).\sum_{i=1}^n v_i(O_i)\;\le\;2\sum_{i=1}^n v_i(A_i).i=1∑n​vi​(Oi​)≤2i=1∑n​vi​(Ai​).

The comparison with every allocation is the paper's comparison with the optimal allocation.

Milestones

  1. Lemma 3.4. The final prices are paid for by the algorithm's welfare:
pn(M)≤∑ivi(Ai).p^n(M)\le\sum_i v_i(A_i).pn(M)≤i∑​vi​(Ai​).
  1. Lemma 3.5. Prices never decrease: pjk≤pjk′p^k_j\le p^{k'}_jpjk​≤pjk′​ for all items jjj and stages k≤k′k\le k'k≤k′.
  2. Lemma 3.6. For every allocation OOO,
∑ivi(Oi)≤2 pn(M).\sum_i v_i(O_i)\le 2\,p^n(M).i∑​vi​(Oi​)≤2pn(M).

Three further statements are included without being milestones: the output A1,…,AnA_1,\dots,A_nA1​,…,An​ is an allocation (used implicitly by the paper); the first sentence of the proof of Lemma 3.6, that with Δi=pi(M)−pi−1(M)\Delta^i=p^i(M)-p^{i-1}(M)Δi=pi(M)−pi−1(M) one has Δi=max⁡T⊆M(vi(T)−pi−1(T))\Delta^i=\max_{T\subseteq M}\bigl(v_i(T)-p^{i-1}(T)\bigr)Δi=maxT⊆M​(vi​(T)−pi−1(T)); and the factor 222 is attained on the paper's two-item, two-bidder example (p. 9).

Significance

Theorem 3.3 shows that a factor-2 approximation of the optimal welfare for XOS bidders needs no linear program: one pass over the bidders, one demand query and one XOS query each. The paper's LP-based algorithm of §3.2 attains the better ratio e/(e−1)e/(e-1)e/(e−1), and Theorem 4.1 of the paper shows that for the larger class of complement-free bidders no (2−ϵ)(2-\epsilon)(2−ϵ)-approximation is possible with polynomial communication.

The result is proved in the paper; to the best of our knowledge it has no machine-checked proof. This mission produces a formal model of XOS valuations, demand and XOS oracles and the greedy run that is reusable for other price-based arguments, and a formal proof of the guarantee for every tie-breaking in both oracles.

Difficulty

The argument is elementary, but its bookkeeping is where a formal proof can go wrong. Items move between bidders: an item taken from an earlier bidder in step (b) is re-priced in step (d), and every priced item lies in exactly one final bundle. Lemma 3.4 needs this invariant across all nnn stages, together with the fact that a maximizing clause for the demanded set bounds viv_ivi​ on every subset, which holds because it is a clause of viv_ivi​ itself, not merely an additive function agreeing with viv_ivi​ on SiS_iSi​. Lemma 3.5 is a contradiction argument using optimality of the demand; Lemma 3.6 telescopes the price increases and needs prices to stay nonnegative. The argument must hold for arbitrary oracle answers, so no canonical demand can be assumed.

Formalization scope

  • Bidders are Fin n, items Fin m, bundles Finset (Fin m), values in ℝ. An XOS valuation is represented by its expression: a nonempty Finset (Fin m → ℝ) of clauses with nonnegative entries, evaluated with Finset.sup'. The paper's standing assumptions, normalized and monotone valuations (p. 1), hold automatically in this representation.
  • The oracles are function parameters dem : Fin n → (Fin m → ℝ) → Finset (Fin m) and cl : Fin n → Finset (Fin m) → (Fin m → ℝ) with hypotheses IsDemandOracle and IsXOSOracle; every theorem holds for every such pair, so no tie-breaking rule is fixed.
  • The run is a recursion on the stage: stage k+1k+1k+1 processes the 0-based bidder kkk, i.e. the paper's bidder k+1k+1k+1; after stage nnn the state is constant.
  • The paper's goal compares with the optimal allocation; the Lean goal compares with every allocation, which is equivalent and avoids an argmax. Stating the bound against one particular allocation, or against the algorithm's own output, would be trivial and is excluded.
  • There are no O(⋅)O(\cdot)O(⋅) constants: the factor 222 is the paper's.
  • Printed slip: the model on p. 1 writes an allocation as S1,…,SmS_1,\dots,S_mS1​,…,Sm​; it is one bundle per bidder, S1,…,SnS_1,\dots,S_nS1​,…,Sn​.
  • Out of scope: running time, the cost of simulating oracles (Proposition 2.1), and communication lower bounds.

Contributions welcome: proofs of the three milestones and of the goal, and reusable lemmas on the invariant that every priced item lies in exactly one final bundle.

Selected references

  • S. Dobzinski, N. Nisan, M. Schapira, Approximation Algorithms for Combinatorial Auctions with Complement-Free Bidders, Mathematics of Operations Research 35(1):1–13, 2010. https://doi.org/10.1287/moor.1090.0436
  • B. Lehmann, D. Lehmann, N. Nisan, Combinatorial auctions with decreasing marginal utilities, Games and Economic Behavior 55(2):270–296, 2006. https://doi.org/10.1016/j.geb.2005.02.006
6 thms2 active usersReviewed
🏆Completed
Algorithmic Game TheoryMechanism DesignOperations Research+1·Captain: mikedeng1

Approximation Algorithms for Combinatorial Auctions with Complement-Free Bidders IV: A Truthful Value-Query Mechanism for Subadditive BiddersResearch Paper

Motivation

In a combinatorial auction a seller offers several indivisible items at once, and bidders value bundles of items rather than items one at a time. Allocating the items to maximize total value is the central optimization problem of the area, and it arises in spectrum licensing, procurement and transport contracting (Cramton, Shoham and Steinberg, Combinatorial Auctions, MIT Press, 2006). Two obstacles meet. Computationally, a valuation has 2m2^m2m numbers, so an algorithm can only query it, and even then optimization is hard. Strategically, the valuations are private: a bidder reports whatever maximizes its own utility, so an algorithm that is a good approximation on true inputs may be useless on reported ones.

The classical answer to the strategic obstacle is the VCG payment scheme, which makes truthful reporting a dominant strategy but requires the exact optimum. Nisan and Ronen (2007) showed that an approximation algorithm becomes truthful under VCG payments essentially only when it is maximal in range: it fixes a restricted set of allocations in advance and optimizes exactly over that set. Dobzinski, Nisan and Schapira (Math. Oper. Res. 35(1), 2010, §5) give such an algorithm for complement-free (subadditive) bidders that uses only value queries and loses a factor of order m\sqrt mm​. For general valuations in the value-query model the paper cites a lower bound of order m/log⁡mm/\log mm/logm (Dobzinski and Schapira, working paper 2005; Blumrosen and Nisan, Hebrew University Discussion Paper 381, 2005; see the paper's references [7] and [2]), and the same paper (Theorem 6.1) shows that even XOS bidders cannot be approximated within m1/2−ϵm^{1/2-\epsilon}m1/2−ϵ with polynomially many value queries.

Setting

A set M={1,…,m}M=\{1,\dots,m\}M={1,…,m} of items is sold to nnn bidders. Bidder iii has a valuation viv_ivi​ that assigns a real number vi(S)v_i(S)vi​(S) to every bundle S⊆MS\subseteq MS⊆M. Throughout, valuations are normalized, vi(∅)=0v_i(\emptyset)=0vi​(∅)=0, and monotone, S⊆T⇒vi(S)≤vi(T)S\subseteq T\Rightarrow v_i(S)\le v_i(T)S⊆T⇒vi​(S)≤vi​(T). A valuation is complement free (CF) if v(S∪T)≤v(S)+v(T)v(S\cup T)\le v(S)+v(T)v(S∪T)≤v(S)+v(T) for all bundles S,TS,TS,T. An allocation A=(A1,…,An)A=(A_1,\dots,A_n)A=(A1​,…,An​) gives the bidders pairwise disjoint bundles (items may stay unallocated), and its social welfare is ∑ivi(Ai)\sum_i v_i(A_i)∑i​vi​(Ai​).

The mechanism receives reports b=(b1,…,bn)b=(b_1,\dots,b_n)b=(b1​,…,bn​) and runs the following algorithm ALG\mathrm{ALG}ALG:

  1. query bi(M)b_i(M)bi​(M) and bi({j})b_i(\{j\})bi​({j}) for every bidder iii and item jjj;
  2. compute a maximum-weight matching PPP in the complete bipartite graph between items and bidders, where the edge between item jjj and bidder iii costs bi({j})b_i(\{j\})bi​({j});
  3. if the bidder ttt maximizing bi(M)b_i(M)bi​(M) has bt(M)b_t(M)bt​(M) strictly larger than the weight ∣P∣|P|∣P∣, give all items to ttt; otherwise give every item matched by PPP to its matched bidder.

Its range RRR is the set of allocations that give all of MMM to one bidder, together with the allocations in which every bidder receives at most one item. Under VCG payments bidder iii receives ∑k≠ibk(ALG(b)k)\sum_{k\ne i}b_k(\mathrm{ALG}(b)_k)∑k=i​bk​(ALG(b)k​), so its utility is vi(ALG(b)i)+∑k≠ibk(ALG(b)k)v_i(\mathrm{ALG}(b)_i)+\sum_{k\ne i}b_k(\mathrm{ALG}(b)_k)vi​(ALG(b)i​)+∑k=i​bk​(ALG(b)k​). The mechanism is incentive compatible on a class of valuations if no bidder can raise its utility by misreporting within that class, whatever the others report.

Formalization targets

Goal: Theorem 5.1 (p. 11)

For every choice of the maximum-weight matching and of the top bidder as functions of the reports, for every profile vvv of normalized, monotone, CF valuations and every allocation OOO,

∑i=1nvi(Oi)  ≤  2m ∑i=1nvi(ALG(v)i),\sum_{i=1}^n v_i(O_i)\;\le\;2\sqrt m\,\sum_{i=1}^n v_i\big(\mathrm{ALG}(v)_i\big),i=1∑n​vi​(Oi​)≤2m​i=1∑n​vi​(ALG(v)i​),

and the mechanism (ALG,VCG payments)(\mathrm{ALG},\text{VCG payments})(ALG,VCG payments) is incentive compatible on the CF valuations.

Milestones, in attack order

  1. §5.1, VCG. Welfare maximization with Groves payments is incentive compatible (a published platform theorem, AGT.vcg_incentive_compatible).
  2. §5.1, maximal in range. Any allocation rule that optimizes reported welfare exactly over a fixed range is incentive compatible under VCG payments on the same domain.
  3. ALG is maximal in range with range RRR on normalized reports.
  4. The CF single-item bound. For a CF valuation and c∈Tc\in Tc∈T maximizing v({j})v(\{j\})v({j}) over TTT: v(T)≤∑j∈Tv({j})≤∣T∣ v({c})v(T)\le\sum_{j\in T}v(\{j\})\le|T|\,v(\{c\})v(T)≤∑j∈T​v({j})≤∣T∣v({c}).
  5. First case. If bidders with ∣Oi∣≥m|O_i|\ge\sqrt m∣Oi​∣≥m​ carry at least half the welfare of OOO, then ∑ivi(Oi)≤2m vt(M)\sum_i v_i(O_i)\le 2\sqrt m\,v_t(M)∑i​vi​(Oi​)≤2m​vt​(M) for the top bidder ttt.
  6. Second case. Otherwise some allocation in which every bidder gets at most one item has welfare at least ∑ivi(Oi)/(2m)\sum_i v_i(O_i)/(2\sqrt m)∑i​vi​(Oi​)/(2m​).

Significance

The theorem shows that, for subadditive bidders, the m\sqrt mm​ barrier known for general valuations can be matched by a truthful mechanism that asks each bidder only m+1m+1m+1 value queries. It is one of the early examples of maximal-in-range mechanism design, a template later used for many truthful approximation mechanisms in combinatorial auctions, and it sits against Theorem 6.1 of the same paper, which shows that for XOS bidders no value-query algorithm with polynomially many queries does better than m1/2−ϵm^{1/2-\epsilon}m1/2−ϵ.

The result is proved in the paper. What this mission adds is a machine-checked proof: a formal model of VCG-based mechanisms over a restricted range, a proof that the §5.2 algorithm is maximal in range for every tie-breaking of its two optimization steps, and the explicit constant 222 in the O(m)O(\sqrt m)O(m​) bound. To our knowledge neither half of Theorem 5.1 is formalized elsewhere; the general VCG theorem exists on the platform in the setting of arbitrary outcome sets.

Difficulty

The approximation argument partitions the bidders of a reference allocation by whether their bundles have at least m\sqrt mm​ items, and the two cases need different facts: disjointness bounds the number of large bundles by m\sqrt mm​, and subadditivity bounds each small bundle by its size times its best item. A naive transcription breaks at degenerate inputs: the page divides by ∣Ti∣|T_i|∣Ti​∣ and writes strict inequalities, both of which fail when a bundle is empty or all values are zero, so the formal statement must be organized around non-strict bounds.

Incentive compatibility has a different obstacle. It holds only if the allocation rule depends on the reports alone and optimizes exactly over its range, including at ties between the grand bundle and the matching. The matching and the top bidder are not unique, so the proof must work for an arbitrary but fixed tie-breaking, and the welfare of the matching allocation must be identified with the matching weight, which uses normalization of every bidder who receives nothing.

Formalization scope

Bidders are Fin n, items Fin m, bundles Finset (Fin m), valuations Finset (Fin m) → ℝ. Normalization and monotonicity (the paper's standing assumptions, p. 1) and complement freedom are hypotheses; IsCFValuation bundles all three. An allocation is a family of pairwise disjoint bundles; unallocated items are allowed. A matching is a partial map Fin m → Option (Fin n) with no bidder matched twice.

Conventions the formalization commits to:

  • Explicit constant. The paper writes O(m)O(\sqrt m)O(m​); its proof yields 2m2\sqrt m2m​ (both cases end with ∣OPT∣/(2m)|OPT|/(2\sqrt m)∣OPT∣/(2m​)), and the goal states 2m2\sqrt m2m​ with Real.sqrt m.
  • Oracles and ties. The maximum-weight matching and the top bidder enter as functions mat, top of the report profile, each with a specification hypothesis; the goal is stated for every such pair. The algorithm reads only the reports; the tie between bt(M)b_t(M)bt​(M) and ∣P∣|P|∣P∣ goes to the matching, as on the page.
  • Payments. The mechanism pays each bidder ∑k≠ibk(⋅)\sum_{k\ne i}b_k(\cdot)∑k=i​bk​(⋅), the paper's convention (footnote 2, p. 11); incentive compatibility is stated on the CF domain, the paper's. The local definition mirrors AGT.MechIncentiveCompatible on outcomes a↦vi(ai)a\mapsto v_i(a_i)a↦vi​(ai​).
  • Reference allocation. The approximation is stated against every allocation OOO, not only an optimal one; this is equivalent and avoids a junk maximum.
  • Printed slips. The strict inequalities and the division by ∣Ti∣|T_i|∣Ti​∣ in the second case are replaced by non-strict, multiplied forms; the first case concludes for a bidder maximizing vi(M)v_i(M)vi​(M) rather than vi(Oi)v_i(O_i)vi​(Oi​).
  • Degenerate sizes. At m=0m=0m=0 everything is zero and the bound holds trivially; with n=0n=0n=0 no top-bidder rule exists.
  • Out of scope. "In polynomial time" is a running-time claim and is not modelled.

A trivializing formalization is ruled out: the ratio is the explicit 2m2\sqrt m2m​ rather than an existential constant, incentive compatibility is over the full CF domain (not additive reports only) for a rule that cannot see true valuations, and the rules mat, top are satisfiable (a maximum over the finitely many matchings exists; a top bidder exists when n≥1n\ge1n≥1).

Useful infrastructure: finite maximum-weight matchings on complete bipartite graphs, subadditivity bounds over Finset sums, and a reusable lemma that maximal-in-range rules with VCG payments are truthful. Contributions of any milestone are welcome; milestones 2 and 4 are self-contained.

Selected references

  • S. Dobzinski, N. Nisan, M. Schapira, Approximation Algorithms for Combinatorial Auctions with Complement-Free Bidders, Mathematics of Operations Research 35(1):1–13, 2010. https://doi.org/10.1287/moor.1090.0436
  • N. Nisan, A. Ronen, Computationally Feasible VCG Mechanisms, Journal of Artificial Intelligence Research 29:19–47, 2007. https://doi.org/10.1613/jair.2046
  • S. Dobzinski, M. Schapira, Optimal Upper and Lower Approximation Bounds for k-Duplicates Combinatorial Auctions, working paper, The Hebrew University of Jerusalem, 2005 (reference [7] of the paper).
  • L. Blumrosen, N. Nisan, On the Computational Power of Iterative Auctions I: Demand Queries, Discussion Paper 381, Center for the Study of Rationality, The Hebrew University of Jerusalem, 2005 (reference [2] of the paper).
  • N. Nisan, Introduction to Mechanism Design (for Computer Scientists), in N. Nisan, T. Roughgarden, E. Tardos, V. Vazirani (eds.), Algorithmic Game Theory, Cambridge University Press, 2007, pp. 209–242.
  • P. Cramton, Y. Shoham, R. Steinberg (eds.), Combinatorial Auctions, MIT Press, 2006.
8 thms4 active usersReviewed
🏆Completed
CombinatoricsGraph TheoryOperations Research+2·Captain: mikedeng1

An Analysis of Several Heuristics for the Traveling Salesman Problem IV: Insertion Heuristics Can Return Poor k-Optimal ToursResearch Paper

Motivation

Insertion heuristics build a traveling salesman tour one city at a time: start from a single city, and at each step choose a city not yet on the subtour and splice it into the subtour where it lengthens the subtour least. Local search heuristics start from a tour and repeatedly replace a few of its edges by others while this shortens the tour. Both families are standard in practice, and a natural engineering idea is to combine them: run an insertion heuristic, then polish the result by local search. The question this mission formalizes is whether local optimality of the insertion tour certifies anything about its quality.

Rosenkrantz, Stearns and Lewis (SIAM J. Comput. 6(3), 1977) answered this for graphs satisfying the triangle inequality. Their §4 proves that nearest and cheapest insertion always return a tour of length at most 2(1−1/n)2(1-1/n)2(1−1/n) times the optimal length, and their Theorem 5 shows this bound is attained. Their §7 then shows that the very tour attaining the bound is kkk-optimal for every k≤n/4k\le n/4k≤n/4: no exchange of kkk edges shortens it. So the insertion bound is tight even for tours that local search with kkk-changes cannot improve.

Timeline, as far as this mission is concerned:

  • 1965: Lin (Bell System Tech. J. 44) defines kkk-optimal tours and uses 3-optimal local search.
  • 1973: Lin and Kernighan (Oper. Res. 21) generalize the edge-exchange neighbourhoods.
  • 1977: Rosenkrantz, Stearns and Lewis prove the 2(1−1/n)2(1-1/n)2(1−1/n) upper bound for nearest and cheapest insertion (Theorem 4 and its corollary), its tightness for n≥6n\ge 6n≥6 (Theorem 5), the existence of kkk-optimal tours with the same ratio (Theorem 6, stated for n≥8n\ge 8n≥8), and the Corollary combining the two.

Setting

A traveling salesman graph on nnn nodes is the node set N={1,…,n}N=\{1,\dots,n\}N={1,…,n} with a distance d(i,j)≥0d(i,j)\ge 0d(i,j)≥0 that is symmetric and satisfies the triangle inequality d(i,k)≤d(i,j)+d(j,k)d(i,k)\le d(i,j)+d(j,k)d(i,k)≤d(i,j)+d(j,k). A tour is a Hamiltonian circuit; its length is the sum of its edge lengths; OPTIMAL is the least length of a tour. As in the paper, the identically zero distance is excluded, so OPTIMAL >0>0>0.

A subtour is a circuit on a subset of the nodes (a single node is a subtour without edges). For a subtour TTT and a node k∉Tk\notin Tk∈/T, TOUR(T,k)(T,k)(T,k) is obtained by deleting an edge (x,y)(x,y)(x,y) of TTT minimizing d(x,k)+d(k,y)−d(x,y)d(x,k)+d(k,y)-d(x,y)d(x,k)+d(k,y)−d(x,y) and adding (x,k)(x,k)(x,k) and (k,y)(k,y)(k,y); COST(T,k)(T,k)(T,k) is the resulting increase in length. An insertion method chooses nodes a0,a1,…,an−1a_0,a_1,\dots,a_{n-1}a0​,a1​,…,an−1​, starts from T1={a0}T_1=\{a_0\}T1​={a0​} and sets Ti+1=TOUR(Ti,ai)T_{i+1}=\mathrm{TOUR}(T_i,a_i)Ti+1​=TOUR(Ti​,ai​); INSERT is the length of TnT_nTn​. Nearest insertion chooses aia_iai​ minimizing d(Ti,x)=min⁡y∈Tid(y,x)d(T_i,x)=\min_{y\in T_i}d(y,x)d(Ti​,x)=miny∈Ti​​d(y,x) over x∉Tix\notin T_ix∈/Ti​; cheapest insertion chooses aia_iai​ minimizing COST(Ti,x)(T_i,x)(Ti​,x). Ties are broken arbitrarily.

A kkk-change of a tour deletes kkk of its edges and adds kkk other edges so that another tour is obtained. A tour is kkk-optimal if no kkk-change produces a strictly shorter tour.

The extremal instance is the circle (Nn,dn)(N_n,d_n)(Nn​,dn​): nnn cities equally spaced on a circular road, with dn(i,j)d_n(i,j)dn​(i,j) the smallest m≥0m\ge 0m≥0 with i−j≡mi-j\equiv mi−j≡m or j−i≡m(modn)j-i\equiv m \pmod nj−i≡m(modn). The insertion run of Theorem 5 inserts the cities in the order 1,2,…,n1,2,\dots,n1,2,…,n and produces the zig-zag tour TnT_nTn​: city 1, then the even cities in increasing order, then the odd cities in decreasing order.

Formalization targets

Goal: the Corollary to Theorem 6

For n≥6n\ge 6n≥6 and 4k≤n4k\le n4k≤n there is a traveling salesman graph with OPTIMAL >0>0>0 on which some run of nearest insertion, and some run of cheapest insertion, return a kkk-optimal tour with

INSERTOPTIMAL=2(1−1n).\frac{\mathrm{INSERT}}{\mathrm{OPTIMAL}}=2\left(1-\frac1n\right).OPTIMALINSERT​=2(1−n1​).

Milestones

  1. The insertion run on the circle: the subtours TiT_iTi​ and nodes ai=i+1a_i=i+1ai​=i+1 form an insertion run that obeys both the nearest and the cheapest rule (proof of Theorem 5).
  2. On the circle, TnT_nTn​ has length 2(n−1)2(n-1)2(n−1) and OPTIMAL =n=n=n (proof of Theorem 5).
  3. Theorem 5: for n≥6n\ge 6n≥6 there is a graph with INSERT/OPTIMAL =2(1−1/n)=2(1-1/n)=2(1−1/n) for both methods.
  4. Equation (7.4): the length of a tour of the circle is the sum over unit edges eee of COUNT(e,T)(e,T)(e,T), the number of times eee is traversed when each tour edge is replaced by a shortest arc.
  5. Every tour of the circle is odd or even (all counts of one parity), eq. (7.5).
  6. TnT_nTn​ is the shortest even tour, so every tour shorter than TnT_nTn​ is odd.
  7. TnT_nTn​ is kkk-optimal for every k≤n/4k\le n/4k≤n/4.
  8. Theorem 6: for n≥8n\ge 8n≥8 there is a graph with a tour that is kkk-optimal for all k≤n/4k\le n/4k≤n/4 and has LOCALOPT/OPTIMAL =2(1−1/n)=2(1-1/n)=2(1−1/n).

Significance

The result. The Corollary shows that the 2(1−1/n)2(1-1/n)2(1−1/n) worst-case guarantee of nearest and cheapest insertion cannot be improved by requiring that the returned tour survive kkk-change local search, for kkk up to a quarter of the number of cities. Theorem 6 says more generally that kkk-optimality with k≤n/4k\le n/4k≤n/4 does not bound the ratio to the optimum below 2(1−1/n)2(1-1/n)2(1−1/n). Together with the paper's upper bound, the insertion guarantee is exact, and it stays exact after local polishing with small neighbourhoods.

Formalizing it. All statements are proved in the paper; none, to our knowledge, has been machine-checked. The platform has an upper bound for nearest insertion (SupplyChainTheory, Theorem 10.7, ratio at most 2) but no tightness example and no notion of kkk-optimality. This mission produces a reusable definition of kkk-changes against arbitrary tours, the circle metric, and the parity-counting argument on a cycle, and it supplies the calculations the paper omits ("We omit these calculations but note that they require the assumption n≥6n\ge 6n≥6").

Difficulty

Two steps carry the weight. First, the omitted calculations for the insertion run: at each stage one must show that inserting aia_iai​ between i−1i-1i−1 and iii minimizes the insertion increase over every edge of the zig-zag subtour, and that no other outside city can be inserted for less than 2; the claim fails for n=4n=4n=4 and n=5n=5n=5, so the verification must use n≥6n\ge 6n≥6 in an essential way. Second, kkk-optimality is a statement about every tour at edge difference kkk, not about 2-opt segment reversals or any specific move family. A search over moves of a special form does not establish it; the argument must bound the length of an arbitrary tour at edge difference kkk from below.

Formalization scope

Nodes are Fin n, so the paper's node mmm is index m−1m-1m−1 and ai=i+1a_i=i+1ai​=i+1 is index iii; subtour indices stay 1-based (T1=[a0]T_1=[a_0]T1​=[a0​], approximation TnT_nTn​). A distance is d : Fin n → Fin n → ℝ with the structure IsTSPDist (symmetric, nonnegative, triangle inequality, and d(i,i)=0d(i,i)=0d(i,i)=0; the last is a normalization absent from the paper that changes no length). A tour is an Equiv.Perm (Fin n), a subtour a list read cyclically; OPTIMAL is Finset.univ.inf' over permutations, the true minimum. TOUR(T,k)(T,k)(T,k) is insertion at a position minimizing the new length; COST is a minimum over positions; the nearest-insertion distance (4.1) takes values in WithTop ℝ, so no junk value arises. kkk-optimality compares the tour with every permutation whose edge set (unordered pairs) misses exactly kkk of the tour's edges. Ratios are multiplied out.

COUNT(e,T)(e,T)(e,T) needs a choice of shortest arc for antipodal pairs when nnn is even; the formalization takes the arc through min⁡(x,y),…,max⁡(x,y)\min(x,y),\dots,\max(x,y)min(x,y),…,max(x,y). The paper's argument does not depend on this choice.

Deviations from the printed text: the Corollary is stated for n≥6n\ge 6n≥6 (the printed statement says only 4k≤n4k\le n4k≤n, but its proof uses the example of Theorem 5, which exists for n≥6n\ge 6n≥6; for k=0k=0k=0, n=3n=3n=3 the printed statement is false). Theorem 6 keeps its printed n≥8n\ge 8n≥8. In the proof of Theorem 5 the paper writes "(4.2) holds" where the cheapest-insertion condition (4.3) is meant; the formal statement uses (4.3).

The existence statements carry OPTIMAL >0>0>0, the paper's standing assumption (1.1). Without it, the zero distance would make every length zero and every tour kkk-optimal, which would satisfy the ratio equations trivially; that formalization is ruled out.

Contributions welcome: proofs of any milestone, in particular the omitted insertion calculations and the parity lemma, and reusable lemmas on cyclic lists and edge sets of permutations.

Selected references

  • D. J. Rosenkrantz, R. E. Stearns, P. M. Lewis II, An Analysis of Several Heuristics for the Traveling Salesman Problem, SIAM J. Comput. 6(3):563–581, 1977. https://doi.org/10.1137/0206041
  • S. Lin, Computer solutions of the traveling salesman problem, Bell System Tech. J. 44:2245–2269, 1965. https://doi.org/10.1002/j.1538-7305.1965.tb04146.x
  • S. Lin, B. W. Kernighan, An effective heuristic algorithm for the traveling-salesman problem, Oper. Res. 21(2):498–516, 1973. https://doi.org/10.1287/opre.21.2.498
14 thms2 active usersReviewed
🏆Completed
Convex OptimizationDiscrete GeometryOperations Research+1·Captain: Shuze Chen

Discrete Convex Analysis XXVII: Directional Derivatives and Quasi L-Convex FunctionsTextbook

Motivation

This mission completes chapter 7's L-convex function theory and closes the book on it. It first finishes the theory of positively homogeneous L-convex functions — showing they coincide exactly with the classical Lovász extensions of submodular set functions, a one-to-one correspondence that recognizes forty years of submodular-optimization machinery as a special case of L-convex function theory. It then proves the L-side capstone this series has been building toward since mission 26-ch07b-lconvexfunctions: polyhedral L-convexity is characterized simultaneously by directional derivatives, subdifferentials, and weighted-minimizer polyhedra — the exact mirror of what mission 24-ch06d-mconvexfunctions proved for M-convex functions. Finally it develops quasi L-convex functions, the L-side analogue of mission 25-ch06e-mconvexfunctions's quasi M-convex functions, ending exactly where chapter 7 itself ends.

Setting

Fix a finite ground set VVV. The class 0L[R→R]0L[\mathbb R \to \mathbb R]0L[R→R] consists of polyhedral L-convex functions that are positively homogeneous; 0L[Z→Z]0L[\mathbb Z \to \mathbb Z]0L[Z→Z], its integer-valued integer-domain analogue. A positively homogeneous L-convex function ggg induces a submodular set function ρg(X)=g(χX)\rho_g(X) = g(\chi_X)ρg​(X)=g(χX​); conversely the Lovász extension ρ^\hat\rhoρ^​ of a submodular set function is positively homogeneous L-convex. The base polyhedron B(ρ)={x∈RV:x(X)≤ρ(X) ∀X, x(V)=ρ(V)}B(\rho) = \{x \in \mathbb R^V : x(X) \le \rho(X)\ \forall X,\ x(V) = \rho(V)\}B(ρ)={x∈RV:x(X)≤ρ(X) ∀X, x(V)=ρ(V)} of a submodular ρ\rhoρ is always an M-convex polyhedron. A function g:ZV→R∪{+∞}g : \mathbb Z^V \to \mathbb R \cup \{+\infty\}g:ZV→R∪{+∞} is quasi submodular (QSB) if g(p∧q)≤g(p)g(p\wedge q) \le g(p)g(p∧q)≤g(p) or g(p∨q)≤g(q)g(p\vee q) \le g(q)g(p∨q)≤g(q) for all p,qp,qp,q; the weaker (QSBw) requires only max⁡{g(p),g(q)}≥min⁡{g(p∧q),g(p∨q)}\max\{g(p),g(q)\} \ge \min\{g(p\wedge q), g(p\vee q)\}max{g(p),g(q)}≥min{g(p∧q),g(p∨q)}.

Formalization targets

Goal: the four characterizations of polyhedral L-convexity (Theorem 7.45)

For a polyhedral convex function ggg with dom⁡Rg≠∅\operatorname{dom}_{\mathbb R} g \ne \emptysetdomR​g=∅: ggg is L-convex if and only if every directional derivative g′(p;⋅)g'(p;\cdot)g′(p;⋅) is 0L[R→R]0L[\mathbb R \to \mathbb R]0L[R→R], if and only if every subdifferential ∂Rg(p)\partial_{\mathbb R} g(p)∂R​g(p) is an M-convex polyhedron, if and only if every weighted minimizer set is an L-convex polyhedron. Not present in this chunk's own extraction table (its label opens mid-paragraph, missed by the same extractor failure already documented for mission 25-ch06e-mconvexfunctions's Theorem 6.68), found by direct reading and chosen as goal because it is the exact L-side mirror of mission 24-ch06d-mconvexfunctions's own milestone Theorem 6.63, and its proof is assembled entirely from results already in this series (Theorem 7.43, Proposition 7.34, Theorem 7.40).

Supporting structural targets

Fifteen further results build the two remaining pieces of chapter 7's theory. Propositions 7.37-7.39 and Theorem 7.40 establish the one-to-one correspondence between positively homogeneous L-convex functions and submodular set functions via the Lovász extension; Proposition 7.41 gives a minimizer-polyhedron characterization of this class, and Proposition 7.42 shows directional derivatives of L-convex functions automatically land in it. Theorem 7.43 — the L-side mirror of mission 24-ch06d-mconvexfunctions's own goal, Theorem 6.61 — proves the directional- derivative/subdifferential correspondence via the induced submodular set function's base polyhedron; Proposition 7.44 checks consistency at integer points, and Theorem 7.46 refines Theorem 7.45 to the integral case. Theorem 7.49 (also missed by the extractor) gives the quasi-submodularity implication hierarchy and its perturbation-equivalence capstone, mirroring mission 25-ch06e-mconvexfunctions's Theorem 6.68 exactly. Proposition 7.50 and Theorems 7.51-7.52 build the level-set/perturbation machinery quasi submodularity needs; Theorems 7.53-7.54 (both missed by the extractor, the latter's full statement requiring one page beyond this chunk's nominal range, at the very end of chapter 7) give the quasi L-optimality and quasi L-proximity theorems.

Significance

The 0L/submodular correspondence (Theorem 7.40) is the precise sense in which L-convex function theory generalizes submodular set function theory rather than merely resembling it: every submodular set function is literally the restriction to {0,1}V\{0,1\}^V{0,1}V of a positively homogeneous L-convex function, and every algorithm for one transfers to the other through this exact dictionary. The goal, Theorem 7.45, completes the parallel structure this series has built since chapter 6: M-convexity and L-convexity are now each characterized in the same four convex-analytic vocabularies, setting up chapter 8's conjugacy theorem, which will show these two characterizations are not merely analogous but literally dual to each other under the Legendre-Fenchel transform. The quasi-submodularity results matter for the same reason as their M-side counterparts: chapter 10's algorithms for L-convex-function minimization remain correct under nonlinear rescalings that destroy L-convexity itself but preserve quasi submodularity.

None of these results are open — they are Murota's account of how far L-convex function theory extends beyond the polyhedral case (to positive homogeneity and its submodular-function incarnation) and how far its exchange-style inequality can be relaxed while preserving optimization theory (to quasi submodularity), mirroring chapter 6's identical two-part program for M-convex functions. What this mission contributes is a faithful, machine-checked formal statement of each, including four theorems (7.45, 7.49, 7.53, 7.54) the platform's own automated extractor missed entirely — one of them requiring a page beyond this chunk's own nominal range to complete, since chapter 7 ends there and this is the last mission covering it — extending the shared Lean vocabulary (ZeroLR, BasePolyhedron, QSBw) this series builds on; no comparable formalization exists on the platform (see Formalization scope).

Difficulty

The naive approach to the goal would try to prove all six pairwise implications among its four conditions independently; the book's own proof instead chains through results already established: (a)⇒(b) is Proposition 7.42, (a)⇒(c) is Theorem 7.43, (a)⇒(d) is Proposition 7.34, (b)⇔(c) uses the 0L/M0[R] correspondence, and (d)⇒(b) is the genuinely hard direction, requiring Proposition 7.41 applied to the directional derivative itself (showing arg⁡min⁡(g′(p;⋅)[−x])\arg\min(g'(p;\cdot)[-x])argmin(g′(p;⋅)[−x]) is an L-convex cone by an explicit description via the admissible-potential set of the distance function underlying arg⁡min⁡g[−x]\arg\min g[-x]argming[−x]). The remaining combinatorial difficulty in this block is in Theorem 7.43's proof: identifying ∂Rg(p)\partial_{\mathbb R} g(p)∂R​g(p) with the base polyhedron B(ρg,p)B(\rho_{g,p})B(ρg,p​) requires the L-optimality criterion (Theorem 7.33, mission 27-ch07c-lconvexfunctions) applied pointwise, a chain of logical equivalences with no single-step shortcut, exactly mirroring how mission 24-ch06d-mconvexfunctions's Theorem 6.61 needed the M-optimality criterion.

Formalization scope

Ground-set elements are a Fintype V with DecidableEq; L-convex functions are (V→ℝ)→WithTop ℝ (polyhedral) or (V→ℤ)→WithTop ℝ (integer-domain). All sixteen numbered results found in this chunk's page range — the twelve in BRIEF.md's own table plus four the extractor missed (Theorems 7.45, 7.49, 7.53, 7.54) — are placed, with two documented, content-preserving scope decisions: Theorem 7.43 omits the dual-integral refinement clauses for L[R→R|Z]/L[Z→Z] (the same decision mission 24-ch06d-mconvexfunctions's Theorem 6.61 made), and Proposition 7.50 states the general inequalities without restating their "In particular" specializations, which add no independent content — see HARD.md. "inf⁡g[−x]>−∞\inf g[-x]>-\inftyinfg[−x]>−∞" is replaced by the equivalent (ArgMinR ...).Nonempty hypothesis throughout, matching mission 25-ch06e-mconvexfunctions's identical substitution. This mission's base vocabulary is redeclared from missions 20-ch04b-mconvexsets, 21-ch05b-lconvexsets, 23-24-ch06*-mconvexfunctions, and 26-27-ch07*-lconvexfunctions rather than imported, since sibling drafts in this series cannot yet reference one another. Contributions completing any of the sixteen sorrys are welcome; the goal and Theorem 7.43 carry the most independent proof content.

Selected references

  • K. Murota, Discrete Convex Analysis, SIAM, 2003. DOI: 10.1137/1.9780898718508.
  • K. Murota and A. Shioura, "M-convex function on generalized polymatroid," Mathematics of Operations Research, 24 (1999), pp. 95-105 [152] (the polyhedral theory Theorems 7.26-7.46 are drawn from).
  • P. Milgrom and C. Shannon, "Monotone comparative statics," Econometrica, 62 (1994), pp. 157-180 [129] (the origin of the quasi-submodularity condition (SSQSB)).
68 thms3 active usersReviewed
Convex OptimizationDiscrete GeometryOperations Research+1·Captain: Shuze Chen

Discrete Convex Analysis IX: The Discrete Conjugacy TheoremTextbook

Motivation

The Legendre-Fenchel transform is the single most structurally important operation in convex analysis: for a proper closed convex function fff, its conjugate f∙(p)=sup⁡x{⟨p,x⟩−f(x)}f^\bullet(p) = \sup_x \{\langle p,x\rangle - f(x)\}f∙(p)=supx​{⟨p,x⟩−f(x)} is again proper closed convex, and the transform is an involution — f∙∙=ff^{\bullet\bullet} = ff∙∙=f. This one fact underlies duality theory across optimization: every strong-duality theorem is, at bottom, a statement about conjugate pairs. Chapters 6 and 7 of this book developed M-convex and L-convex functions as if they were two separate theories, each with its own exchange axiom, optimality criterion, and proximity theorem. Chapter 8 reveals they were never separate: the Legendre-Fenchel transform, suitably discretized, is a bijection between the two classes. This mission formalizes that discrete conjugacy theorem together with its classical real-valued precursor and a genuine function-level generalization of Edmonds's intersection theorem, completing the picture that chunks 06 through 09 built the two halves of.

Setting

Let VVV be a finite ground set. For f:RV→R∪{+∞}f : \mathbb R^V \to \mathbb R \cup \{+\infty\}f:RV→R∪{+∞}, the Legendre-Fenchel transform is f∙(p)=sup⁡{⟨p,x⟩−f(x):x∈RV}f^\bullet(p) = \sup\{\langle p,x\rangle - f(x) : x \in \mathbb R^V\}f∙(p)=sup{⟨p,x⟩−f(x):x∈RV}; fff is submodular if f(x)+f(y)≥f(x∨y)+f(x∧y)f(x)+f(y) \ge f(x\vee y)+f(x\wedge y)f(x)+f(y)≥f(x∨y)+f(x∧y) and supermodular under the reverse inequality. For f:ZV→R∪{+∞}f : \mathbb Z^V \to \mathbb R \cup \{+\infty\}f:ZV→R∪{+∞}, the discrete Legendre-Fenchel transform restricts the same supremum formula to p∈ZVp \in \mathbb Z^Vp∈ZV: f∙(p)=sup⁡{⟨p,x⟩−f(x):x∈ZV}f^\bullet(p) = \sup\{\langle p,x\rangle - f(x) : x \in \mathbb Z^V\}f∙(p)=sup{⟨p,x⟩−f(x):x∈ZV} for p∈ZVp \in \mathbb Z^Vp∈ZV — a genuinely different object from the real-valued transform, since the supremum is now over integer xxx only, and the codomain is checked back against the discrete M-/L-convexity axioms of chunks 06–09. The integer biconjugate f∙∙f^{\bullet\bullet}f∙∙ is the transform applied twice. fff is integer valued if every finite value it takes is an integer (the classes M[Z→Z]M[\mathbb Z\to\mathbb Z]M[Z→Z], L[Z→Z]L[\mathbb Z\to\mathbb Z]L[Z→Z] of the goal theorem are exactly the M-/L-convex functions with this property).

Formalization targets

Goal: Theorem 8.12 (the discrete conjugacy theorem)

(1) The classes M[Z→Z]M[\mathbb Z\to\mathbb Z]M[Z→Z] and L[Z→Z]L[\mathbb Z\to\mathbb Z]L[Z→Z] are in one-to-one correspondence under the discrete Legendre-Fenchel transform: for f∈M[Z→Z]f \in M[\mathbb Z\to\mathbb Z]f∈M[Z→Z] and g∈L[Z→Z]g \in L[\mathbb Z\to\mathbb Z]g∈L[Z→Z], f∙∈L[Z→Z]f^\bullet \in L[\mathbb Z\to\mathbb Z]f∙∈L[Z→Z], g∙∈M[Z→Z]g^\bullet \in M[\mathbb Z\to\mathbb Z]g∙∈M[Z→Z], f∙∙=ff^{\bullet\bullet}=ff∙∙=f, and g∙∙=gg^{\bullet\bullet}=gg∙∙=g. (2) The same correspondence holds between M♮[Z→Z]M^\natural[\mathbb Z\to\mathbb Z]M♮[Z→Z] and L♮[Z→Z]L^\natural[\mathbb Z\to\mathbb Z]L♮[Z→Z].

Milestones: Theorem 8.1, Proposition 8.11, Theorem 8.17

Theorem 8.1: the conjugate of a real-valued submodular function is always supermodular — the classical warm-up, and evidence that submodularity/supermodularity is not symmetric under conjugation on its own (the converse fails). Proposition 8.11: the integer biconjugate recovers fff at any point with a nonempty integer subdifferential — the fact that makes discrete biconjugation meaningful at all. Theorem 8.17 (the M-convex intersection theorem): a point jointly minimizes a sum of two M♮^\natural♮-convex functions if and only if a single linear functional separately certifies it as a minimizer of each perturbed function — the function-level generalization of chunk 04's Edmonds's intersection theorem for M-convex sets.

Significance

The result itself. The discrete conjugacy theorem is, in the book's own words, "the unifying result of the entire book": every theorem proved separately for M-convex functions (chunks 06–07) has an exact mirror for L-convex functions (chunks 08–09) precisely because the Legendre-Fenchel transform carries one class to the other. Theorem 8.17's function-level Edmonds generalization shows the payoff directly — the classical matroid-intersection-style min-max duality of chunk 04 was never really about sets; it is a special case (indicator functions) of a duality that holds for the whole class of M-convex functions.

Formalizing it. No matching item exists on the platform for conjugate functions, discrete conjugacy, or this generality of intersection theorem. This mission gives the first formal statement of the discrete conjugacy theorem, distinguishing it carefully from its real-valued (polyhedral) precursor, Theorem 8.4 — a genuinely different, harder theorem this mission does not draft (see Formalization scope), since the integer bijection needs the M-/L-proximity theorems of chunks 06–09 to control integrality under convex extension, while the real-valued case does not.

Difficulty

The obvious approach — try to prove the discrete conjugacy theorem directly by mimicking the real-valued proof (Theorem 8.4) with ℤ in place of ℝ everywhere — fails, because the real-valued proof's key step (Proposition 8.3, an infimal-convolution argument comparing arg min sets of perturbed polyhedral functions) has no immediate discrete analogue: a discrete arg min need not vary continuously with the perturbation the way a polyhedral one does. The book's actual strategy instead routes through the convex extension of the discrete function (chunk 06/08's bridge to chapter 3's integral convexity), applies the already-proved real-valued conjugacy theorem to the extension, and then must separately argue that the resulting conjugate, restricted back to integer points, is again integer-valued and satisfies the discrete exchange axiom — an argument that needs different treatment depending on whether the original function's domain is bounded or unbounded (an exhaustion argument via restriction to a growing integer interval, invoking chunk 06's proximity theorem to control convergence). Skipping this discreteness argument and treating the real-valued theorem as if it settled the integer case would silently discard exactly the chapter's own point.

Formalization scope

The ground set VVV is a Fintype with DecidableEq. ConvexConjugate (the discrete transform) has domain and codomain both (V → ℤ) → WithTop ℝ, obtained by taking the defining supremum in EReal (a complete lattice, so it is always total) and projecting back via a new FromEReal map — this is what lets the biconjugate f•• typecheck as an equality of functions of the same type as f. ConvexConjugateR (the real-valued transform, used only by the milestone Theorem 8.1) is a separate object with no shared code, per the explicit warning against conflating the two transforms; the two never appear in the same item.

A trivializing formalization of the goal would draft only the real-valued case (Theorem 8.4) as if it were the discrete theorem, or would silently allow WithTop ℝ's subtraction-avoidance convention to change which values are compared; neither is done. Theorem 8.4 itself (the polyhedral conjugacy theorem) is not drafted in this mission at all — it would require a fresh, otherwise-unused polyhedral M-/L-convex-function layer on Rⱽ that no other item here needs (see MODERATION_NOTES.md). The M-/L-separation theorems (8.15, 8.16) and the Fenchel-type duality theorem (8.21) are likewise left for a follow-on mission; contributions building the polyhedral bridge or the separation theorems, which depend on machinery this mission establishes, are welcome.

Selected references

  • K. Murota, Discrete Convex Analysis, SIAM, 2003. DOI: 10.1137/1.9780898718508.
13 thms2 active usersReviewed
🏆Completed
Linear OptimizationOperations ResearchOptimization·Captain: mikedeng1

Revenue Management Under the Markov Chain Choice Model I: The Dual Linear Program Yields an Optimal AssortmentResearch Paper

Motivation

A retailer or an airline decides which products to make available, and customers choose among what is offered. When a preferred product is missing, many customers substitute to another product instead of leaving. Assortment optimization asks which subset of products to offer so that the expected revenue from a customer is as large as possible, and its answer depends entirely on the choice model used to describe substitution.

The Markov chain choice model was introduced by Blanchet, Gallego and Goyal (EC 2013; Oper. Res. 64(4), 2016), who showed that it contains the multinomial logit model as a special case and proposed it as an approximation of general random-utility choice models. Feldman and Topaloglu (Oper. Res. 65(5), 2017) study revenue management under this model. Their first result, the subject of this mission, is that the assortment problem, a search over all 2n2^n2n offer sets, is solved by one linear program with nnn variables. The same paper uses this result for its dynamic single-resource and network results, which are the subjects of the companion missions II–IV of this series.

Timeline:

  • 2013/2016: Blanchet, Gallego and Goyal introduce the model and give a polynomial-time assortment algorithm.
  • 2017: Feldman and Topaloglu show that the optimal assortment is read off an optimal solution of a dual linear program (their Theorem 2), and derive structural and capacity-control consequences.

Setting

There are nnn products N={1,…,n}N=\{1,\dots,n\}N={1,…,n}. A customer arrives to purchase product jjj with probability λj\lambda_jλj​. If the product she visits is offered, she buys it. Otherwise she transitions to product iii with probability ρj,i\rho_{j,i}ρj,i​ and checks whether iii is offered, or leaves without buying with probability 1−∑i∈Nρj,i1-\sum_{i\in N}\rho_{j,i}1−∑i∈N​ρj,i​. Throughout, λj>0\lambda_j>0λj​>0, ρj,i≥0\rho_{j,i}\ge0ρj,i​≥0 and ∑i∈Nρj,i<1\sum_{i\in N}\rho_{j,i}<1∑i∈N​ρj,i​<1 for all jjj.

For an offer set S⊆NS\subseteq NS⊆N, let Pj,SP_{j,S}Pj,S​ be the expected number of visits to product jjj while it is offered (the probability that jjj is purchased) and Rj,SR_{j,S}Rj,S​ the expected number of visits to jjj while it is not offered. The pair (PS,RS)(P_S,R_S)(PS​,RS​) is the unique solution of the (Balance) equations

Pj,S+Rj,S=λj+∑i∈Nρi,jRi,S  ∀j∈N,Pj,S=0  ∀j∉S,Rj,S=0  ∀j∈S.P_{j,S}+R_{j,S}=\lambda_j+\sum_{i\in N}\rho_{i,j}R_{i,S}\ \ \forall j\in N,\qquad P_{j,S}=0\ \ \forall j\notin S,\qquad R_{j,S}=0\ \ \forall j\in S .Pj,S​+Rj,S​=λj​+i∈N∑​ρi,j​Ri,S​  ∀j∈N,Pj,S​=0  ∀j∈/S,Rj,S​=0  ∀j∈S.

With revenue rj∈Rr_j\in\mathbb Rrj​∈R for product jjj, the (Assortment) problem is max⁡S⊆N∑j∈NPj,Srj\max_{S\subseteq N}\sum_{j\in N}P_{j,S}r_jmaxS⊆N​∑j∈N​Pj,S​rj​. Two linear programs enter: the maximization of ∑jrjxj\sum_j r_jx_j∑j​rj​xj​ over the polyhedron

H={(x,z)∈R+2n: xj+zj=λj+∑i∈Nρi,jzi  ∀j∈N},\mathcal H=\Big\{(x,z)\in\mathbb R^{2n}_+:\ x_j+z_j=\lambda_j+\sum_{i\in N}\rho_{i,j}z_i\ \ \forall j\in N\Big\},H={(x,z)∈R+2n​: xj​+zj​=λj​+i∈N∑​ρi,j​zi​  ∀j∈N},

and its dual

min⁡v∈Rn{∑j∈Nλjvj: vj≥rj  ∀j∈N,  vj≥∑i∈Nρj,ivi  ∀j∈N}.(Dual)\min_{v\in\mathbb R^n}\Big\{\sum_{j\in N}\lambda_jv_j:\ v_j\ge r_j\ \ \forall j\in N,\ \ v_j\ge\sum_{i\in N}\rho_{j,i}v_i\ \ \forall j\in N\Big\}.\qquad\text{(Dual)}v∈Rnmin​{j∈N∑​λj​vj​: vj​≥rj​  ∀j∈N,  vj​≥i∈N∑​ρj,i​vi​  ∀j∈N}.(Dual)

Formalization targets

Goal: Theorem 2 (p. 1326)

For every optimal solution v^\hat vv^ of (Dual), the set S^={j∈N:v^j=rj}\hat S=\{j\in N:\hat v_j=r_j\}S^={j∈N:v^j​=rj​} is an optimal assortment:

∑j∈NPj,S rj ≤ ∑j∈NPj,S^ rjfor all S⊆N.\sum_{j\in N}P_{j,S}\,r_j\ \le\ \sum_{j\in N}P_{j,\hat S}\,r_j\qquad\text{for all } S\subseteq N .j∈N∑​Pj,S​rj​ ≤ j∈N∑​Pj,S^​rj​for all S⊆N.

Milestones, in the order the paper uses them

  1. (p. 1325) The (Balance) equations have a unique nonnegative solution for every SSS.
  2. Lemma 1 (p. 1326): for an extreme point (x^,z^)(\hat x,\hat z)(x^,z^) of H\mathcal HH and Sx^={j:x^j>0}S_{\hat x}=\{j:\hat x_j>0\}Sx^​={j:x^j​>0}, Pj,Sx^=x^jP_{j,S_{\hat x}}=\hat x_jPj,Sx^​​=x^j​ and Rj,Sx^=z^jR_{j,S_{\hat x}}=\hat z_jRj,Sx^​​=z^j​ for all jjj.
  3. (p. 1326) The linear program over H\mathcal HH has an optimal solution, and its optimal value equals the optimal value of (Assortment).
  4. (p. 1326) (Dual) has an optimal solution, and its optimal value equals that of the linear program over H\mathcal HH.
  5. (p. 1326, proof of Theorem 2) An optimal v^\hat vv^ satisfies v^j=rj\hat v_j=r_jv^j​=rj​ or v^j=∑iρj,iv^i\hat v_j=\sum_i\rho_{j,i}\hat v_iv^j​=∑i​ρj,i​v^i​ for each jjj.

Significance

Theorem 2 reduces a combinatorial problem over 2n2^n2n offer sets to a linear program, so the assortment problem under the Markov chain choice model is solvable in polynomial time. The same structure drives the rest of the paper: the dual variables v^j\hat v_jv^j​ are used to show that optimal offer sets shrink when all revenues fall by a common amount, to show that the optimal offer sets of the single-resource dynamic program are nested in the remaining capacity and time, and to reduce the choice-based network linear program to a compact one.

The result is proved in the paper. This mission produces a machine-checked version of it and of its supporting lemmas; to the knowledge of the mission author no formalization of the Markov chain choice model exists. The definition layer (the model, the (Balance) solution, H\mathcal HH and (Dual)) is the first formal encoding of this choice model and is shared, with the same encoding, by missions II–IV.

Difficulty

The obvious route, comparing ∑jPj,Srj\sum_jP_{j,S}r_j∑j​Pj,S​rj​ across offer sets directly, fails because Pj,SP_{j,S}Pj,S​ is defined only implicitly through a linear system whose coefficient matrix changes with SSS; there is no closed-form expression that can be compared across offer sets, and enumerating the 2n2^n2n sets is exponential. The connection to linear programming needs an exact correspondence between the vertices of H\mathcal HH and the (Balance) solutions, which is a statement about polyhedra, not about Markov chains. Even well-posedness is not free: existence, uniqueness and nonnegativity of (PS,RS)(P_S,R_S)(PS​,RS​) depend on the row sums ∑iρj,i\sum_i\rho_{j,i}∑i​ρj,i​ being strictly below one. Mathlib has extreme points of convex sets but no ready-made theory of vertices of polyhedra or of linear programming duality in this form.

Formalization scope

Products are Fin n (0-based), offer sets are Finset (Fin n) (the paper's S⊂NS\subset NS⊂N is non-strict inclusion, so every subset including ∅\emptyset∅ and NNN is an offer set), and rho j i is ρj,i\rho_{j,i}ρj,i​, the transition from jjj to iii. The model structure carries the paper's standing assumptions λj>0\lambda_j>0λj​>0 and ∑iρj,i<1\sum_i\rho_{j,i}<1∑i​ρj,i​<1 (p. 1325) and the implicit nonnegativity ρj,i≥0\rho_{j,i}\ge0ρj,i​≥0. Revenues are arbitrary reals with no sign assumption. R2n\mathbb R^{2n}R2n is (Fin n → ℝ) × (Fin n → ℝ), and extreme points are Mathlib's Set.extremePoints ℝ.

The pair (PS,RS)(P_S,R_S)(PS​,RS​) is a solution of (Balance) chosen by Classical.epsilon; milestone 1 states that it satisfies (Balance), is nonnegative and equals every solution, so all statements are about the paper's (PS,RS)(P_S,R_S)(PS​,RS​) and not about a junk value. Every optimum (of (Assortment), of the linear program over H\mathcal HH, of (Dual)) is stated as "feasible and at least as good as every feasible point", never through sSup or sInf. The goal is stated for every optimal v^\hat vv^ of (Dual), which is what the proof uses; uniqueness of v^\hat vv^ is neither assumed nor claimed. Replacing the hypothesis "v^\hat vv^ optimal for (Dual)" by "v^\hat vv^ feasible for (Dual)" would make the statement false, and an existential over v^\hat vv^ would weaken it; neither is the target.

No hypothesis beyond the paper's is added. Two printed index slips on pp. 1325–1326 (a garbled sum in the discussion after (Balance), and ∑iρi,jz^j\sum_i\rho_{i,j}\hat z_j∑i​ρi,j​z^j​ for ∑iρi,jz^i\sum_i\rho_{i,j}\hat z_i∑i​ρi,j​z^i​ in the proof of Lemma 1) are not part of any statement here.

Welcome contributions: the existence and uniqueness of (Balance) solutions via Neumann series for substochastic matrices, a characterization of vertices of polyhedra given by equality constraints and nonnegativity, and a strong duality statement usable for this primal–dual pair. These are reusable well beyond this mission.

Selected references

  • J. B. Feldman, H. Topaloglu, Revenue Management Under the Markov Chain Choice Model, Operations Research 65(5):1322–1342, 2017. https://doi.org/10.1287/opre.2017.1628
  • J. Blanchet, G. Gallego, V. Goyal, A Markov Chain Approximation to Choice Modeling, Operations Research 64(4):886–905, 2016. https://doi.org/10.1287/opre.2016.1505
  • M. L. Puterman, Markov Decision Processes: Discrete Stochastic Dynamic Programming, Wiley, 1994. https://doi.org/10.1002/9780470316887
8 thms2 active usersReviewed
🏆Completed
Convex OptimizationDiscrete GeometryOperations Research+1·Captain: Shuze Chen

Discrete Convex Analysis X: The Lagrangian Saddle-Point TheoremTextbook

Motivation

Chunk 10 formalized the discrete conjugacy theorem — the Legendre-Fenchel transform's bijection between the classes of M-convex and L-convex functions — and, along the way, a function-level generalization of Edmonds's intersection theorem. Section 8.4 turns that machinery toward a different question: not "how are two convexity classes related," but "when does a discrete optimization problem have a dual that meets it with equality." The classical route to such strong-duality results in continuous convex programming — Lagrangian relaxation, an embedding of the problem in a family of perturbed problems, and a saddle-point characterization of when primal and dual values coincide — has a discrete analogue that needs no continuity, no differentiability, and no convexity in the classical sense at all: only the elementary fact that the Legendre-Fenchel transform, once discretized, is still an involution on the right class of functions. This mission formalizes that discrete Lagrangian duality framework and its central saddle-point theorem, in full generality — before the book specializes it, in the section that follows, to the specific M-convex perturbation that gives the chapter's headline strong-duality result for M-convex programs.

Setting

Let VVV and UUU be finite ground sets. A perturbation of an optimization problem min⁡{f(x):x∈ZV}\min\{f(x) : x \in \mathbb Z^V\}min{f(x):x∈ZV} is a function F:ZV×ZU→Z∪{+∞}F : \mathbb Z^V \times \mathbb Z^U \to \mathbb Z \cup \{+\infty\}F:ZV×ZU→Z∪{+∞} such that F(x,0)=f(x)F(x,0) = f(x)F(x,0)=f(x) for all xxx (Eq. (8.54)) and, for each fixed xxx, F(x,⋅)F(x,\cdot)F(x,⋅) is self-biconjugate: F(x,⋅)∙∙=F(x,⋅)F(x,\cdot)^{\bullet\bullet} = F(x,\cdot)F(x,⋅)∙∙=F(x,⋅) under the discrete Legendre-Fenchel transform of chunk 10 (Eq. (8.55)). The Lagrangian function is K(x,y)=inf⁡{F(x,u)+⟨u,y⟩:u∈ZU}K(x,y) = \inf\{F(x,u) + \langle u,y\rangle : u \in \mathbb Z^U\}K(x,y)=inf{F(x,u)+⟨u,y⟩:u∈ZU} (Eq. (8.58)), valued in Z∪{±∞}\mathbb Z \cup \{\pm\infty\}Z∪{±∞} (formalized in EReal, since both the infimum and the supremum below can be genuinely unbounded). The dual objective is g(y)=inf⁡{K(x,y):x∈ZV}g(y) = \inf\{K(x,y) : x \in \mathbb Z^V\}g(y)=inf{K(x,y):x∈ZV} (Eq. (8.60)). Writing inf⁡(P)=inf⁡xf(x)\inf(P) = \inf_x f(x)inf(P)=infx​f(x), sup⁡(D)=sup⁡yg(y)\sup(D) = \sup_y g(y)sup(D)=supy​g(y), opt⁡(P)={x:f(x)=inf⁡(P)}\operatorname{opt}(P) = \{x : f(x) = \inf(P)\}opt(P)={x:f(x)=inf(P)}, opt⁡(D)={y:g(y)=sup⁡(D)}\operatorname{opt}(D) = \{y : g(y) = \sup(D)\}opt(D)={y:g(y)=sup(D)}, the primal problem PPP is to minimize fff over ZV\mathbb Z^VZV and the dual problem DDD is to maximize ggg over ZU\mathbb Z^UZU.

Formalization targets

Goal: Theorem 8.54 (the saddle-point theorem)

Assuming FFF is self-biconjugate (Eq. (8.55)): both inf⁡(P)\inf(P)inf(P) and sup⁡(D)\sup(D)sup(D) are finite and min⁡(P)=max⁡(D)\min(P) = \max(D)min(P)=max(D) if and only if there exist xˉ∈ZV\bar x \in \mathbb Z^Vxˉ∈ZV, yˉ∈ZU\bar y \in \mathbb Z^Uyˉ​∈ZU with K(xˉ,yˉ)K(\bar x,\bar y)K(xˉ,yˉ​) finite and K(x,yˉ)≤K(xˉ,yˉ)≤K(xˉ,y)K(x,\bar y) \le K(\bar x,\bar y) \le K(\bar x,y)K(x,yˉ​)≤K(xˉ,yˉ​)≤K(xˉ,y) for all x,yx,yx,y — a saddle point of the Lagrangian kernel. When this holds, xˉ∈opt⁡(P)\bar x \in \operatorname{opt}(P)xˉ∈opt(P) and yˉ∈opt⁡(D)\bar y \in \operatorname{opt}(D)yˉ​∈opt(D).

Milestones: Theorem 8.52, Proposition 8.51(1)-(2)

Theorem 8.52 (weak duality): inf⁡(P)≥sup⁡(D)\inf(P) \ge \sup(D)inf(P)≥sup(D) always, with no biconjugacy hypothesis on FFF at all — the baseline the saddle-point theorem sharpens to equality. Proposition 8.51(1)-(2): under self-biconjugacy, the perturbation FFF (and hence the primal objective fff) is itself recoverable from the Lagrangian kernel KKK by a supremum, F(x,u)=sup⁡y{K(x,y)−⟨u,y⟩}F(x,u) = \sup_y\{K(x,y) - \langle u,y\rangle\}F(x,u)=supy​{K(x,y)−⟨u,y⟩} and f(x)=sup⁡yK(x,y)f(x) = \sup_y K(x,y)f(x)=supy​K(x,y) — the algebraic identity the saddle-point theorem's proof turns on directly.

Significance

The result itself. The saddle-point theorem is the general-purpose engine behind every strong-duality result the book proves for specific classes of discrete optimization problems: the book's own next section specializes it (via a particular choice of FFF built from an M-convex regularizer rrr) to obtain strong duality for M-convex programs, but the theorem itself needs no M-convexity, no submodularity, and no exchange axiom — only the elementary self-biconjugacy of a perturbation under the discrete Legendre-Fenchel transform. It is, in that sense, the most general and most reusable strong-duality statement in the book: any future mission proving strong duality for a specific class of discrete programs (M-convex, M2-convex, network flow, or otherwise) by exhibiting a self-biconjugate perturbation can cite this theorem directly rather than reproving the saddle-point argument from scratch.

Formalizing it. No matching item exists on the platform for a discrete Lagrangian saddle- point theorem, discrete weak duality, or this perturbation-based duality framework. (A prior-art search turned up an unrelated continuous Lagrangian saddle-point theorem for convex cones, Luenberger's Chapter 8 §8.4, formalized as VectorSpaceOpt.lagrangian_saddle_sufficient_pointed — a genuinely different setting: no discreteness, no biconjugacy hypothesis, and a one-directional sufficiency statement rather than this mission's iff. Not reused.) This mission gives the first formal statement of discrete Lagrangian duality, and directly reuses chunk 10's ConvexConjugate apparatus (self-biconjugacy is stated using chunk 10's own conjugate-of-conjugate composition), demonstrating exactly the kind of shared-substrate payoff the discrete conjugacy theorem was built to provide.

Difficulty

The saddle-point theorem's "only if" direction is not a routine unwinding of definitions: given min⁡(P)=max⁡(D)\min(P) = \max(D)min(P)=max(D) at finite common value, one must construct the saddle point (xˉ,yˉ)(\bar x,\bar y)(xˉ,yˉ​) — the book's proof takes xˉ∈opt⁡(P)\bar x \in \operatorname{opt}(P)xˉ∈opt(P), yˉ∈opt⁡(D)\bar y \in \operatorname{opt}(D)yˉ​∈opt(D) (which exist because the infimum/supremum are attained at a finite optimum) and verifies the sandwiching inequality using Proposition 8.51(2)'s identity f(x)=sup⁡yK(x,y)f(x) = \sup_y K(x,y)f(x)=supy​K(x,y) together with weak duality, rather than by any direct algebraic manipulation of KKK alone. Skipping straight to a "trivial" biconditional that never invokes Proposition 8.51 would misrepresent the actual proof structure the book relies on for exactly this direction.

Formalization scope

V,UV, UV,U are Fintype ground types; LagrangianKernel, DualObjective, InfP, SupD are EReal-valued to keep both the defining infima/suprema total (a complete lattice) without an artificial finiteness side-condition; OptP, OptD compare PrimalValue/DualObjective against InfP/SupD after casting through chunk 10's ToEReal, mirroring that chunk's own round-trip convention. "Finite" throughout is formalized as ≠ ⊤ ∧ ≠ ⊥ in EReal. The perturbation FFF itself is left fully abstract (an arbitrary function satisfying the self-biconjugacy hypothesis where needed) — this mission does not draft the specific M-convex perturbation FrF_rFr​ (Eq. (8.61)) that the book's next subsection (§8.4.3) uses to specialize this framework to M-convex programs, nor Theorem 8.59 (the resulting M-convex strong-duality theorem) itself, which needs that specific perturbation plus its own regularity conditions (REG)/(OBJ) and a chain of M-convex-specific propositions (8.55–8.58) beyond what the general framework built here provides. A trivializing formalization would state the saddle-point theorem's sandwiching inequality with a weaker order (e.g., only one of the two directions) or would omit the "xˉ∈opt⁡(P),yˉ∈opt⁡(D)\bar x \in \operatorname{opt}(P), \bar y \in \operatorname{opt}(D)xˉ∈opt(P),yˉ​∈opt(D)" consequence clause; neither is done — both inequalities and the full consequence clause are included exactly as the book states them.

Selected references

  • K. Murota, Discrete Convex Analysis, SIAM, 2003. DOI: 10.1137/1.9780898718508.
10 thms3 active usersReviewed
🏆Completed
Dynamic ProgrammingOperations ResearchOptimization·Captain: mikedeng1

Revenue Management Under the Markov Chain Choice Model II: Optimal Offer Sets Grow with Remaining Capacity and Remaining TimeResearch Paper

Motivation

Airlines, hotels and rental firms sell a fixed stock of capacity (seats on a flight leg, rooms on a night) over a finite selling horizon, and control revenue mainly by deciding which products (fare classes, rate plans) to make available at each moment. When customers substitute between products, the decision in each period is an assortment: a subset of products to offer. Talluri and van Ryzin (Management Science 2004) formulated this single resource revenue management problem as a dynamic program for a general choice model, and showed that structural properties of the optimal policy depend strongly on how customers choose.

The Markov chain choice model of Blanchet, Gallego and Goyal (technical report 2013; Oper. Res. 2016) describes substitution by a Markov chain on the products and approximates a broad class of random-utility models. Feldman and Topaloglu (Oper. Res. 65(5), 2017) study assortment and revenue management problems under this model. This mission formalizes their structural result for the single resource problem (Theorem 5): there is an optimal policy whose offer sets are nested in the remaining capacity and in the remaining time, so that it can be implemented by protection levels, one capacity threshold per product and period.

Setting

There are nnn products N={1,…,n}N=\{1,\dots,n\}N={1,…,n}. A customer arrives to purchase product jjj with probability λj\lambda_jλj​. If jjj is offered she buys it; otherwise she moves to product iii with probability ρj,i\rho_{j,i}ρj,i​, and leaves with probability 1−∑i∈Nρj,i1-\sum_{i\in N}\rho_{j,i}1−∑i∈N​ρj,i​. The paper assumes λj>0\lambda_j>0λj​>0 and ∑i∈Nρj,i<1\sum_{i\in N}\rho_{j,i}<1∑i∈N​ρj,i​<1 for all jjj. For an offer set S⊆NS\subseteq NS⊆N, the purchase probabilities Pj,SP_{j,S}Pj,S​ and the visit counts Rj,SR_{j,S}Rj,S​ of unavailable products solve the (Balance) equations

Pj,S+Rj,S=λj+∑i∈Nρi,jRi,S  ∀j,Pj,S=0  (j∉S),Rj,S=0  (j∈S).P_{j,S}+R_{j,S}=\lambda_j+\sum_{i\in N}\rho_{i,j}R_{i,S}\ \ \forall j,\qquad P_{j,S}=0\ \ (j\notin S),\qquad R_{j,S}=0\ \ (j\in S).Pj,S​+Rj,S​=λj​+i∈N∑​ρi,j​Ri,S​  ∀j,Pj,S​=0  (j∈/S),Rj,S​=0  (j∈S).

With product revenues rjr_jrj​, the (Assortment) problem is max⁡S⊆N∑jPj,Srj\max_{S\subseteq N}\sum_{j}P_{j,S}r_jmaxS⊆N​∑j​Pj,S​rj​, and its (Dual) linear program is

min⁡v∈Rn{∑jλjvj:vj≥rj, vj≥∑iρj,ivi  ∀j}.\min_{v\in\mathbb R^n}\Big\{\sum_{j}\lambda_jv_j : v_j\ge r_j,\ v_j\ge\sum_{i}\rho_{j,i}v_i\ \ \forall j\Big\}.v∈Rnmin​{j∑​λj​vj​:vj​≥rj​, vj​≥i∑​ρj,i​vi​  ∀j}.

In the single resource problem there are TTT periods and ccc units of capacity. In each period at most one customer arrives; a sale of product jjj earns rjr_jrj​ and uses one unit. The optimal expected revenue Vt(x)V_t(x)Vt​(x) from period ttt on with xxx units left satisfies the (Single Resource) dynamic program

Vt(x)=max⁡S⊆N{∑j∈NPj,S{rj+Vt+1(x−1)−Vt+1(x)}}+Vt+1(x),V_t(x)=\max_{S\subseteq N}\Big\{\sum_{j\in N}P_{j,S}\{r_j+V_{t+1}(x-1)-V_{t+1}(x)\}\Big\}+V_{t+1}(x),Vt​(x)=S⊆Nmax​{j∈N∑​Pj,S​{rj​+Vt+1​(x−1)−Vt+1​(x)}}+Vt+1​(x),

with VT+1(x)=0V_{T+1}(x)=0VT+1​(x)=0 and Vt(0)=0V_t(0)=0Vt​(0)=0. An optimal subset S^t(x)\hat S_t(x)S^t​(x) is a maximizer of the problem on the right side. The marginal value of capacity is ΔVt(x)=Vt(x)−Vt(x−1)\Delta V_t(x)=V_t(x)-V_t(x-1)ΔVt​(x)=Vt​(x)−Vt​(x−1).

Formalization targets

Goal: Theorem 5 (p. 1329)

There exists an optimal policy, i.e. a choice of maximizers S^t(x)\hat S_t(x)S^t​(x) for all 1≤t≤T1\le t\le T1≤t≤T, 1≤x≤c1\le x\le c1≤x≤c, such that

S^t(x−1)⊆S^t(x)andS^t−1(x)⊆S^t(x).\hat S_t(x-1)\subseteq \hat S_t(x)\qquad\text{and}\qquad \hat S_{t-1}(x)\subseteq\hat S_t(x).S^t​(x−1)⊆S^t​(x)andS^t−1​(x)⊆S^t​(x).

The offer set shrinks as capacity runs down, and it is smaller when more periods remain.

Milestones

  1. (§2, p. 1325) The (Balance) equations have a unique nonnegative solution for every SSS.
  2. (Theorem 2, p. 1326) If v^\hat vv^ is optimal for (Dual), then {j:v^j=rj}\{j:\hat v_j=r_j\}{j:v^j​=rj​} is optimal for (Assortment).
  3. (Lemma 3, p. 1327) For η≥0\eta\ge0η≥0, with v^η\hat v^\etav^η optimal for (Dual) with revenues rj−ηr_j-\etarj​−η,
{j:v^jη=rj−η}⊆{j:v^j0=rj}.\{j:\hat v^\eta_j=r_j-\eta\}\subseteq\{j:\hat v^0_j=r_j\}.{j:v^jη​=rj​−η}⊆{j:v^j0​=rj​}.
  1. ((Single Resource), pp. 1328–1329) The value functions satisfy the printed recursion Vt(x)=max⁡S{∑jPj,S{rj+Vt+1(x−1)}+{1−∑jPj,S}Vt+1(x)}V_t(x)=\max_S\{\sum_jP_{j,S}\{r_j+V_{t+1}(x-1)\}+\{1-\sum_jP_{j,S}\}V_{t+1}(x)\}Vt​(x)=maxS​{∑j​Pj,S​{rj​+Vt+1​(x−1)}+{1−∑j​Pj,S​}Vt+1​(x)} and the boundary conditions.
  2. (Proof of Theorem 5, p. 1329) ΔVt+1(x)≤ΔVt+1(x−1)\Delta V_{t+1}(x)\le\Delta V_{t+1}(x-1)ΔVt+1​(x)≤ΔVt+1​(x−1) and ΔVt+1(x)≤ΔVt(x)\Delta V_{t+1}(x)\le\Delta V_t(x)ΔVt+1​(x)≤ΔVt​(x).

Significance

Theorem 5 makes the optimal policy a protection level policy: for each product jjj and period ttt there is a threshold xˉjt\bar x_{jt}xˉjt​ such that jjj is offered exactly when at least xˉjt\bar x_{jt}xˉjt​ units remain. The policy can then be stored as n Tn\,TnT numbers instead of a table of subsets, and each product can be controlled separately, which is how airline inventory systems are organized. The paper also shows (Table 2, p. 1330) that the products need not be closed in revenue order: a higher-fare product can be closed before a lower-fare one, so the result is genuinely about nested sets, not about nested fare classes. Talluri and van Ryzin (2004) show that under the multinomial logit model an optimal assortment consists of a number of products with the largest revenues; the Markov chain choice model does not have this property (Table 1, p. 1328), so their structure of the optimal policy does not carry over directly.

The result is proved in the paper. No part of it is formalized on Prove2Me. The monotonicity of marginal values for an abstract choice model is published and proved as RevenueManagement.choice_marginal_values, stated over the definitions RevenueManagement_singleResource; milestone 5 is the same statement for this paper's dynamic program and can be bridged to it. A complete development here produces machine-checked Theorem 2 and Lemma 3 for the Markov chain choice model, which are reusable for any assortment problem under this model.

Difficulty

The obvious argument chooses, for each (t,x)(t,x)(t,x), any maximizer of the stage problem. This fails: the stage problems have ties, and an arbitrary choice of maximizers need not be nested, so the theorem is an existence statement about a coordinated choice. The dependence of Pj,SP_{j,S}Pj,S​ on SSS is through the solution of a linear system, so the effect of adding or removing a product on the other purchase probabilities has no simple sign, and optimal assortments need not be nested by revenue (Table 1, p. 1328). The link between two stage problems is that their revenues differ by the same constant for all products, and what has to be shown is that such a uniform shift moves an optimal assortment in a controlled direction. Revenues in the stage problems, rj−ΔVt+1(x)r_j-\Delta V_{t+1}(x)rj​−ΔVt+1​(x), can be negative.

Formalization scope

Products are Fin n, offer sets Finset (Fin n), the paper's ⊂\subset⊂ is non-strict inclusion ⊆\subseteq⊆. The model is a structure with fields λ\lambdaλ, ρ\rhoρ and the standing assumptions λj>0\lambda_j>0λj​>0, ∑iρj,i<1\sum_i\rho_{j,i}<1∑i​ρj,i​<1; ρj,i≥0\rho_{j,i}\ge0ρj,i​≥0 is added as a field because the ρj,i\rho_{j,i}ρj,i​ are probabilities. (PS,RS)(P_S,R_S)(PS​,RS​) is a solution of (Balance) chosen by Classical.epsilon; milestone 1 states that it is the unique nonnegative one. The value function is defined by recursion on the number of periods to go, and VtV_tVt​ is used only for 1≤t≤T+11\le t\le T+11≤t≤T+1. Maxima over S⊆NS\subseteq NS⊆N are taken over the finite family of all subsets, so they are attained; dual optimality is "feasible and no worse than every feasible point".

One hypothesis is added to Theorem 5 and milestone 5, and disclosed: ∑jλj≤1\sum_j\lambda_j\le1∑j​λj​≤1, implied by the paper's description of at most one arrival per period (it makes 1−∑jPj,S1-\sum_jP_{j,S}1−∑j​Pj,S​ a probability). No sign condition is placed on the revenues, as on the page. Theorem 2 and Lemma 3 are stated for arbitrary real revenues, as the proof of Theorem 5 applies them to rj−ΔVt+1(x)r_j-\Delta V_{t+1}(x)rj​−ΔVt+1​(x). The first inclusion of Theorem 5 is stated for x≥2x\ge2x≥2: with x−1=0x-1=0x−1=0 units there is no decision, and the paper reads S^t(0)\hat S_t(0)S^t​(0) as ∅\emptyset∅. The existential requires every S^t(x)\hat S_t(x)S^t​(x) in range to be optimal for its stage problem; a statement without that clause would be satisfied by the empty sets and is ruled out.

Theorem 2 and Lemma 3 need LP duality for (Dual) and the (Balance) system; milestone 5 needs the standard induction on the dynamic program, or a bridge to the published choice_marginal_values (with arrival probabilities 111 and choice model Pj,SP_{j,S}Pj,S​). Proofs of any milestone, and bridges to published Mathlib or platform LP duality results, are welcome.

Selected references

  • J. B. Feldman, H. Topaloglu, Revenue Management Under the Markov Chain Choice Model, Operations Research 65(5):1322–1342, 2017. https://doi.org/10.1287/opre.2017.1628
  • J. Blanchet, G. Gallego, V. Goyal, A Markov Chain Approximation to Choice Modeling, Operations Research 64(4):886–905, 2016. https://doi.org/10.1287/opre.2016.1505
  • K. Talluri, G. van Ryzin, Revenue Management Under a General Discrete Choice Model of Consumer Behavior, Management Science 50(1):15–33, 2004. https://doi.org/10.1287/mnsc.1030.0147
  • K. Talluri, G. van Ryzin, The Theory and Practice of Revenue Management, Springer, 2004. https://doi.org/10.1007/b139000
10 thms2 active usersReviewed
🏆Completed
Linear OptimizationOperations ResearchOptimization·Captain: mikedeng1

Revenue Management Under the Markov Chain Choice Model III: The Reduced Linear Program Is Equivalent to the Choice-Based Linear ProgramResearch Paper

Motivation

Network revenue management decides which products to make available to arriving customers when products share scarce resources: an airline sells itineraries (products) that consume seats on flight legs (resources), and each itinerary has a fare. When customers choose among the offered products, rather than asking for one fixed product, the standard planning tool is a deterministic linear program that replaces random choices by their expected values. Gallego, Iyengar, Phillips and Dubey (2004, Columbia CORC technical report TR-2004-01) and Liu and van Ryzin (2008) formulated this choice-based linear program; its solution drives bid-price and offer-set policies used in practice.

The difficulty is size. The choice-based program has one variable for each subset of products, 2n2^n2n in all, and is solved by column generation, whose pricing subproblem is itself an assortment problem. Feldman and Topaloglu (Oper. Res. 65(5), 2017) show that when customers choose under the Markov chain choice model of Blanchet, Gallego and Goyal (2016), the choice-based program is equivalent to a linear program with only 2n2n2n variables and m+nm+nm+n constraints. This mission formalizes that equivalence, Theorem 7 of the paper.

Setting

There are nnn products, N={1,…,n}N=\{1,\dots,n\}N={1,…,n}. Under the Markov chain choice model a customer first visits product jjj with probability λj\lambda_jλj​. If the product she visits is offered, she buys it. Otherwise she moves from product jjj to product iii with probability ρj,i\rho_{j,i}ρj,i​, or leaves without buying with probability 1−∑i∈Nρj,i1-\sum_{i\in N}\rho_{j,i}1−∑i∈N​ρj,i​. The paper assumes throughout that

λj>0and∑i∈Nρj,i<1for all j∈N.\lambda_j>0\quad\text{and}\quad\sum_{i\in N}\rho_{j,i}<1\qquad\text{for all } j\in N.λj​>0andi∈N∑​ρj,i​<1for all j∈N.

For an offer set S⊆NS\subseteq NS⊆N, Pj,SP_{j,S}Pj,S​ is the expected number of visits to product jjj while it is offered, which is its purchase probability, and Rj,SR_{j,S}Rj,S​ is the expected number of visits to jjj while it is not offered. The pair (PS,RS)(P_S,R_S)(PS​,RS​) is the solution of the (Balance) equations

Pj,S+Rj,S=λj+∑i∈Nρi,jRi,S  ∀j∈N,Pj,S=0  ∀j∉S,Rj,S=0  ∀j∈S.P_{j,S}+R_{j,S}=\lambda_j+\sum_{i\in N}\rho_{i,j}R_{i,S}\ \ \forall j\in N,\qquad P_{j,S}=0\ \ \forall j\notin S,\qquad R_{j,S}=0\ \ \forall j\in S .Pj,S​+Rj,S​=λj​+i∈N∑​ρi,j​Ri,S​  ∀j∈N,Pj,S​=0  ∀j∈/S,Rj,S​=0  ∀j∈S.

Dropping the constraints tied to SSS gives the polyhedron

H={(x,z)∈R+2n:xj+zj=λj+∑i∈Nρi,jzi  ∀j∈N}.\mathcal H=\Big\{(x,z)\in\mathbb R^{2n}_+ : x_j+z_j=\lambda_j+\sum_{i\in N}\rho_{i,j}z_i\ \ \forall j\in N\Big\}.H={(x,z)∈R+2n​:xj​+zj​=λj​+i∈N∑​ρi,j​zi​  ∀j∈N}.

The network has mmm resources, M={1,…,m}M=\{1,\dots,m\}M={1,…,m}, with capacities cqc_qcq​; the selling horizon has TTT periods; product jjj earns rjr_jrj​ and consumes aq,ja_{q,j}aq,j​ units of resource qqq. With uSu_SuS​ the probability of offering SSS in a period, the (Choice Based) linear program is

max⁡u∈R+2n{∑S⊆N∑j∈NTrjPj,SuS: ∑S⊆N∑j∈NTaq,jPj,SuS≤cq ∀q∈M, ∑S⊆NuS=1},\max_{u\in\mathbb R^{2^n}_+}\Big\{\sum_{S\subseteq N}\sum_{j\in N}T r_jP_{j,S}u_S:\ \sum_{S\subseteq N}\sum_{j\in N}Ta_{q,j}P_{j,S}u_S\le c_q\ \forall q\in M,\ \sum_{S\subseteq N}u_S=1\Big\},u∈R+2n​max​{S⊆N∑​j∈N∑​Trj​Pj,S​uS​: S⊆N∑​j∈N∑​Taq,j​Pj,S​uS​≤cq​ ∀q∈M, S⊆N∑​uS​=1},

and the (Reduced) linear program is

max⁡(x,z)∈R+2n{∑j∈NTrjxj: ∑j∈NTaq,jxj≤cq ∀q∈M, xj+zj=λj+∑i∈Nρi,jzi ∀j∈N}.\max_{(x,z)\in\mathbb R^{2n}_+}\Big\{\sum_{j\in N}T r_jx_j:\ \sum_{j\in N}Ta_{q,j}x_j\le c_q\ \forall q\in M,\ x_j+z_j=\lambda_j+\sum_{i\in N}\rho_{i,j}z_i\ \forall j\in N\Big\}.(x,z)∈R+2n​max​{j∈N∑​Trj​xj​: j∈N∑​Taq,j​xj​≤cq​ ∀q∈M, xj​+zj​=λj​+i∈N∑​ρi,j​zi​ ∀j∈N}.

In (Reduced), xjx_jxj​ is the expected number of visits to product jjj while it is available and zjz_jzj​ the expected number of visits while it is not.

Formalization targets

Goal: Theorem 7

Let (x^,z^)(\hat x,\hat z)(x^,z^) be an optimal solution of (Reduced). Then there are subsets S1,…,SK⊆NS^1,\dots,S^K\subseteq NS1,…,SK⊆N and positive scalars γ1,…,γK\gamma^1,\dots,\gamma^Kγ1,…,γK with ∑kγk=1\sum_k\gamma^k=1∑k​γk=1 such that

x^=∑k=1KγkPSk,z^=∑k=1KγkRSk,\hat x=\sum_{k=1}^K\gamma^kP_{S^k},\qquad \hat z=\sum_{k=1}^K\gamma^kR_{S^k},x^=k=1∑K​γkPSk​,z^=k=1∑K​γkRSk​,

and for any such subsets and scalars the vector u^\hat uu^ with u^Sk=γk\hat u_{S^k}=\gamma^ku^Sk​=γk and u^S=0\hat u_S=0u^S​=0 for S∉{S1,…,SK}S\notin\{S^1,\dots,S^K\}S∈/{S1,…,SK} is optimal for (Choice Based), with objective value equal to that of (x^,z^)(\hat x,\hat z)(x^,z^) in (Reduced). In particular the two programs have the same optimal value.

Milestones

  1. (Balance) has a unique and nonnegative solution for every offer set (§2, p. 1325).
  2. Lemma 1: an extreme point (x^,z^)(\hat x,\hat z)(x^,z^) of H\mathcal HH equals (PS,RS)(P_{S},R_{S})(PS​,RS​) for S={j:x^j>0}S=\{j:\hat x_j>0\}S={j:x^j​>0} (p. 1326).
  3. Lemma 10: H\mathcal HH is bounded (quoted on p. 1331; proved in the online appendix).
  4. Every point of H\mathcal HH is a positive convex combination of finitely many extreme points of H\mathcal HH (proof of Theorem 7, p. 1331).
  5. Every feasible uuu of (Choice Based) yields the feasible point x~j=∑SPj,SuS\tilde x_j=\sum_S P_{j,S}u_Sx~j​=∑S​Pj,S​uS​, z~j=∑SRj,SuS\tilde z_j=\sum_S R_{j,S}u_Sz~j​=∑S​Rj,S​uS​ of (Reduced), with the same objective value (proof of Theorem 7, p. 1332).

Significance

The result. Theorem 7 replaces a program with 2n2^n2n columns by one with 2n2n2n variables and m+nm+nm+n constraints, solvable directly by any LP solver, and it returns an optimal solution of the original program, not only its value. The optimal value is the standard upper bound on the optimal expected revenue of a network revenue management policy, and the dual variables of the capacity constraints are the bid prices used to control sales. The decomposition of part 1 is what turns the small program's solution back into offer-set frequencies that a policy can implement; Section 7 of the paper makes that decomposition algorithmic (a separate mission of this series).

Formalizing it. The theorem is proved in the paper; to the best of available knowledge no machine-checked version exists. A formal proof checks the link between polyhedral geometry (extreme points of H\mathcal HH and the solutions of (Balance)) and linear-programming optimality, and records exactly which properties of the Markov chain choice model are used: the standing assumptions enter through uniqueness and nonnegativity of (PS,RS)(P_S,R_S)(PS​,RS​) and through boundedness of H\mathcal HH.

Difficulty

The inequality "(Reduced) ≥\ge≥ (Choice Based)" is a direct computation: averaging the (Balance) equations with weights uSu_SuS​ lands in H\mathcal HH. The reverse direction is where the obvious argument fails. A point of H\mathcal HH has no offer set attached to it, and a general polyhedron need not be the convex hull of its extreme points: it can contain lines or rays. The argument requires that H\mathcal HH is bounded, which depends on the substochasticity ∑iρj,i<1\sum_i\rho_{j,i}<1∑i​ρj,i​<1, and that each extreme point is exactly some (PS,RS)(P_S,R_S)(PS​,RS​), which uses the structure of the balance equations and the uniqueness of their solution. Neither follows from general linear-programming facts. In Lean, the finite vertex representation of a bounded polyhedron is also not a one-line consequence of Mathlib's Krein–Milman theorem, which gives only the closure of the convex hull.

Formalization scope

Products are Fin n, offer sets Finset (Fin n), resources Fin m. The model is a structure Model n holding λ\lambdaλ, ρ\rhoρ (rho j i =ρj,i=\rho_{j,i}=ρj,i​, the transition from jjj to iii) and the standing assumptions λj>0\lambda_j>0λj​>0 and ∑iρj,i<1\sum_i\rho_{j,i}<1∑i​ρj,i​<1; the nonnegativity ρj,i≥0\rho_{j,i}\ge0ρj,i​≥0, implicit in the paper because the ρj,i\rho_{j,i}ρj,i​ are probabilities, is an added field. (PS,RS)(P_S,R_S)(PS​,RS​) is a solution of (Balance) chosen by Classical.epsilon, and milestone 1 is what identifies it with the paper's unique solution. H\mathcal HH is a subset of (Fin n → ℝ) × (Fin n → ℝ), extreme points are Mathlib's Set.extremePoints ℝ, and boundedness is Bornology.IsBounded. TTT is a natural number entering as a real factor exactly where the paper writes it; ccc, aaa, rrr carry no sign conditions, as in the paper. "Optimal solution" means feasible and at least as good as every feasible point; no supremum is used.

Two conventions are disclosed. The paper defines u^\hat uu^ by u^Sk=γk\hat u_{S^k}=\gamma^ku^Sk​=γk; the formalization sets u^S=∑k:Sk=Sγk\hat u_S=\sum_{k:S^k=S}\gamma^ku^S​=∑k:Sk=S​γk, which agrees when the SkS^kSk are distinct and is the only consistent reading otherwise. Milestone 5 is stated for every feasible uuu of (Choice Based), while the paper applies it to an optimal one; its argument uses only feasibility. No printed statement needed correction.

The goal is not only the decomposition of part 1, which is milestones 2 and 4 combined: it also asserts optimality of u^\hat uu^ and equality of the optimal values, and a formalization that drops part 2 does not state Theorem 7. Part 2 is required for every decomposition, and part 1 guarantees one exists, so part 2 is not vacuous.

A complete development needs the vertex representation of polytopes (reusable beyond this mission; LinearOptimization.polyhedron_resolution on the platform proves the resolution theorem in another encoding), the theory of substochastic matrices behind (Balance) (invertibility of I−QˉI-\bar QI−Qˉ​ with a nonnegative inverse), and finite-sum manipulations over Finset (Fin n). Contributions to any milestone, and bridges to existing polyhedral results, are welcome.

Selected references

  • J. B. Feldman, H. Topaloglu, Revenue Management Under the Markov Chain Choice Model, Operations Research 65(5):1322–1342, 2017. https://doi.org/10.1287/opre.2017.1628
  • J. Blanchet, G. Gallego, V. Goyal, A Markov Chain Approximation to Choice Modeling, Operations Research 64(4):886–905, 2016. https://doi.org/10.1287/opre.2016.1505
  • Q. Liu, G. van Ryzin, On the Choice-Based Linear Programming Model for Network Revenue Management, Manufacturing & Service Operations Management 10(2):288–310, 2008. https://doi.org/10.1287/msom.1070.0172
  • G. Gallego, G. Iyengar, R. Phillips, A. Dubey, Managing Flexible Products on a Network, Computational Optimization Research Center Technical Report TR-2004-01, Columbia University, 2004 (technical report; no DOI).
  • M. L. Puterman, Markov Decision Processes: Discrete Stochastic Dynamic Programming, Wiley, 1994. https://doi.org/10.1002/9780470316887
8 thms2 active usersReviewed
Convex OptimizationDiscrete GeometryOperations Research+1·Captain: Shuze Chen

Discrete Convex Analysis XXVIII: The Conjugacy TheoremTextbook

Motivation

Chapter 8 is where discrete convex analysis explains why it needed two separate notions — M-convexity (exchangeability) and L-convexity (submodularity) — rather than one. The answer is conjugacy: under the classical Legendre-Fenchel transform, the two classes turn out to be exactly dual to each other, the discrete analogue of the fact that convex analysis's transform is self-dual within a single class of convex functions. Mission 10-conjugacy-i proved the integer-lattice version of this fact (Theorem 8.12) but explicitly deferred the polyhedral version — Theorem 8.4, the chapter's own headline "Conjugacy theorem" — noting it needed a real-variable M-/L-convex-function layer the series had not yet built. That layer now exists, built across missions 23-24-ch06*-mconvexfunctions and 26-27-ch07*-lconvexfunctions. This mission proves Theorem 8.4 and its companions: the polar-cone correspondence it induces, its nonpolyhedral generalization, the separation and Fenchel-duality theorems for M♮-/L♮-convex functions, and the basic theory of M2-convex functions (sums of M-convex functions), which the Edmonds intersection theorem's own combinatorics is built from.

Setting

Fix a finite ground set VVV. For f:RV→R∪{+∞}f : \mathbb R^V \to \mathbb R \cup \{+\infty\}f:RV→R∪{+∞}, the Legendre-Fenchel transform is f∙(p)=sup⁡x[⟨p,x⟩−f(x)]f^\bullet(p) = \sup_x [\langle p,x\rangle - f(x)]f∙(p)=supx​[⟨p,x⟩−f(x)]. A polyhedral convex function fff is M-convex (f∈M[R→R]f \in M[\mathbb R \to \mathbb R]f∈M[R→R]) if it satisfies (M-EXC[R]); ggg is L-convex (g∈L[R→R]g \in L[\mathbb R \to \mathbb R]g∈L[R→R]) if it satisfies (SBF[R]) and (TRF[R]). A concave function hhh is always represented via h2=−hh_2 = -hh2​=−h, an ordinary convex function, so every "f≥hf \ge hf≥h" hypothesis is restated as "f+h2≥0f + h_2 \ge 0f+h2​≥0" — an equivalent formulation avoiding any need to represent −∞-\infty−∞ in the codomain. A polyhedral cone's polar is C∘={y:⟨y,x⟩≤0 ∀x∈C}C^\circ = \{y : \langle y,x\rangle \le 0\ \forall x \in C\}C∘={y:⟨y,x⟩≤0 ∀x∈C}. A function is M2-convex if it is the sum of two M-convex functions.

Formalization targets

Goal: the conjugacy theorem (Theorem 8.4)

The classes of polyhedral M-convex functions and polyhedral L-convex functions are in one-to-one correspondence under the Legendre-Fenchel transform: f∈M⇒f∙∈Lf \in M \Rightarrow f^\bullet \in Lf∈M⇒f∙∈L, g∈L⇒g∙∈Mg \in L \Rightarrow g^\bullet \in Mg∈L⇒g∙∈M, and the transform is an involution (f∙∙=ff^{\bullet\bullet}=ff∙∙=f, g∙∙=gg^{\bullet\bullet}=gg∙∙=g) on each class, with the identical statement for the M♮^\natural♮/L♮^\natural♮ variants. This is the theorem mission 10-conjugacy-i deferred, citing exactly the missing infrastructure this series has since built.

Supporting structural targets

Twelve further results build the surrounding theory. Proposition 8.2 gives the easy two-variable case of the general submodularity-preservation fact (Theorem 8.1, already a milestone of mission 10-conjugacy-i); Proposition 8.3 is the technical minimizer-difference lemma the goal's harder direction is built from. Theorem 8.5 derives the M-convex/L-convex cone polarity from the goal, and Theorem 8.6 extends the correspondence beyond the polyhedral case to general closed proper convex functions. Proposition 8.14 and Theorems 8.15-8.16 build the separation theory for M♮-/L♮-convex and concave function pairs, with integral witnesses when the functions are integer valued; Theorem 8.21 (parts 1-2) derives the Fenchel-type strong-duality equality these separation theorems make possible. Propositions 8.29-8.30 and Theorem 8.31 (plus Theorem 8.32, found by direct reading immediately after 8.31) build the basic theory of M2-convex functions: their domains and minimizer sets are M2-convex, they are integrally convex, and their global optimality reduces to a finite local check.

Significance

The goal is the theorem that retroactively explains this entire series' two-track structure: missions 20-25 (M-convex sets and functions) and 08/21/26-28 (L-convex sets and functions) are not two independent theories that happen to share techniques — they are conjugate images of each other, so every theorem proved on one side has a dual counterpart automatically available on the other via Theorem 8.4. This is made concrete immediately: Theorem 8.5's cone polarity and the diagram the book draws connecting M0[R]M_0[\mathbb R]M0​[R], 0L[R→R]0L[\mathbb R\to\mathbb R]0L[R→R], and submodular set functions S[R]S[\mathbb R]S[R] (already correspondences this series proved independently, in missions 24-ch06d-mconvexfunctions and 28-ch07d-lconvexfunctions) are shown to be facets of one single conjugacy fact rather than three separate coincidences. The separation and Fenchel duality theorems (8.15, 8.16, 8.21) are the discrete analogues of the two theorems every convex optimization course opens with, and the book is explicit that they are not corollaries of the classical versions plus convex extensibility — they carry genuinely combinatorial content, specializing to Frank's discrete separation theorem and Edmonds's intersection theorem as examples the book itself gives.

None of these results are open — they are Murota's account of the duality at the heart of discrete convex analysis, the reason the theory needed two dual notions rather than one. What this mission contributes is a faithful, machine-checked formal statement of each, completing a theorem mission 10-conjugacy-i explicitly left for a future session once the necessary polyhedral apparatus existed, and including one result (Theorem 8.32) the platform's own automated extractor missed; no comparable formalization exists on the platform (see Formalization scope).

Difficulty

The naive approach to the goal's harder direction (L⇒M) would try to verify the exchange inequality for g∙g^\bulletg∙ directly from the definition of the transform; the book's actual proof instead identifies the exchange inequality with a statement about weighted minimizers of ggg itself via Proposition 8.3 (the minimizer-difference bound), converting a claim about the conjugate function into a claim about ggg's own combinatorial structure — a genuine change of perspective, not a direct calculation. Proposition 8.3's own proof is the hardest single argument in this block: it derives the minimizer-difference bound by a contradiction argument that constructs an explicit pair of "worse" minimizers via a join/meet perturbation and derives a strict inequality from Theorem 7.29's translation inequality — a multi-step combinatorial argument with no direct shortcut.

Formalization scope

Ground-set elements are a Fintype V with DecidableEq; convex functions are WithTop ℝ valued throughout (never EReal, except for the Legendre-Fenchel transform itself, whose defining supremum/infimum can genuinely be infinite). All thirteen numbered results found in this chunk's page range — the twelve in BRIEF.md's own table plus Theorem 8.32 — are placed, with one documented scope reduction: Theorem 8.21 states only its real-attainment parts (1)-(2), not the integer-attainment refinement of parts (3)-(4), which needs a separate argument no other result in this chunk requires — see HARD.md. Concave functions hhh are always represented via h2=−hh_2 = -hh2​=−h and every inequality f≥hf \ge hf≥h restated as f+h2≥0f + h_2 \ge 0f+h2​≥0, avoiding WithTop ℝ negation entirely. This chunk's own BRIEF.md inherited the chapters-4-7 page-offset boilerplate (printed = PDF −-− 19); chapter 8 uses offset 18, confirmed against the PDF's own footers — every citation here uses the corrected offset. This mission's base vocabulary is redeclared from missions 10-conjugacy-i, 20-ch04b-mconvexsets, 21-ch05b-lconvexsets, 23-24-ch06*-mconvexfunctions, and 26-27-ch07*-lconvexfunctions rather than imported, since sibling drafts in this series cannot yet reference one another. Contributions completing any of the thirteen sorrys are welcome; the goal and Proposition 8.3 carry the most independent proof content.

Selected references

  • K. Murota, Discrete Convex Analysis, SIAM, 2003. DOI: 10.1137/1.9780898718508.
  • K. Murota and A. Shioura, "M-convex function on generalized polymatroid," Mathematics of Operations Research, 24 (1999), pp. 95-105 [152] (the polyhedral M-/L-convex conjugacy theory this mission's real-variable results are drawn from).
73 thms2 active usersReviewed
🏆Completed
CombinatoricsGraph TheoryOperations Research+2·Captain: mikedeng1

Applied Combinatorics VII: Minimum Spanning Trees and Dijkstra's AlgorithmTextbook

Motivation

Two optimization problems on weighted networks sit at the base of operations research and algorithm design. The first asks for the cheapest way to connect every node of a network, such as a cable, pipeline or communication network. The answer is a minimum weight spanning tree. The second asks for the shortest route from a depot to every other node of a road or data network, the single-source shortest path problem. Chapter 12 of Keller and Trotter's Applied Combinatorics (appliedcombinatorics.org, CC BY-SA 4.0) treats both. It proves the structural lemmas behind the greedy spanning tree algorithms of Kruskal (1956) and Prim (1957), and the correctness of the shortest path algorithm of Dijkstra (1959).

The minimum spanning tree problem goes back to Borůvka (1926), who designed an electrical network for Moravia. Kruskal and Prim gave the two greedy algorithms taught today, and Dijkstra's 1959 note treated both problems. Dijkstra's shortest path method, with heap-based refinements such as Fredman and Tarjan (1987), remains the standard solver for non-negative lengths and a building block of routing, scheduling and network flow codes.

Setting

A graph G=(V,E)G = (V, E)G=(V,E) has a finite vertex set VVV and a set EEE of 2-element subsets of VVV. A weight w(e)∈N0w(e) \in \mathbb N_0w(e)∈N0​ is attached to each edge, and a set SSS of edges has weight w(S)=∑e∈Sw(e)w(S) = \sum_{e \in S} w(e)w(S)=∑e∈S​w(e). A spanning forest of GGG is an acyclic graph H=(V,S)H = (V, S)H=(V,S) with S⊆ES \subseteq ES⊆E. A spanning tree is a spanning forest that is connected. The weight of a spanning tree is the weight of its edge set. In Lean these are SimpleGraph V with [Fintype V], IsSpanningForest G H (H≤GH \le GH≤G and acyclic), IsSpanningTree G T (T≤GT \le GT≤G and a tree), and weight w T for a weight w : Sym2 V → ℕ.

A digraph G=(V,E)G = (V, E)G=(V,E) has E⊆V×VE \subseteq V \times VE⊆V×V with x≠yx \ne yx=y for every directed edge (x,y)(x, y)(x,y). Each directed edge has a length w(x,y)∈N0w(x, y) \in \mathbb N_0w(x,y)∈N0​. The length is extended by w(x,y)=∞w(x, y) = \inftyw(x,y)=∞ for non-edges. A directed path from aaa to bbb is a sequence (a=u0,…,ut=b)(a = u_0, \dots, u_t = b)(a=u0​,…,ut​=b) of distinct vertices in which consecutive pairs are directed edges. Its length is ∑i<tw(ui,ui+1)\sum_{i<t} w(u_i, u_{i+1})∑i<t​w(ui​,ui+1​). The distance dist⁡(a,b)∈N0∪{∞}\operatorname{dist}(a, b) \in \mathbb N_0 \cup \{\infty\}dist(a,b)∈N0​∪{∞} is the minimum length of a directed path from aaa to bbb, and is ∞\infty∞ when no such path exists. A shortest path is a directed path attaining it. In Lean this is WeightedDigraph V with ext, IsDirPath, pathLength, dist and IsShortestPath.

Dijkstra's algorithm (Algorithm 12.14) with root rrr and n=∣V∣n = |V|n=∣V∣ keeps a sequence σ\sigmaσ of permanent vertices, a value δ(x)∈N0∪{∞}\delta(x) \in \mathbb N_0 \cup \{\infty\}δ(x)∈N0​∪{∞} and a sequence P(x)P(x)P(x) for each vertex. Step 1 sets δ(r)=0\delta(r) = 0δ(r)=0, P(r)=(r)P(r) = (r)P(r)=(r), σ=(r)\sigma = (r)σ=(r), and δ(x)=w(r,x)\delta(x) = w(r, x)δ(x)=w(r,x), P(x)=(r,x)P(x) = (r, x)P(x)=(r,x) for x≠rx \ne rx=r. Step iii with 1<i<n1 < i < n1<i<n scans from the last permanent vertex viv_ivi​. For every temporary xxx it sets δ(x)←min⁡{δ(x),δ(vi)+w(vi,x)}\delta(x) \leftarrow \min\{\delta(x), \delta(v_i) + w(v_i, x)\}δ(x)←min{δ(x),δ(vi​)+w(vi​,x)}, and on a strict decrease it replaces P(x)P(x)P(x) by P(vi)P(v_i)P(vi​) followed by xxx. Each step ends by appending to σ\sigmaσ a temporary vertex of minimum δ\deltaδ, chosen arbitrarily among ties. The algorithm halts at Step nnn. DijkstraRun G r i s holds when some sequence of admissible choices leads to state s at the start of Step iii.

Formalization targets

Goal: correctness of Dijkstra's algorithm (Theorem 12.18)

For every halted state of every run, and every vertex xxx,

δ(x)=dist⁡(r,x),dist⁡(r,x)<∞  ⟹  P(x) is a shortest path from r to x.\delta(x) = \operatorname{dist}(r, x), \qquad \operatorname{dist}(r, x) < \infty \implies P(x) \text{ is a shortest path from } r \text{ to } x.δ(x)=dist(r,x),dist(r,x)<∞⟹P(x) is a shortest path from r to x.

Milestones

  1. Proposition 12.3. A spanning forest H=(V,S)H = (V, S)H=(V,S) of a graph on n≥1n \ge 1n≥1 vertices has ∣S∣≤n−1|S| \le n - 1∣S∣≤n−1 and exactly n−∣S∣n - |S|n−∣S∣ components. It is a spanning tree if and only if ∣S∣=n−1|S| = n - 1∣S∣=n−1.
  2. Proposition 12.4 (Exchange Principle). Let TTT be a spanning tree and xy∈E∖Txy \in E \setminus Txy∈E∖T. Then TTT contains a unique path x=x0,…,xt=yx = x_0, \dots, x_t = yx=x0​,…,xt​=y, and replacing any edge xixi+1x_i x_{i+1}xi​xi+1​ of it by xyxyxy gives a spanning tree.
  3. Lemma 12.6. In a connected weighted graph, let FFF be a spanning forest and CCC a component of FFF. A minimum weight edge leaving CCC lies in some spanning tree that has minimum weight among the spanning trees containing FFF.
  4. Proposition 12.16. Every prefix and every suffix of a shortest path is a shortest path.
  5. Proposition 12.17. When the algorithm halts, δ(v1)≤δ(v2)≤⋯≤δ(vn)\delta(v_1) \le \delta(v_2) \le \cdots \le \delta(v_n)δ(v1​)≤δ(v2​)≤⋯≤δ(vn​).

Milestones 4 and 5 are the two statements the book's proof of the goal rests on. Milestones 1–3 are the spanning tree half of the chapter. Lemma 12.6 is the result from which the book derives the correctness of Kruskal's and Prim's algorithms.

Significance

Theorem 12.18 certifies that one pass of nnn steps computes all distances from rrr and a shortest path tree, with no condition on the digraph beyond non-negative lengths. Lemma 12.6 is the cut property. Every greedy minimum spanning tree method (Kruskal, Prim, Borůvka) is an instance of it, and the exchange principle is the matroid basis-exchange axiom specialised to the graphic matroid.

All of these results are classical and proved. None is formalized in this form on the platform. Mathlib has spanning trees of connected graphs, uniqueness of paths in acyclic graphs, and the edge count n−1n - 1n−1 of a tree. It has no edge–component count for forests, no exchange principle, no weighted spanning trees, and no Dijkstra. On Prove2Me, FamousTheorems.tree_card_edges_6b and ClassicalGaps.isAcyclic_edges_eq_card_sub_one_imp_connected cover only the tree case of Proposition 12.3. KServer.mst_cut_property is a cut property for complete graphs encoded by parent maps, a different statement. The label-correcting algorithm of Dynamic Programming and Optimal Control II (BertsekasDP.label_correcting_*) is a different algorithm: it keeps an open list and scans in arbitrary order, not by minimum label.

Difficulty

The goal is a statement about the final state of a run, but the facts it depends on only become visible across steps: a permanent vertex's δ\deltaδ and PPP never change again, and δ(x)\delta(x)δ(x) is always the length of the current P(x)P(x)P(x). None of this is recorded in the final state itself. An argument over the steps of the run has to show that each P(x)P(x)P(x) remains a path with distinct vertices, including when edges of length 000 allow ties. It also has to handle the value ∞\infty∞, where ∞+a=∞\infty + a = \infty∞+a=∞ and a comparison between two infinite values never counts as a decrease. Tie-breaking is arbitrary, so no argument may depend on which minimum is chosen. For Lemma 12.6 the difficulty is the exchange step: removing an edge of a tree path and adding a crossing edge must again give a tree that still contains the forest FFF, and this is a statement about cycles and components, not about counts.

Formalization scope

  • Graphs are SimpleGraph V over a Fintype V. Weights are Sym2 V → ℕ (the book's w:E→N0w : E \to \mathbb N_0w:E→N0​; values off EEE are never used). Acyclic, tree and connected components are Mathlib's. In Proposition 12.3, ∣S∣=n−k|S| = n - k∣S∣=n−k is written ∣S∣+k=n|S| + k = n∣S∣+k=n and n≥1n \ge 1n≥1 is assumed, which the bound n−1n - 1n−1 presupposes.
  • Lemma 12.6 assumes GGG connected, the section's standing assumption (p. 239). The page's "to avoid trivialities, we assume n≥3n \ge 3n≥3" is not imposed, because the statement holds for every nnn. The crossing edge may have either endpoint in CCC.
  • Lengths in the digraph are ℕ, and δ\deltaδ and distances are ℕ∞, where ∞\infty∞ is ⊤, never a large finite number. A version with real or ℝ≥0 lengths would be a generalization and is not what is asked.
  • Dijkstra's algorithm is defined step by step exactly as on pp. 246–247, including δ(x)=w(r,x)=∞\delta(x) = w(r, x) = \inftyδ(x)=w(r,x)=∞ and P(x)=(r,x)P(x) = (r, x)P(x)=(r,x) for non-neighbours at Step 1. The goal quantifies over every halted state, so it holds for every tie-breaking. A halted state always exists; a sorry-free check of this is in the workspace. For a vertex not reachable from rrr the book is silent. The distance there is read as ∞\infty∞, and the shortest-path conclusion is asserted only at finite distance.
  • A trivializing formalization is ruled out: δ\deltaδ is computed by the update rule of Algorithm 12.14, not defined as the distance, and the theorem is not stated for an arbitrary procedure satisfying its own conclusion.
  • The book uses no O(⋅)O(\cdot)O(⋅) bounds or approximate constants in these statements, so there are no constants to instantiate.
  • Reusable infrastructure: a list-based theory of directed paths and distances in ℕ∞, the invariants of Dijkstra's algorithm, and forest edge counting. Contributions of general lemmas (walks shortcut to paths without increasing length, component counts under edge insertion) are welcome.

Selected references

  • M. T. Keller and W. T. Trotter, Applied Combinatorics, 2017 Edition, Chapter 12. https://www.appliedcombinatorics.org/
  • E. W. Dijkstra, "A note on two problems in connexion with graphs", Numerische Mathematik 1 (1959) 269–271. https://doi.org/10.1007/BF01386390
  • J. B. Kruskal, "On the shortest spanning subtree of a graph and the traveling salesman problem", Proc. AMS 7 (1956) 48–50. https://doi.org/10.1090/S0002-9939-1956-0078686-7
  • R. C. Prim, "Shortest connection networks and some generalizations", Bell System Technical Journal 36 (1957) 1389–1401. https://doi.org/10.1002/j.1538-7305.1957.tb01515.x
  • M. L. Fredman and R. E. Tarjan, "Fibonacci heaps and their uses in improved network optimization algorithms", J. ACM 34 (1987) 596–615. https://doi.org/10.1145/28869.28874
  • O. Borůvka, "O jistém problému minimálním", Práce Moravské přírodovědecké společnosti 3 (1926) 37–58. https://dml.cz/handle/10338.dmlcz/500114
8 thms2 active usersReviewed
🏆Completed
CombinatoricsGraph TheoryLinear Optimization+2·Captain: mikedeng1

Applied Combinatorics VIII: The Max Flow–Min Cut TheoremTextbook

Motivation

Moving as much as possible of something — freight, water, data — from an origin to a destination through connections of limited capacity is one of the basic problems of operations research. Its mathematical form, the maximum flow problem, was posed in the 1950s in work on rail networks and solved independently by Ford and Fulkerson (Maximal flow through a network, Canadian J. Math. 8 (1956)) and by Elias, Feinstein and Shannon (A note on the maximum flow through a network, IRE Trans. Inform. Theory 2 (1956)). The answer, the Max Flow–Min Cut Theorem, is a min–max duality: the largest amount that can be shipped equals the smallest total capacity whose removal disconnects the destination from the origin. It is a standard example of linear-programming duality with a combinatorial proof, and it is the source of Hall's matching theorem, Menger's theorem and Dilworth's theorem via network constructions.

This mission formalizes Chapter 13 of Keller and Trotter's Applied Combinatorics (2017 Edition), together with the two theorems of Chapter 14 that apply it, in the book's own model of a network.

Setting

A network consists of a finite vertex set VVV, a set of directed edges (x,y)(x, y)(x,y), a source SSS and a sink TTT with S≠TS \ne TS=T, and a capacity c(x,y)≥0c(x, y) \ge 0c(x,y)≥0 (a real number) on each edge. The underlying directed graph is an oriented graph: for any two vertices x,yx, yx,y at most one of (x,y)(x, y)(x,y), (y,x)(y, x)(y,x) is an edge. Every edge at SSS points away from SSS and every edge at TTT points into TTT.

A flow is a function ϕ\phiϕ on the edges with 0≤ϕ(x,y)≤c(x,y)0 \le \phi(x, y) \le c(x, y)0≤ϕ(x,y)≤c(x,y), extended by ϕ(x,y)=0\phi(x, y) = 0ϕ(x,y)=0 on pairs that are not edges, satisfying the conservation laws

∑xϕ(S,x)=∑xϕ(x,T),∑xϕ(x,y)=∑xϕ(y,x)(y≠S,T).\sum_x \phi(S, x) = \sum_x \phi(x, T), \qquad \sum_x \phi(x, y) = \sum_x \phi(y, x)\quad (y \ne S, T).x∑​ϕ(S,x)=x∑​ϕ(x,T),x∑​ϕ(x,y)=x∑​ϕ(y,x)(y=S,T).

The value of ϕ\phiϕ is value⁡(ϕ)=∑xϕ(S,x)\operatorname{value}(\phi) = \sum_x \phi(S, x)value(ϕ)=∑x​ϕ(S,x).

A cut is a partition V=L∪UV = L \cup UV=L∪U with S∈LS \in LS∈L, T∈UT \in UT∈U. Its capacity is

c(L,U)=∑x∈L, y∈Uc(x,y),c(L, U) = \sum_{x \in L,\ y \in U} c(x, y),c(L,U)=x∈L, y∈U∑​c(x,y),

summed over the edges directed from LLL to UUU only.

Given a flow ϕ\phiϕ, an edge (x,y)(x, y)(x,y) is used if ϕ(x,y)>0\phi(x, y) > 0ϕ(x,y)>0 and has spare capacity if ϕ(x,y)<c(x,y)\phi(x, y) < c(x, y)ϕ(x,y)<c(x,y). An augmenting path is a sequence P=(x0,…,xm)P = (x_0, \dots, x_m)P=(x0​,…,xm​) of distinct vertices from x0=Sx_0 = Sx0​=S to xm=Tx_m = Txm​=T such that each step either follows an edge (xi−1,xi)(x_{i-1}, x_i)(xi−1​,xi​) with spare capacity (a forward edge) or traverses a used edge (xi,xi−1)(x_i, x_{i-1})(xi​,xi−1​) backwards (a backward edge). Its augmentation amount is δ=min⁡{δ1,δ2}\delta = \min\{\delta_1, \delta_2\}δ=min{δ1​,δ2​}, where δ1\delta_1δ1​ is the least spare capacity of a forward edge and δ2\delta_2δ2​ the least flow on a backward edge (δ=δ1\delta = \delta_1δ=δ1​ when there is no backward edge).

For Chapter 14: in a finite simple graph with bipartition V=V1∪V2V = V_1 \cup V_2V=V1​∪V2​, a matching is a set of edges no two of which share an endpoint; it saturates a vertex that is an endpoint of one of its edges; and N(A)N(A)N(A) is the set of neighbors of the vertices in AAA.

Formalization targets

Goal: the Max Flow–Min Cut Theorem (Theorem 13.10)

For every network there is a real number v0v_0v0​ with

v0=max⁡{value⁡(ϕ):ϕ a flow}=min⁡{c(L,U):V=L∪U a cut},v_0 = \max\{\operatorname{value}(\phi) : \phi \text{ a flow}\} = \min\{c(L, U) : V = L \cup U \text{ a cut}\},v0​=max{value(ϕ):ϕ a flow}=min{c(L,U):V=L∪U a cut},

that is, v0v_0v0​ is attained by some flow and bounds every flow value from above, and v0v_0v0​ is attained by some cut and bounds every cut capacity from below.

Milestones

  • Theorem 13.4. For every flow ϕ\phiϕ and every cut, value⁡(ϕ)≤c(L,U)\operatorname{value}(\phi) \le c(L, U)value(ϕ)≤c(L,U).
  • Proposition 13.7. If PPP is an augmenting path for a flow ϕ\phiϕ of value vvv and δ\deltaδ is its augmentation amount, the function obtained by adding δ\deltaδ on the forward edges of PPP and subtracting δ\deltaδ on its backward edges is a flow of value v+δv + \deltav+δ.
  • Theorem 14.1. If every capacity is an integer, some maximum flow has ϕ(x,y)∈Z\phi(x, y) \in \mathbb Zϕ(x,y)∈Z on every edge.
  • Theorem 14.7 (Hall). In a finite bipartite graph with bipartition V1∪V2V_1 \cup V_2V1​∪V2​ there is a matching saturating every vertex of V1V_1V1​ if and only if ∣N(A)∣≥∣A∣|N(A)| \ge |A|∣N(A)∣≥∣A∣ for every A⊆V1A \subseteq V_1A⊆V1​.

Significance

The result. Theorem 13.10 turns every maximum-flow computation into a certified one: a flow and a cut of equal value prove each other optimal, and Theorem 13.4 shows no certificate can do better. Together with the integrality theorem 14.1 it is the engine behind the combinatorial applications of Chapter 14: maximum matchings in bipartite graphs, Hall's theorem, and the computation of the width of a poset with a minimum chain partition. Beyond the book, the same duality underlies Menger's theorem, König's theorem, the analysis of image segmentation by graph cuts, and the combinatorial theory of totally unimodular linear programs.

Formalizing it. The results are classical and proved. Mathlib has no theory of network flows. The platform has a Max-Flow Min-Cut theorem in the model of Bertsimas and Tsitsiklis (a general digraph on Fin n with capacities in (0,∞](0, \infty](0,∞], value compared in EReal), which does not cover the book's networks with zero capacities and is stated for a different encoding. This mission produces the theory in the book's model: finite oriented networks with real non-negative capacities, flows as functions on vertex pairs, cuts as vertex subsets, and the augmenting-path step that the Ford–Fulkerson labeling algorithm iterates. Hall's theorem is in Mathlib in its indexed-family form; the graph form stated here is new to the platform.

Difficulty

Theorem 13.4 is a finite-sum rearrangement. The difficulty of the goal is the existence of a maximum flow. The textbook argument runs the labeling algorithm until it halts, then reads off a cut from the labeled vertices. With real capacities this algorithm need not halt: with badly chosen augmenting paths and irrational capacities the flow values can converge to a limit strictly below the maximum, so "repeat until no augmenting path exists" does not by itself produce a maximum flow. The existence of an optimal flow is therefore not a by-product of the algorithm's description; it has to be established in its own right before the absence of augmenting paths can be turned into a cut of equal capacity. A formalization that assumes a maximum flow exists proves a strictly weaker statement. Proposition 13.7 is elementary but bookkeeping-heavy: backward edges subtract flow, and conservation must be checked at every interior vertex of the path.

Formalization scope

The vertex set is a type V with [Fintype V] [DecidableEq V]. A network (AppliedComb.Flows.Network) bundles an edge relation adj, the source S and sink T with S ≠ T, and a real capacity function cap, together with the axioms of an oriented graph, the orientation of edges at S and T, and 0 ≤ cap x y on edges. Flows are functions ϕ : V → V → ℝ satisfying IsFlow, which includes ϕ=0\phi = 0ϕ=0 off the edges and keeps the first conservation law as part of the definition, as on the page. The value is ∑xϕ(S,x)\sum_x \phi(S, x)∑x​ϕ(S,x). A cut is its part L : Finset V with S ∈ L, T ∉ L. Augmenting paths are injective maps Fin (m + 1) → V, and δ1,δ2,δ\delta_1, \delta_2, \deltaδ1​,δ2​,δ are computed in WithTop ℝ so that an empty minimum is ⊤\top⊤ and δ=δ1\delta = \delta_1δ=δ1​ when there is no backward edge. Hall's theorem uses Mathlib's SimpleGraph with a given bipartition into two Finsets and matchings as sets of Sym2 V edges.

No explicit constants arise: the chapter has no asymptotic or approximate statements.

The book's sentence of Theorem 13.10 reads "if v0v_0v0​ is the maximum value of a flow and c0c_0c0​ the minimum capacity of a cut, then v0=c0v_0 = c_0v0​=c0​". A formalization that takes v0v_0v0​ and c0c_0c0​ as hypothetical extrema of possibly empty or unattained sets would be trivial or vacuous; the goal here asserts the existence of a maximum flow and a minimum cut at the same number, and the existence of a maximum flow for real capacities is part of what must be proved.

Needed infrastructure: finite-sum manipulation over Finset (reindexing, splitting over L and Lᶜ), existence of maximizers of a linear function over the set of flows, and, for Theorem 14.1, control of integrality. The definitions of networks, flows, cuts and augmenting paths are reusable for Menger's theorem, König's theorem and the chain-partition network of Section 14.3. Contributions of alternative proofs (via linear-programming duality) are welcome.

Selected references

  • M. T. Keller and W. T. Trotter, Applied Combinatorics, 2017 Edition, Chapters 13–14. https://www.appliedcombinatorics.org/book/
  • L. R. Ford and D. R. Fulkerson, Maximal flow through a network, Canadian Journal of Mathematics 8 (1956), 399–404. https://doi.org/10.4153/CJM-1956-045-5
  • P. Elias, A. Feinstein and C. E. Shannon, A note on the maximum flow through a network, IRE Transactions on Information Theory 2 (1956), 117–119. https://doi.org/10.1109/TIT.1956.1056816
  • P. Hall, On representatives of subsets, Journal of the London Mathematical Society 10 (1935), 26–30. https://doi.org/10.1112/jlms/s1-10.37.26
  • U. Zwick, The smallest networks on which the Ford–Fulkerson maximum flow procedure may fail to terminate, Theoretical Computer Science 148 (1995), 165–170. https://doi.org/10.1016/0304-3975(95)00022-O
8 thms3 active usersReviewed
🏆Completed
Mechanism DesignOperations ResearchOptimization·Captain: mikedeng1

Supply Chain Coordination for False Failure Returns: A Coordinating Target Rebate Helps the Retailer, and the Manufacturer iff Coordinated Effort Is at Least Twice Decentralized EffortResearch Paper

Motivation

A false failure return is a product returned by a consumer as defective although it has no functional or cosmetic defect; managers attribute such returns to installation difficulties, a mismatch with the consumer's preferences, and remorse. Ferguson, Guide and Souza report (pp. 376–377) that false failures account for up to 80% of Hewlett-Packard's inkjet printer returns, roughly 5% of sales, and that the per-unit cost of a false failure return to computer manufacturers is around 25% of the product's price. The manufacturer absorbs most of that cost, while the retailer is the party able to prevent the returns in the short term, by spending time with customers before the sale and supporting them after it. The retailer bears the cost of that effort but captures only part of its benefit, so without an incentive it exerts too little.

The paper (Ferguson, Guide & Souza, MSOM 2006) models this as a single-period manufacturer–retailer problem with non-contractible retailer effort, and asks which contracts restore the supply chain's optimal effort and who gains from them. It belongs to the literature on supply chain coordination with contracts (Cachon 2003) and on channel rebates with sales effort (Taylor 2002); its object is a target rebate, a payment to the retailer for every false failure return below a target.

Setting

A manufacturer with unit cost ccc sells to a retailer at wholesale price www, who sells at retail price ppp. Avoiding one false failure return is worth

Mm=m+δm(w−c) to the manufacturer,Rr=r+δr(p−w) to the retailer,M_m = m + \delta_m(w - c) \ \text{to the manufacturer},\qquad R_r = r + \delta_r(p - w)\ \text{to the retailer},Mm​=m+δm​(w−c) to the manufacturer,Rr​=r+δr​(p−w) to the retailer,

where mmm and rrr are the parties' return-processing costs and δm\delta_mδm​, δr\delta_rδr​ are the unit sale impacts of avoiding the return (p. 381). Both are assumed positive.

The retailer chooses an effort ρ≥1\rho \ge 1ρ≥1 at cost aρ2/2a\rho^2/2aρ2/2, a>0a > 0a>0. At effort ρ\rhoρ the number of false failures is a nonnegative random variable X(ρ)X(\rho)X(ρ) with mean β/ρ\beta/\rhoβ/ρ, where β>0\beta > 0β>0 is the expected number at the minimum effort ρ=1\rho = 1ρ=1. The coordinated supply chain earns

Π(ρ)=(Mm+Rr) β(1−1ρ)−aρ22,\Pi(\rho) = (M_m + R_r)\,\beta\Big(1 - \frac1\rho\Big) - \frac{a\rho^2}{2},Π(ρ)=(Mm​+Rr​)β(1−ρ1​)−2aρ2​,

maximized at the coordinated effort ρC=[(Mm+Rr)β/a]1/3\rho^C = [(M_m + R_r)\beta/a]^{1/3}ρC=[(Mm​+Rr​)β/a]1/3. Without a contract the retailer earns πR(ρ)=−aρ2/2+Rrβ(1−1/ρ)\pi_R(\rho) = -a\rho^2/2 + R_r\beta(1 - 1/\rho)πR​(ρ)=−aρ2/2+Rr​β(1−1/ρ) and chooses the decentralized effort ρD=max⁡{(Rrβ/a)1/3,1}\rho^D = \max\{(R_r\beta/a)^{1/3}, 1\}ρD=max{(Rr​β/a)1/3,1}; the manufacturer then earns πM(ρD)=Mmβ(1−1/ρD)\pi_M(\rho^D) = M_m\beta(1 - 1/\rho^D)πM​(ρD)=Mm​β(1−1/ρD).

Under a target rebate contract (u,T)(u, T)(u,T) the retailer receives uuu for every false failure below the target TTT, so the profits become

πR(ρ∣T,u)=u E{[T−X(ρ)]+}−aρ22+Rrβ(1−1ρ),πM(ρ∣T,u)=Mmβ(1−1ρ)−u E{[T−X(ρ)]+}.\pi_R(\rho \mid T, u) = u\,E\{[T - X(\rho)]^+\} - \frac{a\rho^2}{2} + R_r\beta\Big(1 - \frac1\rho\Big),\qquad \pi_M(\rho \mid T, u) = M_m\beta\Big(1 - \frac1\rho\Big) - u\,E\{[T - X(\rho)]^+\}.πR​(ρ∣T,u)=uE{[T−X(ρ)]+}−2aρ2​+Rr​β(1−ρ1​),πM​(ρ∣T,u)=Mm​β(1−ρ1​)−uE{[T−X(ρ)]+}.

The contract coordinates the supply chain when ρC\rho^CρC maximizes πR(⋅∣T,u)\pi_R(\cdot \mid T, u)πR​(⋅∣T,u) over ρ≥1\rho \ge 1ρ≥1. In the uniform case of §3.1, X(ρ)∼Uniform(0,2β/ρ)X(\rho) \sim \mathrm{Uniform}(0, 2\beta/\rho)X(ρ)∼Uniform(0,2β/ρ), and the contract must satisfy T<2β/ρCT < 2\beta/\rho^CT<2β/ρC.

Formalization targets

Goal: Proposition 2 (p. 383)

Assume a,β,Mm,Rr>0a, \beta, M_m, R_r > 0a,β,Mm​,Rr​>0 and (Mm+Rr)β>a(M_m + R_r)\beta > a(Mm​+Rr​)β>a, and let X(ρ)X(\rho)X(ρ) be uniform. For every coordinating contract (u,T)(u, T)(u,T) with u>0u > 0u>0, 0<T<2β/ρC0 < T < 2\beta/\rho^C0<T<2β/ρC,

πR(ρC∣T,u)≥πR(ρD)and(πM(ρC∣T,u)≥πM(ρD)  ⟺  ρC≥2ρD).\pi_R(\rho^C \mid T, u) \ge \pi_R(\rho^D) \qquad\text{and}\qquad \Big(\pi_M(\rho^C \mid T, u) \ge \pi_M(\rho^D) \iff \rho^C \ge 2\rho^D\Big).πR​(ρC∣T,u)≥πR​(ρD)and(πM​(ρC∣T,u)≥πM​(ρD)⟺ρC≥2ρD).

Milestones

The milestones follow the paper's §3–§3.1 and the appendix proof, in attack order: concavity of Π\PiΠ and optimality of ρC\rho^CρC (Eqs. (1)–(2)); ρC>1\rho^C > 1ρC>1 in the interesting case; optimality of ρD\rho^DρD (Eqs. (3)–(4)); ρC≥ρD\rho^C \ge \rho^DρC≥ρD; Proposition 1 (concavity of the retailer's rebate profit when ∂2F(x∣ρ)/∂ρ2≤0\partial^2 F(x\mid\rho)/\partial\rho^2 \le 0∂2F(x∣ρ)/∂ρ2≤0); its uniform instance; the uniform closed form (8); the first-order condition (9); the coordinating target (10) together with the admissibility condition u>Mmu > M_mu>Mm​; the manufacturer's profit Mmβ(ρC−2)/ρCM_m\beta(\rho^C - 2)/\rho^CMm​β(ρC−2)/ρC under a coordinating contract (25); the retailer's profit (27); and the retailer's gain in the two cases ρD>1\rho^D > 1ρD>1 (30) and ρD=1\rho^D = 1ρD=1 (31).

Significance

The result divides the effect of the contract between the two parties. The retailer is always at least as well off as without a contract; the manufacturer, who pays the rebate, gains exactly when the supply chain's optimal effort is at least twice what the retailer would exert alone. When ρD>1\rho^D > 1ρD>1 this is equivalent to Mm≥7RrM_m \ge 7R_rMm​≥7Rr​ (p. 383), so a target rebate pays for the manufacturer only when its own stake in avoiding a false failure dwarfs the retailer's. The companion result (10) shows that for every rebate u>Mmu > M_mu>Mm​ exactly one admissible coordinating target exists, and none for u≤Mmu \le M_mu≤Mm​: a coordinating rebate is always larger than the manufacturer's own cost of a return.

The results are proved in the paper by calculus and algebra. None of them has a machine-checked proof that we know of, and nothing on Prove2Me models non-contractible effort or target rebates. The mission produces a checked version of the paper's model with the expectation taken as a genuine integral against the uniform law, a formal notion of coordination as the retailer's optimization, and statements that make explicit which hypotheses each step of the appendix uses. The definitions of effort-dependent profits and coordination are reusable for other effort-inducing contracts in the same paper and in the sales-effort literature.

Difficulty

The algebra of the appendix is short once the first-order condition (9) holds at ρC\rho^CρC. The substance is getting there. Coordination is defined by optimality of ρC\rho^CρC for the retailer's profit, and that profit involves the expectation E{[T−X(ρ)]+}E\{[T - X(\rho)]^+\}E{[T−X(ρ)]+}, which is piecewise in ρ\rhoρ: it equals T2ρ/4βT^2\rho/4\betaT2ρ/4β only while T≤2β/ρT \le 2\beta/\rhoT≤2β/ρ, and T−β/ρT - \beta/\rhoT−β/ρ beyond. Deriving (9) requires showing that ρC\rho^CρC is an interior maximizer, that the expectation is differentiable there with the closed-form derivative, and that the side condition T<2β/ρCT < 2\beta/\rho^CT<2β/ρC keeps ρC\rho^CρC in the closed-form region. The converse direction of (10), that the formula for TTT produces a coordinating contract, needs concavity of the piecewise profit on all of ρ≥1\rho \ge 1ρ≥1, which is where Proposition 1 enters.

Replacing the expectation by the global formula T2ρ/4βT^2\rho/4\betaT2ρ/4β is the tempting shortcut and it changes the problem: for ρ>2β/T\rho > 2\beta/Tρ>2β/T the formula exceeds the true expectation, and the retailer's maximizer, hence the meaning of "coordinates", changes with it.

Formalization scope

All parameters are real numbers, bundled in a structure Params; MmM_mMm​ and RrR_rRr​ are Params.Mm and Params.Rr. Effort ranges over ρ≥1\rho \ge 1ρ≥1 (Set.Ici 1); statements the paper makes for every positive effort (concavity of Π\PiΠ, the closed form (8)) are stated on ρ>0\rho > 0ρ>0. Cube roots are Real.rpow with exponent 1/31/31/3 on positive bases. The uniform law is Lebesgue measure conditioned on [0,2β/ρ][0, 2\beta/\rho][0,2β/ρ], and the expectation is the Bochner integral against it. Coordination is IsMaxOn of the retailer's profit on Set.Ici 1 at ρC\rho^CρC.

Three conventions differ from the printed text, each recorded in the item's formalization note:

  1. The interesting case is printed as (m+r)β>a(m + r)\beta > a(m+r)β>a; the condition equivalent to the stated consequence ρC>1\rho^C > 1ρC>1, which the proof uses, is (Mm+Rr)β>a(M_m + R_r)\beta > a(Mm​+Rr​)β>a. The formalization uses the latter.
  2. The printed evaluation EX{[T−X(ρ)]+}=u∫0T(T−x)(ρ/2β) dxE_X\{[T - X(\rho)]^+\} = u\int_0^T (T - x)(\rho/2\beta)\,dxEX​{[T−X(ρ)]+}=u∫0T​(T−x)(ρ/2β)dx carries a stray factor uuu; the expectation is T2ρ/4βT^2\rho/4\betaT2ρ/4β.
  3. Proposition 1 is stated for an arbitrary family of probability laws on [0,∞)[0,\infty)[0,∞) whose distribution functions are C2C^2C2 in ρ\rhoρ with nonpositive second derivative for x∈[0,T]x \in [0,T]x∈[0,T]; the paper's further assumptions on FFF (differentiable, strictly increasing in xxx, mean β/ρ\beta/\rhoβ/ρ) are not imposed.

The side condition T<2β/ρCT < 2\beta/\rho^CT<2β/ρC of §3.1 is a hypothesis of the goal and of the appendix milestones; without it a coordinating contract with u=Mmu = M_mu=Mm​ exists and the "if" direction fails. The unused page assertion δr<δm<1\delta_r < \delta_m < 1δr​<δm​<1 is not imposed.

The goal is not trivialized by its coordination hypothesis: coordination is the retailer's optimization over the true profit, and milestone (10) shows that coordinating contracts with T<2β/ρCT < 2\beta/\rho^CT<2β/ρC exist for every u>Mmu > M_mu>Mm​, so the hypotheses are satisfiable (Example 1 of the paper, p. 384, is an instance). The retailer half of the goal is comparatively short under this definition of coordination; that is a property of the paper's theorem, not of the encoding. The manufacturer half needs (8), (9) and (25).

The development needs only Mathlib: real calculus (derivatives, concavity, Real.rpow) and Lebesgue integration against a conditioned Lebesgue measure. The model definitions (effort-dependent profits, coordination as the retailer's optimization) are reusable for the paper's other effort-inducing contracts. Contributions welcome: proofs of any milestone, and reusable lemmas on expectations of [T−X]+[T - X]^+[T−X]+ under uniform laws.

Selected references

  • M. Ferguson, V. D. R. Guide Jr., G. C. Souza, Supply Chain Coordination for False Failure Returns, Manufacturing & Service Operations Management 8(4):376–393, 2006. https://doi.org/10.1287/msom.1060.0112
  • G. P. Cachon, Supply Chain Coordination with Contracts, in Handbooks in Operations Research and Management Science, Vol. 11: Supply Chain Management, Elsevier, 2003. https://doi.org/10.1016/S0927-0507(03)11006-7
  • T. A. Taylor, Supply Chain Coordination Under Channel Rebates with Sales Effort Effects, Management Science 48(8):992–1007, 2002. https://doi.org/10.1287/mnsc.48.8.992.168
16 thms2 active usersReviewed
Convex OptimizationDiscrete GeometryOperations Research+1·Captain: Shuze Chen

Discrete Convex Analysis XXIX: M2-Convex and L2-Convex FunctionsTextbook

Motivation

Mission 29-ch08b-conjugacyduality opened chapter 8's account of M2-convex functions — sums of M-convex functions — proving their domains and minimizers are M2-convex and that they are integrally convex. This mission completes that program and builds its exact mirror for L2-convex functions (integer infimal convolutions of L-convex functions), the class that appears on the opposite side of Edmonds's intersection theorem's min-max relation from M2-convexity. It proves optimality and proximity theorems for both classes, shows their subdifferentials add (a discrete analogue of the classical subdifferential sum rule), derives how the Legendre-Fenchel transform interacts with the sum/infimal-convolution operation, and — the technically hardest result in the whole cluster — establishes that L♮₂-convex functions are integrally convex, by a genuinely different and more intricate argument than the M2-side analogue required.

Setting

Fix a finite ground set VVV. A function g:ZV→R∪{+∞}g : \mathbb Z^V \to \mathbb R \cup \{+\infty\}g:ZV→R∪{+∞} is L2-convex if g=g1□g2g = g_1 \square g_2g=g1​□g2​, the integer infimal convolution g1□g2(p)=inf⁡{g1(p1)+g2(p2):p1+p2=p}g_1\square g_2(p) = \inf\{g_1(p_1)+g_2(p_2) : p_1+p_2=p\}g1​□g2​(p)=inf{g1​(p1​)+g2​(p2​):p1​+p2​=p}, of two L-convex functions g1,g2g_1, g_2g1​,g2​; L2♮^\natural_22♮​-convex if the summands are L♮^\natural♮-convex. An M2-convex function is a sum f1+f2f_1+f_2f1​+f2​ of two M-convex functions (mission 29-ch08b-conjugacyduality). The integer subdifferential ∂Zf(x)\partial_{\mathbb Z} f(x)∂Z​f(x) and real subdifferential ∂Rf(x)\partial_{\mathbb R} f(x)∂R​f(x) generalize the subgradient set to integer- and real-valued perturbation directions respectively.

Formalization targets

Goal: L2♮^\natural_22♮​-convex functions are integrally convex (Theorem 8.42)

Every L2♮^\natural_22♮​-convex function is integrally convex, and in particular every L2♮^\natural_22♮​-convex set is integrally convex. The book's own proof is the most intricate argument in this cluster: given ppp in the Minkowski sum D1+D2D_1+D_2D1​+D2​ of two L-convex sets, it constructs an explicit representation of ppp as a convex combination of finitely many integer points of D1+D2D_1+D_2D1​+D2​, all lying in ppp's own integral neighborhood, via the sorted fractional-part values of a chosen decomposition p=p1+p2p=p_1+p_2p=p1​+p2​ — a genuinely different technique from the M2-side analogue (Theorem 8.31), whose proof is a two-line consequence of convex extensibility.

Supporting structural targets

Eleven further results build the M2-/L2-convex theory in parallel. Theorems 8.33-8.34 give the M2-optimality criterion (a nonnegative-sum condition over cyclic exchange families) and its scaling-based proximity theorem; Theorem 8.35 shows subdifferentials of a sum of M♮^\natural♮- convex functions add, and that subdifferentials of M2-/M2♮^\natural_22♮​-convex functions are L2-/L2♮^\natural_22♮​-convex; Theorem 8.36 computes the conjugate of a sum as the infimal convolution of conjugates, with biconjugacy recovering the original sum. Propositions 8.39-8.41 transfer L-(natural-)convexity from summands to the domain and minimizer set of an L2-convex function, and give the precise attainment condition under which a linearly-perturbed infimal convolution's minimizer set splits additively. Theorems 8.43-8.44 give the L2-optimality and L2-proximity theorems, the exact L-side mirrors of Theorems 8.33-8.34; Theorem 8.45 mirrors Theorem 8.35 for subdifferentials of an infimal convolution; and Theorem 8.46 (found by direct reading, immediately following 8.45 and explicitly named by the book as 8.36's counterpart) shows biconjugacy for L♮^\natural♮-convex infimal convolutions.

Significance

The M2-/L2-convex function classes are where discrete convex analysis's abstract machinery meets concrete combinatorial optimization: Edmonds's matroid intersection theorem and its generalizations are literally statements about M2-convex minimization, with the L2-convex side supplying the dual bound. Theorem 8.35's subdifferential additivity is the discrete analogue of the classical Moreau-Rockafellar sum rule, and its proof (via the M-convex intersection theorem, already a milestone of mission 10-conjugacy-i) shows the sum rule holding without the constraint-qualification technicalities the continuous theory needs — a case where the discrete theory is cleaner than its continuous ancestor. Theorem 8.42's harder, dedicated proof technique is itself informative: it demonstrates that L2-convexity's combinatorial structure is not a routine transcription of the M2-convex case, foreshadowing the book's broader theme that M- and L-convexity, while conjugate, are not interchangeable in how their proofs actually work.

None of these results are open — they are Murota's account of the sum/infimal-convolution closure properties of M-convex and L-convex functions, continuing chapter 8's duality program into its most combinatorially concrete corner. What this mission contributes is a faithful, machine-checked formal statement of each, including one result (Theorem 8.46) the platform's own automated extractor missed, extending the shared Lean vocabulary (InfConv, L2Convex, M2ConvexSet) mission 29-ch08b-conjugacyduality began; no comparable formalization exists on the platform (see Formalization scope).

Difficulty

The naive approach to the goal would try to adapt the M2-side integral-convexity proof (a direct appeal to convex extensibility) verbatim; the book's own proof shows this does not work, requiring instead a from-scratch construction: decompose p=p1+p2p=p_1+p_2p=p1​+p2​, take fractional parts a1=p1−⌊p1⌋a_1 = p_1-\lfloor p_1\rfloora1​=p1​−⌊p1​⌋ and a2=⌈p2⌉−p2a_2=\lceil p_2\rceil-p_2a2​=⌈p2​⌉−p2​, sort their combined distinct values, build threshold sets exactly as in the Lovász-extension construction, and verify each resulting integer point qi=⌊p1⌋+χU1i+⌈p2⌉−χU2iq_i = \lfloor p_1\rfloor+\chi_{U_{1i}}+\lceil p_2\rceil-\chi_{U_{2i}}qi​=⌊p1​⌋+χU1i​​+⌈p2​⌉−χU2i​​ both lies in D1+D2D_1+D_2D1​+D2​ (via L-convex-set closure properties, Theorem 5.10) and in ppp's integral neighborhood (a case split on whether p(v)p(v)p(v) is itself an integer) — a genuinely multi-stage combinatorial argument with no single-inequality shortcut, unlike almost every other result in this mission.

Formalization scope

Ground-set elements are a Fintype V with DecidableEq; M2-/L2-convex functions are (V→ℤ)→WithTop ℝ. All twelve numbered results found in this chunk's page range are placed, with no partial-coverage scope reduction needed — every clause of every result, including all three parts of Theorems 8.35 and 8.45 and the full cyclic-exchange condition of Theorems 8.33-8.34, is stated in full. One numbered result nominally in this chunk's page range, Theorem 8.32, is not re-placed here: it was already found and placed as a milestone in mission 29-ch08b-conjugacyduality, whose own page range overlaps this chunk's by one page (PDF245) — see HARD.md. "g1□g2 > −∞" hypotheses are omitted rather than translated, since WithTop ℝ has no −∞ element to violate. This mission's base vocabulary is redeclared verbatim from mission 29-ch08b-conjugacyduality rather than imported, since sibling drafts in this series cannot yet reference one another; ConvexConjugate is redeclared from mission 10-conjugacy-i. Contributions completing any of the twelve sorrys are welcome; the goal and Theorem 8.35 carry the most independent proof content.

Selected references

  • K. Murota, Discrete Convex Analysis, SIAM, 2003. DOI: 10.1137/1.9780898718508.
  • K. Murota and A. Shioura, "Extreme points of a generalized polymatroid," Discrete Applied Mathematics, 152 (2005), pp. 268-278 [153] (the L2-convex integral-convexity proof this mission's goal is drawn from).
  • K. Murota and A. Tamura, "Application of M-convex submodular flow problem to mathematical economics," Japan Journal of Industrial and Applied Mathematics, 20 (2003), pp. 257-277 [162] (the M2-proximity theorem, Theorem 8.34).
55 thms3 active usersReviewed
🏆Completed
Bandit AlgorithmsMachine LearningOperations Research+2·Captain: mikedeng1

Optimal Best Arm Identification with Fixed Confidence I: Non-Asymptotic Lower Bound on the Sample ComplexityResearch Paper

Motivation

Best arm identification with fixed confidence is the pure-exploration counterpart of the multi-armed bandit problem. A learner faces KKK unknown reward distributions ("arms"), samples them sequentially, and must stop and name the arm with the largest mean, being wrong with probability at most a prescribed δ\deltaδ. The question is how many samples this requires. It arises in adaptive A/B testing, in the selection of the best of several simulated systems (ranking and selection in simulation optimization), and in clinical trials that must declare the best treatment with a guaranteed error rate.

Lower bounds for this problem were first stated in terms of the gaps between means (Mannor and Tsitsiklis, 2004). Kaufmann, Cappé and Garivier (2016) replaced ad hoc changes of measure by a single "transportation" lemma relating expected sample counts, Kullback–Leibler divergences and the error probability. Garivier and Kaufmann (COLT 2016, arXiv:1602.04589v2) combine this lemma over all alternative models at once, in the spirit of Graves and Lai (1997), and obtain a lower bound whose constant T∗(μ)T^*(\boldsymbol\mu)T∗(μ) is exactly matched, as δ→0\delta \to 0δ→0, by their Track-and-Stop strategy. This mission formalizes that lower bound (Theorem 1 of the paper, p. 3).

Setting

A canonical one-parameter exponential family is given by a reference measure ξ\xiξ on R\mathbb RR, an open interval Θ⊂R\Theta \subset \mathbb RΘ⊂R and a function bbb, twice continuously differentiable on Θ\ThetaΘ with b¨>0\ddot b > 0b¨>0, such that the laws νθ\nu_\thetaνθ​ with density exp⁡(θx−b(θ))\exp(\theta x - b(\theta))exp(θx−b(θ)) with respect to ξ\xiξ are probability measures for θ∈Θ\theta \in \Thetaθ∈Θ. The mean of νθ\nu_\thetaνθ​ is b˙(θ)\dot b(\theta)b˙(θ). Bernoulli laws and Gaussian laws of known variance are examples.

A bandit model is a vector θ=(θ1,…,θK)∈ΘK\theta = (\theta_1, \dots, \theta_K) \in \Theta^Kθ=(θ1​,…,θK​)∈ΘK; arm aaa returns i.i.d. rewards with law νθa\nu_{\theta_a}νθa​​ and mean μa=b˙(θa)\mu_a = \dot b(\theta_a)μa​=b˙(θa​). Arm a∗(μ)a^*(\boldsymbol\mu)a∗(μ) is the unique optimal arm if μa∗>μa\mu_{a^*} > \mu_aμa∗​>μa​ for every a≠a∗a \ne a^*a=a∗. Let S\mathcal SS be any set of bandit models of the family each having a unique optimal arm, and put Alt(μ)={λ∈S:a∗(λ)≠a∗(μ)}\mathrm{Alt}(\boldsymbol\mu) = \{\boldsymbol\lambda \in \mathcal S : a^*(\boldsymbol\lambda) \ne a^*(\boldsymbol\mu)\}Alt(μ)={λ∈S:a∗(λ)=a∗(μ)}.

A strategy consists of a sampling rule π\piπ (the arm AtA_tAt​ drawn at round ttt depends, possibly with extra randomization, on the first t−1t - 1t−1 observations), a stopping time τ\tauτ of the natural filtration Ft=σ(A1,X1,…,At,Xt)\mathcal F_t = \sigma(A_1, X_1, \dots, A_t, X_t)Ft​=σ(A1​,X1​,…,At​,Xt​), and an Fτ\mathcal F_\tauFτ​-measurable decision a^τ\hat a_\taua^τ​. It is δ\deltaδ-PAC on S\mathcal SS if for every μ∈S\boldsymbol\mu \in \mathcal Sμ∈S, Pμ(τ<∞)=1\mathbb P_{\boldsymbol\mu}(\tau < \infty) = 1Pμ​(τ<∞)=1 and Pμ(a^τ≠a∗(μ))≤δ\mathbb P_{\boldsymbol\mu}(\hat a_\tau \ne a^*(\boldsymbol\mu)) \le \deltaPμ​(a^τ​=a∗(μ))≤δ. Na(t)N_a(t)Na​(t) is the number of draws of arm aaa among the first ttt rounds.

Write d(μa,λa)=KL(νθa,νλa)d(\mu_a, \lambda_a) = \mathrm{KL}(\nu_{\theta_a}, \nu_{\lambda_a})d(μa​,λa​)=KL(νθa​​,νλa​​) for the divergence between two arm laws, kl(x,y)=xlog⁡xy+(1−x)log⁡1−x1−y\mathrm{kl}(x, y) = x\log\frac{x}{y} + (1 - x)\log\frac{1 - x}{1 - y}kl(x,y)=xlogyx​+(1−x)log1−y1−x​, and ΣK\Sigma_KΣK​ for the probability simplex on the KKK arms. The characteristic time is defined by eq. (1):

T∗(μ)−1=sup⁡w∈ΣK inf⁡λ∈Alt(μ)∑a=1Kwa d(μa,λa).T^*(\boldsymbol\mu)^{-1} = \sup_{w \in \Sigma_K}\ \inf_{\boldsymbol\lambda \in \mathrm{Alt}(\boldsymbol\mu)} \sum_{a=1}^K w_a\, d(\mu_a, \lambda_a).T∗(μ)−1=w∈ΣK​sup​ λ∈Alt(μ)inf​a=1∑K​wa​d(μa​,λa​).

Formalization targets

Goal: Theorem 1 (p. 3)

For δ∈(0,1/2]\delta \in (0, 1/2]δ∈(0,1/2], every δ\deltaδ-PAC strategy on S\mathcal SS and every μ∈S\boldsymbol\mu \in \mathcal Sμ∈S,

Eμ[τ] ≥ T∗(μ) kl(δ,1−δ).\mathbb E_{\boldsymbol\mu}[\tau] \ \ge\ T^*(\boldsymbol\mu)\,\mathrm{kl}(\delta, 1 - \delta).Eμ​[τ] ≥ T∗(μ)kl(δ,1−δ).

The statement fixes no constant beyond those of the paper, and it holds for every δ\deltaδ, not only in the limit.

Milestone: eq. (2) (p. 4)

For every λ∈S\boldsymbol\lambda \in \mathcal Sλ∈S with a∗(λ)≠a∗(μ)a^*(\boldsymbol\lambda) \ne a^*(\boldsymbol\mu)a∗(λ)=a∗(μ),

∑a=1Kd(μa,λa) Eμ[Na(τ)] ≥ kl(δ,1−δ).\sum_{a=1}^K d(\mu_a, \lambda_a)\, \mathbb E_{\boldsymbol\mu}[N_a(\tau)] \ \ge\ \mathrm{kl}(\delta, 1 - \delta).a=1∑K​d(μa​,λa​)Eμ​[Na​(τ)] ≥ kl(δ,1−δ).

This is Lemma 1 of Kaufmann et al. (2016), which the paper quotes without proof; Theorem 1 follows from it for every alternative simultaneously.

Significance

Theorem 1 identifies T∗(μ)T^*(\boldsymbol\mu)T∗(μ) as the exact problem-dependent complexity of fixed-confidence best arm identification: since kl(δ,1−δ)∼log⁡(1/δ)\mathrm{kl}(\delta, 1 - \delta) \sim \log(1/\delta)kl(δ,1−δ)∼log(1/δ), it gives lim inf⁡δ→0Eμ[τδ]/log⁡(1/δ)≥T∗(μ)\liminf_{\delta \to 0} \mathbb E_{\boldsymbol\mu}[\tau_\delta]/\log(1/\delta) \ge T^*(\boldsymbol\mu)liminfδ→0​Eμ​[τδ​]/log(1/δ)≥T∗(μ), and the paper's Track-and-Stop strategy attains this rate (the subject of mission IV of this series). The bound also explains which proportions of draws an optimal strategy must use: the maximizer w∗(μ)w^*(\boldsymbol\mu)w∗(μ) of eq. (1) (mission II).

Both results are proved in the literature. Neither is formalized in the paper's generality. The platform holds the textbook form of Lattimore and Szepesvári (Theorem 33.5), which is stated for an arbitrary class with the weaker constant log⁡(1/(4δ))\log(1/(4\delta))log(1/(4δ)); for δ≤1/2\delta \le 1/2δ≤1/2, kl(δ,1−δ)≥log⁡(1/(2.4δ))>log⁡(1/(4δ))\mathrm{kl}(\delta, 1 - \delta) \ge \log(1/(2.4\delta)) > \log(1/(4\delta))kl(δ,1−δ)≥log(1/(2.4δ))>log(1/(4δ)), so Theorem 1 is strictly stronger. A formal proof here yields the transportation lemma for exponential families on the platform's infinite-horizon bandit model, which later missions (II–IV, and any lower bound by change of measure) can reuse.

Difficulty

The obvious proof applies the finite-horizon divergence decomposition KL(Pμn,Pλn)=∑aEμ[Na(n)] d(μa,λa)\mathrm{KL}(\mathbb P^n_{\boldsymbol\mu}, \mathbb P^n_{\boldsymbol\lambda}) = \sum_a \mathbb E_{\boldsymbol\mu}[N_a(n)]\,d(\mu_a, \lambda_a)KL(Pμn​,Pλn​)=∑a​Eμ​[Na​(n)]d(μa​,λa​) at a deterministic horizon nnn. That fails here: τ\tauτ is random and unbounded, the decision is Fτ\mathcal F_\tauFτ​-measurable, and the relevant divergence is between the laws of the stopped observations. The step from a fixed horizon to a stopping time, together with the data-processing inequality that turns the error guarantees under two models into kl(δ,1−δ)\mathrm{kl}(\delta, 1 - \delta)kl(δ,1−δ), is the central difficulty. A second, smaller difficulty is to identify the paper's divergence ddd and its means b˙(θ)\dot b(\theta)b˙(θ) with the measure-theoretic KL divergence and mean of the arm laws of the exponential family.

Formalization scope

Lean namespace OptimalBAI.LowerBound. The bandit protocol is the platform's (BanditAlgorithm.BanditPolicy, banditTrajMeasure, IsBanditStoppingTime, IsSoundBAI, baiComplexity); kl\mathrm{kl}kl is the platform's bernoulliRelativeEntropy and Na(t)N_a(t)Na​(t) is trajPullCount. Conventions:

  • arms are Fin K, 0-based (the paper's arm aaa is index a−1a - 1a−1); trajectory coordinate ttt is round t+1t + 1t+1;
  • Θ\ThetaΘ is a nonempty open interval and b¨>0\ddot b > 0b¨>0 on Θ\ThetaΘ (added: the paper says bbb is convex and twice differentiable; strict convexity is what makes "the unique distribution with mean μ\muμ" meaningful); the paper's ddd is written as the KL divergence of the arm laws (its first equality on p. 3), and the unique optimal arm is defined through the parameter means b˙(θa)\dot b(\theta_a)b˙(θa​);
  • S\mathcal SS is an arbitrary set of models with a unique optimal arm, not the specific set the paper fixes from p. 4 on;
  • δ\deltaδ-PAC keeps both halves of the paper's definition (almost-sure stopping and error at most δ\deltaδ);
  • T∗(μ)T^*(\boldsymbol\mu)T∗(μ), divergences and expectations of τ\tauτ take values in [0,∞][0, \infty][0,∞], never truncated to reals; T∗=0T^* = 0T∗=0 when Alt(μ)=∅\mathrm{Alt}(\boldsymbol\mu) = \emptysetAlt(μ)=∅ and T∗=∞T^* = \inftyT∗=∞ when the supremum in eq. (1) is 000;
  • δ≤1/2\delta \le 1/2δ≤1/2 is added. The paper states δ∈(0,1)\delta \in (0, 1)δ∈(0,1), but the theorem and eq. (2) are false for δ∈(1/2,1)\delta \in (1/2, 1)δ∈(1/2,1): with two unit-variance Gaussian arms, drawing arm 1 once and naming arm 1 exactly when the fractional part of the reward is below 1/21/21/2 is 0.90.90.9-PAC, while T∗(μ)→∞T^*(\boldsymbol\mu) \to \inftyT∗(μ)→∞ as the two means merge. At δ=1/2\delta = 1/2δ=1/2 the bound is 000.

A statement with log⁡(1/(4δ))\log(1/(4\delta))log(1/(4δ)) in place of kl(δ,1−δ)\mathrm{kl}(\delta, 1 - \delta)kl(δ,1−δ), or restricted to Gaussian arms, is the platform's existing textbook theorem and does not count as this mission's goal; nor does any version that drops the almost-sure stopping clause or truncates E[τ]\mathbb E[\tau]E[τ] or T∗T^*T∗ to real numbers.

Needed infrastructure: the transportation lemma at a stopping time (data processing for KL through an Fτ\mathcal F_\tauFτ​-measurable event, Wald-type identity for the stopped log-likelihood ratio), the identities "mean of νθ\nu_\thetaνθ​ =b˙(θ)= \dot b(\theta)=b˙(θ)" and "KL of two family members =b(θ′)−b(θ)−b˙(θ)(θ′−θ)= b(\theta') - b(\theta) - \dot b(\theta)(\theta' - \theta)=b(θ′)−b(θ)−b˙(θ)(θ′−θ)", and E[τ]=∑aE[Na(τ)]\mathbb E[\tau] = \sum_a \mathbb E[N_a(\tau)]E[τ]=∑a​E[Na​(τ)]. All are reusable beyond this mission. Contributions of any of these lemmas, of eq. (2) alone, or of the Gaussian and Bernoulli special cases as stepping stones are welcome.

Selected references

  • A. Garivier, E. Kaufmann, Optimal Best Arm Identification with Fixed Confidence, COLT 2016 (JMLR W&CP 49), arXiv:1602.04589v2. https://arxiv.org/abs/1602.04589
  • E. Kaufmann, O. Cappé, A. Garivier, On the Complexity of Best-Arm Identification in Multi-Armed Bandit Models, Journal of Machine Learning Research 17(1), 2016. https://arxiv.org/abs/1407.4443
  • T. L. Graves, T. L. Lai, Asymptotically Efficient Adaptive Choice of Control Laws in Controlled Markov Chains, SIAM Journal on Control and Optimization 35(3), 1997. https://doi.org/10.1137/S0363012994275440
  • S. Mannor, J. N. Tsitsiklis, The Sample Complexity of Exploration in the Multi-Armed Bandit Problem, Journal of Machine Learning Research 5, 2004. https://www.jmlr.org/papers/v5/mannor04b.html
  • T. Lattimore, C. Szepesvári, Bandit Algorithms, Cambridge University Press, 2020, Chapter 33. https://doi.org/10.1017/9781108571401
11 thms5 active usersReviewed
🏆Completed
Bandit AlgorithmsMachine LearningOperations Research+1·Captain: mikedeng1

Optimal Best Arm Identification with Fixed Confidence II: Characterization of the Optimal Proportions of Arm DrawsResearch Paper

Motivation

In best arm identification with fixed confidence, a learner samples KKK unknown distributions ("arms") sequentially and must name the arm with the largest mean, with error probability at most a prescribed δ\deltaδ, using as few samples as possible. Garivier and Kaufmann (arXiv:1602.04589, COLT 2016) showed that every δ\deltaδ-PAC strategy needs, in expectation, at least T∗(μ) kl(δ,1−δ)T^*(\boldsymbol\mu)\,\mathrm{kl}(\delta,1-\delta)T∗(μ)kl(δ,1−δ) samples, where the characteristic time T∗(μ)T^*(\boldsymbol\mu)T∗(μ) is the value of a max–min optimization problem over the proportions of draws allocated to the arms. The maximizer of that problem, w∗(μ)w^*(\boldsymbol\mu)w∗(μ), is the allocation any asymptotically optimal strategy must follow; the Track-and-Stop algorithm of the same paper computes w∗(μ^)w^*(\hat{\boldsymbol\mu})w∗(μ^​) at plug-in estimates and tracks it.

A strategy can only track w∗w^*w∗ if w∗w^*w∗ can be computed. This mission formalizes the part of the paper (Section 2.2 and Appendix A) that turns the abstract max–min problem into an explicit recipe: a closed form for the inner infimum, and a characterization of w∗w^*w∗ through the root of one increasing scalar function. The problem had been solved in closed form before only for special cases, such as Poisson rewards with all suboptimal arms equal (Vaidhyan and Sundaresan, 2015); the paper's result covers every one-parameter exponential family.

Setting

A canonical one-parameter exponential family is a family of laws νθ\nu_\thetaνθ​, θ∈Θ\theta\in\Thetaθ∈Θ, on R\mathbb RR with density exp⁡(θx−b(θ))\exp(\theta x-b(\theta))exp(θx−b(θ)) with respect to a reference measure ξ\xiξ. The law νθ\nu_\thetaνθ​ has mean b˙(θ)\dot b(\theta)b˙(θ); the set of attainable means is the mean space b˙(Θ)\dot b(\Theta)b˙(Θ). For means μ=b˙(θ)\mu=\dot b(\theta)μ=b˙(θ) and μ′=b˙(θ′)\mu'=\dot b(\theta')μ′=b˙(θ′) the Kullback–Leibler divergence is

d(μ,μ′)=KL(νθ,νθ′)=b(θ′)−b(θ)−b˙(θ)(θ′−θ).d(\mu,\mu')=\mathrm{KL}(\nu_\theta,\nu_{\theta'})=b(\theta')-b(\theta)-\dot b(\theta)(\theta'-\theta).d(μ,μ′)=KL(νθ​,νθ′​)=b(θ′)−b(θ)−b˙(θ)(θ′−θ).

Bernoulli laws and Gaussian laws with known variance are the standard examples.

A bandit model is identified with its vector of means μ=(μ1,…,μK)∈b˙(Θ)K\boldsymbol\mu=(\mu_1,\dots,\mu_K)\in\dot b(\Theta)^Kμ=(μ1​,…,μK​)∈b˙(Θ)K. S\mathcal SS is the set of models with a unique optimal arm a∗(μ)a^*(\boldsymbol\mu)a∗(μ), and Alt(μ)={λ∈S:a∗(λ)≠a∗(μ)}\mathrm{Alt}(\boldsymbol\mu)=\{\boldsymbol\lambda\in\mathcal S:a^*(\boldsymbol\lambda)\ne a^*(\boldsymbol\mu)\}Alt(μ)={λ∈S:a∗(λ)=a∗(μ)} is the set of alternatives. ΣK\Sigma_KΣK​ is the probability simplex. The transportation cost of proportions w∈ΣKw\in\Sigma_Kw∈ΣK​ and the objects of the paper are

cμ(w)=inf⁡λ∈Alt(μ)∑a=1Kwa d(μa,λa),T∗(μ)−1=sup⁡w∈ΣKcμ(w),w∗(μ)=argmax⁡w∈ΣKcμ(w).c_{\boldsymbol\mu}(w)=\inf_{\boldsymbol\lambda\in\mathrm{Alt}(\boldsymbol\mu)}\sum_{a=1}^Kw_a\,d(\mu_a,\lambda_a),\qquad T^*(\boldsymbol\mu)^{-1}=\sup_{w\in\Sigma_K}c_{\boldsymbol\mu}(w),\qquad w^*(\boldsymbol\mu)=\operatorname*{argmax}_{w\in\Sigma_K}c_{\boldsymbol\mu}(w).cμ​(w)=λ∈Alt(μ)inf​a=1∑K​wa​d(μa​,λa​),T∗(μ)−1=w∈ΣK​sup​cμ​(w),w∗(μ)=w∈ΣK​argmax​cμ​(w).

The arms are sorted so that μ1>μ2≥⋯≥μK\mu_1>\mu_2\ge\dots\ge\mu_Kμ1​>μ2​≥⋯≥μK​. The parameterized Jensen–Shannon divergence is, for α∈[0,1]\alpha\in[0,1]α∈[0,1],

Iα(μ1,μ2)=α d(μ1,αμ1+(1−α)μ2)+(1−α) d(μ2,αμ1+(1−α)μ2).I_\alpha(\mu_1,\mu_2)=\alpha\,d\big(\mu_1,\alpha\mu_1+(1-\alpha)\mu_2\big)+(1-\alpha)\,d\big(\mu_2,\alpha\mu_1+(1-\alpha)\mu_2\big).Iα​(μ1​,μ2​)=αd(μ1​,αμ1​+(1−α)μ2​)+(1−α)d(μ2​,αμ1​+(1−α)μ2​).

For a∈{2,…,K}a\in\{2,\dots,K\}a∈{2,…,K} let ga(x)=(1+x)I1/(1+x)(μ1,μa)g_a(x)=(1+x)I_{1/(1+x)}(\mu_1,\mu_a)ga​(x)=(1+x)I1/(1+x)​(μ1​,μa​) for x≥0x\ge0x≥0, let xa=ga−1x_a=g_a^{-1}xa​=ga−1​, and let x1≡1x_1\equiv1x1​≡1. Finally

Fμ(y)=∑a=2Kd(μ1,ma(y))d(μa,ma(y)),ma(y)=μ1+xa(y)μa1+xa(y).F_{\boldsymbol\mu}(y)=\sum_{a=2}^K\frac{d\big(\mu_1,m_a(y)\big)}{d\big(\mu_a,m_a(y)\big)},\qquad m_a(y)=\frac{\mu_1+x_a(y)\mu_a}{1+x_a(y)}.Fμ​(y)=a=2∑K​d(μa​,ma​(y))d(μ1​,ma​(y))​,ma​(y)=1+xa​(y)μ1​+xa​(y)μa​​.

Formalization targets

Goal: Theorem 5 (p. 5)

With D=d(μ1,μ2)D=d(\mu_1,\mu_2)D=d(μ1​,μ2​): FμF_{\boldsymbol\mu}Fμ​ is continuous and strictly increasing on [0,D[[0,D[[0,D[, Fμ(0)=0F_{\boldsymbol\mu}(0)=0Fμ​(0)=0, Fμ(y)→∞F_{\boldsymbol\mu}(y)\to\inftyFμ​(y)→∞ as y→Dy\to Dy→D, the equation Fμ(y)=1F_{\boldsymbol\mu}(y)=1Fμ​(y)=1 has a unique solution y∗∈[0,D[y^*\in[0,D[y∗∈[0,D[, and

w∈w∗(μ)  ⟺  wa=xa(y∗)∑i=1Kxi(y∗)for every arm a.w\in w^*(\boldsymbol\mu)\iff w_a=\frac{x_a(y^*)}{\sum_{i=1}^Kx_i(y^*)}\quad\text{for every arm }a.w∈w∗(μ)⟺wa​=∑i=1K​xi​(y∗)xa​(y∗)​for every arm a.

The equivalence says at once that the argmax exists, that it is a single point, and that it is given by eq. (5).

Milestones

  1. Lemma 3 (p. 5): for every w∈ΣKw\in\Sigma_Kw∈ΣK​,
cμ(w)=min⁡a≠1(w1+wa) Iw1w1+wa(μ1,μa).c_{\boldsymbol\mu}(w)=\min_{a\ne1}(w_1+w_a)\,I_{\frac{w_1}{w_1+w_a}}(\mu_1,\mu_a).cμ​(w)=a=1min​(w1​+wa​)Iw1​+wa​w1​​​(μ1​,μa​).
  1. Claim after eq. (4) (p. 5): gag_aga​ is a strictly increasing one-to-one mapping from [0,+∞[[0,+\infty[[0,+∞[ onto [0,d(μ1,μa)[[0,d(\mu_1,\mu_a)[[0,d(μ1​,μa​)[.
  2. Lemma 4 (p. 5): for every maximizer w∗w^*w∗ and all a,b∈{2,…,K}a,b\in\{2,\dots,K\}a,b∈{2,…,K},
(w1∗+wa∗)Iw1∗w1∗+wa∗(μ1,μa)=(w1∗+wb∗)Iw1∗w1∗+wb∗(μ1,μb).(w^*_1+w^*_a)I_{\frac{w^*_1}{w^*_1+w^*_a}}(\mu_1,\mu_a)=(w^*_1+w^*_b)I_{\frac{w^*_1}{w^*_1+w^*_b}}(\mu_1,\mu_b).(w1∗​+wa∗​)Iw1∗​+wa∗​w1∗​​​(μ1​,μa​)=(w1∗​+wb∗​)Iw1∗​+wb∗​w1∗​​​(μ1​,μb​).

Significance

The result. Theorem 5 reduces a (K−1)(K-1)(K−1)-dimensional non-smooth max–min problem to finding the root of one continuous increasing function on a bounded interval, each evaluation of which requires K−1K-1K−1 scalar inversions. It gives existence and uniqueness of w∗(μ)w^*(\boldsymbol\mu)w∗(μ), which the paper's lower bound only presupposes, and it is the computational core of Track-and-Stop: without an explicit, well-posed w∗w^*w∗ the tracking strategy is not defined. Lemma 3 alone gives the closed form of the inner infimum used again in the analysis of the stopping rule.

Formalizing it. The results are proved in the paper; nothing here is open. To the best of our knowledge none of them has a machine-checked proof: the platform's existing best-arm-identification rows concern Gaussian arms and state the characteristic time at the level of measures, without this characterization. The mission produces a checked reduction for general one-parameter exponential families, including the edge cases the text passes over (ties among suboptimal arms, zero weights, the behaviour of xax_axa​ near the end of its domain).

Difficulty

The infimum in Lemma 3 ranges over Alt(μ)\mathrm{Alt}(\boldsymbol\mu)Alt(μ), a set of models with a unique best arm, so it is an open condition: the minimizing configuration, in which λ1\lambda_1λ1​ and λa\lambda_aλa​ coincide, lies outside Alt(μ)\mathrm{Alt}(\boldsymbol\mu)Alt(μ) and is only approached. Other arms may also compete for the best position. A statement in which the infimum is taken over the closed relaxation {λa≥λ1}\{\lambda_a\ge\lambda_1\}{λa​≥λ1​} is a lemma of the proof, not Lemma 3.

For Theorem 5, the equalization in Lemma 4 needs an argument that holds for every maximizer, not only for one found by a first-order condition, because the objective is a minimum of functions and is not differentiable. The monotonicity of FμF_{\boldsymbol\mu}Fμ​ needs the monotonicity of each xax_axa​ and of each ratio in the moving point mam_ama​, and the limit at DDD rests on the second-best arm(s) only, which is where the ordering μ1>μ2≥…\mu_1>\mu_2\ge\dotsμ1​>μ2​≥… enters. Finally the analytic facts about ddd (continuity, positivity off the diagonal, monotonicity in each argument) must be derived from the exponential family itself.

Formalization scope

Lean represents a model by μ : Fin K → ℝ with 2 ≤ K and every μ a in the mean space deriv F.b '' F.Θ. The paper's arm 111 is index 0, arm 222 is index 1. The exponential family is a structure ExpFamily whose parameter set is a nonempty open interval and whose b is twice continuously differentiable with b¨>0\ddot b>0b¨>0 on Θ\ThetaΘ. These two conditions are added to the paper's "convex, twice differentiable" and are disclosed: strict convexity is what makes the mean parameterization unique, and openness is what lets alternatives approach the boundary of Alt(μ)\mathrm{Alt}(\boldsymbol\mu)Alt(μ). The reference measure and normalization are part of the structure but unused here.

The transportation cost is an infimum in EReal, so it is the true infimum of the set of values rather than a default 0. w∗(μ)w^*(\boldsymbol\mu)w∗(μ) is never defined by choice: "www is optimal" is a predicate, and Theorem 5 characterizes the set of such www. The functions xax_axa​ are the inverse of gag_aga​ on [0,+∞[[0,+\infty[[0,+∞[ and are evaluated only on [0,d(μ1,μ2)[[0,d(\mu_1,\mu_2)[[0,d(μ1​,μ2​)[. "Increasing" in Theorem 5 is stated as strictly increasing, as proved in Appendix A.2. Lemmas 3 and 4 and the claim on gag_aga​ assume only that arm 111 is the unique best arm, which is weaker than the paper's standing ordering.

A formalization that replaces Alt(μ)\mathrm{Alt}(\boldsymbol\mu)Alt(μ) by {λa≥λ1}\{\lambda_a\ge\lambda_1\}{λa​≥λ1​}, assumes the maximizer exists and is unique, or asserts only existence of some y∗y^*y∗ without the formula for w∗w^*w∗, does not state these results and is ruled out.

A complete development needs: basic calculus of exponential families (the Bregman form of ddd, its continuity and strict positivity off the diagonal, its monotonicity in the second argument), the inverse function of a continuous strictly monotone map on an interval, and compactness of the simplex. The divergence facts are reusable in every bandit mission built on exponential families. Proofs of the milestones, of auxiliary facts about ddd and IαI_\alphaIα​, and a sorry-free instance of ExpFamily (Bernoulli or unit-variance Gaussian) are welcome.

Selected references

  • A. Garivier, E. Kaufmann, Optimal Best Arm Identification with Fixed Confidence, COLT 2016 (JMLR W&CP 49), arXiv:1602.04589v2. https://arxiv.org/abs/1602.04589
  • E. Kaufmann, O. Cappé, A. Garivier, On the Complexity of Best-Arm Identification in Multi-Armed Bandit Models, JMLR 17, 2016. https://arxiv.org/abs/1407.4443
  • N. K. Vaidhyan, R. Sundaresan, Learning to detect an oddball target, arXiv:1508.05572, 2015. https://arxiv.org/abs/1508.05572
  • O. Cappé, A. Garivier, O.-A. Maillard, R. Munos, G. Stoltz, Kullback–Leibler upper confidence bounds for optimal sequential allocation, Annals of Statistics 41(3), 2013. https://arxiv.org/abs/1210.1136
6 thms2 active usersReviewed
🏆Completed
Bandit AlgorithmsMachine LearningOperations Research+2·Captain: mikedeng1

Optimal Best Arm Identification with Fixed Confidence III: δ-PAC Guarantee of Chernoff's Stopping Rule for Bernoulli BanditsResearch Paper

Motivation

In best arm identification with fixed confidence, a learner samples KKK unknown distributions ("arms") one at a time, and must eventually stop and name the arm with the largest mean, with an error probability at most a prescribed risk δ\deltaδ, while using as few samples as possible. The problem goes back to the sequential design of experiments (Chernoff, 1959; Even-Dar, Mannor and Mansour, 2006) and underlies adaptive A/B testing, clinical trial design and hyperparameter selection.

Any fixed-confidence strategy consists of three parts: a sampling rule, a stopping rule and a decision rule. Garivier and Kaufmann (arXiv:1602.04589, COLT 2016) proposed the Track-and-Stop strategy, the first shown to match the asymptotic lower bound on the expected sample complexity. Its stopping rule is a generalized likelihood ratio (GLR) test, Chernoff's stopping rule. Its correctness, the guarantee that the recommended arm is wrong with probability at most δ\deltaδ, must hold whatever the sampling rule, which is what allows the sampling rule to be tuned freely for efficiency. This mission formalizes that guarantee for Bernoulli arms, Theorem 10 of the paper, with its explicit threshold β(t,δ)=log⁡(2t(K−1)/δ)\beta(t,\delta) = \log(2t(K-1)/\delta)β(t,δ)=log(2t(K−1)/δ).

Setting

The arms are A={1,…,K}\mathcal A = \{1,\dots,K\}A={1,…,K}. A Bernoulli bandit model is a mean vector μ=(μ1,…,μK)∈[0,1]K\boldsymbol\mu = (\mu_1,\dots,\mu_K) \in [0,1]^Kμ=(μ1​,…,μK​)∈[0,1]K: pulling arm aaa returns reward 111 with probability μa\mu_aμa​ and 000 otherwise, independently of the past. The class S\mathcal SS contains the models with a unique optimal arm a∗(μ)a^*(\boldsymbol\mu)a∗(μ), i.e. μa∗>μi\mu_{a^*} > \mu_iμa∗​>μi​ for all i≠a∗i \ne a^*i=a∗.

At round ttt the learner chooses an arm AtA_tAt​ as a (possibly randomized) function of the past observations and observes a reward XtX_tXt​. Write Na(t)N_a(t)Na​(t) for the number of pulls of arm aaa among the first ttt rounds, sa(t)s_a(t)sa​(t) for the number of those pulls that returned 111, and μ^a(t)=Na(t)−1∑s≤tXs1{As=a}\hat\mu_a(t) = N_a(t)^{-1}\sum_{s \le t} X_s \mathbb 1\{A_s = a\}μ^​a​(t)=Na​(t)−1∑s≤t​Xs​1{As​=a} for the empirical mean. The likelihood of arm aaa's observations under mean uuu is pu(X‾Na(t)a)=usa(t)(1−u)Na(t)−sa(t)p_u(\underline X^a_{N_a(t)}) = u^{s_a(t)}(1-u)^{N_a(t)-s_a(t)}pu​(X​Na​(t)a​)=usa​(t)(1−u)Na​(t)−sa​(t).

The GLR statistic for "arm aaa is at least as good as arm bbb" is

Za,b(t)=log⁡max⁡μa′≥μb′pμa′(X‾Na(t)a) pμb′(X‾Nb(t)b)max⁡μa′≤μb′pμa′(X‾Na(t)a) pμb′(X‾Nb(t)b).Z_{a,b}(t) = \log \frac{\max_{\mu'_a \ge \mu'_b} p_{\mu'_a}(\underline X^a_{N_a(t)})\, p_{\mu'_b}(\underline X^b_{N_b(t)})}{\max_{\mu'_a \le \mu'_b} p_{\mu'_a}(\underline X^a_{N_a(t)})\, p_{\mu'_b}(\underline X^b_{N_b(t)})}.Za,b​(t)=logmaxμa′​≤μb′​​pμa′​​(X​Na​(t)a​)pμb′​​(X​Nb​(t)b​)maxμa′​≥μb′​​pμa′​​(X​Na​(t)a​)pμb′​​(X​Nb​(t)b​)​.

Chernoff's stopping rule with exploration rate β(t,δ)\beta(t,\delta)β(t,δ) is

τδ=inf⁡{t≥1:∃a∈A, ∀b≠a, Za,b(t)>β(t,δ)},\tau_\delta = \inf\{t \ge 1 : \exists a \in \mathcal A,\ \forall b \ne a,\ Z_{a,b}(t) > \beta(t,\delta)\},τδ​=inf{t≥1:∃a∈A, ∀b=a, Za,b​(t)>β(t,δ)},

and the decision rule recommends a^τδ∈argmax⁡aμ^a(τδ)\hat a_{\tau_\delta} \in \operatorname{argmax}_a \hat\mu_a(\tau_\delta)a^τδ​​∈argmaxa​μ^​a​(τδ​).

The Krichevsky–Trofimov (KT) distribution on binary sequences x∈{0,1}nx \in \{0,1\}^nx∈{0,1}n is kt(x)=∫01(πu(1−u))−1pu(x) du\mathrm{kt}(x) = \int_0^1 \big(\pi\sqrt{u(1-u)}\big)^{-1} p_u(x)\,\mathrm dukt(x)=∫01​(πu(1−u)​)−1pu​(x)du, the Bernoulli likelihood mixed over the Beta(1/2,1/2)(1/2,1/2)(1/2,1/2) prior.

Formalization targets

Goal: Theorem 10

For every δ∈(0,1)\delta \in (0,1)δ∈(0,1), every sampling strategy, and the threshold β(t,δ)=log⁡(2t(K−1)/δ)\beta(t,\delta) = \log\big(2t(K-1)/\delta\big)β(t,δ)=log(2t(K−1)/δ),

∀μ∈S,Pμ(τδ<∞, a^τδ≠a∗)≤δ.\forall \boldsymbol\mu \in \mathcal S,\qquad \mathbb P_{\boldsymbol\mu}\big(\tau_\delta < \infty,\ \hat a_{\tau_\delta} \ne a^*\big) \le \delta .∀μ∈S,Pμ​(τδ​<∞, a^τδ​​=a∗)≤δ.

Milestone: Lemma 11 (Willems, Shtarkov and Tjalkens, 1995)

kt\mathrm{kt}kt is a probability law on {0,1}n\{0,1\}^n{0,1}n, and for n≥1n \ge 1n≥1,

sup⁡x∈{0,1}n sup⁡u∈[0,1]pu(x)kt(x)≤2n.\sup_{x\in\{0,1\}^n}\ \sup_{u\in[0,1]} \frac{p_u(x)}{\mathrm{kt}(x)} \le 2\sqrt n .x∈{0,1}nsup​ u∈[0,1]sup​kt(x)pu​(x)​≤2n​.

Milestone: the pairwise crossing bound of Appendix C.1

With Ta,b=inf⁡{t:Za,b(t)>β(t,δ)}T_{a,b} = \inf\{t : Z_{a,b}(t) > \beta(t,\delta)\}Ta,b​=inf{t:Za,b​(t)>β(t,δ)}, for all arms with μa<μb\mu_a < \mu_bμa​<μb​,

Pμ(Ta,b<∞)≤δK−1.\mathbb P_{\boldsymbol\mu}(T_{a,b} < \infty) \le \frac{\delta}{K-1}.Pμ​(Ta,b​<∞)≤K−1δ​.

Significance

Theorem 10 decouples correctness from efficiency. Because the guarantee holds for every sampling strategy, any sampling rule, including the C-Tracking and D-Tracking rules of Track-and-Stop, the uniform rule, or a heuristic, inherits δ\deltaδ-correctness as soon as it is paired with Chernoff's stopping rule at this threshold. The asymptotic optimality result of the paper (Theorem 14) then only has to control the sample complexity. The threshold is explicit, with no unspecified constant, in contrast to the deviational threshold of Proposition 12.

The result is proved in the paper, in Appendix C.1, and rests on Lemma 11, which the paper quotes from the universal coding literature without proof. As far as the platform's catalog shows, none of these results is formalized. The platform holds a machine-checkable statement of the analogous result for Gaussian arms with the Lattimore–Szepesvári threshold (BanditAlgorithm.chernoff_stopping_rule_sound, Lemma 33.7 of Bandit Algorithms), which is a different model and a different threshold. Formalizing Theorem 10 adds a proof of Lemma 11 (the KT regret bound, reusable in information theory and universal prediction), the Bernoulli GLR statistic, and a change of measure from the true bandit law to a Bayesian mixture law on the trajectory space.

Difficulty

The obvious approach bounds, for each fixed ttt, the probability that Za,b(t)Z_{a,b}(t)Za,b​(t) exceeds β(t,δ)\beta(t,\delta)β(t,δ) by a concentration inequality and sums over ttt. This fails: the sampling strategy is arbitrary and adaptive, so Na(t)N_a(t)Na​(t) and Nb(t)N_b(t)Nb​(t) are random and depend on the past rewards, and a fixed-sample-size deviation bound does not apply; a union bound over the possible values of the counts loses more than the threshold allows. The maximum likelihood in the numerator of Za,bZ_{a,b}Za,b​ is also not a probability density, so the likelihood ratio cannot directly be read as a change of measure. The argument must control the whole trajectory law under an arbitrary randomized policy, and must handle empty samples (an arm never pulled contributes likelihood 111) and the boundary means 000 and 111.

Formalization scope

The formalization is in Lean 4 with Mathlib and reuses the platform's canonical bandit model: StochasticBandit, BanditPolicy (a Markov kernel per round from the observed history to the next arm, so randomized strategies are included), banditTrajMeasure (the law of the infinite trajectory, where coordinate sss is round s+1s+1s+1) and IsSoundBAI from BanditTrajectory; bernoulliBandit from bernoulliRelativeEntropy; and only the pull counts trajPullCount and empirical means trajEmpiricalMean from TrackAndStop. The Gaussian GLR and threshold of TrackAndStop are not used.

Conventions committed to:

  • Arms are Fin K. Bernoulli means range over [0,1][0,1][0,1], degenerate laws included; the paper's exponential-family mean space is (0,1)(0,1)(0,1), so the [0,1][0,1][0,1] statement implies the paper's.
  • Za,b(t)Z_{a,b}(t)Za,b​(t) is defined as the ratio of the two maxima over [0,1]2[0,1]^2[0,1]2, not by the closed form (7), which holds only when μ^a(t)≥μ^b(t)\hat\mu_a(t) \ge \hat\mu_b(t)μ^​a​(t)≥μ^​b​(t). Both maxima are attained and positive.
  • The stopping rule ranges over t≥1t \ge 1t≥1; at t=0t = 0t=0 there is no observation and the paper's β(0,δ)=log⁡0\beta(0,\delta) = \log 0β(0,δ)=log0 is undefined. τδ=∞\tau_\delta = \inftyτδ​=∞ when the rule never fires.
  • The decision rule is quantified: the goal holds for every recommendation that maximizes the empirical mean at τδ\tau_\deltaτδ​, whatever the tie-breaking.
  • Probabilities of events are outer measures under the trajectory law; no measurability is assumed.
  • K≥1K \ge 1K≥1 only. For K=1K = 1K=1 the statement is trivially true (no suboptimal arm).

Disclosed deviations from the page: Lemma 11's ratio bound is stated for n≥1n \ge 1n≥1, since at n=0n = 0n=0 the printed bound reads 1≤01 \le 01≤0; the use of the lemma in Appendix C.1 is unaffected. Appendix C.1 calls the result "Proposition 10" (a slip for Theorem 10) and prints the KT density as 1/πu(1−u)1/\sqrt{\pi u(1-u)}1/πu(1−u)​ (a slip for 1/(πu(1−u))1/(\pi\sqrt{u(1-u)})1/(πu(1−u)​) of Lemma 11, which is the normalized one); the formalization follows Lemma 11.

A trivializing formalization is ruled out: stating the result for Gaussian arms or with the Lattimore–Szepesvári threshold is the platform's existing Lemma 33.7 and is not Theorem 10, and a free decision rule without the argmax hypothesis would make the claim false rather than faithful.

Contributions welcome: a proof of Lemma 11; a change-of-measure lemma for banditTrajMeasure under a mixture of environments; and the union-bound reduction from the goal to the pairwise claim.

Selected references

  • A. Garivier, E. Kaufmann, Optimal Best Arm Identification with Fixed Confidence, COLT 2016 (JMLR W&CP 49), arXiv:1602.04589v2, 2016. https://arxiv.org/abs/1602.04589
  • F. M. J. Willems, Y. M. Shtarkov, T. J. Tjalkens, The context-tree weighting method: basic properties, IEEE Transactions on Information Theory 41(3), 1995. https://doi.org/10.1109/18.382012
  • R. Krichevsky, V. Trofimov, The performance of universal encoding, IEEE Transactions on Information Theory 27(2), 1981. https://doi.org/10.1109/TIT.1981.1056331
  • H. Chernoff, Sequential design of experiments, Annals of Mathematical Statistics 30(3), 1959. https://doi.org/10.1214/aoms/1177706205
  • T. Lattimore, C. Szepesvári, Bandit Algorithms, Cambridge University Press, 2020, Chapter 33. https://doi.org/10.1017/9781108571401
10 thms4 active usersReviewed
Convex OptimizationDiscrete GeometryOperations Research+1·Captain: Shuze Chen

Discrete Convex Analysis XXX: Lagrangian Duality for M-Convex ProgramsTextbook

Motivation

Missions 29-ch08b-conjugacyduality and 30-ch08c-conjugacyduality built the M2-/L2-convex function classes and proved their conjugacy correspondence is nearly complete. This mission finishes that correspondence (Theorems 8.48-8.49) and then turns to chapter 8's capstone application: a Lagrangian duality theory for integer programs, built entirely from the M-/L-convexity machinery developed across the whole book. It develops the general perturbation-based duality framework (mirroring Rockafellar's conjugate duality for nonlinear programming), specializes it to M-convex programs via the perturbation FrF_rFr​, and proves the strong duality theorem this specialization exists to deliver — together with its mirror construction recovering the primal problem from the dual.

Setting

An M-convex program consists of a set B⊆ZVB\subseteq\mathbb Z^VB⊆ZV satisfying (REG) — BBB is an M-convex set — and an objective c:ZV→Z∪{+∞}c:\mathbb Z^V\to\mathbb Z\cup\{+\infty\}c:ZV→Z∪{+∞} satisfying (OBJ) — ccc is an M-convex function. The general duality framework embeds any f(x)=c(x)+δB(x)f(x)=c(x)+\delta_B(x)f(x)=c(x)+δB​(x) in a family of perturbed problems via F:ZV×ZV→Z∪{+∞}F:\mathbb Z^V\times\mathbb Z^V\to\mathbb Z\cup\{+\infty\}F:ZV×ZV→Z∪{+∞} with F(x,0)=f(x)F(x,0)=f(x)F(x,0)=f(x), yielding an optimal-value function φ\varphiφ, a Lagrangian KKK, and a dual objective ggg. For M-convex programs the perturbation Fr(x,u)=c(x)+δB(x+u)+r(u)F_r(x,u)=c(x)+\delta_B(x+u)+r(u)Fr​(x,u)=c(x)+δB​(x+u)+r(u), for an M-convex regularizer rrr with r(0)=0r(0)=0r(0)=0, makes this framework concrete; the case r≡0r\equiv 0r≡0 is written with subscript 000.

Formalization targets

Goal: Strong duality for M-convex programs (Theorem 8.59)

For a feasible, bounded-below M-convex program, min⁡(P)=φr(0)=φr∙∙(0)=max⁡(Dr)\min(P)=\varphi_r(0)=\varphi_r^{\bullet\bullet}(0) =\max(D_r)min(P)=φr​(0)=φr∙∙​(0)=max(Dr​), and opt⁡(Dr)=−∂Zφr(0)\operatorname{opt}(D_r)=-\partial_{\mathbb Z}\varphi_r(0)opt(Dr​)=−∂Z​φr​(0). This is the theorem mission 11-conjugacy-ii-lagrange's own STATUS.md explicitly deferred, noting it needs the specific M-convex perturbation FrF_rFr​ (Eq. (8.61)) and Propositions 8.55-8.56/Theorems 8.57-8.58 as prerequisites — all built as milestones of this mission.

Supporting structural targets

Theorem 8.48 completes the M2-/L2-convex conjugacy correspondence; Theorem 8.49 characterizes separable convex functions as exactly the M2♮^\natural_22♮​-and-L2♮^\natural_22♮​-convex functions. Theorem 8.53 (reduced to parts (1),(2),(4)) gives the general perturbation-independent duality identities: the dual objective is g=−φ∙(−⋅)g=-\varphi^{\bullet}(-\cdot)g=−φ∙(−⋅), weak duality's biconjugate form sup⁡(D)=φ∙∙(0)\sup(D)=\varphi^{\bullet\bullet}(0)sup(D)=φ∙∙(0), and the equivalence of strong duality with biconjugate exactness. Proposition 8.55 shows the M-convex perturbation FrF_rFr​ legitimately instantiates the general framework; Proposition 8.56 (reduced to part (1)) gives the closed form for the unregularized Lagrangian kernel K0K_0K0​ via the conjugate of BBB's indicator function; Theorems 8.57 and 8.58 establish the resulting convexity/concavity of the kernel, the dual objective, and the optimal-value function in each of their arguments. Propositions 8.62-8.63 and Theorems 8.64-8.65 build and analyze the mirror construction — the dual perturbation GrG_rGr​, its optimal-value function γr\gamma_rγr​, and the dual-of-dual reconstruction — showing that for bounded BBB the process exactly recovers the primal problem and its own strong duality theorem.

Significance

This is chapter 8's payoff: a full nonlinear-integer-programming duality theory, built without any convexity assumption beyond M-/L-convexity, mirroring Rockafellar's classical conjugate duality approach line for line while replacing every continuous convexity argument with a discrete M-/L-convexity one. Theorem 8.59's proof is a two-line consequence of the machinery this mission assembles (Theorems 8.35, 8.53, 8.58), which is itself the point: the discrete theory's hard combinatorial work (Theorems 8.35, 8.36, 8.42 from prior missions) is what makes the strong duality theorem here nearly free, exactly as convex analysis makes classical Lagrangian duality nearly free once Fenchel duality is established. The bidirectional construction of Theorems 8.62-8.65 is the discrete analogue of the classical fact that Lagrangian duality is symmetric between primal and dual convex programs.

None of these results are open — they are Murota's own account of M2-/L2-conjugacy and Lagrangian duality (section 8.3.3 and section 8.4), continuing chapter 8's duality program to its conclusion. What this mission contributes is a faithful, machine-checked formal statement of each, completing the platform's coverage of chapter 8's duality theorems begun in missions 10-conjugacy-i and 11-conjugacy-ii-lagrange; no comparable formalization exists on the platform (see Formalization scope).

Difficulty

The EReal-valued (Z∪{±∞}\mathbb Z\cup\{\pm\infty\}Z∪{±∞}) typing is essential and new to this mission: unlike every prior mission in this series, the general framework's derived quantities (φ\varphiφ, KKK, ggg, and their mirror-construction analogues GrG_rGr​, γr\gamma_rγr​, K~r\tilde K_rK~r​, f~\tilde ff~​) are defined as infima/suprema over families that are not a priori bounded, so they can genuinely equal −∞-\infty−∞ or +∞+\infty+∞ — a value WithTop ℝ cannot represent and whose sInf instance would silently substitute a junk value (0) rather than correctly returning −∞-\infty−∞. The book's own repeated "XXX is convex (resp. concave), or X≡+∞X\equiv+\inftyX≡+∞, or X≡−∞X\equiv-\inftyX≡−∞" disjunctive escape clauses (Theorems 8.57, 8.58, Propositions 8.63) are captured with two small generic combinators, IsEmbedOf/IsNegOf, rather than restating the embedding by hand at each of the roughly dozen occurrences.

Formalization scope

Ground-set elements are a Fintype V with DecidableEq; the base M-/L-/M2-/L2-convexity vocabulary is redeclared verbatim from missions 29-ch08b-conjugacyduality and 30-ch08c-conjugacyduality, since sibling drafts in this series cannot yet reference one another. Two results carry a documented partial-coverage scope reduction (see HARD.md): Theorem 8.53 is placed with only parts (1),(2),(4), the purely algebraic identities holding unconditionally for any perturbation FFF, omitting parts (3),(5),(6), which characterize opt⁡(D)\operatorname{opt}(D)opt(D) under the book's own biconjugacy hypothesis (8.55) — a hypothesis this mission's M-convex-specific Theorem 8.59 later establishes directly rather than invoking Theorem 8.53's general form; and Proposition 8.56 is placed with only part (1), the K0K_0K0​ closed form, omitting part (2), the KrK_rKr​ closed form via the infimal convolution δ−B□r[y]\delta_{-B}\square r[y]δ−B​□r[y], not independently needed elsewhere in this chunk. One numbered result nominally in this chunk's page range, Theorem 8.46, is not re-placed here: it was already found and placed as a milestone in mission 30-ch08c-conjugacyduality, whose own page range overlaps this chunk's by one page (PDF251/printed 233) — see HARD.md. Contributions completing any of the twelve sorrys are welcome; the goal and Theorem 8.57 carry the most independent proof content.

Selected references

  • K. Murota, Discrete Convex Analysis, SIAM, 2003. DOI: 10.1137/1.9780898718508.
  • R. T. Rockafellar, "Conjugate duality and optimization," CBMS-NSF Regional Conference Series in Applied Mathematics, SIAM, 1974 [177] (the classical conjugate-duality framework this mission's section 8.4 adapts to the discrete M-/L-convex setting).
  • K. Murota, "Discrete convex analysis," Mathematical Programming, 83 (1998), pp. 313-371 [140] (the original source of M2-/L2-convexity, Theorems 8.35, 8.36, 8.45, 8.46, 8.48, and the Lagrange duality theory of section 8.4).
56 thms3 active usersReviewed
CombinatoricsOperations ResearchOptimization·Captain: Shuze Chen

Discrete Convex Analysis XI: Max-Flow Min-Cut for Submodular FlowsTextbook

Motivation

Chapters 6 through 8 built M-convex and L-convex functions and their conjugacy theory as abstract combinatorial objects on the integer lattice. Chapter 9 grounds that theory in a setting every reader already knows: network flows. The chapter's throughline is that the classical minimum cost flow problem — flows bounded by simple arc capacities, with a single linear cost — is a shadow of a much richer submodular flow problem, in which the constraint on a flow's boundary is not "equal a fixed supply vector" but "lie in the base polyhedron of an arbitrary submodular set function." This mission formalizes the feasibility theory for both problems and its capstone: a max-flow min-cut theorem for submodular flows that specializes to the classical max-flow min-cut theorem exactly when the submodular function degenerates to a plain capacity function.

Setting

Let G=(V,A)G = (V, A)G=(V,A) be a finite directed graph, with tail,head:A→V\mathrm{tail}, \mathrm{head} : A \to Vtail,head:A→V giving each arc's start and end vertex. The boundary of a flow ξ:A→R\xi : A \to \mathbb Rξ:A→R is ∂ξ(v)=∑a:tail(a)=vξ(a)−∑a:head(a)=vξ(a)\partial\xi(v) = \sum_{a : \mathrm{tail}(a) = v} \xi(a) - \sum_{a : \mathrm{head}(a) = v} \xi(a)∂ξ(v)=∑a:tail(a)=v​ξ(a)−∑a:head(a)=v​ξ(a). For X⊆VX \subseteq VX⊆V, Δ+X\Delta^+XΔ+X and Δ−X\Delta^-XΔ−X are the arcs leaving and entering XXX. Given an upper capacity cˉ:A→R∪{+∞}\bar c : A \to \mathbb R \cup \{+\infty\}cˉ:A→R∪{+∞} and lower capacity c‾:A→R∪{−∞}\underline c : A \to \mathbb R \cup \{-\infty\}c​:A→R∪{−∞}, the cut capacity function is κ(X)=cˉ(Δ+X)−c‾(Δ−X)\kappa(X) = \bar c(\Delta^+X) - \underline c(\Delta^-X)κ(X)=cˉ(Δ+X)−c​(Δ−X). A submodular set function ρ:2V→R∪{+∞}\rho : 2^V \to \mathbb R \cup \{+\infty\}ρ:2V→R∪{+∞} with ρ(∅)=ρ(V)=0\rho(\emptyset) = \rho(V) = 0ρ(∅)=ρ(V)=0 plays the same structural role as κ\kappaκ but is arbitrary problem data rather than a derived quantity.

Formalization targets

Goal: Theorem 9.13 (max-flow min-cut for submodular flows)

For a feasible maximum submodular flow problem on a specified arc a0a_0a0​: sup⁡{ξ(a0):ξ feasible}=min⁡(cˉ(a0),min⁡X{cˉ(Δ−X)−c‾(Δ+X∖{a0})+ρ(X):a0∈Δ+X})\sup\{\xi(a_0) : \xi \text{ feasible}\} = \min\big(\bar c(a_0), \min_X\{\bar c(\Delta^-X) - \underline c(\Delta^+X \setminus \{a_0\}) + \rho(X) : a_0 \in \Delta^+X\}\big)sup{ξ(a0​):ξ feasible}=min(cˉ(a0​),minX​{cˉ(Δ−X)−c​(Δ+X∖{a0​})+ρ(X):a0​∈Δ+X}), a common value in R∪{+∞}\mathbb R \cup \{+\infty\}R∪{+∞}; if the data is integer valued and the value is finite, an integer-valued maximum flow exists.

Milestones: Proposition 9.2, Theorem 9.3, Theorem 9.10

Proposition 9.2: the cut capacity function κ\kappaκ is always submodular — the fact that lets the classical minimum cost flow problem's feasibility be phrased in exactly the same base- polyhedron language as the general submodular flow problem. Theorem 9.3: a flow meeting the capacity constraint with boundary xxx exists if and only if x(X)≤κ(X)x(X) \le \kappa(X)x(X)≤κ(X) for all XXX and x(V)=0x(V) = 0x(V)=0 — the classical case, and the direct predecessor of the goal's feasibility side. Theorem 9.10: the submodular flow problem is feasible if and only if cˉ(Δ−X)−c‾(Δ+X)+ρ(X)≥0\bar c(\Delta^-X) - \underline c(\Delta^+X) + \rho(X) \ge 0cˉ(Δ−X)−c​(Δ+X)+ρ(X)≥0 for all XXX — obtained from Theorem 9.3 via Edmonds's intersection theorem in the book's own proof, and the feasibility half of the goal's own maximum-flow variant.

Significance

The result itself. Theorem 9.13 is a genuine generalization of the max-flow min-cut theorem — one of the most-cited results in combinatorial optimization — to a submodularly constrained setting where the classical single-source-single-sink cut structure is replaced by an arbitrary vertex subset XXX scored by a submodular function ρ\rhoρ rather than merely counted. It specializes to the classical theorem when ρ\rhoρ is the indicator of a fixed boundary value and the graph carries a single source/sink; the book's own derivation (dividing the target arc a0a_0a0​ and reducing to Theorem 9.10's feasibility criterion) is exactly the kind of "one shared mechanism explains two theorems" result this whole book is organized around.

Formalizing it. A prior-art search (GET /theorems?q=max-flow min-cut) found two existing platform items for the classical theorem — LinearOptimization.max_flow_min_cut (Bertsimas & Tsitsiklis, single source/sink, plain capacities) and menger_directed_max_flow (Ford-Fulkerson, integer capacities) — both at a genuinely different, simpler generality (no lower capacity bounds, no submodular vertex-cut function, a fixed source/sink rather than an arbitrary marked arc). A further search (q=network flow) found a distinct mission formalizing Bertsimas & Tsitsiklis's uncapacitated network flow LP theory (basic feasible solutions, tree solutions, basis-matrix integrality) — a different technique (linear-algebraic, not cut-based) for a different problem (no capacities at all). Neither family is reused; this mission gives the first formal statement of submodular-flow feasibility and its max-flow min-cut theorem at the book's own generality.

Difficulty

The obvious shortcut — state only the value equality of Theorem 9.13 and drop the integrality clause — would misrepresent the theorem's own content: the equality of the extremal values follows from ordinary LP duality on the polyhedron B(κ)∩B(ρ)B(\kappa) \cap B(\rho)B(κ)∩B(ρ) (arguably already within reach of chunk 04's Edmonds's intersection theorem machinery, as the book's own proof of the feasibility predecessor Theorem 9.10 uses exactly that), whereas the integer-flow existence half is the theorem's genuine combinatorial content, unique to the integer lattice. This chunk keeps both halves in every drafted theorem (Theorem 9.3, 9.10, and the goal) rather than only the polyhedral half.

A second, more structural difficulty governed this chunk's scope: BRIEF.md recommended Theorem 9.4 (the potential-optimality criterion) and its M-convex-cost specialization Theorem 9.14 as milestones, but both need a polyhedral convexity hypothesis on real-valued (or M-convex) functions over RV\mathbb R^VRV that this series has never built — the identical scope boundary chunk 10 hit with Theorem 8.4. Rather than silently drop the polyhedral-convexity hypothesis (which would make the drafted statement unsound, since the theorem's hard direction genuinely needs it), this chunk selects only results — Proposition 9.2, Theorem 9.3, Theorem 9.10, Theorem 9.13 — that need no convexity apparatus of any kind, only the submodularity of κ\kappaκ/ρ\rhoρ and elementary capacity-constraint feasibility.

Formalization scope

VVV and AAA are Fintypes with DecidableEq V (and DecidableEq A where a Finset.erase is needed); tail, head : A → V are plain functions, not a bundled graph structure. Every capacity- and cut-related quantity is WithTop ℝ-valued (ℝ ∪ {+∞}) throughout, with no EReal: a per-term check (documented in MODERATION_NOTES.md) confirms every subtraction this chunk needs is really an addition of two terms each individually in R∪{+∞}\mathbb R \cup \{+\infty\}R∪{+∞}, via a small new cast NegLowerToUpper : WithBot ℝ → WithTop ℝ. The base polyhedron B(ρ)B(\rho)B(ρ) is stated by its defining inequalities rather than via a named polyhedral object (chunk 04's BasePolyhedron is ℤ^V-domain and does not fit chapter 9's real-vector- space setting). Not drafted: Theorem 9.4/9.14 (needs the real-domain polyhedral-convexity layer above), Theorem 9.6 (needs a real-domain polyhedral L-convexity notion for its dual-integrality half), Theorem 9.5/9.18/9.20/9.22 (negative-cycle criteria, an alternative non-potential certificate family, checked against platform prior art and found adjacent only), Propositions 9.23–9.25 (supporting technical facts), and Theorems 9.26–9.28 (the separate network- transformation technique of §9.6). A trivializing formalization would state Theorem 9.13's value equality with the integrality clause dropped, or would silently allow cˉ\bar ccˉ/c‾\underline cc​ to range over all of EReal (permitting a nonsensical c‾(a)=+∞\underline c(a) = +\inftyc​(a)=+∞ upper- capacity-like lower bound); neither is done — both the integrality clause and the WithTop ℝ/WithBot ℝ type-level domain restriction are kept exactly as the book states them.

Selected references

  • K. Murota, Discrete Convex Analysis, SIAM, 2003. DOI: 10.1137/1.9780898718508.
16 thms3 active usersReviewed
🏆Completed
Bandit AlgorithmsMachine LearningOperations Research+2·Captain: mikedeng1

Optimal Best Arm Identification with Fixed Confidence IV: Asymptotic Optimality of the Track-and-Stop StrategyResearch Paper

Motivation

In best arm identification with fixed confidence, a learner samples KKK unknown distributions (arms) sequentially and must, as early as possible, name the arm with the largest mean, while being wrong with probability at most a prescribed risk δ\deltaδ. The problem models adaptive A/B/n testing, clinical and simulation-based selection among alternatives, and the "ranking and selection" problem of operations research and simulation optimization. The quantity of interest is the sample complexity Eμ[τδ]\mathbb E_{\boldsymbol\mu}[\tau_\delta]Eμ​[τδ​], the expected number of samples a strategy takes before stopping.

Timeline of the question this mission formalizes:

  • Chernoff (1959) introduced sequential tests based on generalized likelihood ratios for adaptive design of experiments, with a finite set of hypotheses (doi:10.1214/aoms/1177706205).
  • Kaufmann, Cappé and Garivier (2016, JMLR) proved a change-of-measure lower bound on the sample complexity of every δ\deltaδ-PAC strategy (arXiv:1407.4443).
  • Garivier and Kaufmann (COLT 2016) identified the exact constant T∗(μ)T^*(\boldsymbol\mu)T∗(μ) in that lower bound and gave the first strategy, Track-and-Stop, whose sample complexity matches it asymptotically as δ→0\delta\to0δ→0 (arXiv:1602.04589). This mission covers the upper-bound half of that paper.

Setting

A canonical one-parameter exponential family is a family of laws νθ\nu_\thetaνθ​, θ∈Θ\theta\in\Thetaθ∈Θ, on R\mathbb RR with density exp⁡(θx−b(θ))\exp(\theta x-b(\theta))exp(θx−b(θ)) with respect to a reference measure ξ\xiξ; bbb is twice differentiable and strictly convex, and νθ\nu_\thetaνθ​ has mean b˙(θ)\dot b(\theta)b˙(θ). Bernoulli, Poisson and Gaussian laws with known variance are examples. The divergence d(μ,μ′)d(\mu,\mu')d(μ,μ′) is the Kullback–Leibler divergence between the members with means μ\muμ and μ′\mu'μ′.

A bandit model μ=(μ1,…,μK)\boldsymbol\mu=(\mu_1,\dots,\mu_K)μ=(μ1​,…,μK​) assigns a member of the family to each arm. The class S\mathcal SS consists of models with a unique optimal arm a∗(μ)a^*(\boldsymbol\mu)a∗(μ). At each round t=1,2,…t=1,2,\dotst=1,2,… the learner picks an arm AtA_tAt​ as a function of past observations, observes a reward drawn from that arm's law, and at a stopping time τδ\tau_\deltaτδ​ recommends an arm. Na(t)N_a(t)Na​(t) is the number of draws of arm aaa in the first ttt rounds and μ^a(t)\hat\mu_a(t)μ^​a​(t) its empirical mean.

With Alt(μ)={λ∈S:a∗(λ)≠a∗(μ)}\mathrm{Alt}(\boldsymbol\mu)=\{\boldsymbol\lambda\in\mathcal S: a^*(\boldsymbol\lambda)\ne a^*(\boldsymbol\mu)\}Alt(μ)={λ∈S:a∗(λ)=a∗(μ)} and ΣK\Sigma_KΣK​ the probability simplex, the characteristic time is

T∗(μ)−1=sup⁡w∈ΣK inf⁡λ∈Alt(μ) ∑a=1Kwa d(μa,λa),T^*(\boldsymbol\mu)^{-1}=\sup_{w\in\Sigma_K}\ \inf_{\boldsymbol\lambda\in\mathrm{Alt}(\boldsymbol\mu)}\ \sum_{a=1}^K w_a\,d(\mu_a,\lambda_a),T∗(μ)−1=w∈ΣK​sup​ λ∈Alt(μ)inf​ a=1∑K​wa​d(μa​,λa​),

and the maximizer w∗(μ)w^*(\boldsymbol\mu)w∗(μ) are the optimal proportions of arm draws.

Track-and-Stop combines two ingredients:

  • a sampling rule that tracks the plug-in proportions w∗(μ^(t))w^*(\hat{\boldsymbol\mu}(t))w∗(μ^​(t)) while forcing each arm to be drawn about t\sqrt tt​ times: C-Tracking tracks the cumulated sum of projections of w∗(μ^(s))w^*(\hat{\boldsymbol\mu}(s))w∗(μ^​(s)) onto ΣKϵs={w∈ΣK:wa≥ϵs}\Sigma^{\epsilon_s}_K=\{w\in\Sigma_K: w_a\ge\epsilon_s\}ΣKϵs​​={w∈ΣK​:wa​≥ϵs​}, ϵs=(K2+s)−1/2/2\epsilon_s=(K^2+s)^{-1/2}/2ϵs​=(K2+s)−1/2/2; D-Tracking draws an under-sampled arm when some Na(t)<t−K/2N_a(t)<\sqrt t-K/2Na​(t)<t​−K/2, and otherwise the arm maximizing t wa∗(μ^(t))−Na(t)t\,w^*_a(\hat{\boldsymbol\mu}(t))-N_a(t)twa∗​(μ^​(t))−Na​(t);
  • Chernoff's stopping rule, which stops at the first ttt at which some arm aaa beats every other arm bbb in a generalized likelihood ratio test, Za,b(t)>β(t,δ)Z_{a,b}(t)>\beta(t,\delta)Za,b​(t)>β(t,δ), here with β(t,δ)=log⁡(r(t)/δ)\beta(t,\delta)=\log(r(t)/\delta)β(t,δ)=log(r(t)/δ).

Formalization targets

Goal: Theorem 14 (p. 13)

For α∈[1,e/2]\alpha\in[1,e/2]α∈[1,e/2] and r(t)=O(tα)r(t)=O(t^\alpha)r(t)=O(tα), Chernoff's stopping rule with β(t,δ)=log⁡(r(t)/δ)\beta(t,\delta)=\log(r(t)/\delta)β(t,δ)=log(r(t)/δ) combined with C-Tracking or D-Tracking satisfies

lim sup⁡δ→0Eμ[τδ]log⁡(1/δ)≤α T∗(μ)\limsup_{\delta\to0}\frac{\mathbb E_{\boldsymbol\mu}[\tau_\delta]}{\log(1/\delta)}\le\alpha\,T^*(\boldsymbol\mu)δ→0limsup​log(1/δ)Eμ​[τδ​]​≤αT∗(μ)

for every μ∈S\boldsymbol\mu\in\mathcal Sμ∈S.

Milestones

  • Lemma 15 (p. 20): greedy tracking of cumulated proportions P(k)P(k)P(k) keeps max⁡i∣Ni(n)−Pi(n)∣≤K−1\max_i|N_i(n)-P_i(n)|\le K-1maxi​∣Ni​(n)−Pi​(n)∣≤K−1.
  • Lemma 7 (p. 7): C-Tracking ensures Na(t)≥t+K2−2KN_a(t)\ge\sqrt{t+K^2}-2KNa​(t)≥t+K2​−2K and max⁡a∣Na(t)−∑s<twa∗(μ^(s))∣≤K(1+t)\max_a|N_a(t)-\sum_{s<t}w^*_a(\hat{\boldsymbol\mu}(s))|\le K(1+\sqrt t)maxa​∣Na​(t)−∑s<t​wa∗​(μ^​(s))∣≤K(1+t​).
  • Lemma 8 (p. 7): D-Tracking ensures Na(t)≥(t−K/2)+−1N_a(t)\ge(\sqrt t-K/2)_+-1Na​(t)≥(t​−K/2)+​−1, and proportions within 3(K−1)ϵ3(K-1)\epsilon3(K−1)ϵ of w∗(μ)w^*(\boldsymbol\mu)w∗(μ) after a time tϵt_\epsilontϵ​ that does not depend on the trajectory, once the plug-in targets are within ϵ\epsilonϵ.
  • Proposition 9 (p. 8): under either rule, Na(t)/t→wa∗(μ)N_a(t)/t\to w^*_a(\boldsymbol\mu)Na​(t)/t→wa∗​(μ) almost surely.
  • Lemma 18 (p. 27): an explicit xxx with c1x≥log⁡(c2xα)c_1x\ge\log(c_2x^\alpha)c1​x≥log(c2​xα) for α∈[1,e/2]\alpha\in[1,e/2]α∈[1,e/2].
  • Proposition 13 (p. 11): with any sampling rule whose proportions converge almost surely to w∗w^*w∗, τδ<∞\tau_\delta<\inftyτδ​<∞ almost surely and lim sup⁡δ→0τδ/log⁡(1/δ)≤αT∗(μ)\limsup_{\delta\to0}\tau_\delta/\log(1/\delta)\le\alpha T^*(\boldsymbol\mu)limsupδ→0​τδ​/log(1/δ)≤αT∗(μ) almost surely.

Significance

Theorem 1 of the same paper shows Eμ[τδ]≥T∗(μ) kl(δ,1−δ)\mathbb E_{\boldsymbol\mu}[\tau_\delta]\ge T^*(\boldsymbol\mu)\,\mathrm{kl}(\delta,1-\delta)Eμ​[τδ​]≥T∗(μ)kl(δ,1−δ) for every δ\deltaδ-PAC strategy, and kl(δ,1−δ)∼log⁡(1/δ)\mathrm{kl}(\delta,1-\delta)\sim\log(1/\delta)kl(δ,1−δ)∼log(1/δ). Theorem 14 with α=1\alpha=1α=1 therefore shows that the lower bound is attained: T∗(μ)T^*(\boldsymbol\mu)T∗(μ) is the exact asymptotic sample complexity of best arm identification in exponential family models, and Track-and-Stop is asymptotically optimal.

The result is proved in the paper. What is not available is a machine-checked proof for exponential families. The platform already holds a Lean development of the Gaussian case following Lattimore and Szepesvári, Bandit Algorithms, Ch. 33, stated for one existentially chosen policy with a different threshold. This mission asks for the universal statement: every run of either tracking rule, for every exponential family, with the paper's thresholds. The tracking lemmas (Lemmas 15, 7, 8) are deterministic combinatorics and reusable by any tracking-based algorithm.

Difficulty

The obvious argument plugs the almost-sure behaviour of Proposition 13 into an expectation. That step fails: almost-sure convergence of τδ/log⁡(1/δ)\tau_\delta/\log(1/\delta)τδ​/log(1/δ) does not control E[τδ]\mathbb E[\tau_\delta]E[τδ​], because on the rare events where the empirical means are far from μ\boldsymbol\muμ the stopping time may be very large. Theorem 14 needs a quantitative concentration of μ^(t)\hat{\boldsymbol\mu}(t)μ^​(t) on events whose complements have summable probability, which in turn relies on the forced exploration guaranteed by the t\sqrt tt​ lower bounds on Na(t)N_a(t)Na​(t) (the concentration step of App. D, Lemmas 19–20).

A second obstacle is the regularity of w∗w^*w∗: the tracking lemmas only transfer convergence of μ^(t)\hat{\boldsymbol\mu}(t)μ^​(t) to convergence of Na(t)/tN_a(t)/tNa​(t)/t through the continuity of μ↦w∗(μ)\boldsymbol\mu\mapsto w^*(\boldsymbol\mu)μ↦w∗(μ) on S\mathcal SS, proved from the characterization of w∗w^*w∗ in §2.2 (Proposition 6). The GLR statistic also needs its closed form (7) near μ\boldsymbol\muμ, which requires the empirical means to lie in the interior of the mean space.

Formalization scope

  • Model. The exponential family is a structure (ξ,Θ,b)(\xi,\Theta,b)(ξ,Θ,b) with Θ\ThetaΘ a nonempty open interval, each νθ\nu_\thetaνθ​ normalized, bbb twice continuously differentiable and b¨>0\ddot b>0b¨>0 on Θ\ThetaΘ. Openness and b¨>0\ddot b>0b¨>0 are added to the paper's "convex, twice differentiable"; strict convexity is what makes νμ\nu^\muνμ unique. Bandit models are parameter vectors θ∈ΘK\theta\in\Theta^Kθ∈ΘK with K≥2K\ge2K≥2; arms are indexed 0,…,K−10,\dots,K-10,…,K−1. S\mathcal SS is the set of parameter vectors with a unique arm of largest mean b˙(θa)\dot b(\theta_a)b˙(θa​).
  • Protocol. Policies, the trajectory law Pμ\mathbb P_{\boldsymbol\mu}Pμ​, pull counts, empirical means and T∗(μ)T^*(\boldsymbol\mu)T∗(μ) are the platform's published definitions (BanditPolicy, BanditTrajectory, TrackAndStop). T∗T^*T∗ uses Kullback–Leibler divergences of the arm laws over the class S\mathcal SS and takes values in [0,∞][0,\infty][0,∞]. Trajectory coordinate ttt is round t+1t+1t+1. An arm never drawn has empirical mean 000.
  • Target map. w∗(μ^(t))w^*(\hat{\boldsymbol\mu}(t))w∗(μ^​(t)) is undefined in the paper when μ^(t)∉S\hat{\boldsymbol\mu}(t)\notin\mathcal Sμ^​(t)∈/S (an unsampled arm, ties, a mean outside b˙(Θ)\dot b(\Theta)b˙(Θ)). Every tracking statement quantifies over every target map with values in ΣK\Sigma_KΣK​ that returns optimal proportions on S\mathcal SS, over every choice of L∞L^\inftyL∞ projections, and over every tie-breaking, including randomized ones.
  • Stopping rule. The two maxima in Za,b(t)Z_{a,b}(t)Za,b​(t) are suprema over Θ\ThetaΘ in the extended reals. Za,b(t)>βZ_{a,b}(t)>\betaZa,b​(t)>β is written without subtracting infinities. The stopping time is the first t≥1t\ge1t≥1 at which the test succeeds, +∞+\infty+∞ if none. "r(t)=O(tα)r(t)=O(t^\alpha)r(t)=O(tα)" is r(t)≤Dtαr(t)\le Dt^\alphar(t)≤Dtα for t≥1t\ge1t≥1; r>0r>0r>0 is added so that log⁡(r(t)/δ)\log(r(t)/\delta)log(r(t)/δ) is defined.
  • Values in [0,∞][0,\infty][0,∞]. Expectations of τδ\tau_\deltaτδ​, the ratios and T∗T^*T∗ live in [0,∞][0,\infty][0,∞]. No statement converts them to reals, so an infinite expected stopping time is never read as 000.
  • Corrections, disclosed. Proposition 9's printed Pw\mathbb P_wPw​ is Pμ\mathbb P_{\boldsymbol\mu}Pμ​. Lemma 18 adds c2/c1α>1c_2/c_1^\alpha>1c2​/c1α​>1 and x>0x>0x>0, without which its expressions are undefined.
  • Ruled out. Specializing to Gaussian arms, or asserting that some sampling policy achieves the bound, would restate existing platform results and is not this theorem: the goal is about every C-Tracking or D-Tracking run in every exponential family.
  • Welcome contributions. Exponential-family facts (b˙\dot bb˙ is the mean, the KL formula, concentration of empirical means); the continuity of w∗w^*w∗ (Proposition 6, App. A.3); Lemma 17 (App. B.2), from which Lemma 8 follows; the closed form (7) of the GLR statistic.

Selected references

  • A. Garivier, E. Kaufmann, Optimal Best Arm Identification with Fixed Confidence, COLT 2016, JMLR W&CP 49. arXiv:1602.04589v2
  • E. Kaufmann, O. Cappé, A. Garivier, On the Complexity of Best-Arm Identification in Multi-Armed Bandit Models, JMLR 17, 2016. arXiv:1407.4443
  • H. Chernoff, Sequential Design of Experiments, Ann. Math. Statist. 30(3), 1959. doi:10.1214/aoms/1177706205
  • T. Lattimore, C. Szepesvári, Bandit Algorithms, Cambridge University Press, 2020, Ch. 33. doi:10.1017/9781108571401
15 thms5 active usersReviewed
PreviousNext

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me