Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in
← Collections

The OR Formalization Drive

Help us formalize the operations research literature in Lean.

1094 missions

Missions

861–880 of 1094
OpenCompletedAll
🏆Completed
Operations ResearchOptimizationTheoretical Computer Science·Captain: mikedeng1

Assortment Optimisation Under a General Discrete Choice Model: A Tight Analysis of Revenue-Ordered Assortments I: Revenue-Ordered Assortments Earn OPT/(1 + ln(r_k/r_1)) Under Any Regular Choice ModelResearch Paper

Motivation

A retailer, an airline or an online platform decides which products to show a customer. Showing more is not always better: a customer who would have bought an expensive product may switch to a cheap one once it is offered. The assortment problem asks for the set of products that maximises expected revenue, given a model of how customers choose. It is a central problem of revenue management (Talluri and van Ryzin, 2004), and it is NP-hard even for mixtures of two multinomial logit models (Rusmevichientong, Shmoys, Tong and Topaloglu, 2014).

The standard heuristic in practice is revenue-ordered assortments: sort the products by price and only consider the sets consisting of the most expensive products down to some threshold. It is optimal under the multinomial logit model (Talluri and van Ryzin, 2004), but not in general. Berbeglia and Joret (arXiv:1606.01371) ask how much revenue the heuristic can lose under every reasonable choice model, and answer with guarantees that depend only on the prices.

Timeline:

  • 2004: Talluri and van Ryzin prove revenue-ordered assortments optimal under the multinomial logit model.
  • 2014: Rusmevichientong et al. show NP-hardness of the assortment problem for mixtures of logits, and prove that revenue-ordered assortments earn at least OPT/(e(1+ln⁡(rk/r1)))\mathrm{OPT}/(e(1+\ln(r_k/r_1)))OPT/(e(1+ln(rk​/r1​))) under mixed logit models.
  • 2016–2019: Berbeglia and Joret prove the guarantees 1/k1/k1/k and 1/(1+ln⁡(rk/r1))1/(1+\ln(r_k/r_1))1/(1+ln(rk​/r1​)) under any regular choice model and show them tight (arXiv v1 2016, v3 2019; Algorithmica 2020). Aouad, Farias, Levi and Segev (2018) show that under random utility models no efficient algorithm does essentially better than these ratios.

Setting

There is a finite nonempty set C\mathcal CC of products. For a choice set S⊆CS\subseteq\mathcal CS⊆C, P(x,S)\mathcal P(x,S)P(x,S) is the probability that a customer offered SSS buys product xxx, and P(0,S)=1−∑x∈SP(x,S)\mathcal P(0,S)=1-\sum_{x\in S}\mathcal P(x,S)P(0,S)=1−∑x∈S​P(x,S) is the probability that the customer buys nothing. The system P\mathcal PP is a regular discrete choice model if

  1. P(x,S)≥0\mathcal P(x,S)\ge0P(x,S)≥0 for every x∈C∪{0}x\in\mathcal C\cup\{0\}x∈C∪{0};
  2. P(x,S)=0\mathcal P(x,S)=0P(x,S)=0 whenever x∉Sx\notin Sx∈/S;
  3. ∑x∈SP(x,S)≤1\sum_{x\in S}\mathcal P(x,S)\le1∑x∈S​P(x,S)≤1;
  4. P(x,S)≥P(x,S′)\mathcal P(x,S)\ge\mathcal P(x,S')P(x,S)≥P(x,S′) whenever S⊆S′S\subseteq S'S⊆S′ and x∈S∪{0}x\in S\cup\{0\}x∈S∪{0}.

Axiom 4, regularity, says that adding products never makes a given product, or leaving without buying, more likely. Every random utility model is regular.

Each product has a positive price r(x)>0r(x)>0r(x)>0. The revenue of SSS is rev⁡(S)=∑x∈SP(x,S) r(x)\operatorname{rev}(S)=\sum_{x\in S}\mathcal P(x,S)\,r(x)rev(S)=∑x∈S​P(x,S)r(x), and OPT=max⁡S⊆Crev⁡(S)\mathrm{OPT}=\max_{S\subseteq\mathcal C}\operatorname{rev}(S)OPT=maxS⊆C​rev(S). Let 0<r1<⋯<rk0<r_1<\cdots<r_k0<r1​<⋯<rk​ be the distinct prices, so kkk counts price levels and not products, and set r0=0r_0=0r0​=0. The revenue-ordered assortments are Si={x∈C:r(x)≥ri}S_i=\{x\in\mathcal C : r(x)\ge r_i\}Si​={x∈C:r(x)≥ri​}, i=1,…,ki=1,\dots,ki=1,…,k, and the heuristic earns

RO=max⁡1≤i≤krev⁡(Si).\mathrm{RO}=\max_{1\le i\le k}\operatorname{rev}(S_i).RO=1≤i≤kmax​rev(Si​).

Formalization targets

Goal: Theorem 3.2

OPT  ≤  (∑i=1kri−ri−1ri) ROand∑i=1kri−ri−1ri  ≤  1+ln⁡rkr1.\mathrm{OPT}\;\le\;\Big(\sum_{i=1}^{k}\frac{r_i-r_{i-1}}{r_i}\Big)\,\mathrm{RO} \qquad\text{and}\qquad \sum_{i=1}^{k}\frac{r_i-r_{i-1}}{r_i}\;\le\;1+\ln\frac{r_k}{r_1}.OPT≤(i=1∑k​ri​ri​−ri−1​​)ROandi=1∑k​ri​ri​−ri−1​​≤1+lnr1​rk​​.

The goal fixes no constant beyond the paper's own quantities. Both parts are required: the sum form is the sharper bound, and the paper shows it is attained (Theorem 3.4, a later mission of this series).

Milestones

  • Lemma 2.1: ∑x∈SP(x,S)≤∑x∈S′P(x,S′)\sum_{x\in S}\mathcal P(x,S)\le\sum_{x\in S'}\mathcal P(x,S')∑x∈S​P(x,S)≤∑x∈S′​P(x,S′) for S⊆S′S\subseteq S'S⊆S′.
  • Inequality (5): rev⁡(Si)≥ri∑x∈S∗∩SiP(x,S∗)\operatorname{rev}(S_i)\ge r_i\sum_{x\in S^*\cap S_i}\mathcal P(x,S^*)rev(Si​)≥ri​∑x∈S∗∩Si​​P(x,S∗) for every S∗S^*S∗ and i∈[k]i\in[k]i∈[k].
  • Theorem 3.1: OPT≤k⋅RO\mathrm{OPT}\le k\cdot\mathrm{RO}OPT≤k⋅RO.
  • Rearrangement (proof of Theorem 3.2): rev⁡(S∗)=∑ℓ(rℓ−rℓ−1)∑x∈S∗∩SℓP(x,S∗)\operatorname{rev}(S^*)=\sum_{\ell}(r_\ell-r_{\ell-1})\sum_{x\in S^*\cap S_\ell}\mathcal P(x,S^*)rev(S∗)=∑ℓ​(rℓ​−rℓ−1​)∑x∈S∗∩Sℓ​​P(x,S∗), and rev⁡(S∗)≤∑ℓrℓ−rℓ−1rℓrev⁡(Sℓ)\operatorname{rev}(S^*)\le\sum_\ell\frac{r_\ell-r_{\ell-1}}{r_\ell}\operatorname{rev}(S_\ell)rev(S∗)≤∑ℓ​rℓ​rℓ​−rℓ−1​​rev(Sℓ​).
  • Logarithmic bound: ∑ℓ=1kaℓ−aℓ−1aℓ≤1+ln⁡(ak/a1)\sum_{\ell=1}^k\frac{a_\ell-a_{\ell-1}}{a_\ell}\le1+\ln(a_k/a_1)∑ℓ=1k​aℓ​aℓ​−aℓ−1​​≤1+ln(ak​/a1​) for 0=a0<a1<⋯<ak0=a_0<a_1<\cdots<a_k0=a0​<a1​<⋯<ak​.

Significance

The theorem shows that a pricing-only quantity controls the loss of the most common heuristic in revenue management, uniformly over all regular choice models, including every random utility model, mixtures of logits and Markov chain models. Combined with the hardness result of Aouad et al., it shows that revenue-ordered assortments achieve essentially the best ratio, as a function of kkk or of rk/r1r_k/r_1rk​/r1​, that an efficient algorithm can achieve. The same analysis transfers to the envy-free pricing and Stackelberg problems studied in the later sections of the paper.

The result is proved in the paper; to our knowledge it has no machine-checked proof. This mission produces a Lean formalization of regular choice models, the revenue-ordered heuristic and its two guarantees, on which the paper's tightness examples, the purchase-probability bound (Theorem 3.3) and the applications to pricing can build.

Difficulty

The argument is short, but two points are easy to get wrong. First, revenues of SiS_iSi​ and of an optimal S∗S^*S∗ involve choice probabilities evaluated at different sets, so the comparison must pass through S∗∩SiS^*\cap S_iS∗∩Si​, using regularity once for products and once for the no-purchase option. A model that only assumes regularity for products does not satisfy the theorem. Second, the bound runs over distinct price levels, not products, and the first summand uses the convention r0=0r_0=0r0​=0; indexing by products or dropping r0r_0r0​ gives a different quantity. The comparison of the sum with ln⁡(rk/r1)\ln(r_k/r_1)ln(rk​/r1​) is a Riemann-sum estimate for ∫dt/t\int dt/t∫dt/t and needs a real-analysis lemma not phrased this way in Mathlib.

Formalization scope

  • Products are a finite nonempty type C with decidable equality; choice sets are Finset C. The choice probabilities are P : C → Finset C → ℝ, defined on all pairs. The no-purchase option is not a product: P(0,S)\mathcal P(0,S)P(0,S) is the derived quantity noPurchase P S = 1 - ∑ x ∈ S, P x S.
  • IsRegular P carries axioms (i)–(iv), with (i) and (iv) each split into a product case and a no-purchase case. The no-purchase case of (i) is redundant with (iii) and is kept to match the page.
  • r : C → ℝ with the hypothesis ∀ x, 0 < r x. revenue P r S is rev⁡(S)\operatorname{rev}(S)rev(S) and opt P r is the maximum over all Finset C (Finset.sup'), including the empty set.
  • Price levels are 1-based: level r i is rir_iri​ for 1≤i≤k1\le i\le k1≤i≤k and level r 0 = 0; numVals r is kkk, the number of distinct values. roSet r i is SiS_iSi​; roValue P r is the maximum over i∈{1,…,k}i\in\{1,\dots,k\}i∈{1,…,k} only.
  • Approximation guarantees are stated in product form, OPT≤D⋅RO\mathrm{OPT}\le D\cdot\mathrm{RO}OPT≤D⋅RO, never as a ratio. ln⁡\lnln is Real.log, applied to rk/r1≥1r_k/r_1\ge1rk​/r1​≥1.
  • Ruled out: a maximum over all subsets in place of RO\mathrm{RO}RO (which makes the bound trivial), a regularity axiom without its no-purchase case, the logarithmic form alone in place of the sum form, and any specific choice model (logit, Markov chain, random utility) in place of an arbitrary regular P\mathcal PP.

Needed infrastructure: finite sums over price levels and summation by parts, the comparison of (b−a)/b(b-a)/b(b−a)/b with ln⁡(b/a)\ln(b/a)ln(b/a), and the sorted enumeration of a finite set of reals (Finset.orderEmbOfFin). The regular model and the revenue-ordered sets are shared with the other missions of this series. Contributions of any milestone, alternative proofs of the logarithmic bound, and proofs that specific choice models are regular are welcome.

Selected references

  • G. Berbeglia and G. Joret, Assortment Optimisation Under a General Discrete Choice Model: A Tight Analysis of Revenue-Ordered Assortments, arXiv:1606.01371v3, 2019; Algorithmica 82, 2020. https://arxiv.org/abs/1606.01371
  • K. Talluri and G. van Ryzin, Revenue Management Under a General Discrete Choice Model of Consumer Behavior, Management Science 50(1), 2004. https://doi.org/10.1287/mnsc.1030.0147
  • A. Aouad, V. Farias, R. Levi and D. Segev, The Approximability of Assortment Optimization Under Ranking Preferences, Operations Research 66(6), 2018. https://doi.org/10.1287/opre.2018.1724
  • P. Rusmevichientong, D. Shmoys, C. Tong and H. Topaloglu, Assortment Optimization under the Multinomial Logit Model with Random Choice Parameters, Production and Operations Management 23(11), 2014. https://doi.org/10.1111/poms.12191
9 thms2 active usersReviewed
Operations ResearchProbability·Captain: mikedeng1

Optimal Dynamic Pricing of Inventories with Stochastic Demand over Finite Horizons 3: With a Discrete Price Set the Two-Price Stopping-Time Heuristic Is Asymptotically OptimalResearch Paper

Motivation

Airlines, hotels and cruise lines rarely change prices continuously. They sell a fixed product (seats on one flight, rooms on one night) over a finite selling season, and they sell it at a small set of fares, opening and closing fare classes as the season unfolds. Gallego and van Ryzin, in Optimal Dynamic Pricing of Inventories with Stochastic Demand over Finite Horizons (Management Science 40(8), 1994, doi:10.1287/mnsc.40.8.999), model this as the sale of nnn items over a horizon of length ttt, with Poisson demand whose rate depends on the current price. Section 4 of the paper restricts the price to a finite menu and asks how much is lost by using a simple rule that charges only two adjacent prices and switches once. The answer, Theorem 5, gives one explanation of fixed-fare-class yield management: with two fares and one well-timed switch, a seller earns asymptotically the best revenue any policy over the menu can earn. The source of this mission is the published 1994 article.

The paper is the starting point of a long line of work on fluid (deterministic) approximations in revenue management, including Feng and Gallego (1995) on optimal switching times between two prices and later re-solving and bid-price analyses, all of which compare stochastic policies to the value of a deterministic problem in the same way.

Setting

A menu consists of K≥2K\ge2K≥2 prices p1<p2<⋯<pKp_1<p_2<\dots<p_Kp1​<p2​<⋯<pK​ and Poisson demand rates λ1>λ2>⋯>λK>0\lambda_1>\lambda_2>\dots>\lambda_K>0λ1​>λ2​>⋯>λK​>0; the firm may also charge the null price p∞p_\inftyp∞​, at which demand is 000. The revenue rates rk=pkλkr_k=p_k\lambda_krk​=pk​λk​ satisfy r1>r2>⋯>rKr_1>r_2>\dots>r_Kr1​>r2​>⋯>rK​, and the points (λk,rk)(\lambda_k,r_k)(λk​,rk​) lie on a concave function on [0,∞)[0,\infty)[0,∞) vanishing at 000.

The deterministic problem replaces random demand by its rate. If tk≥0t_k\ge0tk​≥0 is the time spent at price pkp_kpk​, the problem is the linear program

JD(n,t)=sup⁡{∑krktk: ∑ktk≤t, ∑kλktk≤n, tk≥0}.J^D(n,t)=\sup\Big\{\sum_k r_k t_k:\ \sum_k t_k\le t,\ \sum_k\lambda_k t_k\le n,\ t_k\ge0\Big\}.JD(n,t)=sup{k∑​rk​tk​: k∑​tk​≤t, k∑​λk​tk​≤n, tk​≥0}.

Given n∈Nn\in\mathbb Nn∈N and t>0t>0t>0, let k=k∗k=k^*k=k∗ be the index with λkt≥n>λk+1t\lambda_k t\ge n>\lambda_{k+1}tλk​t≥n>λk+1​t, and put

tk=n−λk+1tλk−λk+1,m=⌈λktk⌉,tm=mλk.t_k=\frac{n-\lambda_{k+1}t}{\lambda_k-\lambda_{k+1}},\qquad m=\lceil\lambda_k t_k\rceil,\qquad t_m=\frac{m}{\lambda_k}.tk​=λk​−λk+1​n−λk+1​t​,m=⌈λk​tk​⌉,tm​=λk​m​.

The stopping-time (ST) heuristic starts at price pkp_kpk​ and switches to pk+1p_{k+1}pk+1​ at the random time τ=min⁡(Tm,tm)\tau=\min(T_m,t_m)τ=min(Tm​,tm​), where TmT_mTm​ is the time of the mmm-th demand. Sales stop when the nnn items are gone or at time ttt. JST(n,t)J^{ST}(n,t)JST(n,t) is its expected revenue.

Formalization targets

Goal: Theorem 5

For a fixed index kkk with 1≤k≤K−11\le k\le K-11≤k≤K−1 and any sequences nj∈Nn_j\in\mathbb Nnj​∈N, tj→∞t_j\to\inftytj​→∞ with λktj≥nj>λk+1tj\lambda_k t_j\ge n_j>\lambda_{k+1}t_jλk​tj​≥nj​>λk+1​tj​,

lim⁡j→∞JST(nj,tj)JD(nj,tj)=1.\lim_{j\to\infty}\frac{J^{ST}(n_j,t_j)}{J^D(n_j,t_j)}=1.j→∞lim​JD(nj​,tj​)JST(nj​,tj​)​=1.

No rate of convergence is fixed in the goal, and the ratio nj/tjn_j/t_jnj​/tj​ may vary along the sequence.

Milestones

  1. Proposition 4. The LP is solved by pricing at pk∗p_{k^*}pk∗​ for time tk∗t_{k^*}tk∗​ and at pk∗+1p_{k^*+1}pk∗+1​ for time tk∗+1=(λk∗t−n)/(λk∗−λk∗+1)t_{k^*+1}=(\lambda_{k^*}t-n)/(\lambda_{k^*}-\lambda_{k^*+1})tk∗+1​=(λk∗​t−n)/(λk∗​−λk∗+1​), together with the edge cases k∗=0k^*=0k∗=0 and k∗=Kk^*=Kk∗=K.
  2. The wasteful heuristic is a lower bound: JW(n,t)≤JST(n,t)J^W(n,t)\le J^{ST}(n,t)JW(n,t)≤JST(n,t), where the wasteful heuristic offers mmm units at pkp_kpk​ during [0,tm][0,t_m][0,tm​] and n−mn-mn−m units at pk+1p_{k+1}pk+1​ afterwards.
  3. Equation (28): the shrunk horizon t′=tm+(n−m)/λk+1t'=t_m+(n-m)/\lambda_{k+1}t′=tm​+(n−m)/λk+1​ satisfies t−(λk−λk+1)/(λkλk+1)<t′≤tt-(\lambda_k-\lambda_{k+1})/(\lambda_k\lambda_{k+1})<t'\le tt−(λk​−λk+1​)/(λk​λk+1​)<t′≤t.
  4. The closed form of JDJ^DJD and JD(n,t)<JD(n,t′)+(pk+1−pk)J^D(n,t)<J^D(n,t')+(p_{k+1}-p_k)JD(n,t)<JD(n,t′)+(pk+1​−pk​).
  5. Equation (29): JST(n,t)/JD(n,t)≥JW(n,t)/JD(n,t)≥JW(n,t′)/(JD(n,t′)+(pk+1−pk))J^{ST}(n,t)/J^D(n,t)\ge J^W(n,t)/J^D(n,t)\ge J^W(n,t')/(J^D(n,t')+(p_{k+1}-p_k))JST(n,t)/JD(n,t)≥JW(n,t)/JD(n,t)≥JW(n,t′)/(JD(n,t′)+(pk+1​−pk​)).
  6. The wasteful bound: JW(n,t′)≥pk[m−12m]+pk+1[(n−m)−12n−m]J^W(n,t')\ge p_k[m-\tfrac12\sqrt m]+p_{k+1}[(n-m)-\tfrac12\sqrt{n-m}]JW(n,t′)≥pk​[m−21​m​]+pk+1​[(n−m)−21​n−m​] and JW(n,t′)/JD(n,t′)≥1−12(1/m+1/n−m)J^W(n,t')/J^D(n,t')\ge1-\tfrac12(1/\sqrt m+1/\sqrt{n-m})JW(n,t′)/JD(n,t′)≥1−21​(1/m​+1/n−m​).

Significance

Theorem 5 says that a policy with one price change, chosen from the deterministic solution, loses a vanishing fraction of the deterministic revenue. Since JDJ^DJD bounds the optimal expected revenue over all non-anticipating policies with prices in the menu (§4.0.1 of the paper), the ST heuristic is asymptotically optimal, and the optimal policy, which solves a Hamilton–Jacobi–Bellman system with no closed form, can be replaced by a rule that is computed by hand. The result also shows that a finite menu, together with dynamic allocation of capacity between two neighbouring prices, can realize the effective price of a continuous demand curve.

The theorem is proved in the paper. As far as the platform's index shows, neither this result nor the controlled Poisson sales process it needs has been formalized; Mathlib has the exponential and Poisson distributions but no counting process with a policy-dependent intensity. The mission produces a machine-checked version of the paper's proof chain: the LP solution, the coupling inequality between two heuristics, the deterministic horizon estimate (28), and the Poisson overflow estimate built on Gallego's bound (inequality (18) of the paper, already proved on the platform as PricingRM.DetHeuristic.gallego_bound).

Difficulty

The deterministic parts (Proposition 4, (28), the closed form of JDJ^DJD) are finite-dimensional linear algebra. The difficulty sits in the stochastic comparison JW≤JSTJ^W\le J^{ST}JW≤JST. The ST heuristic's switching time depends on the sales process, and after the switch the remaining stock and the remaining time are both random. The obvious attempt, writing JSTJ^{ST}JST as a sum of two independent Poisson terms, is wrong: the two phases are dependent through τ\tauτ. Any comparison has to handle a second phase whose starting stock and starting time are both random, which brings in the behaviour of the sales process after a random time determined by the process itself. The limit step then needs the overflow bound uniformly along sequences whose ratio n/tn/tn/t is not fixed.

Formalization scope

All declarations live in the namespace GVRPricing.StoppingTime. The committed conventions are:

  • Indices are 0-based (Fin K): Lean index kkk is the paper's price number k+1k+1k+1, and lamN, pN, rN extend the sequences by 000 beyond KKK, matching the paper's λK+1=rK+1=0\lambda_{K+1}=r_{K+1}=0λK+1​=rK+1​=0.
  • The menu carries the printed conditions plus an added concavity condition: the points (λk,rk)(\lambda_k,r_k)(λk​,rk​) lie on a concave function vanishing at 000. This is the reading of §4's "corresponding to price pkp_kpk​, we have a known demand rate λk\lambda_kλk​" for a regular demand function with concave revenue rate. Without it Proposition 4 and Theorem 5 are false: the menu λ=(3,2,1)\lambda=(3,2,1)λ=(3,2,1), p=(1,1.01,1.5)p=(1,1.01,1.5)p=(1,1.01,1.5) meets every printed condition, but at t=1t=1t=1, n=1.5n=1.5n=1.5 Proposition 4's allocation earns 1.761.761.76 while a feasible mix of p1p_1p1​ and p3p_3p3​ earns 1.8751.8751.875, and the ST ratio tends to about 0.9390.9390.939.
  • JDJ^DJD is defined directly as the LP value; the reduction from the rate-path problem (11) is the paper's assertion and is not formalized.
  • The sales process is built from nnn i.i.d. standard exponential clocks by the time change of the ST policy's cumulative intensity, so at most nnn items are sold. Time is elapsed time from 000. JSTJ^{ST}JST is the expectation of the sum of prices charged at sales in [0,t][0,t][0,t], a lower Lebesgue integral of a bounded nonnegative function.
  • JWJ^WJW is the paper's two-Poisson formula of p. 1018.
  • J∗J^*J∗ is not defined, so the left ratio of (29) uses JDJ^DJD in place of J∗J^*J∗ (a stronger inequality, since J∗≤JDJ^*\le J^DJ∗≤JD), and the §4.0.1 upper bound J∗≤JDJ^*\le J^DJ∗≤JD is not a milestone.
  • Corrected slips: the page prints tn−m≐n−m/λk+1t_{n-m}\doteq n-m/\lambda_{k+1}tn−m​≐n−m/λk+1​ for (n−m)/λk+1(n-m)/\lambda_{k+1}(n−m)/λk+1​; the wasteful bound is stated at the shrunk horizon t′t't′, where its integrality assumptions hold exactly, instead of along the paper's subsequence; the ratio bound assumes m<nm<nm<n, since 1/n−m1/\sqrt{n-m}1/n−m​ is undefined otherwise. Proposition 4 is stated as optimality, without the uniqueness that fails when three menu points are collinear.
  • Excluded: the edge cases k∗=0k^*=0k∗=0 and k∗=Kk^*=Kk∗=K of Theorem 5, treated on the page only in an unproved remark.

A trivializing formalization would define JSTJ^{ST}JST through the wasteful formula, or by a closed-form expression, which makes the goal the wasteful bound; here JSTJ^{ST}JST is the expected revenue of the switching rule τ=min⁡(Tm,tm)\tau=\min(T_m,t_m)τ=min(Tm​,tm​) on the sales process. Likewise the limit is taken along sequences with tj→∞t_j\to\inftytj​→∞, not at a single (n,t)(n,t)(n,t).

Useful infrastructure, reusable beyond this mission: the exponential-clock construction of a Poisson process with piecewise-constant intensity, the strong Markov property at a stopping time of the clocks, and the expected Poisson overflow E(Nμ−μ)+\mathbb E(N_\mu-\mu)^+E(Nμ​−μ)+. Contributions to any milestone, and alternative proofs of JW≤JSTJ^W\le J^{ST}JW≤JST, are welcome.

Selected references

  • G. Gallego, G. van Ryzin, Optimal Dynamic Pricing of Inventories with Stochastic Demand over Finite Horizons, Management Science 40(8), 999–1020, 1994. doi:10.1287/mnsc.40.8.999
  • G. Gallego, A Minmax Distribution Free Procedure for the (Q, R) Inventory Model, Operations Research Letters 11, 55–60, 1992 (the source of inequality (18)).
  • Y. Feng, G. Gallego, Optimal Starting Times for End-of-Season Sales and Optimal Stopping Times for Promotional Fares, Management Science 41(8), 1995.
  • P. Brémaud, Point Processes and Queues: Martingale Dynamics, Springer-Verlag, New York, 1980 (as cited in the source).
11 thms2 active usersReviewed
🏆Completed
Convex OptimizationLinear OptimizationOperations Research·Captain: mikedeng1

Constructing Uncertainty Sets for Robust Linear Optimization 3: The Largest Centrally Symmetric Distortion Inner Approximation of a Polytope Solves a Linear ProgramResearch Paper

Motivation

A robust linear constraint a′x≥ba'x \ge ba′x≥b for all a∈Ua \in \mathcal Ua∈U protects a decision xxx against every realization of the data aaa in an uncertainty set U\mathcal UU. Robust optimization took this form in the work of Ben-Tal and Nemirovski (Math. Oper. Res. 1998; Oper. Res. Lett. 1999), where U\mathcal UU is chosen by the modeller. Bertsimas and Brown (Oper. Res. 2009) tie the choice of U\mathcal UU to the decision maker's attitude towards risk: on a finite sample A={a1,…,aN}\mathcal A = \{a_1,\dots,a_N\}A={a1​,…,aN​}, a coherent risk measure constraint μ(a~′x−b)≤0\mu(\tilde a'x - b) \le 0μ(a~′x−b)≤0 is equivalent to a robust constraint over a convex set built from A\mathcal AA, and for the distortion risk measures (the law-invariant, comonotone coherent measures, which include CVaR) that set is a polytope of a special kind, a permutohull.

An uncertainty set in practice is often an arbitrary polyhedron, given by the modeller or by previous analysis. Section 4.5 of the paper asks which distortion risk measure best approximates such a polyhedron from inside: the largest permutohull of a given shape contained in it. A positive answer quantifies how conservative a given polyhedral uncertainty set is relative to a distortion risk measure, and gives the risk measure that is closest to it. This mission is the third of a series of three on the paper; the first establishes the permutohull representation of distortion risk constraints, the second the generators of the centrally symmetric distortion measures.

Setting

Fix N≥1N \ge 1N≥1 and data a1,…,aN∈Rna_1,\dots,a_N \in \mathbb R^na1​,…,aN​∈Rn, the columns of a matrix AAA. Let eN∈RNe_N \in \mathbb R^NeN​∈RN have 1/N1/N1/N at each entry, so the sample mean is a^=AeN\hat a = Ae_Na^=AeN​.

  • The restricted simplex Δ^N\hat\Delta^NΔ^N is the set of probability vectors q∈RNq \in \mathbb R^Nq∈RN with q1≥⋯≥qNq_1 \ge \dots \ge q_Nq1​≥⋯≥qN​. Under the uniform probability on NNN points, the distortion risk measures are exactly the maps μq(X)=−∑iqix(i)\mu_q(X) = -\sum_i q_i x_{(i)}μq​(X)=−∑i​qi​x(i)​, q∈Δ^Nq \in \hat\Delta^Nq∈Δ^N, with x(1)≤⋯≤x(N)x_{(1)} \le \dots \le x_{(N)}x(1)​≤⋯≤x(N)​ the ordered values of XXX (Theorem 4.2 of the paper).
  • For q∈RNq \in \mathbb R^Nq∈RN, the qqq-permutohull is Πq(A)=conv⁡{∑iqσ(i)ai:σ∈SN}\Pi_q(\mathcal A) = \operatorname{conv}\{\sum_i q_{\sigma(i)} a_i : \sigma \in S_N\}Πq​(A)=conv{∑i​qσ(i)​ai​:σ∈SN​}. The robust constraint over Πq(A)\Pi_q(\mathcal A)Πq​(A) is the risk constraint for μq\mu_qμq​.
  • The symmetric restricted simplex Δ^symN\hat\Delta^N_{\mathrm{sym}}Δ^symN​ is the set of q∈Δ^Nq \in \hat\Delta^Nq∈Δ^N with q=2eN−qσq = 2e_N - q_\sigmaq=2eN​−qσ​ for some permutation σ\sigmaσ, where (qσ)i=qσ(i)(q_\sigma)_i = q_{\sigma(i)}(qσ​)i​=qσ(i)​. For these qqq the permutohull is centrally symmetric about a^\hat aa^.
  • With π~q(A)=Πq(A)−a^\tilde\pi_q(\mathcal A) = \Pi_q(\mathcal A) - \hat aπ~q​(A)=Πq​(A)−a^, the Minkowski functional
∥w∥q,A=inf⁡{α>0:w/α∈π~q(A)}\|w\|_{q,\mathcal A} = \inf\{\alpha > 0 : w/\alpha \in \tilde\pi_q(\mathcal A)\}∥w∥q,A​=inf{α>0:w/α∈π~q​(A)}

measures w=a−a^w = a - \hat aw=a−a^ against the shifted permutohull (12).

  • The polyhedron is U={a∈Rn:uk′a≥vk, k=1,…,m}\mathcal U = \{a \in \mathbb R^n : u_k'a \ge v_k,\ k = 1,\dots,m\}U={a∈Rn:uk′​a≥vk​, k=1,…,m} (14), with a^∈U\hat a \in \mathcal Ua^∈U.

The family of candidate inner approximations is obtained by mixing a fixed q^∈Δ^symN\hat q \in \hat\Delta^N_{\mathrm{sym}}q^​∈Δ^symN​ with the uniform generator: q=λq^+(1−λ)eNq = \lambda\hat q + (1-\lambda)e_Nq=λq^​+(1−λ)eN​, λ∈R\lambda \in \mathbb Rλ∈R.

Formalization targets

Goal: Theorem 4.5

Let λ∗\lambda^*λ∗ be the optimal value of the linear program

max⁡ λs.t.q=λq^+(1−λ)e/N,e′(sk+tk)≥vk ∀k,sk,i+tk,j≤(uk′aj) qi ∀i,j,k,(15)\max\ \lambda\quad\text{s.t.}\quad q = \lambda\hat q + (1-\lambda)e/N,\quad e'(s_k + t_k) \ge v_k\ \forall k,\quad s_{k,i} + t_{k,j} \le (u_k'a_j)\,q_i\ \forall i,j,k, \tag{15}max λs.t.q=λq^​+(1−λ)e/N,e′(sk​+tk​)≥vk​ ∀k,sk,i​+tk,j​≤(uk′​aj​)qi​ ∀i,j,k,(15)

in sk,tk,q∈RNs_k, t_k, q \in \mathbb R^Nsk​,tk​,q∈RN and λ∈R\lambda \in \mathbb Rλ∈R, and q∗=λ∗q^+(1−λ∗)eNq^* = \lambda^*\hat q + (1-\lambda^*)e_Nq∗=λ∗q^​+(1−λ∗)eN​. Then

Πq∗(A)⊆U,Πλq^+(1−λ)eN(A)⊆U  ⟹  Πλq^+(1−λ)eN(A)⊆Πq∗(A),\Pi_{q^*}(\mathcal A) \subseteq \mathcal U,\qquad \Pi_{\lambda\hat q + (1-\lambda)e_N}(\mathcal A) \subseteq \mathcal U \implies \Pi_{\lambda\hat q + (1-\lambda)e_N}(\mathcal A) \subseteq \Pi_{q^*}(\mathcal A),Πq∗​(A)⊆U,Πλq^​+(1−λ)eN​​(A)⊆U⟹Πλq^​+(1−λ)eN​​(A)⊆Πq∗​(A),

and, when q^≠eN\hat q \ne e_Nq^​=eN​, q∗∈Δ^Nq^* \in \hat\Delta^Nq∗∈Δ^N if and only if

λ∗≤11−Nq^min⁡.(16)\lambda^* \le \frac{1}{1 - N\hat q_{\min}}. \tag{16}λ∗≤1−Nq^​min​1​.(16)

Milestones

  1. Proposition 4.2: for q∈Δ^symNq \in \hat\Delta^N_{\mathrm{sym}}q∈Δ^symN​ with Πq(A)\Pi_q(\mathcal A)Πq​(A) of nonempty interior, ∥⋅∥q,A\|\cdot\|_{q,\mathcal A}∥⋅∥q,A​ is a norm.
  2. Scaling (proof of Lemma 4.2): Πλq+(1−λ)eN(A)=a^+λ π~q(A)\Pi_{\lambda q + (1-\lambda)e_N}(\mathcal A) = \hat a + \lambda\,\tilde\pi_q(\mathcal A)Πλq+(1−λ)eN​​(A)=a^+λπ~q​(A) for every q∈RNq \in \mathbb R^Nq∈RN, λ∈R\lambda \in \mathbb Rλ∈R.
  3. Lemma 4.2: ∥a−a^∥λq+(1−λ)eN,A=1∣λ∣∥a−a^∥q,A\|a - \hat a\|_{\lambda q + (1-\lambda)e_N,\mathcal A} = \frac{1}{|\lambda|}\|a - \hat a\|_{q,\mathcal A}∥a−a^∥λq+(1−λ)eN​,A​=∣λ∣1​∥a−a^∥q,A​ for q∈Δ^symNq \in \hat\Delta^N_{\mathrm{sym}}q∈Δ^symN​, λ≠0\lambda \ne 0λ=0.
  4. Containment as linear constraints (proof of Theorem 4.5): Πq(A)⊆U\Pi_q(\mathcal A) \subseteq \mathcal UΠq​(A)⊆U iff vectors sk,tks_k, t_ksk​,tk​ satisfying the constraints of (15) exist, for every q∈RNq \in \mathbb R^Nq∈RN.
  5. Nonnegativity (proof of Theorem 4.5): for λ≥0\lambda \ge 0λ≥0 and Nq^min⁡<1N\hat q_{\min} < 1Nq^​min​<1, λq^+(1−λ)eN∈Δ^N\lambda\hat q + (1-\lambda)e_N \in \hat\Delta^Nλq^​+(1−λ)eN​∈Δ^N iff λ≤1/(1−Nq^min⁡)\lambda \le 1/(1 - N\hat q_{\min})λ≤1/(1−Nq^​min​).

Significance

The theorem reduces a geometric question — the largest member of a one-parameter family of centrally symmetric polytopes, each with N!N!N! potential vertices, that fits inside an arbitrary polyhedron — to a linear program with O(mN)O(mN)O(mN) variables and O(mN2)O(mN^2)O(mN2) constraints. Its solution identifies a distortion risk measure μ=λ∗μq^+(1−λ∗)E[−X]\mu = \lambda^*\mu_{\hat q} + (1-\lambda^*)\mathbb E[-X]μ=λ∗μq^​​+(1−λ∗)E[−X], which the paper reads as a mean–deviation measure in the style of a Sharpe ratio, and the bound (16) decides whether the optimal set is itself a distortion set or must be shrunk further.

The results are proved in the paper, with short proofs that pass over several points: the scaling identity is asserted, the duality step leaves the assignment-problem structure implicit, and the norm claim requires a nondegeneracy condition that the page does not state. No machine-checked proof of any of them is known. A formalization fixes the exact hypotheses (nonempty interior for the norm, λ≠0\lambda \ne 0λ=0 in (13), q^≠eN\hat q \ne e_Nq^​=eN​ in (16)), and the containment equivalence for arbitrary real weight vectors qqq is a reusable fact about permutohulls and assignment duality.

Difficulty

The goal combines three ingredients of different nature. The containment equivalence needs that minimizing a linear function over the permutohull is a linear program over the Birkhoff polytope of doubly stochastic matrices, followed by linear programming duality for that program; neither the Birkhoff–von Neumann theorem nor assignment duality is a one-line consequence of what is in Mathlib. The scaling identity is a statement about convex hulls under an affine map and holds for all real λ\lambdaλ, including the reflected case λ<0\lambda < 0λ<0; the maximality claim then needs the central symmetry of Πq^(A)\Pi_{\hat q}(\mathcal A)Πq^​​(A) about a^\hat aa^, which is a property of Δ^symN\hat\Delta^N_{\mathrm{sym}}Δ^symN​ (Proposition 4.1 of the paper) and not of a general qqq. The tempting shortcut — comparing gauges directly — fails at λ=0\lambda = 0λ=0, where the permutohull is the single point a^\hat aa^ and the gauge is degenerate.

Formalization scope

Vectors in RN\mathbb R^NRN and Rn\mathbb R^nRn are Fin N → ℝ and Fin n → ℝ, with 000-based indices; aia_iai​ is a i, uk′au_k'auk′​a is a dot product. Δ^N\hat\Delta^NΔ^N uses Mathlib's stdSimplex and Antitone. The permutohull is convexHull of the range over Equiv.Perm (Fin N), defined for every real qqq because (15) evaluates it at mixtures with possibly negative entries. The Minkowski functional is Mathlib's gauge, which takes the value 000 (not +∞+\infty+∞) on points no positive multiple of the set reaches; this is why Proposition 4.2 assumes Πq(A)\Pi_q(\mathcal A)Πq​(A) has nonempty interior and why the goal states "largest" as set containment. q^min⁡\hat q_{\min}q^​min​ is min⁡iq^i\min_i \hat q_imini​q^​i​. The optimal value λ∗\lambda^*λ∗ is a hypothesis (it is the greatest element of the feasible set of (15)), not a supremum defined by sSup.

Standing assumptions and disclosed additions: N≥1N \ge 1N≥1; the polyhedron (14) is not assumed bounded (a generalization); in (13) the right-hand norm is that of qqq, not q~\tilde qq~​ as printed, and λ≠0\lambda \ne 0λ=0; in (16), Nq^min⁡<1N\hat q_{\min} < 1Nq^​min​<1; "corresponds to a distortion risk measure" is read, as the proof reads it, as q∗∈Δ^Nq^* \in \hat\Delta^Nq∗∈Δ^N. A formalization that assumes Πq∗(A)⊆U\Pi_{q^*}(\mathcal A) \subseteq \mathcal UΠq∗​(A)⊆U or the maximality of λ∗\lambda^*λ∗ trivializes the theorem: both are conclusions, and the linear program enters only through its constraints and its optimal value.

A complete development needs: convex hulls under affine maps; the Birkhoff–von Neumann theorem (doubly stochastic matrices are convex combinations of permutation matrices); duality for the assignment linear program; gauge calculus for centrally symmetric convex bodies. The containment equivalence and the scaling identity are reusable beyond this mission. Proofs of any milestone, and of the Birkhoff and assignment-duality infrastructure, are welcome.

Selected references

  • D. Bertsimas and D. B. Brown, Constructing uncertainty sets for robust linear optimization, Operations Research 57(6):1483–1495, 2009. https://doi.org/10.1287/opre.1080.0646
  • A. Ben-Tal and A. Nemirovski, Robust convex optimization, Mathematics of Operations Research 23(4):769–805, 1998. https://doi.org/10.1287/moor.23.4.769
  • A. Ben-Tal and A. Nemirovski, Robust solutions of uncertain linear programs, Operations Research Letters 25(1):1–13, 1999. https://doi.org/10.1016/S0167-6377(99)00016-4
  • P. Artzner, F. Delbaen, J.-M. Eber and D. Heath, Coherent measures of risk, Mathematical Finance 9(3):203–228, 1999. https://doi.org/10.1111/1467-9965.00068
7 thms2 active usersReviewed
Control TheoryDynamic ProgrammingOperations Research+1·Captain: mikedeng1

Optimality of Affine Policies in Multistage Robust Optimization: In One-Dimensional Constrained Min-Max Control, Disturbance-Affine Policies with Affine Stage Costs Attain the Optimal ValueResearch Paper

Motivation

Multistage robust optimization chooses decisions over time while an adversary picks the uncertain data from a known set; every later decision may react to what has been observed. The exact problem is a nested min-max over functions of the past, and is intractable in general. The standard workaround, proposed by Ben-Tal, Goryashko, Guslitzer and Nemirovski (Math. Program. 2004), restricts every decision to an affine function of the observed disturbances. The restricted problem is a single convex (often linear) program, which is why disturbance-affine policies are used throughout robust control, inventory management and model predictive control. The price is suboptimality, and before this paper there was no nontrivial multistage problem in which that price was known to be zero.

Bertsimas, Iancu and Parrilo (arXiv:0904.3986, 2009; Math. Oper. Res. 35(2), 2010) proved that for one-dimensional linear dynamics with box constraints on controls and disturbances, linear control costs and convex state costs, disturbance-affine policies are exactly optimal. Their companion paper (Bertsimas & Goyal, Math. Program. 2012) shows how poorly affine policies can perform in other settings, so the one-dimensional result marks one side of the boundary between models where affine policies are exact and models where they are not.

Setting

Fix a horizon TTT and an initial state x1∈Rx_1\in\mathbb Rx1​∈R. For each stage k=1,…,Tk=1,\dots,Tk=1,…,T there are a per-unit control cost ck≥0c_k\ge0ck​≥0, control bounds Lk≤UkL_k\le U_kLk​≤Uk​, disturbance bounds w‾k≤w‾k\underline w_k\le\overline w_kw​k​≤wk​, and a state cost hk:R→Rh_k:\mathbb R\to\mathbb Rhk​:R→R that is convex and coercive. The state evolves as

xk+1=xk+uk+wk,uk∈[Lk,Uk],wk∈Wk=[w‾k,w‾k].x_{k+1}=x_k+u_k+w_k,\qquad u_k\in[L_k,U_k],\qquad w_k\in\mathcal W_k=[\underline w_k,\overline w_k].xk+1​=xk​+uk​+wk​,uk​∈[Lk​,Uk​],wk​∈Wk​=[w​k​,wk​].

The controller chooses uku_kuk​ after seeing xkx_kxk​; the adversary then chooses wkw_kwk​. The min-max value JmMJ_{mM}JmM​ is the value of the nested problem min⁡u1[c1u1+max⁡w1[h1(x2)+min⁡u2[⋯ ]]]\min_{u_1}[c_1u_1+\max_{w_1}[h_1(x_2)+\min_{u_2}[\cdots]]]minu1​​[c1​u1​+maxw1​​[h1​(x2​)+minu2​​[⋯]]], computed by the Bellman recursion with JT+1∗≡0J^*_{T+1}\equiv0JT+1∗​≡0:

gk(y)=max⁡w∈Wk[hk(y+w)+Jk+1∗(y+w)],Jk∗(x)=min⁡Lk≤u≤Uk[cku+gk(x+u)],JmM=J1∗(x1).g_k(y)=\max_{w\in\mathcal W_k}\big[h_k(y+w)+J^*_{k+1}(y+w)\big],\qquad J^*_k(x)=\min_{L_k\le u\le U_k}\big[c_ku+g_k(x+u)\big],\qquad J_{mM}=J^*_1(x_1).gk​(y)=w∈Wk​max​[hk​(y+w)+Jk+1∗​(y+w)],Jk∗​(x)=Lk​≤u≤Uk​min​[ck​u+gk​(x+u)],JmM​=J1∗​(x1​).

An affine control policy and an affine running cost at stage kkk are

qk(w)=qk,0+∑t=1k−1qk,twt,zk(w)=zk,0+∑t=1kzk,twt,q_k(w)=q_{k,0}+\sum_{t=1}^{k-1}q_{k,t}w_t,\qquad z_k(w)=z_{k,0}+\sum_{t=1}^{k}z_{k,t}w_t,qk​(w)=qk,0​+t=1∑k−1​qk,t​wt​,zk​(w)=zk,0​+t=1∑k​zk,t​wt​,

so qkq_kqk​ sees the disturbances before stage kkk and zkz_kzk​ those up to stage kkk. Under these policies the state after stage kkk is x1+∑t≤k(qt(w)+wt)x_1+\sum_{t\le k}(q_t(w)+w_t)x1​+∑t≤k​(qt​(w)+wt​).

Formalization targets

Goal: Theorem 3.1

There exist affine policies qkq_kqk​ and affine costs zkz_kzk​ such that, for every k=1,…,Tk=1,\dots,Tk=1,…,T,

Lk≤qk(w)≤Uk∀w∈W1×⋯×Wk−1,L_k\le q_k(w)\le U_k\quad\forall w\in\mathcal W_1\times\dots\times\mathcal W_{k-1},Lk​≤qk​(w)≤Uk​∀w∈W1​×⋯×Wk−1​, zk(w)≥hk(x1+∑t=1k(qt(w)+wt))∀w∈W1×⋯×Wk,z_k(w)\ge h_k\Big(x_1+\sum_{t=1}^k(q_t(w)+w_t)\Big)\quad\forall w\in\mathcal W_1\times\dots\times\mathcal W_k,zk​(w)≥hk​(x1​+t=1∑k​(qt​(w)+wt​))∀w∈W1​×⋯×Wk​, JmM=max⁡w1,…,wk[∑t=1k(ctqt(w)+zt(w))+Jk+1∗(x1+∑t=1k(qt(w)+wt))].J_{mM}=\max_{w_1,\dots,w_k}\Big[\sum_{t=1}^k\big(c_tq_t(w)+z_t(w)\big)+J^*_{k+1}\Big(x_1+\sum_{t=1}^k(q_t(w)+w_t)\Big)\Big].JmM​=w1​,…,wk​max​[t=1∑k​(ct​qt​(w)+zt​(w))+Jk+1∗​(x1​+t=1∑k​(qt​(w)+wt​))].

At k=Tk=Tk=T this says that affine policies are robustly feasible and attain the min-max value.

Milestones

  1. Lemma 7.1 (with (8)–(9), P2): Jk∗J^*_kJk∗​ and gkg_kgk​ are convex, and the optimal control is the clamp max⁡(Lk,min⁡(Uk,y∗−x))\max(L_k,\min(U_k,y^*-x))max(Lk​,min(Uk​,y∗−x)) for a minimizer y∗y^*y∗ of cky+gk(y)c_ky+g_k(y)ck​y+gk​(y).
  2. P3: the clamp is non-increasing and 1-Lipschitz.
  3. Lemma 4.1: the maximum of θ1+f(θ2)\theta_1+f(\theta_2)θ1​+f(θ2​), fff convex, over a planar zonogon Θ=π([0,1]k)\Theta=\pi([0,1]^k)Θ=π([0,1]k) is attained at one of the k+1k+1k+1 vertices on its right side.
  4. Corollary 4.1: the maximum of θ1+f(θ2)\theta_1+f(\theta_2)θ1​+f(θ2​) is unchanged when a polygon is replaced by its convex hull, its vertex set, its right side, or the zonogon hull of its vertices.
  5. Lemma 4.2: after the optimal control is applied, the worst case is reached on the right side of conv⁡{v~0,…,v~k}\operatorname{conv}\{\tilde v_0,\dots,\tilde v_k\}conv{v~0​,…,v~k​}.
  6. Lemma 4.4: the matching-and-alignment system (37) defining the affine controller is feasible, and its solutions satisfy −bi≤qi≤0-b_i\le q_i\le0−bi​≤qi​≤0 and L≤q(w)≤UL\le q(w)\le UL≤q(w)≤U.
  7. Lemma 4.8 and Lemma 4.9: the affine cost defined by system (51)–(53) dominates the convex cost, first at the hypercube vertices, then on the whole hypercube.

Significance

The theorem is one of the few exact optimality results for affine policies in multistage robust optimization. Combined with linear programming duality it has a computational corollary: when the hkh_khk​ are piecewise affine, an optimal policy for the full min-max problem is obtained from a single linear program (the affinely adjustable robust counterpart, p. 5), instead of a dynamic program over a continuous state. The construction also shows what is special about one dimension: the relevant uncertainty enters only through a planar zonogon, whose right side has at most k+1k+1k+1 vertices, matching the k+1k+1k+1 coefficients of an affine policy.

The result is proved in the literature, not formalized; no machine-checked proof of it, or of the zonogon lemmas it uses, is known. The formalization adds a checked proof of the main theorem and of the planar convexity facts (Lemma 4.1, Corollary 4.1) that are reusable for other zonotope arguments. It also closes the gaps the preprint leaves to the reader: Assumption 2 is removed by an infinitesimal perturbation argument, footnote 4 assumes a unique minimizer of cky+gk(y)c_ky+g_k(y)ck​y+gk​(y), and Lemma 4.3 is proved in one sub-case only.

Difficulty

Dynamic programming gives the optimal control as a function of the current state, uk∗(xk)u^*_k(x_k)uk∗​(xk​), which is piecewise affine in xkx_kxk​ with up to three pieces. Since xkx_kxk​ is affine in past disturbances, the obvious idea is to substitute; but the composition is piecewise affine, not affine, in the disturbances, and no single affine function reproduces it. An affine policy is necessarily suboptimal at some disturbance sequences. The theorem asserts only that it is never suboptimal at the worst case, and that the excess cost it causes can be absorbed into an affine cost zkz_kzk​ that still dominates hkh_khk​. Establishing this requires controlling where a convex objective is maximized over a zonogon, and showing that the affine controller and the affine cost can be chosen to reproduce exactly the right-side vertices that matter, at every stage, while staying feasible. A naive matching of all 2k2^k2k vertices of the disturbance box is overdetermined.

Formalization scope

Stages are indexed by Fin T (0-based). The model is the reduced form (DP) of §2, with dynamics coefficients equal to 1; the paper notes that this is without loss of generality. The standing hypotheses are those of Problem 1.1 (ck≥0c_k\ge0ck​≥0, hkh_khk​ convex and coercive) plus two disclosed additions, Lk≤UkL_k\le U_kLk​≤Uk​ and w‾k≤w‾k\underline w_k\le\overline w_kw​k​≤wk​: the page writes both as intervals but does not say they are nonempty. Jk∗J^*_kJk∗​ is defined by the Bellman recursion with sSup/sInf over images of nonempty compact intervals of continuous functions, so the values are attained maxima and minima. The max in (14) is stated with IsGreatest, which asserts attainment.

The goal carries none of the proof's normalizations (Assumptions 1–3 of p. 10, the unique minimizer of footnote 4). The milestones of §4 are stated in the paper's simplified notation: the unit hypercube, generators ordered as in (32) (cross-multiplied), the clamp form of the optimal control law (the printed (8) has misprinted thresholds), and, where the paper divides by bib_ibi​, the hypothesis bi>0b_i>0bi​>0. Lemma 4.4 takes Lemma 4.3's conclusions as hypotheses; Lemmas 4.8–4.9 take system (51)–(53) (with two misprints of (53) corrected) as hypotheses instead of "computed by Algorithm 2". Every fraction in a system is cross-multiplied.

Trivializing formalizations are ruled out. (14) uses a maximum over a nonempty box of a continuous function, with the true Jk+1∗J^*_{k+1}Jk+1∗​. The policies read only past disturbances (sums over t<kt<kt<k, resp. t≤kt\le kt≤k). JmMJ_{mM}JmM​ is the Bellman value over all state-feedback controls, not the value of the affine problem.

The development needs convexity of value functions under partial minimization and maximization, extreme points of planar polygons, and maxima of convex functions over polytopes. Contributions of independent planar-geometry lemmas are welcome, as are proofs of Lemma 4.3 (not stated here) and of the remaining construction lemmas 4.5–4.7.

Selected references

  • D. Bertsimas, D. A. Iancu, P. A. Parrilo, Optimality of Affine Policies in Multi-stage Robust Optimization, arXiv:0904.3986v1, 2009; Mathematics of Operations Research 35(2):363–394, 2010. https://arxiv.org/abs/0904.3986, https://doi.org/10.1287/moor.1100.0444
  • A. Ben-Tal, A. Goryashko, E. Guslitzer, A. Nemirovski, Adjustable robust solutions of uncertain linear programs, Mathematical Programming 99(2):351–376, 2004. https://doi.org/10.1007/s10107-003-0454-y
  • D. Bertsimas, V. Goyal, On the power and limitations of affine policies in two-stage adaptive optimization, Mathematical Programming 134(2):491–531, 2012. https://doi.org/10.1007/s10107-011-0444-4
  • G. M. Ziegler, Lectures on Polytopes, Springer GTM 152, 1995 (Chapter 7, zonotopes). https://doi.org/10.1007/978-1-4613-8431-1
11 thms2 active usersReviewed
🏆Completed
Linear OptimizationOperations ResearchOptimization·Captain: mikedeng1

On the Power and Limitations of Affine Policies in Two-Stage Adaptive Optimization III: The Best Affine Policy Can Cost More Than m^(1/2−δ)/4 Times the Fully Adaptable OptimumResearch Paper

Motivation

Two-stage adaptive optimization models decisions taken in two steps: a first-stage decision xxx is fixed before an uncertain right-hand side bbb is revealed, and a second-stage recourse y(b)y(b)y(b) is chosen afterwards, with the worst case over an uncertainty set U\mathcal UU to be minimized. The fully-adaptable problem, in which yyy may be an arbitrary function of bbb, is intractable in general. The standard tractable restriction, introduced by Ben-Tal, Goryashko, Guslitzer and Nemirovski (2004), requires yyy to be an affine policy y(b)=Pb+qy(b)=Pb+qy(b)=Pb+q; it turns the problem into a single convex program and is used throughout robust inventory, network design and energy planning.

How much is lost by this restriction? Bertsimas and Goyal (Math. Program. 2012) answer the question for problems with a nonnegative constraint matrix. On one side, affine policies are optimal when U\mathcal UU is a simplex, and are within a factor O(m)O(\sqrt m)O(m​) of the optimum on every instance of the class, where mmm is the number of constraints. On the other side, the bound is nearly tight: Section 4 of the paper constructs an instance on which the best affine policy costs Ω(m1/2−δ)\Omega(m^{1/2-\delta})Ω(m1/2−δ) times the fully-adaptable optimum, for any δ>0\delta>0δ>0. This mission formalizes that lower bound.

Timeline: Ben-Tal et al. (2004) propose affinely adjustable robust counterparts; Bertsimas, Iancu and Parrilo (2010) prove optimality of affine policies for one-dimensional multistage problems; Bertsimas and Goyal (2012) give the O(m)O(\sqrt m)O(m​) upper bound and the matching lower-bound example formalized here.

Setting

The two-stage problem ΠAdapt(U)\Pi_{\mathrm{Adapt}}(\mathcal U)ΠAdapt​(U) has data A∈Rm×n1A\in\mathbb R^{m\times n_1}A∈Rm×n1​, B∈Rm×n2B\in\mathbb R^{m\times n_2}B∈Rm×n2​, c∈R+n1c\in\mathbb R^{n_1}_+c∈R+n1​​, d∈R+n2d\in\mathbb R^{n_2}_+d∈R+n2​​ and U⊆R+m\mathcal U\subseteq\mathbb R^m_+U⊆R+m​:

zAdapt(U)=min⁡x, y(⋅) c⊤x+max⁡b∈Ud⊤y(b)s.t.Ax+By(b)≥b, x≥0, y(b)≥0  ∀b∈U.z_{\mathrm{Adapt}}(\mathcal U)=\min_{x,\,y(\cdot)}\ c^\top x+\max_{b\in\mathcal U}d^\top y(b)\quad\text{s.t.}\quad Ax+By(b)\ge b,\ x\ge0,\ y(b)\ge0\ \ \forall b\in\mathcal U .zAdapt​(U)=x,y(⋅)min​ c⊤x+b∈Umax​d⊤y(b)s.t.Ax+By(b)≥b, x≥0, y(b)≥0  ∀b∈U.

The value zAff(U)z_{\mathrm{Aff}}(\mathcal U)zAff​(U) is the same minimum over policies of the form y(b)=Pb+qy(b)=Pb+qy(b)=Pb+q; such a policy must be nonnegative on all of U\mathcal UU.

The large-gap instance I\mathcal II of display (19) has n1=n2=mn_1=n_2=mn1​=n2​=m, a parameter δ>0\delta>0δ>0 with mδ>200m^\delta>200mδ>200 (condition (18)), and

θ0=1m(1−δ)/2,r=⌈m1−δ⌉,\theta_0=\frac{1}{m^{(1-\delta)/2}},\qquad r=\lceil m^{1-\delta}\rceil,θ0​=m(1−δ)/21​,r=⌈m1−δ⌉, c=0,d=e=(1,…,1)⊤,A=0,Bij={1,i=j,θ0,i≠j,c=0,\quad d=e=(1,\dots,1)^\top,\quad A=0,\quad B_{ij}=\begin{cases}1,&i=j,\\ \theta_0,&i\ne j,\end{cases}c=0,d=e=(1,…,1)⊤,A=0,Bij​={1,θ0​,​i=j,i=j,​ U=conv⁡({0, e1,…,em, 1me}∪{θ01S: ∣S∣=r}),\mathcal U=\operatorname{conv}\Bigl(\{0,\ e_1,\dots,e_m,\ \tfrac{1}{\sqrt m}e\}\cup\{\theta_0\mathbf 1_S:\ |S|=r\}\Bigr),U=conv({0, e1​,…,em​, m​1​e}∪{θ0​1S​: ∣S∣=r}),

where eje_jej​ are the unit vectors and 1S\mathbf 1_S1S​ is the indicator vector of a set SSS of coordinates. A permutation σ\sigmaσ of the coordinates acts on vectors by bσ=(bσ(1),…,bσ(m))b^\sigma=(b_{\sigma(1)},\dots,b_{\sigma(m)})bσ=(bσ(1)​,…,bσ(m)​) and on matrices by Pijσ=Pσ(i),σ(j)P^\sigma_{ij}=P_{\sigma(i),\sigma(j)}Pijσ​=Pσ(i),σ(j)​.

Formalization targets

Goal: Theorem 3, explicit form

zAff(U)>m1/2−δ4⋅zAdapt(U)for all δ>0 and m with mδ>200.z_{\mathrm{Aff}}(\mathcal U)>\frac{m^{1/2-\delta}}{4}\cdot z_{\mathrm{Adapt}}(\mathcal U)\qquad\text{for all }\delta>0\text{ and }m\text{ with }m^\delta>200 .zAff​(U)>4m1/2−δ​⋅zAdapt​(U)for all δ>0 and m with mδ>200.

The paper writes zAff(U)=Ω(m1/2−δ)⋅zAdapt(U)z_{\mathrm{Aff}}(\mathcal U)=\Omega(m^{1/2-\delta})\cdot z_{\mathrm{Adapt}}(\mathcal U)zAff​(U)=Ω(m1/2−δ)⋅zAdapt​(U); the constant 1/41/41/4 is the one the proof establishes, so the explicit statement is the stronger one.

Milestones

  1. Lemma 4: zAdapt(U)≤1z_{\mathrm{Adapt}}(\mathcal U)\le1zAdapt​(U)≤1, with a feasible solution attaining cost at most 111.
  2. Lemma 5: U\mathcal UU is permutation-invariant under every σ∈Sm\sigma\in S^mσ∈Sm.
  3. Lemma 6: the permuted instance I(σ)\mathcal I(\sigma)I(σ) of (22) equals I\mathcal II.
  4. Lemma 7: if y(b)=Pb+qy(b)=Pb+qy(b)=Pb+q is an optimal affine solution, so is yσ(b)=Pσb+qσy^\sigma(b)=P^\sigma b+q^\sigmayσ(b)=Pσb+qσ.
  5. Lemma 8: some optimal affine solution has P^ij=μ\hat P_{ij}=\muP^ij​=μ (i≠ji\ne ji=j), P^jj=θ\hat P_{jj}=\thetaP^jj​=θ, q^j=λ\hat q_j=\lambdaq^​j​=λ.
  6. The three Claims of the proof of Theorem 3: for a symmetric feasible affine policy with worst-case cost at most m1/2−δ/4m^{1/2-\delta}/4m1/2−δ/4, one has 0≤λ≤m−1/2−δ0\le\lambda\le m^{-1/2-\delta}0≤λ≤m−1/2−δ, θ≥1/3\theta\ge1/3θ≥1/3, and −m−1−δ/2≤μ<0-m^{-1-\delta/2}\le\mu<0−m−1−δ/2≤μ<0.

Significance

The result shows that the O(m)O(\sqrt m)O(m​) approximation guarantee for affine policies on problems with A≥0A\ge0A≥0 (Theorem 4 of the same paper) cannot be improved beyond a factor mδm^{\delta}mδ, so the uncertainty set that looks like a portion of the unit sphere in the nonnegative orthant is essentially the worst case for affine recourse. It also explains why later work moved to piecewise-affine and finitely adaptable policies to close the gap. The example satisfies c,d≥0c,d\ge0c,d≥0, A,B≥0A,B\ge0A,B≥0 and U⊆R+m\mathcal U\subseteq\mathbb R^m_+U⊆R+m​, so the lower bound applies to every larger problem class.

The theorem is proved in the paper; to our knowledge no machine-checked version exists. A formalization adds checked statements of the symmetrization argument (an optimal affine policy may be taken invariant under the symmetry group of the instance), which applies to any symmetric robust linear program, and a checked derivation of the explicit constant.

Difficulty

The upper bound zAdapt≤1z_{\mathrm{Adapt}}\le1zAdapt​≤1 is a direct construction. The difficulty lies in the lower bound on zAffz_{\mathrm{Aff}}zAff​, which must hold for every affine policy, a family with m2+mm^2+mm2+m free parameters. Bounding the cost of a policy at a few chosen points of U\mathcal UU does not suffice without first reducing the parameters, and the reduction requires that an optimal affine solution exists (attainment of the minimum over an unbounded parameter set) and that averaging over the symmetric group preserves both feasibility and optimality. The remaining argument balances three different generators of U\mathcal UU against each other, and the exponents of mmm must be tracked exactly through ceilings and real powers.

Formalization scope

Vectors are Fin m → ℝ with the componentwise order and 0-based indices; matrices are Matrix (Fin m) (Fin m) ℝ. The values zAdaptz_{\mathrm{Adapt}}zAdapt​ and zAffz_{\mathrm{Aff}}zAff​ are infima of the sets of worst-case cost bounds achieved by feasible solutions (epigraph form), so they do not rely on a supremum of a possibly unbounded function. Affine policies must be nonnegative on U\mathcal UU. Optimal solutions are defined as feasible solutions whose worst-case cost is bounded by every achievable bound, so Lemma 8 asserts attainment. Powers mam^{a}ma are real powers; θ0=1/m(1−δ)/2\theta_0=1/m^{(1-\delta)/2}θ0​=1/m(1−δ)/2 and r=⌈m1−δ⌉r=\lceil m^{1-\delta}\rceilr=⌈m1−δ⌉ exactly as on the page. U\mathcal UU is the convex hull of its listed generators; the generator count NNN printed in (19) plays no role.

The parameter δ\deltaδ is not restricted beyond δ>0\delta>0δ>0 and mδ>200m^\delta>200mδ>200, as in the paper. Lemma 4's proof on the page uses δ≤1\delta\le1δ≤1; the statement is kept for all δ>0\delta>0δ>0, where it remains true with a different witness. The Claims are stated for any symmetric feasible affine policy with cost at most m1/2−δ/4m^{1/2-\delta}/4m1/2−δ/4; their hypotheses are jointly unsatisfiable by Theorem 3, which is inherent in steps of a proof by contradiction.

A trivializing formalization is excluded: the goal mentions only the instance data and the two optimal values, not the symmetric parameters μ,θ,λ\mu,\theta,\lambdaμ,θ,λ, and the nonemptiness of the feasible sets is established by Lemma 4 and by the existence of a feasible affine policy, so neither value is a junk infimum of an empty set.

A complete development needs: convex hulls of finite point sets in Rm\mathbb R^mRm and their extreme points; the action of SmS^mSm by coordinate permutation; averaging over the finite group SmS^mSm; and existence of minimizers for linear programs over a polytope. The symmetrization lemmas (5–8) are reusable for other symmetric robust problems. Proofs of any milestone, including partial infrastructure for linear-programming attainment, are welcome.

Selected references

  • D. Bertsimas, V. Goyal, On the power and limitations of affine policies in two-stage adaptive optimization, Mathematical Programming Ser. A 134 (2012) 491–531. https://doi.org/10.1007/s10107-011-0444-4
  • A. Ben-Tal, A. Goryashko, E. Guslitzer, A. Nemirovski, Adjustable robust solutions of uncertain linear programs, Mathematical Programming 99 (2004) 351–376. https://doi.org/10.1007/s10107-003-0454-y
  • D. Bertsimas, D. A. Iancu, P. A. Parrilo, Optimality of affine policies in multistage robust optimization, Mathematics of Operations Research 35 (2010) 363–394. https://doi.org/10.1287/moor.1100.0444
12 thms2 active usersReviewed
🏆Completed
Linear OptimizationOperations ResearchOptimization·Captain: mikedeng1

On the Power and Limitations of Affine Policies in Two-Stage Adaptive Optimization V: The Optimal First Stage over a Dominating Simplex Is a 4√m-ApproximationResearch Paper

Motivation

Two-stage adaptive optimization models decisions taken in two steps: a first-stage decision xxx is fixed before an uncertain right-hand side bbb is revealed, and a second-stage decision y(b)y(b)y(b) is chosen afterwards, with the worst case over an uncertainty set U\mathcal UU to be minimized. Problems of this form arise in capacity planning, network design and inventory control, where the first stage is an investment and the second stage a recourse. Computing the fully adaptable optimum is hard in general, so tractable restrictions are used in practice, most prominently affine policies y(b)=Pb+qy(b)=Pb+qy(b)=Pb+q (Ben-Tal, Goryashko, Guslitzer, Nemirovski, Math. Program. 2004).

Bertsimas and Goyal (Math. Program. Ser. A, DOI 10.1007/s10107-011-0444-4) characterize how well affine policies perform. Their Section 5 shows a factor O(m)O(\sqrt m)O(m​) when the first-stage matrix satisfies A≥0A\ge 0A≥0. Section 6, the subject of this mission, drops the sign condition on AAA: it constructs, from U\mathcal UU, a polytope U0\mathcal U^0U0 with at most m+1m+1m+1 vertices that dominates U\mathcal UU, and shows that an optimal first stage for U0\mathcal U^0U0 is a 4m4\sqrt m4m​-approximate first stage for the original problem.

Timeline. Ben-Tal et al. (2004) introduced affinely adjustable robust counterparts. Bertsimas, Iancu and Parrilo (Math. Oper. Res. 2010) proved optimality of affine policies for one-dimensional multistage problems. Bertsimas and Goyal (Math. Oper. Res. 2010) analysed static robust solutions for two-stage problems. The present paper (received 2009, published 2011) gives the Θ(m1/2)\Theta(m^{1/2})Θ(m1/2) picture for affine policies and the general-case first-stage approximation formalized here.

Setting

Fix matrices A∈Rm×n1A\in\mathbb R^{m\times n_1}A∈Rm×n1​, B∈Rm×n2B\in\mathbb R^{m\times n_2}B∈Rm×n2​ and cost vectors c∈R+n1c\in\mathbb R^{n_1}_+c∈R+n1​​, d∈R+n2d\in\mathbb R^{n_2}_+d∈R+n2​​. The uncertainty set U⊆R+m\mathcal U\subseteq\mathbb R^m_+U⊆R+m​ is convex, compact and full-dimensional. A feasible solution of ΠAdapt(U)\Pi_{Adapt}(\mathcal U)ΠAdapt​(U) is a pair (x,y)(x,y)(x,y) with x≥0x\ge0x≥0 and, for every b∈Ub\in\mathcal Ub∈U, y(b)≥0y(b)\ge0y(b)≥0 and Ax+By(b)≥bAx+By(b)\ge bAx+By(b)≥b, componentwise. Its worst-case cost is sup⁡b∈U cTx+dTy(b)\sup_{b\in\mathcal U}\, c^Tx+d^Ty(b)supb∈U​cTx+dTy(b), and the fully adaptable optimum is

zAdapt(U)=inf⁡(x,y) feasible sup⁡b∈U cTx+dTy(b).z_{Adapt}(\mathcal U)=\inf_{(x,y)\ \text{feasible}}\ \sup_{b\in\mathcal U}\ c^Tx+d^Ty(b).zAdapt​(U)=(x,y) feasibleinf​ b∈Usup​ cTx+dTy(b).

An optimal solution attains this value.

For j=1,…,mj=1,\dots,mj=1,…,m let μj=max⁡{bj:b∈U}\mu_j=\max\{b_j: b\in\mathcal U\}μj​=max{bj​:b∈U} and let βj∈U\beta^j\in\mathcal Uβj∈U be a maximizer, βjj=μj\beta^j_j=\mu_jβjj​=μj​ (display (38)). Algorithm A\mathcal AA (Fig. 1 of the paper) starts with the index set J1={1,…,m}J_1=\{1,\dots,m\}J1​={1,…,m}; while some b∈Ub\in\mathcal Ub∈U has ∑j∈J1bj/μj>m\sum_{j\in J_1}b_j/\mu_j>\sqrt m∑j∈J1​​bj​/μj​>m​, it picks a maximizer uku^kuk of that scaled sum over U\mathcal UU, adds uku^kuk to a running total on the coordinates of J1J_1J1​, and removes from J1J_1J1​ every coordinate whose total has reached μj\mu_jμj​. It stops after KKK iterations and returns β=u1+⋯+uK\beta=u^1+\dots+u^Kβ=u1+⋯+uK. The dominating set is

U0=conv⁡{2m⋅β1,…,2m⋅βm, 2β}.(66)\mathcal U^0=\operatorname{conv}\{2\sqrt m\cdot\beta^1,\dots,2\sqrt m\cdot\beta^m,\ 2\beta\}.\tag{66}U0=conv{2m​⋅β1,…,2m​⋅βm, 2β}.(66)

Formalization targets

Goal: Theorem 6

For every run of Algorithm A\mathcal AA, every choice of the maximizers βj\beta^jβj, and every optimal solution (x~,y~)(\tilde x,\tilde y)(x~,y~​) of ΠAdapt(U0)\Pi_{Adapt}(\mathcal U^0)ΠAdapt​(U0),

∀b∈U  ∃y≥0:Ax~+By≥b,cTx~+dTy≤4m⋅zAdapt(U).\forall b\in\mathcal U\ \ \exists y\ge 0:\quad A\tilde x+By\ge b,\qquad c^T\tilde x+d^Ty\le 4\sqrt m\cdot z_{Adapt}(\mathcal U).∀b∈U  ∃y≥0:Ax~+By≥b,cTx~+dTy≤4m​⋅zAdapt​(U).

The page states the factor as O(m)O(\sqrt m)O(m​); 4m4\sqrt m4m​ is the constant its proof establishes.

Milestones

  1. Lemma 12. U0\mathcal U^0U0 dominates U\mathcal UU: every b∈Ub\in\mathcal Ub∈U has some b′∈U0b'\in\mathcal U^0b′∈U0 with b≤b′b\le b'b≤b′.
  2. Lemma 13 (inequality). ΠAdapt(U0)\Pi_{Adapt}(\mathcal U^0)ΠAdapt​(U0) is feasible with finite worst-case cost, and
zAdapt(U0)≤4m⋅zAdapt(U).z_{Adapt}(\mathcal U^0)\le 4\sqrt m\cdot z_{Adapt}(\mathcal U).zAdapt​(U0)≤4m​⋅zAdapt​(U).
  1. The domination claim in the proof of Theorem 6. If VVV dominates WWW and (x~,y~)(\tilde x,\tilde y)(x~,y~​) is optimal for ΠAdapt(V)\Pi_{Adapt}(V)ΠAdapt​(V) with finite worst-case cost, then every b∈Wb\in Wb∈W can be served from x~\tilde xx~ at cost at most zAdapt(V)z_{Adapt}(V)zAdapt​(V).

Significance

The result gives a first-stage decision with a guarantee of order m\sqrt mm​ for two-stage problems with an arbitrary first-stage matrix, a setting where the affine-policy analysis of Section 5 does not apply. The decision is obtained from a problem whose uncertainty set has at most m+1m+1m+1 extreme points, so it reduces an adaptive problem over a general convex set to one over a polytope with few vertices. Together with the paper's lower bounds (Theorems 2 and 3, Ω(m1/2−δ)\Omega(m^{1/2-\delta})Ω(m1/2−δ) for affine policies), it places the general-case approximability of the first stage at the same order as the affine-policy gap.

The result is proved in the paper. It has no machine-checked proof that we know of. The formalization produces, beyond the theorem itself, an encoding of model (1) with values that are honest infima, a relational encoding of Algorithm A\mathcal AA usable for its termination and output properties, and a reusable domination lemma for two-stage problems. Mission IV of this series (the case A≥0A\ge0A≥0) formalizes Lemmas 9 and 10 on Algorithm A\mathcal AA, which the proofs here use.

Difficulty

The obvious argument replaces U\mathcal UU by a simple set that contains or dominates it, such as the box ∏j[0,μj]\prod_j[0,\mu_j]∏j​[0,μj​], and solves over that set. This loses a factor mmm, not m\sqrt mm​: for U=conv⁡{0,e1,…,em}\mathcal U=\operatorname{conv}\{0,e_1,\dots,e_m\}U=conv{0,e1​,…,em​} with A=0A=0A=0, B=IB=IB=I, c=0c=0c=0, d=ed=ed=e, the optimum over U\mathcal UU is 111 while the optimum over the box is mmm. A dominating set with few vertices whose cost is only O(m)O(\sqrt m)O(m​) times the original optimum has to be built from U\mathcal UU itself, and controlling the cost of its vertex 2β2\beta2β depends on the number KKK of iterations of Algorithm A\mathcal AA, which is bounded only through the potential argument of Lemma 10 in the paper.

A second difficulty is that zAdaptz_{Adapt}zAdapt​ is an infimum, not an attained minimum, over second-stage rules that are arbitrary functions; the cost comparison must work from near-optimal solutions of ΠAdapt(U)\Pi_{Adapt}(\mathcal U)ΠAdapt​(U).

Formalization scope

Vectors are functions on Fin m, matrices are Matrix (Fin m) (Fin n) ℝ, and inequalities between vectors are componentwise. The paper's coordinate jjj is Fin index j−1j-1j−1. zAdapt(U)z_{Adapt}(\mathcal U)zAdapt​(U) is the infimum of the set of bounds ttt such that some feasible (x,y)(x,y)(x,y) satisfies cTx+dTy(b)≤tc^Tx+d^Ty(b)\le tcTx+dTy(b)≤t for all b∈Ub\in\mathcal Ub∈U; this avoids a real supremum of a possibly unbounded worst case. An optimal solution is a feasible one that achieves every achievable bound. μ\muμ and the maximizers βj\beta^jβj enter the theorems as data with their defining properties. Algorithm A\mathcal AA is a relation on a choice sequence u1,u2,…u^1,u^2,\dotsu1,u2,…: the theorems hold for every run and every choice of maximizers, never for "some simplex dominating U\mathcal UU".

Standing assumptions of (1) carried by the goal and Lemma 13: c≥0c\ge0c≥0, d≥0d\ge0d≥0, U⊆R+m\mathcal U\subseteq\mathbb R^m_+U⊆R+m​ convex, compact and with nonempty interior, and (1) feasible. There is no sign condition on AAA. Lemma 12 keeps only nonnegativity and full-dimensionality of U\mathcal UU; the domination claim is stated for arbitrary scenario sets VVV and WWW with VVV dominating WWW and assumes that the optimal solution over VVV has a finite worst-case cost.

The printed Lemma 13 also asserts zAff(U0)=zAdapt(U0)z_{Aff}(\mathcal U^0)=z_{Adapt}(\mathcal U^0)zAff​(U0)=zAdapt​(U0) on the grounds that U0\mathcal U^0U0 is a simplex. Its m+1m+1m+1 generators need not be affinely independent, so this equality is not part of the mission; Theorem 6 does not use it.

A bound on zAdapt(U0)z_{Adapt}(\mathcal U^0)zAdapt​(U0) alone is not the goal: the goal requires, for each scenario of the original set U\mathcal UU, a feasible second stage completing the fixed first stage x~\tilde xx~ at the stated cost. Lemma 13 also asserts feasibility over U0\mathcal U^0U0 with a finite bound, so its inequality cannot hold through the value of an infimum over an empty set.

A complete development needs elementary facts about convex hulls of finitely many points (representation by convex weights), the properties of Algorithm A\mathcal AA (its output bound and termination, Lemmas 9 and 10 of the paper), and ε\varepsilonε-approximation arguments for infima. The encoding of model (1) and of Algorithm A\mathcal AA is shared with the other missions of this series. Contributions of these supporting lemmas are welcome.

Selected references

  • D. Bertsimas, V. Goyal, On the power and limitations of affine policies in two-stage adaptive optimization, Math. Program. Ser. A, 2011. https://doi.org/10.1007/s10107-011-0444-4
  • A. Ben-Tal, A. Goryashko, E. Guslitzer, A. Nemirovski, Adjustable robust solutions of uncertain linear programs, Math. Program. 99, 2004. https://doi.org/10.1007/s10107-003-0454-y
  • D. Bertsimas, D. A. Iancu, P. A. Parrilo, Optimality of affine policies in multistage robust optimization, Math. Oper. Res. 35, 2010. https://doi.org/10.1287/moor.1100.0444
  • D. Bertsimas, V. Goyal, On the power of robust solutions in two-stage stochastic and adaptive optimization problems, Math. Oper. Res. 35, 2010. https://doi.org/10.1287/moor.1090.0440
7 thms2 active usersReviewed
🏆Completed
Convex OptimizationOperations ResearchProbability·Captain: mikedeng1

Data-Driven Robust Optimization I: An Uncertainty Set Whose Support Function Dominates Value at Risk Implies a Probabilistic Guarantee for Every Concave ConstraintResearch Paper

Motivation

Robust optimization replaces an uncertain constraint f(u~,x)≤0f(\tilde{\mathbf u},\mathbf x)\le 0f(u~,x)≤0, whose parameter u~∈Rd\tilde{\mathbf u}\in\mathbb R^du~∈Rd is random, by the requirement that the constraint hold for every u\mathbf uu in a chosen uncertainty set U\mathcal UU:

f(u,x)≤0∀ u∈U.f(\mathbf u,\mathbf x)\le 0\qquad\forall\,\mathbf u\in\mathcal U .f(u,x)≤0∀u∈U.

The resulting problem is deterministic and, for many shapes of U\mathcal UU, tractable (Ben-Tal, El Ghaoui and Nemirovski, Robust Optimization, 2009). The modelling question it leaves open is how to choose U\mathcal UU. A set that is too large makes every solution conservative; a set that is too small gives no protection. The practitioner's real requirement is usually probabilistic: a robust feasible x\mathbf xx should violate the uncertain constraint with probability at most ϵ\epsilonϵ.

Bertsimas, Gupta and Kallus (Data-Driven Robust Optimization, arXiv:1401.0212v2, 2014; Math. Program. 167, 2018) build uncertainty sets directly from data so that this requirement holds with high confidence. Their whole construction rests on one characterization, Theorem 1 of the paper, of when a set carries such a guarantee. This mission formalizes that characterization and the two results (Theorems 2 and 3) that turn it into a data-driven recipe.

Earlier work used the "if" direction of the characterization for bi-affine constraints when designing sets for specific distributional assumptions (Ben-Tal et al., 2009; Chen, Sim and Sun, Oper. Res. 55, 2007). The extension to every constraint concave in u\mathbf uu is due to Bertsimas, Gupta and Kallus.

Setting

Let P\mathbb PP be a probability measure on Rd\mathbb R^dRd, the law of u~\tilde{\mathbf u}u~, and fix a level 0<ϵ<10<\epsilon<10<ϵ<1. Throughout, f(u,x)f(\mathbf u,\mathbf x)f(u,x) is concave in u\mathbf uu for every value of the decision variable x∈Rk\mathbf x\in\mathbb R^kx∈Rk.

The support function of a set U⊆Rd\mathcal U\subseteq\mathbb R^dU⊆Rd is

δ∗(v∣U)=sup⁡u∈UvTu,v∈Rd.\delta^*(\mathbf v\mid\mathcal U)=\sup_{\mathbf u\in\mathcal U}\mathbf v^T\mathbf u,\qquad\mathbf v\in\mathbb R^d .δ∗(v∣U)=u∈Usup​vTu,v∈Rd.

The Value at Risk of the linear loss u~Tv\tilde{\mathbf u}^T\mathbf vu~Tv at level ϵ\epsilonϵ is

VaRϵP(v)=inf⁡{t: P(u~Tv≤t)≥1−ϵ}.\mathrm{VaR}^{\mathbb P}_\epsilon(\mathbf v)=\inf\{t:\ \mathbb P(\tilde{\mathbf u}^T\mathbf v\le t)\ge 1-\epsilon\}.VaRϵP​(v)=inf{t: P(u~Tv≤t)≥1−ϵ}.

A set U\mathcal UU implies a probabilistic guarantee at level ϵ\epsilonϵ for P\mathbb PP (property (P2) of the paper) if for every kkk, every f(u,x)f(\mathbf u,\mathbf x)f(u,x) concave in u\mathbf uu for each x∈Rk\mathbf x\in\mathbb R^kx∈Rk, and every x∗∈Rk\mathbf x^*\in\mathbb R^kx∗∈Rk,

f(u,x∗)≤0  ∀u∈U⟹P(f(u~,x∗)≤0)≥1−ϵ.(2)f(\mathbf u,\mathbf x^*)\le0\ \ \forall\mathbf u\in\mathcal U\quad\Longrightarrow\quad\mathbb P\big(f(\tilde{\mathbf u},\mathbf x^*)\le0\big)\ge1-\epsilon. \tag{2}f(u,x∗)≤0  ∀u∈U⟹P(f(u~,x∗)≤0)≥1−ϵ.(2)

A function is bi-affine if it has the form f(u,x)=uTFx+fuTu+fxTx+f0f(\mathbf u,\mathbf x)=\mathbf u^TF\mathbf x+\mathbf f_u^T\mathbf u+\mathbf f_x^T\mathbf x+f_0f(u,x)=uTFx+fuT​u+fxT​x+f0​.

In the data-driven setting, P∗\mathbb P^*P∗ is unknown and a sample S=(u^1,…,u^N)\mathcal S=(\hat{\mathbf u}^1,\dots,\hat{\mathbf u}^N)S=(u^1,…,u^N) is drawn i.i.d. from it. The paper's schema fixes 0<α<10<\alpha<10<α<1, takes the confidence region P(S)\mathcal P(\mathcal S)P(S) of a hypothesis test at level α\alphaα, and builds a closed convex set U(S)\mathcal U(\mathcal S)U(S) whose support function bounds VaRϵP(v)\mathrm{VaR}^{\mathbb P}_\epsilon(\mathbf v)VaRϵP​(v) for every P∈P(S)\mathbb P\in\mathcal P(\mathcal S)P∈P(S) and every v\mathbf vv.

Formalization targets

Goal: Theorem 1

(a) If U\mathcal UU is nonempty, convex and compact and

δ∗(v∣U)≥VaRϵP(v)∀ v∈Rd,\delta^*(\mathbf v\mid\mathcal U)\ge\mathrm{VaR}^{\mathbb P}_\epsilon(\mathbf v)\qquad\forall\,\mathbf v\in\mathbb R^d,δ∗(v∣U)≥VaRϵP​(v)∀v∈Rd,

then U\mathcal UU implies a probabilistic guarantee at level ϵ\epsilonϵ for P\mathbb PP.

(b) If U\mathcal UU is nonempty and δ∗(v∣U)<VaRϵP(v)\delta^*(\mathbf v\mid\mathcal U)<\mathrm{VaR}^{\mathbb P}_\epsilon(\mathbf v)δ∗(v∣U)<VaRϵP​(v) for some v\mathbf vv at which δ∗(v∣U)\delta^*(\mathbf v\mid\mathcal U)δ∗(v∣U) is finite, then some bi-affine fff violates (2).

Milestones toward the goal

The proof in the electronic companion (EC.1.1) is a short chain, and its steps are the milestones: the attainment property of VaR, P(u~Tv>VaRϵP(v))≤ϵ\mathbb P(\tilde{\mathbf u}^T\mathbf v>\mathrm{VaR}^{\mathbb P}_\epsilon(\mathbf v))\le\epsilonP(u~Tv>VaRϵP​(v))≤ϵ (already proved on the platform); a strict separating hyperplane between U\mathcal UU and the superlevel set {f(⋅,x∗)≥t}\{f(\cdot,\mathbf x^*)\ge t\}{f(⋅,x∗)≥t}; the bound P(f(u~,x∗)≥t)≤ϵ\mathbb P(f(\tilde{\mathbf u},\mathbf x^*)\ge t)\le\epsilonP(f(u~,x∗)≥t)≤ϵ for t>0t>0t>0; its limit P(f(u~,x∗)>0)≤ϵ\mathbb P(f(\tilde{\mathbf u},\mathbf x^*)>0)\le\epsilonP(f(u~,x∗)>0)≤ϵ; and, for part (b), the witness f(u,x)=vTu−xf(\mathbf u,x)=\mathbf v^T\mathbf u-xf(u,x)=vTu−x at x∗=δ∗(v∣U)x^*=\delta^*(\mathbf v\mid\mathcal U)x∗=δ∗(v∣U).

Companions: Theorems 2 and 3

Theorem 2: with probability at least 1−α1-\alpha1−α over the sample, U(S)\mathcal U(\mathcal S)U(S) implies a probabilistic guarantee at level ϵ\epsilonϵ for P∗\mathbb P^*P∗. Theorem 3: if the region does not depend on ϵ\epsilonϵ, then with probability at least 1−α1-\alpha1−α the whole family {U(S,ϵ):0<ϵ<1}\{\mathcal U(\mathcal S,\epsilon):0<\epsilon<1\}{U(S,ϵ):0<ϵ<1} implies the guarantee simultaneously (a), and every x\mathbf xx satisfying the level-optimized constraints (9) satisfies the joint chance constraint

P∗(max⁡j=1,…,mfj(u~,x)≤0)≥1−ϵˉ(7)\mathbb P^*\Big(\max_{j=1,\dots,m}f_j(\tilde{\mathbf u},\mathbf x)\le0\Big)\ge1-\bar\epsilon \tag{7}P∗(j=1,…,mmax​fj​(u~,x)≤0)≥1−ϵˉ(7)

(b).

Significance

Theorem 1(a) is what certifies every uncertainty set in the paper: the χ2\chi^2χ2 and GGG sets for discrete distributions, the Kolmogorov–Smirnov and forward–backward sets for independent marginals, the marginal-sample box and the moment sets. Each construction reduces to proving one inequality between a support function and a Value at Risk, which is a statement about a single linear functional, and Theorem 1(a) lifts it to every concave constraint at once. Part (b) shows the condition cannot be dropped even for bi-affine constraints. Theorems 2 and 3 separate the statistical input (coverage of a confidence region) from the convex-analytic input (the support-function bound), and Theorem 3(b) is what allows the levels ϵj\epsilon_jϵj​ of a system of constraints to be optimized after seeing the data.

The results are proved in the paper. None of them has a machine-checked proof; the only formalized ingredient is the attainment property of VaR, which is on the platform as a proved theorem. The formalization provides a checked bridge from support-function bounds to probabilistic guarantees that the other missions of this series (II–VI) use to state their own results in the criterion form VaR≤δ∗\mathrm{VaR}\le\delta^*VaR≤δ∗.

Difficulty

The informal argument is short; the difficulty is in the infinite-dimensional bookkeeping that the page leaves implicit. The superlevel set {f(⋅,x∗)≥t}\{f(\cdot,\mathbf x^*)\ge t\}{f(⋅,x∗)≥t} need not be bounded, so the strict separation must use compactness of U\mathcal UU alone. Closedness of this set and measurability of {f(u~,x∗)≤0}\{f(\tilde{\mathbf u},\mathbf x^*)\le0\}{f(u~,x∗)≤0} depend on concave functions on Rd\mathbb R^dRd being continuous. The passage t↓0t\downarrow0t↓0 is continuity of a measure along an increasing union. The attainment of the infimum in the definition of VaR requires right-continuity of distribution functions. A naive attempt to separate U\mathcal UU from the zero superlevel set {f≥0}\{f\ge0\}{f≥0} directly fails, because the two sets may touch.

Formalization scope

Rd\mathbb R^dRd is Fin d → ℝ; u~\tilde{\mathbf u}u~ is the identity map; vTu\mathbf v^T\mathbf uvTu is the dot product u ⬝ᵥ v. The Value at Risk is the published MultistageStochastic.valueAtRisk at level 1−ϵ1-\epsilon1−ϵ, and the support function is the published RobustMDP.Shared.supportFunction. Both are real-valued sInf/sSup, which return 000 on empty or unbounded sets, so every statement assumes 0<ϵ<10<\epsilon<10<ϵ<1, a probability measure, and an uncertainty set that is nonempty and compact (Theorem 1(a), Theorems 2–3) or nonempty with {vTu:u∈U}\{\mathbf v^T\mathbf u:\mathbf u\in\mathcal U\}{vTu:u∈U} bounded above in the direction considered (Theorem 1(b)). In Theorem 1(b) and its witness this is the paper's own requirement that δ∗(v∣U)\delta^*(\mathbf v\mid\mathcal U)δ∗(v∣U) be finite, which its strict inequality with a real VaR forces and its proof uses by treating δ∗(v∣U)\delta^*(\mathbf v\mid\mathcal U)δ∗(v∣U) as a real number. Part (b) is printed with U∗\mathcal U^*U∗, a slip for U\mathcal UU; the proof's separation step prints both inequalities in the same direction, a slip corrected in the strict separation milestone.

Property (P2) quantifies over the dimension kkk of the decision variable, every function concave in u\mathbf uu for each x\mathbf xx, and every x∗\mathbf x^*x∗. Restricting it to affine fff or to k=0k=0k=0 would trivialize part (a) and falsify part (b), and is ruled out by the definition.

In Theorems 2 and 3 the sample is Fin N → (Fin d → ℝ) with the product law Measure.pi; the confidence region and the uncertainty set are arbitrary maps of the sample, and the coverage PS∗(P∗∈P(S))≥1−α\mathbb P^*_{\mathcal S}(\mathbb P^*\in\mathcal P(\mathcal S))\ge1-\alphaPS∗​(P∗∈P(S))≥1−α is a hypothesis, never the conclusion's event. Step 2 of the schema is stated with g=δ∗(⋅∣U(S))g=\delta^*(\cdot\mid\mathcal U(\mathcal S))g=δ∗(⋅∣U(S)) directly. The sets are assumed nonempty and compact (Step 3 says closed and convex; a finite support function that bounds VaR forces nonemptiness and boundedness). Theorem 3(b) reads the levels ϵj\epsilon_jϵj​ in (0,1)(0,1)(0,1), where the family is defined. Probabilities of events in the sample space are outer measures, so no measurability hypotheses are needed.

A complete development needs strict separation of a compact convex set from a closed convex set (Mathlib's geometric_hahn_banach_compact_closed), continuity of concave functions on finite-dimensional spaces, and the attainment property of VaR. Contributions are welcome on all milestones; the separation and limit steps are reusable for any chance-constraint argument based on support functions.

Selected references

  • D. Bertsimas, V. Gupta, N. Kallus, Data-Driven Robust Optimization, arXiv:1401.0212v2, 2014; Mathematical Programming 167:235–292, 2018. https://arxiv.org/abs/1401.0212
  • A. Ben-Tal, L. El Ghaoui, A. Nemirovski, Robust Optimization, Princeton University Press, 2009. https://doi.org/10.1515/9781400831050
  • X. Chen, M. Sim, P. Sun, A Robust Optimization Perspective on Stochastic Programming, Operations Research 55(6):1058–1071, 2007. https://doi.org/10.1287/opre.1070.0441
12 thms4 active usersReviewed
Convex OptimizationOperations ResearchProbability+1·Captain: mikedeng1

Data-Driven Robust Optimization II: With Known Finite Support, the χ² and G Uncertainty Sets Bound the Worst-Case Value at Risk over Their Confidence RegionsResearch Paper

Motivation

Robust optimization replaces uncertain data by a set of possible values and requires a decision to work for every value in that set. A central question is how to choose the set from data so that robust feasibility also gives a specified chance of satisfying the original constraint. Bertsimas, Gupta, and Kallus study this question for several sampling models in Data-Driven Robust Optimization. Their finite-support construction addresses a practical case: the uncertain vector can take one of finitely many known outcomes, while their probabilities must be inferred from observations. The resulting sets use classical goodness-of-fit tests to account for uncertainty in those probabilities. Bertsimas, Gupta, and Kallus, §§2–4, pp. 2–13.

In this case the support vectors are known in advance, so the problem is not to discover which outcomes are possible. The question is how much confidence to place in their estimated frequencies and how to turn that confidence region into a set of uncertain vectors suitable for a robust constraint. The paper gives two answers, one based on Pearson's chi-square statistic and one based on the likelihood-ratio, or G, statistic. Both answers are meant to work at every requested risk level 0<ϵ<10<\epsilon<10<ϵ<1 for the same observed sample. Bertsimas, Gupta, and Kallus, Theorem 4, p. 13.

Setting

Let a0,…,an−1∈Rda_0,\ldots,a_{n-1}\in\mathbb R^da0​,…,an−1​∈Rd be the listed possible outcomes. A probability vector p=(pj)p=(p_j)p=(pj​) belongs to the simplex Δn\Delta_nΔn​ when all pjp_jpj​ are nonnegative and ∑jpj=1\sum_jp_j=1∑j​pj​=1. It determines the finite-support law Pp=∑jpjδajP_p=\sum_jp_j\delta_{a_j}Pp​=∑j​pj​δaj​​. From a sample one obtains the empirical frequencies p^∈Δn\hat p\in\Delta_np^​∈Δn​. A nonnegative number ρ\rhoρ records the test threshold; in the paper it is χn−1,1−α2/(2N)\chi^2_{n-1,1-\alpha}/(2N)χn−1,1−α2​/(2N), where NNN is sample size and α\alphaα is the test's significance level. Bertsimas, Gupta, and Kallus, (10), p. 12.

The Pearson confidence region Pχ2\mathcal P^{\chi^2}Pχ2 contains candidates p∈Δnp\in\Delta_np∈Δn​ satisfying ∑j(pj−p^j)2/(2pj)≤ρ\sum_j(p_j-\hat p_j)^2/(2p_j)\le\rho∑j​(pj​−p^​j​)2/(2pj​)≤ρ. The G confidence region PG\mathcal P^GPG instead requires D(p^,p)≤ρD(\hat p,p)\le\rhoD(p^​,p)≤ρ, with relative entropy D(r,p)=∑jrjlog⁡(rj/pj)D(r,p)=\sum_jr_j\log(r_j/p_j)D(r,p)=∑j​rj​log(rj​/pj​). In either region, a candidate pj=0p_j=0pj​=0 is excluded when p^j>0\hat p_j>0p^​j​>0: the source's divergence is then infinite. If both entries are zero, that coordinate contributes zero. These conventions matter because ordinary real division and logarithm in Lean have total values at zero. Bertsimas, Gupta, and Kallus, (10), p. 12.

For a direction v∈Rdv\in\mathbb R^dv∈Rd, value at risk VaR⁡ϵPp(v)\operatorname{VaR}^{P_p}_\epsilon(v)VaRϵPp​​(v) is the lower 1−ϵ1-\epsilon1−ϵ quantile of the scalar loss uTvu^{\mathsf T}vuTv. Conditional value at risk is the minimum over real ttt of t+ϵ−1∑jpj(ajTv−t)+t+\epsilon^{-1}\sum_jp_j(a_j^{\mathsf T}v-t)^+t+ϵ−1∑j​pj​(ajT​v−t)+. The paper's auxiliary set UϵCVaR⁡PpU^{\operatorname{CVaR}_{P_p}}_\epsilonUϵCVaRPp​​​ reweights the outcomes with another probability vector qqq constrained by qj≤pj/ϵq_j\le p_j/\epsilonqj​≤pj​/ϵ. The two data-driven uncertainty sets Uϵχ2U^{\chi^2}_\epsilonUϵχ2​ and UϵGU^G_\epsilonUϵG​ allow such a reweighting for some ppp in the corresponding confidence region. Their support function δ∗(v∣U)\delta^*(v\mid U)δ∗(v∣U) is the largest uTvu^{\mathsf T}vuTv over u∈Uu\in Uu∈U. Bertsimas, Gupta, and Kallus, (11)–(13), pp. 12–13; Theorem EC.1, p. ec2.

Formalization targets

The first target is the paper's finite-support CVaR identity and the comparison between the two risk measures:

VaR⁡ϵPp(v)≤CVaR⁡ϵPp(v)=δ∗(v∣UϵCVaR⁡Pp).\operatorname{VaR}^{P_p}_\epsilon(v) \le \operatorname{CVaR}^{P_p}_\epsilon(v) =\delta^*(v\mid U^{\operatorname{CVaR}_{P_p}}_\epsilon).VaRϵPp​​(v)≤CVaRϵPp​​(v)=δ∗(v∣UϵCVaRPp​​​).

The goal is Theorem 4's deterministic claim, simultaneously for all 0<ϵ<10<\epsilon<10<ϵ<1. For each ppp in the relevant confidence region, it asks for both bounds

VaR⁡ϵPp(v)≤δ∗(v∣Uϵχ2),VaR⁡ϵPp(v)≤δ∗(v∣UϵG)\operatorname{VaR}^{P_p}_\epsilon(v)\le\delta^*(v\mid U^{\chi^2}_\epsilon), \qquad \operatorname{VaR}^{P_p}_\epsilon(v)\le\delta^*(v\mid U^G_\epsilon)VaRϵPp​​(v)≤δ∗(v∣Uϵχ2​),VaRϵPp​​(v)≤δ∗(v∣UϵG​)

for every vvv, with each uncertainty set nonempty, convex, and compact. A supporting milestone identifies each support function as the supremum of CVaR over its confidence region. The paper also displays conic optimization programs for these support functions in (14) and (15); those programs are outside this mission's drafted statements. Bertsimas, Gupta, and Kallus, Theorem 4, p. 13; proof, p. ec2.

Significance

The bounds give a way to certify the directional risk of every candidate distribution accepted by a goodness-of-fit test. For a nonempty convex compact uncertainty set, the paper's Theorem 1 turns this directional condition into a probabilistic guarantee for every constraint concave in the uncertain vector. Theorem 4 adds the sampling claim through coverage of the confidence region: when the true finite-support distribution belongs to that region, the whole family indexed by ϵ\epsilonϵ receives the guarantee. The statistical tests use chi-square approximations, so their advertised coverage is asymptotic rather than an exact finite-sample result. Bertsimas, Gupta, and Kallus, Theorems 1–4, pp. 10–13.

The paper proves the mathematical result. This mission asks for machine-checked proofs of its finite-dimensional definitions, the CVaR identity, the worst-case support identities, and the deterministic risk bounds. The drafted Lean statements are open goals. A completed development would also give reusable facts about finite-support risk measures and support functions under divergence-constrained probabilities. It would leave the test coverage calculation and the explicit programs (14)–(15) for separate work.

Difficulty

The risk comparison alone does not identify a robust uncertainty set: the support function must agree with the worst-case CVaR over an entire region of probability vectors. This brings a finite-dimensional optimization identity into the formal proof, including attainment and the relationship between reweightings and distributions. Boundary coordinates create another difficulty. The Pearson expression divides by pjp_jpj​, and the G expression contains log⁡(p^j/pj)\log(\hat p_j/p_j)log(p^​j​/pj​); silently accepting Lean's values at zero would enlarge the regions and change the theorem. The support function and CVaR are real infima or suprema, so their nonempty, bounded domains must also be established. Bertsimas, Gupta, and Kallus, (10)–(13), pp. 12–13; proof, p. ec2.

Formalization scope

Lean represents outcomes and probability vectors as functions on Fin d and Fin n; indices start at zero. The simplex is Mathlib's stdSimplex. The law is a finite sum of point masses. If two listed vectors coincide, their point masses aggregate; the paper's notation pj=Pp(u~=aj)p_j=P_p(\tilde u=a_j)pj​=Pp​(u~=aj​) is recovered with the intended distinct listing. Value at risk and the support function reuse published Prove2Me definitions; the finite-vector relative entropy also reuses a published definition, guarded at zero in this mission's G region. CVaR uses a real sInf, equal to the paper's minimum for a simplex law and 0<ϵ<10<\epsilon<10<ϵ<1. No statement applies it outside that domain.

The goal assumes p^∈Δn\hat p\in\Delta_np^​∈Δn​ and ρ≥0\rho\ge0ρ≥0. These express, respectively, that the center is an empirical probability vector and that the chi-square threshold is nonnegative. It quantifies over every 0<ϵ<10<\epsilon<10<ϵ<1, with the same confidence regions for all levels. The paper's sample size, chi-square quantile, and significance level are compressed into ρ\rhoρ; coverage of the true distribution by the test is a separate statistical premise and is not formalized here. The source's P∗\mathbb P^*P∗ is represented by Pp∗P_{p^*}Pp∗​ for a supported probability vector p∗p^*p∗. The draft does not treat an arbitrary unsupported law as a member of the confidence region.

The nonempty and compact conclusions rule out a zero returned by a support function on an empty or unbounded set. The zero-denominator guards rule out candidates the paper assigns infinite divergence. Contributions needed to close the mission include finite-simplex geometry, the finite-support CVaR identity, continuity of the divergence regions at boundary coordinates, and the risk-bound theorem. Those facts can be reused in later data-driven robust optimization developments.

Selected references

  • Dimitris Bertsimas, Vishal Gupta, and Nathan Kallus, Data-Driven Robust Optimization, arXiv:1401.0212v2, 2014; revised version in Mathematical Programming 167 (2018), 235–292. Preprint.
8 thms2 active usersReviewed
Convex OptimizationOperations ResearchProbability+1·Captain: mikedeng1

Data-Driven Robust Optimization III: For Independent Marginals, the Kolmogorov–Smirnov Set U^I Has Support Function (19) and Bounds the Worst-Case Value at RiskResearch Paper

Motivation

A robust linear constraint f(u,x)≤0f(\mathbf u,\mathbf x)\le 0f(u,x)≤0 for all u∈U\mathbf u\in\mathcal Uu∈U replaces an uncertain parameter u~\tilde{\mathbf u}u~ by a deterministic uncertainty set U⊆Rd\mathcal U\subseteq\mathbb R^dU⊆Rd. Bertsimas, Gupta and Kallus (arXiv:1401.0212v2; Math. Program. 167, 2018) build such sets directly from data. Their requirement is a probabilistic guarantee: every robust-feasible decision should satisfy the constraint with probability at least 1−ϵ1-\epsilon1−ϵ under the true distribution P∗\mathbb P^*P∗, and this should hold with probability at least 1−α1-\alpha1−α over the sample. The construction runs a statistical hypothesis test, takes its confidence region of distributions, and turns the worst-case Value at Risk over that region into a set.

This mission covers the case where P∗\mathbb P^*P∗ may be continuous but its ddd coordinates are known to be independent and supported in a known box (§5.1 of the paper). The test is the classical Kolmogorov–Smirnov (KS) goodness-of-fit test, applied separately to each marginal. The result is a convex set UϵI\mathcal U^I_\epsilonUϵI​ whose support function has a one-dimensional closed form, (19). The set is representable with exponential cones, and a line search over a single multiplier separates over it (Remarks 6–7).

Setting

Let d≥0d\ge 0d≥0 and N≥1N\ge 1N≥1 (the sample size). For each coordinate iii we are given points u^i(0)<u^i(1)<⋯<u^i(N)<u^i(N+1)\hat u^{(0)}_i<\hat u^{(1)}_i<\cdots<\hat u^{(N)}_i<\hat u^{(N+1)}_iu^i(0)​<u^i(1)​<⋯<u^i(N)​<u^i(N+1)​. The interval [u^i(0),u^i(N+1)][\hat u^{(0)}_i,\hat u^{(N+1)}_i][u^i(0)​,u^i(N+1)​] is the known box containing the support, and u^i(1),…,u^i(N)\hat u^{(1)}_i,\dots,\hat u^{(N)}_iu^i(1)​,…,u^i(N)​ are the order statistics of the iii-th coordinates of the data. Let Γ=ΓKS∈(0,1)\Gamma=\Gamma^{KS}\in(0,1)Γ=ΓKS∈(0,1) be the KS threshold and 0<ϵ<10<\epsilon<10<ϵ<1.

  • The Value at Risk of P\mathbb PP in direction v\mathbf vv is VaRϵP(v)=inf⁡{t:P(u~Tv≤t)≥1−ϵ}\mathrm{VaR}^{\mathbb P}_\epsilon(\mathbf v)=\inf\{t:\mathbb P(\tilde{\mathbf u}^{\mathsf T}\mathbf v\le t)\ge 1-\epsilon\}VaRϵP​(v)=inf{t:P(u~Tv≤t)≥1−ϵ}.
  • The support function of a set is δ∗(v∣U)=sup⁡u∈UvTu\delta^*(\mathbf v\mid\mathcal U)=\sup_{\mathbf u\in\mathcal U}\mathbf v^{\mathsf T}\mathbf uδ∗(v∣U)=supu∈U​vTu.
  • The KS region PiKS\mathcal P^{KS}_iPiKS​ is the set of Borel probability measures Pi\mathbb P_iPi​ on [u^i(0),u^i(N+1)][\hat u^{(0)}_i,\hat u^{(N+1)}_i][u^i(0)​,u^i(N+1)​] with Pi(u~i≤u^i(j))≥j/N−Γ\mathbb P_i(\tilde u_i\le\hat u^{(j)}_i)\ge j/N-\GammaPi​(u~i​≤u^i(j)​)≥j/N−Γ and Pi(u~i<u^i(j))≤(j−1)/N+Γ\mathbb P_i(\tilde u_i<\hat u^{(j)}_i)\le (j-1)/N+\GammaPi​(u~i​<u^i(j)​)≤(j−1)/N+Γ for j=1,…,Nj=1,\dots,Nj=1,…,N.
  • The independent region PI\mathcal P^IPI is the set of product measures ∏iPi\prod_i\mathbb P_i∏i​Pi​ with Pi∈PiKS\mathbb P_i\in\mathcal P^{KS}_iPi​∈PiKS​.
  • The vectors qL(Γ),qR(Γ)∈ΔN+2q^L(\Gamma),q^R(\Gamma)\in\Delta_{N+2}qL(Γ),qR(Γ)∈ΔN+2​ of (17) are the two boundary distributions of the KS band. With k=⌊N(1−Γ)⌋k=\lfloor N(1-\Gamma)\rfloork=⌊N(1−Γ)⌋, qLq^LqL puts mass Γ\GammaΓ at j=0j=0j=0, mass 1/N1/N1/N at j=1,…,kj=1,\dots,kj=1,…,k, and mass 1−Γ−k/N1-\Gamma-k/N1−Γ−k/N at j=k+1j=k+1j=k+1. Its mirror image is qjR=qN+1−jLq^R_j=q^L_{N+1-j}qjR​=qN+1−jL​.
  • The relative entropy is D(q,p)=∑jqjlog⁡(qj/pj)D(\mathbf q,\mathbf p)=\sum_jq_j\log(q_j/p_j)D(q,p)=∑j​qj​log(qj​/pj​).
  • The uncertainty set (18) is
UϵI={u:∃ θi∈[0,1], qi∈ΔN+2, ∑j=0N+1u^i(j)qji=ui, ∑i=1dD(qi,θiqL+(1−θi)qR)≤log⁡(1/ϵ)}.\mathcal U^I_\epsilon=\Big\{\mathbf u:\exists\,\theta_i\in[0,1],\ \mathbf q^i\in\Delta_{N+2},\ \sum_{j=0}^{N+1}\hat u^{(j)}_iq^i_j=u_i,\ \sum_{i=1}^dD\big(\mathbf q^i,\theta_i\mathbf q^L+(1-\theta_i)\mathbf q^R\big)\le\log(1/\epsilon)\Big\}.UϵI​={u:∃θi​∈[0,1], qi∈ΔN+2​, j=0∑N+1​u^i(j)​qji​=ui​, i=1∑d​D(qi,θi​qL+(1−θi​)qR)≤log(1/ϵ)}.

Formalization targets

Goal: Theorem 5 (deterministic content)

For every v∈Rd\mathbf v\in\mathbb R^dv∈Rd:

UϵI is nonempty, convex and compact,VaRϵP(v)≤δ∗(v∣UϵI)  ∀ P∈PI,\mathcal U^I_\epsilon\ \text{is nonempty, convex and compact},\qquad \mathrm{VaR}^{\mathbb P}_\epsilon(\mathbf v)\le\delta^*(\mathbf v\mid\mathcal U^I_\epsilon)\ \ \forall\,\mathbb P\in\mathcal P^I,UϵI​ is nonempty, convex and compact,VaRϵP​(v)≤δ∗(v∣UϵI​)  ∀P∈PI, δ∗(v∣UϵI)=inf⁡λ>0{λlog⁡(1/ϵ)+λ∑i=1dlog⁡[max⁡(∑jqjLeviu^i(j)/λ,∑jqjReviu^i(j)/λ)]}.(19)\delta^*(\mathbf v\mid\mathcal U^I_\epsilon)=\inf_{\lambda>0}\Big\{\lambda\log(1/\epsilon)+\lambda\sum_{i=1}^d\log\Big[\max\Big(\sum_{j}q^L_je^{v_i\hat u^{(j)}_i/\lambda},\sum_jq^R_je^{v_i\hat u^{(j)}_i/\lambda}\Big)\Big]\Big\}.\tag{19}δ∗(v∣UϵI​)=λ>0inf​{λlog(1/ϵ)+λi=1∑d​log[max(j∑​qjL​evi​u^i(j)​/λ,j∑​qjR​evi​u^i(j)​/λ)]}.(19)

Milestones, in attack order

  1. The Nemirovski–Shapiro bound VaRϵP(v)≤λlog⁡(1/ϵ)+λ∑ilog⁡EPi[eviu~i/λ]\mathrm{VaR}^{\mathbb P}_\epsilon(\mathbf v)\le\lambda\log(1/\epsilon)+\lambda\sum_i\log\mathbb E^{\mathbb P_i}[e^{v_i\tilde u_i/\lambda}]VaRϵP​(v)≤λlog(1/ϵ)+λ∑i​logEPi​[evi​u~i​/λ] for independent, compactly supported marginals.
  2. The boundary laws qLq^LqL, qRq^RqR belong to PiKS\mathcal P^{KS}_iPiKS​.
  3. Theorem EC.2: for monotone ggg, sup⁡PiKSE[g(u~i)]=max⁡(∑jqjLg(u^i(j)),∑jqjRg(u^i(j)))\sup_{\mathcal P^{KS}_i}\mathbb E[g(\tilde u_i)]=\max(\sum_jq^L_jg(\hat u^{(j)}_i),\sum_jq^R_jg(\hat u^{(j)}_i))supPiKS​​E[g(u~i​)]=max(∑j​qjL​g(u^i(j)​),∑j​qjR​g(u^i(j)​)).
  4. (16) combined with EC.2: the Value at Risk over PI\mathcal P^IPI is at most the expression in (19), for every λ>0\lambda>0λ>0.
  5. The Lagrangian dual of max⁡{vTu:u∈UϵI}\max\{\mathbf v^{\mathsf T}\mathbf u:\mathbf u\in\mathcal U^I_\epsilon\}max{vTu:u∈UϵI​}.
  6. (EC.6): max⁡q∈Δ{cTq−D(q,p)}=log⁡∑jpjecj\max_{\mathbf q\in\Delta}\{\mathbf c^{\mathsf T}\mathbf q-D(\mathbf q,\mathbf p)\}=\log\sum_jp_je^{c_j}maxq∈Δ​{cTq−D(q,p)}=log∑j​pj​ecj​.
  7. (EC.7): the linear optimization over θi∈[0,1]\theta_i\in[0,1]θi​∈[0,1] is solved at an endpoint.

Significance

Theorem 5 gives a data-driven uncertainty set for continuous distributions with independent components. Its guarantee is finite-sample, not asymptotic, and its support function costs one line search over λ\lambdaλ to evaluate. Theorem 1 of the paper shows that VaR≤δ∗\mathrm{VaR}\le\delta^*VaR≤δ∗ for all v\mathbf vv is equivalent to the probabilistic guarantee for nonempty convex compact sets. So the goal certifies that every robust-feasible solution of a constraint concave in u\mathbf uu satisfies the chance constraint for every distribution the KS tests cannot reject. Theorem EC.2 is a reusable fact about KS bands: monotone expectations are extremized at the band's two boundary distributions.

The result is proved in the paper, but none of it has been formalized. A formal development would supply:

  • worst-case expectations over a KS confidence band;
  • the finite Gibbs variational identity with possibly vanishing reference masses;
  • a Chernoff-type Value-at-Risk bound for product measures;
  • a strong-duality statement for an entropy-constrained convex program.

Difficulty

The obvious route to the VaR bound is a union bound over coordinates. It loses a factor of ddd in ϵ\epsilonϵ, which is why the paper uses exponential moments and independence instead. The KS region is infinite dimensional, so the inner supremum of (16) is not a finite linear program. Reducing it to the boundary distributions needs the monotonicity of u↦eviu/λu\mapsto e^{v_iu/\lambda}u↦evi​u/λ, and a measure-level comparison of distribution functions against the band. The support-function identity needs strong duality for a jointly convex divergence constraint. The duality holds because θi↦θiqL+(1−θi)qR\theta_i\mapsto\theta_i\mathbf q^L+(1-\theta_i)\mathbf q^Rθi​↦θi​qL+(1−θi​)qR is affine and DDD is jointly convex. The reference vector can have zero entries (when N(1−Γ)N(1-\Gamma)N(1−Γ) is an integer, or in the middle of the band), so the Gibbs step must handle vanishing masses.

Formalization scope

  • Data and conventions. Coordinates are Fin d. The points are uhat : Fin d → Fin (N + 2) → ℝ with the page's indices j=0,…,N+1j=0,\dots,N+1j=0,…,N+1, and the KS constraints run over j : Fin N, which is the page's j−1j-1j−1. The order statistics are data. They are ordered, u^i(0)≤u^i(1)≤⋯≤u^i(N+1)\hat u^{(0)}_i\le\hat u^{(1)}_i\le\dots\le\hat u^{(N+1)}_iu^i(0)​≤u^i(1)​≤⋯≤u^i(N+1)​ (Monotone (uhat i)), as order statistics of a sample in the box are; ties are allowed.
  • Standing assumptions. N≥1N\ge1N≥1, 0<Γ<10<\Gamma<10<Γ<1 and 0<ϵ<10<\epsilon<10<ϵ<1.
  • Regions. Measures in PiKS\mathcal P^{KS}_iPiKS​ are probability measures on R\mathbb RR carried by the box, and PI\mathcal P^IPI consists of the Measure.pi products of such measures, so independence is built in.
  • Relative entropy. DDD carries an explicit finiteness predicate (qj>0⇒pj>0q_j>0\Rightarrow p_j>0qj​>0⇒pj​>0), so Lean's log 0 = 0 cannot make an infinite divergence finite.
  • Published definitions. Value at Risk is the published MultistageStochastic.valueAtRisk at level 1−ϵ1-\epsilon1−ϵ, and δ∗\delta^*δ∗ is the published RobustMDP.Shared.supportFunction, a real sSup. The goal proves UϵI\mathcal U^I_\epsilonUϵI​ nonempty and compact, so δ∗\delta^*δ∗ is never the junk value 000 of an empty or unbounded set.
  • Infima and the multiplier. Infima over λ\lambdaλ are over λ>0\lambda>0λ>0 and stated with IsGLB. The page's λ≥0\lambda\ge0λ≥0 gives the same value.
  • Criterion form of the guarantee. The guarantee is stated as VaRϵP(v)≤δ∗(v∣UϵI)\mathrm{VaR}^{\mathbb P}_\epsilon(\mathbf v)\le\delta^*(\mathbf v\mid\mathcal U^I_\epsilon)VaRϵP​(v)≤δ∗(v∣UϵI​) for all P∈PI\mathbb P\in\mathcal P^IP∈PI. By Theorem 1 (mission I of this series), this criterion is equivalent to the probabilistic guarantee for nonempty convex compact sets.
  • Coverage of the test. The statement "with probability at least 1−α1-\alpha1−α over the sample" is the coverage of PI\mathcal P^IPI. It rests on the distribution-free law of the KS statistic (tables) and on combining ddd tests at level 1−1−αd1-\sqrt[d]{1-\alpha}1−d1−α​. This part is cited, not formalized.
  • Ruled out. The VaR inequality is never checked against a δ∗\delta^*δ∗ that sSup collapses to 000, and the divergence budget is never relaxed by unguarded logarithms.

Contributions are welcome on any milestone. Milestones 1, 3 and 6 are independent of each other and of the rest; the goal follows from milestones 1–7 together with the convex-analytic facts about UϵI\mathcal U^I_\epsilonUϵI​.

Selected references

  • D. Bertsimas, V. Gupta, N. Kallus, Data-Driven Robust Optimization, arXiv:1401.0212v2, 2014; Math. Program. 167:235–292, 2018. https://arxiv.org/abs/1401.0212
  • A. Nemirovski, A. Shapiro, Convex approximations of chance constrained programs, SIAM J. Optim. 17(4):969–996, 2006. https://doi.org/10.1137/050622328
  • M. A. Stephens, EDF statistics for goodness of fit and some comparisons, J. Amer. Statist. Assoc. 69(347):730–737, 1974. https://doi.org/10.1080/01621459.1974.10480196
  • S. Boyd, L. Vandenberghe, Convex Optimization, Cambridge University Press, 2004. https://web.stanford.edu/~boyd/cvxbook/
11 thms3 active usersReviewed
🏆Completed
Convex OptimizationOperations ResearchProbability+1·Captain: mikedeng1

Data-Driven Robust Optimization IV: The Forward–Backward Deviation Set U^FB Has a Closed-Form Support Function That Bounds the Worst-Case Value at RiskResearch Paper

Motivation

A robust linear constraint u⊤v≤tu^\top v \le tu⊤v≤t with uuu ranging over an uncertainty set U⊆Rd\mathcal U\subseteq\mathbb R^dU⊆Rd is tractable whenever the support function δ∗(v∣U)=sup⁡u∈Uu⊤v\delta^*(v\mid\mathcal U)=\sup_{u\in\mathcal U}u^\top vδ∗(v∣U)=supu∈U​u⊤v is. Robust optimization gains a probabilistic meaning when U\mathcal UU is chosen so that every robustly feasible decision also satisfies the constraint with probability at least 1−ε1-\varepsilon1−ε under the true distribution P∗\mathbb P^*P∗ of the uncertain parameter u~\tilde uu~. Bertsimas, Gupta and Kallus (arXiv:1401.0212v2; Math. Program. 167, 2018) build such sets from data: a statistical hypothesis test yields a confidence region P\mathcal PP of distributions, and the uncertainty set is any convex set whose support function dominates the worst-case Value at Risk over P\mathcal PP.

Section 5.2 of the paper applies this schema to the forward and backward deviations of Chen, Sim and Sun (Oper. Res. 55, 2007), one-sided measures of spread that capture skewness. Chen, Sim and Sun assume the mean and deviations are known; the data-driven version replaces them by confidence intervals and must work out the worst case over those intervals. The result is the set UεFB\mathcal U^{FB}_\varepsilonUεFB​ of Theorem 6, whose support function has a closed form.

Setting

The uncertain parameter u~\tilde uu~ takes values in Rd\mathbb R^dRd and P\mathbb PP is its law. For ε∈(0,1)\varepsilon\in(0,1)ε∈(0,1) and v∈Rdv\in\mathbb R^dv∈Rd, the Value at Risk is

VaRεP(v)=inf⁡{t:P(u~⊤v≤t)≥1−ε}.\mathrm{VaR}^{\mathbb P}_\varepsilon(v)=\inf\{t:\mathbb P(\tilde u^\top v\le t)\ge1-\varepsilon\}.VaRεP​(v)=inf{t:P(u~⊤v≤t)≥1−ε}.

For a probability measure Pi\mathbb P_iPi​ on R\mathbb RR with mean μi\mu_iμi​, the forward deviation and the backward deviation are

σf(Pi)=sup⁡x>0−2μix+2x2log⁡EPi[exu~i],σb(Pi)=sup⁡x>02μix+2x2log⁡EPi[e−xu~i].\sigma_f(\mathbb P_i)=\sup_{x>0}\sqrt{-\tfrac{2\mu_i}{x}+\tfrac{2}{x^2}\log\mathbb E^{\mathbb P_i}[e^{x\tilde u_i}]},\qquad\sigma_b(\mathbb P_i)=\sup_{x>0}\sqrt{\tfrac{2\mu_i}{x}+\tfrac{2}{x^2}\log\mathbb E^{\mathbb P_i}[e^{-x\tilde u_i}]}.σf​(Pi​)=x>0sup​−x2μi​​+x22​logEPi​[exu~i​]​,σb​(Pi​)=x>0sup​x2μi​​+x22​logEPi​[e−xu~i​]​.

From a sample, a bootstrap produces thresholds tit_iti​, σˉfi\bar\sigma_{fi}σˉfi​, σˉbi\bar\sigma_{bi}σˉbi​. With the sample mean μ^i\hat\mu_iμ^​i​ put mbi=μ^i−tim_{bi}=\hat\mu_i-t_imbi​=μ^​i​−ti​ and mfi=μ^i+tim_{fi}=\hat\mu_i+t_imfi​=μ^​i​+ti​. The confidence region PFB\mathcal P^{FB}PFB consists of the distributions of vectors with independent components u~i∼Pi\tilde u_i\sim\mathbb P_iu~i​∼Pi​, each Pi\mathbb P_iPi​ having bounded support, mean in [mbi,mfi][m_{bi},m_{fi}][mbi​,mfi​], σf(Pi)≤σˉfi\sigma_f(\mathbb P_i)\le\bar\sigma_{fi}σf​(Pi​)≤σˉfi​ and σb(Pi)≤σˉbi\sigma_b(\mathbb P_i)\le\bar\sigma_{bi}σb​(Pi​)≤σˉbi​.

The uncertainty set is

UεFB={y1+y2−y3: y2,y3∈R+d, ∑i=1d(y2i22σˉfi2+y3i22σˉbi2)≤log⁡(1/ε), mbi≤y1i≤mfi}.\mathcal U^{FB}_\varepsilon=\Big\{y_1+y_2-y_3:\ y_2,y_3\in\mathbb R^d_+,\ \sum_{i=1}^d\Big(\frac{y_{2i}^2}{2\bar\sigma_{fi}^2}+\frac{y_{3i}^2}{2\bar\sigma_{bi}^2}\Big)\le\log(1/\varepsilon),\ m_{bi}\le y_{1i}\le m_{fi}\Big\}.UεFB​={y1​+y2​−y3​: y2​,y3​∈R+d​, i=1∑d​(2σˉfi2​y2i2​​+2σˉbi2​y3i2​​)≤log(1/ε), mbi​≤y1i​≤mfi​}.

Formalization targets

Goal: Theorem 6

For mb≤mfm_b\le m_fmb​≤mf​, σˉf,σˉb>0\bar\sigma_f,\bar\sigma_b>0σˉf​,σˉb​>0 and ε∈(0,1)\varepsilon\in(0,1)ε∈(0,1), the set UεFB\mathcal U^{FB}_\varepsilonUεFB​ is nonempty, convex and compact,

δ∗(v∣UεFB)=∑i:vi≥0mfivi+∑i:vi<0mbivi+2log⁡(1/ε)(∑i:vi≥0σˉfi2vi2+∑i:vi<0σˉbi2vi2)(24)\delta^*(v\mid\mathcal U^{FB}_\varepsilon)=\sum_{i:v_i\ge0}m_{fi}v_i+\sum_{i:v_i<0}m_{bi}v_i+\sqrt{2\log(1/\varepsilon)\Big(\sum_{i:v_i\ge0}\bar\sigma_{fi}^2v_i^2+\sum_{i:v_i<0}\bar\sigma_{bi}^2v_i^2\Big)}\qquad(24)δ∗(v∣UεFB​)=i:vi​≥0∑​mfi​vi​+i:vi​<0∑​mbi​vi​+2log(1/ε)(i:vi​≥0∑​σˉfi2​vi2​+i:vi​<0∑​σˉbi2​vi2​)​(24)

for every vvv, and VaRεP(v)\mathrm{VaR}^{\mathbb P}_\varepsilon(v)VaRεP​(v) is at most the right-hand side of (24) for every P∈PFB\mathbb P\in\mathcal P^{FB}P∈PFB and every vvv.

Milestones

  1. The Chen–Sim–Sun bound (22): for independent components with known means μi\mu_iμi​ and deviations, VaRεP(v)≤∑iμivi+2log⁡(1/ε)(∑vi<0σbi2vi2+∑vi≥0σfi2vi2)\mathrm{VaR}^{\mathbb P}_\varepsilon(v)\le\sum_i\mu_iv_i+\sqrt{2\log(1/\varepsilon)(\sum_{v_i<0}\sigma_{bi}^2v_i^2+\sum_{v_i\ge0}\sigma_{fi}^2v_i^2)}VaRεP​(v)≤∑i​μi​vi​+2log(1/ε)(∑vi​<0​σbi2​vi2​+∑vi​≥0​σfi2​vi2​)​.
  2. The right-hand side of (24) is the worst case of (22) over the parameters allowed by PFB\mathcal P^{FB}PFB.
  3. Lagrangian strong duality for max⁡u∈UεFBu⊤v\max_{u\in\mathcal U^{FB}_\varepsilon}u^\top vmaxu∈UεFB​​u⊤v.
  4. The three one-dimensional sub-subproblems and their optimal values.
  5. The combined formula: δ∗\delta^*δ∗ equals a linear term plus inf⁡λ>0{λlog⁡(1/ε)+S/(2λ)}\inf_{\lambda>0}\{\lambda\log(1/\varepsilon)+S/(2\lambda)\}infλ>0​{λlog(1/ε)+S/(2λ)}.
  6. inf⁡λ>0{λL+S/(2λ)}=2LS\inf_{\lambda>0}\{\lambda L+S/(2\lambda)\}=\sqrt{2LS}infλ>0​{λL+S/(2λ)}=2LS​, attained at λ∗=S/(2L)\lambda^*=\sqrt{S/(2L)}λ∗=S/(2L)​ when S>0S>0S>0.

Companions

  • Remark 9: when (24) exceeds ttt, an explicit point of UεFB\mathcal U^{FB}_\varepsilonUεFB​ gives a violated cut u⊤v≤tu^\top v\le tu⊤v≤t.
  • Theorem 13(b): the constraint δ∗(v∣UεFB)≤t\delta^*(v\mid\mathcal U^{FB}_\varepsilon)\le tδ∗(v∣UεFB​)≤t is convex in (v,t)(v,t)(v,t) and convex in ε\varepsilonε for 0<ε<1/e0<\varepsilon<1/\sqrt e0<ε<1/e​.

Significance

Theorem 6 gives a data-driven uncertainty set for which a robust linear constraint is a second-order cone constraint, (24) being an explicit norm expression. By Theorem 1 of the paper, the domination of the worst-case Value at Risk over the region by the support function means that every robustly feasible solution satisfies a chance constraint at level ε\varepsilonε for every distribution in the region. Unlike the Chen–Sim–Sun set, which requires the true mean and deviations, UεFB\mathcal U^{FB}_\varepsilonUεFB​ needs only data and allows the mean and the support to be unknown. Theorem 13(b) supports the alternating heuristic of §9 for choosing the levels εj\varepsilon_jεj​ across several constraints.

The paper's proof is short and leans on "by inspection" and "by Lagrangian strong duality". A formal development makes each of these steps explicit, including the case where the multiplier is not attained, and corrects two printed slips (the optimal values viσˉ2/(2λ)v_i\bar\sigma^2/(2\lambda)vi​σˉ2/(2λ), which should be vi2σˉ2/(2λ)v_i^2\bar\sigma^2/(2\lambda)vi2​σˉ2/(2λ), and the bound mb≤y1≤mbm_b\le y_1\le m_bmb​≤y1​≤mb​). The Chen–Sim–Sun bound itself, a Chernoff-type tail bound under one-sided moment-generating conditions, is cited by the paper without proof. None of these results has a machine-checked proof that this mission is aware of.

Difficulty

The support function of (23) is a maximisation over a set defined by a box, two nonnegative orthants and one coupled quadratic constraint. A coordinate-wise argument does not apply directly because the quadratic budget is shared. The worst case over PFB\mathcal P^{FB}PFB is not a single distribution: the extreme mean and the extreme deviations are chosen coordinate by coordinate according to the sign of viv_ivi​. The Value at Risk bound needs independence of the components; without it (22) fails. When v=0v=0v=0 or the sign pattern makes the quadratic term vanish, the dual multiplier escapes to zero and the dual minimum is only an infimum.

Formalization scope

Vectors are Fin d → ℝ, with 0-based coordinates; u~⊤v\tilde u^\top vu~⊤v is u ⬝ᵥ v. The Value at Risk is the published MultistageStochastic.valueAtRisk at level 1−ε1-\varepsilon1−ε, and the support function is the published RobustMDP.Shared.supportFunction, a real supremum; the goal includes nonemptiness and compactness of UεFB\mathcal U^{FB}_\varepsilonUεFB​, so the supremum is a true maximum and cannot hold through the value 000 of an empty or unbounded set.

The statement is formalized in the criterion form: VaRεP(v)≤δ∗(v∣UεFB)\mathrm{VaR}^{\mathbb P}_\varepsilon(v)\le\delta^*(v\mid\mathcal U^{FB}_\varepsilon)VaRεP​(v)≤δ∗(v∣UεFB​) for all vvv and every P\mathbb PP in the region. By Theorem 1 (mission I of this series), for a nonempty convex compact set this criterion is equivalent to the probabilistic guarantee. The page's "with probability 1−α1-\alpha1−α with respect to the sample" is the coverage of the bootstrap confidence region, which the paper itself treats as approximate; it is not formalized.

Conventions and added hypotheses:

  • σˉfi,σˉbi>0\bar\sigma_{fi},\bar\sigma_{bi}>0σˉfi​,σˉbi​>0, so that the denominators of (23) are genuine; with σˉ=0\bar\sigma=0σˉ=0 Lean's x/0=0x/0=0x/0=0 would leave y2y_2y2​ unconstrained instead of forcing y2=0y_2=0y2​=0.
  • mb≤mfm_b\le m_fmb​≤mf​, which holds because ti≥0t_i\ge0ti​≥0.
  • The region is built from a product measure (independence) of probability measures with bounded support. These are the hypotheses of Theorem 6 on P∗\mathbb P^*P∗ and the section's standing assumption; the page's set-builder for PFB\mathcal P^{FB}PFB omits independence. Without bounded support, the Bochner integral of a non-integrable exponential is 000 in Lean and the deviation conditions would lose their meaning.
  • "σf(Pi)≤σˉ\sigma_f(\mathbb P_i)\le\bar\sigmaσf​(Pi​)≤σˉ" is the predicate "the expression under the root is at most σˉ2\bar\sigma^2σˉ2 for every x>0x>0x>0", which is equivalent and avoids an unbounded supremum.
  • Dual minimisations over λ≥0\lambda\ge0λ≥0 are infima over λ>0\lambda>0λ>0, stated with IsGLB.

A trivializing formalization is ruled out: a region without independence would make the goal false, a region without the probability and bounded-support conditions would let junk integrals satisfy the deviation predicates, and a support function of an empty set would make (24) a statement about 000.

The development needs a Chernoff argument for products of measures, finite-dimensional Lagrangian duality for one convex quadratic constraint (or a direct Cauchy–Schwarz argument), and compactness of the set (23). The definitions file is self-contained and reusable for other forward/backward-deviation sets. Proofs of any milestone, and of the Chen–Sim–Sun bound as a standalone tail inequality, are welcome.

Selected references

  • D. Bertsimas, V. Gupta, N. Kallus, Data-Driven Robust Optimization, arXiv:1401.0212v2, 2014; Math. Program. 167:235–292, 2018. https://arxiv.org/abs/1401.0212
  • X. Chen, M. Sim, P. Sun, A Robust Optimization Perspective on Stochastic Programming, Operations Research 55(6):1058–1071, 2007. https://doi.org/10.1287/opre.1070.0441
12 thms3 active usersReviewed
Convex OptimizationOperations ResearchProbability+1·Captain: mikedeng1

Data-Driven Robust Optimization V: The Order-Statistic Box U^M Built from Marginal Samples Dominates Value at Risk with Probability at Least 1 − αResearch Paper

Motivation

Robust optimization replaces an uncertain constraint f(u~,x)≤0f(\tilde{\mathbf u},\mathbf x)\le 0f(u~,x)≤0 by the requirement that it hold for every u\mathbf uu in an uncertainty set U⊆Rd\mathcal U\subseteq\mathbb R^dU⊆Rd. The resulting problems are tractable for many sets, but the choice of U\mathcal UU decides whether the solution means anything probabilistically. Bertsimas, Gupta and Kallus (arXiv:1401.0212v2; Math. Program. 167:235–292, 2018) propose to build U\mathcal UU from data so that, with high probability over the sample, every robust-feasible decision is also feasible with probability at least 1−ϵ1-\epsilon1−ϵ under the unknown distribution P∗\mathbb P^*P∗.

This mission covers §6 of that paper, the case where the data are samples of the marginals of P∗\mathbb P^*P∗, observed separately, with no assumption that the marginals are independent. This is the situation of asynchronous measurements or records with many missing entries: the joint law cannot be learned, yet a valid uncertainty set can still be built. The set is a box whose sides are order statistics, and its guarantee rests on an elementary binomial test (David and Nagaraja, Order Statistics, §7.1) and a Value-at-Risk bound of Embrechts, Höing and Juri (Finance Stoch. 7, 2003).

Setting

Let P∗\mathbb P^*P∗ be a probability measure on Rd\mathbb R^dRd whose support lies in a known box [u^(0),u^(N+1)]={u:u^i(0)≤ui≤u^i(N+1)}[\hat{\mathbf u}^{(0)},\hat{\mathbf u}^{(N+1)}]=\{\mathbf u:\hat u^{(0)}_i\le u_i\le\hat u^{(N+1)}_i\}[u^(0),u^(N+1)]={u:u^i(0)​≤ui​≤u^i(N+1)​}. Fix a violation level 0<ϵ<10<\epsilon<10<ϵ<1 and a significance level 0<α<10<\alpha<10<α<1.

The Value at Risk of u~Tv\tilde{\mathbf u}^T\mathbf vu~Tv under a probability measure P\mathbb PP is

VaRϵP(v)=inf⁡{t:P(u~Tv≤t)≥1−ϵ},\mathrm{VaR}^{\mathbb P}_\epsilon(\mathbf v)=\inf\{t:\mathbb P(\tilde{\mathbf u}^T\mathbf v\le t)\ge1-\epsilon\},VaRϵP​(v)=inf{t:P(u~Tv≤t)≥1−ϵ},

and the support function of a set U\mathcal UU is δ∗(v∣U)=sup⁡u∈UvTu\delta^*(\mathbf v\mid\mathcal U)=\sup_{\mathbf u\in\mathcal U}\mathbf v^T\mathbf uδ∗(v∣U)=supu∈U​vTu. A set U\mathcal UU implies a probabilistic guarantee at level ϵ\epsilonϵ for P∗\mathbb P^*P∗ if for every f(u,x)f(\mathbf u,\mathbf x)f(u,x) concave in u\mathbf uu and every x∗\mathbf x^*x∗, f(u,x∗)≤0f(\mathbf u,\mathbf x^*)\le0f(u,x∗)≤0 for all u∈U\mathbf u\in\mathcal Uu∈U implies P∗(f(u~,x∗)≤0)≥1−ϵ\mathbb P^*(f(\tilde{\mathbf u},\mathbf x^*)\le0)\ge1-\epsilonP∗(f(u~,x∗)≤0)≥1−ϵ.

From a sample u^1,…,u^N\hat{\mathbf u}^1,\dots,\hat{\mathbf u}^Nu^1,…,u^N let u^i(j)\hat u^{(j)}_iu^i(j)​, 1≤j≤N1\le j\le N1≤j≤N, be the jjj-th order statistic (the jjj-th smallest value) of coordinate iii, and let u^i(0),u^i(N+1)\hat u^{(0)}_i,\hat u^{(N+1)}_iu^i(0)​,u^i(N+1)​ be the box ends. The index sss is

s=min⁡{k∈N:∑j=kN(Nj)(ϵ/d)N−j(1−ϵ/d)j≤α2d},s=N+1 if the set is empty,(26)s=\min\Big\{k\in\mathbb N:\sum_{j=k}^N\binom Nj(\epsilon/d)^{N-j}(1-\epsilon/d)^j\le\frac{\alpha}{2d}\Big\},\qquad s=N+1\text{ if the set is empty}, \tag{26}s=min{k∈N:j=k∑N​(jN​)(ϵ/d)N−j(1−ϵ/d)j≤2dα​},s=N+1 if the set is empty,(26)

and the uncertainty set is the box

UϵM={u∈Rd:u^i(N−s+1)≤ui≤u^i(s), i=1,…,d}.(28)\mathcal U^M_\epsilon=\{\mathbf u\in\mathbb R^d:\hat u^{(N-s+1)}_i\le u_i\le\hat u^{(s)}_i,\ i=1,\dots,d\}. \tag{28}UϵM​={u∈Rd:u^i(N−s+1)​≤ui​≤u^i(s)​, i=1,…,d}.(28)

The confidence region PM\mathcal P^MPM is the set of probability measures on the box with VaRϵ/dP(ei)≤u^i(s)\mathrm{VaR}^{\mathbb P}_{\epsilon/d}(\mathbf e_i)\le\hat u^{(s)}_iVaRϵ/dP​(ei​)≤u^i(s)​ and VaRϵ/dP(−ei)≤−u^i(N−s+1)\mathrm{VaR}^{\mathbb P}_{\epsilon/d}(-\mathbf e_i)\le-\hat u^{(N-s+1)}_iVaRϵ/dP​(−ei​)≤−u^i(N−s+1)​ for every iii.

Formalization targets

Goal: Theorem 7

If N−s+1<sN-s+1<sN−s+1<s, then with probability at least 1−α1-\alpha1−α over the sample (NNN samples of each marginal of P∗\mathbb P^*P∗, each marginal's samples i.i.d., arbitrary dependence across marginals),

δ∗(v∣UϵM)≥VaRϵP∗(v)for all v∈Rd,\delta^*(\mathbf v\mid\mathcal U^M_\epsilon)\ge\mathrm{VaR}^{\mathbb P^*}_\epsilon(\mathbf v)\qquad\text{for all }\mathbf v\in\mathbb R^d,δ∗(v∣UϵM​)≥VaRϵP∗​(v)for all v∈Rd,

and, for every sample, UϵM\mathcal U^M_\epsilonUϵM​ is nonempty, convex and compact with

δ∗(v∣UϵM)=∑i=1dmax⁡(viu^i(N−s+1), viu^i(s)).(29)\delta^*(\mathbf v\mid\mathcal U^M_\epsilon)=\sum_{i=1}^d\max\big(v_i\hat u^{(N-s+1)}_i,\,v_i\hat u^{(s)}_i\big). \tag{29}δ∗(v∣UϵM​)=i=1∑d​max(vi​u^i(N−s+1)​,vi​u^i(s)​).(29)

Milestones

  1. Positive homogeneity: VaRδP(cw)=c VaRδP(w)\mathrm{VaR}^{\mathbb P}_\delta(c\mathbf w)=c\,\mathrm{VaR}^{\mathbb P}_\delta(\mathbf w)VaRδP​(cw)=cVaRδP​(w) for c>0c>0c>0 (p. 10).
  2. Each one-sided order-statistic test is valid at level α/(2d)\alpha/(2d)α/(2d): PS∗(u^i(s)<VaRϵ/dP∗(ei))≤α/(2d)\mathbb P^*_{\mathcal S}(\hat u^{(s)}_i<\mathrm{VaR}^{\mathbb P^*}_{\epsilon/d}(\mathbf e_i))\le\alpha/(2d)PS∗​(u^i(s)​<VaRϵ/dP∗​(ei​))≤α/(2d), and the mirror bound for −ei-\mathbf e_i−ei​ with u^i(N−s+1)\hat u^{(N-s+1)}_iu^i(N−s+1)​ (pp. 20–21).
  3. Union bound: PS∗(P∗∈PM)≥1−α\mathbb P^*_{\mathcal S}(\mathbb P^*\in\mathcal P^M)\ge1-\alphaPS∗​(P∗∈PM)≥1−α (p. 21).
  4. The weak Embrechts bound VaRϵP(v)≤∑iVaRϵ/dP(viei)\mathrm{VaR}^{\mathbb P}_\epsilon(\mathbf v)\le\sum_i\mathrm{VaR}^{\mathbb P}_{\epsilon/d}(v_i\mathbf e_i)VaRϵP​(v)≤∑i​VaRϵ/dP​(vi​ei​) for every probability measure P\mathbb PP (p. 21).
  5. If N−s+1<sN-s+1<sN−s+1<s then u^i(N−s+1)≤u^i(s)\hat u^{(N-s+1)}_i\le\hat u^{(s)}_iu^i(N−s+1)​≤u^i(s)​ (p. 21).
  6. (EC.8): for P∈PM\mathbb P\in\mathcal P^MP∈PM, VaRϵP(v)≤∑vi>0viu^i(s)+∑vi≤0viu^i(N−s+1)\mathrm{VaR}^{\mathbb P}_\epsilon(\mathbf v)\le\sum_{v_i>0}v_i\hat u^{(s)}_i+\sum_{v_i\le0}v_i\hat u^{(N-s+1)}_iVaRϵP​(v)≤∑vi​>0​vi​u^i(s)​+∑vi​≤0​vi​u^i(N−s+1)​ (p. ec5).
  7. (29) as a standalone statement (p. 21).

Significance

Theorem 7 gives an uncertainty set with a finite-sample guarantee from data that carry no information on the dependence between coordinates. The set is a box, so the robust counterpart of a linear constraint is again linear, and Remark 12 of the paper notes that separation over {(v,t):δ∗(v∣UM)≤t}\{(\mathbf v,t):\delta^*(\mathbf v\mid\mathcal U^M)\le t\}{(v,t):δ∗(v∣UM)≤t} is in closed form. Unlike the other confidence regions of the paper (χ², G-test, Kolmogorov–Smirnov, bootstrap), whose coverage is asymptotic, tabulated or approximate, the test here is exact and distribution-free, so the probability statement itself is in scope.

The result is proved in the paper; to our knowledge none of it has a machine-checked proof. The mission produces a complete formal statement of Theorem 7 including the sampling probability, the binomial order-statistic test for a quantile, and the marginal Value-at-Risk bound, all of which are standard tools in nonparametric statistics and risk management that are absent from Mathlib.

Difficulty

The deterministic half, (EC.8) and (29), is short once the weak Embrechts bound is available. The work is in the probabilistic half, which the paper delegates to a textbook citation. Validity of the order-statistic test ties together facts that no library currently connects: the combinatorics of sorted tuples, the binomial law of the number of i.i.d. sample points below a threshold, the behaviour of a quantile at its left limit (the distribution function at the quantile can exceed 1−ϵ/d1-\epsilon/d1−ϵ/d, so the obvious bound uses the wrong probability), and the comparison of binomial tails across success probabilities. The lower-tail test must be handled with the index N−s+1N-s+1N−s+1 and the quantile of −u~i-\tilde u_i−u~i​, where a sign or off-by-one slip produces a false statement that still looks plausible. The boundary regime s=N+1s=N+1s=N+1, where UϵM\mathcal U^M_\epsilonUϵM​ is the a priori box, is valid only because P∗\mathbb P^*P∗ lives in that box and needs separate treatment.

Formalization scope

Rd\mathbb R^dRd is Fin d → ℝ with 0-based coordinates; vectors pair by ⬝ᵥ. Value at Risk is the published MultistageStochastic.valueAtRisk at level 1−ϵ1-\epsilon1−ϵ applied to u↦uTv\mathbf u\mapsto\mathbf u^T\mathbf vu↦uTv, and the support function is the published RobustMDP.Shared.supportFunction; both are real infima/suprema, genuine under 0<ϵ<10<\epsilon<10<ϵ<1, a probability measure, and a nonempty bounded set (the goal proves the latter). The order statistics use Mathlib's Tuple.sort; the index N−s+1N-s+1N−s+1 is N + 1 - s in natural numbers, which is the paper's value since 1≤s≤N+11\le s\le N+11≤s≤N+1.

The data are an array S : Fin N → Fin d → ℝ, S k i the kkk-th sample of marginal iii, under any probability law Q such that, for each iii, the samples S 0 i, …, S (N-1) i are i.i.d. from the iii-th marginal of P∗\mathbb P^*P∗ (IsMarginalSampleLaw). The dependence between samples of different marginals is left arbitrary, as the paper's asynchronous setting requires; i.i.d. draws of whole vectors are one admissible law. Probabilities of possibly non-measurable events are outer measures. The level ϵ\epsilonϵ is fixed: by Remark 11 the family {UϵM}\{\mathcal U^M_\epsilon\}{UϵM​} need not work for all ϵ\epsilonϵ simultaneously.

The guarantee is stated in the criterion form of Theorem 1(a) of the paper: δ∗(v∣UϵM)≥VaRϵP∗(v)\delta^*(\mathbf v\mid\mathcal U^M_\epsilon)\ge\mathrm{VaR}^{\mathbb P^*}_\epsilon(\mathbf v)δ∗(v∣UϵM​)≥VaRϵP∗​(v) for all v\mathbf vv, together with nonemptiness, convexity and compactness of UϵM\mathcal U^M_\epsilonUϵM​. Theorem 1 (mission I of this series) shows that for such sets this criterion is equivalent to implying a probabilistic guarantee. The coverage of the test is proved, not assumed: there is no hypothesis that P∗∈PM\mathbb P^*\in\mathcal P^MP∗∈PM. A formalization in which the support function is evaluated on an empty or unbounded set, where the library value is 0, would make the criterion trivial; the nonemptiness and compactness conjunct of the goal rules it out.

Standing assumptions: d≥1d\ge1d≥1, 0<ϵ<10<\epsilon<10<ϵ<1, 0<α<10<\alpha<10<α<1, u^(0)≤u^(N+1)\hat{\mathbf u}^{(0)}\le\hat{\mathbf u}^{(N+1)}u^(0)≤u^(N+1), P∗\mathbb P^*P∗ a probability measure with P∗\mathbb P^*P∗-null complement of the box, and Theorem 7's hypothesis N−s+1<sN-s+1<sN−s+1<s. The page prints the second condition of PM\mathcal P^MPM as "VaRϵ/dPi≥u^i(N−s+1)\mathrm{VaR}^{\mathbb P_i}_{\epsilon/d}\ge\hat u^{(N-s+1)}_iVaRϵ/dPi​​≥u^i(N−s+1)​"; the formal region uses the lower-tail condition VaRϵ/d(−ei)≤−u^i(N−s+1)\mathrm{VaR}_{\epsilon/d}(-\mathbf e_i)\le-\hat u^{(N-s+1)}_iVaRϵ/d​(−ei​)≤−u^i(N−s+1)​ that the hypothesis, its rejection rule and the proof use. (EC.8) is stated with "≤\le≤" for each P∈PM\mathbb P\in\mathcal P^MP∈PM; the page's middle equality is not claimed.

Reusable infrastructure welcome beyond this mission: order statistics of tuples and the binomial law of threshold counts for i.i.d. samples; monotonicity of binomial tails in the success probability; the left-limit property of quantiles; the Embrechts-type subadditivity bound for Value at Risk.

Selected references

  • D. Bertsimas, V. Gupta, N. Kallus, Data-Driven Robust Optimization, arXiv:1401.0212v2, 2014; Math. Program. 167:235–292, 2018. https://arxiv.org/abs/1401.0212
  • H. A. David, H. N. Nagaraja, Order Statistics, Wiley (cited by the paper as 1970; third edition 2003), §7.1, distribution-free confidence intervals for quantiles. https://doi.org/10.1002/0471722162
  • P. Embrechts, A. Höing, A. Juri, Using copulae to bound the Value-at-Risk for functions of dependent risks, Finance and Stochastics 7:145–167, 2003. https://doi.org/10.1007/s007800200085
11 thms3 active usersReviewed
🏆Completed
Convex OptimizationOperations ResearchProbability+1·Captain: mikedeng1

Data-Driven Robust Optimization VI: The Moment Set U^CS Has Support Function μ̂ᵀv + Γ₁‖v‖ + √(1/ε − 1)‖Cv‖, an Upper Bound on the Worst-Case Value at RiskResearch Paper

Motivation

In robust optimization, a constraint is checked against every parameter value in an uncertainty set. This turns uncertainty into a deterministic optimization problem, but the set must be chosen carefully: a large set can make decisions unnecessarily conservative, while a small one can miss likely outcomes. Bertsimas, Gupta and Kallus use data to calibrate sets through statistical confidence regions. Their question is whether feasibility for every parameter in the set protects a decision against a fresh uncertain outcome with a specified probability. This mission treats the part of their construction based on estimated first and second moments. Bertsimas, Gupta and Kallus, §8.1.

The moment region originates in a concentration result attributed in the paper to Shawe-Taylor and Cristianini. That result bounds the distance between sample and population means and covariances when the uncertain vector is supported in a Euclidean ball. Bertsimas, Gupta and Kallus also discuss replacing those analytic thresholds with bootstrap thresholds; they describe the resulting coverage as approximate. The present target concerns the mathematical relation between a fixed moment region and its uncertainty set, leaving the statistical calibration of the thresholds to its cited source. Shawe-Taylor and Cristianini, 2003; Bertsimas, Gupta and Kallus, pp. 24–25.

Setting

Let the uncertain vector u~\tilde uu~ take values in Rd\mathbb R^dRd. A probability law PPP belongs to the moment confidence region PCS\mathcal P^{CS}PCS when it is supported in the Euclidean ball of radius RRR, its mean mPm_PmP​ is within Γ1\Gamma_1Γ1​ of an estimate μ^\hat\muμ^​, and its covariance SPS_PSP​ is within Γ2\Gamma_2Γ2​ of an estimate Σ^\hat\SigmaΣ^ in Frobenius norm. The covariance is SP=EP[u~u~⊤]−mPmP⊤S_P=\mathbb E_P[\tilde u\tilde u^\top]-m_Pm_P^\topSP​=EP​[u~u~⊤]−mP​mP⊤​. The thresholds Γ1,Γ2\Gamma_1,\Gamma_2Γ1​,Γ2​ are nonnegative and can be chosen by either calibration procedure discussed in the paper. Bertsimas, Gupta and Kallus, Theorem 9 and (33).

For a vector vvv, Value at Risk VaR⁡εP(v)\operatorname{VaR}^{P}_{\varepsilon}(v)VaRεP​(v) is the smallest threshold ttt for which P(u~⊤v≤t)≥1−εP(\tilde u^\top v\le t)\ge1-\varepsilonP(u~⊤v≤t)≥1−ε. The support function of a set U\mathcal UU is δ∗(v∣U)=sup⁡u∈Uu⊤v\delta^*(v\mid\mathcal U)=\sup_{u\in\mathcal U}u^\top vδ∗(v∣U)=supu∈U​u⊤v. The authors construct the set

UεCS={μ^+y+C⊤w:∥y∥2≤Γ1, ∥w∥2≤1/ε−1},C⊤C=Σ^+Γ2I.\mathcal U^{CS}_{\varepsilon} =\{\hat\mu+y+C^\top w:\|y\|_2\le\Gamma_1,\ \|w\|_2\le\sqrt{1/\varepsilon-1}\}, \qquad C^\top C=\hat\Sigma+\Gamma_2 I.UεCS​={μ^​+y+C⊤w:∥y∥2​≤Γ1​, ∥w∥2​≤1/ε−1​},C⊤C=Σ^+Γ2​I.

Here 0<ε<10<\varepsilon<10<ε<1 is the allowed violation probability, III is the identity matrix, and CCC is a matrix factor of the adjusted covariance. The estimates and CCC stay fixed while ε\varepsilonε varies. Bertsimas, Gupta and Kallus, (34)–(35).

Formalization targets

The first milestone bounds the quantile for every law in the moment region:

VaR⁡εP(v)≤μ^⊤v+Γ1∥v∥2+1−εεv⊤(Σ^+Γ2I)v(P∈PCS).\operatorname{VaR}^{P}_{\varepsilon}(v)\le \hat\mu^\top v+\Gamma_1\|v\|_2+ \sqrt{\frac{1-\varepsilon}{\varepsilon}} \sqrt{v^\top(\hat\Sigma+\Gamma_2I)v} \quad(P\in\mathcal P^{CS}).VaRεP​(v)≤μ^​⊤v+Γ1​∥v∥2​+ε1−ε​​v⊤(Σ^+Γ2​I)v​(P∈PCS).

The second milestone evaluates the two linear maxima over the Euclidean balls in UεCS\mathcal U^{CS}_{\varepsilon}UεCS​ and identifies ∥Cv∥2\|Cv\|_2∥Cv∥2​ with the quadratic form above. The goal, the deterministic part of Theorem 10, says the displayed bound equals δ∗(v∣UεCS)\delta^*(v\mid\mathcal U^{CS}_{\varepsilon})δ∗(v∣UεCS​) for every vvv, while the set is nonempty, convex and compact. This gives the support-function criterion of Theorem 1 for each law in the region. A companion formalizes Theorem 13(a): the resulting support constraint is separately convex in (v,t)(v,t)(v,t) and in ε\varepsilonε for 0<ε<3/40<\varepsilon<3/40<ε<3/4. Bertsimas, Gupta and Kallus, Theorems 10 and 13(a).

Significance

The support formula turns a distributional statement about an entire region of probability laws into a deterministic bound on a linear projection. It gives the robust model an explicit quantity to compare with a constraint threshold. The companion convexity result describes which risk levels allow separate convex optimization in the decision variables and the violation probability. Together they explain why the particular set in (35) is useful beyond the fact that it contains plausible uncertain vectors. Bertsimas, Gupta and Kallus, §§8.1 and 9.

The paper proves the mathematical construction and cites statistical results for the region's coverage. In Lean, the published Value-at-Risk and support-function definitions are already available, while this paper's moment region and set (35) need their own definitions. Formalizing the result therefore establishes a reusable interface between moment bounds, quantiles and set support. The theorem statements in this proposal are open proof targets; compiling them checks their types, not their proofs.

Difficulty

A bound on the mean and covariance does not directly bound a high quantile of every projection. The bound must work simultaneously for every probability law in the moment region, including discrete laws and singular covariances. The factor (1−ε)/ε\sqrt{(1-\varepsilon)/\varepsilon}(1−ε)/ε​ is essential: replacing it by a standard deviation or a Gaussian quantile would change the claim. On the set side, the ordinary norm of a Lean function vector is a sup norm, whereas both balls in (35) are Euclidean. Getting the norm wrong changes the support function. Bertsimas, Gupta and Kallus, (34)–(35).

Formalization scope

Vectors are functions on Fin d, whose coordinates start at zero. enorm and frob explicitly compute the Euclidean and Frobenius norms. The ball-support condition in PCS\mathcal P^{CS}PCS secures finite first and second moments; no density is assumed. The goal fixes R≥0R\ge0R≥0, Γ1,Γ2≥0\Gamma_1,\Gamma_2\ge0Γ1​,Γ2​≥0, 0<ε<10<\varepsilon<10<ε<1, and C⊤C=Σ^+Γ2IC^\top C=\hat\Sigma+\Gamma_2IC⊤C=Σ^+Γ2​I. This factor relation makes the quadratic form nonnegative; a separate positive-semidefinite assumption on Σ^\hat\SigmaΣ^ is unnecessary. The matrix need not be triangular because (35) and its support depend on C⊤CC^\top CC⊤C. The uncertainty set's nonemptiness and compactness appear in the goal so the real support-function supremum cannot take Lean's default value for an empty or unbounded set.

Theorem 10's sampling claim is represented by its deterministic criterion for each P∈PCSP\in\mathcal P^{CS}P∈PCS. The confidence-region coverage of Theorem 9 is cited, and the bootstrap coverage discussed on p. 25 is approximate; neither is asserted as an exact probability theorem here. Equation (34) prints an equality for a supremum over PCS\mathcal P^{CS}PCS, yet that region restricts support to a ball, and the page does not establish attainment under that restriction. This mission uses the upper-bound direction needed for Theorem 10 and does not assert the equality or Remark 16's exact equivalence. The scope includes a sharp quantile bound, the exact support formula and the 3/43/43/4 convexity range; a definition that merely makes the claim true by construction would miss these targets. Bertsimas, Gupta and Kallus, pp. 24–25 and 29.

Selected references

  • D. Bertsimas, V. Gupta and N. Kallus, Data-Driven Robust Optimization, arXiv:1401.0212v2, 2014; revised in Mathematical Programming 167 (2018), 235–292. arXiv preprint.
  • J. Shawe-Taylor and N. Cristianini, Estimating the Moments of a Random Vector with Applications, 2003. University of Southampton ePrint.
  • G. C. Calafiore and L. El Ghaoui, On Distributionally Robust Chance-Constrained Linear Programs, Journal of Optimization Theory and Applications 130 (2006), 1–22. DOI.
6 thms4 active usersReviewed
Algebraic GeometryComplexity TheoryLinear Optimization+2·Captain: mikedeng1

Log-Barrier Interior Point Methods Are Not Strongly Polynomial 1: Every Polygonal Curve in the Wide Neighborhood of the Central Path of LW_r(t) from μ̄ ≤ 1 to μ̄ ≥ t² Has at Least 2^(r−1) SegmentsResearch Paper

Motivation

Interior point methods solve linear programs in a number of arithmetic operations polynomial in the bit length of the input (Karmarkar 1984). Whether linear programming admits a strongly polynomial algorithm, one whose number of arithmetic operations is bounded by a polynomial in the number of variables and constraints alone, is open; it is the ninth of Smale's problems for the next century (Smale 1998/2000, see the references). A natural question is whether some interior point method is strongly polynomial. Primal-dual path-following methods follow the central path of a log-barrier problem and are the methods used in practice.

Allamigeon, Benchimol, Gaubert and Joswig (arXiv:1708.01544, SIAM J. Appl. Algebra Geom. 2018) gave such a family. For linear programs LWr(t)\mathbf{LW}_r(t)LWr​(t) with 2r2r2r variables and 3r+13r+13r+1 constraints, every path-following method that stays in the wide neighborhood of the central path needs at least 2r−12^{r-1}2r−1 iterations once ttt is large enough. The same family disproves the "continuous Hirsch conjecture" of Deza, Terlaky and Zinchenko (DTZ09, see the references) on the total curvature of the central path. That curvature result is the subject of a separate mission. This mission formalizes the iteration bound.

Setting

For a real m×nm\times nm×n matrix AAA, b∈Rmb\in\mathbb R^mb∈Rm, c∈Rnc\in\mathbb R^nc∈Rn and N:=n+mN:=n+mN:=n+m, the paper considers the linear program in slack form and its dual,

LP(A,b,c): min⁡ ⟨c,x⟩  s.t.  Ax+w=b, (x,w)≥0,DualLP(A,b,c): s−A⊤y=c, (s,y)≥0.\mathrm{LP}(A,b,c):\ \min\ \langle c,x\rangle\ \text{ s.t. }\ Ax+w=b,\ (x,w)\ge0,\qquad \mathrm{DualLP}(A,b,c):\ s-A^\top y=c,\ (s,y)\ge0 .LP(A,b,c): min ⟨c,x⟩  s.t.  Ax+w=b, (x,w)≥0,DualLP(A,b,c): s−A⊤y=c, (s,y)≥0.

A primal-dual point is z=(x,w,s,y)∈R2Nz=(x,w,s,y)\in\mathbb R^{2N}z=(x,w,s,y)∈R2N. The set F∘\mathcal F^\circF∘ of strictly feasible points consists of the zzz with all 2N2N2N coordinates positive that satisfy both equality systems. The duality measure is

μˉ(z)=1N(⟨x,s⟩+⟨w,y⟩),\bar\mu(z)=\frac1N\big(\langle x,s\rangle+\langle w,y\rangle\big),μˉ​(z)=N1​(⟨x,s⟩+⟨w,y⟩),

and for 0<θ<10<\theta<10<θ<1 the wide neighborhood of the central path is

Nθ−∞={z∈F∘: xjsj≥(1−θ)μˉ(z) ∀j,  wiyi≥(1−θ)μˉ(z) ∀i}.\mathcal N^{-\infty}_\theta=\Big\{z\in\mathcal F^\circ:\ x_js_j\ge(1-\theta)\bar\mu(z)\ \forall j,\ \ w_iy_i\ge(1-\theta)\bar\mu(z)\ \forall i\Big\}.Nθ−∞​={z∈F∘: xj​sj​≥(1−θ)μˉ​(z) ∀j,  wi​yi​≥(1−θ)μˉ​(z) ∀i}.

The central path itself is the set of points where all products xjsjx_js_jxj​sj​, wiyiw_iy_iwi​yi​ are equal. The neighborhood bounds the products only from below. It contains the ℓ2\ell_2ℓ2​ and ℓ∞\ell_\inftyℓ∞​ neighborhoods used by short-step, long-step and predictor-corrector methods.

The instance is LWr(t)\mathbf{LW}_r(t)LWr​(t), for r≥1r\ge1r≥1 and t>0t>0t>0:

min⁡ x1  s.t.  x1≤t2, x2≤t, x2j+1≤t x2j−1, x2j+1≤t x2j, x2j+2≤t1−1/2j(x2j−1+x2j) (1≤j<r), x2r−1,x2r≥0.\min\ x_1\ \text{ s.t. }\ x_1\le t^2,\ x_2\le t,\ x_{2j+1}\le t\,x_{2j-1},\ x_{2j+1}\le t\,x_{2j},\ x_{2j+2}\le t^{1-1/2^j}(x_{2j-1}+x_{2j})\ (1\le j<r),\ x_{2r-1},x_{2r}\ge0 .min x1​  s.t.  x1​≤t2, x2​≤t, x2j+1​≤tx2j−1​, x2j+1​≤tx2j​, x2j+2​≤t1−1/2j(x2j−1​+x2j​) (1≤j<r), x2r−1​,x2r​≥0.

With slacks w1,…,w3r−1w_1,\dots,w_{3r-1}w1​,…,w3r−1​ it becomes LWr=(t)=LP(A,b,c)\mathbf{LW}^=_r(t)=\mathrm{LP}(A,b,c)LWr=​(t)=LP(A,b,c) with n=2rn=2rn=2r, m=3r−1m=3r-1m=3r−1, N=5r−1N=5r-1N=5r−1. Its wide neighborhood is written Nθ,t−∞\mathcal N^{-\infty}_{\theta,t}Nθ,t−∞​. A polygonal curve is a union [z0,z1]∪⋯∪[zp−1,zp][z^0,z^1]\cup\dots\cup[z^{p-1},z^p][z0,z1]∪⋯∪[zp−1,zp] of ppp segments, and it is contained in the neighborhood when every point of every segment is.

The milestones use the tropical semifield T=R∪{−∞}\mathbb T=\mathbb R\cup\{-\infty\}T=R∪{−∞} with a⊕b=max⁡(a,b)a\oplus b=\max(a,b)a⊕b=max(a,b) and a⊙b=a+ba\odot b=a+ba⊙b=a+b. The tropical segment tsegm(u,v)\mathsf{tsegm}(u,v)tsegm(u,v) is the set of points λ⊙u⊕μ⊙v\lambda\odot u\oplus\mu\odot vλ⊙u⊕μ⊙v with λ⊕μ=0\lambda\oplus\mu=0λ⊕μ=0. The Funk metric is δF(x,y)=max⁡(0,max⁡k(yk−xk))\delta_F(x,y)=\max(0,\max_k(y_k-x_k))δF​(x,y)=max(0,maxk​(yk​−xk​)), with d∞(x,y)=max⁡(δF(x,y),δF(y,x))d_\infty(x,y)=\max(\delta_F(x,y),\delta_F(y,x))d∞​(x,y)=max(δF​(x,y),δF​(y,x)) and the directed Hausdorff distance d∞(X,Y)=sup⁡x∈Xinf⁡y∈Yd∞(x,y)d_\infty(X,Y)=\sup_{x\in X}\inf_{y\in Y}d_\infty(x,y)d∞​(X,Y)=supx∈X​infy∈Y​d∞​(x,y). Finally, log⁡t\log_tlogt​ is applied coordinatewise, with log⁡t0=−∞\log_t0=-\inftylogt​0=−∞.

Formalization targets

Goal: Theorem 30 (p. 27)

Let r≥1r\ge1r≥1 and 0<θ<10<\theta<10<θ<1, and suppose that

t>(max⁡((10r−2)!, ((10r−1)!)24(1−θ)3))2r−1.(36)t>\Big(\max\Big((10r-2)!,\ \frac{((10r-1)!)^{24}}{(1-\theta)^3}\Big)\Big)^{2^{r-1}} .\tag{36}t>(max((10r−2)!, (1−θ)3((10r−1)!)24​))2r−1.(36)

If a polygonal curve [z0,z1]∪⋯∪[zp−1,zp][z^0,z^1]\cup\dots\cup[z^{p-1},z^p][z0,z1]∪⋯∪[zp−1,zp] is contained in Nθ,t−∞\mathcal N^{-\infty}_{\theta,t}Nθ,t−∞​ with μˉ(z0)≤1\bar\mu(z^0)\le1μˉ​(z0)≤1 and μˉ(zp)≥t2\bar\mu(z^p)\ge t^2μˉ​(zp)≥t2, then

p≥2r−1.p\ge2^{r-1}.p≥2r−1.

The threshold (36) is the paper's own explicit constant. Corollary 31 (Theorem B of the introduction) restates the result for algorithms. Any method whose iterates and the segments joining them stay in the wide neighborhood performs at least 2r−12^{r-1}2r−1 iterations to reduce the duality measure from t2t^2t2 to 111.

Milestones

  1. Proposition 1 (p. 5). On the primal-dual feasible set, μˉ((1−α)z+αz′)=(1−α)μˉ(z)+αμˉ(z′)\bar\mu((1-\alpha)z+\alpha z')=(1-\alpha)\bar\mu(z)+\alpha\bar\mu(z')μˉ​((1−α)z+αz′)=(1−α)μˉ​(z)+αμˉ​(z′) for all α∈R\alpha\in\mathbb Rα∈R.
  2. Lemma 5 (p. 10). For u≤vu\le vu≤v in Td\mathbb T^dTd, tsegm(u,v)\mathsf{tsegm}(u,v)tsegm(u,v) is a polygonal curve whose segments, oriented from uuu to vvv, have directions eK1,…,eKℓe^{K_1},\dots,e^{K_\ell}eK1​,…,eKℓ​ with K1⊊⋯⊊KℓK_1\subsetneq\dots\subsetneq K_\ellK1​⊊⋯⊊Kℓ​ and ℓ≤d\ell\le dℓ≤d.
  3. Lemma 8 (p. 11). For a segment S=[u,v]S=[u,v]S=[u,v] in R+d\mathbb R^d_+R+d​ and t>1t>1t>1,
d∞(tsegm(log⁡tu,log⁡tv), log⁡tS)≤log⁡t2.d_\infty\big(\mathsf{tsegm}(\log_tu,\log_tv),\ \log_tS\big)\le\log_t2 .d∞​(tsegm(logt​u,logt​v), logt​S)≤logt​2.
  1. Lemma 11 (p. 13). For a d×dd\times dd×d matrix M\mathbf MM with monomial entries ±tαij\pm t^{\alpha_{ij}}±tαij​ and t>1t>1t>1, log⁡t∣det⁡M(t)∣\log_t|\det\mathbf M(t)|logt​∣detM(t)∣ and val⁡(det⁡M)\operatorname{val}(\det\mathbf M)val(detM) differ by at most log⁡td!\log_td!logt​d!; the lower bound holds once t≥(d!)1/η(M)t\ge(d!)^{1/\eta(\mathbf M)}t≥(d!)1/η(M).
  2. Proposition 20 (p. 19). The explicit recursion for xλx^\lambdaxλ gives the greatest point of the tropical polyhedron {x∈P′:x1≤λ}\{x\in\mathcal P':x_1\le\lambda\}{x∈P′:x1​≤λ}, where P′⊆T2r\mathcal P'\subseteq\mathbb T^{2r}P′⊆T2r is cut out by the tropicalized constraints (26) of LWr\mathbf{LW}_rLWr​.

Significance

The theorem shows that the iteration count of a large class of primal-dual log-barrier interior point methods cannot be bounded by any function of rrr that grows more slowly than 2r−12^{r-1}2r−1, uniformly in the data. The class includes the methods of Kojima–Mizuno–Yoshise, Monteiro–Adler and Mizuno–Todd–Ye. No such method is strongly polynomial. The constraint matrix of LWr(t)\mathbf{LW}_r(t)LWr​(t) is fixed by rrr and ttt alone, so the bound concerns the combinatorial dimension, not the bit length. The only property of the method used is that its trajectory stays in Nθ,t−∞\mathcal N^{-\infty}_{\theta,t}Nθ,t−∞​. The lower bound therefore applies to every method with that property, whatever rule chooses its steps.

The result is proved in the paper; no machine-checked proof of it or of its tropical ingredients is known. A formalization would check the explicit threshold (36), which the paper derives in a few lines from bounds on Puiseux polyhedra. It would also produce reusable statements about tropical segments, the Funk and Hilbert metrics on Td\mathbb T^dTd, and determinants of monomial matrices.

Difficulty

Following the central path is not hard in principle: the obvious argument tracks the duality measure, which decreases by a constant factor per iteration in a neighborhood of the path. That argument gives only upper bounds. The lower bound requires showing that the neighborhood itself, for large ttt, is too thin to be crossed in a few straight steps, uniformly over every possible trajectory. The paper does this by passing to the limit t→∞t\to\inftyt→∞ on logarithmic scale. The image of Nθ,t−∞\mathcal N^{-\infty}_{\theta,t}Nθ,t−∞​ under log⁡t\log_tlogt​ collapses onto a piecewise-linear tropical central path, and a segment of R2N\mathbb R^{2N}R2N becomes, up to log⁡t2\log_t2logt​2, a tropical segment. The tropical central path of LWr\mathbf{LW}_rLWr​ then has to be shown to need 2r−12^{r-1}2r−1 tropical segments. The limit argument has to be made quantitative at a finite, explicit ttt. That is where the Puiseux-series machinery (Theorems 12, 15 and 19 of the paper) and the explicit constant enter.

Formalization scope

Everything is stated over R\mathbb RR and T\mathbb TT; the goal typechecks without the field of Puiseux series. A primal-dual point is an element of Rn×Rm×Rn×Rm\mathbb R^n\times\mathbb R^m\times\mathbb R^n\times\mathbb R^mRn×Rm×Rn×Rm. The dual equation is s−A⊤y=cs-A^\top y=cs−A⊤y=c with Mathlib's transpose, μˉ\bar\muμˉ​ divides by N=n+mN=n+mN=n+m (equal to 5r−15r-15r−1 for LWr=\mathbf{LW}^=_rLWr=​), and the wide neighborhood is one-sided. The instance matrix is generated from the paper's 1-based row and column numbers; Lean indices are 0-based. A polygonal curve is a map z:{0,…,p}→R2Nz:\{0,\dots,p\}\to\mathbb R^{2N}z:{0,…,p}→R2N with segment ℝ (z i) (z (i+1)) ⊆ N. The power 2r−12^{r-1}2r−1 in (36) is a natural-number power and the factorials are natural-number factorials. T\mathbb TT is WithBot ℝ, and distances that can be infinite take values in EReal, with the convention −∞+(+∞)=−∞-\infty+(+\infty)=-\infty−∞+(+∞)=−∞ encoded explicitly.

Two statements are repaired or restated. Lemma 11 is printed for all t>0t>0t>0, but its first inequality fails for 0<t<10<t<10<t<1 (for M=(t111)\mathbf M=\begin{pmatrix}t&1\\1&1\end{pmatrix}M=(t1​11​) at t=1/2t=1/2t=1/2), so it is stated for t>1t>1t>1. Lemma 8 makes explicit its implicit hypotheses t>1t>1t>1 and u,v≥0u,v\ge0u,v≥0. Proposition 20 is stated in the form its proof establishes, as the greatest point of a tropical polyhedron. Its identification with the valuation of the Puiseux central path is not part of the item. Monomial matrices are given by sign and exponent matrices, and the valuation of the determinant is computed from the permutation expansion.

A trivializing formalization is ruled out: Nθ,t−∞\mathcal N^{-\infty}_{\theta,t}Nθ,t−∞​ is not empty, since the build includes a sorry-free proof that it contains an explicit point for r=1r=1r=1, t=2t=2t=2, θ=1/2\theta=1/2θ=1/2. A curve with p=0p=0p=0 cannot satisfy both duality-measure conditions, since t2>1t^2>1t2>1.

The paper's Puiseux-series results are not posed: Theorems 12, 15, 19 and 29, Propositions 14, 16, 21 and 28, Corollary 17, and the count γ([0,2])≥2r−1\gamma([0,2])\ge2^{r-1}γ([0,2])≥2r−1 of §6.2. They need a faithful model of the field of absolutely convergent generalized Puiseux series and of the tropical central path. Contributions of that infrastructure, and of these statements as further milestones, are welcome. So are proofs of the five milestones, which need no Puiseux series. Proposition 1, Lemma 5 and Proposition 20 are elementary, and Lemma 8 and Lemma 11 are estimates with explicit constants.

Selected references

  • X. Allamigeon, P. Benchimol, S. Gaubert, M. Joswig, Log-barrier interior point methods are not strongly polynomial, SIAM J. Appl. Algebra Geom. 2(1), 2018; arXiv:1708.01544v2. https://arxiv.org/abs/1708.01544
  • A. Deza, T. Terlaky, Y. Zinchenko, Central path curvature and iteration-complexity for redundant Klee–Minty cubes, in Advances in Applied Mathematics and Global Optimization, Adv. Mech. Math. 17, Springer, 2009, pp. 223–256. https://doi.org/10.1007/978-0-387-75714-8
  • S. Smale, Mathematical problems for the next century, Math. Intelligencer 20(2), 1998, 7–15; reprinted in Mathematics: Frontiers and Perspectives, AMS, 2000. https://doi.org/10.1007/BF03025291
  • M. Develin, B. Sturmfels, Tropical convexity, Doc. Math. 9, 2004. https://arxiv.org/abs/math/0308254
  • S. J. Wright, Primal-Dual Interior-Point Methods, SIAM, 1997. https://doi.org/10.1137/1.9781611971453
  • X. Allamigeon, S. Gaubert, M. Skomra, Tropical spectrahedra, Discrete Comput. Geom. 63, 2020; arXiv:1610.06746. https://arxiv.org/abs/1610.06746
12 thms2 active usersReviewed
Graph TheoryOperations ResearchTheoretical Computer Science·Captain: mikedeng1

On the Approximability of Single-Machine Scheduling with Precedence Constraints 5: An r-Approximate Vertex Cover of the Variable-Cost Graph Yields an (r + ε)-Approximate Vertex Cover of GResearch Paper

Why the variable cost matters

The problem 1∣prec∣∑wjCj1|\mathrm{prec}|\sum w_jC_j1∣prec∣∑wj​Cj​ asks for an order in which to process jobs on one machine, respecting precedence constraints, so as to minimize the weighted sum of completion times. It is strongly NP-hard, and for decades the best approximation ratio known has been 222, achieved by several unrelated algorithms (LP relaxations, Sidney decompositions, primal–dual methods).

Correa and Schulz (2005) and Ambühl and Mastrolilli (2009) showed that the problem is a special case of weighted vertex cover: its objective splits into a fixed cost, the same for every feasible solution, and a variable cost, which equals the weight of a vertex cover in an auxiliary graph GPSG^S_{\mathbf P}GPS​. Approximating vertex cover in GPSG^S_{\mathbf P}GPS​ within a factor α\alphaα therefore approximates the scheduling problem within α\alphaα. Uhan observed that the classical 2-approximations owe their guarantee to the fixed cost and can be arbitrarily bad on the variable cost alone.

Section 8 of Ambühl, Mastrolilli, Mutsanas and Svensson, Math. Oper. Res. 36(4) (2011) (DOI), proves the converse: approximating the variable cost is as hard as approximating vertex cover itself. A better-than-2 algorithm for 1∣prec∣∑wjCj1|\mathrm{prec}|\sum w_jC_j1∣prec∣∑wj​Cj​ must therefore either exploit the fixed cost or improve on the best known approximation for vertex cover, a long-standing open question.

Setting

Scheduling instance. A finite set NNN of jobs, a partial order P=(N,P)\mathbf P = (N,P)P=(N,P) (reflexive; (i,j)∈P(i,j) \in P(i,j)∈P, i≠ji \ne ji=j, means iii precedes jjj), processing times pj≥0p_j \ge 0pj​≥0 and weights wj≥0w_j \ge 0wj​≥0.

Incomparable pairs. Jobs x,yx,yx,y are incomparable, x∥yx \parallel yx∥y, if neither (x,y)(x,y)(x,y) nor (y,x)(y,x)(y,x) lies in PPP. The set inc⁡(P)\operatorname{inc}(\mathbf P)inc(P) consists of the ordered pairs (x,y)(x,y)(x,y) with x∥yx \parallel yx∥y.

The vertex cover graph GPSG^S_{\mathbf P}GPS​. One node per incomparable pair (i,j)(i,j)(i,j), of weight w(i,j)=piwjw_{(i,j)} = p_i w_jw(i,j)​=pi​wj​. Distinct nodes (i,j)(i,j)(i,j) and (k,ℓ)(k,\ell)(k,ℓ) are adjacent when, in one of the two orders, j=kj=kj=k and i=ℓi=\elli=ℓ, or j=kj=kj=k and (i,ℓ)∈P(i,\ell)\in P(i,ℓ)∈P, or (i,ℓ),(k,j)∈P(i,\ell),(k,j) \in P(i,ℓ),(k,j)∈P. For a set CCC of nodes, w(C)=∑u∈Cwuw(C) = \sum_{u\in C} w_uw(C)=∑u∈C​wu​; for a vertex cover CCC this is the variable cost, and τw(GPS)\tau_w(G^S_{\mathbf P})τw​(GPS​) is its minimum over all vertex covers.

The instance S(G,k)S(G,k)S(G,k). Given a graph G=(V,E)G=(V,E)G=(V,E) with V={v1,…,vn}V = \{v_1,\dots,v_n\}V={v1​,…,vn​} and k>0k > 0k>0, the instance has jobs vi′v'_ivi′​ (processing time k−ik^{-i}k−i, weight 000) and vi′′v''_ivi′′​ (processing time 000, weight kik^{i}ki), and precedence constraints vi′<vj′′v'_i < v''_jvi′​<vj′′​ and vj′<vi′′v'_j < v''_ivj′​<vi′′​ for each edge {vi,vj}∈E\{v_i,v_j\} \in E{vi​,vj​}∈E, plus vi′<vj′′v'_i < v''_jvi′​<vj′′​ for all i<ji<ji<j. The nodes (vi′,vi′′)(v'_i, v''_i)(vi′​,vi′′​) of GPSG^S_{\mathbf P}GPS​ have weight 111 and are called heavy; all others are light. For a set CCC of nodes, CG={vi:(vi′,vi′′)∈C}C_G = \{v_i : (v'_i,v''_i)\in C\}CG​={vi​:(vi′​,vi′′​)∈C}. The vertex cover number of GGG is τ(G)\tau(G)τ(G).

Formalization targets

Goal: Theorem 8.1

For every graph GGG on nnn vertices, every r≥1r \ge 1r≥1, ε>0\varepsilon>0ε>0 and every k≥1k \ge 1k≥1 with k>n2r/εk > n^2r/\varepsilonk>n2r/ε: if CCC is a vertex cover of GPSG^S_{\mathbf P}GPS​ for S=S(G,k)S = S(G,k)S=S(G,k) with w(C)≤r τw(GPS)w(C) \le r\,\tau_w(G^S_{\mathbf P})w(C)≤rτw​(GPS​), then CGC_GCG​ is a vertex cover of GGG,

∣CG∣≤r(τ(G)+n2k),|C_G| \le r\Bigl(\tau(G) + \frac{n^2}{k}\Bigr),∣CG​∣≤r(τ(G)+kn2​),

and, when E≠∅E \ne \emptysetE=∅,

∣CG∣≤r(1+n2k)τ(G)<(r+ε) τ(G).|C_G| \le r\Bigl(1+\frac{n^2}{k}\Bigr)\tau(G) < (r+\varepsilon)\,\tau(G).∣CG​∣≤r(1+kn2​)τ(G)<(r+ε)τ(G).

The paper words the theorem as "approximating the variable cost of 1∣prec∣∑wjCj1|\mathrm{prec}|\sum w_jC_j1∣prec∣∑wj​Cj​ is as hard as approximating vertex cover"; the statement above is the mathematical content its proof establishes.

Milestones (§8, p. 664)

  1. In GPSG^S_{\mathbf P}GPS​, every heavy node has weight 111, every light node has weight at most 1/k1/k1/k, and the light nodes have total weight at most n2/kn^2/kn2/k (for k≥1k \ge 1k≥1).
  2. Heavy nodes (vi′,vi′′)(v'_i,v''_i)(vi′​,vi′′​) and (vj′,vj′′)(v'_j,v''_j)(vj′​,vj′′​) are adjacent if and only if {vi,vj}∈E\{v_i,v_j\}\in E{vi​,vj​}∈E; for k>1k>1k>1 the subgraph induced by the weight-1 nodes is isomorphic to GGG via (vi′,vi′′)↦vi(v'_i,v''_i) \mapsto v_i(vi′​,vi′′​)↦vi​.

Significance

The result. Theorem 8.1 is one half of an equivalence: by Theorem 2.1 (Correa–Schulz, Ambühl–Mastrolilli), minimizing the variable cost is a special case of weighted vertex cover; by Theorem 8.1, it is also as hard to approximate. Any hardness of approximation for vertex cover (NP-hardness of factor 1.361.361.36 by Dinur and Safra; factor 2−δ2-\delta2−δ under the unique games conjecture by Khot and Regev) transfers to the variable cost. It also explains why the known 2-approximations must rely on the fixed cost, and it frames the later result of Bansal and Khot that the full objective is hard to approximate within 2−δ2-\delta2−δ under a variant of the unique games conjecture.

Formalizing it. The theorem is proved in the paper; no machine-checked version exists. The mission produces a checked account of the reduction: the vertex cover graph of an arbitrary precedence-constrained instance, the adjacency-poset instance built from a graph, and the quantitative transfer of approximation ratios. The definition of GPSG^S_{\mathbf P}GPS​ is shared with the other missions of this series.

Difficulty

The construction is short; the care is in the bookkeeping. One must check that the precedence relation is a partial order, determine exactly which ordered pairs are incomparable, verify that two heavy nodes are adjacent only through the third clause of the adjacency rule and only when the corresponding vertices are adjacent in GGG, and bound the weights of all remaining nodes, including the many nodes of weight 000. The transfer then compares an approximate cover of GPSG^S_{\mathbf P}GPS​ with an optimal one whose heavy part comes from an optimal cover of GGG; the additive error n2/kn^2/kn2/k must be converted into a multiplicative one, which requires τ(G)≥1\tau(G)\ge 1τ(G)≥1.

A first reading of the page suggests that GPSG^S_{\mathbf P}GPS​ has at most n2n^2n2 nodes; it does not. The pairs (vi′,vj′)(v'_i,v'_j)(vi′​,vj′​) and (vi′′,vj′′)(v''_i,v''_j)(vi′′​,vj′′​) with i≠ji\ne ji=j are incomparable nodes of weight 000, so there can be up to 4n2−2n4n^2-2n4n2−2n nodes. Only nodes of positive weight are few.

Formalization scope

  • Model. Jobs form a finite type; precedence constraints are an explicit reflexive partial-order relation P : N → N → Prop. Processing times and weights are nonnegative reals. The vertex cover graph is a SimpleGraph on the subtype of incomparable ordered pairs, using the symmetric closure of the printed adjacency rule without loops. Vertex covers are Mathlib's SimpleGraph.IsVertexCover; τ(G)\tau(G)τ(G) is Mathlib's vertexCoverNum, finite for a finite graph and converted with toNat; τw(GPS)\tau_w(G^S_{\mathbf P})τw​(GPS​) is a minimum over finite vertex covers.
  • The instance. The graph is a SimpleGraph (Fin n); i : Fin n stands for vi+1v_{i+1}vi+1​, so exponents are i+1i+1i+1 and the order i<ji<ji<j is that of Fin n. Jobs are Fin n ⊕ Fin n (v′v'v′ left, v′′v''v′′ right). The parameter kkk is in R≥0\mathbb R_{\ge 0}R≥0​.
  • Added hypotheses. k≥1k \ge 1k≥1, implicit in the page ("k>n2r/εk > n^2r/\varepsilonk>n2r/ε" does not imply it when ε\varepsilonε is large, and for k<1k<1k<1 the light nodes outweigh the heavy ones). The isomorphism with GGG is stated for k>1k > 1k>1, since at k=1k=1k=1 some light nodes also have weight 111. The multiplicative bound requires E≠∅E \ne \emptysetE=∅; the additive bound holds for every graph.
  • Not formalized. The phrases "approximation algorithm", "polynomial time" and "as hard as"; the passage from vertex covers of GPSG^S_{\mathbf P}GPS​ to schedules (Theorem 2.1, cited from Correa–Schulz and Ambühl–Mastrolilli); the fixed cost. What is stated instead is the explicit map C↦CGC \mapsto C_GC↦CG​ and the ratio it achieves, r(1+n2/k)<r+εr(1+n^2/k) < r+\varepsilonr(1+n2/k)<r+ε. The false count "at most n2n^2n2 vertices" is not stated.
  • Ruled out. The goal is not a statement about an arbitrary graph or an assumed cover of GGG: it concerns the specific instance S(G,k)S(G,k)S(G,k) and every CCC that is an rrr-approximate vertex cover of its graph, and the fact that CGC_GCG​ covers GGG is a conclusion, not a hypothesis.
  • Welcome contributions. Proofs of the two milestones and of the goal; general lemmas on GPSG^S_{\mathbf P}GPS​ (weights of vertex covers, behaviour under induced subgraphs) are reusable across the series.

Selected references

  • C. Ambühl, M. Mastrolilli, N. Mutsanas, O. Svensson, On the Approximability of Single-Machine Scheduling with Precedence Constraints, Mathematics of Operations Research 36(4):653–669, 2011. https://doi.org/10.1287/moor.1110.0512
  • J. R. Correa, A. S. Schulz, Single-Machine Scheduling with Precedence Constraints, Mathematics of Operations Research 30(4):1005–1021, 2005. https://doi.org/10.1287/moor.1050.0158
  • C. Ambühl, M. Mastrolilli, Single Machine Precedence Constrained Scheduling Is a Vertex Cover Problem, Algorithmica 53(4):488–503, 2009. https://doi.org/10.1007/s00453-008-9251-6
  • I. Dinur, S. Safra, On the Hardness of Approximating Minimum Vertex Cover, Annals of Mathematics 162(1):439–485, 2005. https://doi.org/10.4007/annals.2005.162.439
  • S. Khot, O. Regev, Vertex Cover Might Be Hard to Approximate to within 2 − ε, Journal of Computer and System Sciences 74(3):335–349, 2008. https://doi.org/10.1016/j.jcss.2007.06.019
  • N. Bansal, S. Khot, Optimal Long Code Test with One Free Bit, FOCS 2009, 453–462. https://doi.org/10.1109/FOCS.2009.23
5 thms1 active userReviewed
CombinatoricsGraph TheoryOperations Research+1·Captain: mikedeng1

On the Approximability of Single-Machine Scheduling with Precedence Constraints 4: Vertex Cover in Connected Graphs of Degree ≤ 3 Reduces to Weighted Vertex Cover for Interval-Order InstancesResearch Paper

Motivation

In the single-machine scheduling problem 1∣prec∣∑wjCj1|\mathrm{prec}|\sum w_jC_j1∣prec∣∑wj​Cj​, a set NNN of nnn jobs, each with a processing time pj≥0p_j\ge 0pj​≥0 and a weight wj≥0w_j\ge 0wj​≥0, is processed on one machine without interruption, subject to precedence constraints given by a partial order PPP on NNN. The aim is to minimize the weighted sum of completion times ∑jwjCj\sum_j w_jC_j∑j​wj​Cj​. The problem is strongly NP-hard for general precedence constraints (Lawler 1978; Lenstra and Rinnooy Kan 1978), and its approximability was a recurring open question in scheduling theory (Schuurman and Woeginger 1999).

A line of work by Chudak and Hochbaum, Correa and Schulz, and Ambühl and Mastrolilli showed that the problem is a special case of minimum weighted vertex cover in a graph GPSG^S_PGPS​ built from the instance. Many problems on partial orders become polynomial when the order is an interval order, so it is natural to ask whether this one does too. Section 7 of Ambühl, Mastrolilli, Mutsanas and Svensson (Math. Oper. Res. 2011) answers no: the problem stays NP-hard on interval orders. The proof is a reduction from vertex cover in connected graphs of maximum degree 3. This mission formalizes the correctness of that reduction.

Setting

A poset P=(N,P)P=(N,P)P=(N,P) is read as a reflexive relation: (x,y)∈P(x,y)\in P(x,y)∈P means x≤yx\le yx≤y. Jobs x,yx,yx,y are incomparable if neither (x,y)(x,y)(x,y) nor (y,x)(y,x)(y,x) is in PPP, and inc⁡(P)\operatorname{inc}(P)inc(P) is the set of ordered incomparable pairs. The vertex cover graph GPSG^S_PGPS​ has one node (i,j)(i,j)(i,j) for each incomparable pair, weighted piwjp_iw_jpi​wj​. Two nodes (i,j)(i,j)(i,j) and (k,ℓ)(k,\ell)(k,ℓ) are adjacent if j=kj=kj=k and i=ℓi=\elli=ℓ, or j=kj=kj=k and (i,ℓ)∈P(i,\ell)\in P(i,ℓ)∈P, or (i,ℓ)∈P(i,\ell)\in P(i,ℓ)∈P and (k,j)∈P(k,j)\in P(k,j)∈P. Write w(CI)w(C_I)w(CI​) for the minimum weight of a vertex cover of GISG^S_IGIS​.

A poset is an interval order if each element xxx can be assigned a closed real interval [ax,bx][a_x,b_x][ax​,bx​] such that x<yx<yx<y if and only if bx<ayb_x<a_ybx​<ay​.

The reduction starts from a graph G=(V,E)G=(V,E)G=(V,E) with vertices v1,…,vNv_1,\dots,v_Nv1​,…,vN​ and a spanning tree T=(V,ET)T=(V,E_T)T=(V,ET​) rooted at v1v_1v1​, numbered so that each parent comes before its children. The paper uses a breadth-first search tree.

  • Stage 1. The graph G′G'G′ is built from TTT. Each viv_ivi​ gets a pendant path vi−u1i−u2iv_i - u^i_1 - u^i_2vi​−u1i​−u2i​. Each non-tree edge {vi,vj}∈E∖ET\{v_i,v_j\}\in E\setminus E_T{vi​,vj​}∈E∖ET​ with i<ji<ji<j gets the path vi−e1ij−e2ij−u2jv_i - e^{ij}_1 - e^{ij}_2 - u^j_2vi​−e1ij​−e2ij​−u2j​. The non-tree edges themselves are not edges of G′G'G′.
  • Stage 2. The scheduling instance SSS has jobs s0s_0s0​, s1,…,sNs_1,\dots,s_Ns1​,…,sN​, m1,…,mNm_1,\dots,m_Nm1​,…,mN​, e1,…,eNe_1,\dots,e_Ne1​,…,eN​, and bijb_{ij}bij​ for each non-tree edge. Their intervals, processing times and weights are given in a table on p. 662. For example, sjs_jsj​ has interval [i,j][i,j][i,j], processing time 1/kj1/k^j1/kj and weight kik^iki, where viv_ivi​ is the parent of vjv_jvj​. The precedence constraints III are the interval order of these intervals. With nnn the number of jobs, the parameter is k=n2+1k=n^2+1k=n2+1.
  • The set DDD. It is {(s0,s1)}∪{(si,sj):vi parent of vj}∪{(si,mi),(mi,ei)}∪{(si,bij),(bij,mj)}\{(s_0,s_1)\}\cup\{(s_i,s_j): v_i \text{ parent of } v_j\}\cup\{(s_i,m_i),(m_i,e_i)\}\cup\{(s_i,b_{ij}),(b_{ij},m_j)\}{(s0​,s1​)}∪{(si​,sj​):vi​ parent of vj​}∪{(si​,mi​),(mi​,ei​)}∪{(si​,bij​),(bij​,mj​)}. The graph GI′G'_IGI′​ is the subgraph of GISG^S_IGIS​ induced by DDD.

Formalization targets

Goal: Theorem 7.1 (p. 661)

For every connected graph GGG of maximum degree at most 333, every parent-first spanning tree TTT and every m∈Nm\in\mathbb Nm∈N, the precedence constraints III of SSS form an interval order, and

G has a vertex cover of size≤m  ⟺  ⌊w(CI)⌋≤m+∣V∣+∣E∖ET∣.G \text{ has a vertex cover of size} \le m \iff \lfloor w(C_I)\rfloor \le m + |V| + |E\setminus E_T|.G has a vertex cover of size≤m⟺⌊w(CI​)⌋≤m+∣V∣+∣E∖ET​∣.

Milestones, in the order the proof uses them

  • Claim 1 (p. 662): τ(G′)=τ(G)+∣V∣+∣E∖ET∣\tau(G') = \tau(G)+|V|+|E\setminus E_T|τ(G′)=τ(G)+∣V∣+∣E∖ET​∣, where τ\tauτ is the vertex cover number.
  • Remark 7.1 (p. 662): for jobs with intervals [a,b][a,b][a,b] and [c,d][c,d][c,d] and a≤da\le da≤d, pi≤1/k⌈b⌉p_i\le 1/k^{\lceil b\rceil}pi​≤1/k⌈b⌉ and wj≤k⌈c⌉w_j\le k^{\lceil c\rceil}wj​≤k⌈c⌉. On incomparable pairs piwj∈{1}∪[0,1/k]p_iw_j\in\{1\}\cup[0,1/k]pi​wj​∈{1}∪[0,1/k]. Moreover, piwj≥kp_iw_j\ge kpi​wj​≥k forces b<cb<cb<c, and piwj=1p_iw_j=1pi​wj​=1 forces ⌈b⌉=⌈c⌉\lceil b\rceil=\lceil c\rceil⌈b⌉=⌈c⌉.
  • Claim 2 (p. 663): an incomparable pair (i,j)(i,j)(i,j) has piwj=1p_iw_j=1pi​wj​=1 if it is in DDD, and piwj≤1/kp_iw_j\le 1/kpi​wj​≤1/k otherwise.
  • Claim 3 (p. 663): GI′≅G′G'_I\cong G'GI′​≅G′.
  • §7, p. 664: with k=n2+1k=n^2+1k=n2+1, ∑(i,j)∈inc⁡(I)∖Dpiwj<1\sum_{(i,j)\in\operatorname{inc}(I)\setminus D}p_iw_j<1∑(i,j)∈inc(I)∖D​pi​wj​<1, and hence w(CI′)=⌊w(CI)⌋w(C'_I)=\lfloor w(C_I)\rfloorw(CI′​)=⌊w(CI​)⌋.

Significance

The result. Interval orders are a standard tractable class: several scheduling and order-theoretic problems that are hard in general become polynomial on them (Papadimitriou and Yannakakis 1979). Theorem 7.1 puts 1∣prec∣∑wjCj1|\mathrm{prec}|\sum w_jC_j1∣prec∣∑wj​Cj​ outside this pattern. Section 6 of the same paper shows that the problem nonetheless has a 3/23/23/2-approximation on interval orders, so hardness and approximability are separated on this class. The paper also remarks that the proof makes weighted vertex cover NP-hard to approximate within some factor r>1r>1r>1 on the graphs GISG^S_IGIS​ arising from interval orders.

Formalizing it. The theorem is proved in the paper. Nothing in this mission is open, and none of it has been machine-checked before. The work splits into the following parts:

  • a gadget argument on unweighted vertex covers (Claim 1, after Alimonti and Kann);
  • an exact case analysis of incomparable pairs in a concrete interval order (Remark 7.1, Claim 2);
  • a graph isomorphism (Claim 3);
  • a rounding argument that links weighted and unweighted optima.

The definitions of GPSG^S_PGPS​ and of minimum-weight vertex covers are shared with the other missions of this series.

Difficulty

The construction is explicit, and each step is elementary. The work is in the bookkeeping. Claim 2 requires classifying every incomparable pair of jobs, including pairs of different kinds such as (bij,sℓ)(b_{ij}, s_\ell)(bij​,sℓ​), by comparing ceilings of interval endpoints. Half-integer endpoints (mim_imi​, bijb_{ij}bij​) are exactly what separates weight-one pairs from comparable ones. Claim 3 requires checking adjacency in GISG^S_IGIS​ for all pairs of nodes of DDD in both directions. The paper writes out two cases in each direction and calls the rest similar.

Claim 1 has a direction that is not simply local. A vertex cover of G′G'G′ that misses both endpoints of a non-tree edge has to be repaired by swapping gadget vertices, and the repair must be repeated without increasing the size.

A natural first idea is to treat the light nodes (weight at most 1/k1/k1/k) as negligible one at a time. This does not suffice: the argument needs their total weight to stay below 111, which is what forces kkk to grow with n2n^2n2.

Formalization scope

  • Graph and tree. GGG is a SimpleGraph (Fin N); vertex vi+1v_{i+1}vi+1​ is i, and the root is index 0. The tree is a TreeLayout: a parent function returning none exactly at the root, with each parent of smaller index and adjacent in GGG. The statements hold for every such layout. This is stronger than the paper's breadth-first tree, and the proof uses only "parent before child".
  • Hypotheses of the goal. Connectivity and the degree bound ((G.neighborSet v).ncard ≤ 3) are kept as in the paper. They matter only for the NP-completeness of the source problem.
  • Jobs. The jobs form an inductive type with one constructor per row of the table. Their order is a PartialOrder instance: x≤yx\le yx≤y iff x=yx=yx=y or bx<ayb_x<a_ybx​<ay​. Processing times and weights are real numbers. Section 1 of the paper asks for nonnegative integers, but the instance uses 1/kj1/k^j1/kj and the formalization follows the instance as printed.
  • Constants. The constants are explicit: k=n2+1k=n^2+1k=n2+1 with nnn the cardinality of the job type, and c=∣V∣+∣E∖ET∣c=|V|+|E\setminus E_T|c=∣V∣+∣E∖ET​∣. Remark 7.1 and Claim 2 are stated for every real k>1k>1k>1.
  • Optimum values. w(CI)w(C_I)w(CI​) is a minimum over the finite family of vertex covers. Unweighted cover numbers are Mathlib's SimpleGraph.vertexCoverNum. The floor is Nat.floor, which agrees with the integer floor because w(CI)≥0w(C_I)\ge 0w(CI​)≥0.
  • Not formalized. The goal's wording ("NP-hard") is not formalized. Neither are the NP-completeness of degree-3 vertex cover (Garey, Johnson and Stockmeyer), the polynomial size of the construction, or Theorem 2.1 (cited), which turns a vertex cover of GISG^S_IGIS​ into a schedule. What is stated is the correctness of the reduction: the instance has interval-order constraints, and its optimum decides the vertex cover question.
  • No trivialization. The instance SSS is built from GGG and TTT exactly as in the table. The goal quantifies over all graphs and layouts, never over an instance SSS assumed to have the properties.
  • Contributions. Contributions are welcome on any milestone. Claims 1 and 3 are independent of the weights, and Claim 2 is independent of the graph theory.

Selected references

  • C. Ambühl, M. Mastrolilli, N. Mutsanas, O. Svensson, On the Approximability of Single-Machine Scheduling with Precedence Constraints, Math. Oper. Res. 36(4):653–669, 2011. https://doi.org/10.1287/moor.1110.0512
  • C. Ambühl, M. Mastrolilli, Single machine precedence constrained scheduling is a vertex cover problem, Algorithmica 53(4):488–503, 2009. https://doi.org/10.1007/s00453-008-9251-1
  • J. R. Correa, A. S. Schulz, Single machine scheduling with precedence constraints, Math. Oper. Res. 30(4):1005–1021, 2005. https://doi.org/10.1287/moor.1050.0158
  • P. Alimonti, V. Kann, Some APX-completeness results for cubic graphs, Theoret. Comput. Sci. 237(1–2):123–134, 2000. https://doi.org/10.1016/S0304-3975(98)00158-3
  • M. R. Garey, D. S. Johnson, L. Stockmeyer, Some simplified NP-complete graph problems, Theoret. Comput. Sci. 1(3):237–267, 1976. https://doi.org/10.1016/0304-3975(76)90059-1
  • C. H. Papadimitriou, M. Yannakakis, Scheduling interval-ordered tasks, SIAM J. Comput. 8(3):405–409, 1979. https://doi.org/10.1137/0208031
10 thms1 active userReviewed
🏆Completed
CombinatoricsGraph TheoryOperations Research+1·Captain: mikedeng1

On the Approximability of Single-Machine Scheduling with Precedence Constraints 1: A k-Fold Realizer of Size t Yields a Vertex Cover of Expected Weight at Most (2 − 2/(t/k)) Times OptimalResearch Paper

Motivation

Single-machine scheduling with precedence constraints, written 1∣prec∣∑wjCj1|\mathrm{prec}|\sum w_jC_j1∣prec∣∑wj​Cj​ in the notation of Graham et al., asks for an order of nnn weighted jobs on one machine that respects a given partial order and minimizes the weighted sum of completion times. The problem is strongly NP-hard (Lawler 1978; Lenstra and Rinnooy Kan 1978), and closing its approximability gap is listed by Schuurman and Woeginger among ten outstanding open problems in scheduling theory. Several 2-approximation algorithms are known (Schulz 1996; Hall et al. 1997; Chudak and Hochbaum 1999; Chekuri and Motwani 1999; Margot et al. 2003).

A line of work by Chudak and Hochbaum, Correa and Schulz, and Ambühl and Mastrolilli showed that the problem is a special case of minimum weighted vertex cover in a graph built from the precedence order. Ambühl, Mastrolilli, Mutsanas and Svensson (Math. Oper. Res. 36(4), 2011) observed that this graph is the graph of incomparable pairs of dimension theory, and used that identification to obtain (2−2/f)(2-2/f)(2−2/f)-approximations for orders of fractional dimension at most fff. This mission formalizes that framework: the identification of the two graphs and the rounding guarantee of the paper's Theorem 5.1.

Setting

An instance SSS consists of a finite set NNN of jobs, a partial order PPP on NNN (reflexive, antisymmetric, transitive; (i,j)∈P(i,j)\in P(i,j)∈P with i≠ji\ne ji=j means job iii finishes before job jjj starts), processing times pj≥0p_j\ge 0pj​≥0 and weights wj≥0w_j\ge 0wj​≥0.

Two jobs x,yx,yx,y are incomparable, x∥yx\parallel yx∥y, when neither (x,y)(x,y)(x,y) nor (y,x)(y,x)(y,x) lies in PPP. The set inc⁡(P)\operatorname{inc}(P)inc(P) of incomparable pairs consists of ordered pairs and is closed under swapping. A linear extension of PPP is a linear order L⊇PL\supseteq PL⊇P on NNN; it reverses (x,y)∈inc⁡(P)(x,y)\in\operatorname{inc}(P)(x,y)∈inc(P) when y<xy<xy<x in LLL. A nonempty multiset L1,…,LtL_1,\dots,L_tL1​,…,Lt​ of linear extensions is a k:tk:tk:t-realizer if every incomparable pair is reversed by at least kkk of them. The fractional dimension fdim⁡(P)\operatorname{fdim}(P)fdim(P) is the least ratio t/kt/kt/k over all k:tk:tk:t-realizers.

The vertex cover graph GPSG^S_PGPS​ has the incomparable pairs as nodes; nodes (i,j)(i,j)(i,j) and (k,ℓ)(k,\ell)(k,ℓ) are adjacent if j=kj=kj=k and i=ℓi=\elli=ℓ, or j=kj=kj=k and (i,ℓ)∈P(i,\ell)\in P(i,ℓ)∈P, or (i,ℓ),(k,j)∈P(i,\ell),(k,j)\in P(i,ℓ),(k,j)∈P (symmetrically closed). Node (i,j)(i,j)(i,j) has weight w(i,j)=piwjw_{(i,j)}=p_iw_jw(i,j)​=pi​wj​, and w(C)=∑u∈Cwuw(C)=\sum_{u\in C}w_uw(C)=∑u∈C​wu​. OPT\mathrm{OPT}OPT is the minimum weight of a vertex cover of GPSG^S_PGPS​. The LP relaxation [CS-LP] asks for x∈[0,1]inc⁡(P)x\in[0,1]^{\operatorname{inc}(P)}x∈[0,1]inc(P) with xu+xv≥1x_u+x_v\ge1xu​+xv​≥1 on every edge, minimizing ∑uwuxu\sum_u w_ux_u∑u​wu​xu​. For a solution xxx write Va={u:xu=a}V_a=\{u: x_u=a\}Va​={u:xu​=a}, and for a linear extension LLL let I1/2(L)I_{1/2}(L)I1/2​(L) be the pairs of V1/2V_{1/2}V1/2​ reversed in LLL.

The graph of incomparable pairs GPG_PGP​ (Felsner and Trotter 2000) also has the incomparable pairs as vertices; two of them are adjacent when the pair of them is a minimal set of incomparable pairs that no linear extension reverses entirely.

Formalization targets

Goal: Theorem 5.1 (p. 658)

For an instance SSS, a k:tk:tk:t-realizer L1,…,LtL_1,\dots,L_tL1​,…,Lt​ of PPP, and a half-integral optimal solution xxx of [CS-LP], put Ci=V1∪(V1/2∖I1/2(Li))C_i=V_1\cup\bigl(V_{1/2}\setminus I_{1/2}(L_i)\bigr)Ci​=V1​∪(V1/2​∖I1/2​(Li​)). Then every CiC_iCi​ is a vertex cover of GPSG^S_PGPS​, and

1t∑i=1tw(Ci)  ≤  (2−2t/k)OPT.\frac1t\sum_{i=1}^t w(C_i)\;\le\;\Bigl(2-\frac{2}{t/k}\Bigr)\mathrm{OPT}.t1​i=1∑t​w(Ci​)≤(2−t/k2​)OPT.

Milestones

  • Proposition 3.2 (p. 657): GPS=GPG^S_P=G_PGPS​=GP​.
  • Footnote 4 (p. 659): the pairs reversed by a linear extension are independent in GPSG^S_PGPS​.
  • Eq. (4): 1t∣{i:Li reverses u}∣≥k/t\frac1t|\{i: L_i\text{ reverses }u\}|\ge k/tt1​∣{i:Li​ reverses u}∣≥k/t for every incomparable pair uuu.
  • Eq. (5): 1t∑iw(I1/2(Li))≥kt w(V1/2)\frac1t\sum_i w(I_{1/2}(L_i))\ge \frac kt\,w(V_{1/2})t1​∑i​w(I1/2​(Li​))≥tk​w(V1/2​).
  • Hochbaum's observation (§5, p. 659): for half-integral feasible xxx, V1∪CV_1\cup CV1​∪C covers GPSG^S_PGPS​ whenever CCC covers GPS[V1/2]G^S_P[V_{1/2}]GPS​[V1/2​].
  • Eqs. (6)–(8): 1t∑iw(Ci)≤w(V1)+(1−kt)w(V1/2)≤2(1−kt)(w(V1)+12w(V1/2))≤(2−2t/k)OPT\frac1t\sum_iw(C_i)\le w(V_1)+(1-\frac kt)w(V_{1/2})\le 2(1-\frac kt)(w(V_1)+\frac12w(V_{1/2}))\le(2-\frac2{t/k})\mathrm{OPT}t1​∑i​w(Ci​)≤w(V1​)+(1−tk​)w(V1/2​)≤2(1−tk​)(w(V1​)+21​w(V1/2​))≤(2−t/k2​)OPT when PPP is not a linear order.

Significance

The result. Combined with the cited Theorem 2.1 (Ambühl–Mastrolilli 2009; Correa–Schulz 2005), which turns an α\alphaα-approximate vertex cover of GPSG^S_PGPS​ into an α\alphaα-approximate schedule, Theorem 5.1 gives a (2−2/f)(2-2/f)(2−2/f)-approximation for 1∣prec∣∑wjCj1|\mathrm{prec}|\sum w_jC_j1∣prec∣∑wj​Cj​ whenever the precedence order has an efficiently samplable realizer with t/k≤ft/k\le ft/k≤f. The paper applies it to interval orders (3/23/23/2), convex bipartite orders and semiorders (4/34/34/3), orders of bounded degree and orders of interval dimension two; for the earlier special classes it matched or improved the best known ratios, and for the last two it gave the first results. Proposition 3.2 makes the dimension theory of posets (realizers, critical pairs, fractional dimension) directly available to the vertex cover approach.

Formalizing it. The results are proved in the paper; to the best of current knowledge none of them has a machine-checked proof. The mission produces a Lean development of incomparable pairs, linear extensions, kkk-fold realizers and the hypergraph of incomparable pairs, which other dimension-theory missions can reuse, and a verified LP-rounding argument for half-integral vertex cover solutions under a distribution of independent sets.

Difficulty

Most of the rounding argument is arithmetic over finite sums. The central nontrivial step is the inclusion GP⊆GPSG_P\subseteq G^S_PGP​⊆GPS​ in Proposition 3.2: for two incomparable pairs that are not adjacent under the three-case rule, one must construct a single linear extension reversing both. This needs an extension of PPP by two new comparabilities whose transitive closure is still antisymmetric, followed by Szpilrajn's theorem; checking that every potential cycle is excluded by the three cases is the actual content. The opposite inclusion, and footnote 4, follow from transitivity and antisymmetry of linear orders. A second point of care is the inequality t≥2kt\ge 2kt≥2k used in step (7): it is not part of the definition of a realizer, and follows from each linear extension reversing exactly one of (x,y)(x,y)(x,y) and (y,x)(y,x)(y,x).

Formalization scope

  • Jobs form a finite type N; the precedence order is a relation P : N → N → Prop with IsPartialOrder, carried by the structure Instance. Processing times and weights are nonnegative reals.
  • inc⁡(P)\operatorname{inc}(P)inc(P) is the subtype IncPair P of N × N; a linear extension is a relation with IsLinearOrder containing P; a k:tk:tk:t-realizer is a family Fin t → LinearExtension P with t>0t>0t>0. Reversal of (x,y)(x,y)(x,y) means y<xy<xy<x in LLL throughout; the page's "y>xy>xy>x" in Eq. (4) and "Prob[j>i]\mathrm{Prob}[j>i]Prob[j>i]" in Eq. (5) are the same family of inequalities because inc⁡(P)\operatorname{inc}(P)inc(P) is symmetric.
  • GPSG^S_PGPS​ is the symmetric closure of the printed three-case rule on distinct nodes. GPG_PGP​ is defined through linear extensions and hyperedge minimality, never through the three-case rule, so Proposition 3.2 is a genuine statement and not a definitional equality.
  • [CS-LP] drops the constant term ∑jpjwj+∑(i,j)∈Ppiwj\sum_jp_jw_j+\sum_{(i,j)\in P}p_iw_j∑j​pj​wj​+∑(i,j)∈P​pi​wj​ of [CS-IP], which does not affect optimality. OPT\mathrm{OPT}OPT is the minimum weight of a vertex cover of GPSG^S_PGPS​, taken over a finite nonempty family.
  • Not formalized: "efficiently samplable", "polynomial time" and "randomized algorithm". The expectation over a uniformly sampled LiL_iLi​ is stated as the average 1t∑i=1t\frac1t\sum_{i=1}^tt1​∑i=1t​, which is equivalent to it and stronger than the existence of one good index. The existence of a half-integral optimal [CS-LP] solution (Nemhauser–Trotter, cited) is a hypothesis on xxx. The conversion of a vertex cover into a schedule (Theorem 2.1, cited) is not formalized; the goal is stated for vertex covers of GPSG^S_PGPS​.
  • Constants: 2−2/(t/k)2-2/(t/k)2−2/(t/k) in real arithmetic; it equals 2−2k/t2-2k/t2−2k/t, and equals 222 when k=0k=0k=0.
  • The paper assumes fdim⁡(P)≥2\operatorname{fdim}(P)\ge2fdim(P)≥2, i.e. PPP is not a linear order. Eqs. (6)–(8) carry that hypothesis as the paper does; the goal omits it because for a linear order both sides are 000.
  • Conclusion (a), that each CiC_iCi​ is a vertex cover, is part of the goal and is not assumed.

Contributions welcome: proofs of the milestones in any order, and a reusable Szpilrajn-style lemma producing a linear extension that reverses a prescribed set of compatible incomparable pairs.

Selected references

  • C. Ambühl, M. Mastrolilli, N. Mutsanas, O. Svensson, On the approximability of single-machine scheduling with precedence constraints, Math. Oper. Res. 36(4):653–669, 2011. https://doi.org/10.1287/moor.1110.0512
  • C. Ambühl, M. Mastrolilli, Single machine precedence constrained scheduling is a vertex cover problem, Algorithmica 53(4), 2009 (reference [2] of the paper).
  • J. R. Correa, A. S. Schulz, Single-machine scheduling with precedence constraints, Math. Oper. Res. 30(4):1005–1021, 2005. https://doi.org/10.1287/moor.1050.0158
  • G. R. Brightwell, E. R. Scheinerman, Fractional dimension of partial orders, Order 9(2):139–158, 1992 (reference [7]).
  • S. Felsner, W. T. Trotter, Dimension, graph and hypergraph coloring, Order 17(2):167–177, 2000 (reference [13]).
  • D. S. Hochbaum, Efficient bounds for the stable set, vertex cover and set packing problems, Discrete Appl. Math. 6(3):243–254, 1983 (reference [20]).
  • G. L. Nemhauser, L. E. Trotter, Vertex packings: structural properties and algorithms, Math. Programming 8(1):232–248, 1975 (reference [29]).
10 thms2 active usersReviewed
Bandit AlgorithmsOperations ResearchProbability+1·Captain: mikedeng1

Dynamic Pricing Without Knowing the Demand Function: Risk Bounds and Near-Optimal Algorithms I: The Nonparametric Learn-then-Price Policy Has Regret at Most C(log n)^{1/2}/n^{1/4}Research Paper

Why price without knowing demand

A seller with a fixed stock of a single product and a finite selling season has to set prices without knowing how demand responds to them. This is the standard situation in revenue management: airline seats, hotel rooms, fashion goods and event tickets. The classical theory of dynamic pricing (Gallego and van Ryzin, 1994) assumes that the demand function λ(p)\lambda(p)λ(p), the rate of purchase requests at price ppp, is known. In practice it has to be learned from sales, while the season runs and the stock is consumed.

Besbes and Zeevi (2009) asked how much revenue is lost for not knowing λ\lambdaλ. They answered it with explicit policies and matching-order bounds. Their setting differs from the multi-armed bandit literature it borrows from in three ways:

  • the problem is constrained by an initial inventory;
  • the set of prices is a continuum;
  • the set of possible demand functions is a nonparametric class.

This mission formalizes their first main result, Proposition 1: a simple learn-then-price policy has worst-case relative regret of order (log⁡n)1/2n−1/4(\log n)^{1/2}n^{-1/4}(logn)1/2n−1/4 in a market of size nnn.

Setting

Prices. Fix 0<p‾<p‾<∞0<\underline p<\overline p<\infty0<p​<p​<∞ and an off price p∞>0p_\infty>0p∞​>0 outside [p‾,p‾][\underline p,\overline p][p​,p​]. The seller may charge any price in [p‾,p‾]∪{p∞}[\underline p,\overline p]\cup\{p_\infty\}[p​,p​]∪{p∞​}; charging p∞p_\inftyp∞​ stops demand.

Demand. Requests arrive as a Poisson process whose intensity at time ttt is λ(p(t))\lambda(p(t))λ(p(t)). Let NNN be a unit-rate Poisson process. By the time change (1), the cumulative requests up to time ttt under a price path p(⋅)p(\cdot)p(⋅) are N(∫0tλ(p(s)) ds)N\big(\int_0^t\lambda(p(s))\,ds\big)N(∫0t​λ(p(s))ds). The seller starts with inventory xxx and sells until either the horizon TTT ends or the stock runs out. The expected revenue of a policy π\piπ is Jπ(x,T;λ)J^\pi(x,T;\lambda)Jπ(x,T;λ).

Demand class. L=L(M,K‾,K‾,m)\mathcal L=\mathcal L(M,\underline K,\overline K,m)L=L(M,K​,K,m) is the set of regular demand functions satisfying Assumption 1. Regular means:

  • λ≥0\lambda\ge0λ≥0 and λ(p∞)=0\lambda(p_\infty)=0λ(p∞​)=0;
  • λ\lambdaλ is non-increasing on [p‾,p‾][\underline p,\overline p][p​,p​], with inverse γ\gammaγ;
  • the revenue rate r(l)=lγ(l)r(l)=l\gamma(l)r(l)=lγ(l) is concave.

Assumption 1 requires:

  • (i) λ≤M\lambda\le Mλ≤M on [p‾,p‾][\underline p,\overline p][p​,p​];
  • (ii) λ\lambdaλ is K‾\overline KK-Lipschitz and γ\gammaγ is K‾−1\underline K^{-1}K​−1-Lipschitz;
  • (iii) max⁡ppλ(p)≥m\max_p p\lambda(p)\ge mmaxp​pλ(p)≥m.

Benchmark. The deterministic relaxation (5) replaces the random demand by its mean:

JD(x,T∣λ)=sup⁡{∫0Tp(s)λ(p(s)) ds:∫0Tλ(p(s)) ds≤x}.J^D(x,T\mid\lambda)=\sup\Big\{\int_0^T p(s)\lambda(p(s))\,ds:\int_0^T\lambda(p(s))\,ds\le x\Big\}.JD(x,T∣λ)=sup{∫0T​p(s)λ(p(s))ds:∫0T​λ(p(s))ds≤x}.

The regret of a policy is Rπ=1−Jπ/JD\mathcal R^\pi=1-J^\pi/J^DRπ=1−Jπ/JD.

Scaling. In a market of size nnn the inventory is nxnxnx and the demand function is nλn\lambdanλ, as in (11). The corresponding quantities are JnπJ^\pi_nJnπ​, JnD=nJDJ^D_n=nJ^DJnD​=nJD and Rnπ\mathcal R^\pi_nRnπ​.

Algorithm 1, π(τ,κ)\pi(\tau,\kappa)π(τ,κ). The policy has three phases.

  1. Learning. On [0,τ][0,\tau][0,τ] it tests κ\kappaκ equally spaced prices pi=p‾+(i−1)(p‾−p‾)/κp_i=\underline p+(i-1)(\overline p-\underline p)/\kappapi​=p​+(i−1)(p​−p​)/κ, each for Δ=τ/κ\Delta=\tau/\kappaΔ=τ/κ time units. It estimates λ(pi)\lambda(p_i)λ(pi​) by the normalized request counts λ^(pi)\hat\lambda(p_i)λ^(pi​).
  2. Optimization. It chooses p^u=arg⁡max⁡ipiλ^(pi)\hat p^u=\arg\max_i p_i\hat\lambda(p_i)p^​u=argmaxi​pi​λ^(pi​) and p^c=arg⁡min⁡i∣λ^(pi)−x/T∣\hat p^c=\arg\min_i|\hat\lambda(p_i)-x/T|p^​c=argmini​∣λ^(pi​)−x/T∣, and sets p^=max⁡{p^u,p^c}\hat p=\max\{\hat p^u,\hat p^c\}p^​=max{p^​u,p^​c}.
  3. Pricing. It charges p^\hat pp^​ on (τ,T](\tau,T](τ,T] until the stock runs out.

Formalization targets

Goal: Proposition 1

Let τn≍n−1/4\tau_n\asymp n^{-1/4}τn​≍n−1/4 and κn≍n1/4\kappa_n\asymp n^{1/4}κn​≍n1/4, and let πn=π(τn,κn)\pi_n=\pi(\tau_n,\kappa_n)πn​=π(τn​,κn​). Then there is a finite constant CCC, independent of λ\lambdaλ and nnn, such that

sup⁡λ∈LRnπ(x,T;λ)≤C(log⁡n)1/2n1/4(n≥2).\sup_{\lambda\in\mathcal L}\mathcal R^{\pi}_n(x,T;\lambda)\le\frac{C(\log n)^{1/2}}{n^{1/4}}\qquad(n\ge2).λ∈Lsup​Rnπ​(x,T;λ)≤n1/4C(logn)1/2​(n≥2).

The constant is left unspecified, as in the paper. Its dependence on the class parameters, xxx and TTT is "somewhat complex" (p. 12), and the order (log⁡n)1/2n−1/4(\log n)^{1/2}n^{-1/4}(logn)1/2n−1/4 is the content of the result.

Milestones

The milestones follow the proof in the appendix, in order:

  • the scaling JnD=nJDJ^D_n=nJ^DJnD​=nJD (p. 12);
  • Fact 1, JD≥mmin⁡{T,x/M}J^D\ge m\min\{T,x/M\}JD≥mmin{T,x/M} on L\mathcal LL;
  • Lemma 1, the solution of (5): charge pD=max⁡{pu,pc}p^D=\max\{p^u,p^c\}pD=max{pu,pc} until the stock runs out;
  • Lemma 2, a Poisson deviation bound;
  • the revenue lower bound (A-2);
  • Lemma 3, the learned price is near pDp^DpD with high probability;
  • Lemma 4 and the Case 1 bound (A-11), for λ(p‾)≤x/T\lambda(\overline p)\le x/Tλ(p​)≤x/T;
  • Lemma 5 and the Case 2 bound (A-15), for λ(p‾)>x/T\lambda(\overline p)>x/Tλ(p​)>x/T;
  • the Step 4 bound Rnπ≤C12(un+τn)\mathcal R^\pi_n\le C_{12}(u_n+\tau_n)Rnπ​≤C12​(un​+τn​), where un=(log⁡n)1/2max⁡{1/κn,(nΔn)−1/2}u_n=(\log n)^{1/2}\max\{1/\kappa_n,(n\Delta_n)^{-1/2}\}un​=(logn)1/2max{1/κn​,(nΔn​)−1/2}.

Significance

Proposition 1 shows that a seller who knows only a nonparametric class of demand functions can approach the full-information revenue uniformly over the class. Learning costs a vanishing fraction of revenue, and the policy needs no parametric model. Together with the paper's lower bound of order n−1/2n^{-1/2}n−1/2 for every admissible policy (Proposition 2, not in this mission), it brackets the minimax regret of nonparametric pricing under an inventory constraint. The result is a reference point for the learning-and-earning literature in operations management that followed it.

The result is proved in the paper; to our knowledge, it has no machine-checked proof. Formalizing it requires:

  • a working theory of policies driven by a time-changed Poisson process, with sales capped by an inventory;
  • the deterministic relaxation of Gallego and van Ryzin for a continuum of prices with an off price;
  • uniform (over the class) Poisson concentration bounds.

The mission produces Lean statements of all of these. A proof would also check every constant chain of the appendix, where the argument uses some displays in a form slightly different from their printed statement (see the scope section).

Difficulty

The obvious argument controls the estimation error at the tested prices and concludes that p^\hat pp^​ is close to the optimal price. It breaks in two places.

First, pDp^DpD is the larger of two prices, the revenue maximizer and the price that sells the inventory exactly. Near the boundary between these regimes, the revenue rate at p^\hat pp^​ is not controlled by the error in p^\hat pp^​ alone: it needs the concavity of the revenue rate and the inverse Lipschitz bound on γ\gammaγ.

Second, when demand at the highest price exceeds the inventory rate (λ(p‾)>x/T\lambda(\overline p)>x/Tλ(p​)>x/T), the revenue is limited by stock-outs rather than by the price. The bound must then show that nearly all of the inventory is sold during the pricing phase, uniformly over the class.

Throughout, every constant must be independent of the demand function, so the estimates have to hold uniformly over an infinite-dimensional class.

Formalization scope

  • Poisson process. The demand is driven by IsPoissonProcess N 1 on a probability space (Ω,P)(\Omega,\mathbb P)(Ω,P), a published platform definition: ℕ-valued, N(0)=0N(0)=0N(0)=0, monotone paths, independent Poisson increments. The time change (1) is rendered by evaluating NNN at cumulative intensities.
  • Inventory. The inventory of the market of size nnn is ⌊nx⌋\lfloor nx\rfloor⌊nx⌋ units, and sales are min⁡{N(⋅),⌊nx⌋}\min\{N(\cdot),\lfloor nx\rfloor\}min{N(⋅),⌊nx⌋}. The cap is never dropped.
  • Revenue. JnπJ^\pi_nJnπ​ is the Bochner expectation of a bounded, finitely-valued revenue, so it is a genuine integral.
  • Demand functions. A demand function is a map R→R\mathbb R\to\mathbb RR→R, nonnegative, with λ(p∞)=0\lambda(p_\infty)=0λ(p∞​)=0. Regularity and Assumption 1 are imposed on [p‾,p‾][\underline p,\overline p][p​,p​], and the inverse γ\gammaγ is Function.invFunOn.
  • Benchmark. JDJ^DJD is a supremum over measurable price paths with integrable demand rate. The supremum is genuine: the set of path revenues is nonempty and bounded.
  • Algorithm. The grid excludes p‾\overline pp​, as in the paper. Ties in the grid argmax and argmin go to the smallest index. The estimates compare λ^(pi)\hat\lambda(p_i)λ^(pi​) with x/Tx/Tx/T.
  • Tuning. τn≍n−1/4\tau_n\asymp n^{-1/4}τn​≍n−1/4 and κn≍n1/4\kappa_n\asymp n^{1/4}κn​≍n1/4 are encoded with explicit constants 0<c≤c′0<c\le c'0<c≤c′, with τn∈(0,T]\tau_n\in(0,T]τn​∈(0,T] and κn≥1\kappa_n\ge1κn​≥1. Constants may depend on c,c′c,c'c,c′, the class parameters, the prices, xxx and TTT, but never on λ\lambdaλ or nnn.
  • Range of nnn. Bounds whose right side vanishes at n=1n=1n=1 because log⁡1=0\log1=0log1=0 are stated for n≥2n\ge2n≥2: the goal and (A-15).
  • Typo correction. Lemma 5's event uses nx−C9nunnx-C_9nu_nnx−C9​nun​, as in its proof, not the printed nx−C9unnx-C_9u_nnx−C9​un​.
  • Ruled out. A specific demand curve, a fixed nnn, deterministic demand, a finite price set, a known λ\lambdaλ, constants depending on λ\lambdaλ, or dropping the inventory cap would each make the statement a different and easier theorem. None is used.
  • Not included. The lower bound of Proposition 2 and the second assertion of Lemma 1 (Jπ≤JDJ^\pi\le J^DJπ≤JD for all admissible policies) are not included.

Contributions are welcome at any level: proofs of the milestones (Fact 1, Lemma 1 and Lemma 2 are self-contained), measurability and integrability lemmas for the revenue functional, and a reusable Poisson concentration library built on Mathlib's poissonMeasure.

Selected references

  • O. Besbes and A. Zeevi, Dynamic Pricing Without Knowing the Demand Function: Risk Bounds and Near-Optimal Algorithms, Operations Research 57(6):1407–1420, 2009. https://doi.org/10.1287/opre.1080.0640
  • G. Gallego and G. van Ryzin, Optimal Dynamic Pricing of Inventories with Stochastic Demand over Finite Horizons, Management Science 40(8):999–1020, 1994. https://doi.org/10.1287/mnsc.40.8.999
  • K. Talluri and G. van Ryzin, The Theory and Practice of Revenue Management, Springer, 2005. https://doi.org/10.1007/b139000
15 thms3 active usersReviewed
Dynamic ProgrammingMarkov ChainOperations Research·Captain: mikedeng1

Discrete-Time Controlled Markov Processes with Average Cost Criterion: A Survey 3: A Uniform Lower Bound on the Probability of Moving to State 0 Reduces Average Cost to Discounted CostResearch Paper

Why average cost is a control problem

A controller acting over an indefinite horizon must decide whether a lower cost today is worth a higher cost later. Average cost measures the expected expenditure per stage as the horizon grows. It is appropriate when operation has no natural terminal date, but its limiting definition makes it difficult to compute an optimal policy directly. Discounted cost assigns less weight to distant stages and has a more direct optimality equation. Arapostathis, Borkar, Fernández-Gaucherand, Ghosh and Marcus survey these criteria for controlled Markov processes and state a condition under which solving one discounted problem yields a solution to an average-cost problem (Arapostathis et al., 1993, §5.1).

The condition is a common lower bound on the one-step probability of moving to a distinguished state. Ross's reduction, reported as Theorem 5.6 of the survey, uses that bound to define a new transition law and a specific discount factor. The survey's theorem states the reduction informally; its proof specifies the transformed law, the optimality equation and the resulting average-cost policy. Those claims are the targets of this mission (Arapostathis et al., 1993, pp. 303–304).

Controlled process and criteria

The state space is S={0,1,2,…}S=\{0,1,2,\ldots\}S={0,1,2,…}. In state iii, the controller may choose an action aaa from a nonempty compact set U(i)U(i)U(i) in a metric action space. Choosing aaa incurs the one-stage cost c(i,a)≥0c(i,a)\ge0c(i,a)≥0 and moves the state to jjj with probability P(j∣i,a)P(j\mid i,a)P(j∣i,a). The cost is measurable, and for each fixed i,ji,ji,j its value and P(j∣i,a)P(j\mid i,a)P(j∣i,a) vary continuously with aaa on U(i)U(i)U(i). Section 5 imposes these state and continuity conventions; §5.1 additionally assumes the costs are bounded (Arapostathis et al., 1993, pp. 284–288, 299, 301).

An admissible policy π\piπ chooses a probability law for the next action from the entire observed history, and assigns probability one to admissible actions. A stationary deterministic policy is a map fff with f(i)∈U(i)f(i)\in U(i)f(i)∈U(i); it always takes action f(i)f(i)f(i) in state iii. These are distinct classes. Let JN(i,π)J_N(i,\pi)JN​(i,π) be expected cost over the first NNN stages from iii, and let Jβ(i,π)J_\beta(i,\pi)Jβ​(i,π) be expected cost when stage ttt is weighted by βt\beta^tβt, where 0<β<10<\beta<10<β<1. The average-cost criterion is J(i,π)=lim sup⁡N→∞JN(i,π)/NJ(i,\pi)=\limsup_{N\to\infty}J_N(i,\pi)/NJ(i,π)=limsupN→∞​JN​(i,π)/N. The optimal values J∗(i)J^*(i)J∗(i) and Jβ∗(i)J_\beta^*(i)Jβ∗​(i) are infima over all admissible policies, including randomized and history-dependent ones (Arapostathis et al., 1993, pp. 285–287).

The average cost optimality equation, or ACOE, asks for a scalar ρ\rhoρ and a real function hhh such that, for each state iii,

ρ+h(i)=min⁡a∈U(i){c(i,a)+∑j∈SP(j∣i,a)h(j)}.\rho+h(i)=\min_{a\in U(i)}\left\{c(i,a)+\sum_{j\in S}P(j\mid i,a)h(j)\right\}.ρ+h(i)=a∈U(i)min​⎩⎨⎧​c(i,a)+j∈S∑​P(j∣i,a)h(j)⎭⎬⎫​.

The minimum is attained. The survey's verification theorem identifies ρ\rhoρ with the optimal average cost when the terminal contribution of h(Xt)h(X_t)h(Xt​) vanishes after division by ttt (Arapostathis et al., 1993, p. 299, (5.1), Theorem 5.1).

Formalization targets

The reduction

Assume that P(0∣i,a)≥αP(0\mid i,a)\ge\alphaP(0∣i,a)≥α on every admissible state-action pair for a single constant 0<α<10<\alpha<10<α<1. The transformed process M~\widetilde MM has the same admissible actions and costs and has transition probabilities

P~(j∣i,a)=P(j∣i,a)−α1{j=0}1−α.\widetilde P(j\mid i,a)=\frac{P(j\mid i,a)-\alpha\mathbf1_{\{j=0\}}}{1-\alpha}.P(j∣i,a)=1−αP(j∣i,a)−α1{j=0}​​.

Write J~1−α∗\widetilde J^*_{1-\alpha}J1−α∗​ for its discounted value at discount factor 1−α1-\alpha1−α. The goal states that this value is finite, a stationary deterministic discounted-optimal policy exists, and every such policy is average-cost optimal for the original process. It also identifies a constant optimal average cost for every initial state:

J∗(i)=αJ~1−α∗(0),i∈S.J^*(i)=\alpha\widetilde J^*_{1-\alpha}(0),\qquad i\in S.J∗(i)=αJ1−α∗​(0),i∈S.

The goal does not assume the average optimality that it asserts. It requires the transformed law to satisfy the displayed formula at every admissible state-action pair (Arapostathis et al., 1993, Theorem 5.6 and proof, pp. 303–304).

Supporting targets

The milestones establish that the transformed law gives a controlled Markov process, that the discounted problem has an optimal stationary deterministic policy, and that the transformed discounted value satisfies the original ACOE with ρ=αJ~1−α∗(0)\rho=\alpha\widetilde J^*_{1-\alpha}(0)ρ=αJ1−α∗​(0). The final milestone is the ACOE verification theorem needed to identify the average cost. The source gives the first two discounted claims through Theorem 2.1 and writes out the transformed equation in the proof of Theorem 5.6 (Arapostathis et al., 1993, pp. 289, 299, 304).

What the result supplies

The theorem replaces an average-cost optimization problem by one discounted problem with a prescribed discount factor and transition law. It yields a stationary deterministic policy that is optimal even when compared with every history-dependent randomized policy, and it shows that the optimal average cost is independent of the initial state. Without the common return probability, neither this particular law nor this fixed discount factor follows from the survey's argument (Arapostathis et al., 1993, Theorem 5.6).

The survey reports this as a known result of Ross rather than an open conjecture. The formalization work is to give the path measures, value functions, transformed process and verification result machine-checkable meanings. The Lean declarations here are open theorem statements awaiting proofs; compiling a statement with sorry does not establish the mathematical theorem. The policy and cost definitions can also support the other countable-state missions drawn from §5.

Difficulty

The transformed probabilities have to form a measurable stochastic kernel, preserve the action continuity assumptions and yield a controlled process with the original feasible actions and costs. The discounted value must be finite and uniformly bounded before its real form can enter the ACOE. A simple comparison of numerical optimal values is insufficient: a policy chosen in the transformed model must be shown optimal for the original model against the full policy class. The verification theorem also requires control of the terminal expectation of h(Xt)h(X_t)h(Xt​) for arbitrary admissible policies, rather than only the stationary policies named in its printed condition (Arapostathis et al., 1993, pp. 299–300, 304).

Formalization scope

Lean uses N\mathbb NN for the countable state space and Mathlib probability kernels for the transition and randomized decision rules. Strategic path measures are constructed from those kernels. Nonnegative expected costs and their infima live in [0,∞][0,\infty][0,∞], so an unbounded integral cannot silently become a finite real value. The transformed discounted value is converted to a real only in conclusions that also assert its finiteness. The ACOE uses real sums with explicit summability and an attained minimum. The model requires a Borel metric action space, nonempty compact action sets, measurable costs, and coordinatewise action continuity of the transition probabilities.

The source's §5.1 bounded-cost assumption is explicit in the goal and its discounted milestones. The displayed transformation needs α<1\alpha<1α<1; the paper's theorem sentence gives only α>0\alpha>0α>0, so the case α=1\alpha=1α=1 is excluded from this version. The paper prints (5.2) for stationary deterministic policies, but the proof uses it for all admissible policies to compare with J∗J^*J∗; the verification milestone takes the stronger, proof-supported hypothesis. Expectations in that condition are explicitly integrable. The converse part of Theorem 5.1 is not used and is outside this mission.

The transformed process is represented by another CMP constrained to have exactly the source's action sets, admissible costs and transition formula. A milestone poses its existence. This representation keeps the definition layer free of an unproved stochastic-kernel construction. The discount-optimal policy conclusion ranges over every stationary deterministic policy attaining the transformed discounted value, while the values themselves take infima over all admissible policies. Definitions of admissible path laws and the verification theorem are reusable contributions; proofs of the transformed kernel, stationary discounted existence and ACOE identity are welcome.

Selected references

  • A. Arapostathis, V. S. Borkar, E. Fernández-Gaucherand, M. K. Ghosh and S. I. Marcus, Discrete-time controlled Markov processes with average cost criterion: a survey, SIAM Journal on Control and Optimization 31(2), 282–344, 1993. DOI: 10.1137/0331018.
7 thms1 active userReviewed
Bandit AlgorithmsOperations ResearchProbability+1·Captain: mikedeng1

Dynamic Pricing Without Knowing the Demand Function: Risk Bounds and Near-Optimal Algorithms II: The Parametric Learn-then-Price Policy Has Regret at Most C(log n)^{1/2}/n^{1/3}Research Paper

Why learn demand while pricing?

A seller with a fixed inventory must choose prices before knowing how customers respond to them. A price that earns a high margin can sell too slowly; a price that sells quickly can exhaust stock before the selling season ends. Learning demand uses time and inventory, so the seller must account for the cost of its own experiments. This mission formalizes the parametric policy and regret bound of Besbes and Zeevi (2009), Proposition 3. Their setting differs from a finite-arm bandit: the permitted ordinary prices form an interval, customer arrivals are random, and the available stock caps total sales.

The paper first analyzes a nonparametric class with a slower upper bound in Proposition 1, then imposes a known finite-dimensional form on the unknown demand curve in Section 5. Proposition 3 shows how that additional information improves the regret rate for its Algorithm 2. The authors also prove a lower bound for a suitable parametric family in Proposition 4; that result is outside this mission's capstone, which concerns the performance guarantee of the concrete policy.

Market, demand, and policy

The selling horizon has length T>0T>0T>0, and the initial stock is x>0x>0x>0. An ordinary price ppp lies in [p‾,p‾][\underline p,\overline p][p​,p​], with 0<p‾<p‾0<\underline p<\overline p0<p​<p​. The special price p∞>0p_\infty>0p∞​>0 stops demand. At parameter θ∈Θ⊆Rk\theta\in\Theta\subseteq\mathbb R^kθ∈Θ⊆Rk, the demand rate is λ(p;θ)≥0\lambda(p;\theta)\ge0λ(p;θ)≥0. The parameter set Θ\ThetaΘ is nonempty, compact, and convex; kkk is positive. The seller knows the family λ(⋅;θ)\lambda(\cdot;\theta)λ(⋅;θ) but does not know the true parameter θ∗\theta^*θ∗.

For each parameter, demand is nonincreasing in the price and has an inverse γ(⋅;θ)\gamma(\cdot;\theta)γ(⋅;θ) on the attainable rate interval. The rate revenue is r(ℓ;θ)=ℓγ(ℓ;θ)r(\ell;\theta)=\ell\gamma(\ell;\theta)r(ℓ;θ)=ℓγ(ℓ;θ), a concave function of the rate. Every member of the family satisfies Assumption 1 with the same positive constants M,K‾,K‾,mM,\underline K,\overline K,mM,K​,K,m: demand is at most MMM, its price variation is at most K‾\overline KK times the price difference, its inverse is K‾−1\underline K^{-1}K​−1-Lipschitz, and some ordinary price earns revenue rate at least mmm. These conditions define the class in which the bound is uniform. See §§3–4.2 of the source.

Customer requests follow a unit-rate Poisson process NNN run on a demand-dependent clock. Under price p(t)p(t)p(t), cumulative requests at time ttt equal N(∫0tλ(p(s);θ∗) ds)N(\int_0^t\lambda(p(s);\theta^*)\,ds)N(∫0t​λ(p(s);θ∗)ds). The market of size nnn has stock nxnxnx and rate nλn\lambdanλ. Sales stop when stock runs out. The deterministic relaxation JnDJ_n^DJnD​ is the best integrated rate revenue over measurable price paths satisfying the expected-demand stock constraint, with the same scaling. The policy revenue JnπJ_n^\piJnπ​ is its expected sales revenue, and its relative regret is Rnπ=1−Jnπ/JnDR_n^\pi=1-J_n^\pi/J_n^DRnπ​=1−Jnπ​/JnD​. Fact 1 states JnD=nJDJ_n^D=nJ^DJnD​=nJD and gives a positive uniform lower bound on JDJ^DJD.

Assumption 2 selects kkk distinct ordinary test prices. Their mean rates identify the parameter through a Lipschitz inverse map ggg, and demand changes at most K‾2∥θ−θ′∥∞\overline K_2\|\theta-\theta'\|_\inftyK2​∥θ−θ′∥∞​ as the parameter varies. The square root of each test-price rate is differentiable on Θ\ThetaΘ. Algorithm 2 spends τn\tau_nτn​ time units testing these prices in equal subintervals, estimates each rate from its Poisson count increment, and sets θ^=g(d^)\widehat\theta=g(\widehat d)θ=g(d). It then posts p^=max⁡{pu(θ^),pc(θ^)}\widehat p=\max\{p^u(\widehat\theta),p^c(\widehat\theta)\}p​=max{pu(θ),pc(θ)}, where pup^upu maximizes revenue rate and pcp^cpc minimizes the distance of demand to x/Tx/Tx/T. It keeps that price until time TTT or stock-out. See §5.1–5.2.

Formalization targets

The capstone is the uniform bound in Proposition 3, equation (17). With τn≍n−1/3\tau_n\asymp n^{-1/3}τn​≍n−1/3, the mission asks for one constant C>0C>0C>0, independent of nnn, θ∗\theta^*θ∗, the optimizer choices, and the probability space, such that

∀θ∗∈Θ,Rnπ(x,T;θ∗)≤Clog⁡nn1/3(n≥2).\forall\theta^*\in\Theta,\qquad R_n^\pi(x,T;\theta^*)\le C\frac{\sqrt{\log n}}{n^{1/3}}\quad(n\ge2).∀θ∗∈Θ,Rnπ​(x,T;θ∗)≤Cn1/3logn​​(n≥2).

The intermediate quantitative target is equation (A-25), which retains the learning time:

Rnπ≤C3mD(τn+log⁡nnτn),mD=mmin⁡{T,x/M}.R_n^\pi\le\frac{C_3}{m^D}\left(\tau_n+\frac{\sqrt{\log n}}{\sqrt{n\tau_n}}\right),\qquad m^D=m\min\{T,x/M\}.Rnπ​≤mDC3​​(τn​+nτn​​logn​​),mD=mmin{T,x/M}.

The milestone list also carries Fact 1, the optimal deterministic price path and value from the first assertion of Lemma 1, both Poisson tails of Lemma 2, the pricing-phase revenue bound (A-17), the deterministic stability bounds (A-19), (A-22), and (A-23), and the parameter-estimation bound of Lemma 6. The paper's assertion that the policy is “asymptotically optimal” follows from the displayed regret estimate together with nonnegative regret; the displayed numerical estimate is the formal goal.

What the result provides

A finite-dimensional demand model lets the seller learn from a fixed set of kkk prices rather than probing an increasingly fine price grid. Proposition 3 quantifies the resulting revenue loss at O(log⁡n n−1/3)O(\sqrt{\log n}\,n^{-1/3})O(logn​n−1/3), compared with the paper's O(log⁡n n−1/4)O(\sqrt{\log n}\,n^{-1/4})O(logn​n−1/4) upper bound for its nonparametric learn-then-price policy. Both guarantees compare actual expected revenue with the full-information deterministic benchmark, including stock-out. These rates are proved in the article; the mission seeks machine-checked Lean proofs of the stated model, auxiliary bounds, and capstone. No such proof is claimed here.

The formalization would also provide reusable interfaces for a unit-rate Poisson counting process, deterministic inventory-constrained revenue optimization, measurable price selectors, and a random price chosen from normalized count observations. The later single-parameter policy in the paper uses related ideas but is a separate mission with different stages and a different rate.

Main difficulty

A rate estimate can be close to the true rate while the selected price changes between two different optimizers: the unconstrained revenue maximizer and the price that matches inventory to expected demand. A bound for only one optimizer does not control the maximum of the two. The learning price is random, and the number of requests in the pricing phase is evaluated at a random Poisson clock. Stock-out further couples the learning phase to the amount available for later sales. These features prevent a direct substitution of an ordinary parameter-estimation bound into the final revenue formula.

Formalization scope

Lean uses Fin(k)→R\mathrm{Fin}(k)\to\mathbb RFin(k)→R with its sup norm for parameter vectors, a finite positive off price, and a Poisson process on an arbitrary probability space. Each demand curve is defined on all real prices but is constrained on [p‾,p‾][\underline p,\overline p][p​,p​] and at p∞p_\inftyp∞​; the inverse and concavity conditions apply on the attainable rate interval. The deterministic benchmark is a real supremum over measurable, integrable admissible price paths. The class assumptions make its value nonempty and bounded. Policy revenue uses a nonnegative integral of pathwise revenue, avoiding a default zero from a nonintegrable signed expectation.

Inventory is measured in whole units, so the cap is ⌊nx⌋\lfloor nx\rfloor⌊nx⌋, equal to the paper's nxnxnx when that quantity is integral. Test-price observations remain uncapped in the formula for d^\widehat dd; if stock runs out during learning, capped later sales are already zero. The continuous optimizer choices are measurable selections satisfying the actual max/min properties for every member of Θ\ThetaΘ. The bound is uniform over these choices and over all unit-rate Poisson processes.

The printed Assumption 2(i)b asks for a solution to the test-rate equations for every vector in Rk\mathbb R^kRk. Such a solution cannot always lie in compact Θ\ThetaΘ, although the proof applies Assumption 2(ii) to θ^\widehat\thetaθ. Here ggg is a Lipschitz map into Θ\ThetaΘ that recovers each true parameter from its test-rate vector; it can be viewed as the unconstrained inverse followed by a nonexpansive projection in the paper's box example. This explicit convention is required to make the estimate and subsequent use of Assumption 2(ii) coherent. It is an interpretive repair of the printed condition.

The paper prints the regret bound for n≥1n\ge1n≥1, where log⁡1=0\sqrt{\log1}=0log1​=0. The exploration policy can lose revenue at n=1n=1n=1, so the formal theorem starts at n≥2n\ge2n≥2. The comparison τn≍n−1/3\tau_n\asymp n^{-1/3}τn​≍n−1/3 is encoded by positive lower and upper multipliers after a fixed threshold, with 0<τn≤T0<\tau_n\le T0<τn​≤T for all relevant market sizes. This admits the usual finite initial adjustments and leaves the bound uniform over the sequence. No fixed demand curve, known parameter, finite price grid, or uncapped sales model can satisfy this target by substitution.

Selected references

  • Omar Besbes and Assaf Zeevi, Dynamic Pricing Without Knowing the Demand Function: Risk Bounds and Near-Optimal Algorithms, Operations Research 57(6), 2009, authors' final manuscript revised December 16, 2007. DOI: 10.1287/opre.1080.0640.
13 thms2 active usersReviewed
CombinatoricsOperations ResearchTheoretical Computer Science·Captain: mikedeng1

On the Approximability of Single-Machine Scheduling with Precedence Constraints 6: The Optimal Value of S_G Lies Between n² − an²(ln 1/a + 2) and n² − an²Research Paper

Motivation

The problem 1 ∣ prec ∣ ∑wjCj1\,|\,\mathrm{prec}\,|\,\sum w_jC_j1∣prec∣∑wj​Cj​ asks for a single-machine sequence of jobs, respecting precedence constraints, that minimizes the weighted sum of completion times. It has been known to be strongly NP-hard since Lawler (1978) and Lenstra and Rinnooy Kan (1978), several different 2-approximation algorithms are known, and closing the approximability gap is listed by Schuurman and Woeginger (1999) as one of ten outstanding open problems in scheduling theory. Ambühl, Mastrolilli, Mutsanas and Svensson (Math. Oper. Res. 36(4), 2011) give the first inapproximability result for this problem: under a widely believed complexity assumption it has no polynomial-time approximation scheme (PTAS). The bridge to that result is a quantitative link, Lemma 9.1, between the optimal value of a special bipartite scheduling instance and the maximum edge biclique of a bipartite graph, a problem whose hardness of approximation was established by Ambühl, Mastrolilli and Svensson (FOCS 2007). This mission formalizes that link.

Setting

A schedule of a finite job set is a sequence σ\sigmaσ listing every job once; the machine processes the jobs in that order from time 000 without idle time or pre-emption. Job jjj has a processing time pjp_jpj​ and a weight wjw_jwj​; its completion time CjC_jCj​ is the sum of the processing times of the jobs up to and including jjj, and the value of σ\sigmaσ is val(σ)=∑jwjCj\mathrm{val}(\sigma)=\sum_j w_jC_jval(σ)=∑j​wj​Cj​. Precedence constraints are a relation PPP on jobs: (i,j)∈P(i,j)\in P(i,j)∈P with i≠ji\ne ji=j means job iii must be completed before job jjj starts. A schedule respecting all of them is feasible, and a feasible schedule σ∗\sigma^*σ∗ of least value is optimal.

Let G=(U,V,E)G=(U,V,E)G=(U,V,E) be an nnn-by-nnn bipartite graph: ∣U∣=∣V∣=n|U|=|V|=n∣U∣=∣V∣=n and E⊆U×VE\subseteq U\times VE⊆U×V. An edge biclique is a pair A⊆UA\subseteq UA⊆U, B⊆VB\subseteq VB⊆V with A×B⊆EA\times B\subseteq EA×B⊆E, of value ∣A∣⋅∣B∣|A|\cdot|B|∣A∣⋅∣B∣; the maximum edge biclique problem (Definition 9.1) asks for one of largest value. The bipartite scheduling instance SGS_GSG​ has jobs U∪VU\cup VU∪V and precedence constraints

P=(U×V)∖E,P=(U\times V)\setminus E,P=(U×V)∖E,

so u∈Uu\in Uu∈U must precede v∈Vv\in Vv∈V exactly when (u,v)(u,v)(u,v) is not an edge. Jobs of UUU have p=1p=1p=1, w=0w=0w=0; jobs of VVV have p=0p=0p=0, w=1w=1w=1. Thus val(σ)=∑v∈VCv\mathrm{val}(\sigma)=\sum_{v\in V}C_vval(σ)=∑v∈V​Cv​, where CvC_vCv​ is the number of UUU-jobs scheduled before vvv. For i≥1i\ge1i≥1, σ(i)\sigma(i)σ(i) denotes the number of VVV-jobs scheduled before iii jobs of UUU have been scheduled.

In the Lean development these are weightedCompletion, IsOptimalSchedule, IsEdgeBiclique, maxBicliqueValue, precSG, procSG, weightSG, valSG, IsOptimalSG and vBefore in the namespace SingleMachinePrec.Biclique.

Formalization targets

Goal: Lemma 9.1 (p. 666)

If a maximum edge biclique of GGG has value an2an^2an2 with a∈(0,1]a\in(0,1]a∈(0,1], then SGS_GSG​ has an optimal schedule and every optimal schedule σ∗\sigma^*σ∗ satisfies

n2−an2(ln⁡1a+2)≤val(σ∗)≤n2−an2.n^2-an^2\Bigl(\ln\frac1a+2\Bigr)\le\mathrm{val}(\sigma^*)\le n^2-an^2 .n2−an2(lna1​+2)≤val(σ∗)≤n2−an2.

Milestones (proof of Lemma 9.1, §9, p. 666)

  1. For every edge biclique (A,B)(A,B)(A,B), a schedule in the block order U∖A→B→A→V∖BU\setminus A\to B\to A\to V\setminus BU∖A→B→A→V∖B exists, and every such schedule is feasible with
val(σ)=n2−∣A∣⋅∣B∣.\mathrm{val}(\sigma)=n^2-|A|\cdot|B| .val(σ)=n2−∣A∣⋅∣B∣.
  1. For every schedule, σ(n+1)=n\sigma(n+1)=nσ(n+1)=n and
val(σ)=∑i=1n(σ(i+1)−σ(i))i=n2−∑i=1nσ(i).\mathrm{val}(\sigma)=\sum_{i=1}^n\bigl(\sigma(i+1)-\sigma(i)\bigr)i=n^2-\sum_{i=1}^n\sigma(i).val(σ)=i=1∑n​(σ(i+1)−σ(i))i=n2−i=1∑n​σ(i).
  1. For every feasible schedule and i=1,…,ni=1,\dots,ni=1,…,n,
σ(i)(n−i+1)≤an2,σ(i)≤n.\sigma(i)(n-i+1)\le an^2,\qquad \sigma(i)\le n .σ(i)(n−i+1)≤an2,σ(i)≤n.

Significance

Lemma 9.1 shows that the optimal value of SGS_GSG​ determines the maximum edge biclique of GGG up to a factor of order ln⁡(1/a)\ln(1/a)ln(1/a) in the "area above the work line" n2−val(σ∗)n^2-\mathrm{val}(\sigma^*)n2−val(σ∗). Combined with the hardness of approximating maximum edge biclique (Theorem 9.1, cited from Ambühl, Mastrolilli and Svensson 2007) it yields Theorem 9.2: 1 ∣ prec ∣ ∑wjCj1\,|\,\mathrm{prec}\,|\,\sum w_jC_j1∣prec∣∑wj​Cj​ has no PTAS unless SAT can be decided by a probabilistic algorithm in time 2Nϵ2^{N^\epsilon}2Nϵ for every ϵ>0\epsilon>0ϵ>0. It also makes precise the two-dimensional Gantt chart picture of Eastman, Even and Isaacs (1964) and of Goemans and Williamson (2000), in which every point on the work line of a schedule defines an edge biclique.

The lemma is proved in the paper; it is not formalized anywhere to our knowledge. A formal proof certifies the combinatorial core of the no-PTAS result independently of the complexity-theoretic layer, and its definitions (the bipartite instance SGS_GSG​, edge bicliques, the profile σ(i)\sigma(i)σ(i)) are reusable for the gap inequality behind Theorem 9.2.

Difficulty

The upper bound is a direct computation on one explicit schedule. The lower bound is a statement about every feasible schedule, of which there are exponentially many, and it must hold with the explicit constant 222 and the factor ln⁡(1/a)\ln(1/a)ln(1/a) for every a∈(0,1]a\in(0,1]a∈(0,1]. The printed argument splits the sum at i=(1−a)ni=(1-a)ni=(1−a)n and uses ⌊an⌋\lfloor an\rfloor⌊an⌋, treating ananan as an integer; for general aaa (for example n=3n=3n=3, value 222, an=2/3an=2/3an=2/3) the split point is not an integer, so the printed estimate does not apply verbatim and the constant 222 has to be re-checked for non-integral ananan. On the formal side, the value identity requires relating completion times in a list to counting UUU-jobs before each VVV-job, with ties among zero-length jobs.

Formalization scope

Jobs are the disjoint union U ⊕ V of two finite types with Fintype.card U = Fintype.card V = n; EEE is a relation U → V → Prop. A schedule is a duplicate-free list containing every job; feasibility is the published LawlerPrec.MinMax.IsFeasible and completion times are the published MooreLateJobs.Shared.completionTime (time 000 start, no idle time). Processing times and weights are reals, here in {0,1}\{0,1\}{0,1}. The maximum edge biclique value is the maximum of ∣A∣⋅∣B∣|A|\cdot|B|∣A∣⋅∣B∣ over all edge bicliques, the empty ones included, so the hypothesis a>0a>0a>0 means E≠∅E\ne\emptysetE=∅. The logarithm is natural (Real.log).

Conventions and readings committed to:

  • The goal is stated for every optimal schedule, and the existence of an optimal schedule is a separate conclusion, so the bounds cannot hold vacuously. Proving the bounds for one particular schedule, or for an optimal value defined as an infimum that could be a junk default, would not be this lemma.
  • No integrality hypothesis on ananan is added.
  • Milestones 2 and 3 are stated for every schedule (respectively every feasible schedule), not only for σ∗\sigma^*σ∗; milestone 1 states the value of the block-order schedule as an equality, where the paper writes "≤⋯=\le\cdots=≤⋯=".
  • The paper's P=(U×V)∖EP=(U\times V)\setminus EP=(U×V)∖E is irreflexive; feasibility only constrains distinct jobs, so it agrees with the reflexive partial order of §1.

Not formalized: Theorem 9.1 (cited hardness of maximum edge biclique) and Theorem 9.2 (no PTAS under a complexity assumption); no polynomial-time or complexity-theoretic statement appears in the mission. Contributions welcome: proofs of the three milestones and of the goal; Mathlib's bounds on harmonic numbers (Mathlib/NumberTheory/Harmonic/Bounds.lean) are the relevant library.

Selected references

  • C. Ambühl, M. Mastrolilli, N. Mutsanas, O. Svensson, On the Approximability of Single-Machine Scheduling with Precedence Constraints, Mathematics of Operations Research 36(4):653–669, 2011. https://doi.org/10.1287/moor.1110.0512
  • C. Ambühl, M. Mastrolilli, O. Svensson, Inapproximability results for sparsest cut, optimal linear arrangement, and precedence constraint scheduling, Proc. 48th IEEE FOCS, 329–337, 2007 (reference [4] of the paper).
  • W. L. Eastman, S. Even, I. M. Isaacs, Bounds for the optimal scheduling of n jobs on m processors, Management Science 11(2):268–279, 1964 (reference [11]).
  • M. X. Goemans, D. P. Williamson, Two-dimensional Gantt charts and a scheduling algorithm of Lawler, SIAM J. Discrete Math. 13(3):281–294, 2000 (reference [15]).
  • P. Schuurman, G. J. Woeginger, Polynomial time approximation algorithms for machine scheduling: ten open problems, J. Scheduling 2(5):203–213, 1999 (reference [36]).
8 thms1 active userReviewed
PreviousNext

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me