Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Operations Research

1,703 missions · 843 completed

The discipline of applying mathematical analysis to complex decision problems in operations: allocating scarce resources, scheduling, routing, inventory, and the design of service and production systems. Drawing on mathematical programming, stochastic modeling, queueing, simulation, and game-theoretic reasoning, it seeks policies that perform provably well in systems shaped by constraints, congestion, and uncertainty.

Missions

Open860Completed843All1703
Algorithmic Game TheoryMechanism DesignProbability·Captain: mikedeng1

Approximate Revenue Maximization with Multiple Items 3: Selling k ≥ 2 Independent Goods Separately Guarantees a Fraction c/log² k of the Optimal RevenueResearch Paper

Motivation

A seller who knows the distributions of a buyer's values for several goods can, in principle, design a mechanism that offers lotteries and prices conditional on the buyer's reported values. Finding the best such mechanism can be difficult even with two goods. Separate selling is much simpler: choose a one-good price for each item and let the buyer decide item by item. The question is how much revenue this simplicity can cost when the goods' values are independent. Hart and Nisan establish a guarantee that declines only with the square of the logarithm of the number of goods, even though the distributions need not be identical or bounded. Their result is Theorem C of Approximate Revenue Maximization with Multiple Items, stated on p. 7 and proved on p. 26.

The paper grew from the problem of comparing easy selling formats with fully optimal mechanisms. For one good, a posted price characterizes optimal revenue. With multiple goods, the choice of a mechanism becomes genuinely multidimensional: its allocation rule can correlate the disposition of the goods and use lotteries. The guarantee in this mission applies uniformly over all independent distributions on nonnegative valuations, so a seller does not need a regularity, density, or finite-moment assumption to use it.

Setting

There is one seller, one risk-neutral buyer, and k≥2k\ge2k≥2 goods. The buyer's valuation vector is x=(xi)i=1k∈R+kx=(x_i)_{i=1}^k\in\mathbb R_+^kx=(xi​)i=1k​∈R+k​; receiving a set of goods gives the sum of the values of its members. The seller knows the joint law of the random vector XXX, but not its realization. In this mission the coordinates XiX_iXi​ are independent, with possibly different probability laws νi\nu_iνi​.

A direct mechanism consists of an allocation rule qi(x)∈[0,1]q_i(x)\in[0,1]qi​(x)∈[0,1] for each good and a real payment s(x)s(x)s(x). At a truthful report xxx, the buyer's payoff is b(x)=∑iqi(x)xi−s(x)b(x)=\sum_i q_i(x)x_i-s(x)b(x)=∑i​qi​(x)xi​−s(x). The mechanism is incentive compatible if truthful reporting is at least as good as every alternative report, and individually rational if b(x)≥0b(x)\ge0b(x)≥0 for every xxx. The seller's expected payment is its revenue. The optimal revenue Rev⁡(X)\operatorname{Rev}(X)Rev(X) is the supremum of revenue over such mechanisms. Payments are taken to be measurable, following footnote 12 on p. 12 of Hart and Nisan.

For one good, Rev⁡(Xi)\operatorname{Rev}(X_i)Rev(Xi​) equals the supremum of pPr⁡[Xi≥p]p\Pr[X_i\ge p]pPr[Xi​≥p] over prices p≥0p\ge0p≥0, as in display (1) on p. 12. The separate revenue is SRev⁡(X)=∑iRev⁡(Xi)\operatorname{SRev}(X)=\sum_i\operatorname{Rev}(X_i)SRev(X)=∑i​Rev(Xi​). The bundled revenue is BRev⁡(X)=Rev⁡(∑iXi)\operatorname{BRev}(X)=\operatorname{Rev}(\sum_i X_i)BRev(X)=Rev(∑i​Xi​), where the sum is treated as one good. Both formats are defined through one-good revenue, even when the full optimum can use multidimensional allocations.

Formalization targets

Theorem C: a uniform guarantee for separate selling

The goal is the inequality form of Theorem C, with one constant that works for every number and every family of independent goods:

∃c>0  ∀k≥2  ∀(νi)i=1k,SRev⁡(X1,…,Xk)≥c(log⁡k)2Rev⁡(X1,…,Xk).\exists c>0\;\forall k\ge2\;\forall (\nu_i)_{i=1}^k,\qquad \operatorname{SRev}(X_1,\ldots,X_k) \ge \frac{c}{(\log k)^2}\operatorname{Rev}(X_1,\ldots,X_k).∃c>0∀k≥2∀(νi​)i=1k​,SRev(X1​,…,Xk​)≥(logk)2c​Rev(X1​,…,Xk​).

Here XiX_iXi​ has law νi\nu_iνi​, and the joint law is their product. The paper phrases the headline as a guarantee for an approximation ratio; the displayed inequality is the form used in its proof on p. 26. It handles zero and infinite optimal revenues without introducing a ratio with an undefined denominator.

Supporting targets

The milestone list records the one-good posted-price formula, monotonicity under first-order stochastic domination, the equal-revenue comparison of Lemma 20, Proposition 13(ii)'s comparison of separate and bundled revenue, the two inequalities of Theorem 7, and the two-good base case of Theorem A. It also records the power-of-two estimate and the zero-padding assertion stated in the proof of Theorem C. Each milestone is attached to its source page in the pinned preprint.

Significance

The theorem gives a distribution-independent performance floor for a mechanism that can be run using one price per good. It applies to unequal and unbounded independent distributions, for which expected values can be infinite while one-good optimal revenues remain finite. The comparison is with the best incentive-compatible and individually rational multi-good mechanism, including randomized allocations, rather than with another simple selling format. The result is proved in the 2017 preprint; the open work here is a machine-checked formalization of that known result and its selected supporting statements.

The formal development also supplies reusable objects: a law-based direct-mechanism model, extended-real expected revenue, product laws for independent groups of goods, and first-order stochastic domination of one-good laws. These are useful for other comparisons among separate selling, bundling, and optimal mechanisms in the same paper. The mission does not pose the paper's distinct i.i.d. bundling theorem, multi-buyer results, or tightness examples.

Difficulty

The main obstacle is that optimal multi-good revenue is not monotone in the values of the goods. Increasing each coordinate of a valuation vector does not, by itself, give a valid comparison between the optimal revenues of the two vectors' laws; Hart and Nisan, p. 23 explicitly warn against that inference. One-good revenue does have the needed monotonicity, but the full optimum can depend on how the goods interact in an incentive-compatible mechanism. Theorem 7 is a substantive bridge between these two regimes. Infinite expected values also make a real-valued integral or an ordinary ratio unsuitable for the general statement.

Formalization scope

Goods are indexed by finite types, and valuations lie in R≥0k\mathbb R_{\ge0}^kR≥0k​. Each good's law is a probability measure; independence means the product law, while Theorem 7 allows dependence among coordinates within each of its two independent groups. A one-good law is represented by a singleton coordinate type. Revenue takes values in R≥0∪{∞}\mathbb R_{\ge0}\cup\{\infty\}R≥0​∪{∞}, and the expectation of a mechanism's possibly negative payment is represented in extended reals. The supremum defining optimal revenue ranges only over feasible, incentive-compatible, individually rational mechanisms with measurable payments. Theorem C quantifies ccc before kkk and the laws, and the restriction k≥2k\ge2k≥2 keeps the logarithmic coefficient in its stated domain.

The equal-revenue law is represented by the density x−2x^{-2}x−2 on [1,∞)[1,\infty)[1,∞), mapped to nonnegative reals. First-order stochastic domination compares the upper-tail probabilities at nonnegative thresholds, which is equivalent to testing every real threshold for nonnegative valuations. A complete proof will need measure-theoretic facts about that law, the posted-price characterization, product measures, and operations on extended nonnegative revenue. Contributions to those reusable facts and to the selected milestone theorems are within scope.

Selected references

  • Sergiu Hart and Noam Nisan, Approximate Revenue Maximization with Multiple Items, arXiv:1204.1846v3, 2017. Preprint.
10 thms0 active usersReviewed
Algorithmic Game Theory·Captain: mikedeng1

Potential Games Are Necessary to Ensure Pure Nash Equilibria in Cost Sharing Games 1: Every Game Has a Pure Nash Equilibrium Iff the Distribution Rules Are Generalized Weighted Shapley ValuesResearch Paper

Motivation

In a cost sharing game (or, symmetrically, a revenue sharing game) self-interested players each pick a set of resources, every resource generates a welfare that depends on who uses it, and a distribution rule splits that welfare among the users. Network formation, atomic routing, coverage and distributed-control problems all fit this model (Anshelevich et al. 2004; Marden and Wierman, Distributed welfare games, 2013; see §2 of the paper). The designer controls only the distribution rule, and the first requirement on a rule is that the games it induces have a pure Nash equilibrium; without one, equilibrium-based efficiency guarantees say nothing.

Which rules guarantee equilibria? The Shapley value and its weighted and generalized-weighted versions do, because they induce potential games (Hart and Mas-Colell 1989). Chen, Roughgarden and Valiant (2010) and Marden and Wierman (Overcoming the limitations of utility design for multiagent systems, 2013) showed that, among budget-balanced rules, these are the only ones that work for every welfare function, by exhibiting one worst-case welfare function (Proposition 1 of the paper, p. 9). Marden and Wierman (Distributed welfare games) also showed that when players may choose only one resource, other budget-balanced rules can work. That left open what happens when the designer knows the welfare functions in advance, and whether dropping budget-balance enlarges the set of good rules. Gopalakrishnan, Marden and Wierman 2014 answered both questions: for any fixed set of welfare functions, with or without budget-balance, the equilibrium-guaranteeing rules are exactly generalized weighted Shapley values on suitable ground welfare functions.

Setting

Players are N={1,…,n}N=\{1,\dots,n\}N={1,…,n} with n>1n>1n>1; resources are R={r1,…,rm}R=\{r_1,\dots,r_m\}R={r1​,…,rm​} with m>1m>1m>1. A local welfare function is W:2N→RW:2^N\to\mathbb RW:2N→R and a distribution rule is f:N×2N→Rf:N\times2^N\to\mathbb Rf:N×2N→R, where f(i,S)f(i,S)f(i,S) is the share of player iii when sharing with the coalition SSS (and f(i,S)=0f(i,S)=0f(i,S)=0 for i∉Si\notin Si∈/S). Each player iii has a nonempty action set Ai⊆2R\mathcal A_i\subseteq 2^RAi​⊆2R. In an allocation aaa, the users of rrr are {a}r={i:r∈ai}\{a\}_r=\{i:r\in a_i\}{a}r​={i:r∈ai​} and player iii receives

Ui(a)=∑r∈aifWr(i,{a}r).U_i(a)=\sum_{r\in a_i}f^{W_r}\bigl(i,\{a\}_r\bigr).Ui​(a)=r∈ai​∑​fWr​(i,{a}r​).

Resources with equal welfare functions use the same rule. For a nonempty set W\mathbb WW of welfare functions, G(N,fW,W)\mathcal G(N,f^{\mathbb W},\mathbb W)G(N,fW,W) is the class of all such games with every Wr∈WW_r\in\mathbb WWr​∈W, any number of resources and any action sets. A rule is budget-balanced for WWW if ∑i∈Sf(i,S)=W(S)\sum_{i\in S}f(i,S)=W(S)∑i∈S​f(i,S)=W(S).

A weight system ω=(λ,Σ)\omega=(\lambda,\Sigma)ω=(λ,Σ) consists of positive weights λi\lambda_iλi​ and an ordered partition Σ=(S1,…,SK)\Sigma=(S_1,\dots,S_K)Σ=(S1​,…,SK​) of NNN into priority classes. For nonempty TTT, T‾=T∩Sk\overline T=T\cap S_kT=T∩Sk​ with kkk the first class meeting TTT. With the basis coefficients qTW=∑R⊆T(−1)∣T∣−∣R∣W(R)q^W_T=\sum_{R\subseteq T}(-1)^{|T|-|R|}W(R)qTW​=∑R⊆T​(−1)∣T∣−∣R∣W(R), the generalized weighted Shapley value is

fGWSVW[ω](i,S)=∑T⊆S: i∈T‾λi∑j∈T‾λj qTW.f^W_{GWSV}[\omega](i,S)=\sum_{T\subseteq S:\,i\in\overline T}\frac{\lambda_i}{\sum_{j\in\overline T}\lambda_j}\,q^W_T .fGWSVW​[ω](i,S)=T⊆S:i∈T∑​∑j∈T​λj​λi​​qTW​.

The distributed welfare of a rule is W′(S)=∑i∈SfW(i,S)W'(S)=\sum_{i\in S}f^W(i,S)W′(S)=∑i∈S​fW(i,S), display (10).

Formalization targets

Goal: Theorem 1

all games in G(N,fW,W) have a pure Nash equilibrium  ⟺  ∃ ω ∀W∈W: fW=fGWSVW′[ω] on {(i,S):i∈S},\text{all games in }\mathcal G(N,f^{\mathbb W},\mathbb W)\text{ have a pure Nash equilibrium}\iff\exists\,\omega\ \forall W\in\mathbb W:\ f^W=f^{W'}_{GWSV}[\omega]\text{ on }\{(i,S):i\in S\},all games in G(N,fW,W) have a pure Nash equilibrium⟺∃ω ∀W∈W: fW=fGWSVW′​[ω] on {(i,S):i∈S},

with W′W'W′ the distributed welfare of fWf^WfW. One weight system serves all of W\mathbb WW.

Milestones

The "if" direction (Appendix A, p. 16). For a single WWW and a budget-balanced fff guaranteeing equilibria: f(i,S)=0f(i,S)=0f(i,S)=0 when SSS contains no contributing coalition (Lemma 1) and for non-contributing iii (Lemma 2); f(i,S)=f(i,N(S))f(i,S)=f(i,N(S))f(i,S)=f(i,N(S)) (Lemma 3). The basis rules fTf^TfT of the recursion (27) are budget-balanced for the inclusion functions (Lemma 5), recover f=∑TqTfTf=\sum_Tq_Tf^Tf=∑T​qT​fT (Lemma 7), obey an inclusion–exclusion principle (Corollary 1), and are generalized weighted Shapley basis rules fGWSVT[ωT]f^T_{GWSV}[\omega^T]fGWSVT​[ωT] (Lemma 8). Across welfare functions the basis shares are consistent pairwise (Lemma 9) and around cycles (Lemma 10); the induced relation on players is a partial order modulo equivalence (Lemma 11), and one universal weight system replaces all ωW,T\omega^{W,T}ωW,T (Lemma 13).

Companions

Proposition 2: for welfare functions normalized by W′(∅)=W′′(∅)=0W'(\emptyset)=W''(\emptyset)=0W′(∅)=W′′(∅)=0, fGWSVW′[ω]=fGWMCW′′[ω]f^{W'}_{GWSV}[\omega]=f^{W''}_{GWMC}[\omega]fGWSVW′​[ω]=fGWMCW′′​[ω] iff T′=T′′\mathcal T'=\mathcal T''T′=T′′ and qT′=(∑j∈T‾λj)qT′′q'_T=(\sum_{j\in\overline T}\lambda_j)q''_TqT′​=(∑j∈T​λj​)qT′′​. Theorem 2: the same characterization with generalized weighted marginal contributions on W′′=h(W′)W''=h(W')W′′=h(W′).

Significance

The theorem settles the design space completely: a designer who wants equilibria in every game over known welfare functions must use a generalized weighted Shapley value, and the only freedom is the weight system and the ground welfare functions, which control budget-balance. Since these rules induce (generalized weighted) potential games, potential games are necessary for guaranteed equilibrium existence in this model, and computing shares inherits the exponential cost of Shapley values. Theorem 2 gives the marginal-contribution form, which needs one marginal contribution per share.

The paper proves Theorem 1 with a full appendix of counterexample constructions; none of it has a published machine-checked proof. The mission asks for a Lean proof of the characterization, of the reusable structure behind it (necessary conditions, basis decomposition, inclusion–exclusion for basis rules, consistency of weight systems), and of the Shapley–marginal-contribution correspondence.

Difficulty

The "if" direction is a potential argument. The "only if" direction is not: every necessary condition is proved by building, from a hypothetical violation, a specific game with no equilibrium, and the games grow more elaborate as the conditions do. Lemma 8 needs the inclusion–exclusion principle to isolate a single basis share, using many weighted copies of resources; Lemma 10's proof combines best-response cycles over kkk welfare functions and is partly omitted on the page ("We omit the proof for brevity", p. 51), so it is the hardest milestone. A tempting shortcut, applying the worst-case result of Chen et al. and Marden–Wierman (Proposition 1, p. 9), fails: it uses one worst-case welfare function, while here W\mathbb WW is arbitrary and may not contain it.

Formalization scope

Players are Fin n, resources Fin m, an action is a Finset (Fin m) (the empty action is allowed). The family of rules is one function f : Welfare n → Rule n, which encodes that equal welfare functions get equal rules. GuaranteesPNE 𝕎 f quantifies over every m > 1, every assignment Fin m → 𝕎 (repetitions allowed: the counterexamples rely on many copies of one welfare function) and every family of nonempty action sets. A weight system stores a block index Fin K per player (empty blocks allowed) and positive weights. Rules are compared only at i∈Si\in Si∈S. Contributing coalitions exclude ∅\emptyset∅ (Appendix A's normalization W(∅)=0W(\emptyset)=0W(∅)=0). The recursion (27) divides by qTq_TqT​ and is used only for contributing TTT; where it reads f(i,T)f(i,T)f(i,T) with i∉Ti\notin Ti∈/T, the paper's convention f(i,S)=0f(i,S)=0f(i,S)=0 off SSS is a hypothesis.

The ground welfare in Theorem 1 is the distributed welfare (10), written out, never an arbitrary function: an existentially quantified ground welfare would make the right side easier and the theorem a different one. The weight system is quantified before the welfare functions, and empty action sets are excluded; with them no game would have an equilibrium and the theorem would claim that no rule is a Shapley value.

Disclosed readings: Lemma 11's "partial order" is antisymmetry modulo the equivalence =Ω+=^+_\Omega=Ω+​, as the proof states; in (74) the first block S1W,TS_1^{W,T}S1W,T​ is read on TTT as its positive-share block T‾\overline TT. Proposition 2 carries W′(∅)=W′′(∅)=0W'(\emptyset)=W''(\emptyset)=0W′(∅)=W′′(∅)=0 so that the paper's basis support, which ranges over all coalitions, agrees with the local support of nonempty coalitions.

A complete development needs: finite games and pure equilibria on resource-selection models, Möbius inversion on Finset lattices, the potential argument for generalized weighted Shapley values (shared with the companion mission on generalized weighted potential games), and counterexample games built from copies of resources. The game model and the basis-rule recursion are reusable for other cost-sharing results. Proofs of any milestone, and alternative arguments for the necessary conditions, are welcome.

Selected references

  • R. Gopalakrishnan, J. R. Marden, A. Wierman, Potential Games are Necessary to Ensure Pure Nash Equilibria in Cost Sharing Games, Math. Oper. Res. 39(4), 2014; preprint arXiv:1402.3610v1, 2014. https://arxiv.org/abs/1402.3610v1
  • S. Hart, A. Mas-Colell, Potential, Value, and Consistency, Econometrica 57(3), 589–614, 1989. https://doi.org/10.2307/1911054
  • H.-L. Chen, T. Roughgarden, G. Valiant, Designing Network Protocols for Good Equilibria, SIAM J. Comput. 39(5), 1799–1832, 2010 (reference [8] of arXiv:1402.3610v1).
  • J. R. Marden, A. Wierman, Overcoming the Limitations of Utility Design for Multiagent Systems, IEEE Trans. Autom. Control, 2013 (reference [30] of arXiv:1402.3610v1).
  • J. R. Marden, A. Wierman, Distributed Welfare Games, Oper. Res., 2013 (reference [29] of arXiv:1402.3610v1).
  • E. Anshelevich, A. Dasgupta, J. Kleinberg, É. Tardos, T. Wexler, T. Roughgarden, The Price of Stability for Network Design with Fair Cost Allocation, FOCS 2004, 295–304 (reference [3] of arXiv:1402.3610v1).
  • L. S. Shapley, A Value for n-Person Games, Contributions to the Theory of Games II, Princeton University Press, 1953 (reference [43] of arXiv:1402.3610v1).
16 thms0 active usersReviewed
Algorithmic Game TheoryOptimization·Captain: mikedeng1

Information Sharing in Competing Supply Chains with Production Cost Reduction: Under Cournot Competition Both Chains Share Below k_N, Both or Neither Between k_N and k_S, and Neither Above k_SResearch Paper

Motivation

Retailers observe demand signals (point-of-sale data, local forecasts) that their suppliers do not. Whether a retailer should pass such a signal upstream is a central question of the supply chain information-sharing literature. In a single chain, sharing helps the manufacturer plan, but the retailer may lose from it. Competition between chains adds a second effect: sharing in one chain changes how the rival chain responds to its own signal.

Ha, Tian and Tong (MSOM 2017) study this question when the manufacturer's planning decision is production cost reduction: a manufacturer that knows more about demand can invest in lowering its unit cost more efficiently. They find that the equilibrium of the information-sharing game between two competing chains depends on a single efficiency parameter kkk in a three-regime pattern. This mission formalizes that pattern for quantity (Cournot) competition.

Earlier work on information sharing in competing chains (for example Ha, Tong and Zhang, Management Science 2011, on production diseconomies of scale) found related threshold structures under different upstream technologies. The present paper replaces the production cost with a cost-reduction investment.

Setting

There are two identical supply chains i=1,2i=1,2i=1,2, each with one manufacturer and one retailer. Retailer iii faces the inverse demand

pi=a+θ−qi−γCqj,p_i=a+\theta-q_i-\gamma_C q_j,pi​=a+θ−qi​−γC​qj​,

where θ\thetaθ is a demand shock with mean 000 and variance σ2\sigma^2σ2, and γC∈(0,1)\gamma_C\in(0,1)γC​∈(0,1) is the competition intensity. Manufacturer iii has unit production cost ccc and lowers it by xix_ixi​ at effort cost 12kxi2\tfrac12 kx_i^221​kxi2​; a small kkk means efficient cost reduction. Retailer iii observes a signal YiY_iYi​ with accuracy ttt; under the linear information structure, E[θ∣Yi]=E[Yj∣Yi]=tσ21+tσ2YiE[\theta\mid Y_i]=E[Y_j\mid Y_i]=\tfrac{t\sigma^2}{1+t\sigma^2}Y_iE[θ∣Yi​]=E[Yj​∣Yi​]=1+tσ2tσ2​Yi​.

In stage one, each chain fixes its arrangement Xi∈{S,N}X_i\in\{S,N\}Xi​∈{S,N}: the retailer shares its signal with the manufacturer (SSS) or not (NNN). Then the manufacturer sets a wholesale price and a cost reduction, and the retailer a quantity. For each arrangement profile (Xi,Xj)(X_i,X_j)(Xi​,Xj​) the quantity stage has a linear equilibrium qi=qˉ+CXiXjYiq_i=\bar q+C^{X_iX_j}Y_iqi​=qˉ​+CXi​Xj​Yi​ with explicit response coefficients CXiXj(k,γC,t,σ2)C^{X_iX_j}(k,\gamma_C,t,\sigma^2)CXi​Xj​(k,γC​,t,σ2) (Lemma 2(a)). These give closed-form ex-ante profits ΠRi,CXiXj\Pi^{X_iX_j}_{R_i,C}ΠRi​,CXi​Xj​​, ΠMi,CXiXj\Pi^{X_iX_j}_{M_i,C}ΠMi​,CXi​Xj​​ and Πi,CXiXj\Pi^{X_iX_j}_{i,C}Πi,CXi​Xj​​ for the retailer, the manufacturer and the chain.

The value of information sharing to chain iii is Vi,CXj=Πi,CSXj−Πi,CNXjV^{X_j}_{i,C}=\Pi^{SX_j}_{i,C}-\Pi^{NX_j}_{i,C}Vi,CXj​​=Πi,CSXj​​−Πi,CNXj​​. In stage one, manufacturer iii offers retailer iii the smallest side payment m^Xj\hat m^{X_j}m^Xj​ that makes sharing acceptable to the retailer, and chooses SSS or NNN. The result is a symmetric 2×22\times22×2 game between the two manufacturers (Table 1). Manufacturer iii's payoff is ΠMi,CSXj−m^Xj\Pi^{SX_j}_{M_i,C}-\hat m^{X_j}ΠMi​,CSXj​​−m^Xj​ for SSS and ΠMi,CNXj\Pi^{NX_j}_{M_i,C}ΠMi​,CNXj​​ for NNN. The standing assumptions are k>a/(4c)k>a/(4c)k>a/(4c), k>1/3k>1/3k>1/3 and a>ca>ca>c.

Formalization targets

Goal: Proposition 7(a)

For fixed γC∈(0,1)\gamma_C\in(0,1)γC​∈(0,1), t>0t>0t>0 and σ2>0\sigma^2>0σ2>0 there are thresholds

12<kCN<kCS<3+54\tfrac12<k^N_C<k^S_C<\tfrac{3+\sqrt5}{4}21​<kCN​<kCS​<43+5​​

such that the set E\mathcal EE of pure-strategy equilibria of the stage-one game is

E={(S,S)} (k<kCN),E={(S,S),(N,N)} (kCN<k<kCS),E={(N,N)} (k>kCS).\mathcal E=\{(S,S)\}\ (k<k^N_C),\qquad \mathcal E=\{(S,S),(N,N)\}\ (k^N_C<k<k^S_C),\qquad \mathcal E=\{(N,N)\}\ (k>k^S_C).E={(S,S)} (k<kCN​),E={(S,S),(N,N)} (kCN​<k<kCS​),E={(N,N)} (k>kCS​).

In the middle regime, both manufacturers are strictly better off at (S,S)(S,S)(S,S) than at (N,N)(N,N)(N,N).

Milestones

  • the linear strategies solve the best responses (proof of Lemma 2(a));
  • CjXjXi<1C^{X_jX_i}_j<1CjXj​Xi​​<1 and the four coefficient differences in closed form with their signs (proof of Lemma 3);
  • the retailer gains from sharing if and only if k≤1/2k\le1/2k≤1/2, and for k≤1/2k\le1/2k≤1/2 free information strictly raises the manufacturer's profit (§5.3);
  • Vi,CS>0  ⟺  g>0V^S_{i,C}>0\iff g>0Vi,CS​>0⟺g>0 and Vi,CN>0  ⟺  h>0V^N_{i,C}>0\iff h>0Vi,CN​>0⟺h>0 for two explicit polynomials g,hg,hg,h (proof of Proposition 6(a));
  • Proposition 6(a): Vi,CS>0  ⟺  k<kCSV^S_{i,C}>0\iff k<k^S_CVi,CS​>0⟺k<kCS​, Vi,CN>0  ⟺  k<kCNV^N_{i,C}>0\iff k<k^N_CVi,CN​>0⟺k<kCN​, the bounds above, and both thresholds strictly decreasing in ttt and in γC\gamma_CγC​.

A companion item states the Cournot half of Proposition 7(c): for k<1/2k<1/2k<1/2 no side payment is needed and (S,S)(S,S)(S,S) is the unique equilibrium.

Significance

Proposition 7(a) separates three regimes of cost-reduction efficiency. When cost reduction is efficient (k<kCNk<k^N_Ck<kCN​), sharing is dominant. At intermediate efficiency the stage-one game is a coordination game: both chains sharing is Pareto-better for the manufacturers, but both not sharing is also an equilibrium. When cost reduction is inefficient, no chain shares. Competition matters through the gap kCN<kCSk^N_C<k^S_CkCN​<kCS​: a chain whose rival shares tolerates a less efficient cost reduction before it stops sharing, and the thresholds fall as signals become more accurate or competition more intense.

The paper proves these facts by hand-checked algebra, often stated as "we can verify". The formalization turns each such step into a checked statement: the fixed-point identities behind Lemma 2(a), the closed forms of Lemma 3, the reduction of the sign of VVV to the polynomials ggg and hhh, and the monotonicity and location of their roots. None of these results has a machine-checked proof yet. The definitions (response coefficients, profits, side payment, stage-one game) are reusable for the Bertrand half of the paper and for other two-chain information-sharing models.

Difficulty

The obvious approach expands VSV^SVS and VNV^NVN as rational functions of (k,γC,t,σ2)(k,\gamma_C,t,\sigma^2)(k,γC​,t,σ2) and tries to read off their signs. That does not finish by itself. After cancelling positive factors, the signs are those of ggg and hhh, which are quadratics in ξ=t2σ4γC2/(tσ2+1)2∈(0,1)\xi=t^2\sigma^4\gamma_C^2/(t\sigma^2+1)^2\in(0,1)ξ=t2σ4γC2​/(tσ2+1)2∈(0,1) with coefficients polynomial in kkk. The thresholds are defined implicitly by a root of each quadratic crossing ξ\xiξ. Showing that {g>0}\{g>0\}{g>0} and {h>0}\{h>0\}{h>0} are initial intervals of (1/3,∞)(1/3,\infty)(1/3,∞) needs the relevant root to be strictly decreasing in kkk, to exceed 111 below k=1/2k=1/2k=1/2 and to change sign at (3+5)/4(3+\sqrt5)/4(3+5​)/4. The strict ordering kCN<kCSk^N_C<k^S_CkCN​<kCS​ needs a comparison of two roots involving k3(6k−1)\sqrt{k^3(6k-1)}k3(6k−1)​ and k(6k−1)\sqrt{k(6k-1)}k(6k−1)​ on (1/2,(3+5)/4)(1/2,(3+\sqrt5)/4)(1/2,(3+5​)/4). The equilibrium analysis then needs the retailer comparison, to know when the side payment is positive. Table 1's payoff entries are valid only in that case.

Formalization scope

Everything is over R\mathbb RR, in the namespace CompetingChains.Cournot. A general definition TwoPlayerGame gives pure-strategy Nash equilibria of a two-player normal-form game. The definition Setting records the paper's reduced form: the standing assumptions, the response coefficients CXiXjC^{X_iX_j}CXi​Xj​ of Lemma 2(a), the best responses (7) and (9), the ex-ante profit functions of p. 17, the equilibrium profits ΠXiXj=πXi(CjXjXi)\Pi^{X_iX_j}=\pi^{X_i}(C_j^{X_jX_i})ΠXi​Xj​=πXi​(CjXj​Xi​​), VVV, m^\hat mm^, the stage-one payoff and its set of pure equilibria. The Bayesian stages enter only through these closed forms. The arrangements are an inductive type {S, N}. Manufacturer 2's payoff at (X1,X2)(X_1,X_2)(X1​,X2​) is manufacturer 1's payoff at (X2,X1)(X_2,X_1)(X2​,X1​). The chain profit is defined as retailer plus manufacturer profit. The stage-one payoff uses m^\hat mm^ as printed on p. 21, and agrees with Table 1 whenever the side payment is positive.

Conventions and added hypotheses, each disclosed in the items:

  • γC>0\gamma_C>0γC​>0 wherever the result needs it; at γC=0\gamma_C=0γC​=0 the chains do not interact and the middle regime is empty. Positivity of ccc, ttt and σ2\sigma^2σ2 is part of the standing assumptions.
  • The goal's "otherwise" is read as k>kCSk>k^S_Ck>kCS​, because both profiles are equilibria at k=kCNk=k^N_Ck=kCN​ and k=kCSk=k^S_Ck=kCS​.
  • Only pure-strategy equilibria are counted. "Unique equilibrium" is equality of the equilibrium set with a singleton, not membership.
  • The thresholds depend on (γC,t,σ2)(\gamma_C,t,\sigma^2)(γC​,t,σ2) only and are chosen before a,c,ka,c,ka,c,k.
  • "Decreasing" means strictly decreasing.
  • Every division is real division by a quantity positive under k>1/3k>1/3k>1/3, γC≥0\gamma_C\ge0γC​≥0, tσ2>0t\sigma^2>0tσ2>0. These hypotheses are carried in every theorem, so no statement is about Lean's value x/0=0x/0=0x/0=0.

The coefficients, profits, VVV and payoffs are definitions, never free parameters. A statement with free coefficients, a goal whose thresholds lack kCN<kCSk^N_C<k^S_CkCN​<kCS​, or one that only asserts membership of (S,S)(S,S)(S,S) would be trivial or weaker, and is not what is posed. No published platform definition states this model, so none is referenced.

Not in scope: Lemma 2's uniqueness (delegated by the paper to earlier work), the wholesale-price and cost-reduction lines of Lemma 2(a), the Bertrand half (Propositions 6(b), 7(b)), the single-chain analysis of §4, Proposition 8 and the numerical study. Proofs of any item are welcome. The polynomial root analysis behind Proposition 6(a) is the main open piece of work.

Selected references

  • A. Y. Ha, Q. Tian and S. Tong, Information Sharing in Competing Supply Chains with Production Cost Reduction, Manufacturing & Service Operations Management 19(2), 2017. https://doi.org/10.1287/msom.2016.0607
  • A. Y. Ha, S. Tong and H. Zhang, Sharing Imperfect Demand Information in Competing Supply Chains with Production Diseconomies, Management Science 57(3), 566–581, 2011. https://doi.org/10.1287/mnsc.1100.1295
12 thms0 active usersReviewed
Algorithmic Game TheoryMechanism DesignProbability·Captain: mikedeng1

Approximate Revenue Maximization with Multiple Items 5: Bundling Is Optimal for Two I.I.D. Goods Whose Density on [a, ∞) Satisfies x f′(x) + (3/2) f(x) ≤ 0Research Paper

Motivation

A seller with several goods and a single buyer of unknown, additive valuation faces the multi-dimensional revenue maximization problem. For one good the answer is classical: by Myerson's theorem (Myerson 1981) a single posted price is optimal. For two or more goods no such simplification exists in general: optimal mechanisms may randomize, may offer menus of lotteries, and are rarely known in closed form. Selling the grand bundle at one price is the simplest multi-good mechanism, and it is used widely in practice.

Hart and Nisan (arXiv:1204.1846, J. Econ. Theory 2017) quantify how much revenue simple mechanisms lose. Most of their results are approximation bounds. Section 7.2 of the paper also contains an exact result: for two independent and identically distributed goods whose density decays fast enough, in the sense of a differential inequality, bundling is exactly optimal. This mission formalizes that theorem, Theorem 16, and the steps of its proof in Appendix A.6.

Timeline. Manelli and Vincent (2006) gave conditions under which a bundled mechanism is optimal for a multiple-good monopolist. Hart and Nisan's preprint (2012, revised 2017) proved Theorem 16 with the condition xf′(x)+32f(x)≤0x f'(x) + \tfrac32 f(x) \le 0xf′(x)+23​f(x)≤0. Daskalakis, Deckelbaum and Tzamos (2017) later gave a strong duality theory for the multiple-good monopolist, based on optimal transport.

Setting

There are two goods and one buyer. A valuation is a vector x=(y,z)∈R+2x = (y, z) \in \mathbb{R}^2_+x=(y,z)∈R+2​. The buyer's values Y,ZY, ZY,Z are i.i.d. with a one-good law FFF on R+\mathbb{R}_+R+​.

A mechanism μ=(q,s)\mu = (q, s)μ=(q,s) assigns to each reported valuation xxx an allocation vector q(x)∈[0,1]2q(x) \in [0,1]^2q(x)∈[0,1]2 (qi(x)q_i(x)qi​(x) is the probability that good iii is sold) and a payment s(x)∈Rs(x) \in \mathbb{R}s(x)∈R. The buyer's payoff is b(x)=q(x)⋅x−s(x)b(x) = q(x)\cdot x - s(x)b(x)=q(x)⋅x−s(x). The mechanism is

  • incentive compatible (IC) if b(x)≥q(x~)⋅x−s(x~)b(x) \ge q(\tilde x)\cdot x - s(\tilde x)b(x)≥q(x~)⋅x−s(x~) for all x,x~∈R+2x, \tilde x \in \mathbb{R}^2_+x,x~∈R+2​;
  • individually rational (IR) if b(x)≥0b(x) \ge 0b(x)≥0 for all xxx;
  • NPT (no positive transfer) if s≥0s \ge 0s≥0.

The revenue of μ\muμ is R(μ;X)=E[s(X)]R(\mu; X) = \mathbb{E}[s(X)]R(μ;X)=E[s(X)], and the optimal revenue is Rev(X)=sup⁡R(μ;X)\mathrm{Rev}(X) = \sup R(\mu; X)Rev(X)=supR(μ;X) over all IC and IR mechanisms. The bundled revenue is BRev(X)=Rev(Y+Z)\mathrm{BRev}(X) = \mathrm{Rev}(Y + Z)BRev(X)=Rev(Y+Z), the optimal revenue from selling the bundle as a single good.

A two-good mechanism is symmetric if q1(y,z)=q2(z,y)q_1(y,z) = q_2(z,y)q1​(y,z)=q2​(z,y) and s(y,z)=s(z,y)s(y,z) = s(z,y)s(y,z)=s(z,y). For a level a≥0a \ge 0a≥0, the bundled majorant μ^=(q^,s^)\hat\mu = (\hat q, \hat s)μ^​=(q^​,s^) of μ\muμ is

q^(y,z)=(q1(y+z−a,a), q1(y+z−a,a)),s^(y,z)=q^(y,z)⋅(y,z)−b(y+z−a,a).\hat q(y,z) = \bigl(q_1(y+z-a, a),\ q_1(y+z-a, a)\bigr), \qquad \hat s(y,z) = \hat q(y,z)\cdot(y,z) - b(y+z-a, a).q^​(y,z)=(q1​(y+z−a,a), q1​(y+z−a,a)),s^(y,z)=q^​(y,z)⋅(y,z)−b(y+z−a,a).

It depends on (y,z)(y,z)(y,z) only through y+zy + zy+z, so it is a bundled mechanism.

Formalization targets

Goal: Theorem 16

Let a>0a > 0a>0 and let FFF have a density fff supported in [a,∞)[a, \infty)[a,∞), differentiable on (a,∞)(a,\infty)(a,∞), with

xf′(x)+32f(x)≤0(x>a).(9)x f'(x) + \tfrac32 f(x) \le 0 \qquad (x > a). \tag{9}xf′(x)+23​f(x)≤0(x>a).(9)

Then for two i.i.d.-FFF goods,

Rev(X1,X2)=BRev(X1,X2)=Rev(X1+X2).\mathrm{Rev}(X_1, X_2) = \mathrm{BRev}(X_1, X_2) = \mathrm{Rev}(X_1 + X_2).Rev(X1​,X2​)=BRev(X1​,X2​)=Rev(X1​+X2​).

The substance is Rev≤BRev\mathrm{Rev} \le \mathrm{BRev}Rev≤BRev. The reverse inequality holds for every law, and the second equality is the definition of BRev\mathrm{BRev}BRev.

Milestones

  1. Proposition 5 (at least one good): IC holds if and only if bbb is convex and q(x)q(x)q(x) is a subgradient of bbb at every xxx.
  2. Proposition 6 (iii) (at least one good): the supremum defining Rev\mathrm{Rev}Rev may be restricted to NPT mechanisms.
  3. Symmetrization (p. 32): for i.i.d. goods, the symmetrization μˉ\bar\muμˉ​ is IC, IR, NPT and symmetric, and it has the same revenue.
  4. Display (18): for symmetric IC μ\muμ and y,z≥ay, z \ge ay,z≥a, b(y,z)≤b(y+z−a,a)b(y,z) \le b(y+z-a, a)b(y,z)≤b(y+z−a,a).
  5. μ^\hat\muμ^​ is feasible, IC and IR on the quadrant [a,∞)2[a,\infty)^2[a,∞)2, and bundled.
  6. Under (9), R(μ;X)≤R(μ^;X)R(\mu; X) \le R(\hat\mu; X)R(μ;X)≤R(μ^​;X) for symmetric IC, IR and NPT μ\muμ.

Companion: Corollary 17

For two i.i.d. goods with the equal-revenue law P[V≥p]=1/p\mathbb{P}[V \ge p] = 1/pP[V≥p]=1/p (p≥1p \ge 1p≥1),

Rev(V1,V2)=BRev(V1,V2)=2(w+1)≈2.56,\mathrm{Rev}(V_1,V_2) = \mathrm{BRev}(V_1,V_2) = 2(w+1) \approx 2.56,Rev(V1​,V2​)=BRev(V1​,V2​)=2(w+1)≈2.56,

where wew+1=1w e^{w+1} = 1wew+1=1.

Significance

Theorem 16 is one of the few closed-form optimality results for multi-good monopoly. It gives an explicit, checkable condition: x3/2f(x)x^{3/2} f(x)x3/2f(x) is nonincreasing. The condition covers the equal-revenue distribution and Pareto distributions with index α≥1/2\alpha \ge 1/2α≥1/2. On these distributions the optimal revenue reduces to a one-dimensional pricing problem for Y+ZY + ZY+Z. Corollary 17 is the resulting exact value for two equal-revenue goods. Elsewhere in the paper, Theorems C and D use the equal-revenue law as the extremal example for the approximation ratios.

The theorem is proved in the paper. As far as is known it has not been machine-checked. The mission formalizes the model and every step of the proof as a separate milestone. These steps are Rochet's characterization (Proposition 5), the NPT reduction, symmetrization, the convexity majorization (18), and the revenue comparison under (9). Propositions 5 and 6 (iii) and symmetrization are shared with other missions of this series, so they are reusable beyond Theorem 16.

Difficulty

The obvious approach is to show that the optimal mechanism is bundled by exhibiting it. This fails because nothing is known about the optimal mechanism, and it need not exist. The proof instead compares an arbitrary symmetric mechanism with its bundled majorant μ^\hat\muμ^​. A pointwise comparison fails: b^≥b\hat b \ge bb^≥b does not imply s^≥s\hat s \ge ss^≥s. The comparison holds only in expectation and only for densities satisfying (9); without (9) bundling is not optimal in general.

Making this rigorous requires several things:

  • the a.e. differentiability of the convex function bbb, together with q1=∂b/∂yq_1 = \partial b/\partial yq1​=∂b/∂y a.e.;
  • integration by parts on truncated squares [a,M]2[a, M]^2[a,M]2 with possibly infinite total revenue;
  • control of the boundary term at y=ay = ay=a, where fff need not be bounded or continuous;
  • the extension of μ^\hat\muμ^​, defined on [a,∞)2[a,\infty)^2[a,∞)2, to an IC and IR mechanism on all of R+2\mathbb{R}^2_+R+2​.

Formalization scope

Valuations are functions Fin 2→R≥0\mathrm{Fin}\ 2 \to \mathbb{R}_{\ge 0}Fin 2→R≥0​, and random valuations are given by their laws. "Two i.i.d. goods" is the product measure ν⊗ν\nu \otimes \nuν⊗ν. The law ν\nuν is the image on R≥0\mathbb{R}_{\ge0}R≥0​ of f(x) dxf(x)\,dxf(x)dx, so no mass is lost because f=0f = 0f=0 below a>0a > 0a>0. "Density function" means: fff measurable, f≥0f \ge 0f≥0, ∫f=1\int f = 1∫f=1, and f=0f = 0f=0 on (−∞,a)(-\infty, a)(−∞,a). Continuity of FFF is then automatic. Differentiability of fff is required at every x>ax > ax>a, the range of (9). Nothing is assumed about fff at aaa; in particular fff may blow up there.

Admissible mechanisms are feasible, IC, IR and have a measurable payment function. The paper allows measurability without loss of generality (footnote 12). Revenue R(μ;X)R(\mu;X)R(μ;X) is an extended real, so a non-integrable payment never collapses to 000. Rev\mathrm{Rev}Rev takes values in [0,∞][0,\infty][0,∞] and may be infinite under (9), for instance for f(x)=c x−3/2f(x) = c\,x^{-3/2}f(x)=cx−3/2 on [a,∞)[a,\infty)[a,∞). Milestone 5 states IC and IR of μ^\hat\muμ^​ on the quadrant only, as the paper defines μ^\hat\muμ^​ there. Off the quadrant, y+z−ay + z - ay+z−a is truncated at 000.

The goal must not be stated as the second equality alone, which is definitional. Nor may it assume the law is bounded or that f(a)f(a)f(a) is finite: these would replace the theorem with a special case. The display (17) and the limit formula (16) are not posed, because their boundary term 2af(a)∫b(a,z)f(z) dz2a f(a)\int b(a,z) f(z)\,dz2af(a)∫b(a,z)f(z)dz refers to the value of fff at aaa, which the hypotheses do not control.

A complete development needs Rochet's characterization, a.e. gradients of convex functions on R+2\mathbb{R}^2_+R+2​, Fubini–Tonelli on the product law, one-dimensional integration by parts with an absolutely continuous weight, and Myerson's one-good formula for Corollary 17. Contributions of any of these as standalone lemmas are welcome.

Selected references

  • S. Hart and N. Nisan, Approximate Revenue Maximization with Multiple Items, J. Econ. Theory 172 (2017); arXiv:1204.1846v3. https://arxiv.org/abs/1204.1846
  • R. Myerson, Optimal Auction Design, Math. Oper. Res. 6 (1981) 58–73. https://doi.org/10.1287/moor.6.1.58
  • J.-C. Rochet, The taxation principle and multi-time Hamilton–Jacobi equations, J. Math. Econ. 14 (1985) 113–128. https://doi.org/10.1016/0304-4068(85)90015-1
  • A. Manelli and D. Vincent, Bundling as an optimal selling mechanism for a multiple-good monopolist, J. Econ. Theory 127 (2006) 1–35. https://doi.org/10.1016/j.jet.2005.08.007
  • S. Hart and P. Reny, Maximal revenue with multiple goods: nonmonotonicity and other observations, Theoretical Economics 10 (2015) 893–922. https://doi.org/10.3982/TE1517
  • C. Daskalakis, A. Deckelbaum and C. Tzamos, Strong duality for a multiple-good monopolist, Econometrica 85 (2017) 735–767. https://doi.org/10.3982/ECTA12618
9 thms0 active usersReviewed
Algorithmic Game TheoryMechanism DesignProbability·Captain: mikedeng1

Approximate Revenue Maximization with Multiple Items 1: For Independent Groups of Goods Y and Z, Rev(Y, Z) ≤ Rev(Y) + Rev(Z) + BRev(Y) + BRev(Z)Research Paper

Motivation

A seller who offers several goods to a buyer with private values has to choose a selling mechanism. For one good the optimal mechanism is known: post the best take-it-or-leave-it price (Myerson 1981). For two or more goods the optimal mechanism can be complicated: it may use lotteries, its menu may be infinite, and it may not be computable in closed form even for simple value distributions. Sellers therefore use simple mechanisms, such as selling each good separately or selling all goods as one bundle, and the question is how much revenue this costs.

Hart and Nisan (arXiv:1204.1846v3, J. Econ. Theory 2017) answer this with guaranteed fractions of the optimal revenue. Their basic tool is a decomposition theorem: when the goods split into two groups whose values are independent, the optimal revenue from all goods together is bounded by revenues computed from each group separately. This mission formalizes that theorem (Theorem 7) and the paper's first headline result, Theorem A, which is its two-good case.

Setting

There are k≥1k \ge 1k≥1 goods and one buyer with additive values. A valuation is a vector x∈R+kx \in \mathbb{R}^k_+x∈R+k​, and a kkk-good random valuation XXX is a random vector in R+k\mathbb{R}^k_+R+k​ whose law the seller knows.

A mechanism μ=(q,s)\mu = (q, s)μ=(q,s) consists of an allocation q:R+k→[0,1]kq : \mathbb{R}^k_+ \to [0,1]^kq:R+k​→[0,1]k, where qi(x)q_i(x)qi​(x) is the probability that the buyer receives good iii when reporting xxx, and a payment s:R+k→Rs : \mathbb{R}^k_+ \to \mathbb{R}s:R+k​→R. The buyer's payoff from truthful reporting is b(x)=q(x)⋅x−s(x)b(x) = q(x)\cdot x - s(x)b(x)=q(x)⋅x−s(x). The mechanism is

  • incentive compatible (IC) if b(x)≥q(x~)⋅x−s(x~)b(x) \ge q(\tilde x)\cdot x - s(\tilde x)b(x)≥q(x~)⋅x−s(x~) for all x,x~∈R+kx, \tilde x \in \mathbb{R}^k_+x,x~∈R+k​;
  • individually rational (IR) if b(x)≥0b(x) \ge 0b(x)≥0 for all xxx;
  • no positive transfer (NPT) if s(x)≥0s(x) \ge 0s(x)≥0 for all xxx.

Let M\mathcal MM be the class of IC and IR mechanisms. The expected revenue of μ∈M\mu \in \mathcal Mμ∈M is R(μ;X)=E[s(X)]R(\mu; X) = \mathbb{E}[s(X)]R(μ;X)=E[s(X)], which lies in (−∞,+∞](-\infty, +\infty](−∞,+∞], and the optimal revenue is

Rev(X)=sup⁡μ∈MR(μ;X)∈[0,∞].\mathrm{Rev}(X) = \sup_{\mu \in \mathcal M} R(\mu; X) \in [0, \infty].Rev(X)=μ∈Msup​R(μ;X)∈[0,∞].

Two benchmarks reduce to one-good problems: the separate revenue SRev(X)=Rev(X1)+⋯+Rev(Xk)\mathrm{SRev}(X) = \mathrm{Rev}(X_1) + \dots + \mathrm{Rev}(X_k)SRev(X)=Rev(X1​)+⋯+Rev(Xk​) and the bundled revenue BRev(X)=Rev(X1+⋯+Xk)\mathrm{BRev}(X) = \mathrm{Rev}(X_1 + \dots + X_k)BRev(X)=Rev(X1​+⋯+Xk​). Finally Val(X)=E[∑iXi]\mathrm{Val}(X) = \mathbb{E}[\sum_i X_i]Val(X)=E[∑i​Xi​] is the expected total value.

For the decomposition, YYY is a random valuation for k1≥1k_1 \ge 1k1​≥1 goods and ZZZ one for k2≥1k_2 \ge 1k2​≥1 goods. The coordinates of YYY may be arbitrarily dependent, and so may those of ZZZ, but the vectors YYY and ZZZ are independent. Rev(Y,Z)\mathrm{Rev}(Y, Z)Rev(Y,Z) is the optimal revenue from selling all k1+k2k_1 + k_2k1​+k2​ goods together, and X1X∈AX\mathbf 1_{X \in A}X1X∈A​ is the random valuation equal to XXX on the event X∈AX \in AX∈A and to 000 otherwise.

Formalization targets

Goal: Theorem 7 (p. 18)

If YYY and ZZZ are independent, then

Rev(Y,Z)≤Rev(Y)+Rev(Z)+BRev(Y)+BRev(Z)≤2(Rev(Y)+Rev(Z)).\mathrm{Rev}(Y, Z) \le \mathrm{Rev}(Y) + \mathrm{Rev}(Z) + \mathrm{BRev}(Y) + \mathrm{BRev}(Z) \le 2\big(\mathrm{Rev}(Y) + \mathrm{Rev}(Z)\big).Rev(Y,Z)≤Rev(Y)+Rev(Z)+BRev(Y)+BRev(Z)≤2(Rev(Y)+Rev(Z)).

Both inequalities are part of the goal, with the same middle term.

Milestones, in the order of the paper's proof

  1. Proposition 6 (iii), p. 14: Rev(X)\mathrm{Rev}(X)Rev(X) is the supremum of R(μ;X)R(\mu; X)R(μ;X) over IC, IR and NPT mechanisms.
  2. The NPT split, p. 20: Rev(Y,Z)≤Rev((Y,Z)1∑iYi≥∑jZj)+Rev((Y,Z)1∑jZj≥∑iYi)\mathrm{Rev}(Y,Z) \le \mathrm{Rev}\big((Y,Z)\mathbf 1_{\sum_i Y_i \ge \sum_j Z_j}\big) + \mathrm{Rev}\big((Y,Z)\mathbf 1_{\sum_j Z_j \ge \sum_i Y_i}\big)Rev(Y,Z)≤Rev((Y,Z)1∑i​Yi​≥∑j​Zj​​)+Rev((Y,Z)1∑j​Zj​≥∑i​Yi​​).
  3. Proposition 6 (iv), p. 14: for μ∈M\mu \in \mathcal Mμ∈M and a set AAA of values, E[s(X)1X∈A]≤Rev(X1X∈A)≤Rev(X)\mathbb{E}[s(X)\mathbf 1_{X\in A}] \le \mathrm{Rev}(X\mathbf 1_{X\in A}) \le \mathrm{Rev}(X)E[s(X)1X∈A​]≤Rev(X1X∈A​)≤Rev(X).
  4. Lemma 8, p. 19: Rev((Y,Z)1(Y,Z)∈A)≤Rev(Y)+Val(Z1(Y,Z)∈A)\mathrm{Rev}\big((Y,Z)\mathbf 1_{(Y,Z)\in A}\big) \le \mathrm{Rev}(Y) + \mathrm{Val}\big(Z\mathbf 1_{(Y,Z)\in A}\big)Rev((Y,Z)1(Y,Z)∈A​)≤Rev(Y)+Val(Z1(Y,Z)∈A​).
  5. Lemma 9, p. 20: for one-dimensional independent Y,ZY, ZY,Z, Val(Z1Y≥Z)≤Rev(Y)\mathrm{Val}(Z\mathbf 1_{Y \ge Z}) \le \mathrm{Rev}(Y)Val(Z1Y≥Z​)≤Rev(Y).
  6. Lemma 10, p. 20: Val(Z1∑iYi≥∑jZj)≤BRev(Y)\mathrm{Val}\big(Z\mathbf 1_{\sum_i Y_i \ge \sum_j Z_j}\big) \le \mathrm{BRev}(Y)Val(Z1∑i​Yi​≥∑j​Zj​​)≤BRev(Y).
  7. BRev ≤ Rev, p. 18.

Companions

Theorem A in the form (2), p. 16: for two independent goods Y,ZY, ZY,Z, Rev(Y,Z)≤2(Rev(Y)+Rev(Z))\mathrm{Rev}(Y, Z) \le 2(\mathrm{Rev}(Y) + \mathrm{Rev}(Z))Rev(Y,Z)≤2(Rev(Y)+Rev(Z)). Also posed is display (5), p. 17: z⋅P[Y≥z]≤Rev(Y)z\cdot\mathbb{P}[Y \ge z] \le \mathrm{Rev}(Y)z⋅P[Y≥z]≤Rev(Y) for one good and every z≥0z \ge 0z≥0.

Significance

Theorem A says that for two independent goods, selling them separately guarantees half of the optimal revenue, whatever the distributions. Theorem 7 extends this to two independent groups of goods. It is the induction step behind the paper's bounds for many goods: separate selling guarantees a fraction c/log⁡2kc/\log^2 kc/log2k of the optimal revenue for kkk independent goods (Theorem C), and bundling guarantees c/log⁡kc/\log kc/logk for kkk i.i.d. goods (Theorem D). These are other missions of this series, and both use Theorem 7 as a black box. The same approach underlies later work on simple versus optimal mechanisms, for example Babaioff, Immorlica, Lucier and Weinberg (FOCS 2014) and Li and Yao (PNAS 2013).

All results posed here are proved in the paper. As far as we know, none has a machine-checked proof. A formal proof would give a reusable development of mechanism design with multi-dimensional types: IC and IR mechanisms on R+k\mathbb{R}^k_+R+k​, revenue as an extended-real expectation, restriction of mechanisms to subdomains, and marginal mechanisms obtained by fixing some coordinates of an independent product.

Difficulty

The proofs are short on paper but rest on measure theory the prose passes over. Lemma 8 conditions on Z=zZ = zZ=z and applies Proposition 6 (iv) to a one-group mechanism for each fixed zzz. Formally this is a Tonelli argument on a product measure, with an integrand that may be negative on part of the space and +∞+\infty+∞ in expectation. The induced mechanism sz(y)=s(y,z)−∑jqj(y,z)zjs^z(y) = s(y, z) - \sum_j q_j(y,z) z_jsz(y)=s(y,z)−∑j​qj​(y,z)zj​ involves the allocation qqq, which is not assumed measurable. Proposition 6 (iv) bounds a mechanism with possibly negative payments by the optimal revenue on a modified valuation X1X∈AX\mathbf 1_{X \in A}X1X∈A​, and this requires shifting the mechanism to make it NPT. Finally, every revenue may be infinite, so the inequalities must be handled in [0,∞][0,\infty][0,∞] and in the extended reals, without cancelling.

A natural first idea is to apply Theorem A coordinate by coordinate. This fails, because the coordinates inside YYY may be dependent. Only the independence of YYY from ZZZ is available, and the bound must go through the bundled revenue BRev\mathrm{BRev}BRev.

Formalization scope

  • Valuations as laws. A random valuation is represented by its law, a probability measure on ι → ℝ≥0 for a finite type ι of goods. Every quantity of the paper depends only on the law. One good is ι = Unit.
  • Independence as a product law. The law of (Y,Z)(Y,Z)(Y,Z) is the product of the laws of YYY and ZZZ, transported to ι₁ ⊕ ι₂ → ℝ≥0. Theorems that need independence are never stated over an arbitrary joint law with given marginals, since they are false for correlated groups. The NPT split in the proof of Theorem 7 is stated for independent groups, as on the page. Proposition 6 applies to an arbitrary law.
  • The class M\mathcal MM. M\mathcal MM requires q∈[0,1]kq \in [0,1]^kq∈[0,1]k, IC, IR and a measurable payment sss, the last as allowed by the paper's footnote 12. qqq is not required to be measurable.
  • Revenue. R(μ;X)R(\mu;X)R(μ;X) is ∫s+−∫s−\int s^+ - \int s^-∫s+−∫s− in the extended reals, so that E[s(X)]=+∞\mathbb{E}[s(X)] = +\inftyE[s(X)]=+∞ is kept. Since s≥s(0)s \ge s(0)s≥s(0) under IC, the negative part is finite. The Bochner integral is not used, because it would assign 000 to a non-integrable payment. Rev\mathrm{Rev}Rev, SRev\mathrm{SRev}SRev, BRev\mathrm{BRev}BRev and Val\mathrm{Val}Val take values in [0,∞][0,\infty][0,∞].
  • Subdomains. X1X∈AX\mathbf 1_{X\in A}X1X∈A​ is the image law under x↦x1A(x)x \mapsto x\mathbf 1_A(x)x↦x1A​(x), and AAA is assumed measurable. The regions of the proof of Theorem 7 are both closed, so the diagonal is counted twice, as in the paper.
  • Not trivializable. A formalization in which Rev\mathrm{Rev}Rev is computed with a Bochner integral, the expected revenue is clipped before comparing a single mechanism with Rev\mathrm{Rev}Rev, or independence is dropped does not state the paper's theorem, and none of these is used.
  • Not posed. The ratio form of Theorem A (GFOR≥1/2\mathrm{GFOR} \ge 1/2GFOR≥1/2) is not posed, because of its conventions 0/0=10/0 = 10/0=1 and ∞/∞\infty/\infty∞/∞. Theorems B, C, D, 16 and 33 are separate missions of this series.

Contributions are welcome at every level: Proposition 6 (the NPT shift and subdomain restriction), the marginal-mechanism construction behind Lemma 8, and the one-good facts (5) and Lemma 9 are all reusable in the sibling missions on Theorems C and D.

Selected references

  • S. Hart and N. Nisan, Approximate Revenue Maximization with Multiple Items, Journal of Economic Theory 172 (2017); preprint arXiv:1204.1846v3, 2017. https://arxiv.org/abs/1204.1846
  • R. B. Myerson, Optimal Auction Design, Mathematics of Operations Research 6 (1981) 58–73. https://doi.org/10.1287/moor.6.1.58
  • S. Hart and P. J. Reny, Maximal Revenue with Multiple Goods: Nonmonotonicity and Other Observations, Theoretical Economics 10 (2015) 893–922. https://doi.org/10.3982/TE1517
  • M. Babaioff, N. Immorlica, B. Lucier and S. M. Weinberg, A Simple and Approximately Optimal Mechanism for an Additive Buyer, FOCS 2014. https://arxiv.org/abs/1405.6146
  • X. Li and A. C.-C. Yao, On Revenue Maximization for Selling Multiple Independently Distributed Items, PNAS 110 (2013) 11232–11237. https://doi.org/10.1073/pnas.1309533110
9 thms0 active usersReviewed
CombinatoricsOptimizationProbability·Captain: mikedeng1

Online Contention Resolution Schemes with Applications to Bayesian Selection Problems 2: The Degree Relaxation of Matching Has a (b, e^(−2b))-Selectable Randomized Greedy OCRSResearch Paper

Why online matching needs a stronger rounding guarantee

In online selection, candidate items reveal themselves one at a time and an algorithm must decide immediately whether to keep each one. When the kept items must form a matching, accepting one edge can prevent a later edge sharing an endpoint from being accepted. A fractional solution supplies useful marginal probabilities, but it does not by itself specify which active edges can be kept under an unfavorable arrival order. Online contention resolution schemes provide that missing rounding step: they turn independent edge activity into a feasible online selection while guaranteeing each edge a chance of selection. Feldman, Svensson, and Zenklusen introduced the strong selectability guarantee used here, which protects an edge even against an arrival order chosen with knowledge of all random outcomes (Feldman–Svensson–Zenklusen, §1.1).

This mission isolates the matching result of their paper. It concerns a degree relaxation that is weaker than the full matching polytope, so the result applies even when the input fractional point satisfies only local vertex constraints. The source states the existence theorem as Theorem 2.7 and gives its numerical guarantee explicitly (Theorem 2.7, p. 13).

Finite graphs, fractional edges, and greedy families

Let G=(V,E)G=(V,E)G=(V,E) be a finite graph. An edge ggg has two distinct endpoints; multiple edges may have the same endpoints. A matching is a set of edges with no shared vertex. For a vertex uuu, write δ(u)\delta(u)δ(u) for its incident edges. The degree relaxation is

PG={x∈R≥0E:∑g∈δ(u)xg≤1 for every u∈V}.P_G=\left\{x\in\mathbb R_{\ge0}^{E}:\sum_{g\in\delta(u)}x_g\le1\text{ for every }u\in V\right\}.PG​=⎩⎨⎧​x∈R≥0E​:g∈δ(u)∑​xg​≤1 for every u∈V⎭⎬⎫​.

Since each edge meets a vertex, these constraints also give xg≤1x_g\le1xg​≤1. Every matching has a characteristic vector in PGP_GPG​. The degree relaxation can contain points outside the convex hull of matchings, which makes the theorem stronger than a statement restricted to the matching polytope (§2.2, p. 13).

For x∈[0,1]Ex\in[0,1]^Ex∈[0,1]E, the active set R(x)R(x)R(x) includes each edge ggg independently with probability xgx_gxg​. A greedy family Fx\mathcal F_xFx​ is a downward closed family of matchings containing the empty set. A greedy online scheme accepts an active edge if adding it to the already accepted set remains in Fx\mathcal F_xFx​. The family may itself be random, sampled independently of R(x)R(x)R(x).

An edge ggg is selectable for a realized active set and greedy family when every member I∈FxI\in\mathcal F_xI∈Fx​ with I⊆R(x)I\subseteq R(x)I⊆R(x) can be extended by ggg while staying in Fx\mathcal F_xFx​. Thus selectability promises acceptance regardless of which eligible active edges preceded ggg. A scheme is (b,c)(b,c)(b,c)-selectable if this event has probability at least ccc for every x∈bPGx\in bP_Gx∈bPG​ and every edge. The probability includes both the active-set draw and any random family draw (Definitions 1.3–1.5, pp. 3–4).

Formalization targets

Theorem 2.7: a randomized matching scheme

For every b∈[0,1]b\in[0,1]b∈[0,1] and every finite loopless graph GGG,

∃ a randomized greedy scheme for PG that is (b,e−2b)-selectable.\exists\text{ a randomized greedy scheme for }P_G\text{ that is }(b,e^{-2b})\text{-selectable}.∃ a randomized greedy scheme for PG​ that is (b,e−2b)-selectable.

Equivalently, for each x∈bPGx\in bP_Gx∈bPG​ and each edge g∈Eg\in Eg∈E, the probability that ggg is selectable is at least e−2be^{-2b}e−2b. The statement includes edges with xg=0x_g=0xg​=0; the selectability event concerns the ability to add an edge, rather than the probability that it becomes active. The milestones are the steps the source states in its proof, in attack order (proof of Theorem 2.7, pp. 13–14):

  1. for t>0t>0t>0, 0≤(1−e−t)/t≤10\le(1-e^{-t})/t\le10≤(1−e−t)/t≤1, so that an edge can be put into a random set KKK of potential edges with probability (1−e−xg)/xg(1-e^{-x_g})/x_g(1−e−xg​)/xg​;
  2. drawing KKK this way and using the matchings inside KKK as the family is a randomized greedy scheme;
  3. an edge g′g'g′ with ends u,vu,vu,v is selectable exactly when g′∈Kg'\in Kg′∈K and A∩K∩(δ(u)∪δ(v)∖{g′})=∅A\cap K\cap(\delta(u)\cup\delta(v)\setminus\{g'\})=\varnothingA∩K∩(δ(u)∪δ(v)∖{g′})=∅;
  4. the probability of that event equals 1−e−xg′xg′ e−∑g∈δ(u)∪δ(v)∖{g′}xg\frac{1-e^{-x_{g'}}}{x_{g'}}\,e^{-\sum_{g\in\delta(u)\cup\delta(v)\setminus\{g'\}}x_g}xg′​1−e−xg′​​e−∑g∈δ(u)∪δ(v)∖{g′}​xg​;
  5. for x∈bPGx\in bP_Gx∈bPG​, ∑g∈δ(u)∪δ(v)∖{g′}xg≤2(b−xg′)\sum_{g\in\delta(u)\cup\delta(v)\setminus\{g'\}}x_g\le2(b-x_{g'})∑g∈δ(u)∪δ(v)∖{g′}​xg​≤2(b−xg′​);
  6. for t>0t>0t>0, et(et−1)/t≥1e^{t}(e^{t}-1)/t\ge1et(et−1)/t≥1.

Remark (p. 14): the deterministic variant

Taking K=EK=EK=E, the deterministic greedy scheme whose family is the set of all matchings is (b,(1−b)2)(b,(1-b)^2)(b,(1−b)2)-selectable for PGP_GPG​, b∈[0,1]b\in[0,1]b∈[0,1]:

Pr⁡A∼R(x)[g is selectable for A] ≥ (1−b)2∀x∈bPG, ∀g∈E.\Pr_{A\sim R(x)}\big[g\text{ is selectable for }A\big]\ \ge\ (1-b)^2\qquad\forall x\in bP_G,\ \forall g\in E.A∼R(x)Pr​[g is selectable for A] ≥ (1−b)2∀x∈bPG​, ∀g∈E.

This companion is weaker than Theorem 2.7 for every b∈(0,1]b\in(0,1]b∈(0,1] and is not used by it (Remark, p. 14).

What the result contributes

The theorem gives a constant probability bound against the paper's strongest, “almighty” arrival-order adversary. The guarantee is available from vertex degree inequalities alone. Consequently it applies to points of the exact matching polytope as well, without asking the online rounding procedure to exploit its additional odd-set inequalities. The paper places this result beside analogous existence claims for matroids and knapsacks in Theorem 1.8, and uses greedy schemes as components in more general selection results (Theorem 1.8, p. 4).

The existence theorem is proved in the source; it is an open formalization target here. A completed Lean development would supply a reusable finite model of independent active sets, random greedy families, edge selectability, and matching degree relaxations. It would also put the exact e−2be^{-2b}e−2b constant and its endpoint cases under machine checking. The definitions can support future formalizations of the paper's combination and application results, although this mission claims only Theorem 2.7 and its local proof milestones.

Where the argument is delicate

The local degree constraints bound the fractional weight at each endpoint separately, while selectability must survive conflicts at either endpoint under any arrival order. Merely ensuring that the algorithm outputs a matching gives no lower bound for a particular edge: the adversary can expose competing active edges first. The theorem therefore asks for a stronger event that certifies an edge could be added after every eligible previously selected matching. The numerical guarantee must hold uniformly over all edges, even when a coordinate is zero (Definitions 1.4–1.5, pp. 3–4; proof of Theorem 2.7, p. 13).

Formalization scope

The ground set is the finite edge type EEE. The published EdmondsMatching65.Polyhedron.Graph structure represents a graph by a map from edges to unordered pairs of vertices and includes a proof excluding self-loops; its matching predicate is reused directly. This admits parallel edges, a harmless generalization of the page's graph language. Incident edge sets and matchings are finite sets. The polytope is the set of real edge vectors satisfying precisely the nonnegativity and vertex degree inequalities above. Scaling is the pointwise set operation bPGbP_GbPG​, so b=0b=0b=0 remains meaningful. The parameter range 0≤b≤10\le b\le10≤b≤1 is explicit.

Probability is represented by finite sums of product weights. A randomized scheme is a weight function on finite greedy families, independent of the active-set draw. Each family contains the empty set and lies inside the matchings; allowing an empty family would make selectability vacuous. The degree inequalities keep relevant coordinates in [0,1][0,1][0,1], so active-set weights are genuine probabilities. The source's ratio (1−e−xg)/xg(1-e^{-x_g})/x_g(1−e−xg​)/xg​ is given its continuous value 111 at xg=0x_g=0xg​=0. For inputs outside the nonnegative domain, which the theorem never uses, that inclusion probability is also assigned 111 to keep the distribution well formed. These choices and the loopless graph convention are recorded with the draft statements.

The formalization needs finite product probability identities, elementary exponential inequalities, and set facts about matchings and incident edges. Contributions proving the six listed milestones, the deterministic Remark, or the full existential theorem are welcome. The finite model of active sets, greedy families and selectability is shared with the other missions of this series (matroids, knapsack, combinations of schemes, submodular rounding).

Selected references

  • Moran Feldman, Ola Svensson, and Rico Zenklusen, Online Contention Resolution Schemes, arXiv:1508.00142v2, 2015, preprint. Published as Online Contention Resolution Schemes with Applications to Bayesian Selection Problems, SIAM Journal on Computing, 2021.
11 thms0 active usersReviewed
Algorithmic Game TheoryCombinatoricsProbability·Captain: mikedeng1

Online Contention Resolution Schemes with Applications to Bayesian Selection Problems 5: A (b, c)-Selectable Greedy OCRS Rounds x ∈ bP to E[f(S)] ≥ c·F(x) for Monotone Submodular fResearch Paper

Motivation

Many online selection problems ask an algorithm to accept or reject items one at a time, irrevocably, while keeping the accepted set feasible: independent in a matroid, a matching in a graph, or within a knapsack budget. In Bayesian versions, such as prophet inequalities and posted-price mechanisms, a fractional point xxx of a relaxation of the feasible sets is available in advance, and each item is active independently with probability xex_exe​. An online contention resolution scheme (OCRS), introduced by Feldman, Svensson and Zenklusen, turns this random active set into a feasible selection as items arrive.

The quality of an OCRS is measured by its selectability: the probability that every element is accepted when it is active, whatever the arrival order. Applications, however, care about the value of the selected set, often a submodular function such as a coverage or a utility with diminishing returns. Theorem 1.10 of the paper is the bridge between the two: a selectability guarantee ccc yields an approximation guarantee ccc for every monotone submodular objective, and c/4c/4c/4 for non-monotone ones, even against an adversary who sees every random outcome before fixing the order. The other four missions of this series construct selectable OCRSs for matroids, matchings and knapsacks and combine them; this mission formalizes what such a guarantee is worth.

The offline counterpart is the theory of contention resolution schemes (CRSs) of Chekuri, Vondrák and Zenklusen (SIAM J. Comput. 2014), whose Theorem 1.3 shows that a monotone balanced CRS rounds the multilinear extension of a submodular function with the balancedness factor. The proof of Theorem 1.10 reduces the online statement to that offline result.

Setting

Let NNN be a finite ground set and F⊆2N\mathcal F\subseteq 2^NF⊆2N a down-closed family of feasible sets. A polytope P⊆[0,1]NP\subseteq[0,1]^NP⊆[0,1]N is a relaxation of F\mathcal FF if it contains exactly the characteristic vectors 1I\mathbf 1_I1I​ with I∈FI\in\mathcal FI∈F among the {0,1}\{0,1\}{0,1}-points. For x∈[0,1]Nx\in[0,1]^Nx∈[0,1]N, the random set R(x)R(x)R(x) contains every eee independently with probability xex_exe​.

A greedy OCRS fixes, for each input xxx, a down-closed family Fx⊆F\mathcal F_x\subseteq\mathcal FFx​⊆F containing ∅\emptyset∅ (deterministically, or drawn from a distribution independent of R(x)R(x)R(x)). The elements then arrive one by one; an arriving active element is selected if, together with the elements already selected, it forms a set in Fx\mathcal F_xFx​. An element eee is selectable for the active set AAA if I∪{e}∈FxI\cup\{e\}\in\mathcal F_xI∪{e}∈Fx​ for every I⊆AI\subseteq AI⊆A with I∈FxI\in\mathcal F_xI∈Fx​. For b,c∈[0,1]b,c\in[0,1]b,c∈[0,1] the OCRS is (b,c)(b,c)(b,c)-selectable if for every x∈bPx\in bPx∈bP and every e∈Ne\in Ne∈N

Pr⁡[I∪{e}∈Fx  ∀I⊆R(x), I∈Fx]≥c.\Pr\big[I\cup\{e\}\in\mathcal F_x\ \ \forall I\subseteq R(x),\ I\in\mathcal F_x\big]\ge c .Pr[I∪{e}∈Fx​  ∀I⊆R(x), I∈Fx​]≥c.

The arrival order is chosen by the almighty adversary, which knows R(x)R(x)R(x), the realized family Fx\mathcal F_xFx​ and every random bit of the algorithm before choosing it.

For f:2N→Rf:2^N\to\mathbb Rf:2N→R, the multilinear extension is F(x)=E[f(R(x))]F(x)=\mathbb E[f(R(x))]F(x)=E[f(R(x))]. The function fff is submodular if f(A∪B)+f(A∩B)≤f(A)+f(B)f(A\cup B)+f(A\cap B)\le f(A)+f(B)f(A∪B)+f(A∩B)≤f(A)+f(B) for all A,BA,BA,B, and monotone if A⊆BA\subseteq BA⊆B implies f(A)≤f(B)f(A)\le f(B)f(A)≤f(B). For a set SSS, S(1/2)S(1/2)S(1/2) keeps every element of SSS independently with probability 1/21/21/2.

An (offline) CRS π\piπ for PPP maps each S⊆NS\subseteq NS⊆N, possibly at random, to a subset π(S)⊆S\pi(S)\subseteq Sπ(S)⊆S with 1π(S)∈P\mathbf 1_{\pi(S)}\in P1π(S)​∈P. It is (b,c)(b,c)(b,c)-balanced if Pr⁡[e∈π(R(x))∣e∈R(x)]≥c\Pr[e\in\pi(R(x))\mid e\in R(x)]\ge cPr[e∈π(R(x))∣e∈R(x)]≥c for x∈bPx\in bPx∈bP and xe>0x_e>0xe​>0, and monotone if Pr⁡[e∈π(S1)]≥Pr⁡[e∈π(S2)]\Pr[e\in\pi(S_1)]\ge\Pr[e\in\pi(S_2)]Pr[e∈π(S1​)]≥Pr[e∈π(S2​)] whenever e∈S1⊆S2e\in S_1\subseteq S_2e∈S1​⊆S2​. The characteristic CRS of a greedy OCRS is πˉ(A)={e∈A:e selectable for A}\bar\pi(A)=\{e\in A : e \text{ selectable for } A\}πˉ(A)={e∈A:e selectable for A}.

Formalization targets

Goal: Theorem 1.10

Let PPP be a relaxation of F\mathcal FF, let π\piπ be a (b,c)(b,c)(b,c)-selectable greedy OCRS for PPP, let x∈bPx\in bPx∈bP, and let f≥0f\ge0f≥0 be submodular. Against every almighty adversary, the selected set SSS satisfies

E[f(S)]≥c⋅F(x)if f is monotone,E[f(S(1/2))]≥c4⋅F(x)in general,\mathbb E[f(S)]\ge c\cdot F(x)\quad\text{if } f \text{ is monotone},\qquad \mathbb E[f(S(1/2))]\ge \frac c4\cdot F(x)\quad\text{in general},E[f(S)]≥c⋅F(x)if f is monotone,E[f(S(1/2))]≥4c​⋅F(x)in general,

where in the second case the coins defining S(1/2)S(1/2)S(1/2) are known to the adversary. The constants are the paper's and are not parameters to be improved here.

Milestones

  1. Observation 3.3: for every greedy family, active set and order, πˉ(A)\bar\pi(A)πˉ(A) is contained in the selected set.
  2. The remark after Definition 3.2: πˉ\bar\piπˉ is a CRS for PPP.
  3. Lemma 3.4: the characteristic CRS of a (b,c)(b,c)(b,c)-selectable greedy OCRS is (b,c)(b,c)(b,c)-balanced and monotone.
  4. Lemma 3.5 (from Chekuri–Vondrák–Zenklusen): for every non-negative submodular fff there is a pruning map ηf\eta_fηf​, with ηf(S)⊆S\eta_f(S)\subseteq Sηf​(S)⊆S, such that E[f(ηf(π(R(x))))]≥c⋅F(x)\mathbb E[f(\eta_f(\pi(R(x))))]\ge c\cdot F(x)E[f(ηf​(π(R(x))))]≥c⋅F(x) for every monotone (b,c)(b,c)(b,c)-balanced CRS π\piπ and every x∈bPx\in bPx∈bP.
  5. Lemma 3.6 (Feige–Mirrokni–Vondrák, Lemma 2.2): if Tp⊆TT_p\subseteq TTp​⊆T contains every element of TTT with probability ppp, not necessarily independently, then E[g(Tp)]≥(1−p)g(∅)+p g(T)\mathbb E[g(T_p)]\ge(1-p)g(\emptyset)+p\,g(T)E[g(Tp​)]≥(1−p)g(∅)+pg(T) for submodular ggg.
  6. Lemma 3.7 (Buchbinder–Feldman–Naor–Schwartz, Lemma 2.2): if NpN_pNp​ contains every element with probability at most ppp, then E[g(Np)]≥(1−p)g(∅)\mathbb E[g(N_p)]\ge(1-p)g(\emptyset)E[g(Np​)]≥(1−p)g(∅) for non-negative submodular ggg.

Significance

Theorem 1.10 is what makes selectability useful. Combined with the paper's OCRSs for matroids, matchings and knapsacks (Theorem 1.8) and the combination rule (Theorem 1.9), it gives constant-factor online algorithms for submodular objectives under intersections of these constraints, and through them the paper's applications to prophet inequalities, posted-price mechanisms and stochastic probing. The guarantee holds against the strongest adversary considered, so it applies whatever arrival order the application imposes.

The theorem and its proof are published; none of the statements of this mission has a machine-checked proof. Formalizing it produces a reusable interface between online and offline contention resolution, and machine-checked versions of two standard lemmas on correlated random subsets of submodular functions (Lemmas 3.6 and 3.7) used throughout submodular maximization. Lemma 3.5 is the substantial imported ingredient: its formal proof amounts to formalizing the rounding theorem of Chekuri, Vondrák and Zenklusen for non-monotone objectives.

Difficulty

The first idea is to compare the online selection directly with F(x)F(x)F(x) element by element: each element is selected with probability at least c xec\,x_ecxe​. For a linear objective this suffices. For a submodular objective it does not, because the marginal value of an element depends on which other elements are selected, and the adversary controls this through the order. The reduction to the characteristic CRS removes the order, but the offline rounding result (Lemma 3.5) then needs the full CRS machinery, including a pruning step that depends on fff alone.

For non-monotone fff, selecting extra elements can lose value, and the adversary decides which elements beyond πˉ(A)\bar\pi(A)πˉ(A) are selected, after seeing the coins. Controlling this requires the correlated-sampling bounds of Lemmas 3.6 and 3.7 rather than independence.

Formalization scope

The ground set is a finite type α : Type with decidable equality; sets are Finset α; vectors are α → ℝ. All probabilities and expectations are exact finite sums of product weights, without measure theory. bPbPbP is the pointwise scaling b • P, which handles b=0b=0b=0. The multilinear extension and submodularity are the published definitions NonmonotoneSubmod.Shared.F and NonmonotoneSubmod.Shared.Submodular.

A randomized greedy OCRS is a weight function on families Finset (Finset α), a CRS a weight function on maps Finset α → Finset α; a deterministic OCRS is a point mass. The almighty adversary is any function from the realized family and active set (and, in part 2, the coin set CCC, with S(1/2)=S∩CS(1/2)=S\cap CS(1/2)=S∩C and CCC uniform and independent of everything else) to an order listing every element once. The standing assumptions of Definition 1.3 are explicit hypotheses: F\mathcal FF down-closed, PPP a polytope contained in [0,1]N[0,1]^N[0,1]N and a relaxation of F\mathcal FF, and b,c∈[0,1]b,c\in[0,1]b,c∈[0,1]. A polytope is encoded as the convex hull of finitely many vectors. Every greedy family contains ∅\emptyset∅, so the empty family cannot make every element vacuously selectable, and the inputs x∈bPx\in bPx∈bP lie in [0,1]N[0,1]^N[0,1]N, so the product weights are probabilities.

Definition 3.1 is printed with "≥c⋅xe\ge c\cdot x_e≥c⋅xe​"; the formalization uses "≥c\ge c≥c", as the proof of Lemma 3.4 and Definition 4.5 do. Lemma 3.5 keeps the paper's quantifier order: ηf\eta_fηf​ is fixed before PPP, bbb, ccc, π\piπ and xxx.

Welcome contributions: proofs of the milestones in any order; Lemmas 3.6 and 3.7 are self-contained and reusable; Lemma 3.5 may be split further along the proof of Chekuri–Vondrák–Zenklusen.

Selected references

  • M. Feldman, O. Svensson, R. Zenklusen, Online Contention Resolution Schemes, arXiv:1508.00142v2, 2015; Online Contention Resolution Schemes with Applications to Bayesian Selection Problems, SIAM J. Comput. 50(2), 2021. https://arxiv.org/abs/1508.00142v2
  • C. Chekuri, J. Vondrák, R. Zenklusen, Submodular Function Maximization via the Multilinear Relaxation and Contention Resolution Schemes, SIAM J. Comput. 43(6), 2014. https://doi.org/10.1137/110839655
  • U. Feige, V. Mirrokni, J. Vondrák, Maximizing Non-Monotone Submodular Functions, SIAM J. Comput. 40(4), 2011. https://doi.org/10.1137/090779346
  • N. Buchbinder, M. Feldman, J. Naor, R. Schwartz, Submodular Maximization with Cardinality Constraints, SODA 2014. https://doi.org/10.1137/1.9781611973402.106
12 thms0 active usersReviewed
Algorithmic Game TheoryCombinatoricsProbability·Captain: mikedeng1

Online Contention Resolution Schemes with Applications to Bayesian Selection Problems 4: Intersecting the Families of (b, c₁)- and (b, c₂)-Selectable Greedy OCRSs Is (b, c₁c₂)-SelectableResearch Paper

Motivation

Online selection problems ask an algorithm to accept or reject elements as they arrive, while keeping the accepted set feasible. The decisions are irrevocable, and the arrival order can be chosen after the random activity of the elements is known. A guarantee for one constraint is therefore useful only if it remains meaningful when several constraints apply at once. In Feldman, Svensson and Zenklusen's paper, the constraints include matroid independence, matching, and knapsack capacity. A set satisfying two such requirements lies in the intersection of their feasible families. Theorem 1.9 establishes how their online guarantees combine: the two selectability factors multiply.

The result belongs to a sequence of statements in the paper. The authors first define greedy online contention resolution schemes and their selectability guarantee in Definitions 1.3–1.5. They then state the combination theorem in the introduction and identify the intersection construction in Definition 2.10. Lemma 2.11 supplies the precise selectability assertion for that construction. This mission isolates those claims so that later formalizations of specific constraints can reuse them without repeating the probability argument.

Setting

Let NNN be a finite ground set and F⊆2N\mathcal F\subseteq 2^NF⊆2N a family of feasible sets. A fractional point x∈[0,1]Nx\in[0,1]^Nx∈[0,1]N determines a random active set R(x)R(x)R(x): each e∈Ne\in Ne∈N belongs to R(x)R(x)R(x) independently with probability xex_exe​. Thus a particular set A⊆NA\subseteq NA⊆N has weight

Pr⁡[R(x)=A]=∏e∈Axe∏e∉A(1−xe).\Pr[R(x)=A]=\prod_{e\in A}x_e\prod_{e\notin A}(1-x_e).Pr[R(x)=A]=e∈A∏​xe​e∈/A∏​(1−xe​).

A greedy online contention resolution scheme, or greedy OCRS, chooses a down-closed family Gx⊆F\mathcal G_x\subseteq\mathcal FGx​⊆F. As active elements arrive, it accepts an element when adding that element to those already accepted remains in Gx\mathcal G_xGx​. In a randomized scheme, the choice of Gx\mathcal G_xGx​ is random and independent of R(x)R(x)R(x). The family contains the empty set, as the procedure begins with no accepted elements.

An element eee is selectable for a realized active set AAA and family Gx\mathcal G_xGx​ if every I⊆AI\subseteq AI⊆A with I∈GxI\in\mathcal G_xI∈Gx​ still permits eee: I∪{e}∈GxI\cup\{e\}\in\mathcal G_xI∪{e}∈Gx​. This condition covers every possible set that might have been accepted before eee arrives. A greedy OCRS is (b,c)(b,c)(b,c)-selectable for a relaxation PPP when the probability of this event is at least ccc for every x∈bPx\in bPx∈bP and every e∈Ne\in Ne∈N. The probability includes both draws when the family is randomized. Here b,c∈[0,1]b,c\in[0,1]b,c∈[0,1] and bP={by:y∈P}bP=\{by:y\in P\}bP={by:y∈P}.

For two feasible families F1,F2\mathcal F_1,\mathcal F_2F1​,F2​, the combination of their greedy OCRSs independently draws G1,x\mathcal G_{1,x}G1,x​ and G2,x\mathcal G_{2,x}G2,x​, then uses Gx=G1,x∩G2,x\mathcal G_x=\mathcal G_{1,x}\cap\mathcal G_{2,x}Gx​=G1,x​∩G2,x​. This is a family of sets satisfying both constraints. The proof also uses χe(A,F,F′)\chi_e(A,F,F')χe​(A,F,F′), the indicator that I∪{e}∈FI\cup\{e\}\in FI∪{e}∈F for every I⊆AI\subseteq AI⊆A lying in F′F'F′. For selectability itself, F′=FF'=FF′=F.

Formalization targets

Goal: Theorem 1.9

For P1,P2⊆[0,1]NP_1,P_2\subseteq[0,1]^NP1​,P2​⊆[0,1]N, let the first scheme be (b,c1)(b,c_1)(b,c1​)-selectable and the second (b,c2)(b,c_2)(b,c2​)-selectable. The mission asks for a greedy OCRS on the intersection with

Pr⁡[e selectable at x]≥c1c2for all x∈b(P1∩P2), e∈N.\Pr[e\text{ selectable at }x]\ge c_1c_2 \quad\text{for all }x\in b(P_1\cap P_2),\ e\in N.Pr[e selectable at x]≥c1​c2​for all x∈b(P1​∩P2​), e∈N.

The target records existence of the combined scheme, independent of a particular proof of its selectability. The paper also claims preservation of polynomial-time efficiency; the finite mathematical model here does not assign a complexity measure to a family sampler or membership oracle, so that clause is outside this target.

Construction: Lemma 2.11

The lemma names the combined scheme: independently draw both greedy families and use their intersection. It asserts the same (b,c1c2)(b,c_1c_2)(b,c1​c2​) bound for that specific scheme. The earlier milestones record the two order properties of χe\chi_eχe​ and the finite product-measure correlation inequality appearing in the lemma's proof. Their statements keep the original quantifiers over active sets and families visible.

Significance

The theorem turns guarantees for individual constraints into a guarantee for simultaneous constraints. If a matroid scheme and a matching scheme meet the same scale parameter bbb, their intersection is governed by the product of their selectability factors. The factor loss is explicit, which lets subsequent algorithmic results track it without redefining the combined scheme. The lemma additionally fixes the actual distribution over intersected families, avoiding ambiguity about how two randomized procedures are coupled.

Mathlib already provides a general finite FKG inequality, but it does not state the paper's OCRS objects, the selectable event, or the intersection theorem. This mission adds those interfaces and the specialized correlation statement. The source results are proved in the cited paper; the local theorem files in this proposal are statements for later machine-checked proofs. A complete formalization would connect the finite active-set weights to Mathlib's lattice correlation theorem and then establish the randomized family bookkeeping. The finite probability definitions can also serve other OCRS results in the same paper.

Difficulty

The obvious argument would multiply the two probabilities that eee is selectable for the separate families. Both events depend on the same active set R(x)R(x)R(x), so they are not independent even when the families are drawn independently. Moreover, selectability for the intersection checks only sets belonging to both families, whereas the original bounds check each family separately. The formal statements must keep these two dependencies distinct. The paper's two monotonicity claims and its FKG display identify the needed intermediate assertions, but their use with an arbitrary random choice of families still requires careful finite-sum reasoning.

Formalization scope

The ground set is a finite Lean type and subsets are Finsets. Feasibility is a predicate on those finite sets. Fractional points are real-valued functions, and each input relaxation is represented as a set of such functions with an explicit coordinate bound 0≤ye≤10\le y_e\le10≤ye​≤1. The scale and selectability parameters belong to [0,1][0,1][0,1]. The point xxx ranges over b(P1∩P2)b(P_1\cap P_2)b(P1​∩P2​), not over an independently chosen intersection of scaled sets, so the case b=0b=0b=0 retains the paper's meaning. The finite products define the law of R(x)R(x)R(x); no measure-theoretic integral is used.

A randomized scheme is a probability weight on possible greedy families for every input point. The combined weight is the product of the two original weights summed over pairs with the required intersection, expressing independent draws. The family distribution is independent of the active-set draw. This sampling convention is necessary for the stated product guarantee and is made explicit here although Definition 2.10 does not spell it out. Each greedy family contains ∅\varnothing∅ and lies in its own feasible family. These requirements exclude the empty-family and unconstrained-family encodings that would make selectability trivial. The unit-cube bounds prevent negative active-set weights.

The Lean declarations focus on the finite selectability guarantee. They abstract a polytope by its set of fractional points and use the paper's unit-cube condition; they do not formalize a polyhedral representation or test that its binary points equal the feasible sets. A full development of the paper's algorithmic setting would additionally represent online arrival orders, family sampling algorithms, membership oracles, and polynomial running time. Contributions establishing the finite probability lemmas, the specialized FKG statement, and Lemma 2.11 are directly useful here. The general active-set and selectability definitions are reusable across the paper's other missions.

Selected references

  • Moran Feldman, Ola Svensson and Rico Zenklusen, Online Contention Resolution Schemes, arXiv preprint, 2015, arXiv:1508.00142v2. Definitions 1.3–1.5, Theorem 1.9, Definition 2.10 and Lemma 2.11.
  • Moran Feldman, Ola Svensson and Rico Zenklusen, Online Contention Resolution Schemes with Applications to Bayesian Selection Problems, SIAM Journal on Computing 50(2), 2021, DOI:10.1137/18M1226130. The mission's statement indices follow the arXiv version above.
7 thms0 active usersReviewed
CombinatoricsOptimizationProbability·Captain: mikedeng1

Online Contention Resolution Schemes with Applications to Bayesian Selection Problems 3: A Knapsack Polytope Has a (b, (1−2b)/(2−2b))-Selectable Randomized Greedy OCRS for b ≤ 1/2Research Paper

Motivation

In online selection, useful items arrive one at a time and must be accepted or rejected before the next arrival. A knapsack constraint limits the total size of accepted items to one unit. When the order may depend on all of the random outcomes, an algorithm needs a guarantee that survives every such order. Feldman, Svensson, and Zenklusen introduced online contention resolution schemes (OCRSs) to provide this guarantee for fractional relaxations of selection problems. Their knapsack theorem gives an explicit guarantee for a randomized greedy scheme and contrasts with a size-dependent obstruction for deterministic greedy schemes (Feldman–Svensson–Zenklusen, §2.3).

The knapsack result is one of the three concrete existence results summarized in Theorem 1.8 of the paper. The surrounding framework is designed to convert fractional solutions into feasible online selections under an almighty adversary, who knows the active items and the scheme's random choices before choosing their arrival order. This makes the selectability requirement stronger than a performance claim for one fixed order (Feldman–Svensson–Zenklusen, Definitions 1.3–1.5).

Setting

Let NNN be a finite ground set. Each element e∈Ne\in Ne∈N has a size se∈[0,1]s_e\in[0,1]se​∈[0,1]. A subset I⊆NI\subseteq NI⊆N is feasible when its total size is at most one. The natural fractional polytope is

P={x∈[0,1]N:∑e∈Nsexe≤1}.P=\left\{x\in[0,1]^N:\sum_{e\in N}s_ex_e\le1\right\}.P={x∈[0,1]N:e∈N∑​se​xe​≤1}.

For a vector x∈[0,1]Nx\in[0,1]^Nx∈[0,1]N, the random active set R(x)R(x)R(x) includes each element eee independently with probability xex_exe​. A greedy family FxF_xFx​ is a downward-closed family of feasible subsets. The online rule accepts an active arriving element when adding it to the accepted set keeps that set inside FxF_xFx​. A randomized greedy OCRS chooses the family at random, independently of R(x)R(x)R(x). The paper studies the probability that an element eee is selectable: for every possible accepted set I⊆R(x)I\subseteq R(x)I⊆R(x) with I∈FxI\in F_xI∈Fx​, the enlarged set I∪{e}I\cup\{e\}I∪{e} still belongs to FxF_xFx​. Such an event makes eee acceptable regardless of the arrival order (Feldman–Svensson–Zenklusen, §1.1).

Write bP={bp:p∈P}bP=\{bp:p\in P\}bP={bp:p∈P}. An OCRS is (b,c)(b,c)(b,c)-selectable when, for every x∈bPx\in bPx∈bP and every e∈Ne\in Ne∈N, the probability that eee is selectable is at least ccc. The paper divides elements at size 1/21/21/2: Nbig={e:se>1/2}N_{\mathrm{big}}=\{e:s_e>1/2\}Nbig​={e:se​>1/2}, while equality belongs to the small elements. Its construction randomly chooses between the feasible subsets using only big elements and those using only small elements (Feldman–Svensson–Zenklusen, proof of Theorem 2.9).

Formalization targets

Main theorem

Theorem 2.9 asserts that for every b∈[0,1/2]b\in[0,1/2]b∈[0,1/2] and every such knapsack polytope, a randomized greedy OCRS exists with

c=1−2b2−2b.c=\frac{1-2b}{2-2b}.c=2−2b1−2b​.

The goal quantifies over every finite ground set and every allowed size vector. At the endpoint b=1/2b=1/2b=1/2, the claimed lower bound is zero; at b=0b=0b=0, it is 1/21/21/2. The denominator remains positive throughout the stated interval. The goal is an existence statement; its witnesses are arbitrary randomized greedy families meeting the definition, so the paper's particular construction is named separately in the supporting definitions (Feldman–Svensson–Zenklusen, Theorem 2.9, p. 14).

Supporting targets

The milestones include the paper's bound 0≤bbig≤b0\le b_{\mathrm{big}}\le b0≤bbig​≤b for bbig=∑e∈Nbigsexeb_{\mathrm{big}}=\sum_{e\in N_{\mathrm{big}}}s_ex_ebbig​=∑e∈Nbig​​se​xe​, the big and small element selectability bounds for the paper's construction, and Proposition 2.8. That proposition says that, for every ground-set size n≥1n\ge1n≥1, some knapsack constraint defeats every deterministic greedy OCRS whenever c>(1−b)n−1c>(1-b)^{n-1}c>(1−b)n−1 for b∈[0,1]b\in[0,1]b∈[0,1] (Feldman–Svensson–Zenklusen, §2.3, pp. 14–15).

Significance

The theorem supplies a concrete selectable OCRS for the natural fractional knapsack relaxation. Its guarantee applies to every element and every fractional point in bPbPbP, under the paper's strongest arrival-order adversary. Proposition 2.8 explains why randomization matters here: a deterministic greedy scheme cannot retain an analogous positive constant independent of the number of elements on every knapsack instance. These results serve as the knapsack component in the paper's broader OCRS framework and can be combined with schemes for other constraints in the paper's later combination result (Feldman–Svensson–Zenklusen, Theorem 1.9).

The mathematical theorem and proposition have proofs in the cited paper. This mission asks for machine-checked proofs of their formal statements and of the stated intermediate bounds. The current draft declarations contain proof placeholders; compilation establishes only that their statements and definitions are well formed. A completed development would also leave reusable finite active-set probabilities, greedy-family predicates, and explicit knapsack constructions for later online-rounding work.

Difficulty

A family that contains every feasible subset is not automatically useful for online selection: one active set may contain several subsets whose accepted elements block the tested element. The requirement quantifies over every feasible accepted subset of the realized active set, reflecting the almighty adversary rather than a fixed order. In a knapsack, elements larger than one half behave differently from smaller ones, and a single deterministic family cannot give a ground-set-independent selectability guarantee on all instances. The randomized construction must assign valid probabilities to its two families and obtain the same lower bound in both size regimes (Feldman–Svensson–Zenklusen, Proposition 2.8 and Theorem 2.9).

Formalization scope

The Lean ground set is a finite type, and subsets are Finsets. The polytope is the set of real vectors satisfying both the box inequalities and the unit-capacity inequality. The feasible family uses the same sizes and unit capacity. Active-set and family-choice probabilities are finite sums, with independent Bernoulli factors for R(x)R(x)R(x). The scaling bPbPbP is pointwise set scalar multiplication, so the case b=0b=0b=0 retains its intended meaning. The size assumptions se∈[0,1]s_e\in[0,1]se​∈[0,1] and the ranges of bbb are explicit theorem hypotheses. No nonemptiness assumption is added to the ground set; the statements include the empty case.

The greedy-family definition requires the empty set, making it impossible to satisfy selectability by using an empty family. Every family chosen with positive probability is downward closed and consists of feasible sets. The polytope's box constraints keep every active-set weight a probability. The construction's mixing probability is used exactly on x∈bPx\in bPx∈bP; on other vectors its totalized value chooses the small family, where the paper makes no performance claim. The two branch weights are added if their families coincide, as they can on an empty ground set.

One display on page 15 includes the tested element in a load sum, while the next displayed equality treats that element as excluded. The pointwise supporting item uses the excluded-element form needed for the stated argument; the printed display is preserved in the milestone quotation and the discrepancy is detailed in MODERATION_NOTES.md. Contributions toward either size regime, the finite probability bounds, or the deterministic obstruction are welcome. The finite probability and greedy-family definitions are the parts most directly reusable beyond knapsack.

Selected references

  • Moran Feldman, Ola Svensson, and Rico Zenklusen, Online Contention Resolution Schemes, arXiv:1508.00142v2, 2015, §1.1 and §2.3, pp. 2–4 and 14–15. arXiv.
8 thms0 active usersReviewed
Algorithmic Game TheoryCombinatoricsProbability·Captain: mikedeng1

Online Contention Resolution Schemes with Applications to Bayesian Selection Problems 1: Every Loopless Matroid Polytope Has a (b, 1−b)-Selectable Deterministic Greedy OCRSResearch Paper

Motivation

In online selection, items reveal information one at a time, and each decision to accept an item is irrevocable. A matroid constraint permits some subsets and excludes others; it covers choices such as selecting linearly independent vectors or acyclic edges. A fractional solution can assign an acceptance probability to each item, but independent activations can produce a set that violates the constraint. An online contention resolution scheme (OCRS) turns these activations into a feasible selection while respecting the order in which items arrive. The matroid result of Feldman, Svensson and Zenklusen gives a guarantee that survives even when an adversary knows all random outcomes before choosing the arrival order.

This mission concerns the paper's matroid theorem, Theorem 2.1. The same paper develops schemes for matching and knapsack constraints and a rule for combining schemes for intersecting constraints. Those results are separate missions in this series. Here the central question is how much of a fractional matroid point can be retained by a deterministic greedy rule as each active item is revealed.

Setting

Let NNN be a finite ground set and let MMM be a matroid on NNN. Its independent subsets form a down-closed family F\mathcal FF: if III is independent, every subset of III is independent. The rank r(S)r(S)r(S) of S⊆NS\subseteq NS⊆N is the maximum size of an independent subset of SSS. The matroid independence polytope is

PF={x∈R≥0N:x(S):=∑e∈Sxe≤r(S) for all S⊆N}.P_{\mathcal F}=\left\{x\in\mathbb R^N_{\ge0}:x(S):=\sum_{e\in S}x_e\le r(S)\text{ for all }S\subseteq N\right\}.PF​={x∈R≥0N​:x(S):=e∈S∑​xe​≤r(S) for all S⊆N}.

Its points have 0≤xe≤10\le x_e\le10≤xe​≤1. For a point xxx, the active set R(x)R(x)R(x) contains each eee independently with probability xex_exe​. A deterministic greedy OCRS assigns a down-closed family Fx⊆F\mathcal F_x\subseteq\mathcal FFx​⊆F to xxx and accepts an active element when adding it to the already accepted set stays in Fx\mathcal F_xFx​. The empty set belongs to every Fx\mathcal F_xFx​. The rule depends on xxx before the active set and arrival order are revealed.

An element eee is selectable for an active set AAA if I∪{e}∈FxI\cup\{e\}\in\mathcal F_xI∪{e}∈Fx​ for every I⊆AI\subseteq AI⊆A with I∈FxI\in\mathcal F_xI∈Fx​. A greedy OCRS is (b,c)(b,c)(b,c)-selectable if this event has probability at least ccc for every x∈bPFx\in bP_{\mathcal F}x∈bPF​ and every e∈Ne\in Ne∈N. The event implies that eee can be added regardless of which eligible active elements arrived first. These definitions are from §1.1 of the paper.

Formalization targets

Matroid OCRS

For every b∈[0,1]b\in[0,1]b∈[0,1] and every finite loopless matroid MMM, the target is a deterministic greedy OCRS with

Pr⁡[I∪{e}∈Fx for all I⊆R(x), I∈Fx]≥1−bfor every x∈bPF, e∈N.\Pr\left[I\cup\{e\}\in\mathcal F_x\text{ for all }I\subseteq R(x),\ I\in\mathcal F_x\right]\ge 1-b \quad\text{for every }x\in bP_{\mathcal F},\ e\in N.Pr[I∪{e}∈Fx​ for all I⊆R(x), I∈Fx​]≥1−bfor every x∈bPF​, e∈N.

The loopless condition is a disclosed correction to the printed Theorem 2.1: a loop cannot belong to any independent singleton, so its selectability is zero. The printed bound would demand positive selectability for that loop whenever b<1b<1b<1. The theorem keeps the paper's constant 1−b1-b1−b exactly.

Supporting targets

The milestones reproduce six statements from §2.1–2.1.1, in attack order: validity of a family defined by a chain ∅=Nℓ⊊⋯⊊N0=N\varnothing=N_\ell\subsetneq\cdots\subsetneq N_0=N∅=Nℓ​⊊⋯⊊N0​=N of matroid minors (independence of the union of layer-wise independent sets is Soto, Theorem 5.1); a characterization of selectability through span in one layer; monotonicity of the first chain set as coordinates of xxx increase; the description of the base polytope PB={x∈PF:x(N)=r(N)}P_{\mathcal B}=\{x\in P_{\mathcal F}:x(N)=r(N)\}PB​={x∈PF​:x(N)=r(N)} as the set of maximal vectors of PFP_{\mathcal F}PF​; the weighted span bound of Lemma 2.4,

∑e∈NxePr⁡[e∈span⁡(R(x)∪S)]≤b⋅(x(N)+(1−b) r(S)),\sum_{e\in N}x_e\Pr[e\in\operatorname{span}(R(x)\cup S)]\le b\cdot\bigl(x(N)+(1-b)\,r(S)\bigr),e∈N∑​xe​Pr[e∈span(R(x)∪S)]≤b⋅(x(N)+(1−b)r(S)),

strict when S≠∅S\neq\varnothingS=∅; and the proper-inclusion conclusion S⊊NS\subsetneq NS⊊N of Corollary 2.5. They expose the distinct matroid and probability claims on which the main theorem rests.

Significance

The theorem gives a fixed greedy family for each fractional point, with a per-element probability guarantee that is independent of the arrival order. Offline contention resolution schemes for matroids were introduced by Chekuri, Vondrák and Zenklusen; the online, almighty-adversary version here is stronger. A solver can use that guarantee as the matroid component in larger online selection problems. In the source paper it feeds the intersection and application results; those applications require further models and statements beyond this mission. The factor 1−b1-b1−b makes the tradeoff explicit: using a more heavily scaled fractional point raises the risk of contention.

The result is proved in the cited paper. This mission asks for a machine-checked Lean proof of its corrected statement and the source's supporting claims. A successful development would add reusable finite representations of independent activation, matroid polytope inequalities, span probabilities, and chain families. It would also make the loop boundary explicit, preventing a formally false version of the printed theorem from being published as a target.

Difficulty

Independent activation does not itself respect matroid independence. A greedy family that simply contains every independent set can make an element unavailable after earlier active elements are accepted, and the arrival order can expose the worst such history. The central issue is therefore a uniform selectability event: the same element must remain addable after every feasible subset of the active set. The paper measures that obstruction through spans in successive matroid minors. The first chain set must be proper so that the construction can continue, which is why the strict part of the weighted span inequality matters.

Formalization scope

The ground set is a finite Lean type, subsets are Finsets, and Mathlib's Matroid supplies independence, closure, contraction and restriction. Matroid rank is converted from Mathlib's extended natural rank to a real number; finiteness makes this conversion finite on every subset. The independence and base polytopes are defined by the paper's inequalities. The scalar multiple bPbPbP is pointwise set scalar multiplication, including b=0b=0b=0.

Probabilities are finite sums of product weights over all active sets. In particular, the event in Lemma 2.4 uses span⁡(R(x)∪S)\operatorname{span}(R(x)\cup S)span(R(x)∪S), whereas the recurrence defining SSS uses span⁡((R(x)∪Si)∖{e})\operatorname{span}((R(x)\cup S_i)\setminus\{e\})span((R(x)∪Si​)∖{e}). These are separate definitions. Every point used for activation lies in [0,1]N[0,1]^N[0,1]N, as enforced by the polytope and b∈[0,1]b\in[0,1]b∈[0,1]. The base-polytope condition on Corollary 2.5 is the standing assumption stated before the lemma in the source.

The loopless condition applies to the goal, to Corollary 2.5, and to the strict clause of Lemma 2.4 only; its non-strict clause, the chain statements and the monotonicity statement hold for every matroid and are stated without it. Three trivializing formalizations are ruled out: every greedy family must contain the empty set, so an empty family cannot satisfy selectability vacuously; every member of a greedy family must be independent in MMM, so Fx=2N\mathcal F_x=2^NFx​=2N is not admissible; and every point used for activation lies in [0,1]N[0,1]^N[0,1]N, so Pr⁡[R(x)=A]\Pr[R(x)=A]Pr[R(x)=A] is a genuine probability. The quantified scheme depends only on xxx, and its success condition ranges over every feasible subset of the realized active set. Contributions that establish the chain family's independence, finite probability identities, and rank or closure facts are within scope. Polynomial-time implementation and the Monte Carlo estimates of Lemma 2.6 are outside this mission's mathematical target.

Selected references

  • Moran Feldman, Ola Svensson and Rico Zenklusen, Online Contention Resolution Schemes, arXiv:1508.00142v2, 2015; published as Online Contention Resolution Schemes with Applications to Bayesian Selection Problems, SIAM Journal on Computing, 2021. Preprint.
  • Chandra Chekuri, Jan Vondrák and Rico Zenklusen, Submodular Function Maximization via the Multilinear Relaxation and Contention Resolution Schemes, SIAM Journal on Computing, 2014. arXiv:1105.4593.
  • José A. Soto, Matroid Secretary Problem in the Random-Assignment Model, SIAM Journal on Computing, 2013. arXiv:1007.2140.
10 thms0 active usersReviewed
Graph TheoryLinear OptimizationOptimization·Captain: mikedeng1

Minimum Cost Flows in Graphs with Unit Capacities: When the Second Phase of a Cost Scale Starts, at Most 3λ Excess Is Left for λ = √m and 36λ for λ = n^(2/3)Research Paper

Motivation

Minimum-cost flow is a standard model for routing a quantity through a network while paying a cost on each arc. Unit capacities arise when each input arc can carry at most one unit; they include flow formulations of several matching and assignment problems. Goldberg, Kaplan, Hed and Tarjan analyze a cost-scaling algorithm for this setting. Their second-phase argument depends on a bound on the excess left in a pseudoflow when every excess vertex has undergone enough potential increases. This mission formalizes that bound, Lemma 5 of their STACS 2015 paper. The published paper gives an O(min⁡{m1/2,n2/3} mlog⁡(nC))O(\min\{m^{1/2},n^{2/3}\}\,m\log(nC))O(min{m1/2,n2/3}mlog(nC)) running-time bound for its unit-capacity algorithm; the running-time statement itself is outside this mission.

Setting

A network has a finite vertex set VVV and an arc set EEE that contains both orientations of each input arc. Write n=∣V∣n=|V|n=∣V∣. Every input arc has capacity one; its reverse has capacity zero and opposite cost. Write mmm for the number of input arcs, so ∣E∣=2m|E|=2m∣E∣=2m. The paper assumes no parallel or antiparallel input arcs, allowing an arc to be identified by its ordered endpoints. Costs are antisymmetric between orientations.

A pseudoflow fff assigns an antisymmetric quantity to each arc and respects its capacity. Its excess at vvv is the sum ef(v)e_f(v)ef​(v) of incoming flow. Positive excess means that vvv has flow to discharge; negative excess is a deficit. A circulation is a pseudoflow with zero excess at every vertex. An arc is residual for fff when its residual capacity uf(v,w)=u(v,w)−f(v,w)u_f(v,w)=u(v,w)-f(v,w)uf​(v,w)=u(v,w)−f(v,w) is positive. For vertex prices ppp, its reduced cost is cp(v,w)=c(v,w)−p(v)+p(w)c_p(v,w)=c(v,w)-p(v)+p(w)cp​(v,w)=c(v,w)−p(v)+p(w). A pseudoflow is ε\varepsilonε-optimal at ppp when every residual arc has reduced cost at least −ε-\varepsilon−ε. These are the paper's conventions on p. 408.

At the start of a cost scale, let f′f'f′ be a circulation that is 2ε2\varepsilon2ε-optimal at prices p′p'p′. During the scale, fff is a pseudoflow that is ε\varepsilonε-optimal at prices ppp. The potential increase in scale units is d(v)=(p(v)−p′(v))/εd(v)=(p(v)-p'(v))/\varepsilond(v)=(p(v)−p′(v))/ε. Put λ=min⁡{m,n2/3}\lambda=\min\{\sqrt m,n^{2/3}\}λ=min{m​,n2/3}. The second phase begins when every excess vertex has d(v)≥λd(v)\ge\lambdad(v)≥λ; the paper also states that every deficit then has d(v)=0d(v)=0d(v)=0 and that the levels d(v)d(v)d(v) are integral. The remaining excess is X(f)=∑v:ef(v)>0ef(v)X(f)=\sum_{v:e_f(v)>0}e_f(v)X(f)=∑v:ef​(v)>0​ef​(v).

The comparison graph has arcs E+={(v,w)∈E:f′(v,w)>f(v,w)}E^+=\{(v,w)\in E:f'(v,w)>f(v,w)\}E+={(v,w)∈E:f′(v,w)>f(v,w)} and vertices VVV. An excess–deficit cut Y⊆E+Y\subseteq E^+Y⊆E+ meets every path in this graph from an excess vertex to a deficit vertex. Thus a cut is measured among comparison arcs, not among arbitrary arcs of the original network. Lemmas 3 and 4 of the paper establish the level and cut bounds on which the excess estimate rests.

Formalization targets

The goal is Lemma 5 on p. 410, stated with both constants obtained in its proof. Under the cost-scale conditions above, and the divisibility conventions in footnotes 5–6, its two cases are

λ=m⟹X(f)≤3λ,\lambda=\sqrt m\quad\Longrightarrow\quad X(f)\le 3\lambda,λ=m​⟹X(f)≤3λ, λ=n2/3⟹X(f)≤36λ.\lambda=n^{2/3}\quad\Longrightarrow\quad X(f)\le36\lambda.λ=n2/3⟹X(f)≤36λ.

The second case also assumes that six divides the integer λ\lambdaλ; the first uses divisibility by three. The goal keeps the two conclusions separate so that the stronger 3λ3\lambda3λ bound is retained when m\sqrt mm​ determines the scale. Its milestone list follows the paper: Lemma 3 bounds d(v)−d(w)d(v)-d(w)d(v)−d(w) by three on an arc of E+E^+E+; Lemma 4 bounds total excess by a cut; and the proof of Lemma 5 supplies the cut bands and the two size estimates. The bands use the exact three-level and six-level ranges printed on p. 410.

Significance

The result connects a condition on price increases to a numerical bound on the amount of flow still needing discharge. Combined with the paper's time per unit of remaining excess, this is the bound needed for its second-phase running-time estimate. The two regimes show how the same cost-scale state can be controlled by either the number of input arcs or the number of vertices. Without the excess bound, the paper's argument gives no comparable limit on the remaining work at the phase transition.

The paper proves Lemma 5, but this particular unit-capacity excess argument has no matching theorem in the platform catalog checked for this mission. The network, circulation and pseudoflow interfaces are already published as reusable definitions from earlier cost-scaling work. A completed machine-checked development would add the cut argument and band counts to those interfaces. Those facts can also support other analyses that compare an entry circulation with an intermediate pseudoflow; this mission does not claim to formalize the algorithm's entire execution or its running-time model.

Difficulty

The main obstacle is linking local price inequalities to a global bound on excess. A reduced-cost inequality controls a single residual arc, while excess may move through a path and is measured over many vertices. The comparison graph G+G^+G+ is essential: on a residual arc outside E+E^+E+, the level difference used by Lemma 3 is not available. Counting all residual arcs as if they were comparison arcs would therefore not justify the cut bound. There is a separate counting issue: the represented network has both directions of each input arc, so using ∣E∣|E|∣E∣ for mmm changes the constant in the square-root case.

Formalization scope

Lean represents the network by a finite symmetric arc set with real capacities and antisymmetric real costs. A local unit-capacity predicate marks each reverse pair as capacities (1,0)(1,0)(1,0) or (0,1)(0,1)(0,1); mmm counts the capacity-one orientations. Flows are real valued as on p. 408. Integer costs on that page are generalized to real costs because Lemmas 3–5 use only antisymmetry and reduced-cost inequalities. No result here depends on cost integrality.

The formalization takes the cost-scale state as hypotheses: ε>0\varepsilon>0ε>0, entry circulation and 2ε2\varepsilon2ε-optimality, current ε\varepsilonε-optimality, integral levels, level at least λ\lambdaλ at excess vertices, and zero level at deficits. It takes λ\lambdaλ as a natural number equal to min⁡{m,n2/3}\min\{\sqrt m,n^{2/3}\}min{m​,n2/3} and records the paper's divisibility simplifications. The indexed pigeonhole milestones also require λ>0\lambda>0λ>0 so their index ranges are nonempty; the goal includes the zero-arc boundary without requiring an index. Cuts use reachability after deleting a subset of E+E^+E+, equivalent to meeting every excess-to-deficit path. The proof of Lemma 5 prints “cut in GfG_fGf​”; the formalized claim uses G+G^+G+, the graph for which Lemma 3 gives the required level control and Lemma 4 states its bound.

The definition layer, path-cut lemma and finite counting arguments are the reusable infrastructure. Contributions that establish these exact statements, their necessary elementary flow identities, or a machine-checked goal proof are in scope. Counting mmm with reverse arcs, allowing cuts outside E+E^+E+, using arbitrary real levels in place of integral ones, or replacing both cases by the weaker 36λ36\lambda36λ bound does not express this target.

Selected references

  • A. V. Goldberg, H. Kaplan, S. Hed and R. E. Tarjan, Minimum Cost Flows in Graphs with Unit Capacities, 32nd International Symposium on Theoretical Aspects of Computer Science, LIPIcs 30, pp. 406–419, 2015. doi:10.4230/LIPIcs.STACS.2015.406.
9 thms0 active usersReviewed
Algorithmic Game TheoryFunctional Analysis·Captain: mikedeng1

Stochastic Graphon Games: I. The Static Case 2: Under Condition (17) the Unique Nash Equilibrium of a Graphon Game Moves by at Most κ‖W − W′‖ When the Graphon ChangesResearch Paper

Motivation

Large network games can be described by a graphon, a measurable kernel that assigns an interaction weight to each pair of players in a continuum. This representation is useful when a finite network is viewed as an approximation to a limiting network. A basic question is whether a small change in interaction weights can cause a large change in equilibrium behavior. Carmona, Cooney, Graves, and Laurière answer this question for a static game with real actions, noisy player states, and costs coupled through an aggregate state. Their static graphon games paper establishes existence and uniqueness under different hypotheses, and Theorem 3.20 gives an explicit stability estimate under its contraction condition.

The mission isolates that stability estimate and the results on which it depends. It belongs to the same development as the paper's existence theorem, but has a narrower question: how sensitively does the equilibrium respond when one graphon is replaced by another? The paper later studies finite-player approximations, for which understanding the limiting graphon game's equilibrium is useful. Those later approximation theorems are outside this mission.

Setting

The player set is I=[0,1]I=[0,1]I=[0,1] with Lebesgue probability measure. Every player chooses a real action. A strategy profile α\alphaα assigns an action α(x)\alpha(x)α(x) to almost every player and belongs to L2(I)L^2(I)L2(I). Profiles that differ only on a null set represent the same strategy.

A graphon is a symmetric, real-valued, measurable, square-integrable function www on I×II\times II×I. It defines an integral operator WWW on L2(I)L^2(I)L2(I) by

[Wg](x)=∫Iw(x,y)g(y) dy.[Wg](x)=\int_I w(x,y)g(y)\,dy.[Wg](x)=∫I​w(x,y)g(y)dy.

Its norm ∥W∥\|W\|∥W∥ is the L2L^2L2-to-L2L^2L2 operator norm. In particular, interaction weights are allowed to be negative and are not restricted to [0,1][0,1][0,1]. A second graphon w′w'w′ has operator W′W'W′, and ∥W−W′∥\|W-W'\|∥W−W′∥ is the operator norm of their difference.

A player's state is Xa,z,ξ=b(a,z)+ξX_{a,z,\xi}=b(a,z)+\xiXa,z,ξ​=b(a,z)+ξ, where aaa is the player's action, zzz is an aggregate state, and ξ\xiξ has a common centered probability law μ0\mu_0μ0​ with finite second moment. Assumption 1 bounds squared changes in bbb by cαc_\alphacα​ times the squared action change plus czc_zcz​ times the squared aggregate change. For a profile α\alphaα, its aggregate ZαZ\alphaZα is the L2L^2L2 solution of

[Zα](x)=∫Iw(x,y)b(α(y),[Zα](y)) dyfor almost every x∈I.[Z\alpha](x)=\int_I w(x,y)b(\alpha(y),[Z\alpha](y))\,dy \quad\text{for almost every }x\in I.[Zα](x)=∫I​w(x,y)b(α(y),[Zα](y))dyfor almost every x∈I.

Proposition 3.1 states that this aggregate exists and is unique when cz∥W∥<1\sqrt{c_z}\|W\|<1cz​​∥W∥<1. This equation is the deterministic aggregate obtained from the paper's continuum model.

The expected cost of action aaa at aggregate zzz is J(a,z)=∫f(b(a,z)+ξ,a,z) μ0(dξ)J(a,z)=\int f(b(a,z)+\xi,a,z)\,\mu_0(d\xi)J(a,z)=∫f(b(a,z)+ξ,a,z)μ0​(dξ). Assumption 4 says that J(⋅,z)J(\cdot,z)J(⋅,z) is continuously differentiable and uniformly ℓc\ell_cℓc​-strongly convex, and its action derivative changes at most ℓJ∣z−z′∣\ell_J|z-z'|ℓJ​∣z−z′∣ when the aggregate changes. The best response BzBzBz minimizes this cost pointwise. A Nash equilibrium is an L2L^2L2 profile α\alphaα whose action minimizes J(⋅,[Zα](x))J(\cdot,[Z\alpha](x))J(⋅,[Zα](x)) for almost every player. Assumption 5 adds the uniform bound ∣b(a,z)∣≤c0|b(a,z)|\leq c_0∣b(a,z)∣≤c0​.

Formalization targets

The first targets are the unique aggregate of Proposition 3.1, the best-response bound of Lemma 3.7, and the L2L^2L2 aggregate bound (15) of Lemma 3.16. Together these support the uniqueness condition in Proposition 3.17:

ℓJℓccα∥W∥1−cz∥W∥<1.(17)\frac{\ell_J}{\ell_c} \frac{\sqrt{c_\alpha}\|W\|}{1-\sqrt{c_z}\|W\|}<1. \tag{17}ℓc​ℓJ​​1−cz​​∥W∥cα​​∥W∥​<1.(17)

Lemma 3.19 then bounds the change of aggregate when the same profile is placed in two graphons. The goal, Theorem 3.20, concerns an equilibrium α\alphaα for www and any equilibrium α′\alpha'α′ for w′w'w′:

∥α−α′∥L2(I)≤κ∥W−W′∥,κ=c0ℓJ(1−cz∥W∥)(1−cz∥W∥)[ℓc(1−cz∥W∥)−ℓJcα∥W∥].\|\alpha-\alpha'\|_{L^2(I)}\leq\kappa\|W-W'\|, \qquad \kappa=\frac{c_0\ell_J(1-\sqrt{c_z}\|W\|)} {(1-\sqrt{c_z}\|W\|) [\ell_c(1-\sqrt{c_z}\|W\|)-\ell_J\sqrt{c_\alpha}\|W\|]}.∥α−α′∥L2(I)​≤κ∥W−W′∥,κ=(1−cz​​∥W∥)[ℓc​(1−cz​​∥W∥)−ℓJ​cα​​∥W∥]c0​ℓJ​(1−cz​​∥W∥)​.

Here www satisfies both cz∥W∥<1\sqrt{c_z}\|W\|<1cz​​∥W∥<1 and (17), while w′w'w′ is required only to satisfy cz∥W′∥<1\sqrt{c_z}\|W'\|<1cz​​∥W′∥<1. The displayed coefficient is the paper's expression, including its common factor.

Significance

The theorem gives a quantitative guarantee: as long as the original game's contraction condition holds, the distance between equilibria is controlled by the operator distance between graphons. The bound identifies how state sensitivity cα,czc_\alpha,c_zcα​,cz​, cost sensitivity ℓJ\ell_JℓJ​, strong convexity ℓc\ell_cℓc​, and the state bound c0c_0c0​ enter that guarantee. The result also separates two questions: whether an equilibrium exists for a changed graphon, and how far any such equilibrium can lie from the original one.

The mathematical theorem is proved in the paper; the Lean goal is open. A complete formal development would establish the L2L^2L2 integral-operator estimates, the aggregate and best-response regularity results, the unique equilibrium under (17), and finally the stability inequality. The definitions of real-valued graphons, aggregates, and their extended-valued operator norm can support later work on graphon games beyond this particular estimate. The paper's §4 finite-player results, including Theorems 4.3, 4.7, and 4.9, are not posed here.

Difficulty

An equilibrium is a fixed point of a response to an aggregate, so changing the graphon changes both the aggregate and the equilibrium profile. A direct comparison of costs at two equilibria does not by itself separate these effects or yield the printed constant. The aggregate is defined only as an L2L^2L2 equivalence class, while its equation and pointwise best responses use representatives. The formalization must keep those almost-everywhere statements aligned with the operator norm estimate. It must also retain the paper's asymmetric hypotheses: (17) is assumed for the original graphon, while the second graphon is allowed to have any Nash equilibrium under its own aggregate condition.

Formalization scope

Lean uses unitInterval with its volume measure for III, real actions, functions with MemLp for L2L^2L2 profiles, and almost-everywhere equality for profiles and aggregates. IsGraphon includes measurability, symmetry, and square integrability. IsAggregate records equation (6) and membership in L2L^2L2. The integral cost is computed from bbb, fff, and μ0\mu_0μ0​ rather than supplied as an unrelated function. Assumptions 1, 4, and 5 are explicit; the centered noise law is part of the standing model. Lemma 3.7 is stated for an arbitrary cost satisfying Assumption 4, as on the page.

The paper defines equilibrium through a best-response map on a rich Fubini extension. Proposition 3.6 identifies that with the almost-everywhere pointwise minimization condition under Assumption 4. The mission uses that equivalent condition as its equilibrium predicate. This is a disclosed model choice because the Fubini extension itself is not formalized. A best response is selected by classical choice; Assumption 4 gives the minimizer that makes the selection meaningful.

Norm inequalities use extended nonnegative reals. For a square-integrable graphon, its operator norm is finite, and real hypotheses use that finite value. The operator norm is never a real supremum with a default value for unbounded inputs; an equilibrium always includes an aggregate; and an infinite left-side norm is never converted to zero. These choices prevent the stability claim from becoming empty at a bad input. Contributions to the integral-operator infrastructure, the existence and uniqueness of aggregates, and the five named milestones are all within scope.

Selected references

  • René Carmona, Daniel B. Cooney, Christy V. Graves, and Mathieu Laurière, Stochastic Graphon Games: I. The Static Case, arXiv:1911.10664v1, 2019; published in Mathematics of Operations Research, 2022. arXiv
8 thms0 active usersReviewed
Bandit AlgorithmsMachine LearningStatistics·Captain: mikedeng1

Personalized Dynamic Pricing with Machine Learning: High-Dimensional Features and Heterogeneous Elasticity 2: Under Unknown Sparsity, Lasso-Based ILQX Pricing Has Regret at Most Cs√T(log d + log T)Research Paper

Motivation

Online sellers of loans, insurance, travel and retail goods observe data about each arriving customer before quoting a price. Using that data to price individually is attractive only if the seller can learn, from its own sales, how demand responds to price for customers with given characteristics. Two features make this hard in practice. The number of recorded characteristics ddd is often large, possibly larger than the selling horizon TTT, while only a few of them matter. And price sensitivity is itself heterogeneous: different customers respond to the same price change differently.

Ban and Keskin (Management Science 67(9), 2021) model both features and ask how fast the revenue lost to learning can grow. Their answer is that a seller who learns with lasso-regularized quasi-likelihood estimation and occasional price experiments loses revenue of order sTs\sqrt TsT​ up to logarithmic factors, where sss is the number of relevant characteristics, and that no policy can do better than order sTs\sqrt TsT​. This mission formalizes the upper bound for the general (nonlinear-link) model with unknown sparsity, Theorem 3 of the paper.

Setting

In each period t=1,2,…,Tt = 1, 2, \dots, Tt=1,2,…,T a customer arrives with a raw feature vector Zt∈RdZ_t \in \mathbb R^dZt​∈Rd. The ZtZ_tZt​ are i.i.d., take values in a compact set Z\mathcal ZZ inside a ball of radius zmax⁡z_{\max}zmax​, have mean zero and positive definite covariance ΣZ\Sigma_ZΣZ​. The seller sees the augmented vector Xt=[1;Zt]∈Rd+1X_t = [1; Z_t] \in \mathbb R^{d+1}Xt​=[1;Zt​]∈Rd+1, charges a price pt∈[ℓ,u]p_t \in [\ell, u]pt​∈[ℓ,u] with 0<ℓ<u0 < \ell < u0<ℓ<u, and observes the demand

Dt=g(α⋅Xt+(β⋅Xt) pt)+εt.D_t = g\big(\alpha \cdot X_t + (\beta \cdot X_t)\, p_t\big) + \varepsilon_t .Dt​=g(α⋅Xt​+(β⋅Xt​)pt​)+εt​.

Here θ=(α,β)\theta = (\alpha, \beta)θ=(α,β) is an unknown parameter in a compact rectangle Θ⊂R2(d+1)\Theta \subset \mathbb R^{2(d+1)}Θ⊂R2(d+1), the link ggg is known, differentiable and increasing with ℓ~≤g′≤u~\tilde\ell \le g' \le \tilde uℓ~≤g′≤u~ on the relevant domain, and the demand shocks εt\varepsilon_tεt​ form a sub-Gaussian martingale difference sequence. The term β⋅Xt\beta \cdot X_tβ⋅Xt​ is the customer's own price sensitivity. With u(p,x)=[1;p]⊗xu(p, x) = [1; p] \otimes xu(p,x)=[1;p]⊗x the argument of ggg is θ⋅u(p,x)\theta \cdot u(p, x)θ⋅u(p,x).

The sparsity of θ\thetaθ is s=∣S∣s = |\mathcal S|s=∣S∣, S={i:αi≠0}∪{i:βi≠0}\mathcal S = \{i : \alpha_i \neq 0\} \cup \{i : \beta_i \neq 0\}S={i:αi​=0}∪{i:βi​=0}. The seller does not know S\mathcal SS.

The expected revenue of price ppp is r(p,θ,x)=p g(θ⋅u(p,x))r(p, \theta, x) = p\, g(\theta \cdot u(p,x))r(p,θ,x)=pg(θ⋅u(p,x)), and the clairvoyant price φ(θ,x)\varphi(\theta, x)φ(θ,x) maximizes it; it is assumed to lie in the interior of [ℓ,u][\ell, u][ℓ,u] for θ∈Θ\theta \in \Thetaθ∈Θ, x∈X={1}×Zx \in \mathcal X = \{1\} \times \mathcal Zx∈X={1}×Z. The regret of a policy over TTT periods is

Δθπ(T)=E[∑t=1Tr∗(θ,Xt)−r(pt,θ,Xt)],r∗(θ,x)=r(φ(θ,x),θ,x).\Delta^\pi_\theta(T) = \mathbb E\Big[\sum_{t=1}^T r^*(\theta, X_t) - r(p_t, \theta, X_t)\Big], \qquad r^*(\theta,x) = r(\varphi(\theta,x),\theta,x).Δθπ​(T)=E[t=1∑T​r∗(θ,Xt​)−r(pt​,θ,Xt​)],r∗(θ,x)=r(φ(θ,x),θ,x).

The policy ILQX(m1,m2,λ)(m_1, m_2, \lambda)(m1​,m2​,λ) charges the experimental price m1m_1m1​ in periods M1={1,4,9,… }M_1 = \{1, 4, 9, \dots\}M1​={1,4,9,…} and m2m_2m2​ in periods M2={2,5,10,… }M_2 = \{2, 5, 10, \dots\}M2​={2,5,10,…}, and otherwise charges φ(PΘθ^t,Xt)\varphi(\mathcal P_\Theta \hat\theta_t, X_t)φ(PΘ​θ^t​,Xt​), where θ^t\hat\theta_tθ^t​ maximizes the lasso-penalized quasi-likelihood

Qt−1(θ~,λt)=∑k=1t−1χk∫Dkg(θ~⋅uk)Dk−yg′(g−1(y)) dy−λt∥θ~∥1Q_{t-1}(\tilde\theta, \lambda_t) = \sum_{k=1}^{t-1} \chi_k \int_{D_k}^{g(\tilde\theta \cdot u_k)} \frac{D_k - y}{g'(g^{-1}(y))}\, dy - \lambda_t \|\tilde\theta\|_1Qt−1​(θ~,λt​)=k=1∑t−1​χk​∫Dk​g(θ~⋅uk​)​g′(g−1(y))Dk​−y​dy−λt​∥θ~∥1​

over the experimental periods (χk=I{k∈M1∪M2}\chi_k = \mathbb I\{k \in M_1 \cup M_2\}χk​=I{k∈M1​∪M2​}), and PΘ\mathcal P_\ThetaPΘ​ is the projection onto Θ\ThetaΘ. The regularization level is λt+1=c~ t1/4log⁡d+log⁡t\lambda_{t+1} = \tilde c\, t^{1/4} \sqrt{\log d + \log t}λt+1​=c~t1/4logd+logt​ for a constant c~>0\tilde c > 0c~>0.

Formalization targets

Goal: Theorem 3

There is a finite constant C~>0\tilde C > 0C~>0 such that

Δθπ(T)≤C~ sT (log⁡d+log⁡T)for all θ∈Θ, T≥2.\Delta^\pi_\theta(T) \le \tilde C\, s \sqrt T\, (\log d + \log T) \qquad \text{for all } \theta \in \Theta,\ T \ge 2 .Δθπ​(T)≤C~sT​(logd+logT)for all θ∈Θ, T≥2.

C~\tilde CC~ is fixed with the model and is uniform over Θ\ThetaΘ; since s=s(θ)s = s(\theta)s=s(θ) varies over Θ\ThetaΘ, the factor sss carries content.

Milestones

  1. The counting property of the schedule (7): for t≥5t \ge 5t≥5 each experimental price is charged at least 14t\tfrac14 \sqrt t41​t​ times in periods 1,…,t1, \dots, t1,…,t.
  2. Lemma 3, the estimation error of the lasso quasi-likelihood estimate:
P{∥θ^t+1(lasso)(λt+1)−θ∥2≤ρ3s(log⁡d+log⁡t)t}≥1−κ3s(log⁡d+log⁡t)t,t≥t1.\mathbb P\Big\{\|\hat\theta^{(\mathrm{lasso})}_{t+1}(\lambda_{t+1}) - \theta\|^2 \le \rho_3 \frac{s(\log d + \log t)}{\sqrt t}\Big\} \ge 1 - \kappa_3 \frac{s(\log d + \log t)}{\sqrt t}, \qquad t \ge t_1 .P{∥θ^t+1(lasso)​(λt+1​)−θ∥2≤ρ3​t​s(logd+logt)​}≥1−κ3​t​s(logd+logt)​,t≥t1​.

Significance

Theorem 3 says that a seller facing many potentially relevant customer characteristics, without knowing which matter and under a nonlinear demand link such as logit, loses revenue at a rate governed by the number sss of relevant characteristics and only logarithmically by the total number ddd. Combined with the paper's sTs\sqrt TsT​ lower bound (Theorem 1, for the linear model), it makes ILQX first-order optimal up to logarithmic factors. An unregularized policy would pay order dTd\sqrt TdT​, which is linear in TTT when ddd exceeds T\sqrt TT​.

The paper's proofs are in its electronic companion, which this mission does not reproduce; no machine-checked version of the result exists. A complete formalization would also produce a reusable high-probability error bound for lasso-regularized quasi-likelihood estimation under adaptively collected data (Lemma 3), and a machine-checked model of feature-based dynamic pricing on which related policies can be stated.

Difficulty

The estimation error must be controlled on data collected by the policy itself. The design vectors uk=[1;mi(k)]⊗Xku_k = [1; m_{i(k)}] \otimes X_kuk​=[1;mi(k)​]⊗Xk​ use only two prices, so the information about the price sensitivity accrues only from the Θ(t)\Theta(\sqrt t)Θ(t​) experimental periods. Standard lasso error bounds assume a fixed or i.i.d. design and a restricted-eigenvalue condition on it; here a restricted-eigenvalue-type property of the random Kronecker design must be derived from ΣZ≻0\Sigma_Z \succ 0ΣZ​≻0 and m1≠m2m_1 \ne m_2m1​=m2​, and the noise enters through a martingale whose conditional law may depend on past prices. The quasi-likelihood is not a least-squares objective, so the curvature comes from the bounds ℓ~≤g′≤u~\tilde\ell \le g' \le \tilde uℓ~≤g′≤u~, which hold only on the bounded domain {θ⋅u(p,x):θ∈Θ}\{\theta \cdot u(p,x) : \theta \in \Theta\}{θ⋅u(p,x):θ∈Θ} and not at an unconstrained estimate. Finally, the regret bound has to turn a squared-error bound holding with probability 1−O(slog⁡(dt)/t)1 - O(s \log(dt)/\sqrt t)1−O(slog(dt)/t​) into an expected revenue loss, which requires the revenue loss to be second order in the parameter error at an interior optimum.

Formalization scope

  • Coordinates. x∈Rd+1x \in \mathbb R^{d+1}x∈Rd+1 is Fin (d+1) → ℝ with the intercept at index 0; θ\thetaθ is Fin 2 × Fin (d+1) → ℝ with θ(0,i)=αi\theta(0,i) = \alpha_iθ(0,i)=αi​, θ(1,i)=βi\theta(1,i) = \beta_iθ(1,i)=βi​. Periods are 1-based. d≥1d \ge 1d≥1.
  • Objective. The integrated form ∑kχk(Dk (θ~⋅uk)−∫0θ~⋅ukg)−λ∥θ~∥1\sum_k \chi_k \big(D_k\,(\tilde\theta \cdot u_k) - \int_0^{\tilde\theta \cdot u_k} g\big) - \lambda \|\tilde\theta\|_1∑k​χk​(Dk​(θ~⋅uk​)−∫0θ~⋅uk​​g)−λ∥θ~∥1​, which differs from the paper's (17) by a term not depending on θ~\tilde\thetaθ~ and therefore has the same maximizers.
  • Estimator. Any measurable selection that is a maximizer whenever one exists; the theorems hold for every such selection. The paper's claim that (17) is strictly concave with a unique maximizer fails when 2(d+1)2(d+1)2(d+1) exceeds the rank of the design.
  • Policy. The price is defined by strong recursion over the realized history; the estimator sees θ\thetaθ only through the realized demands.
  • Regret is a lower Lebesgue integral of nonnegative losses; conditional moments of the shocks use the conditional Lebesgue expectation; probabilities are compared in [0,∞][0, \infty][0,∞].
  • Standing assumptions formalized: i.i.d. measurable features in a compact Z\mathcal ZZ inside a Euclidean ball, mean zero, positive definite ΣZ\Sigma_ZΣZ​; fresh customers (Zt+1Z_{t+1}Zt+1​ independent of the past); sub-Gaussian martingale-difference shocks; m1≠m2m_1 \ne m_2m1​=m2​ in [ℓ,u][\ell, u][ℓ,u]; ggg differentiable and increasing with derivative bounds on the relevant domain (endnote 2 states them as a consequence, which is false; here they are a hypothesis); φ\varphiφ an unconstrained revenue maximizer in (ℓ,u)(\ell, u)(ℓ,u) whose pricing map after projection and feature augmentation is measurable. The processes are constrained only at the used periods t≥1t\ge1t≥1.
  • Added hypotheses, per θ\thetaθ: s(θ)≥1s(\theta) \ge 1s(θ)≥1 (the paper's s∈{1,…,d+1}s \in \{1, \dots, d+1\}s∈{1,…,d+1}), and almost surely every realized demand lies in the closure of the range of ggg, which guarantees that a maximizer of (17) exists (true for the linear link and for binary demand under a logit link).
  • Not formalized: the paper's support condition on continuous features; Remark 7's independence of C~\tilde CC~ from ddd; dependence of the shock law on θ\thetaθ (the shocks are one fixed process).
  • Ruled-out trivializations. The regret cannot vanish by non-integrability; the estimator cannot be an arbitrary function, since it must maximize the objective; C~\tilde CC~ and κ3,ρ3,t1\kappa_3, \rho_3, t_1κ3​,ρ3​,t1​ are chosen before θ\thetaθ, so they cannot absorb sss; the hypotheses are jointly satisfiable (a linear-link instance with d=1d = 1d=1 is checked).

Contributions welcome: existence of a measurable maximizer of the objective, the counting lemma, and supporting lemmas for Lemma 3 and the regret bound.

Selected references

  • G.-Y. Ban and N. B. Keskin, Personalized Dynamic Pricing with Machine Learning: High-Dimensional Features and Heterogeneous Elasticity, Management Science 67(9):5549–5568, 2021. https://doi.org/10.1287/mnsc.2020.3680
  • A. V. den Boer and B. Zwart, Simultaneously Learning and Optimizing Using Controlled Variance Pricing, Management Science 60(3):770–783, 2014. https://doi.org/10.1287/mnsc.2013.1788
  • N. B. Keskin and A. Zeevi, Dynamic Pricing with an Unknown Demand Model: Asymptotically Optimal Semi-Myopic Policies, Operations Research 62(5):1142–1167, 2014. https://doi.org/10.1287/opre.2014.1294
  • A. Javanmard and H. Nazerzadeh, Dynamic Pricing in High-Dimensions, Journal of Machine Learning Research 20(9):1–49, 2019. https://jmlr.org/papers/v20/17-357.html
6 thms0 active usersReviewed
Algorithmic Game TheoryTheoretical Computer Science·Captain: mikedeng1

Prophet Inequalities Made Easy: Stochastic Optimization by Pricing Nonstochastic Inputs III: Under a Consistent Allocation Rule, (α, β)-Balanced Prices Are Closed Under Maxima of ValuationsResearch Paper

Motivation

Posted prices turn an offline allocation problem into a sequential choice process: each agent sees a menu of outcomes and prices, then chooses an outcome without revealing its full valuation. The balanced prices framework of Dütting, Feldman, Kesselheim, and Lucier gives welfare guarantees by comparing the revenue collected from an allocation with the welfare that remains feasible after it. Its appeal is that the comparison can be checked in a deterministic full-information setting before any probability distribution over valuations enters the analysis. Dütting et al., 2020

One valuation class at a time would make that framework difficult to reuse. Combinatorial auction valuations are often built by taking pointwise maxima of simpler valuations or by adding values from separate markets. Section 5 of the paper asks whether a price construction balanced for the simple class remains balanced after these operations. Theorem 5.3 gives the maximum closure result; Theorem 5.4 gives addition across markets. Appendix B extends both to the weaker balancing condition used elsewhere in the paper. Dütting et al., 2020, §5 and Appendix B

Setting

There are nnn agents in a fixed order. Agent iii receives an outcome xix_ixi​ from a space XiX_iXi​ containing a null outcome. A profile x=(xi)ix=(x_i)_ix=(xi​)i​ is feasible when it lies in F\mathcal FF. The model assumes downward closure: removing the outcomes of any group of agents from a feasible profile keeps it feasible. For a set of agents SSS, write xSx_SxS​ for the profile retaining xix_ixi​ on SSS and assigning the null outcome elsewhere. The prefix x[i−1]x_{[i-1]}x[i−1]​ retains only the agents before iii. Dütting et al., 2020, §2

A valuation profile vvv assigns each agent a function vi:Xi→Rv_i:X_i\to\mathbb Rvi​:Xi​→R. The welfare of xxx is v(x)=∑ivi(xi)v(x)=\sum_i v_i(x_i)v(x)=∑i​vi​(xi​). Every base valuation takes values in [0,1][0,1][0,1], the normalization stated in §2. For any set SSS of profiles, v(OPT⁡(v,S))v(\operatorname{OPT}(v,S))v(OPT(v,S)) denotes the best welfare achievable in SSS. An allocation rule ALG chooses a feasible profile from a valuation profile. A pricing rule assigns a nonnegative, possibly infinite price pi(xi∣y)p_i(x_i\mid y)pi​(xi​∣y) to outcome xix_ixi​ when the partial profile is yyy; an infeasible extension has infinite price. Dütting et al., 2020, pp. 547–548

An exchange-compatible family (Fx)x∈X(\mathcal F_x)_{x\in X}(Fx​)x∈X​ specifies a set of comparison profiles for each profile xxx. It is exchange compatible when replacing any one coordinate of xxx by the corresponding coordinate of any y∈Fxy\in\mathcal F_xy∈Fx​ gives a feasible profile. This property is required for every xxx in the full outcome space. A rule pvp^vpv is (α,β)(\alpha,\beta)(α,β)-balanced for valuation vvv, ALG, and that family, for constants α>0\alpha>0α>0 and β≥0\beta\ge0β≥0 (Definition 3.1), when both inequalities hold for every feasible xxx and every x′∈Fxx'\in\mathcal F_xx′∈Fx​:

v(ALG⁡(v))−v(OPT⁡(v,Fx))α≤∑ipiv(xi∣x[i−1]),∑ipiv(xi′∣x[i−1])≤βv(OPT⁡(v,Fx)).\frac{v(\operatorname{ALG}(v))-v(\operatorname{OPT}(v,\mathcal F_x))}{\alpha} \le \sum_i p_i^v(x_i\mid x_{[i-1]}), \qquad \sum_i p_i^v(x'_i\mid x_{[i-1]}) \le \beta v(\operatorname{OPT}(v,\mathcal F_x)).αv(ALG(v))−v(OPT(v,Fx​))​≤i∑​piv​(xi​∣x[i−1]​),i∑​piv​(xi′​∣x[i−1]​)≤βv(OPT(v,Fx​)).

The maximum extension Vimax⁡V_i^{\max}Vimax​ of a base valuation space ViV_iVi​ consists of nonempty finite pointwise maxima of elements of ViV_iVi​. A base profile v~\tilde vv~ supports an extended profile vvv at xxx if v~i≤vi\tilde v_i\le v_iv~i​≤vi​ at every outcome and v~i(xi)=vi(xi)\tilde v_i(x_i)=v_i(x_i)v~i​(xi​)=vi​(xi​) for every agent. ALG is consistent when v~(ALG⁡(v~))≥v~(ALG⁡(v))\tilde v(\operatorname{ALG}(\tilde v))\ge\tilde v(\operatorname{ALG}(v))v~(ALG(v~))≥v~(ALG(v)) whenever v~\tilde vv~ supports vvv at ALG⁡(v)\operatorname{ALG}(v)ALG(v). The optimal allocation rule has this property by Lemma 5.2. Dütting et al., 2020, p. 554

Formalization targets

Closure under maxima

The goal is Theorem 5.3. Given one exchange-compatible family and a collection (pw)w∈V(p^w)_{w\in V}(pw)w∈V​ balanced for every base profile, consistency of ALG preserves the same constants for every extended profile and every corresponding supporting base profile:

v∈Vmax⁡,v~∈V supports v at ALG⁡(v)⟹pv~ is (α,β)-balanced for v.v\in V^{\max},\quad \tilde v\in V\text{ supports }v\text{ at }\operatorname{ALG}(v) \quad\Longrightarrow\quad p^{\tilde v}\text{ is }(\alpha,\beta)\text{-balanced for }v.v∈Vmax,v~∈V supports v at ALG(v)⟹pv~ is (α,β)-balanced for v.

The milestone list records the welfare supremum comparison and the two price inequalities in the paper's proof. The family Fx\mathcal F_xFx​ remains the same for all base and extended profiles. Dütting et al., 2020, Theorem 5.3 and proof

Closure under addition and weak balancedness

Theorem 5.4 treats mmm separate allocation problems. The joint outcome and feasible set are products; values and prices add across components; ALG applies each component's rule. It asserts balancedness with the same α\alphaα and β\betaβ. Appendix B changes the second balancedness bound to β1v(OPT⁡(v,Fx))+β2v(ALG⁡(v))\beta_1v(\operatorname{OPT}(v,\mathcal F_x))+\beta_2v(\operatorname{ALG}(v))β1​v(OPT(v,Fx​))+β2​v(ALG(v)) and requires strong consistency for maximum closure. Theorems B.2 and B.3 preserve α,β1,β2\alpha,\beta_1,\beta_2α,β1​,β2​ under maxima and addition, respectively. Dütting et al., 2020, Theorems 5.4, B.2, B.3

Significance

The maximum closure theorem lets a balanced-price construction for a simple valuation class cover finite maxima of that class without worsening its balancing constants. The addition theorem lets separately priced markets be combined by summing prices. Together these two operations account for the XOS composition discussed immediately after Theorem 5.4; the paper uses the results to connect its general framework to combinatorial auctions and multidimensional matroid settings. Dütting et al., 2020, p. 555

These results have paper proofs. The work here is to state their exact deterministic content in Lean so later formalizations of the price constructions can import the closure theorems. The definitions of supporting valuations, exchange-compatible families, and extended-real prices are reusable beyond this mission. The companion statements keep the product-market and weak-balancedness variants alongside the central theorem, while their proofs remain to be formalized.

Difficulty

For maximum closure, the prices are indexed by a base profile v~\tilde vv~ but must be balanced for a different profile vvv that is pointwise larger. A supporting profile agrees with vvv only at ALG's outcome ALG⁡(v)\operatorname{ALG}(v)ALG(v), while condition (a) refers to ALG⁡(v~)\operatorname{ALG}(\tilde v)ALG(v~), an outcome ALG chooses for a different input, and both conditions refer to optimal welfare over Fx\mathcal F_xFx​, where v~\tilde vv~ and vvv can differ. Balancedness of pv~p^{\tilde v}pv~ for v~\tilde vv~ therefore says nothing about vvv on its own; without a hypothesis tying ALG's choices for vvv and v~\tilde vv~ together the statement is false, which is why consistency (Definition 5.1) is part of the theorem. The formal statement must keep the real-valued optimum meaningful for maxima of base valuations, so the [0,1][0,1][0,1] normalization of §2 is carried through to Vmax⁡V^{\max}Vmax. Dütting et al., 2020, Definition 5.1 and Theorem 5.3

For addition, a direct product of the component comparison families has an edge case: a component family can be empty while another is nonempty. The paper's displayed product family then makes the lower balancedness inequality too strong. The theorem statements ask for an exchange-compatible family to exist, as the printed theorems do; they do not require that failing product family. This discrepancy is recorded for review. Dütting et al., 2020, proof of Theorem 5.4

Formalization scope

Agents and markets use zero-based finite indices; the paper writes agent indices from one. A profile's prefix contains exactly the agents with smaller indices. Valuations are functions to R\mathbb RR with base values in [0,1][0,1][0,1]. The maximum extension uses a nonempty finite set of base functions, so its maximum is defined at every outcome. Optimal welfare is a real supremum; bounded valuations keep it finite, and the empty set has value zero. Prices are extended nonnegative reals so +∞+\infty+∞ is retained. The lower balancedness inequality embeds its real right side using ofReal, which handles a negative lower bound consistently with nonnegative prices. The upper inequality keeps the price sum in extended reals.

The maximum theorem quantifies over every extended profile and every supporting base profile, including genuinely new maxima. It keeps one exchange-compatible family for all valuations. The maximum-closure theorems require every base price to satisfy the pricing-rule condition and conclude it for the supporting price. ALG feasibility is assumed on Vmax⁡V^{\max}Vmax, which contains the base profiles. The product theorems construct joint outcomes, additive values, componentwise ALG, and summed prices from the component data; they do not admit an unrelated joint allocation rule. Downward closure and a zero price for the null outcome at feasible partial allocations are included for the product statements. The latter is a disclosed assumption satisfied by the paper's pricing examples and needed to handle empty component families. No distribution or posted-price run is part of this deterministic mission. Lemma 5.2 and the strong-consistency companion take an optimal rule to be one that attains the welfare supremum over F\mathcal FF on every profile in Vmax⁡V^{\max}Vmax, the profiles to which Definitions 5.1 and B.1 apply it; the product companions additionally conclude that the summed prices form a pricing rule (infinite off F\mathcal FF). Their ALG feasibility premise concerns the component profiles supplied in the theorem.

The development needs finite dependent products and sums, finite maxima, real suprema of bounded sets, and extended nonnegative arithmetic. Contributions proving the three maximum-closure milestones, the goal, or the product-market companions are all within scope. A proof that specializes the supporting profile to v~=v\tilde v=vv~=v would lose the intended maximum extension and does not satisfy the goal's universal quantification.

Selected references

  • P. Dütting, M. Feldman, T. Kesselheim, and B. Lucier, Prophet Inequalities Made Easy: Stochastic Optimization by Pricing Nonstochastic Inputs, SIAM Journal on Computing 49(3):540–582, 2020. DOI: 10.1137/20M1323850.
7 thms0 active usersReviewed
Bandit AlgorithmsInformation TheoryMachine Learning·Captain: mikedeng1

Regret in Online Combinatorial Optimization II: Under Bandit Feedback Every Strategy Has Minimax Regret at Least 0.02 m√(dn) on Some Set of Actions with m OnesResearch Paper

Why bandit feedback matters

An online player repeatedly chooses a subset of coordinates and pays the sum of their losses. In many applications the player sees only that sum, not the losses of the selected coordinates. This bandit feedback makes it harder to identify which coordinate within each chosen subset is responsible for a favorable or unfavorable outcome. Audibert, Bubeck and Lugosi studied how this information limit changes regret in online combinatorial optimization. Their Theorem 5 establishes a lower bound that scales linearly with the number of selected coordinates and with the square root of the ambient dimension and horizon. Audibert, Bubeck and Lugosi, 2013, pp. 13–14

The result is part of a comparison among full-information, semi-bandit and bandit feedback in the same action model. Under full information the player sees the complete loss vector after each round; under semi-bandit feedback the player sees losses at selected coordinates; under bandit feedback the player sees only one scalar. The paper proves upper bounds for semi-bandit play and a bandit lower bound. The latter is the target of this mission. Audibert, Bubeck and Lugosi, 2013, pp. 2–3, 14

The game and its regret

Fix a dimension ddd, a horizon nnn, and a finite nonempty set A⊆{0,1}d\mathcal A\subseteq\{0,1\}^dA⊆{0,1}d. Each action a∈Aa\in\mathcal Aa∈A has exactly mmm entries equal to one. At round ttt, the player selects a probability distribution on A\mathcal AA, draws an action ata_tat​, and simultaneously an adversary selects a loss vector zt∈[0,1]dz_t\in[0,1]^dzt​∈[0,1]d. The player pays the scalar atTzta_t^\mathsf Tz_tatT​zt​. In the bandit protocol, that scalar is the only new information made available for the next round. A player strategy can use every previous action and observed scalar loss, and can randomize at every round. Audibert, Bubeck and Lugosi, 2013, pp. 2–3

The paper measures performance by pseudo-regret against the best fixed action in expectation:

Rn=E∑t=1natTzt−min⁡a∈AE∑t=1naTzt.R_n=\mathbb E\sum_{t=1}^{n}a_t^\mathsf Tz_t- \min_{a\in\mathcal A}\mathbb E\sum_{t=1}^{n}a^\mathsf Tz_t.Rn​=Et=1∑n​atT​zt​−a∈Amin​Et=1∑n​aTzt​.

The expectation covers the player's randomization and, when present, the adversary's randomization. This benchmark chooses one action for the whole horizon after comparing expected cumulative losses. It is the sole notion of regret used in the paper. Audibert, Bubeck and Lugosi, 2013, p. 2 and footnote 1

For the lower bound, the appendix arranges the ddd coordinates as mmm parallel games with k=d/mk=d/mk=d/m choices per game. An action selects one coordinate from each game. The adversary can associate a favoured choice α\alphaα with each game and assign independent Bernoulli losses whose means are 1/2−ϵ1/2-\epsilon1/2−ϵ at the favoured coordinates and 1/21/21/2 elsewhere. The player still sees only the sum of the mmm selected losses. These are the α\alphaα-adversaries that underlie the milestone statements. Audibert, Bubeck and Lugosi, 2013, pp. 16–17

Formalization targets

The goal is Theorem 5 with the divisibility condition used by its appendix construction. For n≥d≥2mn\ge d\ge2mn≥d≥2m and m∣dm\mid dm∣d, there is an action set A\mathcal AA such that every bandit strategy faces some bounded loss law with

Rn≥0.02 mdn.R_n\ge0.02\,m\sqrt{dn}.Rn​≥0.02mdn​.

The order of the choices is part of the claim: the action set is fixed first; then each player strategy may face its own adversary. The lower bound retains the paper's explicit constant 0.020.020.02. Audibert, Bubeck and Lugosi, 2013, p. 14, Theorem 5; p. 16

The milestones follow the appendix's stated results: Lemma 5 bounds a logarithm; Lemma 4 and its corrected second case bound the divergence between sums of independent Bernoulli variables; the one-round observation bound and the horizon bound control information revealed by bandit feedback. Equations (9), (10), and (11) connect that information to expected regret and symmetry. The final averaged bound on the chance of selecting a favoured choice closes the path to the goal. The milestones are stated for deterministic players, as in the first three steps of the appendix; the passage to randomized players (the appendix's fourth step) is part of the goal's proof and is not a separate milestone. Audibert, Bubeck and Lugosi, 2013, pp. 17–18, 20–21

What the result establishes

The theorem prevents a uniform regret guarantee of smaller order than mdnm\sqrt{dn}mdn​ for this bandit action model. It shows that aggregating mmm selected losses into a single observation imposes a cost beyond what a player can avoid by choosing a different randomized strategy. In particular, the quantifier over every strategy makes the claim about the feedback model, rather than about one named algorithm. The paper proves the result in Appendix B, with the Bernoulli-sum estimate in Appendix C. Audibert, Bubeck and Lugosi, 2013, pp. 14, 16–18, 20–21

The formalization work is to prove the existing paper result in Lean from a finite protocol that represents all behavioural player strategies, together with the finite laws of the appendix's adversaries. The resulting definitions of action paths, scalar observations, finite probability laws, and divergence estimates can support other finite-horizon bandit lower bounds. These statements are drafted as open Lean theorems; compilation checks their types, while proofs remain for solvers. The paper's mathematical proof does not itself constitute a machine-checked proof.

Where the difficulty lies

A scalar bandit observation sums losses from several games. The player cannot separate the contribution of the favoured coordinate in one game from the other selected losses by inspecting that observation. A bound for the divergence of a single Bernoulli variable therefore does not directly bound the information available to the player. The appendix's central estimate concerns sums of independent Bernoulli variables, followed by the law of the whole sequence of scalar observations. Audibert, Bubeck and Lugosi, 2013, pp. 16, 18, 20

There is also a correction to make explicit. Lemma 4 is false for some parameters allowed by its printed statement: taking n=ℓ=1n=\ell=1n=ℓ=1, p=q=1/2p=q=1/2p=q=1/2, and p′=0.001p'=0.001p′=0.001 violates the displayed bound. The error is in the second case of its proof, which applies Lemma 5 outside its range when p′<pp'<pp′<p. The mission states Lemma 4 with the additional condition p(1−p′)≤2p′(1−p)p(1-p')\le2p'(1-p)p(1−p′)≤2p′(1−p), which holds whenever p≤p′p\le p'p≤p′, and states the corrected second case separately: for q=p>p′q=p>p'q=p>p′, KL(B,B′)≤(p′−p)2/((1−p)p′(n+2))\mathrm{KL}(\mathcal B,\mathcal B')\le(p'-p)^2/((1-p)p'(n+2))KL(B,B′)≤(p′−p)2/((1−p)p′(n+2)). Through the corrected case, the one-round bound used by the goal holds for the full range 0<ϵ<1/20<\epsilon<1/20<ϵ<1/2, so Theorem 5 and its constant are unaffected. Audibert, Bubeck and Lugosi, 2013, pp. 20–21, Lemmas 4–5

Formalization scope

Actions are functions Fin(d)→R\mathrm{Fin}(d)\to\mathbb RFin(d)→R constrained to zero or one, with coordinate sum mmm. Coordinates and rounds are indexed from zero. A behavioural strategy maps every history of chosen actions and real-valued observed losses to a probability distribution on the finite action set. Its domain includes every real history, even though the appendix's particular Bernoulli adversaries generate integer observations. The strategy may randomize; restricting the goal to deterministic players or allowing it to inspect an unobserved loss vector would change the game.

The goal's exhibited adversary is an oblivious, finitely supported probability law on loss sequences in [0,1]n×d[0,1]^{n\times d}[0,1]n×d. It belongs to the broader adversary class of the paper, so this existential formulation is stronger. All expectations are finite sums. The regret comparator is a minimum over the nonempty action set, not a default value assigned to an empty set. The action set has binary entries and equal coordinate sums, and every loss lies in the unit interval; these clauses rule out trivial lower bounds from malformed actions or unbounded losses.

The hypothesis m∣dm\mid dm∣d is added to the printed theorem because Appendix B assumes it to partition coordinates into equally sized games. When m=0m=0m=0, it forces d=0d=0d=0 and the claimed lower bound is zero. The milestone model uses functions Fin(m)→Fin(k)\mathrm{Fin}(m)\to\mathrm{Fin}(k)Fin(m)→Fin(k) with d=mkd=mkd=mk, deterministic players, finite Bernoulli product laws, and a finite real KL sum. Its log ratios are meaningful on the common support ensured by the stated parameter bounds. Reusable contributions include the finite bandit protocol and observation laws, as well as proofs of the KL and averaging milestones.

Selected references

  • Jean-Yves Audibert, Sébastien Bubeck and Gábor Lugosi, Regret in Online Combinatorial Optimization, Mathematics of Operations Research 39(1), 2014. arXiv:1204.4710v2; DOI:10.1287/moor.2013.0598.
13 thms0 active usersReviewed
Dynamic ProgrammingMarkov ChainProbability·Captain: mikedeng1

Partially Observable Total-Cost Markov Decision Processes with Weakly Continuous Transition Probabilities 2: Setwise-Continuous Observations Do Not Make the Belief Transition Weakly ContinuousResearch Paper

Motivation

A partially observable Markov decision process describes a controlled system whose state is hidden but whose observations are available to a decision maker. The distribution of the hidden state conditional on the observations is the belief state. Replacing the hidden state by this distribution turns the model into a fully observed decision process, provided the resulting belief transition has the regularity needed by the usual existence and dynamic programming results. Feinberg, Kasyanov, and Zgurovsky give sufficient conditions for that regularity in their study of total-cost POMDPs, Theorems 3.6 and 3.7.

Their observation-kernel condition is continuity in total variation. Example 4.1 of the same paper tests its sharpness: the authors construct a two-state model with setwise-continuous observations for which the belief transition fails to be weakly continuous. This matters when selecting assumptions for a POMDP theorem. Setwise convergence already requires convergence of the probabilities of every fixed observation event, so it can look adequate for belief updates. The example shows that it is still too weak for the stated conclusion.

Setting

The hidden state space is X={1,2}X=\{1,2\}X={1,2} and the observation space is Y=[0,1]Y=[0,1]Y=[0,1] with Lebesgue probability measure mmm. The action space is A={0}∪{1/n:n=1,2,…}A=\{0\}\cup\{1/n:n=1,2,\ldots\}A={0}∪{1/n:n=1,2,…}, equipped with the topology inherited from R\mathbb RR. The state does not move: its transition law P(⋅∣x,a)P(\cdot\mid x,a)P(⋅∣x,a) is the point mass at xxx for every action. Its continuity in total variation is immediate from this fixed-state behavior.

At hidden state 1 the observation law is always mmm. At hidden state 2, action zero also produces mmm. Under action 1/n1/n1/n, state 2 produces a law m(n)=f(n)mm^{(n)}=f^{(n)}mm(n)=f(n)m. The density f(n)f^{(n)}f(n) equals zero on the open left half of each cell in the 2n2^n2n-part dyadic partition and equals two elsewhere, including the cell endpoints. Equation (4.1) gives the exact intervals. These laws oscillate more rapidly as nnn grows, and the paper establishes m(n)(C)→m(C)m^{(n)}(C)\to m(C)m(n)(C)→m(C) for every fixed Borel set CCC. Thus the observation kernel Q(⋅∣a,x)Q(\cdot\mid a,x)Q(⋅∣a,x) is setwise continuous even at the accumulation action zero. Example 4.1, pp. 13–14.

A belief z∈P(X)z\in\mathcal P(X)z∈P(X) assigns a probability to each hidden state. For a current belief zzz and an action aaa, the joint law R(⋅∣z,a)R(\cdot\mid z,a)R(⋅∣z,a) covers the next state and its observation, and R′(⋅∣z,a)R'(\cdot\mid z,a)R′(⋅∣z,a) is the observation marginal. A filter H(z,a,y)H(z,a,y)H(z,a,y) is a conditional law of the next state given observation yyy: it satisfies the disintegration identity (3.3). The belief transition qH(⋅∣z,a)q_H(\cdot\mid z,a)qH​(⋅∣z,a) is the law of the random posterior H(z,a,y)H(z,a,y)H(z,a,y) when yyy has law R′(⋅∣z,a)R'(\cdot\mid z,a)R′(⋅∣z,a). These objects are defined in (3.1)–(3.5) of the paper. Different versions of HHH agree only almost everywhere for each current belief and action, yet they yield the same belief transition.

Formalization targets

Example 4.1: failure of weak belief continuity

At the uniform belief z=(1/2,1/2)z=(1/2,1/2)z=(1/2,1/2), action zero reveals nothing, while every positive-index action produces the same two-point posterior law:

qH(⋅∣z,0)=δz,qH(⋅∣z,1/n)=34δ(1/3,2/3)+14δ(1,0)(n≥1).q_H(\cdot\mid z,0)=\delta_z,\qquad q_H(\cdot\mid z,1/n)=\tfrac34\delta_{(1/3,2/3)}+\tfrac14\delta_{(1,0)} \quad(n\ge1).qH​(⋅∣z,0)=δz​,qH​(⋅∣z,1/n)=43​δ(1/3,2/3)​+41​δ(1,0)​(n≥1).

The mission's goal asserts that PPP is total-variation continuous, QQQ is a setwise-continuous probability kernel, a valid filter exists, and the positive-index laws fail to converge weakly to the zero-action law as 1/n→01/n\to01/n→0. It states the failure for every filter satisfying (3.3), so it is a property of the POMDP rather than of a selected version of its conditional distribution. The milestone list follows the paper's assertions: setwise convergence of the dyadic laws, setwise continuity of QQQ, the two posterior values almost everywhere, and the explicit laws of qHq_HqH​.

Significance

The example identifies a precise boundary of the sufficient condition in Theorems 3.6 and 3.7. Those theorems use total-variation continuity of the observation law to obtain a weakly continuous belief transition; replacing that premise by setwise continuity makes their continuity conclusion false in this model. The explicit law also shows the size of the discrepancy: the positive-index belief transition has two fixed atoms, while the zero-action transition is concentrated at the original belief. Example 4.1, pp. 13–14.

A machine-checked development would add reusable definitions of sequential kernel continuity, the joint state-observation law, conditional filters, and the belief transition on the Borel space of probability measures. It would also formalize a concrete setwise-convergent sequence of densities whose induced posterior laws do not converge weakly. The paper proves the example; the Lean statements in this proposal are open proof targets, with no completed machine-checked proof claimed here.

Difficulty

Setwise continuity controls Q(C∣a,x)Q(C\mid a,x)Q(C∣a,x) for each fixed Borel set CCC. A posterior is a probability measure determined by the observation, and the belief transition tests the distribution of those posterior measures. The observation regions distinguishing the states change with nnn, so convergence on fixed observation sets does not imply convergence of their posterior distributions. This is the gap in the immediate argument that tries to pass from setwise convergence of QQQ to weak convergence of qHq_HqH​.

The conditional filter adds a second precision issue. Equation (3.3) determines its values only almost surely under the observation marginal, and different versions may disagree on null observations. Any claim about a posterior value at every yyy would exceed the source; the posterior milestone therefore has an almost-everywhere qualifier, while the goal quantifies over every valid version of HHH.

Formalization scope

Lean represents XXX by Fin 2, with 0 for the paper's state 1 and 1 for state 2; YYY by unitInterval; and AAA by the specified subtype of R\mathbb RR. Positive integers are a subtype of N\mathbb NN, so the density and the action 1/n1/n1/n are never evaluated at n=0n=0n=0. The measure mmm is volume on unitInterval, which has total mass one. The density follows (4.1) literally, with open zero intervals and density two at their endpoints. The general transition PPP and observation law QQQ use Mathlib kernels; the example instantiates them directly. The goal includes the probability-kernel property of the concrete QQQ and existence of a valid HHH, guarding the universal filter clause against vacuity.

Weak, setwise, and total-variation convergence are sequential, as on page 4. The weak test class consists of bounded continuous real functions; the setwise test class consists of all Borel sets. The target space of qHq_HqH​ carries the Borel σ-algebra of the weak topology on P(X)\mathcal P(X)P(X), stated explicitly because Mathlib's default measurable structure on that type is the Giry σ-algebra. The filter predicate requires measurability in yyy for fixed (z,a)(z,a)(z,a) in both structures. Joint measurability in (z,a,y)(z,a,y)(z,a,y) is described in the paper but is not encoded in this local predicate; only the fixed-parameter property is used by (3.3) and (3.5). This choice and its quantifier effect are recorded in the moderation notes.

No cost, initial observation kernel, initial prior, or discount factor enters Example 4.1. Contributions on the dyadic law, kernel continuity, conditional posterior values, and the resulting belief-law identity are all within scope. A filter hard-coded to return the prior belief, a discrete topology on AAA, or a claim for only one version of HHH would change the counterexample and is excluded by the definitions and goal.

Selected references

  • E. A. Feinberg, P. O. Kasyanov, and M. Z. Zgurovsky, Partially Observable Total-Cost Markov Decision Processes with Weakly Continuous Transition Probabilities, Mathematics of Operations Research 41(2), 2016; arXiv:1401.2168v2. This mission follows the pinned preprint's numbering and pages.
6 thms0 active usersReviewed
Dynamic ProgrammingMarkov ChainProbability·Captain: mikedeng1

Partially Observable Total-Cost Markov Decision Processes with Weakly Continuous Transition Probabilities 1: The Belief MDP Satisfies Assumption (W*) Under Total-Variation-Continuous ObservationsResearch Paper

Motivation

A partially observable Markov decision process (POMDP) models a controller that cannot see the state of the system it steers, only noisy observations of it. Inventory control with unrecorded demand, machine maintenance with imperfect inspection, and target tracking from sensor readings all have this form. The standard way to solve a POMDP is to replace it by its belief MDP, also called the completely observable MDP (COMDP): the state becomes the posterior distribution of the hidden state given everything observed so far. The belief MDP is fully observed, so the theory of Markov decision processes applies to it, but only if the belief MDP satisfies that theory's hypotheses. For MDPs with Borel state and action spaces, unbounded costs and possibly noncompact action sets, the hypothesis that yields optimality equations, convergence of value iterations and stationary optimal policies is Assumption (W*) of Feinberg, Kasyanov and Zadoianchuk (Math. Oper. Res. 2012): the cost is K\mathbb KK-inf-compact and the transition probability is weakly continuous.

Before Feinberg, Kasyanov and Zgurovsky (arXiv:1401.2168v2, published in Math. Oper. Res. 41(2), 2016), sufficient conditions for the belief MDP to be weakly continuous required a weakly continuous filter (Hernández-Lerma, 1989, as recalled on p. 11 of arXiv:1401.2168v2), a condition that fails in many natural models. The paper replaces it by a condition on the primitive data of the POMDP.

Setting

Let X\mathbb XX (states), Y\mathbb YY (observations) and A\mathbb AA (actions) be Borel subsets of Polish spaces. Let P(dx′∣x,a)P(dx' \mid x, a)P(dx′∣x,a) be the transition kernel on X\mathbb XX given X×A\mathbb X \times \mathbb AX×A, Q(dy∣a,x)Q(dy \mid a, x)Q(dy∣a,x) the observation kernel on Y\mathbb YY given A×X\mathbb A \times \mathbb XA×X, and c:X×A→R∪{+∞}c : \mathbb X \times \mathbb A \to \mathbb R \cup \{+\infty\}c:X×A→R∪{+∞} a Borel one-step cost bounded below. P(X)\mathbb P(\mathbb X)P(X) is the set of probability measures on X\mathbb XX with the topology of weak convergence (∫f dμn→∫f dμ\int f\,d\mu_n \to \int f\,d\mu∫fdμn​→∫fdμ for bounded continuous fff). A sequence μn\mu_nμn​ converges setwise if μn(C)→μ(C)\mu_n(C) \to \mu(C)μn​(C)→μ(C) for every Borel CCC, and in the total variation if sup⁡f∣∫f dμn−∫f dμ∣→0\sup_f |\int f\,d\mu_n - \int f\,d\mu| \to 0supf​∣∫fdμn​−∫fdμ∣→0 over Borel fff with values in [−1,1][-1, 1][−1,1]. A kernel is weakly (setwise, total-variation) continuous if xn→xx_n \to xxn​→x implies the corresponding convergence of the measures.

For a belief z∈P(X)z \in \mathbb P(\mathbb X)z∈P(X) and an action aaa, let R(B×C∣z,a)=∫X∫BQ(C∣a,x′) P(dx′∣x,a) z(dx)R(B \times C \mid z, a) = \int_{\mathbb X} \int_B Q(C \mid a, x')\,P(dx' \mid x, a)\,z(dx)R(B×C∣z,a)=∫X​∫B​Q(C∣a,x′)P(dx′∣x,a)z(dx) be the joint law of the next state and observation (3.1), and R′(C∣z,a)=R(X×C∣z,a)R'(C \mid z, a) = R(\mathbb X \times C \mid z, a)R′(C∣z,a)=R(X×C∣z,a) its observation marginal (3.2). A filter is a kernel H(dx∣z,a,y)H(dx \mid z, a, y)H(dx∣z,a,y) with R(B×C∣z,a)=∫CH(B∣z,a,y) R′(dy∣z,a)R(B \times C \mid z, a) = \int_C H(B \mid z, a, y)\,R'(dy \mid z, a)R(B×C∣z,a)=∫C​H(B∣z,a,y)R′(dy∣z,a) (3.3): H(z,a,y)H(z, a, y)H(z,a,y) is the posterior after observing yyy. The belief MDP has state space P(X)\mathbb P(\mathbb X)P(X), action set A\mathbb AA, cost cˉ(z,a)=∫c(x,a) z(dx)\bar c(z, a) = \int c(x, a)\,z(dx)cˉ(z,a)=∫c(x,a)z(dx) (3.8), and transition q(⋅∣z,a)q(\cdot \mid z, a)q(⋅∣z,a), the law of H(z,a,y)H(z, a, y)H(z,a,y) when y∼R′(⋅∣z,a)y \sim R'(\cdot \mid z, a)y∼R′(⋅∣z,a) (3.5). A cost is K\mathbb KK-inf-compact on S1×S2\mathbb S_1 \times \mathbb S_2S1​×S2​ if its restriction to K×S2K \times \mathbb S_2K×S2​ has compact level sets for every compact K⊆S1K \subseteq \mathbb S_1K⊆S1​.

Formalization targets

Goal: Theorem 3.6

If either Assumption (D) (0≤α<10 \le \alpha < 10≤α<1) or Assumption (P) (c≥0c \ge 0c≥0 and 0≤α≤10 \le \alpha \le 10≤α≤1) holds, ccc is bounded below and K\mathbb KK-inf-compact on X×A\mathbb X \times \mathbb AX×A, PPP is weakly continuous and QQQ is continuous in the total variation, then the belief MDP satisfies Assumption (W*):

cˉ is bounded below and K-inf-compact on P(X)×A,(zn,an)→(z,a)  ⟹  q(⋅∣zn,an)→q(⋅∣z,a) weakly.\bar c \text{ is bounded below and } \mathbb K\text{-inf-compact on } \mathbb P(\mathbb X) \times \mathbb A, \qquad (z_n, a_n) \to (z, a) \implies q(\cdot \mid z_n, a_n) \to q(\cdot \mid z, a) \text{ weakly}.cˉ is bounded below and K-inf-compact on P(X)×A,(zn​,an​)→(z,a)⟹q(⋅∣zn​,an​)→q(⋅∣z,a) weakly.

The two halves

  • Cost half (Theorem 3.4, through Lemma 6.1 and Lemma 5.1(ii)): cˉ\bar ccˉ is bounded below by the same constant as ccc and K\mathbb KK-inf-compact.
  • Transition half (Theorem 3.7): under the hypotheses on PPP and QQQ, R′R'R′ is setwise continuous and Assumption (H) holds: whenever zn→zz_n \to zzn​→z and an→aa_n \to aan​→a, along a subsequence H(znk,ank,y)→H(z,a,y)H(z_{n_k}, a_{n_k}, y) \to H(z, a, y)H(znk​​,ank​​,y)→H(z,a,y) weakly for R′(⋅∣z,a)R'(\cdot \mid z, a)R′(⋅∣z,a)-almost every yyy. Theorem 3.5 then gives weak continuity of qqq. The route runs through Theorem 5.2, Lemma 5.3, Corollary 5.4, Theorem 5.5 and Lemma 5.6.

Significance

Theorem 3.6 supplies the hypothesis under which the cited general MDP theory gives stationary optimal policies, optimality equations and convergence of value iterations for total-cost POMDPs in terms of PPP, QQQ and ccc alone, without compactness of the action set, boundedness of the cost or continuity of the filter. It covers, for example, observation kernels with densities continuous in (a,x)(a, x)(a,x), and the paper applies it to inventory control with incomplete records and to the Kalman filter. Example 4.1 of the same paper shows that total-variation continuity of QQQ cannot be weakened to setwise continuity.

The result is proved in the paper; this proposal poses its formal statement and the supporting results as proof targets. Completing them would provide a checked bridge from POMDPs to the general MDP theory under weak continuity, together with reusable facts about weak, setwise and total-variation convergence: equicontinuity of integrals against weakly continuous kernels (Theorem 5.2), the convergence-in-probability criterion (Theorem 5.5), and the generalized Fatou lemmas.

Difficulty

The posterior H(z,a,y)H(z, a, y)H(z,a,y) is defined only for R′(⋅∣z,a)R'(\cdot \mid z, a)R′(⋅∣z,a)-almost every yyy and has no continuous version in general, so weak continuity of qqq cannot be read off from continuity of HHH. The tempting argument, that continuous PPP and QQQ make the Bayes posterior move continuously, fails: Y\mathbb YY need not be countable and QQQ need not have densities. What has to be controlled is the joint law RRR on sets (O1∖O2)×C(\mathcal O_1 \setminus \mathcal O_2) \times C(O1​∖O2​)×C uniformly in the observation set CCC; convergence for each fixed CCC is not enough. Turning this uniform control into almost-sure convergence of posteriors along a subsequence requires a diagonal argument over a countable base of X\mathbb XX. On the cost side, the difficulty is that ccc may take the value +∞+\infty+∞ and is not continuous; K\mathbb KK-inf-compactness has to be transported through integration against a weakly converging sequence of measures.

Formalization scope

All definitions live in FeinbergPOMDP.WStar.Model. X,Y,A\mathbb X, \mathbb Y, \mathbb AX,Y,A are separable metrizable spaces with their Borel σ-algebras (PolishSpace is not assumed, since Borel subsets of Polish spaces need not be Polish); X\mathbb XX is additionally nonempty and standard Borel in Theorems 3.6 and 3.7, where a filter must exist. P(X)\mathbb P(\mathbb X)P(X) is Mathlib's ProbabilityMeasure with the weak topology. All continuity notions are the paper's sequential ones; total variation is the supremum over Borel functions with values in [−1,1][-1, 1][−1,1], written in ε\varepsilonε–NNN form, while the set-indexed suprema of (5.15) and (5.17) keep their set form. The cost is written c=ℓ+fc = \ell + fc=ℓ+f with ℓ∈R\ell \in \mathbb Rℓ∈R and fff taking values in [0,∞][0, \infty][0,∞], so cˉ=ℓ+∫f dz\bar c = \ell + \int f\,dzcˉ=ℓ+∫fdz, exact even when c=+∞c = +\inftyc=+∞ on a set of positive measure. K\mathbb KK-inf-compactness is the published FeinbergLiang.ACOE.KInfCompact. A filter is a map H:P(X)→A→Y→P(X)H : \mathbb P(\mathbb X) \to \mathbb A \to \mathbb Y \to \mathbb P(\mathbb X)H:P(X)→A→Y→P(X) that satisfies (3.3) and is jointly Borel measurable in (z,a,y)(z,a,y)(z,a,y), as the paper's stochastic kernel is; qqq is the image of R′R'R′ under H(z,a,⋅)H(z, a, \cdot)H(z,a,⋅) for the Borel σ-algebra of the weak topology on P(X)\mathbb P(\mathbb X)P(X).

Since qqq does not depend on the choice of filter, every statement about qqq is made for every filter satisfying (3.3). A fixed filter that ignores the observation, such as H(z,a,y)=zH(z, a, y) = zH(z,a,y)=z, would make qqq a point mass and the weak continuity trivial; it satisfies (3.3) only when observations carry no information, and is excluded by quantifying over all filters.

The goal states the Assumption (W*) conclusion of Theorem 3.6. Its tail, "statements (i)–(vi) of Theorem 3.1 hold", invokes Theorem 2.1 of Feinberg et al. (2012) applied to the belief MDP; it is cited rather than proved in this paper. Generalized Fatou's lemmas 5.1(i) and 5.1(ii) are referenced from the published Schäl (1993) items. A complete development needs weak and setwise convergence on ProbabilityMeasure, portmanteau-type arguments, disintegration (Measure.condKernel) and the identification of the Borel and Giry σ-algebras on P(X)\mathbb P(\mathbb X)P(X); the last is missing from Mathlib and is a welcome contribution in its own right. Proofs of any milestone, and alternative arguments for Theorem 3.7, are welcome.

Selected references

  • E. A. Feinberg, P. O. Kasyanov, M. Z. Zgurovsky, Partially Observable Total-Cost Markov Decision Processes with Weakly Continuous Transition Probabilities, arXiv:1401.2168v2 (2014); Mathematics of Operations Research 41(2), 2016. https://arxiv.org/abs/1401.2168v2
  • E. A. Feinberg, P. O. Kasyanov, N. V. Zadoianchuk, Average-cost Markov decision processes with weakly continuous transition probabilities, Mathematics of Operations Research 37(4), 2012. https://doi.org/10.1287/moor.1120.0555
  • D. P. Bertsekas, S. E. Shreve, Stochastic Optimal Control: The Discrete-Time Case, Academic Press, 1978. https://web.mit.edu/dimitrib/www/soc.html
  • M. Schäl, Average optimality in dynamic programming with general state space, Mathematics of Operations Research 18(1), 1993. https://doi.org/10.1287/moor.18.1.163
14 thms0 active usersReviewed
Algorithmic Game TheoryFunctional Analysis·Captain: mikedeng1

Stochastic Graphon Games: I. The Static Case 1: If the State Map b Is Bounded and √c_z‖W‖ < 1, the Graphon Game Has at Least One Nash EquilibriumResearch Paper

Motivation

Games with many interacting players appear in economics, epidemiology and network engineering: firms competing in a market, individuals deciding whether to vaccinate, agents in a social network choosing an effort level. When every player interacts with every other player symmetrically, mean field game theory replaces the finite game by a limit with a continuum of players. Real interactions are rarely symmetric: who influences whom is described by a network, and large networks are described in the limit by a graphon (Lovász, Large networks and graph limits, 2012).

Graphon games combine the two ideas. Parise and Ozdaglar (2018) studied deterministic graphon games with continuous strategy sets. Carmona, Cooney, Graves and Laurière (2019) introduced idiosyncratic random shocks, giving a stochastic graphon game in which each player's state is perturbed by independent noise, and proved existence, uniqueness and stability of Nash equilibria as well as convergence of finite network games to the graphon limit. This mission formalizes their existence theorem (Theorem 3.15).

Setting

The players form the interval I=[0,1]I=[0,1]I=[0,1] with Lebesgue measure λI\lambda_IλI​. Each player x∈Ix\in Ix∈I chooses an action αx∈A=R\alpha_x\in A=\mathbb Rαx​∈A=R; a strategy profile is a function α∈L2(I)\alpha\in L^2(I)α∈L2(I), defined up to λI\lambda_IλI​-null sets.

A graphon is a symmetric, Borel-measurable function w:I×I→Rw:I\times I\to\mathbb Rw:I×I→R with ∫I×Iw(x,y)2 dx dy<∞\int_{I\times I}w(x,y)^2\,dx\,dy<\infty∫I×I​w(x,y)2dxdy<∞. It acts on L2(I)L^2(I)L2(I) through the graphon operator

[Wg]x=∫Iw(x,y) g(y) dy,∥W∥=sup⁡∥φ∥L2(I)=1∥Wφ∥L2(I).[\mathbf Wg]_x=\int_I w(x,y)\,g(y)\,dy,\qquad \|\mathbf W\|=\sup_{\|\varphi\|_{L^2(I)}=1}\|\mathbf W\varphi\|_{L^2(I)}.[Wg]x​=∫I​w(x,y)g(y)dy,∥W∥=∥φ∥L2(I)​=1sup​∥Wφ∥L2(I)​.

A state map b:R×R→Rb:\mathbb R\times\mathbb R\to\mathbb Rb:R×R→R and a noise law μ0\mu_0μ0​ on R\mathbb RR define the state Xα,z,ξ=b(α,z)+ξX_{\alpha,z,\xi}=b(\alpha,z)+\xiXα,z,ξ​=b(α,z)+ξ of a player who takes action α\alphaα, feels aggregate zzz, and receives shock ξ∼μ0\xi\sim\mu_0ξ∼μ0​. Assumption 1 asks that ∣b(α,z)−b(α′,z′)∣2≤cα∣α−α′∣2+cz∣z−z′∣2|b(\alpha,z)-b(\alpha',z')|^2\le c_\alpha|\alpha-\alpha'|^2+c_z|z-z'|^2∣b(α,z)−b(α′,z′)∣2≤cα​∣α−α′∣2+cz​∣z−z′∣2 and that μ0\mu_0μ0​ has mean zero and a finite second moment.

The aggregate Zα\mathbf Z\alphaZα felt by the players under a profile α\alphaα is the solution z∈L2(I)z\in L^2(I)z∈L2(I) of

zx=∫Iw(x,y) b(αy,zy) dyfor λI-a.e. x.(6)z_x=\int_I w(x,y)\,b(\alpha_y,z_y)\,dy\qquad\text{for }\lambda_I\text{-a.e. }x.\tag{6}zx​=∫I​w(x,y)b(αy​,zy​)dyfor λI​-a.e. x.(6)

A player choosing α\alphaα against aggregate zzz pays J(α,z)=∫f(b(α,z)+ξ,α,z) μ0(dξ)J(\alpha,z)=\int f(b(\alpha,z)+\xi,\alpha,z)\,\mu_0(d\xi)J(α,z)=∫f(b(α,z)+ξ,α,z)μ0​(dξ). Assumption 4 asks that J(⋅,z)J(\cdot,z)J(⋅,z) be continuously differentiable and ℓc\ell_cℓc​-strongly convex uniformly in zzz, and that ∂αJ\partial_\alpha J∂α​J be ℓJ\ell_JℓJ​-Lipschitz in zzz. Assumption 5 asks that bbb be bounded: ∣b(α,z)∣≤c0|b(\alpha,z)|\le c_0∣b(α,z)∣≤c0​ for some finite c0>0c_0>0c0​>0. The best response [Bz]x[\mathbf Bz]_x[Bz]x​ is the unique minimizer of α↦J(α,zx)\alpha\mapsto J(\alpha,z_x)α↦J(α,zx​).

A Nash equilibrium is a profile α^∈L2(I)\hat\alpha\in L^2(I)α^∈L2(I) such that, for λI\lambda_IλI​-a.e. player xxx and every action β\betaβ,

J(α^x,(Zα^)x)≤J(β,(Zα^)x).J(\hat\alpha_x,(\mathbf Z\hat\alpha)_x)\le J(\beta,(\mathbf Z\hat\alpha)_x).J(α^x​,(Zα^)x​)≤J(β,(Zα^)x​).

Formalization targets

Goal: Theorem 3.15 (existence)

Assumptions 1, 4, 5 and cz ∥W∥<1 ⟹ there is at least one Nash equilibrium.\text{Assumptions 1, 4, 5 and }\sqrt{c_z}\,\|\mathbf W\|<1\ \Longrightarrow\ \text{there is at least one Nash equilibrium.}Assumptions 1, 4, 5 and cz​​∥W∥<1 ⟹ there is at least one Nash equilibrium.

The statement fixes no constants and asserts no uniqueness.

Milestones

  1. Proposition 3.1: under cz∥W∥<1\sqrt{c_z}\|\mathbf W\|<1cz​​∥W∥<1, (6) has a unique solution in L2(I)L^2(I)L2(I) for every α∈L2(I)\alpha\in L^2(I)α∈L2(I).
  2. Lemma 3.7: ∥Bz1−Bz2∥L2≤(ℓJ/ℓc)∥z1−z2∥L2\|\mathbf Bz^1-\mathbf Bz^2\|_{L^2}\le(\ell_J/\ell_c)\|z^1-z^2\|_{L^2}∥Bz1−Bz2∥L2​≤(ℓJ​/ℓc​)∥z1−z2∥L2​.
  3. Lemma 3.16, (15): ∥Zα1−Zα2∥L2≤cα∥W∥1−cz∥W∥∥α1−α2∥L2\|\mathbf Z\alpha^1-\mathbf Z\alpha^2\|_{L^2}\le\dfrac{\sqrt{c_\alpha}\|\mathbf W\|}{1-\sqrt{c_z}\|\mathbf W\|}\|\alpha^1-\alpha^2\|_{L^2}∥Zα1−Zα2∥L2​≤1−cz​​∥W∥cα​​∥W∥​∥α1−α2∥L2​.
  4. Proof of Theorem 3.15, first claim: with χ=c0\chi=c_0χ=c0​ and Bχ={g∈L2(I):∥g∥≤χ}B_\chi=\{g\in L^2(I):\|g\|\le\chi\}Bχ​={g∈L2(I):∥g∥≤χ}, every aggregate lies in W(Bχ)\mathbf W(B_\chi)W(Bχ​).
  5. Proof of Theorem 3.15, second claim: W(Bχ)\mathbf W(B_\chi)W(Bχ​) is relatively compact in L2(I)L^2(I)L2(I).

Significance

The existence theorem holds under mild hypotheses: unlike the uniqueness result of the same paper (Proposition 3.17), it needs no smallness condition linking ℓJ/ℓc\ell_J/\ell_cℓJ​/ℓc​, cαc_\alphacα​ and ∥W∥\|\mathbf W\|∥W∥. Boundedness of the state map takes its place. Existence of a graphon equilibrium is the starting point for the paper's §4, where graphon equilibria are shown to be limits of equilibria of finite network games and to yield ϵ\epsilonϵ-Nash equilibria for them.

The result is proved in the paper; no part of it is machine-checked. A complete formalization yields reusable pieces beyond this mission: square-integrable kernel operators on L2[0,1]L^2[0,1]L2[0,1] with their operator norm, the Hilbert–Schmidt compactness of such operators, Lipschitz dependence of minimizers of uniformly strongly convex functions on a parameter, and Schauder's fixed-point theorem on a Banach space, which is not in Mathlib.

Difficulty

A contraction argument does not apply: the best-response-of-aggregate map BZ\mathbf B\mathbf ZBZ is Lipschitz with constant ℓJℓc⋅cα∥W∥1−cz∥W∥\frac{\ell_J}{\ell_c}\cdot\frac{\sqrt{c_\alpha}\|\mathbf W\|}{1-\sqrt{c_z}\|\mathbf W\|}ℓc​ℓJ​​⋅1−cz​​∥W∥cα​​∥W∥​, which may exceed 111 under the hypotheses of the theorem. Existence therefore rests on a compactness fixed-point theorem in the infinite-dimensional space L2(I)L^2(I)L2(I). That requires compactness of the integral operator W\mathbf WW, which Mathlib does not provide for kernel operators, and Schauder's theorem itself, which Mathlib does not have. A bounded convex set in L2(I)L^2(I)L2(I) is not compact, so Brouwer-type finite-dimensional arguments do not transfer directly.

Formalization scope

All statements live in the namespace GraphonGames.Existence and share one definitions file.

  • III is Mathlib's unitInterval with volume. Profiles and aggregates are functions I→RI\to\mathbb RI→R with MemLp _ 2 volume; equalities between them are almost-everywhere equalities.
  • The action set is R\mathbb RR.
  • ∥W∥\|\mathbf W\|∥W∥ is the supremum, in [0,∞][0,\infty][0,∞], of ∥Wφ∥L2\|\mathbf W\varphi\|_{L^2}∥Wφ∥L2​ over ∥φ∥L2=1\|\varphi\|_{L^2}=1∥φ∥L2​=1; the graphon condition makes it finite, and the hypothesis cz∥W∥<1\sqrt{c_z}\|\mathbf W\|<1cz​​∥W∥<1 uses its real value.
  • The aggregate is a predicate: zzz is an aggregate of α\alphaα when z∈L2(I)z\in L^2(I)z∈L2(I) and (6) holds a.e. Remark 3.3's identity Zα=W[b(α,Zα)]\mathbf Z\alpha=\mathbf W[b(\alpha,\mathbf Z\alpha)]Zα=W[b(α,Zα)] is then the definition itself, the noise having mean zero.
  • The best response is a choice of minimizer, which exists and is unique under Assumption 4.
  • Pinned definition. The paper defines equilibrium (Definition 3.4) as a fixed point of a best response built on a rich Fubini extension, and states in Proposition 3.6 that under Assumption 4 this is equivalent to the a.e. best-response inequality above. The formalization takes that inequality as the definition. Fubini extensions and the exact law of large numbers (Proposition 3.2) are not formalized.
  • Norm inequalities are stated in [0,∞][0,\infty][0,∞], so an infinite left-hand side cannot make a bound vacuous.

Trivializing encodings are excluded: the operator norm is not a real supremum that could collapse to 000; an equilibrium must come with its aggregate solving (6), be square-integrable, and beat every action β∈R\beta\in\mathbb Rβ∈R for almost every player; and no norm is converted to a real number where it could be infinite.

The results of §4 (Theorems 4.3, 4.7, 4.9 on finite network games) and the uniqueness and stability results (Proposition 3.17, Theorem 3.20) are not posed in this mission. Contributions welcome include Schauder's fixed-point theorem, the compactness of Hilbert–Schmidt integral operators on L2L^2L2, and the contraction argument behind Proposition 3.1.

Selected references

  • R. Carmona, D. B. Cooney, C. V. Graves, M. Laurière, Stochastic Graphon Games: I. The Static Case, arXiv:1911.10664v1, 2019; Mathematics of Operations Research 47(1), 2022. https://arxiv.org/abs/1911.10664
  • F. Parise, A. Ozdaglar, Graphon games, arXiv:1802.00080, 2018. https://arxiv.org/abs/1802.00080
  • L. Lovász, Large Networks and Graph Limits, AMS Colloquium Publications 60, 2012. https://doi.org/10.1090/coll/060
  • R. Carmona, F. Delarue, Probabilistic Theory of Mean Field Games with Applications I, Springer, 2018. https://doi.org/10.1007/978-3-319-58920-6
7 thms0 active usersReviewed
OptimizationProbabilityStatistics·Captain: mikedeng1

Recovering Best Statistical Guarantees via the Empirical Divergence-Based Distributionally Robust Optimization 2: Empirical Burg-Ball DRO Bounds Converge Almost Surely to E[h(x;ξ)]Research Paper

Motivation

Many stochastic optimization models contain an expected-value constraint

Z0(x)=E0[h(x;ξ)]≤0,Z_0(x)=E_0[h(x;\xi)]\le 0,Z0​(x)=E0​[h(x;ξ)]≤0,

where ξ\xiξ is a random object with unknown law P0P_0P0​, xxx is a decision and hhh is a known loss. When P0P_0P0​ is known only through an i.i.d. sample ξ1,…,ξn\xi_1,\dots,\xi_nξ1​,…,ξn​, data-driven distributionally robust optimization (DRO) replaces E0E_0E0​ by the worst case over a ball of distributions around the data. H. Lam, Recovering Best Statistical Guarantees via the Empirical Divergence-Based Distributionally Robust Optimization (arXiv:1605.09349v1, 2016; Operations Research 67(4), 2019), studies a ball of reweightings of the sample itself, measured by the Burg entropy, and links its radius to empirical likelihood (Owen 2001).

Lam's Theorem 2 shows that, for a fixed decision xxx, the minimum and maximum of Ew[h(x;ξ)]E_w[h(x;\xi)]Ew​[h(x;ξ)] over this ball bracket Z0(x)Z_0(x)Z0​(x) with probability tending to 1−α1-\alpha1−α when the radius is χ1,1−α2/(2n)\chi^2_{1,1-\alpha}/(2n)χ1,1−α2​/(2n). Theorem 3, the goal of this mission, complements it: the two bounds also converge almost surely to Z0(x)Z_0(x)Z0​(x). A confidence statement says the robust bounds are rarely wrong; consistency says they are eventually tight, so that the robust constraint does not stay conservative as data accumulate.

This mission is the second of a three-mission series on the pointwise theory of the paper (1: coverage, Theorem 2; 3: reduction to a Burg ball on a finite support, Proposition 1).

Setting

Let ξ1,ξ2,…\xi_1,\xi_2,\dotsξ1​,ξ2​,… be i.i.d. random elements of a measurable space Ξ\XiΞ with law P0P_0P0​. Fix a decision x∈Rmx\in\mathbb R^mx∈Rm and write Z0(x)=E0[h(x;ξ)]Z_0(x)=E_0[h(x;\xi)]Z0​(x)=E0​[h(x;ξ)].

The Burg generator is ϕ(t)=−log⁡t+t−1\phi(t)=-\log t+t-1ϕ(t)=−logt+t−1 for t>0t>0t>0 and ϕ(t)=+∞\phi(t)=+\inftyϕ(t)=+∞ for t≤0t\le0t≤0. The empirical Burg-entropy divergence ball of radius η\etaη is the set of weight vectors

Un(η)={w∈Rn: −1n∑i=1nlog⁡(nwi)≤η, ∑i=1nwi=1, wi≥0}.\mathcal U_n(\eta)=\Big\{w\in\mathbb R^n:\ -\frac1n\sum_{i=1}^n\log(nw_i)\le\eta,\ \sum_{i=1}^nw_i=1,\ w_i\ge0\Big\}.Un​(η)={w∈Rn: −n1​i=1∑n​log(nwi​)≤η, i=1∑n​wi​=1, wi​≥0}.

On the simplex, −1n∑ilog⁡(nwi)=1n∑iϕ(nwi)-\frac1n\sum_i\log(nw_i)=\frac1n\sum_i\phi(nw_i)−n1​∑i​log(nwi​)=n1​∑i​ϕ(nwi​), the ϕ\phiϕ-divergence of www from the uniform weights.

Let 0<α<10<\alpha<10<α<1 and let q=χ1,1−α2q=\chi^2_{1,1-\alpha}q=χ1,1−α2​ be the (1−α)(1-\alpha)(1−α)-quantile of the χ12\chi^2_1χ12​ distribution. The lower and upper empirical DRO values are

Z‾n(x)=min⁡w∈Un(q/(2n))∑i=1nh(x;ξi)wi,Z‾n(x)=max⁡w∈Un(q/(2n))∑i=1nh(x;ξi)wi.\underline Z_n(x)=\min_{w\in\mathcal U_n(q/(2n))}\sum_{i=1}^nh(x;\xi_i)w_i,\qquad \overline Z_n(x)=\max_{w\in\mathcal U_n(q/(2n))}\sum_{i=1}^nh(x;\xi_i)w_i.Z​n​(x)=w∈Un​(q/(2n))min​i=1∑n​h(x;ξi​)wi​,Zn​(x)=w∈Un​(q/(2n))max​i=1∑n​h(x;ξi​)wi​.

The proof works with the centred observations h~i=h(x;ξi)−Z0(x)\tilde h_i=h(x;\xi_i)-Z_0(x)h~i​=h(x;ξi​)−Z0​(x).

Formalization targets

Goal: Theorem 3 (p. 12)

Under the conditions of Theorem 2 (0<Var0(h(x;ξ))<∞0<\mathrm{Var}_0(h(x;\xi))<\infty0<Var0​(h(x;ξ))<∞, Z0(x)Z_0(x)Z0​(x) finite),

Z‾n(x)→a.s.Z0(x)andZ‾n(x)→a.s.Z0(x)(n→∞).\underline Z_n(x)\xrightarrow{a.s.}Z_0(x)\quad\text{and}\quad\overline Z_n(x)\xrightarrow{a.s.}Z_0(x)\qquad(n\to\infty).Z​n​(x)a.s.​Z0​(x)andZn​(x)a.s.​Z0​(x)(n→∞).

Milestones (the steps of the printed proof, at a single decision)

  1. Lemma 3 (p. 38, Owen's Lemma 11.2): for i.i.d. YiY_iYi​ with EYi2<∞EY_i^2<\inftyEYi2​<∞, max⁡1≤i≤n∣Yi∣=o(n1/2)\max_{1\le i\le n}|Y_i|=o(n^{1/2})max1≤i≤n​∣Yi​∣=o(n1/2) a.s.
  2. (75)–(76) (p. 33): the Lagrangian dual
Z‾n(x)−Z0(x)=min⁡λ≥0,γ −∑i=1nλnlog⁡(1−h~i+γλ)+λq2n−γ,\overline Z_n(x)-Z_0(x)=\min_{\lambda\ge0,\gamma}\ -\sum_{i=1}^n\frac{\lambda}{n}\log\Big(1-\frac{\tilde h_i+\gamma}{\lambda}\Big)+\lambda\frac{q}{2n}-\gamma ,Zn​(x)−Z0​(x)=λ≥0,γmin​ −i=1∑n​nλ​log(1−λh~i​+γ​)+λ2nq​−γ,

with the printed conventions at λ=0\lambda=0λ=0 and for arguments outside the domain of the logarithm. 3. The elementary inequality (p. 34): −log⁡(1−t)≤t+2t2-\log(1-t)\le t+2t^2−log(1−t)≤t+2t2 for ∣t∣≤1/2|t|\le1/2∣t∣≤1/2. 4. (77) (p. 34): if max⁡i∣h~i∣≤λ/2\max_i|\tilde h_i|\le\lambda/2maxi​∣h~i​∣≤λ/2 with λ>0\lambda>0λ>0, then

Z‾n(x)−Z0(x)≤1n∑i=1nh~i+2(1/n)∑ih~i2λ+λq2n.\overline Z_n(x)-Z_0(x)\le\frac1n\sum_{i=1}^n\tilde h_i+2\frac{(1/n)\sum_i\tilde h_i^2}{\lambda}+\lambda\frac{q}{2n}.Zn​(x)−Z0​(x)≤n1​i=1∑n​h~i​+2λ(1/n)∑i​h~i2​​+λ2nq​.
  1. The uniform-weight lower bound (p. 34): Z‾n(x)−Z0(x)≥1n∑ih~i\overline Z_n(x)-Z_0(x)\ge\frac1n\sum_i\tilde h_iZn​(x)−Z0​(x)≥n1​∑i​h~i​.

Milestones 2, 4 and 5 are deterministic statements about an arbitrary data vector; only Lemma 3 and the goal are probabilistic.

Significance

The result. Theorem 3 shows that the empirical DRO with the χ12\chi^2_1χ12​ calibration is a consistent estimator of the constraint function at every fixed decision, not only a confidence bound. Together with Theorem 2 it places the empirical Burg-ball DRO on the same footing as the classical normal-approximation confidence interval: correct asymptotic coverage and shrinkage to the truth. The deterministic bounds (76)–(77) are also reusable on their own: they control the worst-case reweighting of any finite sample by its first two empirical moments.

Formalizing it. The theorem is proved in the paper; no machine-checked proof is known. The mission asks for a formal proof of the printed argument, specialized to one decision. A closely related open target exists on the platform: GenEmpLik.Expansion.lemma_1 (Duchi, Glynn and Namkoong) states the expansion of the robust mean, sample mean plus ρsn2/n+o(n−1/2)\sqrt{\rho s_n^2/n}+o(n^{-1/2})ρsn2​/n​+o(n−1/2), for a smooth generator class under stationary ergodic data. Combined with the strong law it would give the upper half of Theorem 3, but it is a different statement with different hypotheses and is itself unproved, so it is not used as a milestone here.

Difficulty

The tempting argument, "the ball shrinks to the empirical distribution and the empirical mean converges", does not close by itself: h(x;ξ)h(x;\xi)h(x;ξ) is only square integrable, not bounded, and the maximizing weight shifts mass towards the largest observations, so the gap Z‾n(x)−1n∑ih(x;ξi)\overline Z_n(x)-\frac1n\sum_ih(x;\xi_i)Zn​(x)−n1​∑i​h(x;ξi​) has to be controlled against the extremes of the sample rather than by the size of the ball alone. The printed proof routes this through the convex dual (76). That step needs a constraint qualification, the conjugate of the Burg generator with its boundary conventions (an infinite value outside the domain of the logarithm, and the degenerate multiplier λ=0\lambda=0λ=0), and a choice of multiplier that dominates every centred observation while still letting all three terms of (77) vanish. The almost-sure statement then combines Lemma 3 with two strong laws on one event of full probability.

Formalization scope

  • Data. The sample ξ1,…,ξn\xi_1,\dots,\xi_nξ1​,…,ξn​ is ξ 0, …, ξ (n-1): a sequence of measurable maps that is independent (iIndepFun) and identically distributed (IdentDistrib with ξ 0). Z0(x)Z_0(x)Z0​(x) is the Bochner integral of h x ∘ ξ 0, and the moment conditions are MemLp (h x ∘ ξ 0) 2 (finite mean and variance) together with positive variance, which makes the integral the true mean.
  • Decision. The paper's x∈Θ⊂Rmx\in\Theta\subset\mathbb R^mx∈Θ⊂Rm is an arbitrary point of EuclideanSpace ℝ (Fin m); Θ\ThetaΘ plays no role in a pointwise statement and is dropped.
  • Quantile. qqq is pinned by N(0,1){y:y2≤q}=1−α\mathcal N(0,1)\{y:y^2\le q\}=1-\alphaN(0,1){y:y2≤q}=1−α, which determines it uniquely. The radius q/(2n)q/(2n)q/(2n) is passed as ρ=q/2\rho=q/2ρ=q/2 to the published GenEmpLik.Expansion.robustMean, whose ball has radius ρ/n\rho/nρ/n.
  • Values. Z‾n\overline Z_nZn​ is robustMean burg (q/2); Z‾n\underline Z_nZ​n​ is robustLower burg (q/2) from the frozen shared EmpiricalDRO.Coverage.Setting module, a real infimum over the same published ball (PhiDivRobust.Counterpart.probUncertaintySet). For n≥1n\ge1n≥1 the value sets are nonempty and bounded, so the real sSup/sInf are the attained maximum and minimum.
  • Divergence. burg is valued in EReal with +∞+\infty+∞ for t≤0t\le0t≤0, so a zero weight is excluded from the ball by an infinite divergence and never by a junk value of Real.log. The dual summand dualTerm is EReal-valued with the printed conventions: +∞+\infty+∞ for t≥λ>0t\ge\lambda>0t≥λ>0; 000 or +∞+\infty+∞ at λ=0\lambda=0λ=0.
  • Generalizations, disclosed. The deterministic milestones hold for every data vector; (76) is stated for every q>0q>0q>0 (the Slater point needs q>0q>0q>0), (77) for every λ>0\lambda>0λ>0 satisfying the hypothesis, and the uniform-weight bound for every radius ρ≥0\rho\ge0ρ≥0. In the goal, positive variance and the value of α\alphaα are kept as printed although the conclusion does not need them.
  • Ruled out. Junk logarithms at zero weights, a junk sSup/sInf of an empty value set, a free radius detached from the χ12\chi^2_1χ12​ quantile, and a dropped variance condition are all excluded by the encoding above. The paper's printed (75) writes Z‾n(x)\overline Z_n(x)Zn​(x) where its radius qn/(2n)q_n/(2n)qn​/(2n) makes it Z‾n∗(x)\overline Z^*_n(x)Zn∗​(x); at a single decision the two coincide.
  • Not posed. The paper's headline result, Theorem 4 (uniform coverage over Θ\ThetaΘ with a χ2\chi^2χ2-process quantile qnq_nqn​), and the uniform statements Theorems 5–7 need Donsker and Glivenko–Cantelli classes, weak convergence in ℓ∞(Θ)\ell^\infty(\Theta)ℓ∞(Θ) and conditional quantiles of Gaussian-process suprema, none of which has library support yet; they are left out.
  • Reuse. Lemma 3 for nonnegative variables is the proved platform theorem NumStochOpt.ListScheduling.lemma_8_1_i_max_over_sqrt_ae, included as a reference. Mathlib's ProbabilityTheory.strong_law_ae supplies the laws of large numbers. Contributions welcome: the duality (76) for general ϕ\phiϕ-divergence balls, and the deterministic bound (77).

Selected references

  • H. Lam, Recovering Best Statistical Guarantees via the Empirical Divergence-Based Distributionally Robust Optimization, arXiv:1605.09349v1, 2016; Operations Research 67(4), 2019. https://arxiv.org/abs/1605.09349v1 , https://doi.org/10.1287/opre.2018.1786
  • A. B. Owen, Empirical Likelihood, Chapman & Hall/CRC, 2001. https://doi.org/10.1201/9781420036152
  • A. Ben-Tal, D. den Hertog, A. De Waegenaere, B. Melenberg, G. Rennen, Robust solutions of optimization problems affected by uncertain probabilities, Management Science 59(2), 2013. https://doi.org/10.1287/mnsc.1120.1641
  • J. C. Duchi, P. W. Glynn, H. Namkoong, Statistics of robust optimization: a generalized empirical likelihood approach, Mathematics of Operations Research 46(3), 2021. https://arxiv.org/abs/1610.03425
13 thms0 active usersReviewed
OptimizationProbabilityStatistics·Captain: mikedeng1

Recovering Best Statistical Guarantees via the Empirical Divergence-Based Distributionally Robust Optimization 3: On a Finite Support the Empirical DRO Equals the Burg-Divergence DRO with χ²₁ RadiusResearch Paper

Motivation

Distributionally robust optimization (DRO) evaluates a decision against a collection of probability distributions near an empirical one. In a finite scenario model, the familiar construction puts a divergence ball around the histogram of observed scenarios. Lam's empirical construction instead gives one weight to each observation, even when several observations have the same value. The distinction matters because a sample can contain repeated values and can omit some points of the stated support. The paper uses a Burg-entropy ball on those observation weights to recover statistical guarantees for an expected loss, despite the empirical ball having low probability of containing the true distribution. Lam, §§2.1–2.3, pp. 5–9.

Proposition 1 identifies what this observation-level construction becomes when the random quantity has finite support: its lower and upper DRO values coincide with values from a Burg-divergence ball on the support histogram. This links a method defined on individual data points to the standard finite-scenario formulation. The radius uses a one-degree-of-freedom chi-square quantile because the paper calibrates an expected value at a fixed decision; it does not use the k−1k-1k−1 degrees of freedom associated with estimating a full kkk-point distribution. Lam, Proposition 1, p. 11, and the discussion on pp. 8–9.

Setting

Fix a decision xxx and a real loss h(x;si)h(x;s_i)h(x;si​) at each of kkk support points s1,…,sks_1,\ldots,s_ks1​,…,sk​. A sample of size nnn has an assignment c(j)c(j)c(j) telling which support point produced observation jjj. Write nin_ini​ for the number of assignments to point iii and p^i=ni/n\hat p_i=n_i/np^​i​=ni​/n for the empirical histogram. The support points need not all appear in the sample. The decision and loss only determine a finite vector of loss values; no probability space is needed for this deterministic comparison. Lam, §2.1, p. 6, and Proposition 1, p. 11.

The empirical Burg ball Un(η)\mathcal U_n(\eta)Un​(η) consists of observation weights w1,…,wnw_1,\ldots,w_nw1​,…,wn​ that are nonnegative, sum to one, and obey −n−1∑jlog⁡(nwj)≤η-n^{-1}\sum_j\log(nw_j)\le\eta−n−1∑j​log(nwj​)≤η. The support Burg ball UBurg′(η)\mathcal U'_{\mathrm{Burg}}(\eta)UBurg′​(η) consists of support weights p1,…,pkp_1,\ldots,p_kp1​,…,pk​ that are nonnegative, sum to one, are absolutely continuous with respect to p^\hat pp^​, and obey −∑ip^ilog⁡(pi/p^i)≤η-\sum_i\hat p_i\log(p_i/\hat p_i)\le\eta−∑i​p^​i​log(pi​/p^​i​)≤η. At an observed point, finite Burg divergence requires pi>0p_i>0pi​>0; at an unobserved point, absolute continuity requires pi=0p_i=0pi​=0. Lam, (13)–(15), pp. 5–6; (19), p. 8; (28), p. 11.

For a support weight vector ppp, the expected loss is ∑ipih(x;si)\sum_i p_i h(x;s_i)∑i​pi​h(x;si​). For an observation weight vector www, it is ∑jwjh(x;sc(j))\sum_j w_j h(x;s_{c(j)})∑j​wj​h(x;sc(j)​). The empirical lower and upper values are the minimum and maximum over Un(η)\mathcal U_n(\eta)Un​(η); the support values use UBurg′(η)\mathcal U'_{\mathrm{Burg}}(\eta)UBurg′​(η). The same empirical ball is used for both bounds. Lam, (26)–(28), p. 11.

Formalization targets

The goal is Proposition 1. For every n>0n>0n>0, every assignment of the sample to finite support points, every fixed decision xxx, and every κ≥0\kappa\ge0κ≥0, set η=κ/(2n)\eta=\kappa/(2n)η=κ/(2n). Then

min⁡w∈Un(η)∑j=1nwjh(x;sc(j))=min⁡p∈UBurg′(η)∑i=1kpih(x;si),\min_{w\in\mathcal U_n(\eta)}\sum_{j=1}^n w_jh(x;s_{c(j)}) =\min_{p\in\mathcal U'_{\mathrm{Burg}}(\eta)}\sum_{i=1}^k p_ih(x;s_i),w∈Un​(η)min​j=1∑n​wj​h(x;sc(j)​)=p∈UBurg′​(η)min​i=1∑k​pi​h(x;si​), max⁡w∈Un(η)∑j=1nwjh(x;sc(j))=max⁡p∈UBurg′(η)∑i=1kpih(x;si).\max_{w\in\mathcal U_n(\eta)}\sum_{j=1}^n w_jh(x;s_{c(j)}) =\max_{p\in\mathcal U'_{\mathrm{Burg}}(\eta)}\sum_{i=1}^k p_ih(x;s_i).w∈Un​(η)max​j=1∑n​wj​h(x;sc(j)​)=p∈UBurg′​(η)max​i=1∑k​pi​h(x;si​).

The printed proposition takes κ=χ1,1−α2\kappa=\chi^2_{1,1-\alpha}κ=χ1,1−α2​. The deterministic identity holds at every nonnegative κ\kappaκ, including zero. The two milestones record the source proof's statements that a feasible support vector gives a feasible observation vector with the same objective value, and conversely that a feasible observation vector gives a feasible support vector with the same objective value. Lam, Proposition 1, p. 11, proof p. 24.

Significance

The identity lets a finite-support user compute the empirical DRO values with one variable per distinct support point instead of one per observation, without changing either bound. It also shows precisely how Lam's empirical calibration relates to a conventional histogram-based divergence model: the ambiguity sets have different coordinates, but the resulting extrema of any loss constant on each class agree. This is the finite-support interpretation stated immediately after Theorem 2, and it explains the radius comparison on pp. 8–9. Lam, pp. 8–9 and Proposition 1, p. 11.

The result is proved in the paper; the remaining task is a machine-checked proof of the two transformations and the equality of extrema. The published formal library already contains the observation-level ϕ\phiϕ-divergence ball and its robust upper mean, and a shared setting supplies the Burg generator and lower empirical value. This mission adds the support histogram, its Burg ball, and the bridge between the two representations. Those definitions and transformations can also be reused for other finite-support losses. The paper's separate pointwise coverage and consistency results are goals of other missions in this series. Lam, Theorems 2–3 and Proposition 1, pp. 11–12.

Difficulty

Repeated observations make the two weight spaces different: the empirical problem has nnn coordinates and the support problem has kkk. Simply identifying coordinates loses multiplicities in both the normalization and the logarithmic divergence. Empty classes create a second boundary case, since no observation weight can be assigned to an unobserved support point. A statement that silently permits such mass changes the support optimization value. The full reduction must preserve feasible objective values in both directions, for the lower and upper extrema. Lam, proof of Proposition 1, p. 24.

Formalization scope

Lean uses Fin n for observations and Fin k for support points, with zero-based indices, a class map ccc, real loss values, and the paper's Burg generator valued in EReal. Nonpositive likelihood ratios receive +∞+\infty+∞. The empirical ball reuses the published PhiDivRobust.Counterpart.probUncertaintySet; its upper value is the published GenEmpLik.Expansion.robustMean. The lower value is a real infimum over the same ball. The condition n>0n>0n>0 and the nonnegative radius make both feasible value sets nonempty and bounded, so the real infimum and supremum mean the paper's minimum and maximum. The histogram can have zero entries. Lam, (19), (26)–(28), pp. 8, 11.

Display (28) omits a condition from the preceding definition of a divergence ball: ppp must be absolutely continuous with respect to p^\hat pp^​. Without it, an unobserved support point can receive positive mass and Proposition 1 is false. The formal support ball includes p^i=0⇒pi=0\hat p_i=0\Rightarrow p_i=0p^​i​=0⇒pi​=0 from (13)–(14). It also requires pi>0p_i>0pi​>0 where p^i>0\hat p_i>0p^​i​>0, because Lean's real logarithm returns zero at zero whereas the paper's Burg divergence is infinite there. These conditions, together with n>0n>0n>0, exclude trivial values from empty balls, division by zero, and logarithms at invalid weights. The decision set Θ\ThetaΘ is omitted because the paper fixes one xxx and the result holds for every such xxx. Lam, (13)–(14), pp. 5–6, and (28), p. 11.

The development needs finite-sum identities, elementary properties of the probability simplex, the logarithm's concavity, and bounds on the extrema of bounded nonempty finite-dimensional value sets. Contributions that establish the two direction statements, or reusable facts about aggregation of finite probability weights, directly advance this mission. The paper's uniform calibration theorem, Theorem 4, is outside this scope: it needs a Donsker class, a data-dependent chi-square process, and its supremum quantile, none of which enters Proposition 1. Lam, Theorem 4, pp. 13–14.

Selected references

  • Henry Lam, Recovering Best Statistical Guarantees via the Empirical Divergence-Based Distributionally Robust Optimization, arXiv:1605.09349v1, 2016; published in Operations Research 67(4), 2019. arXiv, DOI.
8 thms0 active usersReviewed
Algorithmic Game TheoryProbability·Captain: mikedeng1

Prophet Inequalities Made Easy: Stochastic Optimization by Pricing Nonstochastic Inputs II: Posted Expected Weakly (α, β₁, β₂)-Balanced Prices Earn 1/(α(2β₁ + 4β₂)) of the Expected Welfare of ALGResearch Paper

Motivation

A prophet inequality compares an online decision maker, who sees random inputs one at a time and must commit irrevocably, with a "prophet" who sees all inputs in advance. The classic single-item version (Krengel–Sucheston, Samuel-Cahn) says that a well-chosen fixed threshold earns at least half of the expected maximum. In mechanism design the same statement reads: a posted-price mechanism, which offers each arriving buyer a take-it-or-leave-it menu of prices, extracts a constant fraction of the optimal expected welfare, and does so in a way that is truthful, simple and order oblivious.

Dütting, Feldman, Kesselheim and Lucier (SIAM J. Comput. 49 (2020)) reduce the construction of such prices to a deterministic question. If, for every fixed valuation profile vvv, one can find prices pvp^vpv that are balanced — high enough to pay for the welfare an early allocation destroys, low enough that whatever is still feasible stays affordable — then the expected prices Ev~[pv~]\mathbb E_{\tilde v}[p^{\tilde v}]Ev~​[pv~], suitably scaled, give a prophet inequality. This is their Theorem 3.2 for (α,β)(\alpha,\beta)(α,β)-balanced prices. For combinatorial auctions with bundles of size at most ddd, MPH-kkk valuations and related settings, the natural prices only satisfy a weaker condition, in which the affordability bound may also spend a multiple of the benchmark welfare. Theorem 3.5, the subject of this mission, is the extension theorem for that weak balancedness; it is what turns the paper's Theorem 4.1 (bundle size ddd) and Theorem 1.6 (MPH-kkk) into O(d)O(d)O(d)- and O(k)O(k)O(k)-approximate posted-price mechanisms.

Setting

There are nnn agents N={1,…,n}N=\{1,\dots,n\}N={1,…,n}. Agent iii has an outcome space XiX_iXi​ containing a null outcome ∅\emptyset∅; outcome profiles are x∈X=X1×⋯×Xnx\in X=X_1\times\cdots\times X_nx∈X=X1​×⋯×Xn​. For S⊆NS\subseteq NS⊆N, xSx_SxS​ gives xix_ixi​ to the agents in SSS and ∅\emptyset∅ to the others, and x[i−1]x_{[i-1]}x[i−1]​ keeps only the agents before iii. The feasible profiles form a set F⊆X\mathcal F\subseteq XF⊆X that is downward closed (x∈F⇒xS∈Fx\in\mathcal F\Rightarrow x_S\in\mathcal Fx∈F⇒xS​∈F).

Agent iii has a valuation vi:Xi→[0,1]v_i:X_i\to[0,1]vi​:Xi​→[0,1], drawn independently from a known distribution Di\mathcal D_iDi​; D=∏iDi\mathcal D=\prod_i\mathcal D_iD=∏i​Di​. The welfare of xxx is v(x)=∑ivi(xi)v(x)=\sum_i v_i(x_i)v(x)=∑i​vi​(xi​), and v(OPT(v,S))=sup⁡x∈Sv(x)v(\mathrm{OPT}(v,S))=\sup_{x\in S}v(x)v(OPT(v,S))=supx∈S​v(x) (zero on S=∅S=\emptysetS=∅). An allocation rule ALG\mathrm{ALG}ALG maps every valuation profile to a feasible outcome.

A pricing rule assigns prices pi(xi∣y)∈[0,∞]p_i(x_i\mid y)\in[0,\infty]pi​(xi​∣y)∈[0,∞] to outcome xix_ixi​ offered to agent iii given the partial allocation yyy, with pi(xi∣y)=∞p_i(x_i\mid y)=\inftypi​(xi​∣y)=∞ when (xi,y−i)∉F(x_i,y_{-i})\notin\mathcal F(xi​,y−i​)∈/F. In the posted-price mechanism the agents are approached in index order; agent iii sees the prices pi(⋅∣x[i−1])p_i(\cdot\mid x_{[i-1]})pi​(⋅∣x[i−1]​) and buys a utility-maximizing outcome, utility being vi(xi)−pi(xi∣x[i−1])v_i(x_i)-p_i(x_i\mid x_{[i-1]})vi​(xi​)−pi​(xi​∣x[i−1]​).

A family (Fx)x∈X(\mathcal F_x)_{x\in X}(Fx​)x∈X​ of sets of profiles is exchange compatible if (yi,x−i)∈F(y_i,x_{-i})\in\mathcal F(yi​,x−i​)∈F for every x∈Xx\in Xx∈X, y∈Fxy\in\mathcal F_xy∈Fx​ and iii. Given α>0\alpha>0α>0 and β1,β2≥0\beta_1,\beta_2\ge0β1​,β2​≥0, a pricing rule pvp^vpv is weakly (α,β1,β2)(\alpha,\beta_1,\beta_2)(α,β1​,β2​)-balanced (Definition 3.4) with respect to ALG\mathrm{ALG}ALG and (Fx)(\mathcal F_x)(Fx​) if for every x∈Fx\in\mathcal Fx∈F

(a)∑ipiv(xi∣x[i−1]) ≥ 1α(v(ALG(v))−v(OPT(v,Fx))),\text{(a)}\quad \sum_i p^v_i(x_i\mid x_{[i-1]})\ \ge\ \tfrac1\alpha\bigl(v(\mathrm{ALG}(v))-v(\mathrm{OPT}(v,\mathcal F_x))\bigr),(a)i∑​piv​(xi​∣x[i−1]​) ≥ α1​(v(ALG(v))−v(OPT(v,Fx​))), (b)∑ipiv(xi′∣x[i−1]) ≤ β1 v(OPT(v,Fx))+β2 v(ALG(v))for all x′∈Fx.\text{(b)}\quad \sum_i p^v_i(x'_i\mid x_{[i-1]})\ \le\ \beta_1\,v(\mathrm{OPT}(v,\mathcal F_x))+\beta_2\,v(\mathrm{ALG}(v))\quad\text{for all }x'\in\mathcal F_x.(b)i∑​piv​(xi′​∣x[i−1]​) ≤ β1​v(OPT(v,Fx​))+β2​v(ALG(v))for all x′∈Fx​.

A collection (pv)v(p^v)_{v}(pv)v​ is weakly balanced if one exchange-compatible family works for every vvv.

Formalization targets

Goal: Theorem 3.5 (p. 551)

If (pv)v(p^v)_v(pv)v​ is weakly (α,β1,β2)(\alpha,\beta_1,\beta_2)(α,β1​,β2​)-balanced with β1+β2≥1/α\beta_1+\beta_2\ge1/\alphaβ1​+β2​≥1/α, then with

δ=1β1+max⁡{2β2,1/α},pi(xi∣y)=Ev~[piv~(xi∣y)],\delta=\frac1{\beta_1+\max\{2\beta_2,1/\alpha\}},\qquad p_i(x_i\mid y)=\mathbb E_{\tilde v}\bigl[p^{\tilde v}_i(x_i\mid y)\bigr],δ=β1​+max{2β2​,1/α}1​,pi​(xi​∣y)=Ev~​[piv~​(xi​∣y)],

the posted-price mechanism with prices δp\delta pδp, approaching agents in index order, satisfies

Ev[∑ivi(xi(v))] ≥ 1α(2β1+4β2) Ev[v(ALG(v))].\mathbb E_v\Bigl[\sum_i v_i(x_i(v))\Bigr]\ \ge\ \frac1{\alpha(2\beta_1+4\beta_2)}\,\mathbb E_v\bigl[v(\mathrm{ALG}(v))\bigr].Ev​[i∑​vi​(xi​(v))] ≥ α(2β1​+4β2​)1​Ev​[v(ALG(v))].

Milestones (Appendix A, pp. 559–560)

  1. Each agent's utility in the run is nonnegative.
  2. (A.1): the total expected utility is at least the value of a ghost-sample deviation x′(v,v′)∈Fx(v)x'(v,v')\in\mathcal F_{x(v)}x′(v,v′)∈Fx(v)​ minus its expected price.
  3. (A.2): property (b) bounds that price by δβ1E[v~(OPT(v~,Fx(v)))]+δβ2E[v~(ALG(v~))]\delta\beta_1\mathbb E[\tilde v(\mathrm{OPT}(\tilde v,\mathcal F_{x(v)}))]+\delta\beta_2\mathbb E[\tilde v(\mathrm{ALG}(\tilde v))]δβ1​E[v~(OPT(v~,Fx(v)​))]+δβ2​E[v~(ALG(v~))].
  4. (A.3): E[∑iui]≥(1−δβ1) E[v~(OPT(v~,Fx(v)))]−δβ2 E[v~(ALG(v~))]\mathbb E[\sum_iu_i]\ge(1-\delta\beta_1)\,\mathbb E[\tilde v(\mathrm{OPT}(\tilde v,\mathcal F_{x(v)}))]-\delta\beta_2\,\mathbb E[\tilde v(\mathrm{ALG}(\tilde v))]E[∑i​ui​]≥(1−δβ1​)E[v~(OPT(v~,Fx(v)​))]−δβ2​E[v~(ALG(v~))].
  5. (A.4): property (a) bounds the expected revenue from below.
  6. Case 1, β2≥1/(2α)\beta_2\ge1/(2\alpha)β2​≥1/(2α), δ=1/(β1+2β2)\delta=1/(\beta_1+2\beta_2)δ=1/(β1​+2β2​): the goal's bound.
  7. Case 2, β2<1/(2α)\beta_2<1/(2\alpha)β2​<1/(2α), δ=1/(β1+1/α)\delta=1/(\beta_1+1/\alpha)δ=1/(β1​+1/α): the bound with constant (1−αβ2)/(1+αβ1)(1-\alpha\beta_2)/(1+\alpha\beta_1)(1−αβ2​)/(1+αβ1​).
  8. Case 2's last step: (1−αβ2)/(1+αβ1)≥1/(α(2β1+4β2))(1-\alpha\beta_2)/(1+\alpha\beta_1)\ge1/(\alpha(2\beta_1+4\beta_2))(1−αβ2​)/(1+αβ1​)≥1/(α(2β1​+4β2​)) under the theorem's constraints.

Significance

The result. Theorem 3.5 is the second of the paper's two extension theorems. Its hypothesis is a deterministic, full-information property of prices, which is often checkable by a direct combinatorial argument; its conclusion is a Bayesian guarantee for an online, truthful mechanism. The paper instantiates it with weakly (1,1,d−1)(1,1,d-1)(1,1,d−1)-balanced fractional prices for combinatorial auctions with bundle size at most ddd (Theorem 4.1) and for MPH-kkk valuations (Theorem 1.6), obtaining approximation ratios linear in ddd and kkk, where (α,β)(\alpha,\beta)(α,β)-balancedness alone would not apply.

Formalizing it. The theorem is proved on paper; no machine-checked version exists. The mission produces a formal account of the sequential posted-price mechanism with history-dependent prices (an online run defined by recursion over the agents), of the ghost-sample argument, and of the case analysis in δ\deltaδ. The definitions are general enough that the paper's applications — and other balanced-price arguments — can be stated on top of them. The printed proof has a slip: (A.1) is printed as an equality but only the inequality "≥\ge≥" holds; the formalization states the inequality.

Difficulty

Two steps carry the content. First, the utility bound (A.1): agent iii could have bought its part of the deviation x′(v,v′)x'(v,v')x′(v,v′), but that deviation is defined from the run on a different profile. The argument needs that the partial allocation x[i−1](v)x_{[i-1]}(v)x[i−1]​(v) does not depend on viv_ivi​ — the mechanism is online — and that exchanging viv_ivi​ with an independent copy vi′v'_ivi′​ preserves the joint law. Making this exchange rigorous on a product measure, and handling an empty Fx(v)\mathcal F_{x(v)}Fx(v)​ (where no deviation exists and the bound must come from ui≥0u_i\ge0ui​≥0), is where the work lies. Second, v(OPT(v,Fx))v(\mathrm{OPT}(v,\mathcal F_x))v(OPT(v,Fx​)) is a supremum that need not be attained, so "buy your part of OPT" must be replaced by near-optimal selections and a limit.

The tempting shortcut of treating weak balancedness as (α,β1+β2)(\alpha,\beta_1+\beta_2)(α,β1​+β2​)-balancedness and applying Theorem 3.2 does not work: property (b) of Definition 3.1 bounds prices by a multiple of v(OPT(v,Fx))v(\mathrm{OPT}(v,\mathcal F_x))v(OPT(v,Fx​)) alone, which can be zero while v(ALG(v))v(\mathrm{ALG}(v))v(ALG(v)) is not.

Formalization scope

Agents are Fin n, 0-based: the paper's agent iii is index i−1i-1i−1, and "the order they are indexed" is the order of Fin n. Prices take values in ENNReal with ∞=⊤\infty=\top∞=⊤; price sums are never converted to reals, and property (a) passes its right side through ENNReal.ofReal (a negative bound becomes 000, which is the page's meaning). v(OPT(v,S))v(\mathrm{OPT}(v,S))v(OPT(v,S)) is the real supremum sSup, zero on the empty set, meaningful because values lie in [0,1][0,1][0,1].

Valuations are given by type spaces ViV_iVi​ and an evaluation vali(w,xi)∈[0,1]\mathrm{val}_i(w,x_i)\in[0,1]vali​(w,xi​)∈[0,1]. The type spaces are countable with discrete σ-algebras — a disclosed restriction of the paper's general distributions, which makes every function measurable and every bounded one integrable. The null outcome is assumed free at feasible partial allocations (piv~(∅∣y)=0p^{\tilde v}_i(\emptyset\mid y)=0piv~​(∅∣y)=0 for y∈Fy\in\mathcal Fy∈F): every pricing rule in the paper has this property, and the proof needs its consequence ui(v)≥0u_i(v)\ge0ui​(v)≥0. Exchange compatibility is required for all x∈Xx\in Xx∈X, as printed. The agents' behaviour is a choice rule that sees only the agent's own type and the earlier agents' outcomes and maximizes utility at every feasible partial allocation; at infeasible ones no requirement is made. The constant δ\deltaδ is written literally inside the posted prices, never as a free parameter.

The milestones (A.1)–(A.4) are stated for an arbitrary δ>0\delta>0δ>0, and (A.1)–(A.2) for an arbitrary selector into Fx(v)\mathcal F_{x(v)}Fx(v)​ in place of the maximizer, with an explicit zero when Fx(v)=∅\mathcal F_{x(v)}=\emptysetFx(v)​=∅; both are generalizations of the printed steps. A statement in which the agents' optimality hypothesis can never be met, or in which an infinite price sum is read as 000, would make the goal vacuous; the encoding above excludes both, and a sorry-free one-agent instance in the workspace confirms that all hypotheses of the goal can hold together.

Needed infrastructure: product measures and the swap of one coordinate with an independent copy, lower integrals of ENNReal-valued prices, the recursion defining the run, and near-maximizers of bounded suprema. The model and mechanism definitions are reusable for the paper's other extension theorem (Theorem 3.2) and its applications. Contributions are welcome on any milestone; the pure inequality of Case 2 is self-contained.

Selected references

  • P. Dütting, M. Feldman, T. Kesselheim, B. Lucier, Prophet inequalities made easy: Stochastic optimization by pricing nonstochastic inputs, SIAM Journal on Computing 49(3):540–582, 2020. https://doi.org/10.1137/20M1323850
  • U. Krengel, L. Sucheston, Semiamarts and finite values, Bulletin of the AMS 83(4):745–747, 1977. https://doi.org/10.1090/S0002-9904-1977-14378-4
  • E. Samuel-Cahn, Comparison of threshold stop rules and maximum for independent nonnegative random variables, Annals of Probability 12(4):1213–1216, 1984. https://doi.org/10.1214/aop/1176993150
  • R. Kleinberg, S. M. Weinberg, Matroid prophet inequalities, STOC 2012, 123–136. https://doi.org/10.1145/2213977.2213991
12 thms0 active usersReviewed
Machine LearningOptimizationProbability·Captain: mikedeng1

Stochastic First- and Zeroth-Order Methods for Nonconvex Stochastic Programming 3: The Two-Phase RSG Method Finds an (ε, Λ)-Solution within S(Λ)[N(ε) + T(ε, Λ)] Oracle CallsResearch Paper

Motivation

Stochastic optimization methods often see only noisy gradients. For a nonconvex objective, a useful guarantee is that an output point has a small gradient: this is a first-order stationarity certificate, even when there is no claim that the point is globally optimal. A guarantee on the expected squared gradient leaves open how often one particular run succeeds. The two-phase randomized stochastic gradient method of Ghadimi and Lan (2013) addresses that question by generating several candidates and using further oracle calls to select one. The paper gives an explicit bound on the probability of failure and on the number of oracle calls needed for a prescribed accuracy and confidence.

The work sits within stochastic approximation, where the objective may be a population expectation or another function accessible through noisy observations. The 2013 paper develops first- and zeroth-order methods for smooth nonconvex problems. This mission concerns its two-phase first-order result, Theorem 2.4, rather than the Gaussian smoothing results in its later section. The source for every index here is the arXiv v1 preprint; the printed page and PDF page coincide.

Setting

The objective is a differentiable function f:Rn→Rf:\mathbb R^n\to\mathbb Rf:Rn→R bounded below, with true optimal value f∗=inf⁡xf(x)f^*=\inf_x f(x)f∗=infx​f(x). Its gradient map g=∇fg=\nabla fg=∇f is LLL-Lipschitz: ∥g(y)−g(x)∥≤L∥y−x∥\|g(y)-g(x)\|\le L\|y-x\|∥g(y)−g(x)∥≤L∥y−x∥ for all x,yx,yx,y. The mission uses L>0L>0L>0. No convexity is assumed.

A stochastic first-order oracle returns a vector G(xk,ξk)G(x_k,\xi_k)G(xk​,ξk​) when called at the current iterate xkx_kxk​. Assumption A1 says that the oracle is unbiased at that iterate and has squared error of expectation at most σ2\sigma^2σ2. The noise may depend on earlier calls. In the formal model, the mean is conditional on the past, and the oracle and squared-error random variables are integrable. This makes explicit the probabilistic assumptions used when the paper takes expectations. The model takes σ>0\sigma>0σ>0 because the paper's displayed stepsize and post-optimization sample size otherwise degenerate under Lean's total division convention.

A randomized stochastic gradient run starts at x1x_1x1​ and uses xk+1=xk−γkG(xk,ξk)x_{k+1}=x_k-\gamma_k G(x_k,\xi_k)xk+1​=xk​−γk​G(xk​,ξk​). It chooses an output index R∈{1,…,N}R\in\{1,\ldots,N\}R∈{1,…,N} with the probability mass function in equation (2.3), independently of that run's oracle noise, and outputs xRx_RxR​. For a parameter D~>0\widetilde D>0D>0, the constant stepsize in equation (2.13) is γk=min⁡{1/L,D~/(σN)}\gamma_k=\min\{1/L,\widetilde D/(\sigma\sqrt N)\}γk​=min{1/L,D/(σN​)}. The paper writes Df=2(f(x1)−f∗)/LD_f=\sqrt{2(f(x_1)-f^*)/L}Df​=2(f(x1​)−f∗)/L​ and

BN=LDf2N+(D~+Df2D~)σN.\mathcal B_N=\frac{LD_f^2}{N}+\left(\widetilde D+\frac{D_f^2}{\widetilde D}\right)\frac{\sigma}{\sqrt N}.BN​=NLDf2​​+(D+DDf2​​)N​σ​.

The two-phase method makes SSS independent RSG runs, yielding xˉ1,…,xˉS\bar x_1,\ldots,\bar x_Sxˉ1​,…,xˉS​. For each candidate it averages TTT fresh oracle outputs into an estimated gradient g^s\widehat g_sg​s​. It selects a candidate xˉ∗\bar x^*xˉ∗ whose estimated-gradient norm is minimal. The post-optimization samples for different candidates may be recycled; the paper explicitly permits this. The candidate itself is known when its post-optimization samples are taken, so the conditional oracle assumption is stated relative to a filtration that contains it at time zero.

Formalization targets

The first target is the one-run mean bound of Corollary 2.2, L−1E∥g(xR)∥2≤BNL^{-1}\mathbb E\|g(x_R)\|^2\le\mathcal B_NL−1E∥g(xR​)∥2≤BN​, followed by the one-run tail bound (2.19). Lemma 2.3(a) controls the squared norm of a sum of vector martingale differences. Equation (2.28) relates a selected candidate's true gradient to the best candidate and the estimation errors. Equation (2.29) factors the probability of simultaneous failure across independent runs and bounds it, while (2.30) bounds the other source of failure: every optimization run performing poorly, and at least one estimated gradient being inaccurate.

For arbitrary positive S,N,TS,N,TS,N,T, Theorem 2.4(a) states the stronger quantitative tail bound

Pr⁡{∥g(xˉ∗)∥2≥2(4LBN+3λσ2T)}≤S+1λ+2−S(λ>0).\Pr\left\{\|g(\bar x^*)\|^2\ge2\left(4L\mathcal B_N+\frac{3\lambda\sigma^2}{T}\right)\right\}\le\frac{S+1}{\lambda}+2^{-S}\qquad(\lambda>0).Pr{∥g(xˉ∗)∥2≥2(4LBN​+T3λσ2​)}≤λS+1​+2−S(λ>0).

The goal, Theorem 2.4(b), specializes those parameters to an accuracy ε>0\varepsilon>0ε>0 and failure probability 0<Λ<10<\Lambda<10<Λ<1. It sets

S=⌈log⁡22Λ⌉,N=⌈max⁡{32L2Df2ε,(32L(D~+Df2/D~)σε)2}⌉,T=⌈24(S+1)σ2Λε⌉.S=\left\lceil\log_2\frac2\Lambda\right\rceil,\qquad N=\left\lceil\max\left\{\frac{32L^2D_f^2}{\varepsilon},\left(\frac{32L(\widetilde D+D_f^2/\widetilde D)\sigma}{\varepsilon}\right)^2\right\}\right\rceil,\qquad T=\left\lceil\frac{24(S+1)\sigma^2}{\Lambda\varepsilon}\right\rceil.S=⌈log2​Λ2​⌉,N=​max⎩⎨⎧​ε32L2Df2​​,(ε32L(D+Df2​/D)σ​)2⎭⎬⎫​​,T=⌈Λε24(S+1)σ2​⌉.

An (ε,Λ)(\varepsilon,\Lambda)(ε,Λ)-solution is a point satisfying Pr⁡{∥g(xˉ∗)∥2≤ε}≥1−Λ\Pr\{\|g(\bar x^*)\|^2\le\varepsilon\}\ge1-\LambdaPr{∥g(xˉ∗)∥2≤ε}≥1−Λ. With those parameter values, the method computes such a point using at most S(N+T)S(N+T)S(N+T) stochastic first-order oracle calls. The formulas and constants above are those of equations (2.24)–(2.27) of the preprint.

Significance

The result turns a mean stationarity bound into a confidence guarantee for one returned point, with an explicit accounting of both candidate generation and candidate assessment. It identifies how the number of independent runs, iterations per run, and gradient estimates scale with the requested accuracy and failure probability. Without the post-optimization phase, the paper's direct Markov estimate (2.19) gives a less favorable dependence on the failure probability for a single run.

The mathematical theorem is proved in the 2013 paper; the Lean declarations in this proposal are statements awaiting machine-checked proofs. A completed formalization would give reusable definitions for a dependent-noise gradient oracle, a random-output stochastic-gradient run, and a post-optimization selection procedure. The vector martingale estimate and finite-candidate inequality could also serve later stochastic-optimization developments. Contributions to the probability and measurability infrastructure, as well as the final rate proof, are within scope.

Difficulty

Selecting the candidate with the smallest estimated gradient need not select the one with the smallest true gradient. The estimates are random and are evaluated at candidates that are themselves random outputs of earlier oracle runs. A bound for a fixed point does not address this dependence. The argument needs a conditional oracle contract at each candidate and a separate guarantee that the optimization runs supply a sufficiently good candidate. The paper's intermediate display (2.31) applies a fixed-candidate tail estimate to the selected candidate even though the selection examines the same estimates; that step is not justified by the stated assumptions. The final bound can be phrased without treating (2.31) as a separate target.

Formalization scope

The space Rn\mathbb R^nRn is EuclideanSpace ℝ (Fin n). Iterations and oracle samples retain the paper's one-based indexing; candidate runs use Fin S, which reindexes the paper's 1,…,S1,\ldots,S1,…,S. The objective's true infimum is carried by IsGLB (Set.range f) fstar, so DfD_fDf​ cannot be weakened by substituting an arbitrary lower bound. Each candidate is generated by the RSG recursion and the mass function (2.3); the one-run performance bound is a theorem, not a hypothesis of the two-phase model. Independent candidate outputs are required for (2.29). The selected candidate may be any minimizer of the estimated-gradient norm, with any tie rule; no measurability of the selection is assumed.

All expectations are Bochner integrals, with integrability included in the oracle assumptions and in the one-run conclusion. Probabilities are ℝ≥0∞ values. The noise carrier is generalized from the paper's Borel subsets of Euclidean space to a measurable type. The general vector martingale lemma omits the paper's Polish-space and trivial-time-zero conditions; neither is needed for its squared-norm bound, and the latter would conflict with a candidate known at time zero. Its non-strict tail statement is restricted to a positive sum of variance bounds, because the printed version is false when every bound is zero. The goal reads the logarithm in (2.24) as base two, matching the paper's final 2−S≤Λ/22^{-S}\le\Lambda/22−S≤Λ/2 comparison. Positive σ\sigmaσ and D~\widetilde DD avoid zero steps and an empty post-optimization average.

The formal goal states the probability guarantee. The S(N+T)S(N+T)S(N+T) oracle-call bound follows directly from the algorithm's two loops and is recorded in the theorem's prose rather than in a separate operational semantics for calls. A complete proof may use Mathlib's conditional expectations, independent random variables, finite sums, and real logarithm and ceiling libraries. No assumption may simply postulate the one-run gradient bound or the final success probability.

Selected references

  • Saeed Ghadimi and Guanghui Lan, Stochastic First- and Zeroth-Order Methods for Nonconvex Stochastic Programming, SIAM Journal on Optimization 23(4), 2013. arXiv:1309.5549v1.
11 thms0 active usersReviewed
Bandit AlgorithmsInformation TheoryProbability·Captain: mikedeng1

Data-Based Dynamic Pricing and Inventory Control with Censored Demand and Limited Price Changes 2: Any Policy with at Most m Price Changes Has Regret at Least KT^(1/(m+1)) on a Bernoulli InstanceResearch Paper

Why limited price changes matter

A seller learning a demand curve normally adjusts prices as new observations arrive. A price-change limit prevents that continual adjustment: a price may have to be chosen before the seller knows which demand curve it faces, then held through a block of sales. This matters when repricing is operationally costly, constrained by contracts, or visible to customers. Chen, Chao and Wang study pricing jointly with inventory replenishment under censored demand. Their Theorem 2 asks how much regret is unavoidable when the seller can change price at most mmm times, regardless of the learning policy it uses (SSRN revision, pp. 10–11, 35–42).

The lower bound is paired with their Theorem 1: in the well-separated setting an algorithm attains regret proportional to T1/(m+1)T^{1/(m+1)}T1/(m+1) for large horizons, while Theorem 2 asserts the same exponent cannot be improved uniformly over admissible policies (SSRN revision, p. 10). The paper appeared as an Operations Research technical note in 2020 (DOI 10.1287/opre.2020.1993); this mission cites the authors' SSRN revision dated 2020-02-10, whose page and result numbers are used throughout.

Bernoulli pricing setting

The horizon has TTT periods. At each period the seller posts a price pt∈[1,6]p_t\in[1,6]pt​∈[1,6] and replenishes inventory to one unit. Demand dtd_tdt​ is either zero or one, so all demand can be served and the observed sale equals demand. The unknown scalar parameter zzz belongs to [1/6,5/6][1/6,5/6][1/6,5/6]. Conditional on the posted price, the probability of one unit of demand is

ν(p,z)=max⁡{0,1−pz/2}.\nu(p,z)=\max\{0,1-pz/2\}.ν(p,z)=max{0,1−pz/2}.

Holding and shortage costs are zero. Hence expected one-period revenue is rz(p)=pν(p,z)r_z(p)=p\nu(p,z)rz​(p)=pν(p,z). The clairvoyant benchmark is G∗(z)=1/(2z)G^*(z)=1/(2z)G∗(z)=1/(2z): it is attained by the feasible price p∗=1/zp^*=1/zp∗=1/z. The local Lean sanity check proves this maximum property, so the benchmark does not rely on a default value of a supremum. The model is the explicit Bernoulli construction in the proof of Theorem 2 (SSRN revision, p. 35).

An admissible randomized policy may draw random bits and use past posted prices and observed sales when choosing its next price. Its action cannot depend on future demand or on the unknown parameter. Every realized seed and demand path must satisfy the price-change constraint

∑t=1T−11{pt≠pt+1}≤m,m≥1.\sum_{t=1}^{T-1}\mathbf 1\{p_t\ne p_{t+1}\}\le m,\qquad m\ge1.t=1∑T−1​1{pt​=pt+1​}≤m,m≥1.

The regret Rπ(T,z)R_\pi(T,z)Rπ​(T,z) is the expected sum of G∗(z)−rz(pt)G^*(z)-r_z(p_t)G∗(z)−rz​(pt​) under the policy and the demand law at parameter zzz. The paper's admissibility and change constraint are stated on pp. 5–6; its randomized policy factorization is displayed in (49) on p. 35 (SSRN revision).

Formalization targets

The goal is the minimax reading of Theorem 2. For each fixed m≥1m\ge1m≥1, there is a positive constant K7K_7K7​ and a horizon threshold T0T_0T0​, independent of the policy and the horizon, such that

∀T≥T0  ∀π admissible with at most m changes,∃z∈[1/6,5/6]: Rπ(T,z)≥K7T1/(m+1).\forall T\ge T_0\;\forall\pi\text{ admissible with at most }m\text{ changes},\quad \exists z\in[1/6,5/6]:\ R_\pi(T,z)\ge K_7T^{1/(m+1)}.∀T≥T0​∀π admissible with at most m changes,∃z∈[1/6,5/6]: Rπ​(T,z)≥K7​T1/(m+1).

The parameter is selected after the policy. The proof's objective (56) is a worst-case parameter choice for each policy (SSRN revision, p. 37). The printed theorem sentence can also be read as one fixed instance defeating every algorithm; that order is false because a policy supplied with that instance's zzz can post 1/z1/z1/z in every period.

Five milestones expose the source's quantitative ingredients. The hierarchy (50) constructs parameters zζz_\zetazζ​ from signs ζ∈{±1}m+1\zeta\in\{\pm1\}^{m+1}ζ∈{±1}m+1 and scales εℓ=T−ℓ/[2(m+1)]\varepsilon_\ell=T^{-\ell/[2(m+1)]}εℓ​=T−ℓ/[2(m+1)]. Its parameters lie in [1/6,5/6][1/6,5/6][1/6,5/6] for large TTT. Different signs are separated at scale εℓ/8\varepsilon_\ell/8εℓ​/8. Lemma 1 bounds one-period regret by the squared error in a nearest-instance selection. The pointwise inequality underlying (57) gives a cost of at least 10−4εℓ210^{-4}\varepsilon_\ell^210−4εℓ2​ for a wrong sign. A corrected Lemma 2 supplies a quadratic Bernoulli relative-entropy bound under an explicit interior condition (SSRN revision, pp. 36–37).

What the result establishes

The exponent 1/(m+1)1/(m+1)1/(m+1) quantifies the cost of the change budget: fixing mmm leaves a polynomial regret floor even though the Bernoulli demand law is one-dimensional and observed without censoring. Since the constructed instance fixes inventory at a level that serves every demand, a lower bound here also applies to policies in the joint pricing and inventory setting whenever that instance is admitted. It identifies the information loss caused by limited repricing, independently of lost sales and censoring.

The paper states the lower bound and gives a proof, but its printed Lemma 2 is false at prices where ν(p,z)=0\nu(p,z)=0ν(p,z)=0. The subsequent Lemma 3 applies that unrestricted bound. Therefore the source proof does not, as printed, establish the minimax claim for every admissible price policy. The Lean goal is an open target; the four elementary milestones and corrected information bound are also open Lean statements. Formalizing this mission requires an argument that handles prices at the zero-demand kink, or a different route to the lower bound. No machine-checked proof of this specific result is claimed here.

Where the argument is difficult

The natural comparison of two nearby parameters uses the relative entropy between their observed demand laws. Away from the kink, this information is quadratic in the parameter difference. At a price that makes demand impossible under one parameter but possible under the other, the divergence in the printed direction can be linear in that difference. The unrestricted 108∣z−z′∣2108|z-z'|^2108∣z−z′∣2 bound of Lemma 2 therefore fails at exactly the prices an arbitrary policy may choose. Restricting the policy's prices would change the target. A faithful proof must retain those prices while still controlling the policy's information and regret (SSRN revision, Lemmas 2–3, pp. 36–40).

Formalization scope

Lean represents the horizon by Fin T; its index zero is period one in the paper. Bernoulli demand paths have type Fin T → Bool. A policy's price at a period depends on a random seed and only the earlier demand bits; with inventory level one, these bits are exactly the observed sales. A probability measure on the seed models adaptive randomization, including a pre-sampled stream of random choices. Prices are measurable functions of the seed for each finite history. The budget holds on every seed and path, not only on average.

Path probabilities are finite products of conditional Bernoulli probabilities. Regret is a finite sum of nonnegative gaps integrated over the seed with lintegral, so it cannot become zero through non-integrability of a real-valued expectation. The exponent of TTT and the scales εℓ\varepsilon_\ellεℓ​ use real division. The arg-min in (51) is any genuine nearest-instance selection; a local proof checks that one exists. The hierarchy's validity and separation statements require a large-horizon threshold, which the unqualified printed prose omits. The corrected Lemma 2 adds pz≤11/6pz\le11/6pz≤11/6 to keep the Bernoulli probabilities in the interior. Its verbatim milestone retains the printed statement, and its formal statement and note disclose the correction. Lemma 3 is not stated because its printed proof relies on Lemma 2 outside that interior region.

The named Bernoulli family strengthens the theorem's existential instance wording, while also exposing a limitation: at p≥2/zp\ge2/zp≥2/z it violates the positive-mean and identifiability conditions stated earlier in the paper. That discrepancy is recorded rather than hidden in an assumption. Definitions for randomized adapted policies, finite path laws, the parameter hierarchy, and Bernoulli relative entropy are reusable; contributions that establish the open goal or repair the information comparison are in scope.

Selected references

  • B. Chen, X. Chao, and Y. Wang, Data-Based Dynamic Pricing and Inventory Control with Censored Demand and Limited Price Changes, SSRN 2700747, revision of 2020-02-10. Preprint.
  • B. Chen, X. Chao, and Y. Wang, Technical Note—Data-Based Dynamic Pricing and Inventory Control with Censored Demand and Limited Price Changes, Operations Research, 2020. DOI 10.1287/opre.2020.1993.
10 thms0 active usersReviewed
Bandit AlgorithmsProbabilityStatistics·Captain: mikedeng1

Data-Based Dynamic Pricing and Inventory Control with Censored Demand and Limited Price Changes 1: In the Well-Separated Case, Algorithm-I with m Price Changes Has Regret at Most KT^(1/(m+1))Research Paper

Motivation

Retailers set prices and stock levels without knowing how demand responds to price. They must learn the demand curve from their own sales while still earning money, which is the exploration–exploitation trade-off of dynamic pricing with learning (den Boer 2015). Two features of practice make the problem harder than the textbook bandit. First, demand is censored: when the shelf runs empty, the firm sees only its sales min⁡{dt,yt}\min\{d_t,y_t\}min{dt​,yt​}, not the demand dtd_tdt​. Second, firms change prices rarely, because of menu costs and customer reaction, so a policy may change its price at most mmm times over the whole horizon (Cheung, Simchi-Levi and Wang 2017).

Chen, Chao and Wang study a firm facing both features at once, in a parametric model where the demand distribution is known up to a parameter. For the well-separated case they give an algorithm, Algorithm-I, whose regret grows as T1/(m+1)T^{1/(m+1)}T1/(m+1), and they show that no admissible policy does better in general. This mission formalizes the upper bound. A companion mission formalizes the lower bound.

Setting

A firm sells one product over periods t=1,…,Tt=1,\dots,Tt=1,…,T. At the start of period ttt it holds inventory xtx_txt​ (with x1=0x_1=0x1​=0). It chooses a price pt∈P=[pl,ph]p_t\in\mathcal P=[p^l,p^h]pt​∈P=[pl,ph] and an order-up-to level yt∈Y={yl,…,yh}y_t\in\mathcal Y=\{y^l,\dots,y^h\}yt​∈Y={yl,…,yh} with yt≥xty_t\ge x_tyt​≥xt​, and the order arrives at once. Demand dtd_tdt​ then has probability mass function f(⋅;pt,z)f(\cdot;p_t,z)f(⋅;pt​,z) on {dl,dl+1,…,dh}\{d^l,d^l+1,\dots,d^h\}{dl,dl+1,…,dh}, where dh≤+∞d^h\le+\inftydh≤+∞ and the parameter zzz lies in Z=[zl,zh]\mathcal Z=[z^l,z^h]Z=[zl,zh], 0≤zl≤zh0\le z^l\le z^h0≤zl≤zh. Unmet demand is lost, and the firm observes only the sales min⁡{dt,yt}\min\{d_t,y_t\}min{dt​,yt​}. Leftover stock carries over, xt+1=(yt−dt)+x_{t+1}=(y_t-d_t)^+xt+1​=(yt​−dt​)+. Each unit left over costs h≥0h\ge0h≥0 and each lost sale costs b≥0b\ge0b≥0. The single-period expected profit is

G(p,y,z)=p E[D(p,z)]−h E[y−D(p,z)]+−(b+p) E[D(p,z)−y]+.G(p,y,z)=p\,\mathbb E[D(p,z)]-h\,\mathbb E[y-D(p,z)]^+-(b+p)\,\mathbb E[D(p,z)-y]^+ .G(p,y,z)=pE[D(p,z)]−hE[y−D(p,z)]+−(b+p)E[D(p,z)−y]+.

For each yyy, py∗(z)p^*_y(z)py∗​(z) is an optimal price, max⁡p∈PG(p,y,z)=G(py∗(z),y,z)\max_{p\in\mathcal P}G(p,y,z)=G(p^*_y(z),y,z)maxp∈P​G(p,y,z)=G(py∗​(z),y,z), and the clairvoyant value is G∗(z)=max⁡(p,y)∈P×YG(p,y,z)G^*(z)=\max_{(p,y)\in\mathcal P\times\mathcal Y}G(p,y,z)G∗(z)=max(p,y)∈P×Y​G(p,y,z).

A policy's decision in period ttt may depend only on past decisions and past sales. The regret of a policy is

R(T)=T G∗(z)−E[Vϕ(T,z)]=∑t=1TE[G∗(z)−G(pt,yt,z)].R(T)=T\,G^*(z)-\mathbb E[V^\phi(T,z)]=\sum_{t=1}^T\mathbb E\big[G^*(z)-G(p_t,y_t,z)\big].R(T)=TG∗(z)−E[Vϕ(T,z)]=t=1∑T​E[G∗(z)−G(pt​,yt​,z)].

The family is well-separated (Definition 1) if for every price the pmfs f(⋅;p,z)f(\cdot;p,z)f(⋅;p,z), z∈Zz\in\mathcal Zz∈Z, are pairwise distinct.

Algorithm-I splits the horizon into m+1m+1m+1 stages of lengths Ii=⌈Ti/(m+1)⌉I_i=\lceil T^{i/(m+1)}\rceilIi​=⌈Ti/(m+1)⌉ for i≤mi\le mi≤m, with Im+1=T−∑i≤mIiI_{m+1}=T-\sum_{i\le m}I_iIm+1​=T−∑i≤m​Ii​. Stage iii uses one price p^i\hat p_ip^​i​ and the order-up-to target y~i\tilde y_iy~​i​. The target equals the planned level y^i\hat y_iy^​i​, raised by Δ≥1\Delta\ge1Δ≥1 when y^i=dl\hat y_i=d^ly^​i​=dl so that the sales carry information. At the end of the stage the algorithm computes the censored-data maximum-likelihood estimate z^i\hat z_iz^i​ (5). It then sets the next stage's decisions to a maximizer of G(⋅,⋅,z^i)G(\cdot,\cdot,\hat z_i)G(⋅,⋅,z^i​) (6). It changes its price at most mmm times.

Formalization targets

Goal: Theorem 1

Under Assumption A (regularity of GGG and of py∗p^*_ypy∗​ near the true zzz), Assumption 1 (Fisher-information bounds, a positive lower bound on the pmf, strict monotonicity of f(dl;p,⋅)f(d^l;p,\cdot)f(dl;p,⋅)), Definition 1, and the condition that every optimal order-up-to level exceeds dld^ldl, there is K6>0K_6>0K6​>0 such that for all large TTT

R(T)≤K6 T1m+1.R(T)\le K_6\,T^{\frac1{m+1}} .R(T)≤K6​Tm+11​.

The constant may depend on the model, the true parameter and the algorithm's inputs. The rate T1/(m+1)T^{1/(m+1)}T1/(m+1) is the content.

Milestones

  1. Theorem B1: if an estimator satisfies P{∥z^−z∥≥ϵ}≤K14e−nK15ϵ2+K16/n\mathbb P\{\|\hat z-z\|\ge\epsilon\}\le K_{14}e^{-nK_{15}\epsilon^2}+K_{16}/nP{∥z^−z∥≥ϵ}≤K14​e−nK15​ϵ2+K16​/n, then the plug-in decision has optimality gap G∗(z)−E[G(p^∗,y^∗,z)]≤K17/nG^*(z)-\mathbb E[G(\hat p^*,\hat y^*,z)]\le K_{17}/nG∗(z)−E[G(p^​∗,y^​∗,z)]≤K17​/n.
  2. Proposition 1: the censored MLE satisfies P{∣z−z^i∣≥ϵ}≤K3e−K4Iiϵ2+K5/Ii\mathbb P\{|z-\hat z_i|\ge\epsilon\}\le K_3e^{-K_4I_i\epsilon^2}+K_5/I_iP{∣z−z^i​∣≥ϵ}≤K3​e−K4​Ii​ϵ2+K5​/Ii​.
  3. Per-stage estimation regret (p. 25): E[G∗(z)−G(p^i,y^i,z)]≤K17/Ii−1\mathbb E[G^*(z)-G(\hat p_i,\hat y_i,z)]\le K_{17}/I_{i-1}E[G∗(z)−G(p^​i​,y^​i​,z)]≤K17​/Ii−1​.
  4. (25): the summed estimation regret is at most a constant times mT1/(m+1)mT^{1/(m+1)}mT1/(m+1).
  5. (26): P(y^i≠y~i)≤K/Ii−1\mathbb P(\hat y_i\ne\tilde y_i)\le K/I_{i-1}P(y^​i​=y~​i​)≤K/Ii−1​, so exploration after stage 1 is rare.

Significance

The upper bound shows that a budget of mmm price changes costs only a T1/(m+1)T^{1/(m+1)}T1/(m+1) regret even under censoring. With mmm of order log⁡T\log TlogT the rate drops to logarithmic (Theorem 3 of the paper). Together with the matching lower bound (Theorem 2), it identifies the exact price of limiting price changes in this model. Theorem B1 is a general transfer principle, from a large-deviation bound on an estimate to a 1/n1/n1/n optimality gap of the plug-in decision. It allows continuous and discrete decisions together and needs no unique optimizer. It is reusable for any parametric learning problem with that structure. Proposition 1 is a large-deviation bound for maximum likelihood from censored, dependent, non-identically distributed data. The paper notes that such results were not previously available in the statistics literature.

The results are proved in the paper's appendices. None of them has a machine-checked proof. A formalization would check the regret decomposition (23), the stagewise bookkeeping with ceilings, and the large-deviation argument for the censored MLE. It would also make the reading of several loosely stated steps exact (see Formalization scope).

Difficulty

The obvious argument plugs a consistent estimator into the optimizer and bounds the regret by the estimation error. It fails twice. The error of z^i\hat z_iz^i​ is of order Ii−1−1/2I_{i-1}^{-1/2}Ii−1−1/2​, so a Lipschitz bound on the profit would give regret of order Ii/Ii−1I_i/\sqrt{I_{i-1}}Ii​/Ii−1​​ per stage, which is too large. The 1/n1/n1/n rate of Theorem B1 needs the first-order condition at an interior optimum and the exact gap δ\deltaδ between optimal and suboptimal discrete levels. Second, the data are censored and dependent. The censoring level yty_tyt​ depends on carried inventory, which depends on past demand and on past prices. The classical large-deviation results for maximum likelihood assume i.i.d. uncensored samples (Borovkov 1998) and do not apply. Proposition 1 needs a separate argument that the inventory target is reached in most periods with high probability.

Formalization scope

The model is encoded with a scalar parameter. P\mathcal PP, Y\mathcal YY and Z\mathcal ZZ are as above. The pmf is positive exactly on {dl,…,dh}\{d^l,\dots,d^h\}{dl,…,dh} and sums to one, and dh=+∞d^h=+\inftydh=+∞ is allowed. The expected profit GGG is built from these sums. G∗(z)G^*(z)G∗(z) is the finite maximum max⁡yG(py∗(z),y,z)\max_{y}G(p^*_y(z),y,z)maxy​G(py∗​(z),y,z) for a price selection p∗p^*p∗, not a real supremum. Periods are 0-based in Lean, while stages keep the paper's indices. Expectations and probabilities are sums over demand paths d∈NTd\in\mathbb N^Td∈NT weighted by ∏tf(dt;pt,z)\prod_tf(d_t;p_t,z)∏t​f(dt​;pt​,z), the law of the path under the algorithm, taken in [0,∞][0,\infty][0,∞]. Every regret summand is nonnegative.

Algorithm-I reads demand only through sales. Step 2's arg max is any maximizer of the censored product likelihood, which exists by compactness. Step 3's arg max is y^\hat yy^​, any maximizer of y↦G(py∗(z^),y,z^)y\mapsto G(p^*_y(\hat z),y,\hat z)y↦G(py∗​(z^),y,z^), together with the price py^∗(z^)p^*_{\hat y}(\hat z)py^​∗​(z^) of Assumption A(iii). This is the decision the proof of Theorem B1 analyses. Proposition 1's "large enough iii" is read as "large enough TTT, uniformly in the stage and in ϵ\epsilonϵ". Theorem B1 is stated for a scalar price and level and a parameter in Rk\mathbb R^kRk.

Three hypotheses are added and disclosed. Differentiability of fff in zzz is presupposed by Assumption 1. Finiteness of the mean demand is needed for (4) when dh=∞d^h=\inftydh=∞. The condition dl≤yld^l\le y^ldl≤yl is needed because Step 1 defines the target only for y^≥dl\hat y\ge d^ly^​≥dl. "The optimal order-up-to level exceeds dld^ldl" is read for every optimal level.

A trivializing formalization is ruled out. Regret and probabilities are path sums of nonnegative terms, not Bochner integrals that vanish on non-integrable inputs. T1/(m+1)T^{1/(m+1)}T1/(m+1) is a real power. The hypotheses are jointly satisfiable: a Bernoulli instance with Y={1}\mathcal Y=\{1\}Y={1}, P=[1,2]\mathcal P=[1,2]P=[1,2], Z=[2/3,4/5]\mathcal Z=[2/3,4/5]Z=[2/3,4/5], f(0;p,z)=zp/2f(0;p,z)=zp/2f(0;p,z)=zp/2 satisfies all of them, together with explicit selections, and this has been verified in Lean.

A complete development needs the following:

  • Hoeffding-type concentration for dependent bounded sums;
  • a large-deviation bound for the censored log-likelihood;
  • Taylor's theorem with integral remainder on an interval;
  • bookkeeping lemmas for the stage lengths ⌈Ti/(m+1)⌉\lceil T^{i/(m+1)}\rceil⌈Ti/(m+1)⌉.

Theorem B1 and the model definitions are reusable for the paper's later results (Theorems 3, 5, 6), which repeat these arguments. Contributions to any milestone are welcome, including alternative proofs of Proposition 1.

Selected references

  • B. Chen, X. Chao, Y. Wang, Data-Based Dynamic Pricing and Inventory Control with Censored Demand and Limited Price Changes, Operations Research (technical note), 2020; read in the SSRN revision of 2020-02-10. https://doi.org/10.1287/opre.2020.1993, https://ssrn.com/abstract=2700747
  • W. C. Cheung, D. Simchi-Levi, H. Wang, Dynamic Pricing and Demand Learning with Limited Price Experimentation, Operations Research 65(6), 2017. https://doi.org/10.1287/opre.2017.1629
  • J. Broder, P. Rusmevichientong, Dynamic Pricing under a General Parametric Choice Model, Operations Research 60(4), 2012. https://doi.org/10.1287/opre.1120.1057
  • A. A. Borovkov, Mathematical Statistics, Gordon and Breach, 1998.
  • A. V. den Boer, Dynamic pricing and learning: Historical origins, current research, and new directions, Surveys in Operations Research and Management Science 20(1), 2015. https://doi.org/10.1016/j.sorms.2015.03.001
9 thms0 active usersReviewed
OptimizationProbability·Captain: mikedeng1

Optimization-Based Scenario Reduction for Data-Driven Two-Stage Stochastic Optimization II: Under a Symmetric Uncertainty Law the Mean Solves the Convex Upper-Bound Scenario ProblemResearch Paper

Why reduce scenarios with the cost in view

A two-stage stochastic programme chooses a decision zzz before an uncertain parameter ξ\xiξ is revealed and pays a cost c(z;ξ)c(z;\xi)c(z;ξ). When ξ\xiξ is known only through nnn data points, or through a law with many atoms, the expected cost is expensive to optimize, and practitioners replace the law by a small set of mmm reduced scenarios. Classical scenario reduction chooses these scenarios to be close to the data in a Wasserstein distance, without looking at the cost (Dupačová, Gröwe-Kuska and Römisch, 2003; Rujeerapaiboon, Schindler, Kuhn and Wiesemann, 2022). Bertsimas and Mundru (Operations Research, 2023) propose problem-dependent scenario reduction: the distance between two scenarios measures how much the optimal decision for one costs when evaluated on the other. Their method needs, for each cluster of data, the scenario that minimizes a cost-dependent dissimilarity, which they replace by a convex upper bound, problem (16).

Theorem 3 of the paper is the sanity check for that upper bound. For the simplest cost to which it applies and a single reduced scenario (m=1m=1m=1), under a symmetry assumption on the law, the minimizer of the upper bound is the mean of ξ\xiξ, which is also what Wasserstein scenario reduction returns for m=1m=1m=1. This mission formalizes that statement.

Setting

Decisions and parameters both live in Rd\mathbb R^dRd, with the Euclidean inner product z′ξz'\xiz′ξ. The feasible set is a polytope

Z={z∈R+d:Pz≤q},\mathcal Z = \{ z\in\mathbb R^d_+ : Pz\le q\},Z={z∈R+d​:Pz≤q},

for a matrix P∈Rr×dP\in\mathbb R^{r\times d}P∈Rr×d and a vector q∈Rrq\in\mathbb R^rq∈Rr, assumed nonempty and bounded. The cost is c(z;ξ)=max⁡{z′ξ,0}c(z;\xi)=\max\{z'\xi,0\}c(z;ξ)=max{z′ξ,0}, a special case of the piecewise bilinear costs max⁡1≤t≤kz′Atξ\max_{1\le t\le k} z'A_t\ximax1≤t≤k​z′At​ξ of (15) (take k=2k=2k=2, A1=IA_1=IA1​=I, A2=0A_2=0A2​=0).

An optimal-decision map is any function z∗:Rd→Rdz^*:\mathbb R^d\to\mathbb R^dz∗:Rd→Rd with z∗(ξ)∈arg⁡min⁡z∈Zz′ξz^*(\xi)\in\arg\min_{z\in\mathcal Z} z'\xiz∗(ξ)∈argminz∈Z​z′ξ for every ξ\xiξ; for a vector vvv, Z∗(v)=arg⁡min⁡z∈Zz′v\mathcal Z^*(v)=\arg\min_{z\in\mathcal Z} z'vZ∗(v)=argminz∈Z​z′v is the whole set of minimizers. The set of cost-reducing parameters is

U={ξ:min⁡z∈Zz′ξ<0}.\mathcal U=\Big\{\xi : \min_{z\in\mathcal Z} z'\xi<0\Big\}.U={ξ:z∈Zmin​z′ξ<0}.

For a candidate reduced scenario ζ∈Rd\zeta\in\mathbb R^dζ∈Rd, the per-scenario upper-bound loss is

L(ξ,ζ)=max⁡{max⁡z∈Zz′(ξ−2ζ), 0}+2max⁡{z∗(ξ)′ζ, 0}.L(\xi,\zeta)=\max\Big\{\max_{z\in\mathcal Z} z'(\xi-2\zeta),\,0\Big\}+2\max\{z^*(\xi)'\zeta,\,0\}.L(ξ,ζ)=max{z∈Zmax​z′(ξ−2ζ),0}+2max{z∗(ξ)′ζ,0}.

For this cost it is the optimal value, in the auxiliary variables (λ,θ,γ)(\lambda,\theta,\gamma)(λ,θ,γ), of the per-point linear programme in (16). With a random parameter ξ\xiξ of law μ\muμ, the upper-bound objective for m=1m=1m=1 is E[L(ξ,ζ)]\mathbb E[L(\xi,\zeta)]E[L(ξ,ζ)]. The squared cost for Wasserstein reduction to one atom is W(ζ)=∫∥ξ−ζ∥22 dμW(\zeta)=\int\|\xi-\zeta\|_2^2\,d\muW(ζ)=∫∥ξ−ζ∥22​dμ; (4) takes its square root, which preserves minimizers.

Assumption 5 (p. 24) asks:

  • (a) ξ\xiξ has a continuous distribution on U\mathcal UU and density 000 elsewhere;
  • (b) the mean ξˉ=E[ξ]\bar\xi=\mathbb E[\xi]ξˉ​=E[ξ] is finite and z∗(ξˉ)′ξˉ>0z^*(\bar\xi)'\bar\xi>0z∗(ξˉ​)′ξˉ​>0;
  • (c) the law of ξ\xiξ is symmetric about ξˉ\bar\xiξˉ​, that is, ξ\xiξ and 2ξˉ−ξ2\bar\xi-\xi2ξˉ​−ξ are equal in distribution.

Formalization targets

Goal: Theorem 3 (p. 24)

Under Assumption 5, for every measurable optimal-decision map z∗z^*z∗,

E[L(ξ,ξˉ)]  ≤  E[L(ξ,ζ)]andW(ξˉ)≤W(ζ)for all ζ∈Rd.\mathbb E\big[L(\xi,\bar\xi)\big]\;\le\;\mathbb E\big[L(\xi,\zeta)\big]\quad\text{and}\quad W(\bar\xi)\le W(\zeta)\qquad\text{for all }\zeta\in\mathbb R^d.E[L(ξ,ξˉ​)]≤E[L(ξ,ζ)]andW(ξˉ​)≤W(ζ)for all ζ∈Rd.

The page's "the solution … is simply the mean" is read as "the mean is a minimizer", which is what the proof concludes; uniqueness is not claimed.

Milestones (steps of the proof, pp. 24–25)

  1. For each ξ\xiξ, ζ↦L(ξ,ζ)\zeta\mapsto L(\xi,\zeta)ζ↦L(ξ,ζ) is convex.
  2. L(ξ,ζ)≤∣max⁡z∈Zz′(ξ−2ζ)∣+2∣ζ′z∗(ξ)∣≤(∥ξ−2ζ∥1+2∥ζ∥1)max⁡z∈Z∥z∥∞≤(∥ξ∥1+4∥ζ∥1)max⁡z∈Z∥z∥∞L(\xi,\zeta)\le\big|\max_{z\in\mathcal Z} z'(\xi-2\zeta)\big|+2|\zeta'z^*(\xi)|\le(\|\xi-2\zeta\|_1+2\|\zeta\|_1)\max_{z\in\mathcal Z}\|z\|_\infty\le(\|\xi\|_1+4\|\zeta\|_1)\max_{z\in\mathcal Z}\|z\|_\inftyL(ξ,ζ)≤​maxz∈Z​z′(ξ−2ζ)​+2∣ζ′z∗(ξ)∣≤(∥ξ−2ζ∥1​+2∥ζ∥1​)maxz∈Z​∥z∥∞​≤(∥ξ∥1​+4∥ζ∥1​)maxz∈Z​∥z∥∞​.
  3. With probability one, 2ξˉ−ξ∈U2\bar\xi-\xi\in\mathcal U2ξˉ​−ξ∈U and Z∗(2ξˉ−ξ)\mathcal Z^*(2\bar\xi-\xi)Z∗(2ξˉ​−ξ) is a singleton.
  4. Under symmetry, E[z∗(2ξˉ−ξ)]=E[z∗(ξ)]\mathbb E[z^*(2\bar\xi-\xi)]=\mathbb E[z^*(\xi)]E[z∗(2ξˉ​−ξ)]=E[z∗(ξ)].
  5. If z∗(ξˉ)′ξˉ>0z^*(\bar\xi)'\bar\xi>0z∗(ξˉ​)′ξˉ​>0 then z′ξˉ≥z∗(ξˉ)′ξˉ>0z'\bar\xi\ge z^*(\bar\xi)'\bar\xi>0z′ξˉ​≥z∗(ξˉ​)′ξˉ​>0 for every z∈Zz\in\mathcal Zz∈Z.

Significance

The upper bound (16) is the computational core of the paper's Algorithm 1: each alternating-minimization step solves one instance of it per cluster. Theorem 3 is the only result in the paper that identifies its minimizer in closed form, and it shows that, in a symmetric case, the cost-aware reduction agrees with the classical one at m=1m=1m=1. It is the paper's justification that the upper bound is a sensible surrogate and not an arbitrary convex relaxation.

The argument is a variant of the mean-minimizes-the-surrogate result of Elmachtoub and Grigas for the SPO+ loss (Management Science, 2022, Proposition 6(a)), with both terms clipped at zero and with a law living only on U\mathcal UU instead of all of Rd\mathbb R^dRd. Theorem 3 is proved on paper; it has not been formalized, and on Prove2Me the Elmachtoub–Grigas statement is posed but open. The work here is to formalize the known proof, including the measure-theoretic steps the paper treats in one sentence each: integrability of the loss, exchange of the subdifferential and the expectation, and the almost-sure uniqueness of linear minimizers over a polytope.

Difficulty

Convexity of the objective and a vanishing subgradient at ξˉ\bar\xiξˉ​ would settle the theorem, but two steps of that argument are not routine. First, the objective is not differentiable everywhere, and the subdifferential of ζ↦E[L(ξ,ζ)]\zeta\mapsto\mathbb E[L(\xi,\zeta)]ζ↦E[L(ξ,ζ)] is not in general the expectation of the pointwise subdifferentials: the exchange needs the integrable bound of milestone 2 and the almost-sure uniqueness of milestone 3. Second, that uniqueness is a statement about the geometry of polytopes and about the law of the reflected parameter 2ξˉ−ξ2\bar\xi-\xi2ξˉ​−ξ together: neither convexity nor absolute continuity alone gives it. The clipping at zero adds a third point: one has to check that it is inactive at ζ=ξˉ\zeta=\bar\xiζ=ξˉ​ almost surely, which is where Assumption 5a's support condition on U\mathcal UU and Assumption 5b enter. Dropping either half of Assumption 5a breaks the argument: a two-atom symmetric law can put both atoms where Z∗(2ξˉ−ξ)\mathcal Z^*(2\bar\xi-\xi)Z∗(2ξˉ​−ξ) is a whole edge, and a law charging the complement of U\mathcal UU can make the first clipping active at ξˉ\bar\xiξˉ​.

Formalization scope

  • Rd\mathbb R^dRd is EuclideanSpace ℝ (Fin d) and z′ξz'\xiz′ξ is ⟪z, ξ⟫_ℝ. Decision and parameter spaces coincide (nz=dn_z=dnz​=d), as the cost z′ξz'\xiz′ξ requires.
  • Z\mathcal ZZ is polytope P qv, with the hypotheses that it is nonempty and bounded (§1 of the paper assumes Z\mathcal ZZ nonempty and compact; the polytope is closed).
  • The maximum and minimum of z′vz'vz′v over Z\mathcal ZZ and the argmin set are the published definitions SmartPTO.Fisher.xi, SmartPTO.Fisher.zstar and SmartPTO.Fisher.Wstar; "symmetric about its mean" is the published SmartPTO.Fisher.CentrallySymmetric.
  • z∗z^*z∗ is a function zsel with the hypothesis that zsel ξ is a minimizer for every ξ\xiξ, and it is assumed measurable (needed for E[z∗(ξ)]\mathbb E[z^*(\xi)]E[z∗(ξ)]; not on the page). The theorem holds for every such selection; uniqueness of minimizers is not assumed.
  • The law is a probability measure μ\muμ. Assumption 5a is two hypotheses: μ≪\mu\llμ≪ Lebesgue and μ(Rd∖U)=0\mu(\mathbb R^d\setminus\mathcal U)=0μ(Rd∖U)=0. Full support is not assumed and would contradict the second. Assumption 5b is integrability of ξ\xiξ plus z∗(ξˉ)′ξˉ>0z^*(\bar\xi)'\bar\xi>0z∗(ξˉ​)′ξˉ​>0 with ξˉ=∫ξ dμ\bar\xi=\int\xi\,d\muξˉ​=∫ξdμ.
  • The goal is stated on E[L(ξ,ζ)]\mathbb E[L(\xi,\zeta)]E[L(ξ,ζ)], the first display of the proof, not on the linear programme (16) with its auxiliary variables; for this cost the two coincide by LP duality (Proposition 3's proof), and Theorem 3 is the population, m=1m=1m=1 version.
  • Expectations are Bochner integrals, which return 000 for non-integrable integrands. Under the stated hypotheses ξ↦L(ξ,ζ)\xi\mapsto L(\xi,\zeta)ξ↦L(ξ,ζ) is dominated by (∥ξ∥1+4∥ζ∥1)max⁡z∈Z∥z∥∞(\|\xi\|_1+4\|\zeta\|_1)\max_{z\in\mathcal Z}\|z\|_\infty(∥ξ∥1​+4∥ζ∥1​)maxz∈Z​∥z∥∞​ and is integrable, so the goal is not satisfied by junk values; integrability and measurability hypotheses must not be weakened.
  • The Wasserstein clause uses an extended nonnegative integral for WWW. This expresses the theorem without adding a second-moment hypothesis absent from Assumption 5. With a finite second moment it is the usual squared Wasserstein objective; with an infinite second moment every one-atom value is infinite, so the clause has only the extended-value meaning.

Useful infrastructure, reusable beyond this mission: support functions of polytopes and their directional derivatives; the fact that a linear function has a unique minimizer over a polytope for Lebesgue-almost every cost vector; differentiation of convex integral functionals under the integral sign. Contributions of any of these as stand-alone lemmas are welcome.

The source is the authors' accepted manuscript (MIT DSpace, "Submitted to Operations Research"), not the published article; all page and theorem numbers refer to the manuscript, whose printed page numbers equal its PDF page numbers.

Selected references

  • D. Bertsimas and N. Mundru, Optimization-based Scenario Reduction for Data-Driven Two-stage Stochastic Optimization, Operations Research, 2023 (author manuscript, MIT DSpace). https://doi.org/10.1287/opre.2022.2265
  • A. N. Elmachtoub and P. Grigas, Smart "Predict, then Optimize", Management Science 68(1), 2022. https://doi.org/10.1287/mnsc.2020.3922
  • J. Dupačová, N. Gröwe-Kuska and W. Römisch, Scenario reduction in stochastic programming: an approach using probability metrics, Mathematical Programming 95, 2003. https://doi.org/10.1007/s10107-002-0331-0
  • N. Rujeerapaiboon, K. Schindler, D. Kuhn and W. Wiesemann, Scenario Reduction Revisited: Fundamental Limits and Guarantees, Mathematical Programming 191, 2022. https://doi.org/10.1007/s10107-018-1269-1
9 thms0 active usersReviewed
PreviousPage 68 of 69Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me