Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in
← Collections

The OR Formalization Drive

Help us formalize the operations research literature in Lean.

491 open missions

Missions

81–100 of 491
OpenCompletedAll
Operations ResearchProbabilityStochastic Systems·Captain: Shuze Chen

Processing Networks III: Fluid Model Stability Implies SPN StabilityTextbook

Motivation

A stochastic processing network (SPN) — buffers holding waiting work, activities that consume items from buffers and produce items into others, driven by stochastic arrivals and service requirements — is stable, in the sense of mission I's Definition 3.6, exactly when its ambient Markov chain is positive recurrent. That definition is correct, but it is a statement about an infinite-state continuous-time Markov chain, and Markov chains of that kind almost never admit a hand-computed stationary distribution or a directly verifiable positive-recurrence criterion for anything beyond the smallest examples. What is needed is a method that turns "is this specific queueing network, under this specific control policy, stable?" into a tractable, purely deterministic question. J. G. Dai and J. Michael Harrison's Processing Networks: Fluid Models and Stability (Cambridge University Press, forthcoming; cited here from the authors' pre-publication draft, 2020-4-2, http://spnbook.org) supplies exactly this method in Chapter 6, and the theorem that licenses it — Theorem 6.2 — is introduced by the authors themselves as "the fulcrum that supports all other results developed in this book." Every stability theorem in the remaining eight chapters of the book (feedforward and generalized Jackson networks, the Rybko–Stolyar boundary, back-pressure control, proportionally fair allocation, task allocation, packet networks) is an application of this one theorem to a model-specific fluid model.

The method traces to Rybko and Stolyar's 1992 study of a single two-station network and to J. G. Dai's 1995 unification of fluid-limit stability arguments across general queueing networks (Annals of Applied Probability 5, 49–77), with independent contemporaneous work by A. Stolyar for discrete state spaces and a parallel probabilistic route through reflecting Brownian motion due to Dupuis and Williams (1994). This mission formalizes the version of the argument specific to Dai and Harrison's general SPN framework.

Setting

Under a fixed control policy, an SPN with III buffers and JJJ activities generates four continuous-time processes: the cumulative departure process D(t)∈Z+ID(t) \in \mathbb{Z}_+^ID(t)∈Z+I​, the cumulative service-completion process F(t)∈Z+JF(t) \in \mathbb{Z}_+^JF(t)∈Z+J​, the cumulative service-effort process T(t)∈R+JT(t) \in \mathbb{R}_+^JT(t)∈R+J​, and the buffer-contents process Z(t)∈Z+IZ(t) \in \mathbb{Z}_+^IZ(t)∈Z+I​. The model's first-order data — the I×JI \times JI×J material-requirement matrix BBB, the I×JI \times JI×J expected-output matrix Γ\GammaΓ, the vector mmm of mean service times, the K×JK \times JK×J capacity-consumption matrix AAA, the KKK-vector bbb of server-pool capacities, and the vector λ\lambdaλ of external arrival rates — determine six basic relationships that Chapter 2 derives directly from the SPN's construction, and that this mission packages as IsFluidModelSolution.

To study scaling limits, Section 6.3 constructs, on one common probability space, a whole family of versions of the SPN's processes, one for each initial state xxx of the ambient chain: the superscripted Dx,Fx,Tx,ZxD^x, F^x, T^x, Z^xDx,Fx,Tx,Zx. Writing ∣x∣|x|∣x∣ for the total initial buffer content, the fluid-scaled processes are

(D^x,F^x,T^x,Z^x)(t,ω):=1∣x∣(Dx,Fx,Tx,Zx)(∣x∣t,ω),t≥0.\big(\hat D^x, \hat F^x, \hat T^x, \hat Z^x\big)(t,\omega) := \tfrac{1}{|x|}\big(D^x, F^x, T^x, Z^x\big)(|x|t, \omega), \qquad t \ge 0.(D^x,F^x,T^x,Z^x)(t,ω):=∣x∣1​(Dx,Fx,Tx,Zx)(∣x∣t,ω),t≥0.

A fluid limit path (Definition 6.6) is any limit of such a family, along a sequence of initial states with ∣xn∣→∞|x_n| \to \infty∣xn​∣→∞, uniform on compact time intervals (u.o.c.). A fluid model solution is any four-tuple satisfying the six equations above, whether or not it arises as an actual limit — a purely deterministic notion.

Formalization targets

Goal: Theorem 6.2 — fluid limit stability implies SPN stability

fluid limit of the SPN is stable⟹ambient Markov chain X is positive recurrent,\text{fluid limit of the SPN is stable} \quad\Longrightarrow\quad \text{ambient Markov chain } X \text{ is positive recurrent},fluid limit of the SPN is stable⟹ambient Markov chain X is positive recurrent,

where "fluid limit... is stable" (Definition 6.1) means: there is γ>0\gamma > 0γ>0 such that every fluid limit path (D^,F^,T^,Z^)(\hat D, \hat F, \hat T, \hat Z)(D^,F^,T^,Z^) has Z^(t)=0\hat Z(t) = 0Z^(t)=0 for all t≥γ∣Z^(0)∣t \ge \gamma |\hat Z(0)|t≥γ∣Z^(0)∣. This is the weakest possible target: it asserts only that fluid limit paths are eventually driven to zero, with no rate or further structure attached, and it is exactly the hypothesis every later chapter's Lyapunov argument is built to establish.

Supporting milestones

Theorem 6.5 (existence of fluid limits): along any sequence of initial states with ∣xn∣→∞|x_n| \to \infty∣xn​∣→∞, the fluid-scaled processes have a u.o.c.-convergent subsequence, and every such limit is automatically a fluid model solution — the bridge from the purely equational Definition 6.3 (used by every later chapter) to the genuinely stochastic Definition 6.1 (needed by this theorem). Its proof rests on two convergence lemmas (6.7: compactness of the scaled service-effort process via an equicontinuity argument; 6.8: the scaled completion process converges exactly when the scaled effort process does) and, behind Lemma 6.8, a uniform strong law of large numbers for a "delayed" random walk (Lemma 6.9). A separate uniform-integrability result (Lemma 6.10) supplies the remaining ingredient the goal theorem's proof needs to convert an almost-sure fluid-scale limit into the expectation bound mission I's Lemma 3.7 requires.

Significance

The result itself. Theorem 6.2 converts a probabilistic stability question about an infinite-state Markov chain into a real-analysis question about a deterministic dynamical system: does every solution of a fixed, checkable system of equations reach zero in finite time, uniformly in its starting size? Every one of the book's remaining eight chapters answers a version of this question for a specific policy and concludes SPN stability via this theorem alone — none of them re-derives positive recurrence directly.

Formalizing it. No prior formalization of fluid limits, fluid models, or scaling-limit stability of any stochastic system exists on Prove2Me (q=fluid limit, q=fluid model, q=u.o.c. convergence, q=queueing network stability all return zero hits). This mission is a from-scratch formalization of the model data, the fluid equations, the per-state process family, and the two notions of fluid stability, together with the five supporting results and the goal theorem that connects them — the shared infrastructure the rest of the fourteen-mission series depends on.

Difficulty

The obvious shortcut — state Theorem 6.2 using fluid model stability (Definition 6.3, the purely equational notion) in place of fluid limit stability (Definition 6.1) — would produce a strictly easier, unfaithful theorem: fluid model solutions are not restricted to arise as actual scaling limits, so the genuine content of Theorem 6.2 (that convergence of a stochastic family forces a probabilistic conclusion) would be lost, and the theorem would reduce to a tautology once Theorem 6.5 is assumed. The two notions are visually almost identical in the book's own text ("γ∣Z^(0)∣\gamma|\hat Z(0)|γ∣Z^(0)∣-attraction to the origin," applied to two different objects) and keeping them distinct is this mission's central discipline. A second difficulty is that Mathlib has no existing theory of stochastic-process scaling limits, u.o.c. convergence, or the specific renewal/SLLN machinery (Lemma 6.9's uniform strong law for a state-dependent "delayed" random walk) the proof needs — every one of these had to be defined from the ground up rather than instantiated from a general framework.

Formalization scope

The ambient chain's state space is an arbitrary countable type, following mission 01; the per-state process family SPNProcessFamily takes Dx,Fx,Tx,ZxD^x, F^x, T^x, Z^xDx,Fx,Tx,Zx as given real-valued functions satisfying exactly the pathwise properties (Eqs. 2.31–2.32) that Section 6.4's proofs use, since Chapter 2's construction of these processes from primitive stochastic elements is that chapter's own "recap" of already-established facts, not a numbered result of Chapter 6. UOCConverges is stated by its direct ε\varepsilonε-NNN-on-every-compact-interval meaning, and Lemma 6.9's "sup⁡x\sup_xsupx​" is likewise stated by its direct ε\varepsilonε-NNN meaning rather than a Lean supremum expression, because the state space may be countably infinite and an explicit supremum over an unbounded-above family of reals would silently collapse to a junk value of zero in that case — a real risk of trivializing the statement that this formalization avoids outright. A formalization that reused FluidModelStable as the goal theorem's hypothesis, or that dropped ∣Z^(0)∣=1|\hat Z(0)|=1∣Z^(0)∣=1 from Theorem 6.5, would each be a trivializing shortcut of exactly the kind ruled out above. The five definitions (FluidEquationData, IsFluidModelSolution, SPNProcessFamily, FluidLimitPath, FluidLimitStable) are the primary reusable contribution — the shared vocabulary every later mission in the series restates in its own namespace, since drafts do not import one another. Contributions completing the six by sorry proofs are welcome.

Selected references

  • J. G. Dai and J. Michael Harrison, Processing Networks: Fluid Models and Stability, Cambridge University Press (forthcoming), pre-publication draft 2020-4-2. http://spnbook.org
  • J. G. Dai, "On positive Harris recurrence of multiclass queueing networks: a unified approach via fluid limit models," Annals of Applied Probability 5 (1995), 49–77.
  • A. N. Rybko and A. L. Stolyar, "Ergodicity of stochastic processes describing the operation of open queueing networks," Problemy Peredachi Informatsii 28 (1992), 3–26.
  • P. Dupuis and R. J. Williams, "Lyapunov functions for semimartingale reflecting Brownian motions," Annals of Probability 22 (1994), 680–702.
11 thms3 active usersReviewed
Operations ResearchProbabilityStochastic Systems·Captain: Shuze Chen

Processing Networks IV: Fluid Equations for Non-Idling, Priority and FCFS ControlTextbook

Motivation

Mission III's Theorem 6.2 — "fluid limit stability implies SPN stability" — converts a probabilistic stability question into a real-analysis question, but it only supplies the generic fluid equations (6.1)-(6.6), which hold under any control policy and therefore say nothing policy-specific: (6.1)-(6.6) alone never force a fluid path to reach zero. To actually prove a concrete queueing network stable, one must first identify the extra fluid equation a specific policy forces on every fluid limit path, and prove that this extra equation genuinely holds — a task the book calls "justifying" the equation "through the same fluid limit procedure used in the proof of Theorem 6.5." J. G. Dai and J. Michael Harrison's Processing Networks: Fluid Models and Stability (Cambridge University Press, forthcoming; cited here from the authors' pre-publication draft, 2020-4-2, http://spnbook.org) carries out this derivation for four control-policy families in Chapter 7, laying the groundwork every later stability chapter of the book (feedforward networks, the Rybko–Stolyar boundary, back-pressure, proportional fairness, task allocation) builds on.

The first-come-first-served (FCFS) analysis traces to Rybko and Stolyar's 1992 fluid-scaling argument and was first stated in closed form as Eq. (2.6) of M. Bramson's 1996 paper on FCFS queueing networks; Bramson also showed by example (1994) that FCFS networks can be unstable even under the standard load condition, motivating the need for a precise fluid-equation characterization rather than an informal one.

Setting

A queueing network (Section 2.6) is an SPN with one activity per buffer: buffer/class iii is served by a unique pool p(i)p(i)p(i), and on completion a class-iii job becomes class jjj with probability PijP_{ij}Pij​ (the routing matrix). I(k)I(k)I(k) denotes the set of classes served by pool kkk. The fluid equations (6.1)-(6.6) specialize accordingly: consumption is the identity (D^=F^\hat D = \hat FD^=F^) and the output matrix is Γij=Pji\Gamma_{ij} = P_{ji}Γij​=Pji​.

Three control-policy families are studied. A policy is non-idling if no server sits idle while a job waits in one of its buffers. A static buffer priority (SBP) policy is non-idling and additionally orders same-pool classes by a fixed priority permutation σ\sigmaσ, always serving the highest-priority non-empty class first; it is non-preemptive if a job's service, once begun, is never interrupted by a later higher-priority arrival. Under FCFS, jobs at a pool are served strictly in arrival order — the workload-based analysis of Section 7.3. Section 7.4 studies a fourth, more general family: a unitary network (one service type per class) under a relaxed control policy β=h(z^)\beta = h(\hat z)β=h(z^), where z^\hat zz^ is the updated job-count vector and hhh is any capacity-respecting, degree-zero-homogeneous function (Assumption 7.6) — a family general enough to include non-idling and SBP policies as special cases, and to anticipate the proportionally fair allocation studied in Chapters 9-10.

Formalization targets

Goal: Theorem 7.5 — the FCFS fluid equation

For a queueing network under FCFS control, every fluid limit path (D^,F^,T^,Z^)(\hat D, \hat F, \hat T, \hat Z)(D^,F^,T^,Z^) satisfies (6.1)-(6.6) and

D^i(t+W^k(t))=G^i(t),t≥0, i∈I(k), k∈K,\hat D_i\big(t + \hat W_k(t)\big) = \hat G_i(t), \qquad t \ge 0,\ i \in I(k),\ k \in K,D^i​(t+W^k​(t))=G^i​(t),t≥0, i∈I(k), k∈K,

where G^i(t)=λit+∑jPjiD^j(t)\hat G_i(t) = \lambda_i t + \sum_j P_{ji}\hat D_j(t)G^i​(t)=λi​t+∑j​Pji​D^j​(t) is the fluid arrival rate into class iii and W^k(t)=∑i∈I(k)miZ^i(t)\hat W_k(t) = \sum_{i \in I(k)} m_i \hat Z_i(t)W^k​(t)=∑i∈I(k)​mi​Z^i​(t) is pool kkk's fluid-scaled immediate workload. This is the weakest natural target: an identity that pins down exactly the time-shift FCFS imposes, without asserting anything about how quickly or whether the fluid model reaches zero (that is left to the Lyapunov arguments of later chapters, once this equation is in hand).

Supporting milestones

Theorem 7.2 (non-idling): ∑i∈I(k)Z^i(t)>0\sum_{i\in I(k)} \hat Z_i(t) > 0∑i∈I(k)​Z^i​(t)>0 forces pool kkk's aggregate service rate to run at full capacity bkb_kbk​. Theorem 7.3 (non-preemptive SBP): the same conclusion with I(k)I(k)I(k) sharpened to the priority set H(j)H(j)H(j) (Eq. 7.5), for every buffer jjj. Theorem 7.8 (general relaxed control): under Assumption 7.6, Z^i(t)>0\hat Z_i(t) > 0Z^i​(t)>0 forces T^i\hat T_iT^i​'s derivative to equal hi(Z^(t))h_i(\hat Z(t))hi​(Z^(t)) exactly — the common generalization from which the non-idling and SBP fluid equations both follow as special cases of a suitable hhh.

Significance

The result itself. Theorem 7.5 is the precise bridge that lets FCFS-specific stability questions be attacked by the Lyapunov-function method Theorem 6.2 licenses: without a closed-form fluid equation, "does an FCFS network satisfy the standard load condition stably?" has no tractable deterministic reformulation. Bramson's 1994 example (an FCFS network unstable despite satisfying the standard load condition) shows the equation's content is not vacuous — FCFS fluid limits genuinely can misbehave, and this equation is precisely what any subsequent stability or instability argument for FCFS networks must reason about.

Formalizing it. No result about FCFS, non-idling, static-buffer-priority, or general relaxed control policies exists on Prove2Me (q=first-come-first-served, q=FCFS, q=priority policy all return zero hits, consistent with triage.json's record that none of this book's Chapters 6-14 machinery is on the platform). This mission is a from-scratch formalization of queueing networks, their three named control-policy families, and the four policy-specific fluid equations Chapter 7 derives for them.

Difficulty

The obvious shortcut for Theorem 7.3 — reuse Theorem 7.2's hypothesis and conclusion verbatim with I(k)I(k)I(k) replaced by H(j)H(j)H(j) — conflates the preemptive and non-preemptive SBP policies: Remark 7.4 explicitly notes the underlying pathwise identity (7.4) (used directly by Theorem 7.2) holds unconditionally under preemption but only asymptotically, via a vanishing-remainder argument bounding the leftover processing time of interrupted-but-continuing jobs, under non-preemption — the theorem actually being formalized is about the harder, non-preemptive case. For Theorem 7.5, the central difficulty is that FCFS's defining property is a genuinely time-shifted identity (departures at t+W^k(t)t + \hat W_k(t)t+W^k​(t) match arrivals at ttt), not a same-instant conditional statement like the non-idling and SBP equations — an approach that tried to state FCFS as a same-instant condition on T^\hat TT^ or D^\hat DD^ alone, without introducing the auxiliary workload process W^\hat WW^, could not express the theorem's actual content. A further subtlety Theorem 7.8's proof flags directly (Remark 7.9) is that the tempting converse — "Z^i(t)=0\hat Z_i(t) = 0Z^i​(t)=0 implies zero service rate" — is false in general (a corrected version appears only later, as Lemma 8.9); this mission's goal and milestone statements are careful to assert only the one-directional implication the book actually proves.

Formalization scope

Mission III's fluid-limit-path apparatus (Definition 6.6, u.o.c. convergence) is restated locally in this chapter's own namespace rather than imported, since drafts in this series do not import one another; the restatement is trimmed to the four raw processes (Dx,Fx,Tx,Zx)(D^x,F^x,T^x,Z^x)(Dx,Fx,Tx,Zx) this chapter's proofs need, omitting mission III's "delayed random walk" machinery. The non-idling and non-preemptive-SBP hypotheses are both formalized via one shared predicate, FullyUtilized, applied to different index sets (I(k)I(k)I(k) vs. H(j)H(j)H(j)) — the pathwise full-utilization identity (7.4) that each policy's proof establishes for its own priority classes, taken as a hypothesis rather than re-derived from a lower-level model of server scheduling (Chapter 2's construction of the service-starting mechanism is out of scope for this chapter, exactly as it was for mission III's SPNProcessFamily). Likewise, the FCFS goal theorem hypothesizes the raw identity (7.12) (rewritten via the material-balance equation to avoid needing the raw arrival process) and the fluid-scaled limit of the raw workload process (7.17), rather than re-deriving either from the "delayed random walk" VVV of Eq. (6.47). A formalization that dropped the workload shift W^k(t)\hat W_k(t)W^k​(t) from Theorem 7.5's conclusion, or that stated Theorem 7.8's converse implication (which Remark 7.9 explicitly disclaims), would each be an unfaithful trivialization or overstatement ruled out here. QueueingNetworkData, ProcessFamily, FullyUtilized, and SatisfiesAssumption76 are the primary reusable contributions of this mission; contributions completing the four by sorry proofs — each of which needs the u.o.c.-convergence and dominated-convergence arguments mission III's own proofs still lack — are welcome.

Selected references

  • J. G. Dai and J. Michael Harrison, Processing Networks: Fluid Models and Stability, Cambridge University Press (forthcoming), pre-publication draft 2020-4-2. http://spnbook.org
  • M. Bramson, "Convergence to equilibria for fluid models of FIFO queueing networks," Queueing Systems 22 (1996), 5–45.
  • M. Bramson, "Instability of FIFO queueing networks," Annals of Applied Probability 4 (1994), 414–431.
  • A. N. Rybko and A. L. Stolyar, "Ergodicity of stochastic processes describing the operation of open queueing networks," Problemy Peredachi Informatsii 28 (1992), 3–26.
9 thms2 active usersReviewed
Dynamic ProgrammingOperations ResearchProbability+1·Captain: mikedeng1

On the Optimal Dividend Problem for a Spectrally Negative Lévy Process I: Optimality of the Barrier Strategy at c* in the Classical Dividend ProblemResearch Paper

Motivation

An insurance company's surplus grows with premiums and falls with claims. In the Cramér–Lundberg model with a positive safety loading, the surplus drifts to +∞+\infty+∞ with probability one. De Finetti (1957) objected that a company does not accumulate capital indefinitely: surplus above some level is paid out to shareholders. He proposed choosing the payout policy to maximize the expected discounted dividends paid before ruin. This is the optimal dividend problem. It is one of the basic stochastic control problems of actuarial mathematics and corporate finance, and it serves as a test case for singular control of processes with jumps.

The classical answer is a barrier strategy: pay out whatever lifts the surplus above a level aaa and nothing else. Jeanblanc and Shiryaev (1995) proved this optimal when the surplus is a Brownian motion with drift, and Gerber and Shiu studied the same Brownian setting. Azcue and Muler (2005) showed that it can fail in the Cramér–Lundberg model, where the optimal policy may be a band strategy. Avram, Palmowski and Pistorius (Ann. Appl. Probab. 17 (2007) 156–180) treated a general spectrally negative Lévy process, a process with stationary independent increments and only downward jumps. They found the value of every barrier strategy in closed form through the scale function of the process and identified the best barrier level c∗c^*c∗. They also gave a verification condition under which the barrier at c∗c^*c∗ is optimal among all strategies. Loeffen (2008) later showed that the condition holds whenever the Lévy measure has a completely monotone density.

Setting

Let X=(Xt)t≥0X=(X_t)_{t\ge0}X=(Xt​)t≥0​ be a spectrally negative Lévy process on a filtered probability space (Ω,F,F,P)(\Omega,\mathcal F,\mathbb F,P)(Ω,F,F,P) with X0=0X_0=0X0​=0 and Lévy triplet (c,σ,ν)(c,\sigma,\nu)(c,σ,ν). Its Laplace exponent is ψ(θ)=log⁡E[eθX1]\psi(\theta)=\log\mathbf E[e^{\theta X_1}]ψ(θ)=logE[eθX1​], finite for θ≥0\theta\ge0θ≥0:

ψ(θ)=cθ+σ22θ2+∫(−∞,0)(eθy−1−θy1{∣y∣<1})ν(dy).\psi(\theta)=c\theta+\tfrac{\sigma^2}{2}\theta^2+\int_{(-\infty,0)}\bigl(e^{\theta y}-1-\theta y\mathbf 1_{\{|y|<1\}}\bigr)\nu(dy).ψ(θ)=cθ+2σ2​θ2+∫(−∞,0)​(eθy−1−θy1{∣y∣<1}​)ν(dy).

Increments after time sss are independent of Fs\mathcal F_sFs​. Initial capital xxx is added to XXX. The standing assumptions are the following: XXX does not have monotone paths, E[X1]>−∞\mathbf E[X_1]>-\inftyE[X1​]>−∞, and either σ>0\sigma>0σ>0, ∫(−1,0)∣y∣ ν(dy)=∞\int_{(-1,0)}|y|\,\nu(dy)=\infty∫(−1,0)​∣y∣ν(dy)=∞, or ν\nuν has a density.

A dividend strategy is a nondecreasing, left-continuous, adapted process LLL with L0=0L_0=0L0​=0. The risk process is Ut=x+Xt−LtU_t=x+X_t-L_tUt​=x+Xt​−Lt​ and the ruin time is σL=inf⁡{t≥0:Ut<0}\sigma^L=\inf\{t\ge0:U_t<0\}σL=inf{t≥0:Ut​<0}. The strategy is admissible (L∈ΠL\in\PiL∈Π) if no lump sum exceeds the current reserves. Its value is

vL(x)=E[∫0σLe−qt dLt],v∗(x)=sup⁡L∈ΠvL(x),v_L(x)=\mathbf E\Bigl[\int_0^{\sigma^L}e^{-qt}\,dL_t\Bigr],\qquad v_*(x)=\sup_{L\in\Pi}v_L(x),vL​(x)=E[∫0σL​e−qtdLt​],v∗​(x)=L∈Πsup​vL​(x),

with discount rate q>0q>0q>0. For C∈[0,∞]C\in[0,\infty]C∈[0,∞], Π≤C\Pi_{\le C}Π≤C​ consists of the admissible strategies that keep Ut≤CU_t\le CUt​≤C for t>0t>0t>0.

The qqq-scale function W=W(q)W=W^{(q)}W=W(q) is the unique continuous nondecreasing function on [0,∞)[0,\infty)[0,∞) with ∫0∞e−θyW(y) dy=1/(ψ(θ)−q)\int_0^\infty e^{-\theta y}W(y)\,dy=1/(\psi(\theta)-q)∫0∞​e−θyW(y)dy=1/(ψ(θ)−q) for large θ\thetaθ. It is extended by W=0W=0W=0 on (−∞,0)(-\infty,0)(−∞,0). The barrier strategy πa\pi_aπa​ reflects x+Xx+Xx+X at the level aaa, paying (x−a)+(x-a)^+(x−a)+ at time 000. The paper computes its value

va(x)=W(x)W′(a) (0≤x≤a),va(x)=x−a+W(a)W′(a) (x>a),v_a(x)=\frac{W(x)}{W'(a)}\ (0\le x\le a),\qquad v_a(x)=x-a+\frac{W(a)}{W'(a)}\ (x>a),va​(x)=W′(a)W(x)​ (0≤x≤a),va​(x)=x−a+W′(a)W(a)​ (x>a),

and the optimal barrier level is c∗=inf⁡{a>0:W′(a)≤W′(x) ∀x>0}c^*=\inf\{a>0: W'(a)\le W'(x)\ \forall x>0\}c∗=inf{a>0:W′(a)≤W′(x) ∀x>0}, read as 000 when this set is empty and W′(0+)≤W′(x)W'(0+)\le W'(x)W′(0+)≤W′(x) for all x>0x>0x>0. The generator is

Γf(x)=σ22f′′(x)+cf′(x)+∫(−∞,0)[f(x+y)−f(x)−f′(x)y1{∣y∣<1}] ν(dy).\Gamma f(x)=\tfrac{\sigma^2}{2}f''(x)+cf'(x)+\int_{(-\infty,0)}[f(x+y)-f(x)-f'(x)y\mathbf 1_{\{|y|<1\}}]\,\nu(dy).Γf(x)=2σ2​f′′(x)+cf′(x)+∫(−∞,0)​[f(x+y)−f(x)−f′(x)y1{∣y∣<1}​]ν(dy).

Formalization targets

Goal: Theorem 2 (p. 14)

Assume σ>0\sigma>0σ>0, or XXX has bounded variation, or vc∗∈C2(0,∞)v_{c^*}\in C^2(0,\infty)vc∗​∈C2(0,∞). Then c∗<∞c^*<\inftyc∗<∞ and:

(i)πc∗∈Π≤c∗,vπc∗(x)=vc∗(x)=sup⁡π∈Π≤c∗vπ(x)(x≥0);\text{(i)}\quad \pi_{c^*}\in\Pi_{\le c^*},\qquad v_{\pi_{c^*}}(x)=v_{c^*}(x)=\sup_{\pi\in\Pi_{\le c^*}}v_\pi(x)\quad(x\ge0);(i)πc∗​∈Π≤c∗​,vπc∗​​(x)=vc∗​(x)=π∈Π≤c∗​sup​vπ​(x)(x≥0); (ii)(Γvc∗−qvc∗)(x)≤0  ∀x>c∗ ⟹ v∗(x)=vc∗(x) (x≥0),  π∗=πc∗.\text{(ii)}\quad (\Gamma v_{c^*}-qv_{c^*})(x)\le0\ \ \forall x>c^*\ \Longrightarrow\ v_*(x)=v_{c^*}(x)\ (x\ge0),\ \ \pi_*=\pi_{c^*}.(ii)(Γvc∗​−qvc∗​)(x)≤0  ∀x>c∗ ⟹ v∗​(x)=vc∗​(x) (x≥0),  π∗​=πc∗​.

The goal fixes no constants: the barrier level and the value function are both given by the scale function of the given process.

Milestones

  • Proposition 1 (p. 7): vπa(x)=W(x)/W′(a)v_{\pi_a}(x)=W(x)/W'(a)vπa​​(x)=W(x)/W′(a) for a>0a>0a>0, x∈[0,a]x\in[0,a]x∈[0,a].
  • Lemma 2(i) (p. 15): c∗<∞c^*<\inftyc∗<∞.
  • Proposition 3(i) (p. 15): va(x)≤vc∗(x)v_a(x)\le v_{c^*}(x)va​(x)≤vc∗​(x) for x∈[0,c∗]x\in[0,c^*]x∈[0,c∗], a≥0a\ge0a≥0.
  • Lemma 3(i) (p. 16): vc∗′(x)≥1v_{c^*}'(x)\ge1vc∗′​(x)≥1 for x>0x>0x>0.
  • Proposition 4(i) (p. 18): a C2C^2C2 (unbounded variation) or C1C^1C1 (bounded variation) solution www of max⁡{Γw−qw,1−w′}=0\max\{\Gamma w-qw,1-w'\}=0max{Γw−qw,1−w′}=0 on (0,C)(0,C)(0,C) dominates sup⁡Π≤Cvπ\sup_{\Pi_{\le C}}v_\pisupΠ≤C​​vπ​.
  • Lemma 4 (p. 20): (Γvc∗−qvc∗)(x)=0(\Gamma v_{c^*}-qv_{c^*})(x)=0(Γvc∗​−qvc∗​)(x)=0 on (0,c∗)(0,c^*)(0,c∗) when c∗>0c^*>0c∗>0.

Significance

The theorem gives an explicit solution to a singular control problem for a general Lévy model. The candidate value function and barrier level are expressed through one special function, W(q)W^{(q)}W(q), and optimality over all strategies reduces to one inequality on (c∗,∞)(c^*,\infty)(c∗,∞). It is the basis of the later literature on scale-function methods in dividend problems (Loeffen 2008, Kyprianou–Rivero–Song 2010, and the refracted and Parisian variants). Part (i) holds with no condition on the Lévy measure. Part (ii) shows exactly where barrier optimality can fail.

The paper's proofs use fluctuation identities (exit problems, excursion theory) and Itô's formula for semimartingales with jumps. None of these is in Mathlib. As far as is known, none of these results has been machine-checked. A formalization would produce a Lévy-process and scale-function layer, a formal model of singular control with jumps and lump-sum payments, and a checked verification argument. Each of these can be reused beyond this paper.

Difficulty

The analytic part is elementary once the value formula (5.1) is available: the choice of c∗c^*c∗, Proposition 3(i) and Lemma 3(i) follow from the shape of W′W'W′. The difficulty lies in the two probabilistic steps. Proposition 1 identifies the value of a reflected process through exit identities for XXX. Those identities rest on excursion theory, or on the martingale property of e−qtW(Xt)e^{-qt}W(X_t)e−qtW(Xt​) up to exit. The verification step, Proposition 4(i), needs Itô's formula for w(Ut)w(U_t)w(Ut​). Here UUU is a jump process controlled by a left-continuous finite-variation process that may itself jump. The change-of-variables formula must also run under only C1C^1C1 regularity when XXX has bounded variation. Just proving that Γw−qw≤0\Gamma w-qw\le0Γw−qw≤0 and w′≥1w'\ge1w′≥1 imply a supermartingale inequality does not settle the question: the lump-sum payments and the jumps of XXX enter the Itô expansion separately and must each be bounded.

Formalization scope

Time is [0,∞)[0,\infty)[0,∞) (ℝ≥0). XXX is a structure carrying the triplet (c,σ,ν)(c,\sigma,\nu)(c,σ,ν) and pathwise càdlàg paths with only downward jumps. It also carries independence of increments from the filtration and stationarity. Its law is fixed by the Laplace transform E[eθXt]=etψ(θ)\mathbf E[e^{\theta X_t}]=e^{t\psi(\theta)}E[eθXt​]=etψ(θ) for θ≥0\theta\ge0θ≥0. The standing assumptions of §2 and (3.3) are bundled as one predicate. The scale function is a hypothesis on a function argument WWW (it is unique). W′(0+)W'(0+)W′(0+) is an extended real, since it is +∞+\infty+∞ for unbounded variation without a Gaussian part.

Values of strategies and value functions lie in [0,∞][0,\infty][0,∞]. The dividend integral is a Lebesgue–Stieltjes integral over [0,σL)∪{0}[0,\sigma^L)\cup\{0\}[0,σL)∪{0}: it counts the lump sum at time 000 and excludes a payment at the ruin instant.

Several conventions are fixed, and each is disclosed in the item it affects:

  • Admissibility. The paper requires Lt+−Lt<UtL_{t+}-L_t<U_tLt+​−Lt​<Ut​. The formalization uses ≤\le≤, because the paper's own strategy of paying out everything at once needs it.
  • Barrier level (5.2). Printed over a>0a>0a>0 and "all xxx", the defining set is empty for Brownian motion with nonpositive drift. The printed set (with x>0x>0x>0) is kept whenever it is nonempty; when it is empty and W′(0+)≤W′(x)W'(0+)\le W'(x)W′(0+)≤W′(x) for all x>0x>0x>0 — the second alternative in the proof of Lemma 2(i) — c∗=0c^*=0c∗=0, and otherwise c∗=∞c^*=\inftyc∗=∞.
  • Printed slips. The integral ∫−10x ν(dx)\int_{-1}^0 x\,\nu(dx)∫−10​xν(dx) in (3.3) is read as ∫∣x∣ ν(dx)\int|x|\,\nu(dx)∫∣x∣ν(dx). In (3.4), e−θxe^{-\theta x}e−θx is read as e−θye^{-\theta y}e−θy, and in Theorem 2(i), πc∗\pi^*_cπc∗​ is read as πc∗\pi_{c^*}πc∗​.
  • Proposition 4(i) is stated for initial capital x≤Cx\le Cx≤C. Beyond CCC, www is unconstrained and the printed claim fails.
  • Lemma 4 carries the smoothness proviso of Theorem 2 on (0,c∗)(0,c^*)(0,c∗).

A trivializing encoding is ruled out: the value is not a real supremum, the barrier strategy is constructed rather than assumed, and c∗<∞c^*<\inftyc∗<∞ is a conclusion.

A complete development needs:

  • Lévy processes and their Laplace exponents;
  • scale functions and the exit identity Ex[e−qT1{XT=a}]=W(x)/W(a)\mathbf E_x[e^{-qT}\mathbf 1_{\{X_T=a\}}]=W(x)/W(a)Ex​[e−qT1{XT​=a}​]=W(x)/W(a);
  • reflected processes;
  • Itô's formula for jump semimartingales with finite-variation controls.

The Lévy and scale-function layer is shared with the companion mission on the bail-out problem. Contributions of general lemmas (Stieltjes integration by parts, optional stopping for càdlàg martingales) are welcome.

Selected references

  • F. Avram, Z. Palmowski, M. R. Pistorius, On the optimal dividend problem for a spectrally negative Lévy process, Ann. Appl. Probab. 17 (2007) 156–180. https://arxiv.org/abs/math/0702893
  • P. Azcue, N. Muler, Optimal reinsurance and dividend distribution policies in the Cramér–Lundberg model, Math. Finance 15 (2005) 261–308.
  • M. Jeanblanc-Picqué, A. N. Shiryaev, Optimization of the flow of dividends, Russian Math. Surveys 50 (1995) 257–277.
  • R. L. Loeffen, On optimality of the barrier strategy in de Finetti's dividend problem for spectrally negative Lévy processes, Ann. Appl. Probab. 18 (2008) 1669–1680.
  • A. E. Kyprianou, Introductory Lectures on Fluctuations of Lévy Processes with Applications, Springer, 2006. https://doi.org/10.1007/978-3-540-31343-4
61 thms3 active usersReviewed
Dynamic ProgrammingOperations ResearchProbability+1·Captain: mikedeng1

On the Optimal Dividend Problem for a Spectrally Negative Lévy Process II: Optimality of the Double-Barrier Strategy at d* with Bail-Out LoansResearch Paper

Dividends, ruin and bail-out loans

An insurance company's surplus in the Cramér–Lundberg model grows linearly with premiums and falls by claims arriving as a compound Poisson process. When premium income exceeds the expected claims, the surplus drifts to infinity. De Finetti (1957) proposed that the surplus above a barrier should instead be paid to shareholders as dividends, and the resulting optimal dividend problem — maximize the expected discounted dividends — is a central problem of risk theory. A barrier policy, however, drives the surplus below zero with probability one. Harrison and Taylor (1978) and Løkka and Zervos studied, for Brownian motion, a variant with bail-out loans: ruin is forbidden, and the shareholders must inject capital whenever the surplus would become negative, at a cost φ>1\varphi>1φ>1 per unit.

Avram, Palmowski and Pistorius (Ann. Appl. Probab. 17 (2007)) solved the bail-out problem when the surplus is a general spectrally negative Lévy process, which includes the Cramér–Lundberg model, Brownian motion with drift and their sums. They showed that the optimal policy is a double barrier policy for every initial capital. This mission formalizes that result, Theorem 3 of the paper.

Timeline:

  • 1957 — de Finetti introduces dividend barriers.
  • 1978 — Harrison and Taylor: optimal control of a Brownian storage system with two reflecting barriers.
  • 1995 — Jeanblanc and Shiryaev: optimal dividends for Brownian motion with drift.
  • 2004 — Avram, Kyprianou and Pistorius: exit problems for spectrally negative Lévy processes reflected at their infimum and supremum, in terms of scale functions.
  • 2007 — Avram, Palmowski and Pistorius: Theorems 1 and 3 of the present paper; Pistorius' pathwise construction of the doubly reflected process is used.

Setting

A spectrally negative Lévy process X={Xt}t≥0X=\{X_t\}_{t\ge0}X={Xt​}t≥0​ on a filtered probability space (Ω,F,F,P)(\Omega,\mathcal F,\mathbb F,P)(Ω,F,F,P) starts at X0=0X_0=0X0​=0, has càdlàg paths, is F\mathbb FF-adapted, and has stationary increments with Xt−XsX_t-X_sXt​−Xs​ independent of Fs\mathcal F_sFs​. Its jumps are all negative, and E[eθXt]=etψ(θ)E[e^{\theta X_t}]=e^{t\psi(\theta)}E[eθXt​]=etψ(θ) for θ≥0\theta\ge0θ≥0, where the Laplace exponent is

ψ(θ)=cθ+σ22θ2+∫(−∞,0)(eθy−1−θy1{∣y∣<1}) ν(dy).\psi(\theta)=c\theta+\tfrac{\sigma^2}{2}\theta^2+\int_{(-\infty,0)}(e^{\theta y}-1-\theta y\mathbf 1_{\{|y|<1\}})\,\nu(dy).ψ(θ)=cθ+2σ2​θ2+∫(−∞,0)​(eθy−1−θy1{∣y∣<1}​)ν(dy).

With initial capital x≥0x\ge0x≥0 the surplus is x+Xx+Xx+X. The standing assumptions are: XXX does not have monotone paths; E[X1]>−∞E[X_1]>-\inftyE[X1​]>−∞ (so ψ′(0+)=E[X1]\psi'(0+)=E[X_1]ψ′(0+)=E[X1​] is finite); σ>0\sigma>0σ>0, or ∫(−1,0)∣y∣ν(dy)=∞\int_{(-1,0)}|y|\nu(dy)=\infty∫(−1,0)​∣y∣ν(dy)=∞, or ν\nuν has a density (condition (3.3)).

A policy πˉ=(L,R)\bar\pi=(L,R)πˉ=(L,R) consists of nondecreasing adapted processes with L0=R0=0L_0=R_0=0L0​=R0​=0: cumulative dividends LLL (left-continuous) and cumulative injected capital RRR (right-continuous). The controlled surplus is Vt=x+Xt−Lt+RtV_t=x+X_t-L_t+R_tVt​=x+Xt​−Lt​+Rt​. The policy is admissible if Vt≥0V_t\ge0Vt​≥0 for t>0t>0t>0 and ∫0∞e−qtdRt<∞\int_0^\infty e^{-qt}dR_t<\infty∫0∞​e−qtdRt​<∞ almost surely. Its value and the value function are

vˉπˉ(x)=E[∫0∞e−qtdLt−φ∫0∞e−qtdRt],vˉ∗(x)=sup⁡πˉ admissiblevˉπˉ(x),\bar v_{\bar\pi}(x)=E\Bigl[\int_0^\infty e^{-qt}dL_t-\varphi\int_0^\infty e^{-qt}dR_t\Bigr],\qquad \bar v_*(x)=\sup_{\bar\pi\ \text{admissible}}\bar v_{\bar\pi}(x),vˉπˉ​(x)=E[∫0∞​e−qtdLt​−φ∫0∞​e−qtdRt​],vˉ∗​(x)=πˉ admissiblesup​vˉπˉ​(x),

with discount rate q>0q>0q>0 and cost φ>1\varphi>1φ>1. The double-barrier strategy πˉ0,a\bar\pi_{0,a}πˉ0,a​ pays out (x−a)+(x-a)^+(x−a)+ at once and then the minimal dividends and injections that keep VVV in [0,a][0,a][0,a]: dLdLdL is carried by {V=a}\{V=a\}{V=a} and dRdRdR by {V=0}\{V=0\}{V=0}.

The qqq-scale function W=W(q)W=W^{(q)}W=W(q) vanishes on (−∞,0)(-\infty,0)(−∞,0), is continuous and nondecreasing on [0,∞)[0,\infty)[0,∞), and satisfies ∫0∞e−θyW(y)dy=1/(ψ(θ)−q)\int_0^\infty e^{-\theta y}W(y)dy=1/(\psi(\theta)-q)∫0∞​e−θyW(y)dy=1/(ψ(θ)−q) for θ>Φ(q)\theta>\Phi(q)θ>Φ(q), the largest root of ψ=q\psi=qψ=q. Set W‾(y)=∫0yW\overline W(y)=\int_0^yWW(y)=∫0y​W, Z=1+qW‾Z=1+q\overline WZ=1+qW, Z‾(y)=∫0yZ\overline Z(y)=\int_0^yZZ(y)=∫0y​Z. The candidate value of πˉ0,a\bar\pi_{0,a}πˉ0,a​ is

vˉa(x)=φ(Z‾(x)+ψ′(0+)/q)+Z(x)1−φZ(a)qW(a)(0≤x≤a),vˉa(x)=x−a+vˉa(a)(x>a),\bar v_a(x)=\varphi\bigl(\overline Z(x)+\psi'(0+)/q\bigr)+Z(x)\frac{1-\varphi Z(a)}{qW(a)}\quad(0\le x\le a),\qquad \bar v_a(x)=x-a+\bar v_a(a)\quad(x>a),vˉa​(x)=φ(Z(x)+ψ′(0+)/q)+Z(x)qW(a)1−φZ(a)​(0≤x≤a),vˉa​(x)=x−a+vˉa​(a)(x>a),

and the barrier level is d∗=inf⁡{a>0:[φZ(a)−1]W′(a)−φqW(a)2≤0}d^*=\inf\{a>0:[\varphi Z(a)-1]W'(a)-\varphi qW(a)^2\le0\}d∗=inf{a>0:[φZ(a)−1]W′(a)−φqW(a)2≤0}, with inf⁡∅=∞\inf\emptyset=\inftyinf∅=∞.

Formalization targets

Goal: Theorem 3

d∗<∞,vˉ∗(x)=vˉd∗(x)  (x≥0),πˉ0,d∗ exists, is admissible and attains vˉ∗(x).d^*<\infty,\qquad \bar v_*(x)=\bar v_{d^*}(x)\ \ (x\ge0),\qquad \bar\pi_{0,d^*}\ \text{exists, is admissible and attains }\bar v_*(x).d∗<∞,vˉ∗​(x)=vˉd∗​(x)  (x≥0),πˉ0,d∗​ exists, is admissible and attains vˉ∗​(x).

Milestones

  • Lemma 1: W‾(y)/W‾(a)≤W(y)/W(a)\overline W(y)/\overline W(a)\le W(y)/W(a)W(y)/W(a)≤W(y)/W(a) for 0≤y≤a0\le y\le a0≤y≤a.
  • Proposition 2, (3.17): the expected discounted undershoot Ex[e−qT0−XT0−]E_x[e^{-qT_0^-}X_{T_0^-}]Ex​[e−qT0−​XT0−​​] in closed form.
  • Theorem 1: the expected discounted dividends and injections of πˉ0,a\bar\pi_{0,a}πˉ0,a​, a>0a>0a>0, in closed form; hence vˉπˉ0,a=vˉa\bar v_{\bar\pi_{0,a}}=\bar v_avˉπˉ0,a​​=vˉa​.
  • Lemma 2(ii): d∗=0d^*=0d∗=0 if and only if σ=0\sigma=0σ=0 and ν(−∞,0)≤q/(φ−1)\nu(-\infty,0)\le q/(\varphi-1)ν(−∞,0)≤q/(φ−1).
  • Proposition 3(ii): d∗<∞d^*<\inftyd∗<∞ and vˉa≤vˉd∗\bar v_a\le\bar v_{d^*}vˉa​≤vˉd∗​ for all levels aaa.
  • Lemma 3(ii)–(iv): 1≤vˉd∗′≤φ1\le\bar v_{d^*}'\le\varphi1≤vˉd∗′​≤φ with boundary slopes; a↦vˉa(x)a\mapsto\bar v_a(x)a↦vˉa​(x) nonincreasing for a>d∗a>d^*a>d∗; vˉd∗\bar v_{d^*}vˉd∗​ concave.
  • Lemma 5: (Γvˉd∗−qvˉd∗)≤0(\Gamma\bar v_{d^*}-q\bar v_{d^*})\le0(Γvˉd∗​−qvˉd∗​)≤0 on (0,∞)(0,\infty)(0,∞), with equality on (0,d∗)(0,d^*)(0,d∗).
  • Proposition 4(ii): any C2C^2C2 solution of the variational inequality (5.9) dominates vˉ∗\bar v_*vˉ∗​.

Significance

Theorem 3 answers the bail-out problem completely: for every initial capital and every spectrally negative Lévy surplus, the optimal policy is a double barrier with an explicit level and an explicit value in terms of scale functions. In the classical problem without injections (Theorem 2 of the same paper) the analogous conclusion needs an extra generator condition, and Azcue and Muler exhibited Cramér–Lundberg models where barrier policies are not optimal. The result is the basis of later work on dividends with capital injection, transaction costs and Parisian ruin.

The result has a published proof. What this mission adds is a machine-checked version. As far as is known, no part of the theory used — Lévy processes, scale functions, doubly reflected processes, the generator of a Lévy process, singular stochastic control — has been formalized in Lean's Mathlib.

Difficulty

The value function is a supremum over all adapted singular controls. Its upper bound requires a verification argument: Itô's formula for e−qtw(Vt)e^{-qt}w(V_t)e−qtw(Vt​) with a semimartingale VVV that has jumps, a controlled bounded-variation part and a possibly nonzero continuous martingale part, followed by localization and limits. A function that satisfies the variational inequality only in the viscosity sense is not enough, so the candidate vˉd∗\bar v_{d^*}vˉd∗​ must be shown to be regular enough and to satisfy Γvˉd∗−qvˉd∗≤0\Gamma\bar v_{d^*}-q\bar v_{d^*}\le0Γvˉd∗​−qvˉd∗​≤0 everywhere on (0,∞)(0,\infty)(0,∞). Above the barrier this inequality does not follow from a martingale property: the paper derives it from concavity and a comparison with higher barriers, through the resolvent of the doubly reflected process. The lower bound requires the existence and value of the doubly reflected process, and computing that value needs fluctuation identities (two-sided exit, overshoot) that are themselves theorems about scale functions.

Formalization scope

Time is indexed by R≥0\mathbb R_{\ge0}R≥0​. The process is a structure carrying the triplet (c,σ,ν)(c,\sigma,\nu)(c,σ,ν), the paths, adaptedness, independence of future increments from Fs\mathcal F_sFs​, stationarity, the Laplace-exponent identity, and the usual conditions on the filtration. PxP_xPx​ is the law of x+Xx+Xx+X. Policy values are computed as E[∫e−qtdL]−φE[∫e−qtdR]E[\int e^{-qt}dL]-\varphi E[\int e^{-qt}dR]E[∫e−qtdL]−φE[∫e−qtdR] in the extended reals from two [0,∞][0,\infty][0,∞]-valued expectations, and the value function is a supremum in the extended reals; a policy with both expectations infinite gets −∞-\infty−∞. Stieltjes integrals include the jump at time 000. The scale function is a hypothesis IsScaleFunction (it is unique), and d∗d^*d∗ lives in [0,∞][0,\infty][0,∞], so an empty defining set gives ∞\infty∞. The double-barrier strategy is characterized by the two-sided Skorokhod conditions plus mutual singularity of dLdLdL and dRdRdR, which pins the level-000 policy of bounded-variation processes. These conditions hold almost surely, and they are stated on the post-decision surplus Vt+=x+Xt−Lt++RtV_{t+}=x+X_t-L_{t+}+R_tVt+​=x+Xt​−Lt+​+Rt​: dLdLdL is carried by {Vt+=a}\{V_{t+}=a\}{Vt+​=a} and dRdRdR by {Vt+=0}\{V_{t+}=0\}{Vt+​=0}. This is the paper's "minimal amount" (p. 4) and matches its construction on pp. 10–11. The closure-of-support wording of (4.2) on its own would also admit non-minimal lump dividends. Admissibility, Vt≥0V_t\ge0Vt​≥0 for t>0t>0t>0 together with (2.3), is likewise required almost surely.

Printed slips corrected (milestone texts are verbatim):

  • Theorem 3 and Proposition 3(ii) print "ψ′(0+)<∞\psi'(0+)<\inftyψ′(0+)<∞", which always holds; the intended ψ′(0+)>−∞\psi'(0+)>-\inftyψ′(0+)>−∞ is used.
  • (3.3) prints ∫−10x ν(dx)=∞\int_{-1}^0x\,\nu(dx)=\infty∫−10​xν(dx)=∞ for ∫(−1,0)∣x∣ ν(dx)=∞\int_{(-1,0)}|x|\,\nu(dx)=\infty∫(−1,0)​∣x∣ν(dx)=∞.
  • (3.4) prints e−θxe^{-\theta x}e−θx in a dydydy-integral.
  • p. 20 prints the extension vˉd∗(x)+φx\bar v_{d^*}(x)+\varphi xvˉd∗​(x)+φx for vˉd∗(0)+φx\bar v_{d^*}(0)+\varphi xvˉd∗​(0)+φx.
  • Lemma 3(iv) is printed for every a>0a>0a>0 but proved and used only for a=d∗a=d^*a=d∗, and is stated for a=d∗a=d^*a=d∗.
  • Proposition 3(ii) at a=0a=0a=0 is stated only for bounded variation, where vˉ0\bar v_0vˉ0​ is defined.

The goal cannot be satisfied trivially. It asserts equality of the value function with vˉd∗\bar v_{d^*}vˉd∗​, not only an inequality. Existence of the optimal policy is part of the conclusion. Generator statements carry integrability of the jump integrand, so a non-integrable integrand cannot make them true with the junk value 000.

A complete development needs Lévy processes and their Laplace exponents, scale functions, first-passage and two-sided exit identities, reflected and doubly reflected processes, Itô's formula for semimartingales with jumps, and a verification theorem for singular control. All of these are reusable well beyond this mission. Contributions of any of these foundations are welcome, as are proofs of the analytic milestones (Lemma 3, Proposition 3(ii)) from the scale-function properties.

Selected references

  • F. Avram, Z. Palmowski, M. R. Pistorius, On the optimal dividend problem for a spectrally negative Lévy process, Ann. Appl. Probab. 17 (2007) 156–180. https://arxiv.org/abs/math/0702893
  • F. Avram, A. E. Kyprianou, M. R. Pistorius, Exit problems for spectrally negative Lévy processes and applications to (Canadized) Russian options, Ann. Appl. Probab. 14 (2004) 215–238. https://doi.org/10.1214/aoap/1075828052
  • M. R. Pistorius, On doubly reflected completely asymmetric Lévy processes, Stochastic Process. Appl. 107 (2003) 131–143. https://doi.org/10.1016/S0304-4149(03)00065-9
  • J. M. Harrison, A. J. Taylor, Optimal control of a Brownian storage system, Stochastic Process. Appl. 6 (1978) 179–194. https://doi.org/10.1016/0304-4149(78)90059-5
  • A. E. Kyprianou, Introductory Lectures on Fluctuations of Lévy Processes with Applications, Springer, 2006. https://doi.org/10.1007/978-3-540-31343-4
15 thms1 active userReviewed
Operations ResearchProbabilityStochastic Systems·Captain: Shuze Chen

Processing Networks VII: Global Stability, Rings, and the Rybko–Stolyar BoundaryTextbook

Motivation

Mission VI showed that two structural families of queueing networks — feedforward routing, and any network under HLSPS control — are stable throughout their entire subcritical region: no extra condition beyond the standard load condition is ever needed. Until the early 1990s it was widely conjectured that this held for every queueing network. Rybko and Stolyar's 1992 example disproved it: a specific, entirely reasonable two-station network, still subcritical, whose buffer contents grow without bound under a particular non-idling policy. J. G. Dai and J. Michael Harrison's Processing Networks: Fluid Models and Stability (Cambridge University Press, forthcoming; cited here from the authors' pre-publication draft, 2020-4-2, http://spnbook.org) devotes the third part of Chapter 8 to mapping the boundary this discovery opened up: which network structures still enjoy subcriticality-implies-stability (unidirectional rings), and, for a network that does not, exactly what extra condition restores it (the two-station, five-class re-entrant line, the book's own worked instance of the Rybko–Stolyar phenomenon).

Setting

A queueing network is globally stable (Definition 8.22) if it is Markov-chain stable under every simply structured, non-idling control policy — the strongest policy-independent notion of stability a network can have. At the fluid-model level (Definition 8.23, restricting to single-server stations, b≡1b \equiv 1b≡1), this becomes: every solution of the fluid equations (8.20)-(8.23) plus the non-idling condition (8.42) is driven to the origin, uniformly in its starting size. A unidirectional ring network routes each customer type through a fixed cyclic sequence of stations; a two-station, five-class re-entrant line (Figure 8.3) routes its single input stream through five classes in a fixed order, alternating between two stations.

Formalization targets

Goal: Theorem 8.25 — the Rybko–Stolyar-style boundary for a re-entrant line

The two-station, five-class re-entrant network's fluid model is globally stable if and only if

λ1(m1+m3+m5)<1,λ1(m2+m4)<1,λ1(m2+m5)<1.\lambda_1(m_1+m_3+m_5) < 1, \qquad \lambda_1(m_2+m_4) < 1, \qquad \lambda_1(m_2+m_5) < 1.λ1​(m1​+m3​+m5​)<1,λ1​(m2​+m4​)<1,λ1​(m2​+m5​)<1.

The first two conditions together are the standard load condition; the third is a genuinely new "virtual station condition," the direct analogue of the Rybko–Stolyar network's own extra requirement. This is the weakest possible target for the phenomenon it captures: a two-sided iff, so it cannot be strengthened by dropping either the necessity or the sufficiency direction, and it isolates the exact extra condition rather than a merely sufficient one.

Supporting milestones

Lemma 8.20 (restated from mission VI, since this chunk's page range overlaps mission VI's at page 164) is a general departure-rate extinction criterion. Theorem 8.21 proves stability of an "assembly with complementary side business" network via a first two-dimensional piecewise-linear Lyapunov function. Theorem 8.24 shows unidirectional ring networks are globally stable throughout their entire subcritical region — no extra condition needed, in sharp contrast to the goal theorem's network. Lemma 8.26 gives four algebraic sufficient conditions for the workload derivative inequalities the goal theorem's Lyapunov argument needs; Lemma 8.27 shows these conditions are simultaneously satisfiable exactly when (8.47)-(8.49) hold — the geometric core of the sufficiency direction.

Significance

The result itself. Theorem 8.25 is the book's own fully worked instance of the field's most cited stability-boundary phenomenon: it pins down, for a specific and analyzable network, exactly how much more than subcriticality is required, and shows the extra requirement (8.49) is not an artifact of the proof technique but a genuine necessary condition, via an explicit unstable sample path under the "extreme" priority policy that violates it. Theorem 8.24, by contrast, demonstrates that the ring topology is not automatically pathological in this way, delineating the boundary from the other side.

Formalizing it. Searches for "re-entrant line," "Rybko-Stolyar," and "virtual station" (q=re-entrant%20line, q=Rybko-Stolyar, q=virtual%20station) return no results specific to this material; this mission is a from-scratch formalization of global stability at both the Markov-chain and fluid-model tiers, unidirectional ring networks, the two-station five-class re-entrant line, and the assembly-with-side-business network.

Difficulty

Theorem 8.25's necessity direction needs an entirely different proof technique from its sufficiency direction: rather than a Lyapunov argument, it requires exhibiting an explicit unstable fluid model solution under a specific "extreme" static-buffer-priority policy — a sample-path construction, echoing the divergent-cycle construction mission III's own chapter (Section 6.2) gives for the original Rybko–Stolyar network, that the book itself says is "omitted" as analogous. A formalization that stated only the sufficiency direction (dropping the "only if") would misrepresent the theorem entirely, since sufficiency alone is not what makes this result the field's canonical boundary-of-stability statement. A second difficulty is genuinely geometric: Lemma 8.27's proof intersects a parallelogram of admissible (x2,x4)(x_2,x_4)(x2​,x4​) pairs with a wedge region, then separately solves an analogous system for (x1,x3,x5)(x_1,x_3,x_5)(x1​,x3​,x5​) — reducing a five-dimensional existence claim to two two-dimensional geometric arguments, each depending on (8.47)-(8.49) in a way that is not visible from the inequalities' surface form alone.

Formalization scope

Missions IV/VI's queueing-network model data, fluid-equation specialization, and workload operator are restated locally (drafts in this series do not import one another), as is mission VI's non-idling fluid model (renamed to track Definition 8.23's own name, FluidModelGloballyStable, even though defeq in shape). Definition 8.22 (network-level global stability) is stated abstractly over an uninterpreted policy type and two predicates, since the concrete "simply structured non-idling policy" and "positive recurrence under a policy" notions belong to mission I's apparatus, not a dependency of this chunk. The unidirectional ring network is characterized as a structural property of an ordinary flat-indexed queueing network (a partial successor function encoding the deterministic route) rather than by re-introducing the book's own two-index type/stage bookkeeping — a faithful re-encoding, since every ring network in the book's sense is representable this way. The re-entrant line's routing (station 1 serves classes 1,3,5; station 2 serves classes 2,4) was recovered from the explicit computations in Lemma 8.26's own proof, not read off Figure 8.3 directly, though the two are cross-checked as consistent. The assembly-with-side-business network, which needs a genuinely multi-input activity outside Chapter 2's "unitary network" vocabulary, is packaged directly via its already-derived fluid equations (8.36)-(8.39) rather than a general SPN activity structure. Theorem 8.25 is stated as a bare ↔, exposing neither the sufficiency direction's Lyapunov witnesses nor the necessity direction's instability construction — a formalization that dropped either direction of the iff, or that conflated the unidirectional ring's cyclic structure with an unrestricted deterministic routing graph, would each be an unfaithful weakening. IsGloballyStable, FluidModelGloballyStable, IsUnidirectionalRing, and the re-entrant line's Lyapunov ingredients (reentrantG1/reentrantG2/ reentrantH1/reentrantH2) are the primary reusable contributions; contributions completing the six by sorry proofs — Theorem 8.25's necessity direction in particular, which needs machinery this mission does not otherwise build — are welcome.

Selected references

  • J. G. Dai and J. Michael Harrison, Processing Networks: Fluid Models and Stability, Cambridge University Press (forthcoming), pre-publication draft 2020-4-2. http://spnbook.org
  • A. N. Rybko and A. L. Stolyar, "Ergodicity of stochastic processes describing the operation of open queueing networks," Problemy Peredachi Informatsii 28 (1992), 3–26.
  • J. G. Dai and J. H. Vande Vate, "The stability of two-station multitype fluid networks," Operations Research 48 (2000), 721–744.
13 thms2 active usersReviewed
Discrete GeometryLinear OptimizationNumber Theory+2·Captain: mikedeng1

Maximal Lattice-Free Convex Sets in Linear Subspaces I: Characterization of Maximal Lattice-Free Convex Sets in a SubspaceResearch Paper

Motivation

Cutting planes for mixed-integer linear programs are often derived from convex sets that contain no integer point in their interior. Balas observed in 1971 that every such lattice-free convex set containing the current fractional LP solution in its interior yields a valid inequality, the intersection cut (Balas, Intersection cuts, Oper. Res. 19, 1971). The strongest cuts come from sets that are inclusionwise maximal, so the shape of maximal lattice-free convex sets matters to multi-row cut generation.

The case where the set lives in a subspace arises in practice. Taking qqq rows of an optimal simplex tableau restricts the integer points to an affine subspace f+Wf+Wf+W of Rq\mathbb R^qRq spanned by the tableau columns. When WWW is irrational, its integer points span only a proper subspace V⊊WV\subsetneq WV⊊W. The classical theory does not cover this case, and it is the case that the second mission of this series (minimal valid inequalities of the relaxation Rf(W)R_f(W)Rf​(W)) needs.

Timeline.

  • Lovász (Geometry of numbers and integer programming, 1989) stated the characterization for rational subspaces (Proposition 3.1) and gave only a sketch of the proof. The irrational-hyperplane case is not visible in that sketch.
  • Basu, Conforti, Cornuéjols and Zambelli (arXiv:1701.06543v1; Math. Oper. Res. 35(3), 2010, doi:10.1287/moor.1100.0461) gave a complete proof of Lovász's theorem for an arbitrary lattice of a linear space (Theorem 10). They also extended it to a space WWW strictly larger than the span VVV of the lattice (Theorem 9, equivalently Theorem 1 for Zn\mathbb Z^nZn).

Setting

Work in Rn\mathbb R^nRn with the Euclidean inner product and the open balls Bε(x)B_\varepsilon(x)Bε​(x). For X⊆RnX\subseteq\mathbb R^nX⊆Rn, ⟨X⟩\langle X\rangle⟨X⟩ denotes its linear span.

A lattice of a linear space VVV is an additive group Λ={λ1a1+⋯+λmam∣λi∈Z}\Lambda=\{\lambda_1a_1+\dots+\lambda_ma_m\mid\lambda_i\in\mathbb Z\}Λ={λ1​a1​+⋯+λm​am​∣λi​∈Z} generated by linearly independent vectors a1,…,ama_1,\dots,a_ma1​,…,am​ with ⟨a1,…,am⟩=V\langle a_1,\dots,a_m\rangle=V⟨a1​,…,am​⟩=V (Definition 6, IsLatticeOf Λ V). A linear subspace L⊆VL\subseteq VL⊆V is a Λ\LambdaΛ-subspace if it has a basis contained in Λ\LambdaΛ (Definition 7, IsLambdaSubspace Λ V L). For Z2\mathbb Z^2Z2, the line x2=2x1x_2=2x_1x2​=2x1​ is a Λ\LambdaΛ-subspace and the line x2=2x1x_2=\sqrt2x_1x2​=2​x1​ is not.

For sets W,SW,SW,S the interior relative to WWW is intW(S)={x∈S∣Bε(x)∩W⊆S for some ε>0}\mathbf{int}_W(S)=\{x\in S\mid B_\varepsilon(x)\cap W\subseteq S\text{ for some }\varepsilon>0\}intW​(S)={x∈S∣Bε​(x)∩W⊆S for some ε>0} (intW W S). The relative interior is relint(S)=intaff⁡(S)(S)\mathbf{relint}(S)=\mathbf{int}_{\operatorname{aff}(S)}(S)relint(S)=intaff(S)​(S).

Let W⊇VW\supseteq VW⊇V be a linear space. A set SSS is a Λ\LambdaΛ-free convex set of WWW if S⊆WS\subseteq WS⊆W, SSS is convex and Λ∩intW(S)=∅\Lambda\cap\mathbf{int}_W(S)=\emptysetΛ∩intW​(S)=∅. It is maximal if no other Λ\LambdaΛ-free convex set of WWW properly contains it (Definition 8, IsLambdaFree, IsMaxLambdaFree).

The statements also use a polyhedron in WWW (WWW intersected with finitely many closed half-spaces), a polytope (convex hull of a finite set), the dimension dim⁡(S)\dim(S)dim(S) of the affine hull with dim⁡∅=−1\dim\emptyset=-1dim∅=−1 (affDim), and a facet: a nonempty face S∩{⟨a,x⟩=b}S\cap\{\langle a,x\rangle=b\}S∩{⟨a,x⟩=b} of a valid inequality with dim⁡F=dim⁡S−1\dim F=\dim S-1dimF=dimS−1. The recession cone is rec⁡(S)={r∣x+tr∈S ∀x∈S, t≥0}\operatorname{rec}(S)=\{r\mid x+tr\in S\ \forall x\in S,\ t\ge0\}rec(S)={r∣x+tr∈S ∀x∈S, t≥0} and the lineality space is rec⁡(S)∩−rec⁡(S)\operatorname{rec}(S)\cap-\operatorname{rec}(S)rec(S)∩−rec(S).

Formalization targets

Goal: Theorem 9 (p. 8)

For a lattice Λ\LambdaΛ of VVV and a linear space W⊇VW\supseteq VW⊇V with dim⁡W≥1\dim W\ge1dimW≥1, a set SSS is a maximal Λ\LambdaΛ-free convex set of WWW if and only if

(i) S is a full-dimensional polyhedron in W, S∩V is maximal Λ-free in V, F↦F∩V is a bijection of facets;\text{(i) } S \text{ is a full-dimensional polyhedron in } W,\ S\cap V \text{ is maximal } \Lambda\text{-free in } V,\ F\mapsto F\cap V \text{ is a bijection of facets};(i) S is a full-dimensional polyhedron in W, S∩V is maximal Λ-free in V, F↦F∩V is a bijection of facets; (ii) S=v+L is a hyperplane of W with L∩V a hyperplane of V that is not a Λ-subspace;\text{(ii) } S=v+L \text{ is a hyperplane of } W \text{ with } L\cap V \text{ a hyperplane of } V \text{ that is not a } \Lambda\text{-subspace};(ii) S=v+L is a hyperplane of W with L∩V a hyperplane of V that is not a Λ-subspace; (iii) S is a half-space of W containing V on its boundary.\text{(iii) } S \text{ is a half-space of } W \text{ containing } V \text{ on its boundary.}(iii) S is a half-space of W containing V on its boundary.

Main milestone: Theorem 10 (p. 8)

For dim⁡V≥1\dim V\ge1dimV≥1, SSS is a maximal Λ\LambdaΛ-free convex set of VVV if and only if either S=P+LS=P+LS=P+L is a polyhedron with PPP a polytope, LLL a Λ\LambdaΛ-subspace and dim⁡S=dim⁡P+dim⁡L=dim⁡V\dim S=\dim P+\dim L=\dim VdimS=dimP+dimL=dimV, with no lattice point in intV(S)\mathbf{int}_V(S)intV​(S) and a lattice point in the relative interior of every facet; or S=v+LS=v+LS=v+L is an affine hyperplane of VVV whose direction LLL is not a Λ\LambdaΛ-subspace.

Supporting milestones

Lemma 13 (bounded full-dimensional case), Lemma 15 (lattice points near half-lines), Lemma 16 (S+⟨rec⁡S⟩S+\langle\operatorname{rec}S\rangleS+⟨recS⟩ stays Λ\LambdaΛ-free), Lemma 17 (projection along a Λ\LambdaΛ-subspace is a lattice), Lemma 18 (lattice points near non-lattice subspaces), Lemma 19 (maximal hyperplanes), Claims 1 and 2 in the proof of Theorem 10, and identity (6), intW(S)∩V=intV(S∩V)\mathbf{int}_W(S)\cap V=\mathbf{int}_V(S\cap V)intW​(S)∩V=intV​(S∩V).

Significance

Theorem 10 says that maximal lattice-free sets are cylinders over polytopes with a lattice point on every facet, apart from the irrational hyperplanes. This is the structural fact behind the finiteness of facet counts (at most 2dim⁡P2^{\dim P}2dimP) and behind every classification of maximal lattice-free sets in low dimension, such as the triangles and quadrilaterals of the two-row relaxation. Theorem 9 extends it to irrational subspaces. There the new cases are the half-spaces of (iii), which have VVV on their boundary, and the hyperplanes of (ii), whose trace on VVV is a hyperplane of VVV that is not a Λ\LambdaΛ-subspace. Theorem 9 is the geometric input to the paper's Theorem 3: every minimal valid inequality of Rf(W)R_f(W)Rf​(W) is the gauge of a maximal lattice-free convex set of f+Wf+Wf+W.

These results are proved on paper. No machine-checked version of Lovász's theorem, of Theorem 9, or of the lattice-approximation Lemmas 15 and 18 is known to exist. The mission produces the definitions of lattices of subspaces, relative interiors and lattice-free sets on which the second mission of the series builds.

Difficulty

The obvious argument separates each lattice point from SSS by a half-space and intersects the half-spaces. It gives a polyhedron only when finitely many lattice points matter, that is, when SSS is bounded. For unbounded SSS, the recession directions must be shown to be lineality directions and to be spanned by lattice vectors. Both steps rest on simultaneous Diophantine approximation (Dirichlet's theorem) applied in irrational directions, and on a density argument for the projected lattice when the lineality space is not a Λ\LambdaΛ-subspace. In the subspace setting of Theorem 9, one must also track the interiors relative to WWW and to VVV separately. Identity (6) holds only when intW(S)\mathbf{int}_W(S)intW​(S) meets VVV, and the half-space case (iii) is exactly the case where it does not.

Formalization scope

Rn\mathbb R^nRn is EuclideanSpace ℝ (Fin n), linear spaces are Submodule ℝ, and Λ\LambdaΛ is an AddSubgroup. All declarations live in the namespace MaxLatticeFree.Geometry. Every interior is relative (intW, relint). With the ambient topological interior, every subset of a proper subspace would be trivially lattice-free, and the classification would collapse. A lattice must have a linearly independent generating family; a dense finitely generated subgroup such as Z+2Z\mathbb Z+\sqrt2\mathbb ZZ+2​Z is excluded. Dimensions are integers with dim⁡∅=−1\dim\emptyset=-1dim∅=−1, and facets are nonempty, so no dimension equation holds through truncated subtraction.

Two readings of the page are fixed.

  1. Theorem 9 assumes dim⁡W≥1\dim W\ge1dimW≥1 and Theorem 10 assumes dim⁡V≥1\dim V\ge1dimV≥1. For W=V={0}W=V=\{0\}W=V={0} the only maximal set is ∅\emptyset∅, which satisfies none of the listed cases, so the printed statements are false there.
  2. Identity (6) is stated under the three hypotheses its proof uses, not inside the case analysis of Theorem 9.

The paper's Theorem 1 (the same result for Zn\mathbb Z^nZn and affine WWW) is not included, and neither are the cited results of Barvinok and Dirichlet (Theorems 11, 14, Corollary 12). They are welcome as supporting lemmas. Infrastructure that is useful beyond this mission includes Dirichlet's simultaneous approximation theorem in Rm\mathbb R^mRm, discreteness of lattices of subspaces, and the relation between intW/relint and Mathlib's intrinsicInterior.

Selected references

  • A. Basu, M. Conforti, G. Cornuéjols, G. Zambelli, Maximal lattice-free convex sets in linear subspaces, Math. Oper. Res. 35(3), 2010; arXiv:1701.06543v1. https://arxiv.org/abs/1701.06543
  • L. Lovász, Geometry of numbers and integer programming, in: Mathematical Programming: Recent Developments and Applications, 1989, pp. 177–210.
  • E. Balas, Intersection cuts — a new type of cutting planes for integer programming, Oper. Res. 19, 1971. https://doi.org/10.1287/opre.19.1.19
  • A. Barvinok, A Course in Convexity, Graduate Studies in Mathematics 54, AMS, 2002. https://doi.org/10.1090/gsm/054
18 thms2 active usersReviewed
Operations ResearchProbabilityStochastic Systems·Captain: Shuze Chen

Processing Networks IX: Fluid Stability of the Proportionally Fair AllocationTextbook

Motivation

Every control policy formalized so far in this series — HLSPS (mission VI), back-pressure/ max-weight (mission VIII) — allocates service effort to entire job classes as indivisible units. Proportional fairness takes a different starting point: it is a general-purpose recipe for dividing a shared, continuously divisible resource among competing demands, originally developed for bandwidth allocation in communication networks and later adopted throughout economics and operations research as the canonical notion of a "fair" allocation. J. G. Dai and J. Michael Harrison's Processing Networks: Fluid Models and Stability (Cambridge University Press, forthcoming; cited here from the authors' pre-publication draft, 2020-4-2, http://spnbook.org) devotes Chapter 10 to showing that proportional fairness, applied dynamically to a processing network's current buffer contents, is not just an attractive fairness criterion but a maximally stable control policy — stable throughout the entire subcritical region of any unitary network. This mission formalizes the static optimization problem underlying proportional fairness, its key structural properties, the resulting fluid model, and the deepest single theorem of the chapter: fluid stability under the standard load condition, proved via a Lyapunov function that is explicitly not Lipschitz continuous — a genuine departure from every other stability proof in the book.

Setting

The PF allocation function ψ(z)\psi(z)ψ(z) solves, for a demand vector z∈R+Iz \in \mathbb R^I_+z∈R+I​, the concave optimization problem max⁡x∈A∑izilog⁡(xi)\max_{x \in \mathcal A} \sum_i z_i \log(x_i)maxx∈A​∑i​zi​log(xi​) (Eq. 10.3-10.4) over a bounded, closed, convex, monotone capacity-constraint set A\mathcal AA. When A\mathcal AA has the special "aggregate" structure induced by grouping classes with identical resource requirements into demand groups, ψ\psiψ satisfies a resource-relevant aggregation property (Proposition 10.2): its value depends on the full demand vector only through group-level aggregates. Applying ψ\psiψ dynamically — recomputing it from the current buffer-content vector at every decision time — to a unitary network (one-to-one correspondence between job classes and service types) under relaxed control defines the PF control policy, whose fluid limit is the PF fluid model (Definition 10.3, Eqs. 10.29-10.35).

Formalization targets

Goal: Theorem 10.5 — fluid stability of the PF control policy

If the load condition (10.37) — an equivalent, group-level-aggregate reformulation of the standard load condition ρ<b\rho < bρ<b — holds, then the PF fluid model is stable. Combined with Theorem 6.2 (mission III) and Corollary 5.6, this is the technical core of showing PF control is maximally stable, exactly the same shape of result as mission VIII's back-pressure theorem, but for a policy defined by a fundamentally different (utility-maximization, rather than weighted-throughput-maximization) principle.

Supporting milestones

Lemma 10.1 establishes that ψ\psiψ is well-defined at all (existence), essentially unique where it matters (uniqueness on positive-demand coordinates), extreme, scale-invariant, and continuous — six properties that everything downstream depends on. Proposition 10.2 is the aggregation property described above. Proposition 10.4 restates the standard load condition in the group-level-aggregate coordinates Theorem 10.5's proof actually uses. Lemmas 10.6, 10.7, 10.8, and 10.9 develop the properties of the entropy Lyapunov function φ(t):=∑iZi(t)log⁡(D˙i(t)/αi)\varphi(t) := \sum_i Z_i(t)\log(\dot D_i(t)/\alpha_i)φ(t):=∑i​Zi​(t)log(D˙i​(t)/αi​) (Eq. 10.38) that Theorem 10.5's proof needs: nonnegativity (and strict positivity away from the origin), continuity on (0,∞)(0,\infty)(0,∞), a uniform upper bound on its Dini derivative, and a pointwise bound on that derivative at regular points, in terms of the fluid-scale departure and content rates.

Significance

The result itself. Theorem 10.5 shows that proportional fairness — motivated purely by a static fairness axiom (Eq. 10.14) with no reference to queueing dynamics at all — turns out to be a maximally stable dynamic control policy once applied recursively to a unitary network's evolving buffer contents. This is a substantive and non-obvious fact: nothing in PF's static definition anticipates a stability guarantee, and the book's own text stresses the mismatch between PF's static motivation (utility/fairness) and the metric of interest for a queueing system (buffer content, response time). Unlike essentially every other stability proof in the book, Theorem 10.5's proof uses a Lyapunov function (φ\varphiφ) that is provably not absolutely continuous, which is why it needs Lemma 8.11's more delicate Dini-derivative extinction criterion (mission V) rather than the simpler Lipschitz-based criteria (Lemmas 8.5/8.6) used everywhere else.

Formalizing it. A live prior-art check (GET /theorems?q=proportional%20fairness, q=entropy, q=concave%20optimization) finds no relevant hits — the one "entropy" result on the platform is an unrelated matrix-multiplication construction. This mission formalizes the concave PF optimization problem, its allocation function, the aggregation property, and the entropy Lyapunov machinery entirely from scratch, reusing only Mathlib's general convex-analysis and EReal substrate.

Difficulty

The chapter's own convention log⁡(0)=−∞\log(0) = -\inftylog(0)=−∞, 0log⁡(0)=00\log(0) = 00log(0)=0 (Eq. 10.2) cannot be captured by Mathlib's Real.log, whose value at 0 is 0, not -\infty — a silent substitution would corrupt exactly the boundary behavior Lemma 10.1(a)'s existence/uniqueness argument turns on (distinguishing feasible points with xi=0x_i=0xi​=0 for some i∈I+(z)i \in \mathcal I_+(z)i∈I+​(z), which must be strictly dominated, from those without). This mission instead defines the PF objective via EReal, using an explicit extended logarithm (⊥ at 0) and Mathlib's own convention that EReal multiplication satisfies 0 * y = 0 for every y — which reproduces the book's 0 log(0) = 0 rule automatically, with no case split, a pleasant instance of genuine Mathlib substrate reuse resolving what looked like a from-scratch formalization problem. A second difficulty is structural: ψ\psiψ is not merely "a maximizer" but a specific maximizer, normalized to zero on every coordinate with zero demand (Eq. 10.5) — needed so that Lemma 10.1(c)/(d)'s scale-invariance and continuity statements are about a genuine function of zzz, not merely about an arbitrarily-chosen selection from a possibly-multivalued correspondence.

Formalization scope

IsPFDomain, f, IsPFMaximizer, and psi formalize Section 10.1's optimization problem directly, with IsPFMaximizer phrased as "feasible and dominates every feasible alternative" (avoiding sSup/⨆ entirely, per this series' junk-value-avoidance convention). IsTotalArrivalRates (restating Eq. 2.38) and RegularPoint (restating Definition 8.7) are restated locally, matching this series' convention that drafts do not import one another. diniUpperRight duplicates mission V's LyapunovCriteria.diniUpperRight verbatim — this chunk's own BRIEF.md dependency list does not include mission V, so, per the same restate-not-import convention, it is restated here rather than cross-imported (the duplication is intentional and documented, not an oversight). Lemma 10.7 (continuity of φ\varphiφ on (0,∞)(0,\infty)(0,∞)) is added beyond BRIEF.md's own disposition table: the book itself lists it as one of "the following five lemmas" (10.6, 10.7, 10.8, 10.9, 10.11) that suffice to prove Theorem 10.5, on the same page as Lemmas 10.6/10.8/10.9 — a planning-time omission caught during drafting and documented in HARD.md. Lemma 10.11 itself, though stated on the same page, is not included here: the companion chunk (10-proportional-fairness-applications) explicitly begins at "Lemma 10.11 onward," and its own negative-drift conclusion is exactly what completes Theorem 10.5's proof — a dependency this mission's goal theorem does not need to expose in its own statement, since (10.37) is already the theorem's complete, book-stated hypothesis. IsPFDomain, IsPFMaximizer, psi, groupAggregate, IsPFFluidModelSolution, and phi are the primary reusable contributions; contributions completing the eight by sorry proofs, especially Lemma 10.1's six-part argument and the entropy-Lyapunov lemmas' analysis (Section B.4's preliminary results), are welcome.

Selected references

  • J. G. Dai and J. Michael Harrison, Processing Networks: Fluid Models and Stability, Cambridge University Press (forthcoming), pre-publication draft 2020-4-2. http://spnbook.org
  • F. P. Kelly, A. K. Maulloo, and D. K. H. Tan, "Rate control for communication networks: shadow prices, proportional fairness and stability," Journal of the Operational Research Society 49 (1998), 237–252.
  • R. Srikant and L. Ying, Communication Networks: An Optimization, Control, and Stochastic Networks Perspective, Cambridge University Press, 2014.
12 thms3 active usersReviewed
CombinatoricsLinear OptimizationOperations Research+1·Captain: mikedeng1

Santa Claus Schedules Jobs on Unrelated Machines: The Configuration LP Has Integrality Gap at Most 33/17Research Paper

Motivation

Scheduling jobs on unrelated machines so as to minimize the makespan (the time at which the last machine finishes) is one of the central problems of approximation algorithms. For the general problem, Lenstra, Shmoys and Tardos (1990) gave a 2-approximation and showed that no polynomial-time algorithm achieves a factor below 3/23/23/2 unless P = NP; closing the gap between 3/23/23/2 and 222 has been open since.

The restricted assignment problem is the special case in which every job jjj has a single size pjp_jpj​ and may only run on a given set Γ(j)\Gamma(j)Γ(j) of machines. The 3/23/23/2 hardness already holds here, and the best known algorithms were still 222-approximations. Every linear program previously used for the problem has integrality gap 222, so a better LP lower bound was the natural target.

Svensson (2011) showed that the configuration LP of Bansal and Sviridenko (2006), whose variables assign whole sets of jobs to machines, has integrality gap at most 33/17≈1.941233/17 \approx 1.941233/17≈1.9412. Its optimum therefore gives a polynomial-time estimate of the optimal makespan within a factor strictly better than 222.

  • 1990: Lenstra, Shmoys, Tardos, 2-approximation for unrelated machines, and 3/23/23/2 hardness already for restricted assignment.
  • 2006: Bansal and Sviridenko introduce the configuration LP for the max–min variant (the Santa Claus problem).
  • 2008: Feige shows the configuration LP has constant integrality gap for restricted Santa Claus, and Asadpour, Feige and Saberi (2008) give a local search proof of a factor-4 gap.
  • 2011: Svensson adapts that local search to makespan and proves the gap 33/1733/1733/17 for restricted assignment (arXiv:1011.1168).

Setting

An instance consists of finite sets JJJ (jobs) and MMM (machines), sizes pj≥0p_j \ge 0pj​≥0, and for each job a set Γ(j)⊆M\Gamma(j) \subseteq MΓ(j)⊆M. A schedule is a map σ:J→M\sigma : J \to Mσ:J→M with σ(j)∈Γ(j)\sigma(j) \in \Gamma(j)σ(j)∈Γ(j). The load of machine iii is ∑j:σ(j)=ipj\sum_{j : \sigma(j) = i} p_j∑j:σ(j)=i​pj​, and the makespan is the largest load. OPT\mathrm{OPT}OPT is the least makespan of a schedule.

For a target makespan TTT, a configuration for machine iii is a set C⊆JC \subseteq JC⊆J of jobs that may all run on iii (i∈Γ(j)i \in \Gamma(j)i∈Γ(j) for j∈Cj \in Cj∈C) with p(C)=∑j∈Cpj≤Tp(C) = \sum_{j \in C} p_j \le Tp(C)=∑j∈C​pj​≤T. Write C(i,T)\mathcal C(i,T)C(i,T) for the set of configurations. The configuration LP asks for xi,C≥0x_{i,C} \ge 0xi,C​≥0 with

[C-LP]∑C∈C(i,T)xi,C≤1(i∈M),∑i∈M ∑C∈C(i,T), C∋jxi,C≥1(j∈J).\text{[C-LP]}\qquad \sum_{C \in \mathcal C(i,T)} x_{i,C} \le 1 \quad (i \in M), \qquad \sum_{i \in M}\ \sum_{C \in \mathcal C(i,T),\ C \ni j} x_{i,C} \ge 1 \quad (j \in J).[C-LP]C∈C(i,T)∑​xi,C​≤1(i∈M),i∈M∑​ C∈C(i,T), C∋j∑​xi,C​≥1(j∈J).

Its dual has variables yi,zj≥0y_i, z_j \ge 0yi​,zj​≥0 and constraints yi≥∑j∈Czjy_i \ge \sum_{j \in C} z_jyi​≥∑j∈C​zj​ for all iii and C∈C(i,T)C \in \mathcal C(i,T)C∈C(i,T). OPTLP\mathrm{OPT}_{LP}OPTLP​ is the least TTT at which [C-LP] is feasible, and OPTLP≤OPT\mathrm{OPT}_{LP} \le \mathrm{OPT}OPTLP​≤OPT.

In the Lean development these are configs Γ p T i, CLPFeasible Γ p T, CLPDualFeasible Γ p T y z and schedLoad p σ i, in the namespace RestrictedAssignment.Svensson.

Formalization targets

Goal: Theorem 4.1

For every instance with p≥0p \ge 0p≥0 and every T≥0T \ge 0T≥0,

[C-LP] feasible at T ⟹ ∃ σ:J→M,  σ(j)∈Γ(j) ∀j,∑j:σ(j)=ipj≤3317 T  ∀i.\text{[C-LP] feasible at } T \ \Longrightarrow\ \exists\, \sigma : J \to M,\ \ \sigma(j) \in \Gamma(j)\ \forall j,\quad \sum_{j : \sigma(j) = i} p_j \le \tfrac{33}{17}\, T \ \ \forall i .[C-LP] feasible at T ⟹ ∃σ:J→M,  σ(j)∈Γ(j) ∀j,j:σ(j)=i∑​pj​≤1733​T  ∀i.

Equivalently OPT≤3317 OPTLP\mathrm{OPT} \le \tfrac{33}{17}\,\mathrm{OPT}_{LP}OPT≤1733​OPTLP​. The statement is scale-free and does not define OPTLP\mathrm{OPT}_{LP}OPTLP​.

Milestones

The milestones follow the paper's proof, which normalizes OPTLP=1\mathrm{OPT}_{LP} = 1OPTLP​=1 and sets R=16/17R = 16/17R=16/17:

  1. a dual solution with ∑iyi<∑jzj\sum_i y_i < \sum_j z_j∑i​yi​<∑j​zj​ makes [C-LP] infeasible;
  2. the local search, Algorithm 2 (ExtendSchedule), keeps its partial schedule valid (load at most 1+R1 + R1+R, at most one big job per machine);
  3. when the algorithm has no potential move, an explicit pair (y∗,z∗)(y^*, z^*)(y∗,z∗) is dual feasible (Claim 4.7) and has ∑y∗<∑z∗\sum y^* < \sum z^*∑y∗<∑z∗ (Claim 4.8);
  4. hence, if [C-LP] is feasible, a potential move always exists (Lemma 4.6);
  5. the algorithm has no infinite run (Lemma 4.9);
  6. [C-LP] feasible at T=1T = 1T=1 gives a schedule of makespan at most 1+16/171 + 16/171+16/17.

Three facts from Section 2 complete the list: normalization by scaling, OPTLP≤OPT\mathrm{OPT}_{LP} \le \mathrm{OPT}OPTLP​≤OPT, and monotonicity of feasibility in TTT.

Significance

The theorem shows that the configuration LP is a strictly stronger relaxation than those behind the factor-222 algorithms. With the known polynomial-time approximate solvability of the LP, it gives a polynomial-time algorithm that estimates the optimal makespan of restricted assignment within 33/17+ϵ33/17 + \epsilon33/17+ϵ. The local search in the proof finds a schedule of the same quality, but it is not known to run in polynomial time. Later work lowered the constant to 11/611/611/6 (Jansen and Rohwedder, 2017) along the same lines.

The result is proved on paper. As far as known, no part of it has a machine-checked proof. Formalizing it gives:

  • a reusable definition of the configuration LP and its dual certificate;
  • a precise, nondeterministic model of a local search whose termination rests on a lexicographic potential;
  • a check of a proof that has many cases. The formalization already exposed two edge cases:
    • Claim 4.8 fails when jnewj_{\mathrm{new}}jnew​ has size 000 and no admissible machine;
    • the termination proof needs positive job sizes. With a job of size 000, the algorithm can move it back and forth between two tied machines forever.

The milestones are stated with the corresponding hypotheses.

Difficulty

The obvious approach, rounding a fractional configuration solution, loses a factor 222. If each machine takes one configuration and the collisions of jobs chosen twice or not at all are repaired, the repair can double a load. This is where every earlier LP-based bound stalls.

The milestones along the paper's route are hard for two reasons. First, the dual pair (y∗,z∗)(y^*, z^*)(y∗,z∗) rounds job sizes down by class (big to 11/1711/1711/17, medium to 9/179/179/17). Proving ∑y∗<∑z∗\sum y^* < \sum z^*∑y∗<∑z∗ requires a case analysis over how each blocked machine came to be blocked. The two claims are therefore false for arbitrary states of the search and hold only for states the algorithm actually reaches, so the invariants of reachable states have to be formalized too. Second, the search both adds and removes blockers, so no simple quantity decreases at every step. Termination needs a potential defined on the whole history of the search.

Formalization scope

Jobs and machines are finite types with decidable equality, sizes are real numbers with pj≥0p_j \ge 0pj​≥0, and admissible machines are a Finset per job. Schedules are total maps J→MJ \to MJ→M with σ(j)∈Γ(j)\sigma(j) \in \Gamma(j)σ(j)∈Γ(j) stated explicitly. Partial schedules are maps J→J \toJ→ Option M. Constants are exact rationals in R\mathbb RR. Values of moves live in Lex (ℝ × ℝ).

Algorithm 2 is a step relation Step, not a function. The move of minimum lexicographic value is a hypothesis on the chosen pair, so every tie-breaking rule is covered. The blocker tree is stored as its list of blockers in insertion order. Claims 4.7, 4.8 and Lemma 4.6 quantify over states reachable from the initial state, as their proofs require. Lemma 4.9 asserts that no infinite run exists.

Three statements would trivialize the goal, and the formalization rules them out:

  • a schedule allowed to use machines outside Γ(j)\Gamma(j)Γ(j);
  • a target T<0T < 0T<0;
  • an LP missing either constraint row.

Theorem 1.1 (polynomial time), the separation oracle, and Section 3's two-size case are not part of the mission.

Useful contributions include:

  • the weak-duality certificate;
  • the scaling and monotonicity facts;
  • the invariants of reachable states (each job lies in at most one blocker, blockers on a machine are never reassigned while present);
  • the two claims and the termination argument.

The configuration LP definitions are reusable for the Santa Claus problem and for bin packing.

Selected references

  • O. Svensson, Santa Claus Schedules Jobs on Unrelated Machines, arXiv:1011.1168v2, 2011; SIAM J. Comput. 41(5), 2012. https://arxiv.org/abs/1011.1168
  • J. K. Lenstra, D. B. Shmoys, É. Tardos, Approximation algorithms for scheduling unrelated parallel machines, Math. Programming 46, 1990. https://doi.org/10.1007/BF01585745
  • N. Bansal, M. Sviridenko, The Santa Claus problem, STOC 2006. https://doi.org/10.1145/1132516.1132522
  • A. Asadpour, U. Feige, A. Saberi, Santa Claus meets hypergraph matchings, APPROX 2008; ACM Trans. Algorithms 8(3), 2012. https://doi.org/10.1145/2229163.2229168
  • K. Jansen, L. Rohwedder, On the configuration-LP of the restricted assignment problem, SODA 2017. https://arxiv.org/abs/1611.01934
13 thms2 active usersReviewed
Dynamic ProgrammingOperations ResearchProbability+1·Captain: mikedeng1

Exit Problems for Spectrally Negative Lévy Processes and Applications to (Canadized) Russian Options II: Optimal Stopping for the Perpetual Russian OptionResearch Paper

Motivation

A Russian option is a perpetual American-type claim that pays, when the holder exercises at time τ\tauτ, the maximum of the asset price seen so far, discounted by e−ατe^{-\alpha\tau}e−ατ. It was introduced by Shepp and Shiryaev for the Black–Scholes market (Shepp–Shiryaev 1993), where the underlying log-price is a Brownian motion with drift. Empirical work on asset returns (skewness, heavy tails, downward jumps) motivates replacing the Brownian motion by a Lévy process with negative jumps only. Avram, Kyprianou and Pistorius (2004) solve the Russian optimal stopping problem in that model in closed form, in terms of the scale functions of the process.

Timeline. 1993: Shepp and Shiryaev solve the Russian problem for geometric Brownian motion; Duffie and Harrison give its no-arbitrage price. Graversen and Peskir, and Kyprianou and Pistorius, treat further variants within the Black–Scholes market (the works the paper cites in §6). 2004: Avram, Kyprianou and Pistorius solve it for every spectrally negative Lévy process, covering both unbounded and bounded variation, using the exit problem of the reflected process Y=X‾−XY=\overline X-XY=X−X (their Theorem 1, the subject of the first mission of this series).

Setting

Let (Ω,F,F={Ft}t≥0,P)(\Omega,\mathcal F,\mathbf F=\{\mathcal F_t\}_{t\ge0},\mathbb P)(Ω,F,F={Ft​}t≥0​,P) be a filtered probability space with a right-continuous filtration, and X={Xt, t≥0}X=\{X_t,\ t\ge0\}X={Xt​, t≥0} a spectrally negative Lévy process for F\mathbf FF: X0=0X_0=0X0​=0, càdlàg paths with no positive jumps, independent and stationary increments with Xs+t−XsX_{s+t}-X_sXs+t​−Xs​ independent of Fs\mathcal F_sFs​, and paths that are not monotone. The standing assumption of the paper is that XXX has unbounded variation, or bounded variation and a Lévy measure absolutely continuous with respect to Lebesgue measure.

The Laplace exponent is ψ(θ)=log⁡E[eθX1]\psi(\theta)=\log\mathbb E[e^{\theta X_1}]ψ(θ)=logE[eθX1​], and Φ(q)\Phi(q)Φ(q) is the largest root of ψ(θ)=q\psi(\theta)=qψ(θ)=q. For q≥0q\ge0q≥0 the qqq-scale function W(q):R→[0,∞)W^{(q)}:\mathbb R\to[0,\infty)W(q):R→[0,∞) is the unique function that vanishes on (−∞,0](-\infty,0](−∞,0], is continuous on (0,∞)(0,\infty)(0,∞), and satisfies ∫0∞e−θxW(q)(x) dx=(ψ(θ)−q)−1\int_0^\infty e^{-\theta x}W^{(q)}(x)\,dx=(\psi(\theta)-q)^{-1}∫0∞​e−θxW(q)(x)dx=(ψ(θ)−q)−1 for θ>Φ(q)\theta>\Phi(q)θ>Φ(q). Then Z(q)(x)=1+q∫−∞xW(q)(z) dzZ^{(q)}(x)=1+q\int_{-\infty}^xW^{(q)}(z)\,dzZ(q)(x)=1+q∫−∞x​W(q)(z)dz. The tilted scale functions Wv(p)W_v^{(p)}Wv(p)​ are those of the exponent ψv(θ)=ψ(θ+v)−ψ(v)\psi_v(\theta)=\psi(\theta+v)-\psi(v)ψv​(θ)=ψ(θ+v)−ψ(v).

Fix r≥0r\ge0r≥0 with ψ(1)=r\psi(1)=rψ(1)=r (the risk-neutral condition), and let P1\mathbb P^1P1 be the Esscher measure, dP1/dP∣Ft=eXt−rtd\mathbb P^1/d\mathbb P|_{\mathcal F_t}=e^{X_t-rt}dP1/dP∣Ft​​=eXt​−rt. For z≥0z\ge0z≥0, under P−z1\mathbb P^1_{-z}P−z1​ the process starts at −z-z−z with running maximum X‾t=max⁡{0,sup⁡u≤tXu}\overline X_t=\max\{0,\sup_{u\le t}X_u\}Xt​=max{0,supu≤t​Xu​}, and the reflected process Y=X‾−XY=\overline X-XY=X−X starts at Y0=zY_0=zY0​=z. The passage time is τk=inf⁡{t≥0:Yt∉[0,k)}\tau_k=\inf\{t\ge0:Y_t\notin[0,k)\}τk​=inf{t≥0:Yt​∈/[0,k)}. Fix α>0\alpha>0α>0 and put q=α+rq=\alpha+rq=α+r.

The Russian optimal stopping problem (28) is

wR(z)=sup⁡τ E−z1[e−ατ+Yτ],w^R(z)=\sup_\tau\ \mathbb E^1_{-z}\big[e^{-\alpha\tau+Y_\tau}\big],wR(z)=τsup​ E−z1​[e−ατ+Yτ​],

the supremum over all P1\mathbb P^1P1-almost surely finite F\mathbf FF-stopping times. The option price is Vr(M0,S0)=S0 wR(log⁡(M0/S0))V_r(M_0,S_0)=S_0\,w^R(\log(M_0/S_0))Vr​(M0​,S0​)=S0​wR(log(M0​/S0​)).

Formalization targets

Goal: Theorem 2

With the optimal level (30) and the candidate value

κ∗=inf⁡{x: Z(q)(x)≤qW(q)(x)},u(z)=ezZ(q)(κ∗−z),\kappa^*=\inf\{x:\ Z^{(q)}(x)\le qW^{(q)}(x)\},\qquad u(z)=e^zZ^{(q)}(\kappa^*-z),κ∗=inf{x: Z(q)(x)≤qW(q)(x)},u(z)=ezZ(q)(κ∗−z),

for every z≥0z\ge0z≥0,

wR(z)=u(z)=E−z1[e−ατκ∗+Yτκ∗],w^R(z)=u(z)=\mathbb E^1_{-z}\big[e^{-\alpha\tau_{\kappa^*}+Y_{\tau_{\kappa^*}}}\big],wR(z)=u(z)=E−z1​[e−ατκ∗​+Yτκ∗​​],

and τκ∗\tau_{\kappa^*}τκ∗​ is a P1\mathbb P^1P1-a.s. finite F\mathbf FF-stopping time.

Milestones

  1. Remark 4: W(u)(x)=evxWv(u−ψ(v))(x)W^{(u)}(x)=e^{vx}W_v^{(u-\psi(v))}(x)W(u)(x)=evxWv(u−ψ(v))​(x).
  2. Lemma 1: Z(q)(x)/W(q)(x)→q/Φ(q)Z^{(q)}(x)/W^{(q)}(x)\to q/\Phi(q)Z(q)(x)/W(q)(x)→q/Φ(q) as x→∞x\to\inftyx→∞ (for q≥0q\ge0q≥0, with the paper's convention for 0/Φ(0)0/\Phi(0)0/Φ(0)).
  3. Remark 3: Wv(0+)=0W_v(0+)=0Wv​(0+)=0 if and only if XXX has unbounded variation.
  4. Corollary 1, (29): the value of stopping at τk\tau_kτk​,
E−z1(e−ατk+Yτk)=ez(Z(q)(k−z)+Z(q)(k)−qW(q)(k)W(q)′(k)−W(q)(k)W(q)(k−z)).\mathbb E^1_{-z}\big(e^{-\alpha\tau_k+Y_{\tau_k}}\big)=e^z\Big(Z^{(q)}(k-z)+\frac{Z^{(q)}(k)-qW^{(q)}(k)}{W^{(q)\prime}(k)-W^{(q)}(k)}W^{(q)}(k-z)\Big).E−z1​(e−ατk​+Yτk​​)=ez(Z(q)(k−z)+W(q)′(k)−W(q)(k)Z(q)(k)−qW(q)(k)​W(q)(k−z)).
  1. Lemma 2 (i): for q>rq>rq>r, f=Z(q)−qW(q)f=Z^{(q)}-qW^{(q)}f=Z(q)−qW(q) decreases on [0,∞)[0,\infty)[0,∞) to −∞-\infty−∞.
  2. Lemma 2 (ii): κ∗=0\kappa^*=0κ∗=0 if W(q)(0+)≥q−1W^{(q)}(0+)\ge q^{-1}W(q)(0+)≥q−1; otherwise κ∗>0\kappa^*>0κ∗>0 is the unique root of fff.
  3. The stopped process e−α(t∧τκ∗)u(Yt∧τκ∗)e^{-\alpha(t\wedge\tau_{\kappa^*})}u(Y_{t\wedge\tau_{\kappa^*}})e−α(t∧τκ∗​)u(Yt∧τκ∗​​) is a P1\mathbb P^1P1-martingale.
  4. E−z1[e−αt+YtZ(q)(κ∗−Yt)]≤ezZ(q)(κ∗−z)\mathbb E^1_{-z}[e^{-\alpha t+Y_t}Z^{(q)}(\kappa^*-Y_t)]\le e^zZ^{(q)}(\kappa^*-z)E−z1​[e−αt+Yt​Z(q)(κ∗−Yt​)]≤ezZ(q)(κ∗−z).
  5. e−αtu(Yt)e^{-\alpha t}u(Y_t)e−αtu(Yt​) is a P1\mathbb P^1P1-supermartingale.

Significance

The result. Theorem 2 gives the price of the perpetual Russian option and its optimal exercise rule for every exponential spectrally negative Lévy market. The rule is to exercise when the ratio of the running maximum to the current price first reaches eκ∗e^{\kappa^*}eκ∗. The level is explicit through scale functions, and it separates the regimes: for bounded variation with W(q)(0+)≥q−1W^{(q)}(0+)\ge q^{-1}W(q)(0+)≥q−1, immediate exercise is optimal. The theorem is the model case of a general method: an optimal stopping problem for a functional of (X,X‾)(X,\overline X)(X,X) is reduced, by a change of measure, to one for the reflected process, and solved by verification. The same method underlies the Canadized Russian option (third mission of the series).

Formalizing it. The result is proved in the paper; it has no machine-checked proof. This mission produces a Lean statement of the full verification theorem, including admissibility of τκ∗\tau_{\kappa^*}τκ∗​. It also states the analytic facts about scale functions that the proof relies on (Lemmas 1, 2 and Remarks 3, 4), which apply to any problem phrased in scale functions.

Difficulty

The obvious route is the classical verification: show that e−αtu(Yt)e^{-\alpha t}u(Y_t)e−αtu(Yt​) is a supermartingale, apply optional stopping, and check equality at τκ∗\tau_{\kappa^*}τκ∗​. The first step fails as a direct Itô computation. In the unbounded-variation case uuu is only C1C^1C1 at κ∗\kappa^*κ∗, and in the bounded-variation case only continuous there. The generator of YYY is nonlocal, so smoothness away from κ∗\kappa^*κ∗ does not control the jump part of the process across the boundary. The equality case needs the exact value of stopping at τk\tau_kτk​ (Corollary 1). That value requires the overshoot of YYY over kkk, which is caused by a downward jump of XXX, and the exit problem of the reflected process. Finally, P1\mathbb P^1P1 is not equivalent to P\mathbb PP on F∞\mathcal F_\inftyF∞​, so passing from P\mathbb PP-facts to P1\mathbb P^1P1-facts is valid only on each Ft\mathcal F_tFt​.

Formalization scope

Conventions committed to in Lean:

  • Time is [0,∞)[0,\infty)[0,∞) (ℝ≥0) and values are real. Random times take values in [0,∞][0,\infty][0,∞] (WithTop ℝ≥0), and the payoff is set to 000 on {τ=∞}\{\tau=\infty\}{τ=∞}, a P1\mathbb P^1P1-null event for admissible τ\tauτ.
  • The spectrally negative Lévy process is a structure: measurable marginals, X0=0X_0=0X0​=0, independent increments, stationary increments, càdlàg paths, no positive jumps, not almost surely monotone. Paths start at 000, are càdlàg, and have no positive jumps for every ω\omegaω, not merely almost surely. Adaptedness, independence of increments from the past, and right-continuity of F\mathbf FF are added for the filtered version.
  • "The usual conditions" are read as right-continuity only; completeness is not imposed. P1\mathbb P^1P1 is typically singular to P\mathbb PP on F∞\mathcal F_\inftyF∞​, so a complete F0\mathcal F_0F0​ would contradict (3).
  • "Unbounded variation" means "not almost surely of bounded variation on compacts". Condition (AC) is stated through jumps: no jump lands in a Lebesgue-null set, almost surely. The standing assumption is "bounded variation implies (AC)".
  • ψ\psiψ is Mathlib's cumulant generating function; "ψ(v)<∞\psi(v)<\inftyψ(v)<∞" is integrability of evX1e^{vX_1}evX1​.
  • W(q)W^{(q)}W(q) is a definite description (choice among functions with the properties of Definition 2) for q≥0q\ge0q≥0, and the series (5) for q<0q<0q<0. Z(q)Z^{(q)}Z(q) integrates over (−∞,x](-\infty,x](−∞,x].
  • P1\mathbb P^1P1 is data (a probability measure Q\mathbb QQ) with Q∣Ft=eXt−rt⋅P∣Ft\mathbb Q|_{\mathcal F_t}=e^{X_t-rt}\cdot\mathbb P|_{\mathcal F_t}Q∣Ft​​=eXt​−rt⋅P∣Ft​​ for all ttt. P−z1\mathbb P^1_{-z}P−z1​ is encoded by the reflected process with prior maximum 000 and starting point −z-z−z.
  • The value function is a supremum in [0,∞][0,\infty][0,∞] of lower Lebesgue integrals. Expectation identities (Corollary 1, the display on p. 230) are stated in [0,∞][0,\infty][0,∞] and thereby assert finiteness.
  • W(q)(0+)W^{(q)}(0+)W(q)(0+) is Function.rightLim, and κ∗\kappa^*κ∗ is the real infimum (30); its nonemptiness is Lemma 2, not a hypothesis. τ0=0\tau_0=0τ0​=0 extends the paper's τk\tau_kτk​, k>0k>0k>0.
  • Readings of informal words: "decreases monotonically" is strict decrease on [0,∞)[0,\infty)[0,∞); "the unique root" is on [0,∞)[0,\infty)[0,∞); Lemma 1 is formalized for q≥0q\ge0q≥0, with 0/Φ(0)0/\Phi(0)0/Φ(0) read as lim⁡θ↓0θ/Φ(θ)\lim_{\theta\downarrow0}\theta/\Phi(\theta)limθ↓0​θ/Φ(θ) as the paper stipulates; Remarks 3 and 4 for real qqq, uuu only. The p. 230 martingale, bound and supermartingale claims are stated under the standing assumption, covering all three cases of the proof.

A trivializing formalization is ruled out: the supremum ranges over every P1\mathbb P^1P1-a.s. finite stopping time of the given filtration (not only passage times, not a smaller filtration), and it is taken in [0,∞][0,\infty][0,∞], where no junk value of an unbounded real supremum can occur.

Infrastructure a complete development needs: Lévy processes on path space, their Laplace exponents and Esscher transforms, scale functions (existence, uniqueness, smoothness under the standing assumption), the reflected process and the exit identity of Theorem 1, optional stopping for continuous-time supermartingales, and Itô/change-of-variables formulas for semimartingales with jumps. The scale-function and Esscher layers are reusable for the other missions of this series and for any fluctuation-theory problem. Contributions to any of these layers, or to the milestones separately, are welcome.

Selected references

  • F. Avram, A. E. Kyprianou, M. R. Pistorius, Exit problems for spectrally negative Lévy processes and applications to (Canadized) Russian options, Ann. Appl. Probab. 14(1), 215–238, 2004. https://doi.org/10.1214/aoap/1075828052
  • L. Shepp, A. N. Shiryaev, The Russian option: reduced regret, Ann. Appl. Probab. 3(3), 631–640, 1993. https://doi.org/10.1214/aoap/1177005715
  • J. Bertoin, Lévy Processes, Cambridge Tracts in Mathematics 121, Cambridge University Press, 1996. ISBN 0-521-56243-0
  • A. E. Kyprianou, Fluctuations of Lévy Processes with Applications, 2nd ed., Springer, 2014. https://doi.org/10.1007/978-3-642-37632-0
17 thms1 active userReviewed
Dynamic ProgrammingOperations ResearchOptimization+1·Captain: Shuze Chen

Markov Decision Processes II: Existence of Optimal Policies under Compactness and ContinuityTextbook

Motivation

The finite-horizon theory of chunk 02a-model-bellman-equation (Bäuerle and Rieder's Theorem 2.3.8, the Structure Theorem) reduces the existence of an optimal policy and the validity of the Bellman equation to a single abstract hypothesis: the Structure Assumption (SAN), the existence of function classes IMn\mathrm{IM}_nIMn​ and decision-rule classes Δn\Delta_nΔn​ closed under the one-step optimality operator TnT_nTn​. That theorem does not say when (SAN) actually holds for a given Markov Decision Model — checking it directly from the definition would require exhibiting, for every value function that could arise, both its regularity and a measurable action attaining its supremum, an infinite regress. This mission formalizes the classical resolution: sufficient conditions on the primitive data of the model (the admissible-action correspondence, the transition kernel, the one-stage reward) under which (SAN) is guaranteed, so that Theorem 2.3.8 becomes usable in practice rather than merely an existence statement.

Setting

Fix a Markov Decision Model (E,A,Dn,Qn,rn,gN)n=0,…,N−1(E, A, D_n, Q_n, r_n, g_N)_{n=0,\dots,N-1}(E,A,Dn​,Qn​,rn​,gN​)n=0,…,N−1​ (chunk 02a's Definition 2.1.1), now with EEE, AAA Borel spaces. A measurable b:E→R+b : E \to \mathbb{R}_+b:E→R+​ is an upper bounding function (Definition 2.4.1) if rn+(x,a)≤crb(x)r_n^+(x,a) \le c_r b(x)rn+​(x,a)≤cr​b(x), gN+(x)≤cgb(x)g_N^+(x) \le c_g b(x)gN+​(x)≤cg​b(x), and ∫b(x′) Qn(dx′∣x,a)≤αbb(x)\int b(x')\, Q_n(dx' \mid x,a) \le \alpha_b b(x)∫b(x′)Qn​(dx′∣x,a)≤αb​b(x) for constants cr,cg,αb≥0c_r, c_g, \alpha_b \ge 0cr​,cg​,αb​≥0; write IBb+\mathrm{IB}_b^+IBb+​ for the value functions of weighted growth at most c bc\, bcb for some ccc. A set-valued map x↦D(x)x \mapsto D(x)x↦D(x) is upper semicontinuous if xn→xx_n \to xxn​→x and an∈D(xn)a_n \in D(x_n)an​∈D(xn​) force (an)(a_n)(an​) to have an accumulation point in D(x)D(x)D(x) (Definition A.2.1); it is continuous if also every point of D(x)D(x)D(x) is approximated by a sequence from the D(xn)D(x_n)D(xn​).

Formalization targets

Goal: Theorem 2.4.13

Suppose the model has an upper bounding function bbb, and for every n<Nn < Nn<N: (i) Dn(x)D_n(x)Dn​(x) is compact for every xxx; (ii) a↦∫v(x′) Qn(dx′∣x,a)a \mapsto \int v(x')\, Q_n(dx' \mid x,a)a↦∫v(x′)Qn​(dx′∣x,a) is upper semicontinuous on Dn(x)D_n(x)Dn​(x) for every v∈IBb+v \in \mathrm{IB}_b^+v∈IBb+​ and every xxx; (iii) a↦rn(x,a)a \mapsto r_n(x,a)a↦rn​(x,a) is upper semicontinuous on Dn(x)D_n(x)Dn​(x) for every xxx. Then IMn:=IBb+\mathrm{IM}_n := \mathrm{IB}_b^+IMn​:=IBb+​, Δn:=Fn\Delta_n := F_nΔn​:=Fn​ satisfy (SAN). Unlike the two milestone theorems that precede it in the chapter (Theorem 2.4.6 and Theorem 2.4.10, both of which also assume the correspondence x↦Dn(x)x \mapsto D_n(x)x↦Dn​(x) varies semicontinuously or continuously with xxx), Theorem 2.4.13 assumes nothing about Dn(⋅)D_n(\cdot)Dn​(⋅) as a set-valued map beyond pointwise compactness of each fiber Dn(x)D_n(x)Dn​(x); correspondingly it needs semicontinuity of the objective only in the action variable, at each state separately, and it recovers all of IBb+\mathrm{IB}_b^+IBb+​ as the regularity class rather than a semicontinuous or continuous sub-class of it.

Milestones

Proposition 2.4.3 and Proposition 2.4.8 show, respectively, that TnT_nTn​ preserves upper semicontinuity (resp. continuity) of vvv and that a maximizer exists, when Dn(x)D_n(x)Dn​(x) is compact and x↦Dn(x)x \mapsto D_n(x)x↦Dn​(x) is upper semicontinuous (resp. continuous); Theorem 2.4.6 and Theorem 2.4.10 package these into concrete instances of (SAN). Lemma 2.4.7 gives a checkable criterion — weak continuity of the kernel QnQ_nQn​ — for Theorem 2.4.6's integral-semicontinuity hypothesis. Proposition 2.4.11 drops all topological structure on Dn(⋅)D_n(\cdot)Dn​(⋅) itself, keeping only pointwise compactness of Dn(x)D_n(x)Dn​(x) plus semicontinuity of the objective in the action alone, and is what the goal theorem invokes directly, via a projection theorem of Kunugui and Novikov in place of the sequential compactness argument used for Proposition 2.4.3.

Significance

Compactness of the action set together with semicontinuity of the reward is the textbook Weierstrass mechanism for the existence of a maximizer in ordinary optimization; the content of this chapter is doing the same thing correctly when the maximization varies measurably over an uncountable state space EEE, so that the resulting maximizer is not just pointwise-optimal but a genuine decision rule (a measurable function of the state). No formalized version of this theory exists on the platform: BertsekasDP's existence theorems are for finite state-and-action-space models, where D(x)D(x)D(x) is automatically compact (in the discrete topology) and every real-valued function on it is automatically semicontinuous, so none of this chapter's actual content — choosing a measurable maximizing selection as the state varies continuously — has any analogue there. This chunk earns the generalization rather than restating that finite-state prior art.

Difficulty

The three "compactness implies (SAN)" theorems of this chapter (2.4.6, 2.4.10, 2.4.13) trade regularity of the action correspondence x↦Dn(x)x \mapsto D_n(x)x↦Dn​(x) against regularity of the resulting value-function class: assuming more about how Dn(⋅)D_n(\cdot)Dn​(⋅) varies (continuity, in Theorem 2.4.10) buys a stronger conclusion (continuous, not merely upper semicontinuous, value functions); assuming nothing about Dn(⋅)D_n(\cdot)Dn​(⋅) beyond pointwise compactness (Theorem 2.4.13, the goal) forces the weakest conclusion, that the whole class IBb+\mathrm{IB}_b^+IBb+​ is preserved, via a genuinely different, measure-theoretic argument (a projection theorem) rather than the sequential compactness argument common to Propositions 2.4.3 and 2.4.8. Formalizing all three side by side, rather than only the goal in isolation, is what exposes this trade-off as three logically independent theorems rather than one theorem instantiated three times, and is why every one of the section's numbered results is kept as an item of this mission (per the CAPTAIN's budget instruction to include, not cut, results of genuine independent content) rather than only the smallest set literally required by the goal's own proof tree.

Formalization scope

State and action spaces carry MeasurableSpace, TopologicalSpace, BorelSpace instances throughout (the section's own standing assumption that EEE, AAA are Borel spaces), but no metrizability or separability instance is required beyond what each statement's own topology needs — sequences suffice for every semicontinuity notion used here, matching the book's own Appendix A, which is stated for metric spaces. The Markov Decision Model, its operators (LnL_nLn​, TnT_nTn​, TnfT_n^fTnf​), the notion of a maximizer, and the Structure Assumption are restated from chunk 02a-model-bellman-equation in this mission's own MDPFinance.Semicontinuous namespace (drafts in this series cannot import one another). Set-valued upper/lower semicontinuity (Appendix A.2.1) is formalized with the book's own sequential definition, not Mathlib's neighborhood-filter-based UpperHemicontinuous/LowerHemicontinuous for correspondences — the book explicitly remarks that its own definition is "slightly more restrictive than other definitions appearing in the literature" (p. 351), so identifying the two without proof would silently substitute a different notion. The classes IBb\mathrm{IB}_bIBb​, IBb+\mathrm{IB}_b^+IBb+​ are formalized via the book's own equivalent bound-by-a-constant characterization rather than through the weighted supremum norm ∥⋅∥b\|\cdot\|_b∥⋅∥b​ itself, avoiding EReal division and its 0/0 := 0 convention for no loss of content. Each of Theorem 2.4.6's and Theorem 2.4.10's closing "in particular" sentences — restating chunk 02a's Theorem 2.3.8 applied to the (SAN) instance just constructed — is not repeated in this mission's Lean, since it is a corollary of a different chunk's goal, not new content of this section; only the "(SAN) is satisfied" conclusion that is this section's own contribution is stated. A trivializing formalization of the goal would specialize AAA to a finite type or fix Dn(x)D_n(x)Dn​(x) to a single compact set independent of xxx, making hypotheses (i)-(iii) vacuous; this mission states the theorem for arbitrary Borel AAA and a genuinely state-dependent Dn(x)D_n(x)Dn​(x).

Selected references

  • N. Bäuerle and U. Rieder, Markov Decision Processes with Applications to Finance, Universitext, Springer, 2011. DOI: 10.1007/978-3-642-18324-9.
  • D. P. Bertsekas and S. E. Shreve, Stochastic Optimal Control: The Discrete Time Case, Academic Press, 1978.
  • C. J. Himmelberg, T. Parthasarathy, and F. S. Van Vleck, "Optimal plans for dynamic programming problems", Mathematics of Operations Research 1 (1976), 390-394.
  • K. Kuratowski and C. Ryll-Nardzewski, "A general theorem on selectors", Bulletin de l'Académie Polonaise des Sciences 13 (1965), 397-403.
13 thms2 active usersReviewed
Convex OptimizationDiscrete GeometryLinear Optimization+2·Captain: mikedeng1

On Polyhedral Approximations of the Second-Order Cone II: A Lower Bound on the Size of Polyhedral ApproximationsResearch Paper

Motivation

A conic quadratic program minimizes a linear objective subject to constraints of the form ∥Aℓx−bℓ∥2≤cℓTx−dℓ\|A_\ell x-b_\ell\|_2\le c_\ell^Tx-d_\ell∥Aℓ​x−bℓ​∥2​≤cℓT​x−dℓ​. Interior-point methods solve such programs in polynomial time, but around 2000 the available solvers handled far smaller instances than linear programming codes did. Ben-Tal and Nemirovski (Math. Oper. Res. 26(2), 2001) asked whether a conic quadratic program can be replaced by a linear program of comparable size, and answered it by approximating each second-order cone by a projection of a polyhedral cone. Their Theorem 1.1 builds such an approximation with accuracy ε\varepsilonε using O(kln⁡(2/ε))O(k\ln(2/\varepsilon))O(kln(2/ε)) variables and inequalities. The present mission is their Proposition 3.1: this size is optimal in order, because every polyhedral ε\varepsilonε-approximation needs Ω(kln⁡(1/ε))\Omega(k\ln(1/\varepsilon))Ω(kln(1/ε)) inequalities.

The question of how many linear inequalities are needed to represent or approximate a convex set as a projection (its extension complexity) has since become a subject of its own, and the lower bound of Proposition 3.1 is one of its early explicit instances for a non-polyhedral cone.

Setting

For y∈Rky\in\mathbb R^ky∈Rk write ∥y∥2=y12+⋯+yk2\|y\|_2=\sqrt{y_1^2+\dots+y_k^2}∥y∥2​=y12​+⋯+yk2​​. The Lorentz cone is

Lk={(y,t)∈Rk×R∣t≥∥y∥2}.L^k=\{(y,t)\in\mathbb R^k\times\mathbb R\mid t\ge\|y\|_2\}.Lk={(y,t)∈Rk×R∣t≥∥y∥2​}.

Let ε>0\varepsilon>0ε>0. A polyhedral ε\varepsilonε-approximation of LkL^kLk is a linear map Π:Rk×R×Rp→Rq\Pi:\mathbb R^k\times\mathbb R\times\mathbb R^p\to\mathbb R^qΠ:Rk×R×Rp→Rq such that

  1. if (y,t)∈Lk(y,t)\in L^k(y,t)∈Lk, then Π(y,t,u)≥0\Pi(y,t,u)\ge0Π(y,t,u)≥0 for some u∈Rpu\in\mathbb R^pu∈Rp;
  2. if Π(y,t,u)≥0\Pi(y,t,u)\ge0Π(y,t,u)≥0 for some uuu, then ∥y∥2≤(1+ε)t\|y\|_2\le(1+\varepsilon)t∥y∥2​≤(1+ε)t.

Here ≥0\ge0≥0 is componentwise, ppp is the number of auxiliary variables and qqq the number of homogeneous linear inequalities. Equivalently, the polyhedral cone K={(y,t,u)∣Π(y,t,u)≥0}K=\{(y,t,u)\mid\Pi(y,t,u)\ge0\}K={(y,t,u)∣Π(y,t,u)≥0} projects onto a cone L^k\widehat L^kLk of the (y,t)(y,t)(y,t)-space with Lk⊆L^k⊆{(y,t)∣∥y∥2≤(1+ε)t}L^k\subseteq\widehat L^k\subseteq\{(y,t)\mid\|y\|_2\le(1+\varepsilon)t\}Lk⊆Lk⊆{(y,t)∣∥y∥2​≤(1+ε)t}. The slice of L^k\widehat L^kLk at height one is G={y∣(y,1)∈L^k}G=\{y\mid(y,1)\in\widehat L^k\}G={y∣(y,1)∈Lk}, and B={y∣∥y∥2≤1}B=\{y\mid\|y\|_2\le1\}B={y∣∥y∥2​≤1} denotes the closed unit ball.

Formalization targets

Goal: Proposition 3.1, Eq. (13)

∃ c>0  ∀k≥2, ∀ε∈(0,12], ∀p,q, ∀Π polyhedral ε-approximation of Lk:q ≥ c kln⁡1ε.\exists\,c>0\ \ \forall k\ge2,\ \forall\varepsilon\in(0,\tfrac12],\ \forall p,q,\ \forall\Pi\ \text{polyhedral }\varepsilon\text{-approximation of }L^k:\qquad q\ \ge\ c\,k\ln\tfrac1\varepsilon .∃c>0  ∀k≥2, ∀ε∈(0,21​], ∀p,q, ∀Π polyhedral ε-approximation of Lk:q ≥ cklnε1​.

The constant is absolute, as in the paper, and no value is fixed; the goal asserts only the order of growth.

Milestones (claims of the proof, in order)

  1. Reduction. For ε>0\varepsilon>0ε>0 one may replace Π\PiΠ by an approximation with the same qqq, at most ppp auxiliary variables and the same projection, whose cone KKK contains no line.
  2. Extreme rays. A line-free cone {z∣Az≥0}\{z\mid Az\ge0\}{z∣Az≥0} defined by qqq inequalities is the conic hull of at most 2q2^q2q extreme rays.
  3. Sandwich. B⊆G⊆(1+ε)BB\subseteq G\subseteq(1+\varepsilon)BB⊆G⊆(1+ε)B.
  4. Vertices. If KKK has no line, GGG is the convex hull of N≤2qN\le2^qN≤2q points.
  5. Covering. If conv⁡{y1,…,yN}⊇B\operatorname{conv}\{y_1,\dots,y_N\}\supseteq Bconv{y1​,…,yN​}⊇B and all ∥yi∥2≤1+ε\|y_i\|_2\le1+\varepsilon∥yi​∥2​≤1+ε, the closed balls of radius 2ε(1+ε)\sqrt{2\varepsilon(1+\varepsilon)}2ε(1+ε)​ about the yiy_iyi​ cover the sphere {∥y∥2=1+ε}\{\|y\|_2=1+\varepsilon\}{∥y∥2​=1+ε}.
  6. Counting. For k≥2k\ge2k≥2 and ε≤12\varepsilon\le\tfrac12ε≤21​ such a covering needs N≥exp⁡{c kln⁡(1/ε)}N\ge\exp\{c\,k\ln(1/\varepsilon)\}N≥exp{ckln(1/ε)} balls.

Significance

The result. Proposition 3.1 shows that the construction of Theorem 1.1 is optimal up to an absolute factor in the number of inequalities: approximating a conic quadratic constraint in dimension kkk to relative accuracy ε\varepsilonε by linear inequalities costs Θ(kln⁡(1/ε))\Theta(k\ln(1/\varepsilon))Θ(kln(1/ε)) inequalities, no more and no less. It separates what lifting (auxiliary variables) buys, a logarithmic dependence on 1/ε1/\varepsilon1/ε, from what it cannot buy, a sub-linear dependence on kkk or on ln⁡(1/ε)\ln(1/\varepsilon)ln(1/ε). Without auxiliary variables a polytope approximating the ball needs ε−Ω(k)\varepsilon^{-\Omega(k)}ε−Ω(k) facets; the proposition says the logarithm of that count is the true cost even when lifting is allowed.

Formalizing it. The result is proved in the paper, in about fifteen lines that appeal to "elementary geometry" and to an unstated covering estimate. No machine-checked proof is known to exist. The mission produces a checked proof of the lower bound together with reusable facts: the finiteness bound on extreme rays of a pointed polyhedral cone and a lower bound on the number of balls needed to cover a Euclidean sphere, which Mathlib does not contain in this form. A companion mission of this series formalizes the matching upper bound (Theorem 1.1).

Difficulty

The obvious argument counts vertices of GGG: at most 2q2^q2q of them, and a polytope between BBB and (1+ε)B(1+\varepsilon)B(1+ε)B needs many vertices. The difficulty is in making "many" quantitative with the right exponent. A direct volume comparison of GGG with BBB gives nothing, since GGG may have the volume of (1+ε)B(1+\varepsilon)B(1+ε)B. The argument needs the transfer from "the convex hull of the points contains BBB" to "the points are 2ε(1+ε)\sqrt{2\varepsilon(1+\varepsilon)}2ε(1+ε)​-dense on the outer sphere", and then a lower bound on the size of a covering of a sphere by balls whose centres need not lie on the sphere, uniform down to k=2k=2k=2 and up to ε=12\varepsilon=\tfrac12ε=21​, where ln⁡(1/ε)\ln(1/\varepsilon)ln(1/ε) is only ln⁡2\ln2ln2 and the radius 2ε(1+ε)\sqrt{2\varepsilon(1+\varepsilon)}2ε(1+ε)​ is comparable to the sphere's radius. A second, easily overlooked step is the passage to a line-free cone: KKK itself may contain lines in the uuu-directions, in which case it has no extreme rays at all.

Formalization scope

Vectors of Rk\mathbb R^kRk are Fin k → ℝ, and the Euclidean norm is written out as eucNorm y = √(∑ i, y i ^ 2); the norm Mathlib puts on Fin k → ℝ is the sup norm, under which LkL^kLk is polyhedral and the goal is false. A polyhedral approximation is an R\mathbb RR-linear map (Fin k → ℝ) × ℝ × (Fin p → ℝ) →ₗ[ℝ] (Fin q → ℝ), and ppp, qqq are the dimensions of its types; with arbitrary (nonlinear) maps, Π(y,t)=t−∥y∥2\Pi(y,t)=t-\|y\|_2Π(y,t)=t−∥y∥2​ would give q=1q=1q=1, so linearity is what makes the statement non-trivial. "Extreme ray" means a ray {sr∣s≥0}\{sr\mid s\ge0\}{sr∣s≥0}, r≠0r\ne0r=0, that is an extreme subset (Mathlib IsExtreme) of the cone, counted once per ray.

Corrections of the printed statement. Proposition 3.1 is printed for every positive integer kkk. It is false for k=1k=1k=1: L1={∣y∣≤t}L^1=\{|y|\le t\}L1={∣y∣≤t} is polyhedral, and Π(y,t)=(t−y,t+y)\Pi(y,t)=(t-y,t+y)Π(y,t)=(t−y,t+y) is a polyhedral ε\varepsilonε-approximation with q=2q=2q=2 for every ε\varepsilonε, so q≥cln⁡(1/ε)q\ge c\ln(1/\varepsilon)q≥cln(1/ε) fails for small ε\varepsilonε. The goal and the counting milestone are therefore stated for k≥2k\ge2k≥2, which is the case the proof covers. The phrase "polyhedral α\alphaα approximation" in the proof is read as ε\varepsilonε. The paper's O(1)O(1)O(1) constants are existential and quantified before every variable they are uniform over; no numerical value is asserted.

A complete development needs the Minkowski–Weyl representation of pointed polyhedral cones by extreme rays, basic convex-hull and separation arguments in Euclidean space, and a lower bound for covering numbers of spheres (for instance by a cap-measure or volume argument). The extreme-ray and covering lemmas are independent of the Lorentz cone and are welcome as stand-alone contributions.

Selected references

  • A. Ben-Tal and A. Nemirovski, On Polyhedral Approximations of the Second-Order Cone, Mathematics of Operations Research 26(2):193–205, 2001. https://doi.org/10.1287/moor.26.2.193.10561
  • A. Ben-Tal and A. Nemirovski, Lectures on Modern Convex Optimization: Analysis, Algorithms, and Engineering Applications, SIAM, 2001. https://doi.org/10.1137/1.9780898718829
10 thms2 active usersReviewed
Convex OptimizationDiscrete GeometryOperations Research+1·Captain: Shuze Chen

Discrete Convex Analysis XVI: Substitutes and Complements in Network FlowsTextbook

Motivation

In economics, a pair of goods are substitutes if raising the price of one increases demand for the other, and complements if it decreases it; formally, a utility or value function is submodular in the substitutes case and supermodular in the complements case. A natural question is which of these two regimes a given optimization problem's value function falls into, and whether the answer depends on the underlying combinatorial structure of the problem rather than being a coincidence of the particular numbers involved. Murota's Discrete Convex Analysis (SIAM, 2003) answers this question for the maximum-weight circulation problem in a directed network: the value function is submodular in some coordinates and supermodular in others, purely as a consequence of a graph-theoretic distinction — whether the arcs involved are parallel or series — and this chapter shows the distinction is explained precisely by the dual pair of discrete convexity notions (L-natural-convexity and M-natural-convexity) developed elsewhere in the book. This mission also completes the quadratic-forms thread the previous mission in this series (Discrete Convex Analysis XV) began, by formalizing its natural generalization to functions that may take the value +∞+\infty+∞.

Setting

Let G=(V,A)G=(V,A)G=(V,A) be a directed graph with vertex set VVV and arc set AAA; write ∂+a\partial^+a∂+a, ∂−a\partial^-a∂−a for the initial and terminal vertex of arc aaa. For a flow ξ:A→R\xi:A\to\mathbb Rξ:A→R, its boundary is ∂ξ(v)=∑a:∂+a=vξ(a)−∑a:∂−a=vξ(a)\partial\xi(v)=\sum_{a:\partial^+a=v}\xi(a)-\sum_{a:\partial^-a=v}\xi(a)∂ξ(v)=∑a:∂+a=v​ξ(a)−∑a:∂−a=v​ξ(a), the net flow leaving vvv. Given a capacity c:A→R≥0c:A\to\mathbb R_{\ge0}c:A→R≥0​, ξ\xiξ is a feasible circulation for ccc if 0≤ξ(a)≤c(a)0\le\xi(a)\le c(a)0≤ξ(a)≤c(a) for every arc and ∂ξ(v)=0\partial\xi(v)=0∂ξ(v)=0 for every vertex. For a weight w:A→Rw:A\to\mathbb Rw:A→R, F(w,c)=max⁡{⟨w,ξ⟩:ξ feasible for c}F(w,c)=\max\{\langle w,\xi\rangle : \xi\text{ feasible for }c\}F(w,c)=max{⟨w,ξ⟩:ξ feasible for c} is the maximum-weight circulation value, and ξ\xiξ is optimal for www (with capacity ccc) if it is feasible and attains this maximum. A simple cycle is an alternating sequence of pairwise distinct vertices v0,…,vk−1v_0,\dots,v_{k-1}v0​,…,vk−1​ and arcs a1,…,aka_1,\dots,a_ka1​,…,ak​ with {∂+ai,∂−ai}={vi−1,vi}\{\partial^+a_i,\partial^-a_i\}=\{v_{i-1},v_i\}{∂+ai​,∂−ai​}={vi−1​,vi​} (indices mod kkk) and v0=vkv_0=v_kv0​=vk​. Two arcs are parallel if every simple cycle containing both of them orients them oppositely, and series if every such cycle orients them the same way; a set of arcs is parallel (series) if its arcs are pairwise parallel (series). A circuit is a {0,±1}\{0,\pm1\}{0,±1}-valued π:A→R\pi:A\to\mathbb Rπ:A→R with ∂π=0\partial\pi=0∂π=0 whose support forms a simple cycle. For x∈Rnx\in\mathbb R^nx∈Rn, supp⁡+(x)={i:xi>0}\operatorname{supp}^+(x)=\{i:x_i>0\}supp+(x)={i:xi​>0}, supp⁡−(x)={i:xi<0}\operatorname{supp}^-(x)=\{i:x_i<0\}supp−(x)={i:xi​<0}. A function g:Rn→Rg:\mathbb R^n\to\mathbb Rg:Rn→R is submodular if g(p)+g(q)≥g(p∨q)+g(p∧q)g(p)+g(q)\ge g(p\vee q)+g(p\wedge q)g(p)+g(q)≥g(p∨q)+g(p∧q), supermodular with the reverse inequality, and has translation submodularity (is L-natural-convex) if the stronger inequality g(p)+g(q)≥g((p−α1)∨q)+g(p∧(q+α1))g(p)+g(q)\ge g((p-\alpha\mathbf1)\vee q)+g(p\wedge(q+\alpha\mathbf1))g(p)+g(q)≥g((p−α1)∨q)+g(p∧(q+α1)) holds for every α≥0\alpha\ge0α≥0. A function fff has the M-natural exchange property (is M-natural-convex) if for i∈supp⁡+(x−y)i\in\operatorname{supp}^+(x-y)i∈supp+(x−y) there exist j∈supp⁡−(x−y)∪{0}j\in \operatorname{supp}^-(x-y)\cup\{0\}j∈supp−(x−y)∪{0} and α0>0\alpha_0>0α0​>0 with f(x)+f(y)≥f(x−α(χi−χj))+f(y+α(χi−χj))f(x)+f(y)\ge f(x-\alpha(\chi_i-\chi_j))+f(y+\alpha(\chi_i-\chi_j))f(x)+f(y)≥f(x−α(χi​−χj​))+f(y+α(χi​−χj​)) for α∈[0,α0]\alpha\in[0,\alpha_0]α∈[0,α0​]; a function is M-natural-concave or L-natural-concave if its negation is M-natural- or L-natural-convex.

Formalization targets

Goal (Theorem 2.23). For PPP a parallel arc set and SSS a series arc set,

F is L-natural-convex in wP and M-natural-concave in cP,F\text{ is L-natural-convex in }w_P\text{ and M-natural-concave in }c_P,F is L-natural-convex in wP​ and M-natural-concave in cP​, F is M-natural-convex in wS and L-natural-concave in cS,F\text{ is M-natural-convex in }w_S\text{ and L-natural-concave in }c_S,F is M-natural-convex in wS​ and L-natural-concave in cS​,

where wPw_PwP​, cPc_PcP​ denote FFF's dependence on the coordinates of www, ccc indexed by PPP (resp. SSS) with the remaining coordinates held fixed. This is the mission's capstone: it upgrades the plain submodularity/supermodularity split of Theorem 2.22 to the sharper pair of combinatorial convexity classes that explains it.

Supporting milestones. Proposition 2.21 (the classical fact that FFF is convex in www and concave in ccc, with no combinatorial content — the baseline against which Theorem 2.23's sharper claim is measured); Theorem 2.16 (the general, possibly-+∞+\infty+∞-valued extension of the quadratic-form conjugacy from Discrete Convex Analysis XV's Theorem 2.11, to functions restricted to a linear subspace); Theorem 2.22 (plain submodularity/supermodularity of FFF in wP,cPw_P,c_PwP​,cP​ and wS,cSw_S,c_SwS​,cS​, the result Theorem 2.23 strengthens); and Propositions 2.24–2.28 (the graph-theoretic lemmas — sparse intersection of a circuit's support with a parallel or series arc set, merging two circuits along a series set, and three existence statements for optimality-preserving perturbations — that the book's own proof of Theorem 2.23 is built from).

Significance

Theorem 2.23 gives a structural explanation, rather than a case-by-case verification, for a phenomenon well known in network flow theory: that convexity/concavity and submodularity/supermodularity are independent properties, appearing in all four combinations depending on which side of the problem (weights or capacities) and which graph-theoretic role (parallel or series) is varied. Without it, (2.55)'s four combinations would be four separate facts with no common cause; with it, they are corollaries of two applications of a single pair of dual discrete-convexity notions, the same notions the book uses throughout to unify matroid theory, submodular optimization, and convex analysis. Formalizing this mission produces, so far as a platform search shows, the first Lean statement of a combinatorial-convexity classification result for a network optimization value function, together with the graph-theoretic vocabulary (simple cycles, parallel/series arcs, circuits) needed to state it — infrastructure with no prior formalized counterpart on the platform that a later mission on network flows or matroid union could reuse.

Difficulty

The naive approach to Theorem 2.23 tries to verify translation submodularity or the exchange property directly from the linear-programming definition of FFF as a maximum over a polytope, treating wP↦F(w,c)w_P\mapsto F(w,c)wP​↦F(w,c) as an abstract convex-piecewise-linear function; this loses the graph structure entirely and gives at best the plain submodularity of Theorem 2.22, not the sharper L-natural/M-natural classification, because submodularity alone does not distinguish a combinatorially meaningful discrete convexity from an arbitrary submodular function. The book's actual route instead works with explicit optimal circulations for the two perturbed weight vectors and reconstructs a feasible pair achieving the target inequality by rerouting flow along a circuit — and the existence of a usable circuit (one that touches the perturbed arcs in a way compatible with the parallel or series structure) is exactly what Propositions 2.24–2.28 supply via the conformal decomposition of a difference of two circulations into elementary circuits. This is why those five propositions, although individually narrow existence lemmas, are included as milestones: they are the load-bearing combinatorial content the naive convex-analytic argument cannot reach.

Formalization scope

The graph is {V A : Type*} with src dst : A → V rather than a bundled structure, matching the book's own ∂+,∂−\partial^+,\partial^-∂+,∂− notation directly. F(w,c)F(w,c)F(w,c) is a real sSup over feasible circulations' weights (existence of a maximizer is not asserted, since no proof is attempted this pass); IsOptimalCirc is a separate, directly-stated primitive for "ξ\xiξ is optimal for www", matching the book's own working vocabulary in the propositions that need it. A simple cycle is formalized as an injective cyclically-indexed vertex sequence together with a matching arc sequence, exactly as the book's own footnote defines it; parallel and series arcs are defined by quantifying over every such representation of every simple cycle containing the two arcs, which is checked to be independent of which of a cycle's two traversal directions or starting vertex is chosen. Viewing FFF as a function of wPw_PwP​ alone extends a partial vector by a fixed background vector on the complement of PPP, the same partial-application device the book uses informally. M-natural- and L-natural-concavity are recorded as the corresponding convexity property of the negated function, the standard convention. The formalization does not trivialize: parallel and series arc sets are genuine graph-theoretic hypotheses (not, e.g., specialized to ∣P∣=1|P|=1∣P∣=1 or a graph with no simple cycles, which would make the parallel/series distinction vacuous), and Theorem 2.23's four conclusions are stated with the same combinatorial-convexity predicates (TranslationSubmodular, MNatExchangeR) used for the book's sharpest discrete convexity classes, not weakened to plain submodularity/supermodularity. Theorem 2.16 additionally needs Set (V → ℝ)-valued subspaces K, H (following the book's own set-builder notation for ker M and X⊥ rather than bundling them as Mathlib Submodules) and a WithTop ℝ-valued Legendre- Fenchel conjugate. Infrastructure needed beyond Mathlib: all graph, circulation, and combinatorial-convexity vocabulary is defined fresh in DiscreteConvex.CombinatorialC; a contribution proving any of the five graph-theoretic lemmas (Propositions 2.24–2.28) or the convex/concave halves of Proposition 2.21 independently would be a natural entry point.

Selected references

  • K. Murota, Discrete Convex Analysis, SIAM, 2003, DOI 10.1137/1.9780898718508, Chapter 2.
  • K. Murota, A. Shioura, "Conjugacy relationship between M-convex and L-convex functions in continuous variables," Mathematical Programming 101 (2004), 415–433.
  • R. T. Rockafellar, Network Flows and Monotropic Optimization, Wiley, 1984.
41 thms3 active usersReviewed
Dynamic ProgrammingOperations ResearchOptimization+1·Captain: Shuze Chen

Markov Decision Processes VI: Multiperiod Terminal Wealth ProblemsTextbook

Motivation

An investor with a fixed planning horizon, an initial fortune, and a personal attitude toward risk (a utility function) wants to allocate wealth between a riskless bond and several risky assets, rebalancing at each of NNN periods, to maximize the expected utility of terminal wealth. This is the oldest and most basic problem of mathematical finance's dynamic-programming tradition, going back to Samuelson (1969) and Merton (1969, continuous time). Bäuerle and Rieder's Chapter 4 is where the abstract finite-horizon Markov Decision Process theory built up in Chapter 2 — the Bellman equation, existence of optimal policies under compactness and continuity, propagation of concavity through the value function — is first put to genuine financial work: the multiperiod terminal-wealth problem is shown to be exactly an instance of that general theory, and the reduction pays off immediately in six closed-form solutions for the standard families of utility functions used throughout the literature (power, HARA, logarithmic, exponential).

Setting

An investor with utility function U:dom U→RU : \mathrm{dom}\,U \to \mathbb{R}U:domU→R (Definition 3.4.1: strictly increasing, strictly concave, continuous) and wealth xxx invests in a bond (interest rate in+1i_{n+1}in+1​ on [n,n+1)[n,n+1)[n,n+1)) and ddd risky assets with relative risk Rn+1R_{n+1}Rn+1​ (Chapter 3). The one-period problem: admissible investments D(x):={a∈Rd:(1+i)(x+a⋅R)∈dom U a.s.}D(x) := \{a \in \mathbb{R}^d : (1+i)(x+a\cdot R) \in \mathrm{dom}\,U \text{ a.s.}\}D(x):={a∈Rd:(1+i)(x+a⋅R)∈domU a.s.}, u(x,a):=E[U((1+i)(x+a⋅R))]u(x,a) := \mathbb{E}[U((1+i)(x+a\cdot R))]u(x,a):=E[U((1+i)(x+a⋅R))], v(x):=sup⁡a∈D(x)u(x,a)v(x) := \sup_{a \in D(x)} u(x,a)v(x):=supa∈D(x)​u(x,a). The multiperiod problem is the NNN-stage Markov Decision Model with state space E:=dom UE := \mathrm{dom}\,UE:=domU (wealth), action space Rd\mathbb{R}^dRd, transition Tn(x,a,z)=(1+in+1)(x+a⋅z)T_n(x,a,z) = (1+i_{n+1})(x+a\cdot z)Tn​(x,a,z)=(1+in+1​)(x+a⋅z), zero one-stage reward, terminal reward gN:=Ug_N := UgN​:=U; its value functions are Vn(x):=sup⁡πEn,xπ[U(XN)]V_n(x) := \sup_\pi \mathbb{E}^\pi_{n,x}[U(X_N)]Vn​(x):=supπ​En,xπ​[U(XN​)] over Markov portfolio strategies π\piπ.

Formalization targets

Goal — Theorem 4.2.2

VN=U,Vn(x)=sup⁡a∈Dn(x)E[Vn+1((1+in+1)(x+a⋅Rn+1))],V_N = U, \qquad V_n(x) = \sup_{a \in D_n(x)} \mathbb{E}\bigl[V_{n+1}\bigl((1+i_{n+1})(x+a\cdot R_{n+1})\bigr)\bigr],VN​=U,Vn​(x)=a∈Dn​(x)sup​E[Vn+1​((1+in+1​)(x+a⋅Rn+1​))],

with VnV_nVn​ strictly increasing, strictly concave and continuous, and an optimal portfolio strategy (f0∗,…,fN−1∗)(f_0^*,\dots,f_{N-1}^*)(f0∗​,…,fN−1∗​) realized by maximizers of the recursion. This is the structural result every closed-form solution below specializes.

Eight milestones: the one-period existence/regularity theorem the induction step reduces to (Theorem 4.1.1); the upper bounding function that makes Chapter 2's existence machinery apply (Proposition 4.2.1); the zero-mean special case (Theorem 4.2.4); and four utility-specific closed forms plus the binomial-model comparative-statics lemma (Theorems 4.2.6, 4.2.11, 4.2.13, 4.2.15; Lemma 4.2.9).

Significance

Theorem 4.2.2 is the template for every dynamic portfolio problem in the rest of this book (consumption-investment in Chapter 4 §4.3-4.4, mean-variance and index tracking later in Chapter 4, and the partially-observed and jump-market analogues in Chapters 6 and 9): check a handful of structural conditions on the market data, and the existence, regularity, and recursive computability of the optimal policy follow automatically from Chapter 2's general theory rather than needing a bespoke argument each time. The six closed-form corollaries are the results practitioners actually use: the power/HARA/log/exponential-utility feedback rules are the standard textbook portfolio formulas (the logarithmic case is Kelly betting; the exponential case's wealth-independent optimal amount is the CARA-utility hallmark used throughout insurance and reinsurance mathematics), and Lemma 4.2.9's monotonicity result is the discrete-time analogue of the Merton ratio's dependence on the market's risk premium.

No result of this chunk was found on the platform (searched "terminal wealth", "portfolio optimization", "power utility", "HARA utility"). The proofs are complete in the book and mostly short (each utility-specific theorem reduces to checking the Structure Assumption via a transformation to a fraction-of-wealth variable); this mission's contribution is the precise formal statement of each closed form, with its own explicit recursion for dnd_ndn​, since the six theorems share a structure but genuinely differ in which one-period sub-problem and which scaling variable (xxx, x+bSn0/SN0x+bS^0_n/S^0_Nx+bSn0​/SN0​, or a wealth-independent constant) each uses.

Difficulty

The obvious shortcut for the goal is to prove existence of an optimal policy and its concavity/monotonicity properties by separate, ad hoc arguments at each stage; the actual content of Theorem 4.2.2 is that both reduce, via Theorem 4.1.1, to a single one-period fact applied identically at every stage — the induction step is exactly "if v∈I ⁣Mn+1v \in \mathrm{I\!M}_{n+1}v∈IMn+1​ [strictly increasing/concave/continuous with linear growth], then vvv is a utility function on EEE up to the growth bound, so Theorem 4.1.1 applies directly to TnvT_n vTn​v." Missing this reduction leads to reproving compactness/upper-semicontinuity arguments from Chapter 2 by hand at every stage instead of invoking Theorem 4.1.1 once per stage. For the six closed-form theorems, the shared trap is conflating the different one-period sub-problems: the power- and HARA-utility theorems solve the same sub-problem (4.7) after a wealth-shift transformation, while the exponential-utility theorem's sub-problem (4.13) has a fundamentally different scaling (the optimal amount, not fraction, is wealth-independent) — collapsing these into one "utility-agnostic" statement would hide exactly the distinction the book is making.

Formalization scope

The multiperiod value function V is defined as an explicit supremum over admissible Markov portfolio strategies (not the Bellman recursion itself, and not full history-dependent strategies), following the book's own citation of Theorem 2.2.3 to justify restricting to Markov strategies for this model; this keeps the goal's parts (b)/(c) genuine content rather than restatements of the value function's own definition. The one-period vocabulary (OnePeriodD/OnePeriodU/OnePeriodV, NoArbitrageOnePeriod) is a self-contained restatement matching §4.1's own notation (a single iii, RRR, no time index), independent of chunk 03's full market/portfolio apparatus, since Theorem 4.1.1's own content is exactly this one-period reduction. Proposition 4.2.1's proof cites two facts as already established elsewhere in the book (a concave function is dominated by an affine function; no-arbitrage bounds admissible actions linearly in wealth) — both are taken as explicit hypotheses of the Lean statement rather than re-derived, since re-deriving them is not this proposition's own content. HARA and power utility share one sub-problem definition (Afrac/vPower, Eq. (4.7)); logarithmic and exponential utility each need their own (AfracLog/vLog, vExp, Eqs. (4.11), (4.13)) since their admissibility sets and objective functions genuinely differ (a strict vs. non-strict inequality; a fraction vs. an absolute amount).

No trivializing formalization: each of the six closed-form theorems states its own explicit recursion for dnd_ndn​ (a finite product or sum over k=n,…,N−1k=n,\dots,N-1k=n,…,N−1 of genuinely different per-stage terms) rather than a shared abstract "some sequence dnd_ndn​ exists with Vn=dn⋅(shape)V_n = d_n \cdot (\text{shape})Vn​=dn​⋅(shape)" — the latter would hide exactly which recursion each utility function produces, the actual content the brief for this chunk flags as the point of having six near-identical theorems rather than one parametrized statement. Optimal strategies are stated in their exact feedback form (fn∗(x)=αn∗xf_n^*(x) = \alpha_n^* xfn∗​(x)=αn∗​x, or the HARA-specific affine shift, or the wealth-independent exponential-utility amount), not merely asserted to exist.

Selected references

  • N. Bäuerle and U. Rieder, Markov Decision Processes with Applications to Finance, Universitext, Springer, 2011. https://doi.org/10.1007/978-3-642-18324-9
  • R. C. Merton, "Lifetime portfolio selection under uncertainty: the continuous-time case", Review of Economics and Statistics, 1969 (the continuous-time analogue this discrete-time theory approximates, per Chapter 3's binomial-to-Black-Scholes convergence result).
15 thms2 active usersReviewed
Dynamic ProgrammingOperations ResearchOptimization+1·Captain: Shuze Chen

Markov Decision Processes VII: Consumption-Investment Problems and Regime SwitchingTextbook

Motivation

Real investors do not merely accumulate wealth for a single terminal payoff; they consume along the way, and the market they invest in is rarely a single fixed statistical regime for years at a time — bull and bear markets, business cycles, and volatility regimes shift the distribution of returns. Bäuerle and Rieder's §4.3 extends the terminal-wealth theory of chunk 04a by adding a consumption choice at every stage (the Ramsey/Merton consumption-investment problem), and §4.4 extends it again by letting the return distribution itself depend on a hidden, Markov-modulated environment state. Both extensions are shown to be genuine instances of the same abstract finite-horizon Markov Decision Process machinery from Chapter 2 — the joint consumption-investment choice and the extra regime coordinate change the state and action spaces, but not the proof strategy, which is exactly the point.

Setting

The consumption-investment problem: state E:=dom UpE := \mathrm{dom}\,U_pE:=domUp​ (wealth), action R≥0×Rd\mathbb{R}_{\ge0}\times\mathbb{R}^dR≥0​×Rd (consumption ccc, amounts aaa invested), transition Tn(x,c,a,z)=(1+in+1)(x−c+a⋅z)T_n(x,c,a,z) = (1+i_{n+1})(x-c+a\cdot z)Tn​(x,c,a,z)=(1+in+1​)(x−c+a⋅z), reward rn(x,c,a):=Uc(c)r_n(x,c,a) := U_c(c)rn​(x,c,a):=Uc​(c), terminal reward gN:=Upg_N := U_pgN​:=Up​. Value functions Vn(x):=sup⁡πEn,xπ[∑k=nN−1Uc(ck(Xk))+Up(XN)]V_n(x) := \sup_\pi \mathbb{E}^\pi_{n,x}[\sum_{k=n}^{N-1} U_c(c_k(X_k)) + U_p(X_N)]Vn​(x):=supπ​En,xπ​[∑k=nN−1​Uc​(ck​(Xk​))+Up​(XN​)]. The one-period sub-problem: D(x):={(c,a):0≤c≤x, (1+i)(x−c+a⋅R)∈dom Up a.s.}D(x) := \{(c,a) : 0\le c\le x,\ (1+i)(x-c+a\cdot R)\in\mathrm{dom}\,U_p \text{ a.s.}\}D(x):={(c,a):0≤c≤x, (1+i)(x−c+a⋅R)∈domUp​ a.s.}, u(x,c,a):=Uc(c)+E[Up((1+i)(x−c+a⋅R))]u(x,c,a) := U_c(c) + \mathbb{E}[U_p((1+i)(x-c+a\cdot R))]u(x,c,a):=Uc​(c)+E[Up​((1+i)(x−c+a⋅R))], v(x):=sup⁡(c,a)∈D(x)u(x,c,a)v(x) := \sup_{(c,a)\in D(x)} u(x,c,a)v(x):=sup(c,a)∈D(x)​u(x,c,a).

The regime-switching extension (§4.4): an environment process (Yn)(Y_n)(Yn​), a finite-state Markov chain with transition probabilities pjkp_{jk}pjk​, modulates the risky-asset return law: given Yn=jY_n=jYn​=j, the next relative risk Rn+1R_{n+1}Rn+1​ has law QjQ_jQj​, and (Rn+1,Yn+1)(R_{n+1},Y_{n+1})(Rn+1​,Yn+1​) has joint law Qj(dz)pjkQ_j(dz)p_{jk}Qj​(dz)pjk​ given Yn=jY_n=jYn​=j, Yn+1=kY_{n+1}=kYn+1​=k. The augmented state is (x,j)∈[0,∞)×EY(x,j) \in [0,\infty)\times E_Y(x,j)∈[0,∞)×EY​; value functions Jn(x,j)J_n(x,j)Jn​(x,j) are defined analogously, with the recursion incorporating a finite sum over the next regime.

Formalization targets

Goal — Theorem 4.3.3

VN=Up,Vn(x)=sup⁡(c,a)∈Dn(x)[Uc(c)+E Vn+1((1+in+1)(x−c+a⋅Rn+1))],V_N = U_p, \qquad V_n(x) = \sup_{(c,a)\in D_n(x)} \bigl[U_c(c) + \mathbb{E}\,V_{n+1}\bigl((1+ i_{n+1})(x-c+a\cdot R_{n+1})\bigr)\bigr],VN​=Up​,Vn​(x)=(c,a)∈Dn​(x)sup​[Uc​(c)+EVn+1​((1+in+1​)(x−c+a⋅Rn+1​))],

with VnV_nVn​ strictly increasing, strictly concave, continuous, and an optimal strategy realized by per-stage maximizers. This is chunk 04a's Theorem 4.2.2 with consumption added, and every closed-form corollary below specializes it.

Eight milestones: the one-period existence/regularity theorem (Theorem 4.3.1); the zero-mean special case (Theorem 4.3.5); power- and logarithmic-utility closed forms (Theorems 4.3.6, 4.3.7); the regime-switching generalization of the goal itself (Theorem 4.4.1), its power-utility closed form (Theorem 4.4.2), and two comparative-statics results on how the optimal policy moves across regimes under a stochastic order (Theorems 4.4.4, 4.4.5).

Significance

Theorem 4.3.3's consumption-investment structure theorem is the basis for every result about optimal spending and saving under uncertainty; its power/log closed forms (Theorems 4.3.6/4.3.7) recover the classical facts that a power-utility investor consumes and invests constant fractions of current wealth (myopic, wealth-independent policy fractions) while a log-utility investor's optimal consumption fraction, 1/(N−n+1)1/(N-n+1)1/(N−n+1), is the textbook "consume your remaining horizon's worth" rule. The regime-switching extension (§4.4) is the discrete-time analogue of Hamilton's regime-switching models, now standard in empirical finance; Theorems 4.4.4-4.4.5 give a rigorous comparative-statics answer to "does a riskier regime call for more or less stock exposure," using the increasing-concave stochastic order rather than a first- moment heuristic — the mathematically correct notion of "regime kkk's returns dominate regime jjj's for every risk-averse (concave, monotone) preference," not merely "regime kkk has a higher mean."

No result of this chunk was found on the platform (searched "consumption investment", "regime switching", "stochastic order"). The proofs largely mirror chunk 04a's (the book itself says so explicitly for Theorems 4.3.1, 4.3.7, 4.4.2), so this mission's contribution is the precise joint-choice statement of each result and, for the comparative-statics theorems, the correct increasing-concave order (≤_icv, Definition B.3.9c) rather than the plain concave order (≤_cv) chunk 02c already needed for a different theorem — the two are genuinely different relations and must not be conflated.

Difficulty

The naive approach to the goal decouples the consumption and investment choices into two independent optimizations; the book's own proof shows they do separate at the level of the per-stage optimization (Theorem 4.3.6's proof: the transformed problem factors into a consumption fraction ζ\zetaζ and an investment fraction α\alphaα optimized independently once the wealth scale is normalized out), but the admissible sets remain jointly constrained (0≤c≤x0\le c\le x0≤c≤x interacts with the investable amount x−cx-cx−c), so treating them as literally independent unconstrained problems would silently solve an easier, different problem. For the regime-switching comparative statics (Theorem 4.4.5), the natural first attempt tries to prove monotonicity of dn(j)d_n(j)dn​(j) in jjj directly from Qj≤icvQkQ_j\le_{\mathrm{icv}}Q_kQj​≤icv​Qk​ alone; the book's own induction needs both hypotheses simultaneously (the environment chain's own stochastic monotonicity, governing how the regime itself evolves, and the return-distribution order, governing the one-period objective) — Theorem 4.4.4's monotonicity of α∗(j)\alpha^*(j)α∗(j) handles the second factor of the induction's product (Eq. (4.22)) while the chain's stochastic monotonicity handles the first; dropping either hypothesis breaks the induction step.

Formalization scope

The consumption-investment vocabulary (ConsumptionInvestmentMarket, its value function, the one-period sub-problem) mirrors chunk 04a's pure-investment TerminalWealthMarket pattern exactly, extended to a joint (c,a)(c,a)(c,a) action. The regime-switching model (RegimeSwitchingMarket) represents the finite regime set EYE_YEY​ abstractly (a Fintype with a row-stochastic transition matrix p : EY → EY → ℝ, not a PMF/product-measure construction on the joint disturbance): the book's own formula for JnπJ_n^\piJnπ​ is already a finite sum over the next regime of an integral against QjQ_jQj​, so this is the direct, faithful representation and needs no additional measure-theoretic machinery — Jpi/J are built via an accumulator recursing through this finite-sum-of-integrals at each step (the natural generalization of chunk 04a's EFromToAcc pattern to a kernel that depends on an evolving state coordinate, rather than an exogenous process). Theorem 4.4.4/4.4.5 introduce LEIncreasingConcaveOrder (Definition B.3.9c) fresh, since chunk 02c's stochastic-order triple (≤_st/≤_cv/≤_cx) does not include the increasing-concave order this chunk's theorems actually use — reusing one of those three would silently substitute a different hypothesis, exactly the trap the chunk brief warns against. IsStochasticallyMonotoneChain (Definition B.3.13) is likewise restated fresh for a finite chain given by its transition matrix.

No trivializing formalization: D_n(x) is a genuine joint constraint on (c,a) (not two independent unconstrained choices); the six closed-form theorems (4.3.6, 4.3.7, 4.4.2, plus the comparative-statics pair) each state their own explicit recursion for dnd_ndn​ — matching the brief's own note that the index-base convention is not uniform across them (Theorem 4.3.6 gives dNd_NdN​ and recurses backward; Theorem 4.4.2 gives d0(j)d_0(j)d0​(j) and recurses forward) — encoded exactly as each theorem states it, not standardized to one direction.

Selected references

  • N. Bäuerle and U. Rieder, Markov Decision Processes with Applications to Finance, Universitext, Springer, 2011. https://doi.org/10.1007/978-3-642-18324-9
  • J. D. Hamilton, "A new approach to the economic analysis of nonstationary time series and the business cycle", Econometrica, 1989 (the regime-switching framework §4.4 specializes to a portfolio-choice setting).
16 thms2 active usersReviewed
Convex OptimizationDiscrete GeometryOperations Research+1·Captain: Shuze Chen

Discrete Convex Analysis XVII: Fenchel Duality and Linear-Programming IntegralityTextbook

Motivation

Duality is the organizing principle of convex optimization: a minimization problem's optimal value equals a maximization problem's optimal value, and this coincidence, rather than being a lucky accident, follows from a separating-hyperplane argument that applies whenever the two problems' feasible regions are shaped compatibly enough. Werner Fenchel formalized this in the 1950s for pairs of convex and concave functions related by the Legendre-Fenchel transform, and the resulting Fenchel duality theorem specializes, for linear objectives over polyhedral feasible regions, to linear programming duality — the fact, central to the entire theory of combinatorial optimization, that a linear program's optimal value can always be certified from above and below by a pair of primal and dual feasible solutions. Murota's Discrete Convex Analysis (SIAM, 2003) collects this classical machinery, together with the integrality theory that lets it produce combinatorial (integer-valued) certificates rather than merely real ones, as the technical foundation the rest of the book builds its discrete theory on top of.

Setting

For f:Rn→R∪{+∞}f : \mathbb R^n \to \mathbb R \cup \{+\infty\}f:Rn→R∪{+∞}, the epigraph is epi⁡f={(x,Y):Y≥f(x)}\operatorname{epi} f = \{(x,Y) : Y \ge f(x)\}epif={(x,Y):Y≥f(x)}, and fff is convex iff epi⁡f\operatorname{epi} fepif is a convex set; fff is proper if additionally its effective domain dom⁡f={x:f(x)<+∞}\operatorname{dom} f = \{x : f(x) < +\infty\}domf={x:f(x)<+∞} is nonempty, and closed if epi⁡f\operatorname{epi} fepif is topologically closed. A function h:Rn→R∪{−∞}h : \mathbb R^n \to \mathbb R \cup \{-\infty\}h:Rn→R∪{−∞} is concave, proper, closed analogously via its hypograph. The convex conjugate is f∙(p)=sup⁡x{⟨p,x⟩−f(x)}f^\bullet(p) = \sup_x\{\langle p,x\rangle - f(x)\}f∙(p)=supx​{⟨p,x⟩−f(x)}, and the concave conjugate h∘(p)=inf⁡x{⟨p,x⟩−h(x)}h^\circ(p) = \inf_x\{\langle p,x\rangle - h(x)\}h∘(p)=infx​{⟨p,x⟩−h(x)}. The relative interior ri⁡S\operatorname{ri} SriS of a set SSS is the interior of SSS relative to its affine hull. A function is polyhedral if its epigraph (or hypograph) is a finite intersection of half-spaces. Given an m×nm \times nm×n matrix AAA, b∈Rmb \in \mathbb R^mb∈Rm, c∈Rnc \in \mathbb R^nc∈Rn, the primal and dual linear programs are min⁡{c⊤x:Ax=b, x≥0}\min\{c^\top x : Ax=b,\ x\ge0\}min{c⊤x:Ax=b, x≥0} and max⁡{b⊤y:A⊤y≤c}\max\{b^\top y : A^\top y \le c\}max{b⊤y:A⊤y≤c}, with feasible regions PPP, DDD. A matrix is totally unimodular if every square submatrix has determinant 000, 111, or −1-1−1. A discrete set S⊆ZnS \subseteq \mathbb Z^nS⊆Zn is hole free if S=Sˉ∩ZnS = \bar S \cap \mathbb Z^nS=Sˉ∩Zn, where Sˉ\bar SSˉ is the convex hull of SSS's real embedding; the discrete Minkowski sum is S1+S2={x1+x2:x1∈S1,x2∈S2}S_1+S_2 = \{x_1+x_2 : x_1\in S_1, x_2\in S_2\}S1​+S2​={x1​+x2​:x1​∈S1​,x2​∈S2​}.

Formalization targets

Goal (Theorem 3.6, Fenchel duality). For proper convex fff and proper concave hhh satisfying at least one of four alternative conditions — a relative-interior condition on dom⁡f∩dom⁡h\operatorname{dom} f \cap \operatorname{dom} hdomf∩domh, a polyhedrality condition on the same, or the analogous pair of conditions on dom⁡f∙∩dom⁡h∘\operatorname{dom} f^\bullet \cap \operatorname{dom} h^\circdomf∙∩domh∘ together with closedness of fff, hhh —

inf⁡x{f(x)−h(x)}=sup⁡p{h∘(p)−f∙(p)},\inf_x\{f(x)-h(x)\} = \sup_p\{h^\circ(p)-f^\bullet(p)\},xinf​{f(x)−h(x)}=psup​{h∘(p)−f∙(p)},

with the extremum on the appropriate side attained whenever the common value is finite. This is the mission's capstone: the four alternative hypotheses make it the most broadly applicable statement of the four convex-duality results in this mission, each of the other three being either a special case in substance (Theorem 3.5, separation, which 3.6 is proved from) or a literal specialization to linear data (Theorem 3.10, LP duality).

Supporting milestones. Theorem 3.2 (biconjugation: f∙f^\bulletf∙ is always closed proper convex, and g∙∙=gg^{\bullet\bullet}=gg∙∙=g for closed proper convex ggg); Theorem 3.5 (the separation theorem for convex/concave functions, under two of Theorem 3.6's four hypotheses); Theorem 3.9 (the Farkas lemma, equality form); Theorem 3.10 (LP duality: weak duality, strong duality with attainment, and complementary slackness); Theorem 3.13 (total unimodularity of the constraint matrix guarantees an integral optimal solution whenever an optimal solution exists); Proposition 3.14 (an explicit potential function certifying a minimum-weight bipartite perfect matching, via the totally unimodular incidence-matrix LP); and Proposition 3.16 (for a translation-invariant family of hole-free discrete sets, the property that discrete disjointness implies closure disjointness is equivalent to the discrete Minkowski sum matching the integer points of the closures' Minkowski sum).

Significance

Fenchel duality is the single result from which the separation theorem, LP duality, and (via the totally-unimodular incidence matrix of a bipartite graph) the combinatorial duality underlying weighted bipartite matching all descend, in one unbroken chain of specialization; formalizing this chain in one mission exhibits that structure directly, rather than treating each result as an independent fact. Proposition 3.16 plays a different role: it is the chapter's warning that naive discrete analogues of convexity (hole-freeness) do not automatically inherit convexity's good closure properties under Minkowski sums, which is exactly the gap the book's later M-convexity and L-convexity machinery is built to close — this mission's Proposition 3.16 is therefore the motivating negative result for the rest of the book's positive theory, not a loose end. So far as a platform search shows, no existing formalization matches this chunk's specific combination of extended-valued (possibly ±∞\pm\infty±∞) functions, the four-alternative Fenchel duality hypothesis, or the bipartite-matching-via-total-unimodularity argument; the one related platform result (VectorSpaceOpt.fenchel_duality, from Luenberger) is for real-valued functions on general normed spaces under a single relative-interior-and-solidness hypothesis, a different generality from the extended-valued, four-hypothesis statement here.

Difficulty

The naive approach to Theorem 3.6 tries to prove the duality gap is zero directly from the definitions of the two conjugates, which only gives the easy inequality inf⁡≥sup⁡\inf \ge \supinf≥sup (a one-line computation, shown in the book's own proof in three lines); the substantive content is the reverse inequality, and it genuinely fails without a constraint-qualification hypothesis like (a1)-(b2) — Example 3.8 in the book exhibits a convex/concave pair with inf⁡=0≠−1=sup⁡\inf = 0 \ne -1 = \supinf=0=−1=sup when none of the four conditions hold. The book's actual route reduces Theorem 3.6 to the separation theorem (Theorem 3.5) applied to fff shifted down by the (assumed finite) infimum, which produces the separating affine function directly; this is why Theorem 3.5, although logically a special case in spirit, earns its own milestone rather than being subsumed silently.

Formalization scope

All convex and concave functions are represented uniformly as (V → ℝ) → EReal-valued (Fintype V), rather than mixing WithTop ℝ for convex and WithBot ℝ for concave functions, so that Theorem 3.2's biconjugate — whose properness is a conclusion, not an assumption — has a well-defined codomain without extra casts. Convexity is defined via the epigraph being a convex subset of the ordinary real vector space (V→R)×R(V\to\mathbb R)\times\mathbb R(V→R)×R (Mathlib's Convex ℝ), following the book's own equivalent characterization, rather than unfolding the direct inequality definition, which would require a extended-arithmetic scalar-multiplication convention (0\cdot(+\infty)=0) that Mathlib does not provide for EReal. The relative interior is defined directly from the book's own metric-ball-intersected-with-affine-hull description, since Mathlib has no relative-interior primitive at the pinned revision. Polyhedra are finite intersections of explicit half-spaces. A bipartite perfect matching is represented as a bijection between the two vertex sides restricted to the edge set — a faithful, not narrower, representation since every perfect matching between equal-size parts arises this way. The formalization does not trivialize: Theorem 3.6's four hypotheses are carried in full (not reduced to the easiest single case), and no result is stated only for finite-valued (never ±∞\pm\infty±∞) functions, which would discard the entire point of the extended-value convex-analysis framework this chapter sets up for the rest of the book. Infrastructure needed beyond Mathlib's Convex, Matrix, and EReal API: all epigraph/hypograph, conjugate, relative-interior, and polyhedral apparatus is defined fresh in DiscreteConvex.IntegralConvexityB; a contribution proving any of the seven milestones independently, or supplying Mathlib-quality relative-interior lemmas, would be a natural entry point.

Selected references

  • K. Murota, Discrete Convex Analysis, SIAM, 2003, DOI 10.1137/1.9780898718508, Chapter 3.
  • R. T. Rockafellar, Convex Analysis, Princeton University Press, 1970.
  • A. Schrijver, Theory of Linear and Integer Programming, Wiley, 1986.
37 thms2 active usersReviewed
Control TheoryDynamical SystemsOperations Research+2·Captain: mikedeng1

Stabilization of Hybrid Systems by Feedback Control Based on Discrete-Time State Observations II: Mean-Square and Almost Sure Exponential StabilityResearch Paper

Motivation

Many engineered systems switch between a finite number of operating modes at random times: a power grid after a line failure, a networked controller whose links drop, a manufacturing plant whose machines break down and are repaired. A standard model for such systems is a hybrid stochastic differential equation, also called an SDE with Markovian switching: the state follows an Itô equation whose coefficients depend on a mode that evolves as a continuous-time Markov chain. The monograph of Mao and Yuan (Stochastic Differential Equations with Markovian Switching, 2006) develops the stability theory of these equations.

A controller that stabilizes such a system usually needs the current state. In practice the state is sampled: it is observed at times 0,τ,2τ,…0,\tau,2\tau,\dots0,τ,2τ,… and the control is held between observations. Mao (Automatica 49, 2013) showed that, under a global Lipschitz condition on the drift and diffusion, a feedback control based on discrete-time observations makes a hybrid SDE mean-square exponentially stable when τ\tauτ is small enough. You, Liu, Lu, Mao and Qiu (SIAM J. Control Optim. 53(2), 2015) replaced that condition by local Lipschitz continuity plus linear growth, gave an explicit bound (3.5) on the admissible observation interval, and proved H∞H_\inftyH∞​-stability, asymptotic stability, and, in Section 4, exponential stability in mean square and almost surely with an explicit rate. This mission formalizes that exponential stability result, Theorem 4.2, and the steps of its proof.

Setting

Let (Ω,F,{Ft}t≥0,P)(\Omega,\mathcal F,\{\mathcal F_t\}_{t\ge0},\mathbb P)(Ω,F,{Ft​}t≥0​,P) be a probability space with a filtration satisfying the usual conditions (increasing, right-continuous, F0\mathcal F_0F0​ contains the null sets). On it live an mmm-dimensional {Ft}\{\mathcal F_t\}{Ft​}-Brownian motion www and a right-continuous {Ft}\{\mathcal F_t\}{Ft​}-Markov chain rrr on S={1,…,N}S=\{1,\dots,N\}S={1,…,N} with generator Γ=(γij)\Gamma=(\gamma_{ij})Γ=(γij​) (γij≥0\gamma_{ij}\ge0γij​≥0 for i≠ji\ne ji=j, zero row sums), independent of www. Fix τ>0\tau>0τ>0 and the sampling time δt=[t/τ]τ\delta_t=[t/\tau]\tauδt​=[t/τ]τ. The controlled system is

dx(t)=(f(x(t),r(t),t)+u(x(δt),r(t),t))dt+g(x(t),r(t),t) dw(t),x(0)=x0, r(0)=r0,(2.1)dx(t)=\big(f(x(t),r(t),t)+u(x(\delta_t),r(t),t)\big)dt+g(x(t),r(t),t)\,dw(t),\qquad x(0)=x_0,\ r(0)=r_0,\tag{2.1}dx(t)=(f(x(t),r(t),t)+u(x(δt​),r(t),t))dt+g(x(t),r(t),t)dw(t),x(0)=x0​, r(0)=r0​,(2.1)

with f,u:Rn×S×R+→Rnf,u:\mathbb R^n\times S\times\mathbb R_+\to\mathbb R^nf,u:Rn×S×R+​→Rn and g:Rn×S×R+→Rn×mg:\mathbb R^n\times S\times\mathbb R_+\to\mathbb R^{n\times m}g:Rn×S×R+​→Rn×m.

The hypotheses are:

  • Assumption 2.1: f,gf,gf,g locally Lipschitz in xxx, and ∣f(x,i,t)∣≤K1∣x∣|f(x,i,t)|\le K_1|x|∣f(x,i,t)∣≤K1​∣x∣, ∣g(x,i,t)∣≤K2∣x∣|g(x,i,t)|\le K_2|x|∣g(x,i,t)∣≤K2​∣x∣ (∣g∣|g|∣g∣ the trace norm).
  • Assumption 2.2: ∣u(x,i,t)−u(y,i,t)∣≤K3∣x−y∣|u(x,i,t)-u(y,i,t)|\le K_3|x-y|∣u(x,i,t)−u(y,i,t)∣≤K3​∣x−y∣ and u(0,i,t)=0u(0,i,t)=0u(0,i,t)=0.
  • Assumption 3.1: there are U∈C2,1(Rn×S×R+;R+)U\in C^{2,1}(\mathbb R^n\times S\times\mathbb R_+;\mathbb R_+)U∈C2,1(Rn×S×R+​;R+​) and λ1,λ2>0\lambda_1,\lambda_2>0λ1​,λ2​>0 with LU(x,i,t)+λ1∣Ux(x,i,t)∣2≤−λ2∣x∣2\mathcal LU(x,i,t)+\lambda_1|U_x(x,i,t)|^2\le-\lambda_2|x|^2LU(x,i,t)+λ1​∣Ux​(x,i,t)∣2≤−λ2​∣x∣2, where
LU=Ut+Ux[f+u]+12trace⁡[gTUxxg]+∑jγijU(x,j,t).\mathcal LU=U_t+U_x[f+u]+\tfrac12\operatorname{trace}[g^TU_{xx}g]+\sum_j\gamma_{ij}U(x,j,t).LU=Ut​+Ux​[f+u]+21​trace[gTUxx​g]+j∑​γij​U(x,j,t).
  • Assumption 4.1: c1∣x∣2≤U(x,i,t)≤c2∣x∣2c_1|x|^2\le U(x,i,t)\le c_2|x|^2c1​∣x∣2≤U(x,i,t)≤c2​∣x∣2 with c1,c2>0c_1,c_2>0c1​,c2​>0.
  • Condition (3.5): λ2>τK32λ1[2τ(K12+2K32)+K22]\lambda_2>\frac{\tau K_3^2}{\lambda_1}\big[2\tau(K_1^2+2K_3^2)+K_2^2\big]λ2​>λ1​τK32​​[2τ(K12​+2K32​)+K22​] and τ≤14K3\tau\le\frac1{4K_3}τ≤4K3​1​.

Put θ=K32/λ1\theta=K_3^2/\lambda_1θ=K32​/λ1​, λ=λ2−θτ[2τ(K12+2K32)+K22]\lambda=\lambda_2-\theta\tau[2\tau(K_1^2+2K_3^2)+K_2^2]λ=λ2​−θτ[2τ(K12​+2K32​)+K22​] (positive by (3.5)), and

H1=θτ(2τ(K12+2K32)+K22)+24θτ4K341−6τ2K32,H2=12θτ2K32(τK12+K22)1−6τ2K32.H_1=\theta\tau\big(2\tau(K_1^2+2K_3^2)+K_2^2\big)+\frac{24\theta\tau^4K_3^4}{1-6\tau^2K_3^2},\qquad H_2=\frac{12\theta\tau^2K_3^2(\tau K_1^2+K_2^2)}{1-6\tau^2K_3^2}.H1​=θτ(2τ(K12​+2K32​)+K22​)+1−6τ2K32​24θτ4K34​​,H2​=1−6τ2K32​12θτ2K32​(τK12​+K22​)​.

In Lean these are Assumption21, Assumption22, C21, LU, Assumption31, Assumption41, Condition35, theta, lam, H1, H2, rateEquationLHS; the basis is HybridSetup, the Itô integral IsItoIntegral, the sampling time delta, solutions SolvesSampledHybridSDE, and the functional (4.7) Vbar, all in the namespace You2015.Expo.

Formalization targets

Goal: Theorem 4.2 (exponential stability)

Under the hypotheses above, the equation

2τγe2τγ(H1+τH2)+γc2=λ(4.4)2\tau\gamma e^{2\tau\gamma}(H_1+\tau H_2)+\gamma c_2=\lambda\tag{4.4}2τγe2τγ(H1​+τH2​)+γc2​=λ(4.4)

has a unique root γ>0\gamma>0γ>0, and every solution of (2.1) satisfies

lim sup⁡t→∞1tlog⁡(E∣x(t)∣2)≤−γ,lim sup⁡t→∞1tlog⁡∣x(t)∣≤−γ2a.s.\limsup_{t\to\infty}\frac1t\log\big(\mathbb E|x(t)|^2\big)\le-\gamma,\qquad\limsup_{t\to\infty}\frac1t\log|x(t)|\le-\frac\gamma2\quad\text{a.s.}t→∞limsup​t1​log(E∣x(t)∣2)≤−γ,t→∞limsup​t1​log∣x(t)∣≤−2γ​a.s.

for all x0∈Rnx_0\in\mathbb R^nx0​∈Rn, r0∈Sr_0\in Sr0​∈S.

Milestones, in the order the proof uses them

  1. (3.15) E∣x(t)−x(δt)∣2≤2E∫δtt[τ∣f+u(x(δs),⋅)∣2+∣g∣2]ds\mathbb E|x(t)-x(\delta_t)|^2\le2\mathbb E\int_{\delta_t}^t[\tau|f+u(x(\delta_s),\cdot)|^2+|g|^2]dsE∣x(t)−x(δt​)∣2≤2E∫δt​t​[τ∣f+u(x(δs​),⋅)∣2+∣g∣2]ds.
  2. Theorem 3.2 (H∞H_\inftyH∞​-stability): ∫0∞E∣x(s)∣2ds<∞\int_0^\infty\mathbb E|x(s)|^2ds<\infty∫0∞​E∣x(s)∣2ds<∞.
  3. (3.21) E∣x(s)−x(δs)∣2≤3(τK12+K22)1−6τ2K32∫δssE∣x(z)∣2dz+6τ2K321−6τ2K32E∣x(s)∣2\mathbb E|x(s)-x(\delta_s)|^2\le\frac{3(\tau K_1^2+K_2^2)}{1-6\tau^2K_3^2}\int_{\delta_s}^s\mathbb E|x(z)|^2dz+\frac{6\tau^2K_3^2}{1-6\tau^2K_3^2}\mathbb E|x(s)|^2E∣x(s)−x(δs​)∣2≤1−6τ2K32​3(τK12​+K22​)​∫δs​s​E∣x(z)∣2dz+1−6τ2K32​6τ2K32​​E∣x(s)∣2.
  4. (4.11) EVˉ(x^z,r^z,z)≤(H1+τH2)∫z−2τzE∣x(y)∣2dy\mathbb E\bar V(\hat x_z,\hat r_z,z)\le(H_1+\tau H_2)\int_{z-2\tau}^z\mathbb E|x(y)|^2dyEVˉ(x^z​,r^z​,z)≤(H1​+τH2​)∫z−2τz​E∣x(y)∣2dy for z≥2τz\ge2\tauz≥2τ.
  5. (4.14) c1eγtE∣x(t)∣2≤Cc_1e^{\gamma t}\mathbb E|x(t)|^2\le Cc1​eγtE∣x(t)∣2≤C for t≥2τt\ge2\taut≥2τ.
  6. (4.14) ⇒\Rightarrow⇒ (4.3), the mean-square-to-almost-sure transfer cited from Mao–Yuan [23, Theorem 8.8].

Significance

The result. Theorem 4.2 gives a quantitative guarantee: a controller that samples the state every τ\tauτ units makes the switching system decay exponentially, with a rate γ\gammaγ computable from the constants of the assumptions. Asymptotic stability (Section 3 of the paper) says nothing about how fast trajectories settle; the rate is what a designer trades against the sampling cost when choosing τ\tauτ. The almost sure statement concerns individual trajectories, which is what an operator observes.

Formalizing it. The results are proved in the paper; none of them is machine-checked. Mathlib has real Brownian motion but no Itô integral, no stochastic differential equations and no continuous-time Markov chains. The mission therefore also produces a definition layer: a filtration under the usual conditions, a multidimensional {Ft}\{\mathcal F_t\}{Ft​}-Brownian motion, an {Ft}\{\mathcal F_t\}{Ft​}-Markov chain with a given generator, the L2L^2L2 Itô integral of vector-valued integrands, and the solution notion of an SDE with Markovian switching and a sampled-state delay. A related but different layer exists on Prove2Me for Ethier–Kurtz (EthierKurtz_IsStandardBrownian, EthierKurtz_HasBrownianItoIntegral, EthierKurtz_SolvesBrownianSDE); it has no mode switching and no sampled state, so it cannot express (2.1). Formalization also checks the constants: it found that the printed H1H_1H1​ in (4.5) disagrees with the paper's own derivation (see below).

Difficulty

Equation (2.1) is a stochastic differential delay equation whose delay t−δtt-\delta_tt−δt​ is bounded but jumps at every observation time, so the delay-equation stability theorems that require a differentiable delay with derivative below one (Mao–Yuan, p. 285) do not apply. A Lyapunov function of the current state alone leaves the term Ux[u(x(t))−u(x(δt))]U_x[u(x(t))-u(x(\delta_t))]Ux​[u(x(t))−u(x(δt​))], which has no sign and depends on the path over a whole observation interval. An exponential rate requires controlling this delay term with an exponential weight, and the weight inflates the delay contribution by a factor e2τγe^{2\tau\gamma}e2τγ; the rate equation (4.4) records exactly this balance. The almost sure part does not follow from the mean-square part by Chebyshev's inequality at fixed times alone: a pathwise bound needs control of the supremum of ∣x∣|x|∣x∣ over each unit interval, which involves the martingale part of the solution.

Formalization scope

Conventions committed to in Lean:

  • The state space is EuclideanSpace ℝ (Fin n), so ∣x∣|x|∣x∣ is the Euclidean norm; the explicit constants in (3.5), (3.21), (4.5) depend on it. The diffusion ggg is given by its mmm columns and ∣g∣2=∑k∣gk∣2|g|^2=\sum_k|g_k|^2∣g∣2=∑k​∣gk​∣2 (trace norm). Modes are Fin N (0-based). Time is ℝ≥0; time integrals are over subsets of R\mathbb RR at s.toNNReal.
  • Every expectation of a nonnegative quantity (E∣x∣2\mathbb E|x|^2E∣x∣2, EVˉ\mathbb E\bar VEVˉ) and every time integral of one is a lower Lebesgue integral in [0,∞][0,\infty][0,∞], so a non-integrable process cannot produce a junk value 000.
  • Logarithms. The paper's log⁡\loglog takes the value −∞-\infty−∞ at 000. For a finite a(t)≥0a(t)\ge0a(t)≥0, lim sup⁡t→∞1tlog⁡a(t)≤−γ\limsup_{t\to\infty}\frac1t\log a(t)\le-\gammalimsupt→∞​t1​loga(t)≤−γ is stated in the equivalent form "for every γ′<γ\gamma'<\gammaγ′<γ, eventually a(t)≤e−γ′ta(t)\le e^{-\gamma't}a(t)≤e−γ′t". Lean's Real.log 0 = 0 never enters. In (4.3) the almost-sure quantifier is outside the quantifier over γ′\gamma'γ′.
  • Correction of (4.5). The page prints the last term of H1H_1H1​ as 24τ3K34/(1−6τ2K32)24\tau^3K_3^4/(1-6\tau^2K_3^2)24τ3K34​/(1−6τ2K32​). Substituting (3.21) into (4.9), as the proof does, gives 24θτ4K34/(1−6τ2K32)24\theta\tau^4K_3^4/(1-6\tau^2K_3^2)24θτ4K34​/(1−6τ2K32​) (the same computation reproduces the printed H2H_2H2​). The mission uses the corrected H1H_1H1​ in the goal, (4.11) and (4.14). With the printed value the claimed rate could exceed what the proof yields whenever θτ>1\theta\tau>1θτ>1.
  • "The unique root" is a conjunct of the goal (∃! γ>0\exists!\,\gamma>0∃!γ>0); the stability conclusions are stated for every positive root. "(so λ>0\lambda>0λ>0)" is a consequence of (3.5), not a hypothesis. (4.4) is kept as an equality.
  • "The solution of (2.1)" is read as every process satisfying the solution definition: progressively measurable, almost surely continuous paths, E∣x(t)∣2<∞\mathbb E|x(t)|^2<\inftyE∣x(t)∣2<∞ for each ttt, and for each ttt, almost surely, the integral equation with Itô integrals in the L2L^2L2 sense. Existence and uniqueness (cited from Mao–Yuan on p. 908) are not asserted.
  • "An mmm-dimensional Brownian motion" and "a Markov chain with generator Γ\GammaΓ" are read in the Mao–Yuan framework the paper cites: an {Ft}\{\mathcal F_t\}{Ft​}-Brownian motion with independent coordinates and increments independent of the past, and an {Ft}\{\mathcal F_t\}{Ft​}-Markov chain with transition matrix etΓe^{t\Gamma}etΓ. The usual conditions are kept as hypotheses.
  • "Locally Lipschitz" is uniform in the mode and time on each ball. C2,1C^{2,1}C2,1 carries its derivatives Ut,Ux,UxxU_t,U_x,U_{xx}Ut​,Ux​,Uxx​ as witnesses tied to UUU by derivative relations and joint continuity.
  • "τ>0\tau>0τ>0 sufficiently small for (3.5)" means every τ>0\tau>0τ>0 satisfying both inequalities of (3.5). U,λ1,λ2,c1,c2,τU,\lambda_1,\lambda_2,c_1,c_2,\tauU,λ1​,λ2​,c1​,c2​,τ are data. The constant CCC of (4.14) is chosen after x0x_0x0​, r0r_0r0​, the solution and γ\gammaγ, and before ttt.
  • (3.15), (3.21) and the transfer (4.14) ⇒\Rightarrow⇒ (4.3) are stated under fewer hypotheses than the surrounding proof has (Assumptions 2.1, 2.2, τ>0\tau>0τ>0, and for (3.21) τ≤1/(4K3)\tau\le1/(4K_3)τ≤1/(4K3​)), because their derivations use no more. Vˉ\bar VVˉ of (4.7) is used only for z≥2τz\ge2\tauz≥2τ, where no extension of the solution to negative times is needed. Other misprints on the page (g(x,i,s)=f(x,i,0)g(x,i,s)=f(x,i,0)g(x,i,s)=f(x,i,0) on p. 909, V(x^0,r^0,t)V(\hat x_0,\hat r_0,t)V(x^0​,r^0​,t) for V(x^0,r^0,0)V(\hat x_0,\hat r_0,0)V(x^0​,r^0​,0) on p. 918, the swapped ∨,∧\vee,\wedge∨,∧ on p. 907) are not formalized.

A trivializing formalization is ruled out: the expectations are not Bochner integrals, log⁡0\log 0log0 is never evaluated, the goal asserts that the rate equation has exactly one positive root (so the stability clauses are not vacuous), the solution notion admits the true solution and requires path continuity, and the derivative witnesses of UUU are tied to UUU. A sorry-free local check confirms that Assumptions 2.1, 2.2, 4.1, condition (3.5) and λ>0\lambda>0λ>0 hold for n=m=N=1n=m=N=1n=m=N=1, f=g=0f=g=0f=g=0, u(x)=−xu(x)=-xu(x)=−x, U=∣x∣2U=|x|^2U=∣x∣2, K1=K2=K3=1K_1=K_2=K_3=1K1​=K2​=K3​=1, λ1=1/4\lambda_1=1/4λ1​=1/4, λ2=1\lambda_2=1λ2​=1, c1=c2=1c_1=c_2=1c1​=c2​=1, τ=1/10\tau=1/10τ=1/10; for these data LU+λ1∣Ux∣2=−∣x∣2\mathcal LU+\lambda_1|U_x|^2=-|x|^2LU+λ1​∣Ux​∣2=−∣x∣2 by hand.

Welcome contributions: the Itô isometry and Itô's formula for the L2L^2L2 integral defined here, a generalized Itô formula for functions of a Markov-modulated Itô process, the Burkholder–Davis–Gundy inequality, and the Borel–Cantelli argument that turns mean-square exponential decay into almost sure decay. These are reusable far beyond this mission. Section 3 of the paper (asymptotic stability) is a separate mission of the same series.

Selected references

  • S. You, W. Liu, J. Lu, X. Mao, Q. Qiu, Stabilization of Hybrid Systems by Feedback Control Based on Discrete-Time State Observations, SIAM J. Control Optim. 53(2), 905–925, 2015. https://doi.org/10.1137/140985779
  • X. Mao, C. Yuan, Stochastic Differential Equations with Markovian Switching, Imperial College Press, 2006. https://doi.org/10.1142/p473
  • X. Mao, Stabilization of continuous-time hybrid stochastic differential equations by discrete-time feedback control, Automatica 49(12), 3677–3681, 2013. https://doi.org/10.1016/j.automatica.2013.09.005
13 thms1 active userReviewed
CombinatoricsConvex OptimizationDiscrete Geometry+2·Captain: Shuze Chen

Discrete Convex Analysis XIX: Discrete Separation for M-Convex SetsTextbook

Motivation

Submodular set functions are the combinatorial stand-in for convexity: a function ρ:2V→R\rho : 2^V \to \mathbb Rρ:2V→R on the subsets of a finite ground set VVV is submodular if ρ(X)+ρ(Y)≥ρ(X∪Y)+ρ(X∩Y)\rho(X) + \rho(Y) \ge \rho(X \cup Y) + \rho(X \cap Y)ρ(X)+ρ(Y)≥ρ(X∪Y)+ρ(X∩Y), and this single diminishing-returns inequality drives an enormous range of combinatorial optimization — matroid rank functions, graph cut capacities, entropy, coverage functions, and the max-flow min-cut theorem all arise as special or dual cases (Edmonds 1970; Lovász 1983; Fujishige 2005). M-convex sets are the "vector" incarnation of the same idea: subsets BBB of ZV\mathbb Z^VZV satisfying an exchange axiom that generalizes the basis-exchange property of matroids to sets of integer points lying on a common hyperplane. Murota's Discrete Convex Analysis (SIAM, 2003) develops both sides of this correspondence and proves they coincide exactly: M-convex sets are precisely the integer points of the base polyhedra of integer-valued submodular functions. This mission covers the second half of that development — the structural theory (integrality, holes, Minkowski sums) that turns the correspondence into a working calculus, and its capstone, a discrete separation theorem for two disjoint M-convex sets whose separating hyperplane is forced to have {0,1}\{0,1\}{0,1}- or {0,−1}\{0,-1\}{0,−1}-valued coefficients.

Companion mission 04-mconvex-sets (Discrete Convex Analysis III) covers the same chapter's foundational results: the equivalence of the exchange-axiom variants, the one-to-one correspondence between M-convex sets and integer submodular functions (Theorem 4.15), Edmonds's intersection theorem (Theorem 4.18), and Frank's discrete separation theorem for submodular/ supermodular pairs (Theorem 4.17). This mission builds on that vocabulary (redeclared here, since draft missions in the same series cannot yet import one another) and proves the results the chapter leaves for its second half.

Setting

Fix a finite ground set VVV. A vector x∈ZVx \in \mathbb Z^Vx∈ZV assigns an integer x(v)x(v)x(v) to each v∈Vv \in Vv∈V; write x(X)=∑v∈Xx(v)x(X) = \sum_{v \in X} x(v)x(X)=∑v∈X​x(v) for X⊆VX \subseteq VX⊆V. For x,y∈ZVx, y \in \mathbb Z^Vx,y∈ZV, the positive support supp⁡+(x−y)={v:x(v)>y(v)}\operatorname{supp}^+(x-y) = \{v : x(v) > y(v)\}supp+(x−y)={v:x(v)>y(v)} and negative support supp⁡−(x−y)={v:x(v)<y(v)}\operatorname{supp}^-(x-y) = \{v : x(v) < y(v)\}supp−(x−y)={v:x(v)<y(v)} record where xxx exceeds, and falls short of, yyy. A nonempty set B⊆ZVB \subseteq \mathbb Z^VB⊆ZV is M-convex if it satisfies the exchange axiom (B-EXC[Z]): for all x,y∈Bx, y \in Bx,y∈B and u∈supp⁡+(x−y)u \in \operatorname{supp}^+(x-y)u∈supp+(x−y), some v∈supp⁡−(x−y)v \in \operatorname{supp}^-(x-y)v∈supp−(x−y) has both x−χu+χv∈Bx - \chi_u + \chi_v \in Bx−χu​+χv​∈B and y+χu−χv∈By + \chi_u - \chi_v \in By+χu​−χv​∈B, where χu\chi_uχu​ is the characteristic vector of uuu.

A set function ρ:2V→R∪{+∞}\rho : 2^V \to \mathbb R \cup \{+\infty\}ρ:2V→R∪{+∞} with ρ(∅)=0\rho(\emptyset) = 0ρ(∅)=0 and ρ(V)<+∞\rho(V) < +\inftyρ(V)<+∞ is submodular (the class S[R]S[\mathbb R]S[R], or S[Z]S[\mathbb Z]S[Z] when integer-valued) if ρ(X)+ρ(Y)≥ρ(X∪Y)+ρ(X∩Y)\rho(X) + \rho(Y) \ge \rho(X \cup Y) + \rho(X \cap Y)ρ(X)+ρ(Y)≥ρ(X∪Y)+ρ(X∩Y) for all X,YX, YX,Y. Its base polyhedron is B(ρ)={x∈RV:x(X)≤ρ(X) (∀X), x(V)=ρ(V)}B(\rho) = \{x \in \mathbb R^V : x(X) \le \rho(X)\ (\forall X),\ x(V) = \rho(V)\}B(ρ)={x∈RV:x(X)≤ρ(X) (∀X), x(V)=ρ(V)}. The Lovász extension ρ^:RV→R∪{±∞}\hat\rho : \mathbb R^V \to \mathbb R \cup \{\pm\infty\}ρ^​:RV→R∪{±∞} linearly interpolates ρ\rhoρ off {0,1}V\{0,1\}^V{0,1}V: sorting the distinct values of p∈RVp \in \mathbb R^Vp∈RV as p^1>⋯>p^m\hat p_1 > \cdots > \hat p_mp^​1​>⋯>p^​m​ and setting Ui={v:p(v)≥p^i}U_i = \{v : p(v) \ge \hat p_i\}Ui​={v:p(v)≥p^​i​}, it is ρ^(p)=∑i=1m−1(p^i−p^i+1)ρ(Ui)+p^mρ(Um)\hat\rho(p) = \sum_{i=1}^{m-1}(\hat p_i - \hat p_{i+1})\rho(U_i) + \hat p_m \rho(U_m)ρ^​(p)=∑i=1m−1​(p^​i​−p^​i+1​)ρ(Ui​)+p^​m​ρ(Um​).

Formalization targets

Goal: discrete separation for M-convex sets

B1∩B2=∅  ⟹  ∃ p∗∈{0,1}V∪{0,−1}V,inf⁡x∈B1⟨p∗,x⟩−sup⁡x∈B2⟨p∗,x⟩≥1,B_1 \cap B_2 = \emptyset \implies \exists\, p^* \in \{0,1\}^V \cup \{0,-1\}^V,\quad \inf_{x \in B_1}\langle p^*, x\rangle - \sup_{x \in B_2}\langle p^*, x\rangle \ge 1,B1​∩B2​=∅⟹∃p∗∈{0,1}V∪{0,−1}V,x∈B1​inf​⟨p∗,x⟩−x∈B2​sup​⟨p∗,x⟩≥1,

for M-convex sets B1,B2⊆ZVB_1, B_2 \subseteq \mathbb Z^VB1​,B2​⊆ZV (Theorem 4.21). This is the weakest stable form of the result — it asserts only the existence of a combinatorially special separator, not any bound tied to ∣V∣|V|∣V∣ or a particular construction, so it is not invalidated by a sharper algorithm for finding p∗p^*p∗.

Supporting structural targets

Eleven further results build the calculus this goal rests on: the hyperplane property of M-convex sets (Prop. 4.1), an equivalent one-sided exchange axiom (Prop. 4.2), nonemptiness and the support-function identity for B(ρ)B(\rho)B(ρ) (Props. 4.4-4.5), integrality of B(ρ)B(\rho)B(ρ) for integer-valued ρ\rhoρ (Prop. 4.6), the hole-free property identifying an M-convex set with the integer points of its own convex hull (Thm. 4.12), the two-way polyhedral description of M-convex sets via induced submodular functions (Props. 4.13-4.14), the equivalence of submodularity with convexity of the Lovász extension (Thm. 4.16, due to Lovász), integrality of the intersection of M-convex sets (Thm. 4.22), and Minkowski-sum identities for base polyhedra and M-convex sets (Thm. 4.23).

Significance

The discrete separation theorem is what makes M-convexity discrete rather than merely a polyhedral fact: ordinary separation of two disjoint convex sets by a hyperplane is classical, but here the separator is forced into {0,1}V∪{0,−1}V\{0,1\}^V \cup \{0,-1\}^V{0,1}V∪{0,−1}V — a purely combinatorial object — with no loss of strength. This is the mechanism behind integrality results across combinatorial optimization (e.g., that the intersection of two integral base polyhedra is integral, Theorem 4.22, used pervasively in matroid intersection and submodular flow algorithms). The structural results (holes, Minkowski sums, the Lovász-extension convexity equivalence) are the working toolkit every later use of M-convexity in the book — proximity theorems for M-convex functions (chunks 06+), the discrete conjugacy theorem, submodular flows — draws on without restating.

None of these results are open: Murota attributes the exchange-axiom theory to the matroid and submodular-function literature it systematizes, citing Edmonds, Frank, and Lovász by name for the specific theorems. What this mission produces is a machine-checked formal statement of each result exactly as the book states it, in a shared Lean vocabulary (ExchangeAxiomB, BasePolyhedron, LovaszExtension) that the rest of the Discrete Convex Analysis series builds on; no result here has a prior formalization on the platform (see Formalization scope).

Difficulty

The separation theorem is not proved by convex separation directly — the whole point is that the naive proof (apply the ordinary hyperplane separation theorem to the convex hulls of B1,B2B_1, B_2B1​,B2​, then argue the separator can be taken {0,1}\{0,1\}{0,1}-valued) does not go through, because convex separation alone gives no control over the separator's coefficients. The book instead derives it from Edmonds's intersection theorem (Theorem 4.18, chunk 04-mconvex-sets) applied to a submodular/supermodular pair built from B1,B2B_1, B_2B1​,B2​'s associated set functions (Theorem 4.15), routed through Frank's discrete separation theorem (Theorem 4.17) — a genuine two-step reduction, not a direct argument. A second, independent difficulty sits in the supporting results: the hole-free property (Theorem 4.12) requires an explicit induction reducing an arbitrary convex combination representing an integer point to a single element of BBB, a combinatorial exchange argument with no shortcut through general polyhedral theory.

Formalization scope

Ground-set elements are a Fintype V with DecidableEq; M-convex sets are Set (V → ℤ); submodular/supermodular functions are Finset V → WithTop ℝ / WithBot ℝ; base polyhedra are Set (V → ℝ). The Lovász extension is formalized directly from the book's own sorted-values construction (SortedValues, LevelSet, Eq. (4.4)-(4.6)), not via an equivalent closed form. Since WithTop ℝ carries no Module ℝ structure, convexity for Theorem 4.16 is stated via a bespoke nonnegative-scalar action (ScalarWithTop) rather than Mathlib's ConvexOn — this changes no mathematical content, only its packaging (see MODERATION_NOTES.md). No numeric constants are hard-coded anywhere in this mission (rule 7 is vacuous). The goal's hypothesis (ExchangeAxiomB plus Nonempty on each BiB_iBi​) is exactly the book's own definition of M-convexity — no weaker substitute (e.g. requiring a specific ρ\rhoρ witness in the hypothesis rather than deriving one, or dropping the {0,1}/{0,−1}\{0,1\}/\{0,-1\}{0,1}/{0,−1} constraint on p∗p^*p∗ in favor of a generic separator) would be faithful, and both trivializations are ruled out by construction. This mission's definitions (ExchangeAxiomB, BasePolyhedron, SubmodularSetFunction, LovaszExtension) are redeclared from chunk 04-mconvex-sets rather than imported, since sibling drafts in this series cannot yet reference one another; a later, published version of this book's namespace should consolidate them. Contributions completing any of the twelve sorrys are welcome; the hole-free property (Theorem 4.12) and the goal are the two with the most independent proof content.

Selected references

  • K. Murota, Discrete Convex Analysis, SIAM, 2003. DOI: 10.1137/1.9780898718508.
  • J. Edmonds, "Submodular functions, matroids, and certain polyhedra," in Combinatorial Structures and Their Applications, 1970, pp. 69-87.
  • A. Frank, "An algorithm for submodular functions on graphs," Annals of Discrete Mathematics, 16 (1982), pp. 97-120.
  • L. Lovász, "Submodular functions and convexity," in Mathematical Programming: The State of the Art, Springer, 1983, pp. 235-257.
29 thms3 active usersReviewed
Algorithmic Game TheoryConvex OptimizationOperations Research+1·Captain: mikedeng1

Existence of an Equilibrium for a Competitive Economy II: Equilibrium Exists When Every Consumer Can Supply Productive LaborResearch Paper

Motivation

A competitive equilibrium is a list of production plans, consumption plans and prices at which every firm maximizes profit, every consumer maximizes utility within the budget, and no market has excess demand. Whether such prices exist at all is the consistency question behind general equilibrium theory, the welfare theorems, and applied equilibrium models used in policy analysis. Arrow and Debreu gave the first proof of existence for a model with production, private ownership and general convex preferences (Econometrica 22, 1954), using Debreu's existence theorem for abstract economies (PNAS 38, 1952).

Their Theorem I assumes that every consumer initially holds a positive amount of every commodity (Assumption IV.a). The authors call this "clearly unrealistic" (p. 280): a household does not hold every good, and most households own little beyond their labor. Theorem II, the subject of this mission, removes that assumption. It only asks that every consumer be able to supply some type of labor that is always productive of a commodity everyone desires. This is the version of the existence theorem that allows a wage-earner economy.

Timeline. Wald (1935–36) proved existence for special production models. Nash (1950) proved existence of equilibrium points for finite games, and Debreu (1952) extended it to abstract economies, in which each player's feasible set depends on the others' choices. Arrow and Debreu (1954) proved Theorems I and II. McKenzie's independent existence proof was published the same year (Econometrica 22, 1954).

Setting

There are lll commodities, nnn producers and mmm consumers; vectors live in Rl\mathbb R^lRl and x≦yx\leqq yx≦y is componentwise. Producer jjj has a production set YjY_jYj​. Consumer iii has a consumption set XiX_iXi​, a utility uiu_iui​ on XiX_iXi​, an endowment ζi\zeta_iζi​ and profit shares αij\alpha_{ij}αij​. Write Y=∑jYjY=\sum_jY_jY=∑j​Yj​, X=∑iXiX=\sum_iX_iX=∑i​Xi​, ζ=∑iζi\zeta=\sum_i\zeta_iζ=∑i​ζi​, and let P={p≧0, ∑hph=1}P=\{p\geqq0,\ \sum_hp_h=1\}P={p≧0, ∑h​ph​=1} be the price simplex. A competitive equilibrium (x1∗,…,xm∗,y1∗,…,yn∗,p∗)(x_1^*,\dots,x_m^*,y_1^*,\dots,y_n^*,p^*)(x1∗​,…,xm∗​,y1∗​,…,yn∗​,p∗) satisfies four conditions. Each yj∗y_j^*yj∗​ maximizes p∗⋅yjp^*\cdot y_jp∗⋅yj​ on YjY_jYj​. Each xi∗x_i^*xi∗​ maximizes uiu_iui​ on {xi∈Xi:p∗⋅xi≤p∗⋅ζi+∑jαijp∗⋅yj∗}\{x_i\in X_i: p^*\cdot x_i\le p^*\cdot\zeta_i+\sum_j\alpha_{ij}p^*\cdot y_j^*\}{xi​∈Xi​:p∗⋅xi​≤p∗⋅ζi​+∑j​αij​p∗⋅yj∗​}. The price vector satisfies p∗∈Pp^*\in Pp∗∈P. Finally z∗=∑xi∗−∑yj∗−ζ≦0z^*=\sum x_i^*-\sum y_j^*-\zeta\leqq0z∗=∑xi∗​−∑yj∗​−ζ≦0 and p∗⋅z∗=0p^*\cdot z^*=0p∗⋅z∗=0.

The assumptions of Theorem II are as follows. I: production sets are closed, convex and contain 000; Y∩Ω={0}Y\cap\Omega=\{0\}Y∩Ω={0} (no output without input); Y∩(−Y)={0}Y\cap(-Y)=\{0\}Y∩(−Y)={0} (no reversible production). II: each XiX_iXi​ is closed, convex and bounded below. III: uiu_iui​ is continuous, has no satiation point, and satisfies ui(tx+(1−t)x′)>ui(x′)u_i(tx+(1-t)x')>u_i(x')ui​(tx+(1−t)x′)>ui​(x′) whenever ui(x)>ui(x′)u_i(x)>u_i(x')ui​(x)>ui​(x′) and 0<t<10<t<10<t<1. IV.b: shares are nonnegative and sum to one for each firm. Two sets of commodities are defined from the data. The set D\mathcal DD contains the commodities always desired by every consumer: from any xi∈Xix_i\in X_ixi​∈Xi​, adding some positive amount of the commodity stays in XiX_iXi​ and raises uiu_iui​. The set P\mathcal PP contains the types of productive labor: for every y∈Yy\in Yy∈Y, (a) yh≤0y_h\le0yh​≤0, and (b) some y′∈Yy'\in Yy′∈Y satisfies yh′′≥yh′y'_{h'}\ge y_{h'}yh′′​≥yh′​ for all h′≠hh'\ne hh′=h and yh′′′>yh′′y'_{h''}>y_{h''}yh′′′​>yh′′​ for some h′′∈Dh''\in\mathcal Dh′′∈D. The remaining assumptions are:

  • IV′.a: each consumer has some xi∈Xix_i\in X_ixi​∈Xi​ with xi≦ζix_i\leqq\zeta_ixi​≦ζi​ and xhi<ζhix_{hi}<\zeta_{hi}xhi​<ζhi​ for some h∈Ph\in\mathcal Ph∈P;
  • V: some x∈Xx\in Xx∈X and y∈Yy\in Yy∈Y satisfy xh<yh+ζhx_h<y_h+\zeta_hxh​<yh​+ζh​ for every hhh;
  • VI: D≠∅\mathcal D\ne\emptysetD=∅;
  • VII: P≠∅\mathcal P\ne\emptysetP=∅.

Formalization targets

Goal: Theorem II (§4.5, p. 281)

Assumptions I–III, IV′, V–VII ⟹ ∃ (x∗,y∗,p∗) satisfying Conditions 1–4.\text{Assumptions I–III, IV}',\ \text{V–VII}\ \Longrightarrow\ \exists\,(x^*,y^*,p^*)\ \text{satisfying Conditions 1–4.}Assumptions I–III, IV′, V–VII ⟹ ∃(x∗,y∗,p∗) satisfying Conditions 1–4.

Milestones (§5, pp. 282–287)

They follow the paper's proof. Let π=∣P∣\pi=|\mathcal P|π=∣P∣ and Pε={p∈P:ph≥ε ∀h∈P}P^\varepsilon=\{p\in P: p_h\ge\varepsilon\ \forall h\in\mathcal P\}Pε={p∈P:ph​≥ε ∀h∈P} for 0<ε≤1/(2π)0<\varepsilon\le1/(2\pi)0<ε≤1/(2π). Let EεE^\varepsilonEε be the abstract economy in which consumers maximize utility under budget constraints, producers maximize profit, and a market participant chooses p∈Pεp\in P^\varepsilonp∈Pε to maximize p⋅zp\cdot zp⋅z. The milestones are:

  1. §5.0 (1). On PεP^\varepsilonPε every consumer can spend strictly less than p⋅ζip\cdot\zeta_ip⋅ζi​.
  2. §5.1.1 (5). Equilibrium points of EεE^\varepsilonEε satisfy x∗−y∗≦ζ′x^*-y^*\leqq\zeta'x∗−y∗≦ζ′ for a vector ζ′\zeta'ζ′ independent of ε\varepsilonε.
  3. §5.2.0. The attainable sets relative to ζ′\zeta'ζ′ are bounded.
  4. §5.2.1. The truncated economy E~ε\tilde E^\varepsilonE~ε has an equilibrium point.
  5. §5.2.2 (3)–(5). An equilibrium point of E~ε\tilde E^\varepsilonE~ε is one of EεE^\varepsilonEε.
  6. §5.3.0 (2). If ph∗>εp^*_h>\varepsilonph∗​>ε for all h∈Ph\in\mathcal Ph∈P, the point is a competitive equilibrium.
  7. §5.3.2 (1). Limits of equilibrium points as ε→0\varepsilon\to0ε→0 are quasi-equilibria for consumers.
  8. §5.3.4 (3). If the floors bind, some desired commodity has limit price 000.
  9. §5.3.4 (6). If the floors bind, limit consumption minimizes expenditure over XiX_iXi​.
  10. §5.3.5. For some ε\varepsilonε the floor does not bind.

Significance

Theorem II is the existence theorem for a competitive economy in which consumers may own nothing but their labor. It shows that the survival assumption IV.a can be traded for conditions on labor, desirability and the possibility of an overall excess supply. Section 5.3.3 of the paper also isolates the quasi-equilibrium, in which utility maximization under the budget is replaced by cost minimization at a given utility level. That notion is used in later existence and welfare arguments.

The theorem has been proved since 1954; this mission does not reopen it. The work here is the machine-checked proof. The companion mission on Theorem I formalizes the shared model and Debreu's lemma. As of September 2026 neither theorem has a Lean formalization on the platform, and Mathlib contains no general equilibrium theory.

Difficulty

The obvious approach reuses the proof of Theorem I: build the abstract economy of consumers, producers and a price-choosing participant, and apply Debreu's lemma. That fails at the boundary of the price simplex. Without IV.a, a consumer's cheapest point in XiX_iXi​ can cost as much as the endowment at some prices, so the budget correspondence is not continuous there and the lemma does not apply. The paper therefore keeps prices of productive labor at least ε\varepsilonε and must then show that the floor does not bind for some ε\varepsilonε. That is a limit argument as ε→0\varepsilon\to0ε→0 which uses Assumptions V, VI and VII together, and each of the milestones 7–9 is a step of it. Debreu's lemma itself needs a Kakutani-type fixed point theorem for correspondences, which Mathlib does not provide.

Formalization scope

Commodity vectors are Fin l → ℝ. Consumers are indexed by Fin m and producers by Fin n. The inner product is ⬝ᵥ. The paper's x<yx<yx<y is strict in every component and is written componentwise, never as Lean's < on functions. D\mathcal DD and P\mathcal PP are computed from the economy, not supplied as parameters. Utilities are total functions, but every assumption on uiu_iui​ quantifies over XiX_iXi​ only. "Maximizes" is membership plus an inequality against every feasible alternative; no supremum is used. EEE, EεE^\varepsilonEε and E~ε\tilde E^\varepsilonE~ε are built by one constructor over the players Fin m ⊕ Fin n ⊕ Unit. The vector ζ′\zeta'ζ′ takes the lower bounds ξi\xi_iξi​ of Assumption II as an explicit argument. The milestones of §5.3 are stated for the limit of a sequence of equilibrium points, which is how the paper constructs them. Assumption V is dropped from every milestone except §5.3.5 and the goal. With V, the case assumption of §5.3.1 is contradictory and those milestones would hold vacuously.

A trivializing formalization is ruled out as follows. The assumptions are satisfiable with IV.a failing: a sorry-free check covers two goods, one consumer who owns nothing and can only supply labor, and one firm turning labor into the desired good. The goal therefore does not hold vacuously.

Needed infrastructure includes a Kakutani fixed point theorem or Debreu's lemma, compactness of truncated action sets, and sequential compactness arguments in Rl\mathbb R^lRl. AGT.brouwer_fixed_point is on the platform and can serve as a starting point. The lemma is reusable well beyond this mission. Contributions to any milestone, to the lemma, or to the boundedness results shared with Theorem I are welcome.

Selected references

  • K. J. Arrow and G. Debreu, Existence of an Equilibrium for a Competitive Economy, Econometrica 22(3), 265–290, 1954. https://doi.org/10.2307/1907353
  • G. Debreu, A Social Equilibrium Existence Theorem, Proceedings of the National Academy of Sciences 38(10), 886–893, 1952. https://doi.org/10.1073/pnas.38.10.886
  • L. W. McKenzie, On Equilibrium in Graham's Model of World Trade and Other Competitive Systems, Econometrica 22(2), 147–161, 1954. https://doi.org/10.2307/1907352
  • J. F. Nash, Equilibrium Points in n-Person Games, Proceedings of the National Academy of Sciences 36(1), 48–49, 1950. https://doi.org/10.1073/pnas.36.1.48
16 thms2 active usersReviewed
Dynamic ProgrammingOperations ResearchOptimization+1·Captain: Shuze Chen

Markov Decision Processes XV: Optimal Play in Red-and-Black and the Gittins IndexTextbook

Motivation

Chapter 7's abstract machinery — contracting Markov Decision Models, the Structure Theorem, value iteration with an explicit convergence rate — earns its keep by solving concrete problems. Section 7.6 works through four kinds of application: a return to the classical cash-balance inventory problem, now over an infinite horizon; the "red-and-black" gambling problem, where a player tries to reach a target fortune before going bankrupt; and, most substantially, the infinite-horizon two-armed bandit, where the general theory reveals something genuinely surprising — the qualitatively optimal policy can be computed one arm at a time.

Setting

Every application here specializes the general infinite-horizon, contracting-model machinery of chunks 07a/07b to a concrete transition structure. The cash-balance model orders inventory up to a level aaa at linear cost, incurs a holding/shortage cost, then absorbs a random demand. The red-and-black model bets a fraction of a bounded fortune on a biased coin, absorbing at bankruptcy or at the target. The bandit model reconsiders the Beta-Bernoulli two-armed bandit of chunk 05b, now over an infinite horizon with a genuine discount β<1\beta<1β<1: the key new tool is the K-stopping problem, a fictitious single-arm decision problem where, at every stage, the decision maker may either pull the arm or retire with a fixed payment KKK. The Gittins index I(m,n)I(m,n)I(m,n) is the smallest such payment at which retiring immediately is already as good as continuing.

Formalization targets

The goal, Theorem 7.6.10, is the Gittins index theorem for this book's two-armed bandit: always pulling the arm with the higher index is optimal for the full infinite-horizon problem. The milestones build the machinery it needs — the index's definition (Definition 7.6.5) and its equivalent representation as a supremum over stopping times (Theorem 7.6.6), the K-stopping value function's monotonicity/convexity/differentiability properties (Proposition 7.6.7), the index's optimal-stopping-set and indifference characterizations (Corollary 7.6.8), the two-arm joint stopping value's parallel structure (Proposition 7.6.9), and a fixed-point recasting useful for computation (Proposition 7.6.11) — plus, independently, the cash-balance and casino-game applications (Theorems 7.6.1-7.6.4), which use the general theory but not the bandit-specific machinery.

Significance

The Gittins index theorem's real content, emphasized by the book's own remark, is not merely that an optimal policy exists but how little computation it needs: instead of solving one optimization problem over the bandit's full four-dimensional joint state space N02×N02\mathbb N_0^2 \times \mathbb N_0^2N02​×N02​, the decision maker solves two independent two-dimensional single-arm problems and compares two numbers. This mission's formalization of the goal is built specifically to keep that separation visible — each arm's index is computed from a single, shared KStoppingValue structure applied to that arm's own state alone, never from a function that happens to take the whole joint state as an argument. The proof route here (via the K-stopping problem's explicit fixed-point characterization, Definition 7.6.5 and Proposition 7.6.11) is a genuinely different construction from the platform's existing Gittins-index theorems (BanditAlgorithm.gittins_index_theorem and related), which are built via Whittle's retirement/charge-accounting argument — checked directly and found to define the index differently enough that this mission drafts its own theorems rather than treat that construction as prior art.

Difficulty

The K-stopping value function J(m,n;K)J(m,n;K)J(m,n;K) and the two-arm joint value J~(x;K)\tilde J(x;K)J~(x;K) are both genuine fixed points of an infinite-horizon Bellman equation with no finite backward recursion to fall back on (the "stopping" option, rather than a terminal condition, is what makes the horizon infinite); this mission bundles them as data satisfying their own defining fixed-point equations, the same convention this series uses throughout for such objects. A second difficulty is Theorem 7.6.6's supremum over stopping times: without a canonical path measure for the underlying Markov chain (not built anywhere in this series), the two expectations the theorem compares are represented as data satisfying the positivity a genuine expectation must have, over an explicit, elementary notion of stopping time (a function of the whole observed path, adapted in the sense that whether it has fired by time nnn depends only on the path up to nnn) — a faithful, if representational, rendering of the theorem's genuinely path-dependent content.

Formalization scope

The cash-balance model (Theorem 7.6.1) explicitly cites chunk 02d's finite-horizon critical-level sequences as a hypothesis rather than re-deriving them, since this mission's own content is the infinite-horizon extension, not a second proof of the finite-horizon theory those sequences come from. The casino-game theorems (7.6.2-7.6.4) state optimality for the specific, named timid and bold strategies, not for an unnamed "some optimal policy" — the theorems' entire content is that these particular policies, not merely some optimal one, are best in their regime. The bandit model's posterior mean and Bayes-update operator are kept identical in substance to chunk 05b's finite-horizon Beta-Bernoulli model (restated, since chunks cannot import each other's Lean), so a reader can see this section is solving the same underlying statistical model, now over an infinite horizon.

Selected references

  • N. Bäuerle and U. Rieder, Markov Decision Processes with Applications to Finance, Universitext, Springer, 2011. DOI: 10.1007/978-3-642-18324-9.
  • J. C. Gittins, "Bandit processes and dynamic allocation indices," Journal of the Royal Statistical Society, Series B, 1979 (the original index construction this section's K-stopping-problem approach reformulates).
  • P. Whittle, "Multi-armed bandits and the Gittins index," Journal of the Royal Statistical Society, Series B, 1980 (the retirement-option construction the platform's existing Gittins theorems use, a different proof route from this chunk's own).
  • L. E. Dubins and L. J. Savage, How to Gamble If You Must: Inequalities for Stochastic Processes, McGraw-Hill, 1965 (the classical red-and-black problem, Theorems 7.6.2-7.6.4).
14 thms2 active usersReviewed
Convex OptimizationDiscrete GeometryOperations Research+1·Captain: Shuze Chen

Discrete Convex Analysis VI: Quasi M-Convex Functions and the Quasi-Proximity TheoremTextbook

Motivation

Convexity is normally defined additively — a function's value at a mixture is bounded by the mixture of its values — but many of the properties that make convexity useful in optimization (a local minimum is global, level sets are well-behaved) survive under a much weaker, purely ordinal notion: quasi-convexity, which compares function values rather than adding them. A nondecreasing rescaling of a convex function is generally not convex, but it is always quasi-convex — so a theory built only on ordinal comparisons automatically covers every such rescaling for free, at the cost of a more delicate proof architecture (since the algebraic cancellations available to additive convexity are no longer available).

Chapter 6's second half asks exactly how far this idea extends in the discrete setting: does the M-convexity exchange axiom have an ordinal, quasi-convex relaxation that still supports the same strong minimization theory — an optimality criterion, a minimizer-cut lemma, and, most significantly, a proximity theorem with the same explicit distance bound? This mission formalizes the chapter's answer: yes, and the relevant relaxed class, functions satisfying condition (SSQM≠_{\ne}=​), is large enough to include every strictly increasing rescaling of an M-convex function, a class the M-convex theory of chunk 06 alone says nothing about.

Setting

Let VVV be a finite ground set and f:ZV→R∪{+∞}f : \mathbb Z^V \to \mathbb R \cup \{+\infty\}f:ZV→R∪{+∞} with nonempty effective domain. Building on chunk 06's M-convex exchange axiom (M-EXC[Z]), this chapter introduces several ordinal relaxations. fff is weakly quasi M-convex, satisfying (QMw), if for every pair of distinct points x,y∈dom⁡fx, y \in \operatorname{dom} fx,y∈domf there exist uuu in the positive support and vvv in the negative support of x−yx - yx−y with f(x−χu+χv)≤f(x)f(x - \chi_u + \chi_v) \le f(x)f(x−χu​+χv​)≤f(x) or f(y+χu−χv)≤f(y)f(y + \chi_u - \chi_v) \le f(y)f(y+χu​−χv​)≤f(y) — an "or" where (M-EXC[Z]) demands an additive inequality. Two further conditions restrict attention to points of different function value and sharpen the conclusion to a three-way trichotomy (strictly better on one side, or exactly tied on both): (SSQM≠_{\ne}=​) quantifies universally over uuu (as in (M-EXC[Z])), while (SSQM≠,w_{\ne,w}=,w​) quantifies existentially over both uuu and vvv (as in (QMw)). The linear perturbation of fff by p:V→Rp : V \to \mathbb Rp:V→R is f[p](x)=f(x)−⟨p,x⟩f[p](x) = f(x) - \langle p, x \ranglef[p](x)=f(x)−⟨p,x⟩.

Formalization targets

Goal: Theorem 6.78 (the quasi M-proximity theorem)

Let fff satisfy (SSQM≠_{\ne}=​), n=∣V∣n = |V|n=∣V∣, α\alphaα a positive integer. If xα∈dom⁡fx_\alpha \in \operatorname{dom} fxα​∈domf satisfies f(xα)≤f(xα+α(χv−χu))f(x_\alpha) \le f(x_\alpha + \alpha(\chi_v - \chi_u))f(xα​)≤f(xα​+α(χv​−χu​)) for all u,v∈Vu, v \in Vu,v∈V, then arg⁡min⁡f≠∅\arg\min f \ne \emptysetargminf=∅ and there is x∗∈arg⁡min⁡fx^* \in \arg\min fx∗∈argminf with ∥xα−x∗∥∞≤(n−1)(α−1)\|x_\alpha - x^*\|_\infty \le (n-1)(\alpha - 1)∥xα​−x∗∥∞​≤(n−1)(α−1) — verbatim the same conclusion, and the same exact bound, as chunk 06's Theorem 6.37(1), now established for the strictly larger class satisfying (SSQM≠_{\ne}=​) rather than the M-convex exchange axiom itself.

Milestones: Theorems 6.68(2), 6.76, 6.77

Theorem 6.68(2): fff satisfies (M-EXC[Z]) if and only if every linear perturbation f[p]f[p]f[p] satisfies (QMw) — quantifying exactly how much weaker (QMw) is pointwise, and how the gap closes once quantified over every perturbation. Theorem 6.76 (the quasi M-optimality criterion): the direct analogue of chunk 06's Theorem 6.26 for the quasi-convexity classes — a purely pairwise local check still characterizes global (or, in the (QMw) case, strict unique) optimality. Theorem 6.77 (the quasi M-minimizer cut): chunk 06's Theorem 6.28 continues to hold verbatim when its M-convexity hypothesis is replaced by (SSQM≠_{\ne}=​) — the structural fact the proximity theorem's proof is built from survives the relaxation intact.

Significance

The result itself. The proximity theorem is the result algorithms actually use: a scaling algorithm for minimizing quasi-convex functions of this kind inherits exactly the same correctness guarantee, with exactly the same distance bound, as the M-convex case — this is a genuine broadening of chapter 10's algorithmic reach, not a restatement dressed in weaker hypotheses. Every strictly increasing scalar transformation of an M-convex objective (a common modeling device — re-expressing a cost in utility units, or applying a monotone risk measure) now falls under a proximity theorem, whereas prior to this chapter's relaxation such a transformation would generally destroy M-convexity itself and leave optimization theory silent on the transformed problem.

Formalizing it. No matching item exists on the platform for quasi M-convexity in any of its forms. Formalizing Theorem 6.78 requires first pinning down (SSQM≠_{\ne}=​) exactly (there are six closely related axiom variants in this section of the book, only three of which — (QMw), (SSQM≠_{\ne}=​), (SSQM≠,w_{\ne,w}=,w​) — are needed for this mission's chosen results), and this mission also captures, via Theorem 6.68(2), the precise sense in which these relaxed conditions are strictly weaker than plain M-convexity while remaining tightly connected to it.

Difficulty

The natural first instinct, given how close the quasi-convexity axioms look to (M-EXC[Z]), is to try to prove Theorem 6.78 by directly imitating chunk 06's proof of Theorem 6.37 line by line. This mostly works — the proof structure (fix a target coordinate, build a chain of strictly decreasing values via repeated exchange steps, bound the chain's length using the scaled hypothesis) survives verbatim — but every step that chunk 06's proof took by adding two instances of the exchange inequality together must be replaced by an ordinal argument, since (SSQM≠_{\ne}=​) only ever asserts a disjunction of value comparisons, never an additive inequality relating four function values simultaneously the way (M-EXC[Z])'s f(x)+f(y)≥f(x−χu+χv)+f(y+χu−χv)f(x)+f(y) \ge f(x-\chi_u+\chi_v)+f(y+\chi_u-\chi_v)f(x)+f(y)≥f(x−χu​+χv​)+f(y+χu​−χv​) does. The book's proof handles this by working with strict inequalities and the trichotomy structure of (SSQM≠_{\ne}=​) directly rather than algebraic cancellation — the same overall architecture, but every arithmetic step rebuilt as a case analysis on which disjunct of (SSQM≠_{\ne}=​) fires.

Formalization scope

This mission builds directly on chunk 06's published items (CharVec, SuppPos, SuppNeg, DomZ, MExchangeAxiom, ArgMin), per the platform's textbook convention that a later chapter of the same book imports an earlier one's definitions rather than redrafting them; its own namespace DiscreteConvex.MConvexFunctions.Quasi nests under chunk 06's DiscreteConvex.MConvexFunctions accordingly. Δf(z;v,u) (Eq. (6.2)) is never reified as a separate object; every occurrence is unfolded directly into an f-value comparison, avoiding WithTop ℝ subtraction throughout, consistent with chunk 06's own convention.

A trivializing formalization of the goal would silently strengthen (SSQM≠_{\ne}=​) back to plain M-convexity (making this mission redundant with chunk 06's Theorem 6.37) or loosen the exact bound (n−1)(α−1)(n-1)(\alpha-1)(n−1)(α−1) to an unspecified function of n,αn, \alphan,α; neither is done. Six axiom variants appear in this section of the book ((QM), (SSQM), (QMw), (SSQMw_ww​), (SSQM≠_{\ne}=​), (SSQM≠,w_{\ne,w}=,w​)); only the three actually needed by this mission's four items are drafted, and Theorem 6.68's first part (an implication chain among the other three) is left out — see MODERATION_NOTES.md. Contributions building the polyhedral M-convex-function bridge (§6.11–6.12, Theorems 6.59–6.64), the level-set characterizations (Theorems 6.72, 6.74), or the scaled quasi M-minimizer cut (Theorem 6.79, the direct generalization of Theorem 6.77 drafted here) are welcome.

Selected references

  • K. Murota, Discrete Convex Analysis, SIAM, 2003. DOI: 10.1137/1.9780898718508.
  • M. Avriel, W. E. Diewert, S. Schaible, I. Zang, Generalized Concavity, Plenum Press, 1988.
8 thms2 active usersReviewed
PreviousNext

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me