Prove2Me
Navigate
DiscoverFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Convex Optimization

236 missions · 140 completed

Missions

Open96Completed140All236
🏆Completed
Discrete GeometryOperations ResearchOptimization·Captain: Shuze Chen

Discrete Convex Analysis X: The Lagrangian Saddle-Point TheoremTextbook

Motivation

Chunk 10 formalized the discrete conjugacy theorem — the Legendre-Fenchel transform's bijection between the classes of M-convex and L-convex functions — and, along the way, a function-level generalization of Edmonds's intersection theorem. Section 8.4 turns that machinery toward a different question: not "how are two convexity classes related," but "when does a discrete optimization problem have a dual that meets it with equality." The classical route to such strong-duality results in continuous convex programming — Lagrangian relaxation, an embedding of the problem in a family of perturbed problems, and a saddle-point characterization of when primal and dual values coincide — has a discrete analogue that needs no continuity, no differentiability, and no convexity in the classical sense at all: only the elementary fact that the Legendre-Fenchel transform, once discretized, is still an involution on the right class of functions. This mission formalizes that discrete Lagrangian duality framework and its central saddle-point theorem, in full generality — before the book specializes it, in the section that follows, to the specific M-convex perturbation that gives the chapter's headline strong-duality result for M-convex programs.

Setting

Let VVV and UUU be finite ground sets. A perturbation of an optimization problem min⁡{f(x):x∈ZV}\min\{f(x) : x \in \mathbb Z^V\}min{f(x):x∈ZV} is a function F:ZV×ZU→Z∪{+∞}F : \mathbb Z^V \times \mathbb Z^U \to \mathbb Z \cup \{+\infty\}F:ZV×ZU→Z∪{+∞} such that F(x,0)=f(x)F(x,0) = f(x)F(x,0)=f(x) for all xxx (Eq. (8.54)) and, for each fixed xxx, F(x,⋅)F(x,\cdot)F(x,⋅) is self-biconjugate: F(x,⋅)∙∙=F(x,⋅)F(x,\cdot)^{\bullet\bullet} = F(x,\cdot)F(x,⋅)∙∙=F(x,⋅) under the discrete Legendre-Fenchel transform of chunk 10 (Eq. (8.55)). The Lagrangian function is K(x,y)=inf⁡{F(x,u)+⟨u,y⟩:u∈ZU}K(x,y) = \inf\{F(x,u) + \langle u,y\rangle : u \in \mathbb Z^U\}K(x,y)=inf{F(x,u)+⟨u,y⟩:u∈ZU} (Eq. (8.58)), valued in Z∪{±∞}\mathbb Z \cup \{\pm\infty\}Z∪{±∞} (formalized in EReal, since both the infimum and the supremum below can be genuinely unbounded). The dual objective is g(y)=inf⁡{K(x,y):x∈ZV}g(y) = \inf\{K(x,y) : x \in \mathbb Z^V\}g(y)=inf{K(x,y):x∈ZV} (Eq. (8.60)). Writing inf⁡(P)=inf⁡xf(x)\inf(P) = \inf_x f(x)inf(P)=infx​f(x), sup⁡(D)=sup⁡yg(y)\sup(D) = \sup_y g(y)sup(D)=supy​g(y), opt⁡(P)={x:f(x)=inf⁡(P)}\operatorname{opt}(P) = \{x : f(x) = \inf(P)\}opt(P)={x:f(x)=inf(P)}, opt⁡(D)={y:g(y)=sup⁡(D)}\operatorname{opt}(D) = \{y : g(y) = \sup(D)\}opt(D)={y:g(y)=sup(D)}, the primal problem PPP is to minimize fff over ZV\mathbb Z^VZV and the dual problem DDD is to maximize ggg over ZU\mathbb Z^UZU.

Formalization targets

Goal: Theorem 8.54 (the saddle-point theorem)

Assuming FFF is self-biconjugate (Eq. (8.55)): both inf⁡(P)\inf(P)inf(P) and sup⁡(D)\sup(D)sup(D) are finite and min⁡(P)=max⁡(D)\min(P) = \max(D)min(P)=max(D) if and only if there exist xˉ∈ZV\bar x \in \mathbb Z^Vxˉ∈ZV, yˉ∈ZU\bar y \in \mathbb Z^Uyˉ​∈ZU with K(xˉ,yˉ)K(\bar x,\bar y)K(xˉ,yˉ​) finite and K(x,yˉ)≤K(xˉ,yˉ)≤K(xˉ,y)K(x,\bar y) \le K(\bar x,\bar y) \le K(\bar x,y)K(x,yˉ​)≤K(xˉ,yˉ​)≤K(xˉ,y) for all x,yx,yx,y — a saddle point of the Lagrangian kernel. When this holds, xˉ∈opt⁡(P)\bar x \in \operatorname{opt}(P)xˉ∈opt(P) and yˉ∈opt⁡(D)\bar y \in \operatorname{opt}(D)yˉ​∈opt(D).

Milestones: Theorem 8.52, Proposition 8.51(1)-(2)

Theorem 8.52 (weak duality): inf⁡(P)≥sup⁡(D)\inf(P) \ge \sup(D)inf(P)≥sup(D) always, with no biconjugacy hypothesis on FFF at all — the baseline the saddle-point theorem sharpens to equality. Proposition 8.51(1)-(2): under self-biconjugacy, the perturbation FFF (and hence the primal objective fff) is itself recoverable from the Lagrangian kernel KKK by a supremum, F(x,u)=sup⁡y{K(x,y)−⟨u,y⟩}F(x,u) = \sup_y\{K(x,y) - \langle u,y\rangle\}F(x,u)=supy​{K(x,y)−⟨u,y⟩} and f(x)=sup⁡yK(x,y)f(x) = \sup_y K(x,y)f(x)=supy​K(x,y) — the algebraic identity the saddle-point theorem's proof turns on directly.

Significance

The result itself. The saddle-point theorem is the general-purpose engine behind every strong-duality result the book proves for specific classes of discrete optimization problems: the book's own next section specializes it (via a particular choice of FFF built from an M-convex regularizer rrr) to obtain strong duality for M-convex programs, but the theorem itself needs no M-convexity, no submodularity, and no exchange axiom — only the elementary self-biconjugacy of a perturbation under the discrete Legendre-Fenchel transform. It is, in that sense, the most general and most reusable strong-duality statement in the book: any future mission proving strong duality for a specific class of discrete programs (M-convex, M2-convex, network flow, or otherwise) by exhibiting a self-biconjugate perturbation can cite this theorem directly rather than reproving the saddle-point argument from scratch.

Formalizing it. No matching item exists on the platform for a discrete Lagrangian saddle- point theorem, discrete weak duality, or this perturbation-based duality framework. (A prior-art search turned up an unrelated continuous Lagrangian saddle-point theorem for convex cones, Luenberger's Chapter 8 §8.4, formalized as VectorSpaceOpt.lagrangian_saddle_sufficient_pointed — a genuinely different setting: no discreteness, no biconjugacy hypothesis, and a one-directional sufficiency statement rather than this mission's iff. Not reused.) This mission gives the first formal statement of discrete Lagrangian duality, and directly reuses chunk 10's ConvexConjugate apparatus (self-biconjugacy is stated using chunk 10's own conjugate-of-conjugate composition), demonstrating exactly the kind of shared-substrate payoff the discrete conjugacy theorem was built to provide.

Difficulty

The saddle-point theorem's "only if" direction is not a routine unwinding of definitions: given min⁡(P)=max⁡(D)\min(P) = \max(D)min(P)=max(D) at finite common value, one must construct the saddle point (xˉ,yˉ)(\bar x,\bar y)(xˉ,yˉ​) — the book's proof takes xˉ∈opt⁡(P)\bar x \in \operatorname{opt}(P)xˉ∈opt(P), yˉ∈opt⁡(D)\bar y \in \operatorname{opt}(D)yˉ​∈opt(D) (which exist because the infimum/supremum are attained at a finite optimum) and verifies the sandwiching inequality using Proposition 8.51(2)'s identity f(x)=sup⁡yK(x,y)f(x) = \sup_y K(x,y)f(x)=supy​K(x,y) together with weak duality, rather than by any direct algebraic manipulation of KKK alone. Skipping straight to a "trivial" biconditional that never invokes Proposition 8.51 would misrepresent the actual proof structure the book relies on for exactly this direction.

Formalization scope

V,UV, UV,U are Fintype ground types; LagrangianKernel, DualObjective, InfP, SupD are EReal-valued to keep both the defining infima/suprema total (a complete lattice) without an artificial finiteness side-condition; OptP, OptD compare PrimalValue/DualObjective against InfP/SupD after casting through chunk 10's ToEReal, mirroring that chunk's own round-trip convention. "Finite" throughout is formalized as ≠ ⊤ ∧ ≠ ⊥ in EReal. The perturbation FFF itself is left fully abstract (an arbitrary function satisfying the self-biconjugacy hypothesis where needed) — this mission does not draft the specific M-convex perturbation FrF_rFr​ (Eq. (8.61)) that the book's next subsection (§8.4.3) uses to specialize this framework to M-convex programs, nor Theorem 8.59 (the resulting M-convex strong-duality theorem) itself, which needs that specific perturbation plus its own regularity conditions (REG)/(OBJ) and a chain of M-convex-specific propositions (8.55–8.58) beyond what the general framework built here provides. A trivializing formalization would state the saddle-point theorem's sandwiching inequality with a weaker order (e.g., only one of the two directions) or would omit the "xˉ∈opt⁡(P),yˉ∈opt⁡(D)\bar x \in \operatorname{opt}(P), \bar y \in \operatorname{opt}(D)xˉ∈opt(P),yˉ​∈opt(D)" consequence clause; neither is done — both inequalities and the full consequence clause are included exactly as the book states them.

Selected references

  • K. Murota, Discrete Convex Analysis, SIAM, 2003. DOI: 10.1137/1.9780898718508.
10 thms3 active usersReviewed
🏆Completed
Discrete GeometryOperations ResearchOptimization·Captain: Shuze Chen

Discrete Convex Analysis XXVII: Directional Derivatives and Quasi L-Convex FunctionsTextbook

Motivation

This mission completes chapter 7's L-convex function theory and closes the book on it. It first finishes the theory of positively homogeneous L-convex functions — showing they coincide exactly with the classical Lovász extensions of submodular set functions, a one-to-one correspondence that recognizes forty years of submodular-optimization machinery as a special case of L-convex function theory. It then proves the L-side capstone this series has been building toward since mission 26-ch07b-lconvexfunctions: polyhedral L-convexity is characterized simultaneously by directional derivatives, subdifferentials, and weighted-minimizer polyhedra — the exact mirror of what mission 24-ch06d-mconvexfunctions proved for M-convex functions. Finally it develops quasi L-convex functions, the L-side analogue of mission 25-ch06e-mconvexfunctions's quasi M-convex functions, ending exactly where chapter 7 itself ends.

Setting

Fix a finite ground set VVV. The class 0L[R→R]0L[\mathbb R \to \mathbb R]0L[R→R] consists of polyhedral L-convex functions that are positively homogeneous; 0L[Z→Z]0L[\mathbb Z \to \mathbb Z]0L[Z→Z], its integer-valued integer-domain analogue. A positively homogeneous L-convex function ggg induces a submodular set function ρg(X)=g(χX)\rho_g(X) = g(\chi_X)ρg​(X)=g(χX​); conversely the Lovász extension ρ^\hat\rhoρ^​ of a submodular set function is positively homogeneous L-convex. The base polyhedron B(ρ)={x∈RV:x(X)≤ρ(X) ∀X, x(V)=ρ(V)}B(\rho) = \{x \in \mathbb R^V : x(X) \le \rho(X)\ \forall X,\ x(V) = \rho(V)\}B(ρ)={x∈RV:x(X)≤ρ(X) ∀X, x(V)=ρ(V)} of a submodular ρ\rhoρ is always an M-convex polyhedron. A function g:ZV→R∪{+∞}g : \mathbb Z^V \to \mathbb R \cup \{+\infty\}g:ZV→R∪{+∞} is quasi submodular (QSB) if g(p∧q)≤g(p)g(p\wedge q) \le g(p)g(p∧q)≤g(p) or g(p∨q)≤g(q)g(p\vee q) \le g(q)g(p∨q)≤g(q) for all p,qp,qp,q; the weaker (QSBw) requires only max⁡{g(p),g(q)}≥min⁡{g(p∧q),g(p∨q)}\max\{g(p),g(q)\} \ge \min\{g(p\wedge q), g(p\vee q)\}max{g(p),g(q)}≥min{g(p∧q),g(p∨q)}.

Formalization targets

Goal: the four characterizations of polyhedral L-convexity (Theorem 7.45)

For a polyhedral convex function ggg with dom⁡Rg≠∅\operatorname{dom}_{\mathbb R} g \ne \emptysetdomR​g=∅: ggg is L-convex if and only if every directional derivative g′(p;⋅)g'(p;\cdot)g′(p;⋅) is 0L[R→R]0L[\mathbb R \to \mathbb R]0L[R→R], if and only if every subdifferential ∂Rg(p)\partial_{\mathbb R} g(p)∂R​g(p) is an M-convex polyhedron, if and only if every weighted minimizer set is an L-convex polyhedron. Not present in this chunk's own extraction table (its label opens mid-paragraph, missed by the same extractor failure already documented for mission 25-ch06e-mconvexfunctions's Theorem 6.68), found by direct reading and chosen as goal because it is the exact L-side mirror of mission 24-ch06d-mconvexfunctions's own milestone Theorem 6.63, and its proof is assembled entirely from results already in this series (Theorem 7.43, Proposition 7.34, Theorem 7.40).

Supporting structural targets

Fifteen further results build the two remaining pieces of chapter 7's theory. Propositions 7.37-7.39 and Theorem 7.40 establish the one-to-one correspondence between positively homogeneous L-convex functions and submodular set functions via the Lovász extension; Proposition 7.41 gives a minimizer-polyhedron characterization of this class, and Proposition 7.42 shows directional derivatives of L-convex functions automatically land in it. Theorem 7.43 — the L-side mirror of mission 24-ch06d-mconvexfunctions's own goal, Theorem 6.61 — proves the directional- derivative/subdifferential correspondence via the induced submodular set function's base polyhedron; Proposition 7.44 checks consistency at integer points, and Theorem 7.46 refines Theorem 7.45 to the integral case. Theorem 7.49 (also missed by the extractor) gives the quasi-submodularity implication hierarchy and its perturbation-equivalence capstone, mirroring mission 25-ch06e-mconvexfunctions's Theorem 6.68 exactly. Proposition 7.50 and Theorems 7.51-7.52 build the level-set/perturbation machinery quasi submodularity needs; Theorems 7.53-7.54 (both missed by the extractor, the latter's full statement requiring one page beyond this chunk's nominal range, at the very end of chapter 7) give the quasi L-optimality and quasi L-proximity theorems.

Significance

The 0L/submodular correspondence (Theorem 7.40) is the precise sense in which L-convex function theory generalizes submodular set function theory rather than merely resembling it: every submodular set function is literally the restriction to {0,1}V\{0,1\}^V{0,1}V of a positively homogeneous L-convex function, and every algorithm for one transfers to the other through this exact dictionary. The goal, Theorem 7.45, completes the parallel structure this series has built since chapter 6: M-convexity and L-convexity are now each characterized in the same four convex-analytic vocabularies, setting up chapter 8's conjugacy theorem, which will show these two characterizations are not merely analogous but literally dual to each other under the Legendre-Fenchel transform. The quasi-submodularity results matter for the same reason as their M-side counterparts: chapter 10's algorithms for L-convex-function minimization remain correct under nonlinear rescalings that destroy L-convexity itself but preserve quasi submodularity.

None of these results are open — they are Murota's account of how far L-convex function theory extends beyond the polyhedral case (to positive homogeneity and its submodular-function incarnation) and how far its exchange-style inequality can be relaxed while preserving optimization theory (to quasi submodularity), mirroring chapter 6's identical two-part program for M-convex functions. What this mission contributes is a faithful, machine-checked formal statement of each, including four theorems (7.45, 7.49, 7.53, 7.54) the platform's own automated extractor missed entirely — one of them requiring a page beyond this chunk's own nominal range to complete, since chapter 7 ends there and this is the last mission covering it — extending the shared Lean vocabulary (ZeroLR, BasePolyhedron, QSBw) this series builds on; no comparable formalization exists on the platform (see Formalization scope).

Difficulty

The naive approach to the goal would try to prove all six pairwise implications among its four conditions independently; the book's own proof instead chains through results already established: (a)⇒(b) is Proposition 7.42, (a)⇒(c) is Theorem 7.43, (a)⇒(d) is Proposition 7.34, (b)⇔(c) uses the 0L/M0[R] correspondence, and (d)⇒(b) is the genuinely hard direction, requiring Proposition 7.41 applied to the directional derivative itself (showing arg⁡min⁡(g′(p;⋅)[−x])\arg\min(g'(p;\cdot)[-x])argmin(g′(p;⋅)[−x]) is an L-convex cone by an explicit description via the admissible-potential set of the distance function underlying arg⁡min⁡g[−x]\arg\min g[-x]argming[−x]). The remaining combinatorial difficulty in this block is in Theorem 7.43's proof: identifying ∂Rg(p)\partial_{\mathbb R} g(p)∂R​g(p) with the base polyhedron B(ρg,p)B(\rho_{g,p})B(ρg,p​) requires the L-optimality criterion (Theorem 7.33, mission 27-ch07c-lconvexfunctions) applied pointwise, a chain of logical equivalences with no single-step shortcut, exactly mirroring how mission 24-ch06d-mconvexfunctions's Theorem 6.61 needed the M-optimality criterion.

Formalization scope

Ground-set elements are a Fintype V with DecidableEq; L-convex functions are (V→ℝ)→WithTop ℝ (polyhedral) or (V→ℤ)→WithTop ℝ (integer-domain). All sixteen numbered results found in this chunk's page range — the twelve in BRIEF.md's own table plus four the extractor missed (Theorems 7.45, 7.49, 7.53, 7.54) — are placed, with two documented, content-preserving scope decisions: Theorem 7.43 omits the dual-integral refinement clauses for L[R→R|Z]/L[Z→Z] (the same decision mission 24-ch06d-mconvexfunctions's Theorem 6.61 made), and Proposition 7.50 states the general inequalities without restating their "In particular" specializations, which add no independent content — see HARD.md. "inf⁡g[−x]>−∞\inf g[-x]>-\inftyinfg[−x]>−∞" is replaced by the equivalent (ArgMinR ...).Nonempty hypothesis throughout, matching mission 25-ch06e-mconvexfunctions's identical substitution. This mission's base vocabulary is redeclared from missions 20-ch04b-mconvexsets, 21-ch05b-lconvexsets, 23-24-ch06*-mconvexfunctions, and 26-27-ch07*-lconvexfunctions rather than imported, since sibling drafts in this series cannot yet reference one another. Contributions completing any of the sixteen sorrys are welcome; the goal and Theorem 7.43 carry the most independent proof content.

Selected references

  • K. Murota, Discrete Convex Analysis, SIAM, 2003. DOI: 10.1137/1.9780898718508.
  • K. Murota and A. Shioura, "M-convex function on generalized polymatroid," Mathematics of Operations Research, 24 (1999), pp. 95-105 [152] (the polyhedral theory Theorems 7.26-7.46 are drawn from).
  • P. Milgrom and C. Shannon, "Monotone comparative statics," Econometrica, 62 (1994), pp. 157-180 [129] (the origin of the quasi-submodularity condition (SSQSB)).
68 thms3 active usersReviewed
🏆Completed
Discrete GeometryOperations ResearchOptimization·Captain: Shuze Chen

Discrete Convex Analysis XXVI: Polyhedral L-Convex FunctionsTextbook

Motivation

L-convex functions were defined purely combinatorially, on the integer lattice. Chapter 6's M-convex theory showed that combinatorial definition always extends to a genuine convex function on real space (missions 23-ch06c-mconvexfunctions/24-ch06d-mconvexfunctions); this mission carries out the identical program for the L side. It first shows L♮^\natural♮-convexity is exactly integral convexity plus ordinary submodularity — a clean synonym that also explains why submodular set functions are a natural special case — then builds the entire polyhedral (real-variable) theory of L-convex functions: the axioms (SBF[R])/(TRF[R]), two practical local criteria for verifying submodularity without checking every pair of points, the fact that the classical Lovász extension of a submodular set function is itself a polyhedral L-convex function, the six-operation closure toolkit, and — this mission's goal — the L-optimality criterion in its full polyhedral generality, characterizing global optimality by finitely many directional derivatives.

Setting

Fix a finite ground set VVV. A polyhedral convex function g:RV→R∪{+∞}g : \mathbb R^V \to \mathbb R \cup \{+\infty\}g:RV→R∪{+∞} with nonempty effective domain is polyhedral L-convex, g∈L[R→R]g \in L[\mathbb R \to \mathbb R]g∈L[R→R], if it satisfies (SBF[R]): g(p)+g(q)≥g(p∨q)+g(p∧q)g(p)+g(q) \ge g(p\vee q)+g(p\wedge q)g(p)+g(q)≥g(p∨q)+g(p∧q), and (TRF[R]): ∃r∈R\exists r \in \mathbb R∃r∈R, g(p+α1)=g(p)+αrg(p+\alpha\mathbf 1) = g(p)+\alpha rg(p+α1)=g(p)+αr for all p∈RVp \in \mathbb R^Vp∈RV, α∈R\alpha \in \mathbb Rα∈R; it is polyhedral L♮^\natural♮-convex if its lift to one extra real coordinate is polyhedral L-convex. A function g:ZV→R∪{+∞}g : \mathbb Z^V \to \mathbb R \cup \{+\infty\}g:ZV→R∪{+∞} is integrally convex if its convex closure agrees, at every real point, with the closure taken using only that point's integral neighborhood. The Lovász extension ρ^\hat\rhoρ^​ of a submodular set function ρ\rhoρ is the piecewise-linear interpolation built from the sorted distinct components of p∈RVp \in \mathbb R^Vp∈RV. The directional derivative g′(p;d)g'(p;d)g′(p;d) is inf⁡t>0(g(p+td)−g(p))/t\inf_{t>0}(g(p+td)-g(p))/tinft>0​(g(p+td)−g(p))/t.

Formalization targets

Goal: the polyhedral L-optimality criterion (Theorem 7.33)

For a polyhedral L-convex function ggg and p∈dom⁡Rgp \in \operatorname{dom}_{\mathbb R} gp∈domR​g: g(p)≤g(q)g(p) \le g(q)g(p)≤g(q) for all qqq if and only if g′(p;χY)≥0g'(p;\chi_Y) \ge 0g′(p;χY​)≥0 for every Y⊆VY \subseteq VY⊆V and g′(p;1)=0g'(p;\mathbf 1)=0g′(p;1)=0; for polyhedral L♮^\natural♮-convex ggg, the criterion simplifies to g′(p;±χY)≥0g'(p;\pm\chi_Y) \ge 0g′(p;±χY​)≥0 for every YYY. This is the direct L-side mirror of mission 24-ch06d-mconvexfunctions's M-optimality criterion (Theorem 6.52) and the polyhedral generalization of mission 08-lconvex-functions-i's integer-domain L-optimality criterion (Theorem 7.14): checking global optimality against exponentially many points reduces to ∣V∣+1|V|+1∣V∣+1 (or 2∣V∣2|V|2∣V∣) directional-derivative inequalities.

Supporting structural targets

Twelve further results build the polyhedral theory from the ground up. Theorems 7.20-7.21 identify L♮^\natural♮-convexity with the conjunction of ordinary submodularity and integral convexity — a genuinely different, function-analytic characterization from the exchange-axiom- style definitions used so far. Propositions 7.23-7.24 give two practical sufficient conditions for verifying (SBF[R]) locally, at a single scale, rather than globally. Proposition 7.25 shows the Lovász extension of any submodular set function is automatically polyhedral L-convex — not in this chunk's own extraction table (its label is preceded by an unlabeled restatement of the same fact, which evidently confused the extractor), found and placed by direct reading. Theorem 7.26 shows an L-convex function's convex extension, when polyhedral, inherits polyhedral L-convexity, continuing mission 26-ch07b-lconvexfunctions's Theorem 7.19. Theorems 7.28-7.32 restate the discrete theory's core equivalences (translation submodularity, the L/L♮^\natural♮ correspondence, the six basic operations, restrictions) in the polyhedral setting, and Proposition 7.34 shows minimizer sets of linearly-perturbed polyhedral L-convex functions are themselves L-convex polyhedra — flagged by the book itself as a partial result whose full converse characterization (Theorem 7.45) lies beyond this chunk's range.

Significance

Theorems 7.20-7.21's synonym is structurally important: it means every algorithm and theorem already known for submodular-function minimization over {0,1}V\{0,1\}^V{0,1}V-type domains applies, after a midpoint-convexity check, to the vastly larger class of integer-lattice L♮^\natural♮-convex functions, with no new proof technique required. Proposition 7.25 is the bridge that lets the combinatorial Lovász extension — the workhorse of submodular optimization for forty years — be recognized as a special case of the polyhedral L-convex function theory this mission builds, explaining why algorithms for one transfer so readily to the other. The goal, Theorem 7.33, is the precise tool chapter 10's continuous-relaxation algorithms for L-convex-function minimization actually verify against: a scaling algorithm's claimed optimum is confirmed correct exactly by checking the criterion's finitely many directional-derivative inequalities.

None of these results are open — they are Murota's account of how the integer-lattice theory of L-convexity survives, result by result, the passage to polyhedral convex functions on RV\mathbb R^VRV, mirroring chapter 6's identical program for M-convexity. What this mission contributes is a faithful, machine-checked formal statement of each, including one result (Proposition 7.25) the platform's own automated extractor missed, extending the shared Lean vocabulary (SBFR, TRFR, LovaszExtension, DirDeriv) this series builds on; no comparable formalization exists on the platform (see Formalization scope).

Difficulty

The naive approach to the goal would try to verify g(p)≤g(q)g(p) \le g(q)g(p)≤g(q) directly against every q∈RVq \in \mathbb R^Vq∈RV; the book's actual proof instead reduces this to the finite family of directional derivatives via Theorem 7.20's integral-convexity fact (an L♮^\natural♮-convex function's local behavior determines its global behavior) applied to the polyhedral setting through Theorem 3.21's general optimality criterion for integrally convex functions — a two-layer reduction (polyhedral →\to→ integral-convexity →\to→ finite local check) with no direct one-step argument. The genuine combinatorial content in this block is in Proposition 7.25's proof: showing the Lovász extension is submodular requires the finite-valued case (a direct calculation split on whether the two perturbed coordinates land in the same or different threshold sets) and then a limiting argument over a sequence of finite-valued truncations ρk→ρ\rho_k \to \rhoρk​→ρ for the general, possibly-infinite case — a genuine two-step argument, not a single inequality chase.

Formalization scope

Ground-set elements are a Fintype V with DecidableEq; polyhedral L-(natural-)convex functions are (V→ℝ)→WithTop ℝ. All thirteen numbered results found in this chunk's page range are placed, with one documented scope reduction: Proposition 7.24 states only part (1) (the unconditional-on-magnitude sufficient condition), not part (2)'s sharper, sorted-index-restricted version, which needs the same SortedValues apparatus a second time for no other result's benefit — see HARD.md. "gU>−∞g_U > -\inftygU​>−∞" and its variants are replaced by the equivalent (DomR ...).Nonempty hypothesis throughout, matching mission 24-ch06d-mconvexfunctions's identical substitution. "Domain is closed"/"domain is an interval" (Propositions 7.23-7.24) are stated via Mathlib's IsClosed and Set.OrdConnected respectively, the latter being the precise order-theoretic notion of "interval" in a pointwise-ordered space. This mission's base vocabulary is redeclared from missions 08-lconvex-functions-i, 20-ch04b-mconvexsets (for the Lovász extension machinery), 21-ch05b-lconvexsets, 23-ch06c-mconvexfunctions/ 24-ch06d-mconvexfunctions, and 26-ch07b-lconvexfunctions rather than imported, since sibling drafts in this series cannot yet reference one another. Contributions completing any of the thirteen sorrys are welcome; the goal and Proposition 7.25 carry the most independent proof content.

Selected references

  • K. Murota, Discrete Convex Analysis, SIAM, 2003. DOI: 10.1137/1.9780898718508.
  • K. Murota and A. Shioura, "Extreme points of a generalized polymatroid," Discrete Applied Mathematics, 152 (2005), pp. 268-278 [152] (the polyhedral L-convex function theory this mission's real-variable results are drawn from).
50 thms3 active usersReviewed
🏆Completed
Discrete GeometryOperations ResearchOptimization·Captain: Shuze Chen

Discrete Convex Analysis XXV: L-Convex Functions via Minimizer PolyhedraTextbook

Motivation

Chapter 5 characterized L-convex sets — sublattice-closed, translation-periodic subsets of ZV\mathbb Z^VZV — and showed they interact cleanly with integral convexity. Chapter 7 asks the functional analogue: which functions on the integer lattice deserve to be called convex in the "L" sense, and how do they relate back to L-convex sets? This mission (continuing mission 08-lconvex-functions-i, which built the axioms (SBF[Z])/(TRF[Z])/(SBF♮^\natural♮[Z]) and proved the L-optimality and L-proximity theorems) answers the second question at its sharpest: an L-convex function is exactly a function whose every weighted-minimizer set is an L-convex polyhedron — the discrete analogue of the fact that a convex function is determined by the convex geometry of its sublevel sets. Along the way it settles the chapter's basic toolkit: operations that preserve L-convexity, the local nature of submodularity, the correspondence with ordinary submodular set functions, and the first two structural facts about the convex extension every L-convex function admits.

Setting

Fix a finite ground set VVV. A function g:ZV→R∪{+∞}g : \mathbb Z^V \to \mathbb R \cup \{+\infty\}g:ZV→R∪{+∞} with nonempty effective domain is L-convex, g∈L[Z→R]g \in L[\mathbb Z \to \mathbb R]g∈L[Z→R], if it satisfies submodularity (SBF[Z]): g(p)+g(q)≥g(p∨q)+g(p∧q)g(p)+g(q) \ge g(p\vee q) + g(p\wedge q)g(p)+g(q)≥g(p∨q)+g(p∧q), and translation invariance (TRF[Z]): ∃r∈R\exists r \in \mathbb R∃r∈R, g(p+1)=g(p)+rg(p+\mathbf 1) = g(p) + rg(p+1)=g(p)+r for all ppp. It is L♮^\natural♮-convex if its lift to one extra coordinate (Eq. (7.2)) is L-convex. A set function ρ:2V→R∪{+∞}\rho : 2^V \to \mathbb R \cup \{+\infty\}ρ:2V→R∪{+∞} is submodular if ρ(X)+ρ(Y)≥ρ(X∪Y)+ρ(X∩Y)\rho(X)+\rho(Y) \ge \rho(X\cup Y) + \rho(X\cap Y)ρ(X)+ρ(Y)≥ρ(X∪Y)+ρ(X∩Y); it corresponds to an L♮^\natural♮-convex function supported on {0,1}V\{0,1\}^V{0,1}V via g(χX)=ρ(X)g(\chi_X) = \rho(X)g(χX​)=ρ(X) (Eq. (7.5)). The convex closure gˉ\bar ggˉ​ of ggg is its extension to RV\mathbb R^VRV by finite convex combinations.

Formalization targets

Goal: L-convexity via minimizer polyhedra (Theorem 7.17)

For g:ZV→R∪{+∞}g : \mathbb Z^V \to \mathbb R \cup \{+\infty\}g:ZV→R∪{+∞} with bounded nonempty effective domain: ggg is L-convex if and only if arg⁡min⁡g[−x]\arg\min g[-x]argming[−x] is an L-convex set for every x∈RVx \in \mathbb R^Vx∈RV; the L♮^\natural♮ analogue holds with L♮^\natural♮-convex sets. This is the direct mirror of mission 23-ch06c-mconvexfunctions's own goal (Theorem 6.43, characterizing M-convex functions via M-convex weighted-minimizer polyhedra) — the book's text calls it exactly "how the concept of L-convex functions can be defined from that of L-convex sets."

Supporting structural targets

Eleven further results build the chapter's basic vocabulary. Theorem 7.2 strengthens translation submodularity to allow negative shifts; Theorem 7.3 places L-convexity inside L♮^\natural♮- convexity; Proposition 7.4 identifies submodular set functions with a subclass of L♮^\natural♮-convex functions via the indicator embedding, and Theorem 7.15 derives the classical submodular-minimizer local-optimality criterion as its corollary; Proposition 7.5 shows submodularity is a local property, needing only unit-distance pairs; Proposition 7.8 transfers L-(natural-)convexity from functions to their effective domains; Proposition 7.9 and Theorem 7.10–7.11 give the chapter's basic examples (univariate and pairwise-difference functions) and its six-operation closure toolkit (scaling, affine reparametrization, linear perturbation, projection, infimal convolution with a separable function, and sums), both for L-convex and L♮^\natural♮- convex functions, the latter also admitting interval and coordinate restrictions; Proposition 7.16 shows minimizer sets of L-convex functions are themselves L-convex, the special case (x=0x=0x=0) the goal generalizes to every linear perturbation; Theorem 7.19 begins the convex-extension program this chapter's next chunk completes, establishing that the convex closure agrees with ggg on ZV\mathbb Z^VZV and inherits its translation constant.

Significance

The goal is significant for the same structural reason as its M-side counterpart: it says L-convexity is not merely a combinatorial condition on lattice differences but is equivalent to a purely polyhedral-geometric one, closing the loop between chapters 5 and 7 the way Theorem 6.43 closes the loop between chapters 4 and 6. Theorem 7.15's corollary status is itself instructive: the well-known fact that a submodular set function's global minimizer needs only local verification against comparable sets — the theoretical basis of every submodular-minimization algorithm in chapter 10 — falls out of the L-optimality criterion (mission 08-lconvex-functions-i's Theorem 7.14) applied to the indicator embedding, rather than needing an independent proof. Theorem 7.10–7.11's six operations are the toolkit every later construction in this chapter and chapter 9's network transformations builds new L-convex functions from old.

None of these results are open — they are Murota's account of the basic function-level theory of L-convexity, mirroring chapter 6's M-convex function theory chunk-by-chunk. What this mission contributes is a faithful, machine-checked formal statement of each, extending the shared Lean vocabulary (SBF, TRF, LNaturalConvex, LConvexSet) that missions 08-lconvex-functions-i and 21-ch05b-lconvexsets began; no comparable formalization exists on the platform (see Formalization scope).

Difficulty

The naive approach to the goal would try to verify L-convexity's submodularity inequality directly against the definition of an L-convex set applied to each minimizer family; the book's actual proof instead routes through Theorem 7.10 (3)'s closure of L-convexity under linear perturbation and Proposition 7.16's minimizer-is-L-convex-set fact for the forward direction, and defers the converse entirely to a later note (Note 7.47, outside this chunk and mission 08's combined range) proved via the integral-convexity machinery of section 7.7 onward. The genuine combinatorial difficulty in this block is upstream, in Theorem 7.10 (5)'s infimal-convolution operation: proving L-convexity of the perturbed function requires a four-term submodularity inequality assembled from the separable function's own convexity and ggg's submodularity applied at the optimal q1,q2q_1,q_2q1​,q2​ simultaneously — a genuine two-hypothesis combination with no single-inequality shortcut.

Formalization scope

Ground-set elements are a Fintype V with DecidableEq; L-(natural-)convex functions are (V→ℤ)→WithTop ℝ. All twelve numbered results found in this chunk's page range are placed, with one documented scope reduction: Theorem 7.19 states only parts (3)-(4) (that the convex closure agrees with ggg on ZV\mathbb Z^VZV and inherits its translation constant), not the explicit Lovász-extension-formula construction of parts (1)-(2) and (5), which needs a sorted-distinct- component apparatus no other result in this chunk requires — see HARD.md. "gU>−∞g_U > -\inftygU​>−∞" and its variants are replaced by the equivalent (DomZ ...).Nonempty hypothesis throughout, matching mission 24-ch06d-mconvexfunctions's identical substitution (WithTop ℝ has no −∞-\infty−∞ element). This mission's base vocabulary (SBF, TRF, LNaturalConvex, etc.) is redeclared verbatim from mission 08-lconvex-functions-i rather than imported, since sibling drafts in this series cannot yet reference one another; LConvexSet is likewise redeclared from mission 21-ch05b-lconvexsets. Contributions completing any of the twelve sorrys are welcome; the goal and Theorem 7.10 carry the most independent proof content.

Selected references

  • K. Murota, Discrete Convex Analysis, SIAM, 2003. DOI: 10.1137/1.9780898718508.
  • K. Murota, "Discrete convex analysis," Mathematical Programming, 83 (1998), pp. 313–371 (the original account of L-convex functions this chapter's basic theory is drawn from).
34 thms3 active usersReviewed
🏆Completed
Discrete GeometryOperations ResearchOptimization·Captain: Shuze Chen

Discrete Convex Analysis VIII: Quasi L-Convex Functions and the Quasi-Proximity TheoremTextbook

Motivation

Milgrom and Shannon's theory of quasi-supermodularity, developed for monotone comparative statics in economics, showed that many of the consequences of lattice submodularity survive under a much weaker, purely ordinal relaxation of the defining inequality. Chapter 7's final section imports this idea into discrete convex analysis: does L-convexity's optimality and proximity theory survive when the additive submodularity inequality is relaxed to an ordinal condition on the sign pattern of the two relevant differences, rather than their sum? This mission formalizes the chapter's answer for the strongest of the relevant relaxations, (SSQSB) (semistrict quasi submodularity): yes, and the class is large enough to include every strictly increasing rescaling of an L-convex function — exactly mirroring chunk 07's result for the M-convex side, and completing the "quasi" theory on both halves of the exchange-axiom framework before chapter 8 unifies them under conjugacy.

Setting

Let VVV be a finite ground set and g:ZV→R∪{+∞}g : \mathbb Z^V \to \mathbb R \cup \{+\infty\}g:ZV→R∪{+∞}. Building on chunk 08's submodularity axiom (SBF[Z]), this section introduces four ordinal relaxations. ggg is quasi submodular, satisfying (QSB), if for every p,q∈ZVp, q \in \mathbb Z^Vp,q∈ZV, g(p∧q)≤g(p)g(p \wedge q) \le g(p)g(p∧q)≤g(p) or g(p∨q)≤g(q)g(p \vee q) \le g(q)g(p∨q)≤g(q). ggg is semistrictly quasi submodular, satisfying (SSQSB), if additionally g(p∨q)≥g(q)  ⟹  g(p∧q)≤g(p)g(p \vee q) \ge g(q) \implies g(p \wedge q) \le g(p)g(p∨q)≥g(q)⟹g(p∧q)≤g(p) and symmetrically. The weak variants (QSBw) and (SSQSBw) restrict attention to points of the effective domain and compare max⁡(g(p),g(q))\max(g(p), g(q))max(g(p),g(q)) against min⁡(g(p∧q),g(p∨q))\min(g(p \wedge q), g(p \vee q))min(g(p∧q),g(p∨q)) directly, with (SSQSBw) additionally allowing the four-way tie g(p)=g(q)=g(p∧q)=g(p∨q)g(p) = g(q) = g(p\wedge q) = g(p \vee q)g(p)=g(q)=g(p∧q)=g(p∨q). The linear perturbation of ggg by x:V→Rx : V \to \mathbb Rx:V→R is g[x](p)=g(p)+⟨p,x⟩g[x](p) = g(p) + \langle p, x \rangleg[x](p)=g(p)+⟨p,x⟩.

Formalization targets

Goal: Theorem 7.54 (the quasi L-proximity theorem)

Let ggg satisfy (SSQSB) and g(p)=g(p+1)g(p) = g(p + \mathbf 1)g(p)=g(p+1) for all ppp, n=∣V∣n = |V|n=∣V∣, α\alphaα a positive integer. If pα∈dom⁡gp_\alpha \in \operatorname{dom} gpα​∈domg satisfies g(pα)≤g(pα+αχY)g(p_\alpha) \le g(p_\alpha + \alpha \chi_Y)g(pα​)≤g(pα​+αχY​) for all Y⊆VY \subseteq VY⊆V, then arg⁡min⁡g≠∅\arg\min g \ne \emptysetargming=∅ and there is p∗∈arg⁡min⁡gp^* \in \arg\min gp∗∈argming with the componentwise bound pα≤p∗≤pα+(n−1)(α−1)1p_\alpha \le p^* \le p_\alpha + (n-1)(\alpha-1) \mathbf 1pα​≤p∗≤pα​+(n−1)(α−1)1 — verbatim the same conclusion, and the same exact bound, as chunk 08's Theorem 7.18(1), now established for the strictly larger class satisfying (SSQSB) rather than (SBF[Z]).

Milestones: Theorems 7.49, 7.53

Theorem 7.49: the full nesting chain (SBF[Z]) ⇒\Rightarrow⇒ (SSQSB) ⇒\Rightarrow⇒ (QSB), (SSQSB) ⇒\Rightarrow⇒ (SSQSBw) ⇒\Rightarrow⇒ (QSBw), together with the collapse theorem that (SBF[Z]) holds if and only if every linear perturbation of ggg satisfies (QSBw) — precisely quantifying how weak (QSBw) is pointwise and how the classes reunite under universal perturbation. Theorem 7.53 (the quasi L-optimality criterion): the direct analogue of chunk 08's Theorem 7.14, showing that global (or, for the weaker (QSBw) case, unique-up-to-translation) optimality still reduces to a purely local check against the 2n−22^n - 22n−2 nontrivial sign-pattern neighbors p+χXp + \chi_Xp+χX​.

Significance

The result itself. As with the M-convex case (chunk 07), the proximity theorem is what algorithms actually need: an L-convex-flavored objective transformed by any strictly increasing scalar rescaling (a common device — expressing a network-flow cost in a different currency, or applying a monotone risk adjustment) retains a scaling algorithm's correctness guarantee with exactly the same distance bound, even though the rescaled function is generally no longer L-convex itself.

Formalizing it. No matching item exists on the platform for quasi submodularity or quasi L-convexity in any form. Together with chunk 07 (the M-side quasi-convexity theory), this mission completes the "quasi" relaxation on both halves of the exchange-axiom framework the book develops, immediately before chapter 8 unifies M-convexity and L-convexity under a single conjugacy relationship.

Difficulty

As with chunk 07's quasi M-proximity theorem, the temptation is to imitate chunk 08's L-proximity proof line by line. The overall architecture does survive — translate so pα=0p_\alpha = 0pα​=0, find a lattice-minimal sufficiently-good point, and bound the gap using submodularity — but chunk 08's proof uses (SBF[Z])'s additive inequality directly to compare four function values at once, while this proof must instead route every such comparison through (SSQSB)'s two one-directional implications (Proposition 7.50's quasi-version of the same two-sided inequality), which only ever license moving in one direction at a time depending on which side of a comparison is tight. The book's proof handles this by working with the specific implications (7.43)–(7.44) in place of the L♮-approach property used in chunk 08's proof — an ordinal substitute for the same additive step, at the cost of a case analysis chunk 08's proof did not need.

Formalization scope

This mission builds directly on chunk 08's published items (SBF, DomZ, ArgMin, IndicatorVec), per the platform's textbook convention that a later chapter section of the same book imports an earlier one's definitions; its own namespace DiscreteConvex.LConvexFunctions.Quasi nests under chunk 08's DiscreteConvex.LConvexFunctions accordingly. Note the sign convention of the linear perturbation here, g[x](p)=g(p)+⟨p,x⟩g[x](p) = g(p) + \langle p,x\rangleg[x](p)=g(p)+⟨p,x⟩, is the opposite of the M-side's f[p](x)=f(x)−⟨p,x⟩f[p](x) = f(x) - \langle p,x\ranglef[p](x)=f(x)−⟨p,x⟩ (chunks 06–07) — verified against the book's own formula rather than assumed by analogy.

A trivializing formalization of the goal would silently strengthen (SSQSB) back to plain (SBF[Z]) (making this mission redundant with chunk 08's Theorem 7.18) or loosen the exact bound (n−1)(α−1)(n-1)(\alpha-1)(n−1)(α−1); neither is done. Only (QSB), (SSQSB), (QSBw), (SSQSBw) are drafted, matching exactly what the chosen three items need; the polyhedral L-convex-function bridge (§7.8–7.9, Theorems 7.40–7.46) and the level-set characterizations (Theorems 7.51–7.52) are left for a follow-on mission. Contributions building the 0L ↔ S correspondence (Theorem 7.40, a bridge back to chunk 04's submodular-set-function vocabulary) or the scaled quasi L-minimizer-cut analogue are welcome.

Selected references

  • K. Murota, Discrete Convex Analysis, SIAM, 2003. DOI: 10.1137/1.9780898718508.
  • P. Milgrom, C. Shannon, "Monotone comparative statics," Econometrica, 62(1), 1994, pp. 157–180.
8 thms3 active usersReviewed
🏆Completed
Discrete GeometryOperations ResearchOptimization·Captain: Shuze Chen

Discrete Convex Analysis XXIV: Quasi M-Convex FunctionsTextbook

Motivation

Every characterization of M-convexity so far in this series — the exchange axiom, the optimality criterion, convex extensibility, the directional-derivative/subdifferential correspondence — has been an equivalence with M-convexity itself: a function either is M-convex or it is not. Section 6.14 asks a different question: what happens when the exchange axiom's defining inequality is relaxed to only the sign patterns it actually forces? The answer is a hierarchy of "quasi M-convex" conditions — weaker than M-convexity, strong enough to keep the optimality criterion and the proximity/minimizer-cut theorems intact — and, at the top of that hierarchy, a genuinely new characterization of M-convexity itself: a function is M-convex if and only if every one of its linear perturbations is quasi M-convex in the weakest sense. This mission formalizes that entire hierarchy and its capstone, plus two further characterizations of polyhedral M-convexity (via directional derivatives, subdifferentials, and weighted-minimizer polyhedra) that complete the real-variable theory chunk 24-ch06d-mconvexfunctions began.

Setting

Fix a finite ground set VVV and f:ZV→R∪{+∞}f : \mathbb Z^V \to \mathbb R \cup \{+\infty\}f:ZV→R∪{+∞}. Write Δf(z;v,u)=f(z+χv−χu)−f(z)\Delta f(z;v,u) = f(z + \chi_v - \chi_u) - f(z)Δf(z;v,u)=f(z+χv​−χu​)−f(z). Relaxing the exchange axiom's inequality Δf(x;v,u)+Δf(y;u,v)≤0\Delta f(x;v,u) + \Delta f(y;u,v) \le 0Δf(x;v,u)+Δf(y;u,v)≤0 to the sign patterns it forces gives quasi M-convexity (QM) and semistrict quasi M-convexity (SSQM), and requiring only some pair (u,v)(u,v)(u,v) rather than every uuu gives their weaker variants (QMw), (SSQMw); the minimization-only variants (SSQM≠\ne=), (SSQM≠w\ne_w=w​) replace "x,y∈dom⁡fx,y \in \operatorname{dom} fx,y∈domf" with "f(x)≠f(y)f(x) \ne f(y)f(x)=f(y)". The set-level analogue (Q-EXC)/(Q-EXCw) relaxes the M-convex-set exchange axiom the same way. For α∈R\alpha \in \mathbb Rα∈R, the level set L(f,α)={x∈ZV:f(x)≤α}L(f,\alpha) = \{x \in \mathbb Z^V : f(x) \le \alpha\}L(f,α)={x∈ZV:f(x)≤α}. A polyhedral convex function f:RV→R∪{+∞}f : \mathbb R^V \to \mathbb R \cup \{+\infty\}f:RV→R∪{+∞} is (real-variable) M-convex, f∈M[R→R]f \in M[\mathbb R \to \mathbb R]f∈M[R→R], if it satisfies the real exchange axiom (M-EXC[R]) from chunk 24-ch06d-mconvexfunctions; L0[R]L_0[\mathbb R]L0​[R] denotes polyhedra realized as D(γ)D(\gamma)D(γ) for a triangle-inequality distance function γ\gammaγ, and M0[R]M_0[\mathbb R]M0​[R] denotes real M-convex polyhedral cones.

Formalization targets

Goal: the quasi M-convexity hierarchy (Theorem 6.68)

For f:ZV→R∪{+∞}f : \mathbb Z^V \to \mathbb R \cup \{+\infty\}f:ZV→R∪{+∞}: (1) the implication diagram (M-EXC[Z]) ⇒\Rightarrow⇒ (SSQM) ⇒\Rightarrow⇒ (QM), (M-EXCw[Z]) ⇒\Rightarrow⇒ (SSQMw) ⇒\Rightarrow⇒ (QMw), (M-EXC[Z]) ⇔\Leftrightarrow⇔ (M-EXCw[Z]), (SSQM) ⇒\Rightarrow⇒ (SSQMw), (QM) ⇒\Rightarrow⇒ (QMw); (2) fff satisfies (M-EXC[Z]) if and only if f[p]f[p]f[p] satisfies (QMw) for every p∈RVp \in \mathbb R^Vp∈RV. This theorem is not named in the chunk's own extraction table — the automated extractor, which requires a result's label to start a text line, misses it because it opens mid-paragraph directly after an ASCII-rendered implication diagram — but it is the capstone of the section: its own proof is "combining Theorems 6.72 and 6.74," both formalized here as milestones, and part (2) answers exactly the question a reader of this stretch would ask: what does the entire apparatus of quasi M-convexity ultimately say about M-convexity itself?

Supporting structural targets

Fourteen further results build the hierarchy and complete the real-variable theory. Proposition 6.62 checks the two halves of chunk 24-ch06d-mconvexfunctions's Theorem 6.61 agree at integer points. Theorems 6.63–6.64 add two more characterizations of polyhedral M-convexity — via positively homogeneous directional derivatives and L0[R]L_0[\mathbb R]L0​[R]-valued subdifferentials, and via M0[R]M_0[\mathbb R]M0​[R]/M0[Z∣R]M_0[\mathbb Z|\mathbb R]M0​[Z∣R]-valued weighted-minimizer polyhedra — to the convex-extensibility characterization chunk 23-ch06c-mconvexfunctions proved. Theorem 6.67 gives two equivalent reformulations of (QMw) as pointwise inequalities; Propositions 6.69–6.70 and Theorems 6.72–6.74 build the level-set/perturbation machinery the goal needs. Theorem 6.75 is the (SSQM≠w\ne_w=w​) analogue of Theorem 6.67. Theorem 6.76 is the quasi M-optimality criterion (optimality still characterized by local non-improvement, under only the weak quasi-convexity hypotheses). Theorems 6.77–6.79 show the M-minimizer-cut and M-proximity theorems (from missions 06-mconvex-functions-i and 23-ch06c-mconvexfunctions) hold verbatim under the strictly weaker (SSQM≠\ne=) hypothesis.

Significance

The hierarchy's practical payoff is immediate: Theorems 6.77–6.79 mean the algorithms of chapter 10 that rely on minimizer cuts and proximity bounds do not actually need the full exchange axiom to run correctly on nonlinearly rescaled M-convex functions (Example 6.66 shows any nondecreasing scaling ϕ∘f\phi \circ fϕ∘f of an M-convex fff is quasi M-convex, yet nonlinear scalings are common in practice and destroy M-convexity itself). The goal, Theorem 6.68, is significant independently: it says the exchange axiom — a condition that looks irreducibly combinatorial, quantifying over pairs of points and directions — is equivalent to a purely ordinal, perturbation-based condition (every linear tilt of fff has no strict local improvement that a level set can't witness), giving a genuinely different lens on why M-convexity is the right discrete analogue of convexity. Theorems 6.63–6.64 close out chunk 24-ch06d-mconvexfunctions's program of characterizing polyhedral M-convexity in every classical convex-analytic vocabulary at once (directional derivatives, subdifferentials, weighted minimizers), completing the bridge to Chapter 8's duality theory that chunk builds toward.

None of these results are open — they are Murota's account of how far the exchange axiom's defining inequality can be relaxed while keeping optimization theory intact. What this mission contributes is a faithful, machine-checked formal statement of each, including four theorems (6.68, 6.76, 6.77, 6.78) the platform's own automated extractor missed entirely, extending the shared Lean vocabulary (DeltaF, QMw, LevelSet) the Discrete Convex Analysis series builds on; no comparable formalization exists on the platform (see Formalization scope).

Difficulty

The naive approach to the goal would try to prove the implication diagram's six arrows and the perturbation equivalence as six independent facts; the book's own proof of part (2) instead derives it in one step from Theorems 6.72 and 6.74 — themselves nontrivial (Theorem 6.74's proof strengthens the local exchange axiom equivalence (Theorem 6.4) to hold whenever the domain merely satisfies (Q-EXCw), then runs a bipartite-matching argument on a 4-point neighborhood to verify the resulting local condition). The difficulty is genuinely upstream of the goal's own statement: everything the goal needs is already proved by the time Theorem 6.68 is reached, so the formalization work is in stating the sixteen distinct axioms and their level-set reformulations precisely enough that "combining 6.72 and 6.74" is literally how a Lean proof would proceed.

Formalization scope

Ground-set elements are a Fintype V with DecidableEq; integer-domain functions are (V→ℤ)→WithTop ℝ, real-domain ones (V→ℝ)→WithTop ℝ. All fifteen numbered results — including the four (6.68, 6.76, 6.77, 6.78) the automated extractor missed because their labels open mid-paragraph — are placed as milestone or goal, and every clause of every one is stated in full; no partial-coverage scope reduction was needed in this chunk (contrast chunks 22-ch06b-mconvexfunctions/24-ch06d-mconvexfunctions, which restated 4-of-8-part operations theorems). Two formalization choices are recorded in HARD.md/MODERATION_NOTES.md: "inf⁡f[−p]>−∞\inf f[-p] > -\inftyinff[−p]>−∞" is replaced by the equivalent (ArgMinOn ...).Nonempty hypothesis (WithTop ℝ has no −∞-\infty−∞ element), matching mission 23-ch06c-mconvexfunctions's identical substitution; and M0[R]M_0[\mathbb R]M0​[R]/M0[Z∣R]M_0[\mathbb Z|\mathbb R]M0​[Z∣R] are realized via the book's own indicator-function device rather than a freestanding cone axiom. This mission's definitions are redeclared from chunks 06-mconvex-functions-i, 22–24-ch06*-mconvexfunctions rather than imported, since sibling drafts in this series cannot yet reference one another. Contributions completing any of the fifteen sorrys are welcome; the goal and Theorem 6.74 carry the most independent proof content.

Selected references

  • K. Murota, Discrete Convex Analysis, SIAM, 2003. DOI: 10.1137/1.9780898718508.
  • M. Avriel, W. E. Diewert, S. Schaible, and I. Zang, Generalized Concavity, Plenum Press, 1988 (the continuous quasi-convexity theory this chapter's discrete analogue generalizes).
56 thms3 active usersReviewed
Functional AnalysisOperations ResearchOptimization+1·Captain: mikedeng1

Dual Stochastic Dominance and Related Mean-Risk Models 2: Mean–Gini Optimal Portfolios Exist and Are SSD-EfficientResearch Paper

Motivation

Portfolio selection and other decisions under risk are routinely solved as mean–risk models: maximize the expected outcome minus a multiple of a risk measure over the feasible set. Such a model is computationally convenient, but it is only defensible if its answers agree with the preferences of risk-averse decision makers. The standard formal expression of those preferences is second-degree stochastic dominance (SSD): a random outcome XXX dominates YYY when every nondecreasing concave utility prefers XXX. A mean–risk model whose optimal solution may be SSD-dominated by another feasible decision recommends something every risk-averse investor would reject; the classical mean–variance model has exactly this defect.

Ogryczak and Ruszczyński (SIAM J. Optim. 13 (2002) 60–78) characterize SSD through the absolute Lorenz curve (the second quantile function) and use this dual view to study risk measures defined from quantiles: the vertical diameter of the dual dispersion space, the tail Gini measure and the Gini mean difference. Their §5 shows that the mean–Gini model, with trade-off coefficient at most one, has optimal solutions and that all of them are SSD-efficient. This mission formalizes that result together with the lemmas it rests on. A companion mission of this series formalizes the dual characterization of SSD itself (the paper's Theorems 3.1–3.2).

Timeline. Yitzhaki (1982) showed the mean–Gini necessary condition for SSD for bounded distributions; Ogryczak and Ruszczyński proved SSD consistency of mean-semideviation models (Eur. J. Oper. Res. 116 (1999)) and, in the present paper, extended the analysis to quantile-based and Gini-type risk measures for general integrable outcomes, with existence and efficiency of optimal solutions over sets in LqL_qLq​.

Setting

Let (Ω,B,P)(\Omega,\mathcal B,P)(Ω,B,P) be a probability space and X:Ω→RX:\Omega\to\mathbb RX:Ω→R an integrable random variable with mean μX=EX\mu_X=E XμX​=EX and distribution function FX(η)=P{X≤η}F_X(\eta)=P\{X\le\eta\}FX​(η)=P{X≤η}. The second performance function is

FX(2)(η)=∫−∞ηFX(ξ) dξ,F_X^{(2)}(\eta)=\int_{-\infty}^{\eta}F_X(\xi)\,d\xi ,FX(2)​(η)=∫−∞η​FX​(ξ)dξ,

and X⪰SSDYX\succeq_{SSD}YX⪰SSD​Y means FX(2)(η)≤FY(2)(η)F_X^{(2)}(\eta)\le F_Y^{(2)}(\eta)FX(2)​(η)≤FY(2)​(η) for all η∈R\eta\in\mathbb Rη∈R. Strict dominance is X≻SSDYX\succ_{SSD}YX≻SSD​Y iff X⪰SSDYX\succeq_{SSD}YX⪰SSD​Y and not Y⪰SSDXY\succeq_{SSD}XY⪰SSD​X. For a set QQQ of random variables, X∈QX\in QX∈Q is SSD-efficient in QQQ if no Y∈QY\in QY∈Q satisfies Y≻SSDXY\succ_{SSD}XY≻SSD​X.

The left quantile function is FX(−1)(p)=inf⁡{η:FX(η)≥p}F_X^{(-1)}(p)=\inf\{\eta:F_X(\eta)\ge p\}FX(−1)​(p)=inf{η:FX​(η)≥p} for 0<p≤10<p\le10<p≤1; a number qqq is a ppp-quantile if P{X<q}≤p≤P{X≤q}P\{X<q\}\le p\le P\{X\le q\}P{X<q}≤p≤P{X≤q}. The absolute Lorenz curve is FX(−2)(p)=∫0pFX(−1)(α) dαF_X^{(-2)}(p)=\int_0^pF_X^{(-1)}(\alpha)\,d\alphaFX(−2)​(p)=∫0p​FX(−1)​(α)dα on [0,1][0,1][0,1]. From it the paper defines

  • the vertical diameter hX(p)=μXp−FX(−2)(p)h_X(p)=\mu_Xp-F_X^{(-2)}(p)hX​(p)=μX​p−FX(−2)​(p), p∈[0,1]p\in[0,1]p∈[0,1] (eq. (3.6));
  • the Gini mean difference ΓX=2∫01(μXp−FX(−2)(p)) dp\Gamma_X=2\int_0^1(\mu_Xp-F_X^{(-2)}(p))\,dpΓX​=2∫01​(μX​p−FX(−2)​(p))dp (eq. (3.8));
  • the tail Gini measure GX(p)=2p2∫0p(μXα−FX(−2)(α)) dαG_X(p)=\frac{2}{p^2}\int_0^p(\mu_X\alpha-F_X^{(-2)}(\alpha))\,d\alphaGX​(p)=p22​∫0p​(μX​α−FX(−2)​(α))dα, p∈(0,1]p\in(0,1]p∈(0,1] (eq. (4.8)), so that ΓX=GX(1)\Gamma_X=G_X(1)ΓX​=GX​(1).

The optimization problem is

max⁡X∈Q (μX−λrX),(5.1)\max_{X\in Q}\ (\mu_X-\lambda r_X),\tag{5.1}X∈Qmax​ (μX​−λrX​),(5.1)

with λ>0\lambda>0λ>0, rXr_XrX​ one of these dual risk measures, and QQQ a convex, closed, bounded subset of Lq(Ω,P)L_q(\Omega,P)Lq​(Ω,P) for some q>1q>1q>1.

Formalization targets

Goal: Theorem 5.3

For 1<q<∞1<q<\infty1<q<∞, a nonempty convex bounded closed Q⊆LqQ\subseteq L_qQ⊆Lq​, rX=ΓXr_X=\Gamma_XrX​=ΓX​ and every λ∈(0,1]\lambda\in(0,1]λ∈(0,1]:

arg max⁡X∈Q(μX−λΓX)≠∅and every X∈arg max⁡X∈Q(μX−λΓX) is SSD-efficient in Q.\operatorname*{arg\,max}_{X\in Q}(\mu_X-\lambda\Gamma_X)\neq\emptyset\quad\text{and every } X\in\operatorname*{arg\,max}_{X\in Q}(\mu_X-\lambda\Gamma_X)\text{ is SSD-efficient in }Q.X∈Qargmax​(μX​−λΓX​)=∅and every X∈X∈Qargmax​(μX​−λΓX​) is SSD-efficient in Q.

Milestones

  1. Lemma 3.4: for p∈(0,1)p\in(0,1)p∈(0,1), hX(p)=min⁡ξ∈RE{max⁡(p(X−ξ),(1−p)(ξ−X))}h_X(p)=\min_{\xi\in\mathbb R}E\{\max(p(X-\xi),(1-p)(\xi-X))\}hX​(p)=minξ∈R​E{max(p(X−ξ),(1−p)(ξ−X))}, attained at any ppp-quantile.
  2. Lemma 5.1: X↦hX(p)X\mapsto h_X(p)X↦hX​(p) is convex and positively homogeneous on L1L_1L1​ for p∈[0,1]p\in[0,1]p∈[0,1].
  3. Lemma 5.2: X↦GX(p)X\mapsto G_X(p)X↦GX​(p) is convex and positively homogeneous on L1L_1L1​ for p∈(0,1]p\in(0,1]p∈(0,1].
  4. (4.1): X⪰SSDY⇒μX≥μYX\succeq_{SSD}Y\Rightarrow\mu_X\ge\mu_YX⪰SSD​Y⇒μX​≥μY​.
  5. Proposition 4.5: X⪰SSDY⇒μX−ΓX≥μY−ΓYX\succeq_{SSD}Y\Rightarrow\mu_X-\Gamma_X\ge\mu_Y-\Gamma_YX⪰SSD​Y⇒μX​−ΓX​≥μY​−ΓY​ and X≻SSDY⇒μX−ΓX>μY−ΓYX\succ_{SSD}Y\Rightarrow\mu_X-\Gamma_X>\mu_Y-\Gamma_YX≻SSD​Y⇒μX​−ΓX​>μY​−ΓY​.

Companion: Theorem 5.4

For rX=hX(p)/pr_X=h_X(p)/prX​=hX​(p)/p with p∈(0,1)p\in(0,1)p∈(0,1) and λ∈(0,1]\lambda\in(0,1]λ∈(0,1], the optimal set Q∗Q^*Q∗ is nonempty and each X∈Q∗X\in Q^*X∈Q∗ has an SSD-efficient X∗∈Q∗X^*\in Q^*X∗∈Q∗ with μX∗=μX\mu_{X^*}=\mu_XμX∗​=μX​ and hX∗(p)=hX(p)h_{X^*}(p)=h_X(p)hX∗​(p)=hX​(p).

Significance

Theorem 5.3 certifies the mean–Gini model as a safe decision rule: whatever trade-off λ∈(0,1]\lambda\in(0,1]λ∈(0,1] is chosen, the model returns a decision that no feasible alternative dominates for all risk-averse utilities, and such a decision exists under assumptions natural for portfolio sets in LqL_qLq​. Theorem 5.4 gives the weaker but still usable guarantee for the tail-value-at-risk type measure hX(p)/ph_X(p)/phX​(p)/p, for which non-efficient optima can occur. Lemma 3.4 is the bridge to computation: it turns hX(p)h_X(p)hX​(p) into an expected piecewise-linear loss minimized over a scalar, which is how these models become linear programs over scenarios (§6 of the paper).

On the formalization side, the results are proved in the paper but, as far as a search of the platform shows, not machine-checked anywhere. A complete development produces reusable infrastructure: quantile functions and their integrals for integrable random variables, convexity of law-invariant functionals on L1L_1L1​, the Gini mean difference, and an existence argument for concave maximization over weakly compact subsets of LqL_qLq​.

Difficulty

The existence half needs weak compactness of QQQ in the reflexive space LqL_qLq​ and weak upper semicontinuity of μX−λΓX\mu_X-\lambda\Gamma_XμX​−λΓX​. The functional is defined through quantiles, which are not linear in XXX, so neither its concavity nor its continuity is visible from the definition. Closedness of QQQ in the norm topology must be upgraded to weak closedness, which uses convexity. The efficiency half needs the strict inequality (4.7): a strict SSD relation must produce a strict gap in the integrated absolute Lorenz curves, and the pointwise inequality of F(2)F^{(2)}F(2) alone does not give strictness in Γ\GammaΓ. The obvious attempt to argue efficiency from (4.6) alone fails: it yields only a weak inequality, which is compatible with an optimum being strictly dominated.

Formalization scope

  • One probability space (Ω,P)(\Omega,P)(Ω,P) with IsProbabilityMeasure P; random variables are functions Ω → ℝ, and all random variables compared by ⪰SSD\succeq_{SSD}⪰SSD​ live on it.
  • FX(2)F_X^{(2)}FX(2)​ is the Bochner integral of P.real {X ≤ ξ} over (−∞,η](-\infty,\eta](−∞,η]; μX\mu_XμX​ is ∫ X ∂P. Every statement about general random variables assumes Integrable X P (the paper's standing E∣X∣<∞E|X|<\inftyE∣X∣<∞).
  • FX(−1)F_X^{(-1)}FX(−1)​ uses the real sInf; its junk value at p=1p=1p=1 does not enter any integral and is never used pointwise. FX(−2)F_X^{(-2)}FX(−2)​ is used only on [0,1][0,1][0,1], so it is real-valued here; the extended-real version with +∞+\infty+∞ off [0,1][0,1][0,1] belongs to the companion mission.
  • ΓX\Gamma_XΓX​ is defined by the area formula (3.8), not by the double-integral formula that the paper cites; hXh_XhX​ is defined by (3.6), not by the minimum (3.7), so Lemma 3.4 is a genuine statement.
  • LqL_qLq​ is Mathlib's Lp ℝ q P with 1 < q and q ≠ ∞ (the paper's qqq is a real number >1>1>1); the functionals are applied to the function of an LqL_qLq​ element, and SSD-efficiency in QQQ refers to the image of QQQ in functions. Positive homogeneity is stated for the L1L_1L1​ element c⋅Xc\cdot Xc⋅X.
  • Added hypothesis: QQQ is nonempty. The paper does not write it, and without it the optimal set is empty.
  • Optimal solutions are maximizers in QQQ, not a supremum value. The trade-off coefficient is lam because λ is a Lean keyword; the range λ∈(0,1]\lambda\in(0,1]λ∈(0,1] is kept exactly.
  • A trivializing formalization is ruled out: the weak relation ⪰SSD\succeq_{SSD}⪰SSD​ must not replace the strict relation in SSD-efficiency (every XXX weakly dominates itself), and Γ\GammaΓ must not be a hand-chosen closed form.

Needed infrastructure: quantile functions and the identity ∫01FX(−1)=μX\int_0^1F_X^{(-1)}=\mu_X∫01​FX(−1)​=μX​; the minimum representation of Lemma 3.4; convexity of law-invariant functionals on Lp; weak compactness of bounded closed convex sets in reflexive Lp. Contributions of general lemmas about quantiles and Lorenz curves are welcome and reusable beyond this mission.

Selected references

  • W. Ogryczak, A. Ruszczyński, Dual stochastic dominance and related mean-risk models, SIAM J. Optim. 13(1) (2002) 60–78. https://doi.org/10.1137/S1052623400375075
  • W. Ogryczak, A. Ruszczyński, From stochastic dominance to mean-risk models: semideviations as risk measures, Eur. J. Oper. Res. 116 (1999) 33–50. https://doi.org/10.1016/S0377-2217(98)00167-2
  • S. Yitzhaki, Stochastic dominance, mean variance, and Gini's mean difference, Amer. Econ. Rev. 72 (1982) 178–185. https://www.jstor.org/stable/1808584
10 thms3 active usersReviewed
CombinatoricsDiscrete GeometryOperations Research+1·Captain: Shuze Chen

Discrete Convex Analysis XXI: The Exchange Axiom as Local OptimalityTextbook

Motivation

Convexity on the integer lattice cannot be defined by the classical secant-line inequality alone: a function can be midpoint-convex along every line and still admit no useful global optimality theory, because integer points off a chosen line are invisible to it. M-convex functions, introduced by Murota, resolve this by replacing the secant condition with an exchange axiom directly generalizing the basis-exchange property of matroids and the convex-hull structure of network flows: a function on the integer lattice is M-convex if, whenever two points can be improved by moving one coordinate up and a compensating coordinate down, at least one such move weakly improves the sum of the two function values. This single axiom turns out to be equivalent to several strikingly different-looking properties — invariance under a wide family of domain operations, supermodularity in the M♮ (translation-invariant) case, and, most importantly, a local-to-global optimality principle: a point is a global minimizer of an M-convex function if and only if no single coordinate exchange improves it. This mission develops the algebraic core of that theory — the exchange axiom's basic consequences, its equivalent local and dynamic reformulations, and the operations that preserve it — building toward the theorem that recasts M-convexity itself as an algorithmically meaningful local-search guarantee.

Companion mission 06-mconvex-functions-i (Discrete Convex Analysis V) covers this chapter's own primary line of development: the equivalence of M-convexity and M♮-convexity with their respective exchange axioms (Theorem 6.2), the M-optimality criterion (Theorem 6.26), a minimizer-cut lemma (Theorem 6.28), and the M-proximity theorem (Theorem 6.37, its goal). This mission builds the vocabulary those results also need (redeclared here, since sibling drafts cannot yet import one another) and proves the results that chapter leaves for a second pass: the domain structure of M- and M♮-convex functions, worked examples (quadratic forms, quasi-separable functions), the operations that preserve M-convexity, supermodularity of the M♮-convex case, the descent-direction property, and — this mission's goal — the equivalence of the exchange axiom with a dynamic sequential-improvement property.

Setting

Fix a finite ground set VVV. A function f:ZV→R∪{+∞}f : \mathbb Z^V \to \mathbb R \cup \{+\infty\}f:ZV→R∪{+∞} with nonempty effective domain dom⁡f\operatorname{dom} fdomf is M-convex if it satisfies the exchange axiom (M-EXC[Z]): for x,y∈dom⁡fx, y \in \operatorname{dom} fx,y∈domf and u∈supp⁡+(x−y)u \in \operatorname{supp}^+(x-y)u∈supp+(x−y) (coordinates where xxx exceeds yyy), there is v∈supp⁡−(x−y)v \in \operatorname{supp}^-(x-y)v∈supp−(x−y) with

f(x)+f(y)≥f(x−χu+χv)+f(y+χu−χv).f(x) + f(y) \ge f(x - \chi_u + \chi_v) + f(y + \chi_u - \chi_v).f(x)+f(y)≥f(x−χu​+χv​)+f(y+χu​−χv​).

Writing f~(x0,x)=f(x)\tilde f(x_0, x) = f(x)f~​(x0​,x)=f(x) when x0=−x(V)x_0 = -x(V)x0​=−x(V) and +∞+\infty+∞ otherwise (a lift to one extra coordinate), fff is M♮^\natural♮-convex if f~\tilde ff~​ is M-convex; M♮-convexity is a genuine generalization of M-convexity (every M-convex function is M♮-convex, but not conversely) and coincides with it exactly when dom⁡f\operatorname{dom} fdomf lies on a single hyperplane. The linear-weighted function f[p](x)=f(x)−⟨p,x⟩f[p](x) = f(x) - \langle p, x \ranglef[p](x)=f(x)−⟨p,x⟩ (for p∈RVp \in \mathbb R^Vp∈RV) is the standard device for testing local optimality under an arbitrary reweighting.

Formalization targets

Goal: the exchange axiom as sequential improvement

f is M-convex  ⟺  ∀p∈RV, ∀x,y∈dom⁡f, f[p](x)>f[p](y)  ⟹  f[p](x)>min⁡u∈supp⁡+(x−y) min⁡v∈supp⁡−(x−y)f[p](x−χu+χv),f \text{ is M-convex} \iff \forall p \in \mathbb R^V,\ \forall x, y \in \operatorname{dom} f,\ f[p](x) > f[p](y) \implies f[p](x) > \min_{u \in \operatorname{supp}^+(x-y)}\ \min_{v \in \operatorname{supp}^-(x-y)} f[p](x - \chi_u + \chi_v),f is M-convex⟺∀p∈RV, ∀x,y∈domf, f[p](x)>f[p](y)⟹f[p](x)>u∈supp+(x−y)min​ v∈supp−(x−y)min​f[p](x−χu​+χv​),

with the analogous statement for M♮-convexity (Theorem 6.24). This is the weakest stable form: it makes no reference to a specific algorithm, only to the existence of an improving single exchange whenever the current point is suboptimal under any linear reweighting — a property a faster algorithm could exploit without invalidating the characterization itself.

Supporting structural targets

Eleven further results build the vocabulary and toolkit this goal draws on: the domain structure of M-convex and M♮-convex functions (Propositions 6.1, 6.7), the equivalence of the exchange axiom with a local, bounded-distance version (Theorem 6.4), worked examples establishing M-convexity for quadratic forms, univariate, conservation-law, and quasi-separable functions (Propositions 6.8-6.9), the domain and range operations preserving M-convexity (Theorem 6.13, Proposition 6.14), supermodularity of the M♮-convex case (Theorem 6.19), the descent-direction property (Proposition 6.23) that Theorem 6.24 generalizes, and a discrete subgradient inequality (Proposition 6.25).

Significance

Theorem 6.24 is the bridge between the static exchange axiom (a property of function values at pairs of points) and the dynamic behavior of local-search algorithms: it says a greedy single-coordinate-exchange step, applied to any linearly reweighted version of an M-convex function, always finds a strict improvement when one exists. This is exactly the guarantee that makes steepest-descent-type algorithms for M-convex function minimization correct, and it is the theorem chapter 10's algorithmic analysis (Schrijver-type methods) relies on implicitly whenever it argues that local exchange steps make global progress. The descent-direction property (Proposition 6.23) is the special case p=0p=0p=0, isolating the core combinatorial fact before the reweighting machinery is added. The operations catalog (Theorem 6.13) is the practical toolkit that lets later chapters build complex M-convex functions (network flow costs, matroid rank functions composed with linear maps) from simple pieces without re-verifying the exchange axiom from scratch each time.

None of these results are open — they are Murota's own systematic development of the exchange- axiom theory, with worked examples drawn from classical quadratic and separable function theory. What this mission contributes is a faithful, machine-checked formal statement of each, sharing the Lean vocabulary (MExchangeAxiom, MNaturalConvex, LinearWeight) the rest of the Discrete Convex Analysis series builds on; no comparable formalization exists on the platform (see Formalization scope).

Difficulty

The forward direction of Theorem 6.24 (M-convex   ⟹  \implies⟹ sequential improvement) follows in one step from Proposition 6.23 applied to f[p]f[p]f[p], itself M-convex by Theorem 6.13(3) — routine once those two pieces are in hand. The converse is the substantial direction: it must derive the full static exchange axiom from a property that only ever exhibits some improving exchange at some linear weighting, for every pair of suboptimal points — the proof constructs an explicit adversarial weighting ppp designed so that failure of the local exchange step at that specific ppp forces the domain itself to be M-convex (via Theorem 4.3) and then forces the local exchange axiom (M-EXCloc[Z]) via a bipartite-matching argument on the coordinates that differ, finally invoking Theorem 6.4 to lift locality to the full exchange axiom. No shortcut bypasses this two-stage reduction (domain structure, then local exchange) — attempting to verify (M-EXC[Z]) directly from (M-SI[Z]) without first pinning down that dom⁡f\operatorname{dom} fdomf is M-convex fails because the exchange axiom's own statement presupposes a well-structured domain.

Formalization scope

Ground-set elements are a Fintype V with DecidableEq; functions are (V → ℤ) → WithTop ℝ. SuppPos/SuppNeg are Finset V (not Set V), matching how the (M-SI[Z])/(M♮-SI[Z]) axioms and the descent-direction property use Finset.inf, whose value on an empty index set is ⊤ — exactly the book's own stated convention for an empty minimum. No Module ℝ or ConvexOn machinery is used for WithTop ℝ-valued arithmetic; scalar actions by positive reals (PosScalarMul, Theorem 6.13(1)) and by naturals (FCheck's flow coefficients, Proposition 6.25) are built directly from the native order and AddMonoid structure. No numeric constants are hard-coded anywhere in this mission (rule 7 is vacuous); Proposition 6.8's quadratic-form conditions are stated with the book's own literal coefficients (000, and the min/≥ structure of Eq. (6.25)-(6.28)), not a special case. Theorem 6.13's parts (7) (aggregation) and (8) (integer infimal convolution) are not restated here since the book itself proves them only later via Chapter 9's network-transformation machinery — see the Difficulty note and MODERATION_NOTES.md; this is not a trivializing omission, since the six operations that are included already exercise every domain- and range-transformation technique this mission's goal needs. This mission's definitions (MExchangeAxiom, MNaturalConvex, CharVec, DomZ, SuppPos, SuppNeg, CharVecOpt) are redeclared from chunk 06-mconvex-functions-i rather than imported, since sibling drafts in this series cannot yet reference one another. Contributions completing any of the twelve sorrys are welcome; the goal's converse direction and Theorem 6.13's operations are the two with the most independent proof content.

Selected references

  • K. Murota, Discrete Convex Analysis, SIAM, 2003. DOI: 10.1137/1.9780898718508.
  • K. Murota, "Discrete convex analysis," Mathematical Programming, 83 (1998), pp. 313-371 (the exchange axiom and its equivalent local/dynamic reformulations).
38 thms3 active usersReviewed
🏆Completed
Operations ResearchProbability·Captain: mikedeng1

Star-Shaped Risk Measures 2: law-invariant star-shaped risk measures as robustified Value-at-RiskResearch Paper

Motivation

Financial regulators and risk managers summarise the loss distribution of a position by a single number, the capital that must be held against it. The two standards in practice are Value-at-Risk (VaR), a quantile of the loss, and expected shortfall (ES), an average of the upper quantiles; ES is the standard of the Basel framework. Both depend on the position only through its probability law, a property called law invariance, which is what allows them to be estimated from data.

The axiomatic theory of risk measures, starting with Artzner, Delbaen, Eber and Heath (1999) and Föllmer and Schied (2002), centres on convex risk measures. VaR is not convex, however, and neither are its robust variants used in practice: the maximum or the median of VaR over a set of scenario models, or the benchmark-loss VaR of Bignozzi, Burzoni and Munari (2020). Castagnoli, Cattelan, Maccheroni, Tebaldi and Wang (Operations Research 70(5), 2022) propose star-shapedness as the common property of all of these measures: doubling the exposure to a risky position at least doubles the required capital. Their Section 7 identifies exactly which law-invariant risk measures are star-shaped.

Timeline:

  • 1999: Artzner et al. introduce coherent risk measures and show that ES-type measures dominate VaR (doi:10.1111/1467-9965.00068).
  • 2002: Föllmer and Schied introduce convex risk measures.
  • 2020: Mao and Wang characterise the risk measures consistent with second-order stochastic dominance as infima of ES-based functionals.
  • 2022: Castagnoli et al. prove Theorem 5, the corresponding characterisation of star-shaped law-invariant risk measures through VaR.

Setting

Let (Ω,F,P)(\Omega,\mathcal F,P)(Ω,F,P) be a probability space with PPP atomless: every event of positive probability contains an event of strictly smaller positive probability. A position is a bounded measurable function X:Ω→RX:\Omega\to\mathbb RX:Ω→R, read as a loss: X(ω)>0X(\omega)>0X(ω)>0 is money lost in state ω\omegaω. The positions form a linear space X\mathcal XX that contains the constants and carries the pointwise order X≧YX\geqq YX≧Y.

A risk measure is a function ρ:X→R\rho:\mathcal X\to\mathbb Rρ:X→R that is monotone (X≧Y⇒ρ(X)≥ρ(Y)X\geqq Y\Rightarrow\rho(X)\ge\rho(Y)X≧Y⇒ρ(X)≥ρ(Y)), translation invariant (ρ(X−m)=ρ(X)−m\rho(X-m)=\rho(X)-mρ(X−m)=ρ(X)−m for real mmm) and normalized (ρ(0)=0\rho(0)=0ρ(0)=0). It is star-shaped if ρ(λX)≥λρ(X)\rho(\lambda X)\ge\lambda\rho(X)ρ(λX)≥λρ(X) for all XXX and all λ>1\lambda>1λ>1, and law-invariant if XXX and YYY with the same law under PPP satisfy ρ(X)=ρ(Y)\rho(X)=\rho(Y)ρ(X)=ρ(Y). Its acceptance set is Aρ={X∣ρ(X)≤0}\mathcal A_\rho=\{X\mid\rho(X)\le 0\}Aρ​={X∣ρ(X)≤0}. A set SSS in a vector space is star-shaped if λs∈S\lambda s\in Sλs∈S whenever s∈Ss\in Ss∈S and λ∈[0,1]\lambda\in[0,1]λ∈[0,1].

For α∈(0,1)\alpha\in(0,1)α∈(0,1) the Value-at-Risk of XXX is

VaRα(X)=inf⁡{x∈R:P(X>x)≤1−α}.\mathrm{VaR}_\alpha(X)=\inf\{x\in\mathbb R : P(X>x)\le 1-\alpha\}.VaRα​(X)=inf{x∈R:P(X>x)≤1−α}.

Write FX(x)=P(X≤x)F_X(x)=P(X\le x)FX​(x)=P(X≤x). A loss XXX first-order stochastically dominates YYY, written X≿FSDYX\succsim_{\mathrm{FSD}}YX≿FSD​Y, if FX≥FYF_X\ge F_YFX​≥FY​ pointwise, so XXX is the smaller loss.

Formalization targets

Goal: Theorem 5, (i) ⇔ (ii)

For a function ρ:X→R\rho:\mathcal X\to\mathbb Rρ:X→R the following are equivalent:

  1. ρ\rhoρ is a star-shaped and law-invariant risk measure;
  2. there is a star-shaped set G\mathcal GG of increasing functions g:(0,1)→Rg:(0,1)\to\mathbb Rg:(0,1)→R with g(0+)≤0g(0+)\le 0g(0+)≤0 such that
ρ(X)=inf⁡g∈G sup⁡α∈(0,1) {VaRα(X)−g(α)}X∈X.(25)\rho(X)=\inf_{g\in\mathcal G}\ \sup_{\alpha\in(0,1)}\ \{\mathrm{VaR}_\alpha(X)-g(\alpha)\}\qquad X\in\mathcal X.\tag{25}ρ(X)=g∈Ginf​ α∈(0,1)sup​ {VaRα​(X)−g(α)}X∈X.(25)

The goal fixes neither G\mathcal GG nor any constant. The paper's "Moreover" clause, closure of the class under the operations of Theorem 1, is excluded: its proof is a citation of Liu et al. (2020, Theorem 2) plus "the rest is straightforward".

Milestones

  • Eq. (7): ρ(X)=min⁡{m∈R∣X−m∈Aρ}\rho(X)=\min\{m\in\mathbb R\mid X-m\in\mathcal A_\rho\}ρ(X)=min{m∈R∣X−m∈Aρ​} for every risk measure.
  • Proposition 2: for a risk measure ρ\rhoρ, the following are equivalent: ρ\rhoρ is star-shaped; Aρ\mathcal A_\rhoAρ​ is star-shaped; ρ=ρA\rho=\rho_{\mathcal A}ρ=ρA​ for a star-shaped acceptance set A\mathcal AA.
  • Eq. (A.1): FX≥FYF_X\ge F_YFX​≥FY​ if and only if VaRα(X)≤VaRα(Y)\mathrm{VaR}_\alpha(X)\le\mathrm{VaR}_\alpha(Y)VaRα​(X)≤VaRα​(Y) for all α∈(0,1)\alpha\in(0,1)α∈(0,1).
  • FSD consistency (proof of Theorem 5): if PPP is atomless and ρ\rhoρ is monotone and law-invariant, then X≿FSDY⇒ρ(X)≤ρ(Y)X\succsim_{\mathrm{FSD}}Y\Rightarrow\rho(X)\le\rho(Y)X≿FSD​Y⇒ρ(X)≤ρ(Y).

Significance

Theorem 5 says that the star-shaped law-invariant risk measures are exactly the robustifications of VaR: each benchmark ggg in G\mathcal GG gives a capital requirement sup⁡α{VaRα(X)−g(α)}\sup_\alpha\{\mathrm{VaR}_\alpha(X)-g(\alpha)\}supα​{VaRα​(X)−g(α)}, and ρ\rhoρ takes the most favourable benchmark. The class contains VaR, ES, their scenario-based maxima and the benchmark-loss VaR. The theorem parallels Theorem 4 of the same paper, derived from Mao and Wang (2020), in which ES replaces VaR and SSD-consistency replaces law invariance. Together the two results separate the two classes: VaR is star-shaped and law-invariant but not SSD-consistent. Section 7 also records that star-shaped law-invariant measures are in general not minima of law-invariant convex risk measures, which is why a representation specific to VaR is needed.

On the formal side, the result is proved in the paper; no machine-checked proof is known. The mission yields a Lean library of law-invariant risk measures on bounded measurable positions, a quantile-based Value-at-Risk with its basic order properties, and the FSD-consistency of monotone law-invariant functionals on atomless spaces. That last statement is the probabilistic core that other law-invariant representation theorems reuse.

Difficulty

The direction (ii) ⇒ (i) is a direct computation. The direction (i) ⇒ (ii) rests on FSD consistency. The obvious argument writes X≿FSDYX\succsim_{\mathrm{FSD}}YX≿FSD​Y as X≤YX\le YX≤Y and applies monotonicity, but first-order dominance compares only laws, and two positions ordered in law need not be ordered state by state. One must construct positions with the laws of XXX and YYY that are ordered pointwise, and this uses atomlessness in an essential way: on a space with atoms, the construction can fail. The remaining steps are bookkeeping of extended-real infima and suprema, including levels α\alphaα near 000 where ggg may diverge.

Formalization scope

Positions are the bounded measurable functions Ω→R\Omega\to\mathbb RΩ→R (a Submodule ℝ (Ω → ℝ), definition Positions) with the pointwise order, rather than equivalence classes in L∞(Ω,F,P)L^\infty(\Omega,\mathcal F,P)L∞(Ω,F,P). For a law-invariant ρ\rhoρ the two readings agree: almost surely equal positions have the same law, and a position that dominates another almost surely has a pointwise modification with the same law that dominates it everywhere. Atomlessness is defined locally (IsAtomless), because Mathlib's NoAtoms only states that singletons are null, which is weaker. Law invariance compares push-forward measures P.map X; measurability is part of Positions, so these are never degenerate.

VaR is an sInf of reals and is applied only to bounded positions at levels in (0,1)(0,1)(0,1), where the infimum is over a nonempty set that is bounded below. In (25) each function ggg has domain exactly (0,1)(0,1)(0,1), "increasing" means weakly increasing, and g(0+)≤0g(0+)\le 0g(0+)≤0 is stated as inf⁡α∈(0,1)g(α)≤0\inf_{\alpha\in(0,1)}g(\alpha)\le 0infα∈(0,1)​g(α)≤0 in the extended reals. Both sides of (25) are compared in the extended reals, since the inner supremum can be +∞+\infty+∞. The minimum in Eq. (7) is an attained minimum (IsLeast), and the supremum condition on acceptance sets is a least upper bound (IsLUB).

These choices rule out the trivialising formalizations of (25). A real-valued supremum would read an unbounded supremum as 000. Dropping monotonicity of ggg or the condition g(0+)≤0g(0+)\le 0g(0+)≤0 describes a larger class that includes non-normalized functionals. Allowing G=∅\mathcal G=\emptysetG=∅ is excluded because the left side of (25) is a real number and the right side would be +∞+\infty+∞.

The following are not part of the mission: the "Moreover" clause of Theorem 5, Theorem 4 (its main direction is Mao and Wang 2020, Theorem 3.1), and Proposition 7 (ES as the smallest SSD-consistent risk measure dominating VaRα\mathrm{VaR}_\alphaVaRα​), which would need second-order dominance and ES as additional definitions.

Reusable infrastructure: VaR on bounded measurable functions and its homogeneity and translation properties; the equivalence (A.1); existence of a uniform random variable on an atomless probability space and the quantile coupling it provides. Proofs of these as separate lemmas are welcome.

Selected references

  • E. Castagnoli, G. Cattelan, F. Maccheroni, C. Tebaldi, R. Wang, Star-Shaped Risk Measures, Operations Research 70(5):2637–2654, 2022. https://doi.org/10.1287/opre.2022.2303
  • P. Artzner, F. Delbaen, J.-M. Eber, D. Heath, Coherent Measures of Risk, Mathematical Finance 9(3):203–228, 1999. https://doi.org/10.1111/1467-9965.00068
  • H. Föllmer, A. Schied, Stochastic Finance: An Introduction in Discrete Time, 4th ed., De Gruyter, 2016. https://doi.org/10.1515/9783110463453
  • T. Mao, R. Wang, Risk Aversion in Regulatory Capital Principles, SIAM Journal on Financial Mathematics 11(1):169–200, 2020 (cited as Mao and Wang 2020 in the source paper).
  • V. Bignozzi, M. Burzoni, C. Munari, Risk Measures Based on Benchmark Loss Distributions, Journal of Risk and Insurance, 2020 (cited as Bignozzi et al. 2020 in the source paper).
7 thms3 active usersReviewed
🏆Completed
Operations ResearchOptimization·Captain: mikedeng1

Star-Shaped Risk Measures 1: star-shaped risk measures are the minima of convex risk measuresResearch Paper

Motivation

A risk measure turns the random loss of a financial position into a single number: the amount of capital a regulator or a risk manager requires to hold the position. Two families of risk measures dominate practice and theory. Value-at-Risk (VaR), a quantile of the loss distribution, is used in banking and insurance regulation; it is positively homogeneous but not convex, so it can penalize diversification. Convex risk measures (Föllmer and Schied 2002; Frittelli and Rosazza Gianini 2002), and their positively homogeneous subclass of coherent risk measures (Artzner, Delbaen, Eber and Heath 1999), reward diversification and come with a duality theory, but they exclude VaR and many of its robust variants.

Castagnoli, Cattelan, Maccheroni, Tebaldi and Wang (Operations Research 70(5), 2022) study the class that contains both: star-shaped risk measures, those for which increasing the exposure to a position never decreases the risk per unit of exposure. The class is closed under the aggregation operations used in practice (averages across models, worst cases across scenarios, medians, risk sharing), which convexity is not. It contains VaR, Expected Shortfall, their scenario-based robustifications such as MaxVaR\mathrm{MaxVaR}MaxVaR, the benchmark-loss VaR of Bignozzi et al. (2020), and utility-based shortfall risk for utilities with the Landsberger–Meilijson property.

Timeline. Artzner et al. (1999) axiomatize coherent risk measures. Föllmer and Schied (2002) and Frittelli and Rosazza Gianini (2002) introduce convex ones. Föllmer and Schied (2016, Proposition 4.47) show that VaR is the minimum of the convex risk measures dominating it. Castagnoli et al. (2015) state the representation below without proof. The 2022 paper proves it for every star-shaped risk measure, and shows that the property characterizes the class.

Setting

Fix a set Ω\OmegaΩ of states. The space of positions X\mathcal XX is a linear space of bounded functions X:Ω→RX:\Omega\to\mathbb RX:Ω→R containing every constant function; the constant mmm is identified with the position that pays mmm in every state. A value X(ω)>0X(\omega)>0X(ω)>0 is a loss. No probability measure is fixed. X\mathcal XX is ordered pointwise: X≧YX\geqq YX≧Y means X(ω)≥Y(ω)X(\omega)\ge Y(\omega)X(ω)≥Y(ω) for every ω\omegaω.

A risk measure is a function ρ:X→R\rho:\mathcal X\to\mathbb Rρ:X→R that is monotone (X≧Y⇒ρ(X)≥ρ(Y)X\geqq Y\Rightarrow\rho(X)\ge\rho(Y)X≧Y⇒ρ(X)≥ρ(Y)), translation invariant (ρ(X−m)=ρ(X)−m\rho(X-m)=\rho(X)-mρ(X−m)=ρ(X)−m for all real mmm) and normalized (ρ(0)=0\rho(0)=0ρ(0)=0). It is

  • star-shaped if ρ(λX)≥λρ(X)\rho(\lambda X)\ge\lambda\rho(X)ρ(λX)≥λρ(X) for all XXX and all λ>1\lambda>1λ>1;
  • convex if ρ(λX+(1−λ)Y)≤λρ(X)+(1−λ)ρ(Y)\rho(\lambda X+(1-\lambda)Y)\le\lambda\rho(X)+(1-\lambda)\rho(Y)ρ(λX+(1−λ)Y)≤λρ(X)+(1−λ)ρ(Y) for all X,YX,YX,Y and all λ∈(0,1)\lambda\in(0,1)λ∈(0,1);
  • positively homogeneous if ρ(λX)=λρ(X)\rho(\lambda X)=\lambda\rho(X)ρ(λX)=λρ(X) for all λ>0\lambda>0λ>0;
  • coherent if it is positively homogeneous and subadditive, ρ(X+Y)≤ρ(X)+ρ(Y)\rho(X+Y)\le\rho(X)+\rho(Y)ρ(X+Y)≤ρ(X)+ρ(Y).

The acceptance set of ρ\rhoρ is Aρ={X∈X∣ρ(X)≤0}\mathcal A_\rho=\{X\in\mathcal X\mid\rho(X)\le0\}Aρ​={X∈X∣ρ(X)≤0}. More generally, an acceptance set is a subset A⊆X\mathcal A\subseteq\mathcal XA⊆X with sup⁡{m∈R∣m∈A}=0\sup\{m\in\mathbb R\mid m\in\mathcal A\}=0sup{m∈R∣m∈A}=0 that is closed downwards (X∈AX\in\mathcal AX∈A, Y≦XY\leqq XY≦X imply Y∈AY\in\mathcal AY∈A). It is convex if convex and coherent if a convex cone, and it generates ρA(X)=inf⁡{m∣X−m∈A}\rho_{\mathcal A}(X)=\inf\{m\mid X-m\in\mathcal A\}ρA​(X)=inf{m∣X−m∈A}. A set SSS is star-shaped if λs∈S\lambda s\in Sλs∈S for all s∈Ss\in Ss∈S and λ∈[0,1]\lambda\in[0,1]λ∈[0,1].

In the Lean development the space of positions is PositionSpace Ω, positions are elements of 𝒳.carrier, and the predicates are IsRiskMeasure, IsStarShaped, IsConvexRiskMeasure, IsCoherentRiskMeasure, acceptanceSet, IsAcceptanceSet, IsConvexAcceptanceSet.

Formalization targets

Goal: Theorem 2 (p. 2643)

For a risk measure ρ\rhoρ, the following are equivalent:

  1. ρ\rhoρ is star-shaped;
  2. there is a set Γ\GammaΓ of convex risk measures with
ρ(X)=min⁡γ∈Γγ(X)for all X∈X;\rho(X)=\min_{\gamma\in\Gamma}\gamma(X)\qquad\text{for all }X\in\mathcal X;ρ(X)=γ∈Γmin​γ(X)for all X∈X;
  1. there is a family {Aβ}β∈B\{\mathcal A_\beta\}_{\beta\in B}{Aβ​}β∈B​ of convex acceptance sets with
ρ(X)=min⁡{m∈R∣X−m∈Aβ for some β∈B}for all X∈X.\rho(X)=\min\{m\in\mathbb R\mid X-m\in\mathcal A_\beta\text{ for some }\beta\in B\}\qquad\text{for all }X\in\mathcal X.ρ(X)=min{m∈R∣X−m∈Aβ​ for some β∈B}for all X∈X.

Moreover, for star-shaped ρ\rhoρ, Γ\GammaΓ may be taken to be the set of all convex risk measures γ≧ρ\gamma\geqq\rhoγ≧ρ, and the family to be their acceptance sets. The minima are attained. The goal fixes no particular Ω\OmegaΩ, X\mathcal XX or Γ\GammaΓ.

Milestones

  • Proposition 1 (p. 2642): star-shapedness is equivalent to ρ(αX)≤αρ(X)\rho(\alpha X)\le\alpha\rho(X)ρ(αX)≤αρ(X) for α∈(0,1)\alpha\in(0,1)α∈(0,1), and to the risk-to-exposure ratio β↦ρ(βX)/β\beta\mapsto\rho(\beta X)/\betaβ↦ρ(βX)/β being increasing on (0,∞)(0,\infty)(0,∞).
  • Eq. (7) (p. 2642): ρ(X)=min⁡{m∣X−m∈Aρ}\rho(X)=\min\{m\mid X-m\in\mathcal A_\rho\}ρ(X)=min{m∣X−m∈Aρ​}.
  • Proposition 2 (p. 2642): ρ\rhoρ is star-shaped iff Aρ\mathcal A_\rhoAρ​ is star-shaped iff ρ=ρA\rho=\rho_{\mathcal A}ρ=ρA​ for a star-shaped acceptance set A\mathcal AA.
  • Theorem 1 (p. 2643), in four parts: the infimum, supremum, μ\muμ-average and inf-convolution of star-shaped risk measures are star-shaped risk measures.
  • Proposition 3 (p. 2642): for subadditive risk measures, star-shaped, positively homogeneous and convex coincide.
  • Theorem 2, positively homogeneous case: the same equivalence with "positively homogeneous", "coherent risk measures" and "coherent acceptance sets".
  • Corollary 1 (p. 2645): inf⁡X∈Yρ(X)=inf⁡γ∈Γinf⁡X∈Yγ(X)\inf_{X\in\mathcal Y}\rho(X)=\inf_{\gamma\in\Gamma}\inf_{X\in\mathcal Y}\gamma(X)infX∈Y​ρ(X)=infγ∈Γ​infX∈Y​γ(X) for any Y⊆X\mathcal Y\subseteq\mathcal XY⊆X.

Significance

Theorem 2 identifies star-shaped risk measures as exactly the lower envelopes of convex risk measures. Consequences drawn in the paper: minimizing a star-shaped risk measure over a set of positions reduces to a family of convex risk-minimization problems (Corollary 1, Proposition 6), each convex risk measure in the envelope carries its dual representation (Proposition 5), and VaR-type measures inherit a tractable structure without being convex. The positively homogeneous case gives the analogous statement for VaR-like measures in terms of coherent ones, generalizing Föllmer–Schied Proposition 4.47.

The paper proves these results; the mission adds a machine-checked proof on a general space of bounded positions, with the attainment of every minimum made explicit. No formalization of star-shaped risk measures is known to exist. The platform mission Coherent Measures of Risk formalizes the Artzner et al. axioms on finitely many states with a gain convention; its definitions are not reused here. The definitions of this mission (risk measures on a space of bounded functions, acceptance sets, the aggregation operations) are reusable by any later development of monetary risk measures without a reference probability.

Difficulty

The equivalence (2)⇔(3) and the direction (2)⇒(1) reduce to closure properties of the class; the content is (1)⇒(2) together with the "Moreover" clause. The obvious first idea, taking the convex hull or convex envelope of ρ\rhoρ or of Aρ\mathcal A_\rhoAρ​, fails: the convex hull of Aρ\mathcal A_\rhoAρ​ generates a convex risk measure below ρ\rhoρ, not above it, and a single convex risk measure cannot equal a non-convex ρ\rhoρ. What is needed is, for each position, a convex risk measure that dominates ρ\rhoρ everywhere and touches it at that position, and it must be monotone, translation invariant and normalized, not merely a convex functional. Attainment of the minimum, rather than an infimum, is part of the claim.

Formalization scope

  • X\mathcal XX is any Submodule ℝ (Ω → ℝ) containing the constants whose elements are bounded, bundled as PositionSpace Ω. It is not specialised to all bounded functions, and no measurability or probability is imposed; positive values are losses.
  • "min" is always IsLeast (attained). The acceptance-set axiom sup⁡{m∣m∈A}=0\sup\{m\mid m\in\mathcal A\}=0sup{m∣m∈A}=0 is IsLUB, not sSup … = 0. ρA\rho_{\mathcal A}ρA​ uses the real sInf, which is genuine for acceptance sets on bounded positions.
  • Every γ∈Γ\gamma\in\Gammaγ∈Γ is a full risk measure: monotone, translation invariant, normalized and convex. A representation of ρ\rhoρ as a minimum of arbitrary, non-normalized convex functionals holds for every monotone translation-invariant map and is not this theorem; such a formalization is ruled out.
  • The family in (3) is a set of subsets of X\mathcal XX, with no finiteness or nonemptiness assumption.
  • A coherent acceptance set is convex and closed under multiplication by every t>0t>0t>0.
  • Theorem 1 adds the hypotheses the page leaves implicit: a nonempty index set for supremum and infimum; the power-set σ-algebra and a countably additive probability measure for the average (the paper's proof also covers capacities with Choquet integrals, which are not stated here); n≥1n\ge1n≥1 and the normality condition (10) for the inf-convolution.
  • Corollary 1 computes infima in the extended reals, so the set Y\mathcal YY may be empty and the infima may be −∞-\infty−∞.

Contributions welcome: proofs of any milestone, and in particular general lemmas on risk measures on a space of bounded functions (the bounds inf⁡X≤ρ(X)≤sup⁡X\inf X\le\rho(X)\le\sup XinfX≤ρ(X)≤supX, properties of ρA\rho_{\mathcal A}ρA​, convexity of ρA\rho_{\mathcal A}ρA​ for convex A\mathcal AA), which are reusable across risk-measure missions.

Selected references

  • E. Castagnoli, G. Cattelan, F. Maccheroni, C. Tebaldi, R. Wang, Star-Shaped Risk Measures, Operations Research 70(5):2637–2654, 2022. https://doi.org/10.1287/opre.2022.2303
  • P. Artzner, F. Delbaen, J.-M. Eber, D. Heath, Coherent Measures of Risk, Mathematical Finance 9(3):203–228, 1999. https://doi.org/10.1111/1467-9965.00068
  • H. Föllmer, A. Schied, Convex measures of risk and trading constraints, Finance and Stochastics 6(4):429–447, 2002. https://doi.org/10.1007/s007800200072
  • M. Frittelli, E. Rosazza Gianin, Putting order in risk measures, Journal of Banking & Finance 26(7):1473–1486, 2002. https://doi.org/10.1016/S0378-4266(02)00270-4
  • H. Föllmer, A. Schied, Stochastic Finance: An Introduction in Discrete Time, 4th ed., De Gruyter, 2016. https://doi.org/10.1515/9783110463453
14 thms3 active usersReviewed
🏆Completed
CombinatoricsDiscrete GeometryOperations Research+1·Captain: Shuze Chen

Discrete Convex Analysis XX: Integral Convexity of L-Convex SetsTextbook

Motivation

Shortest-path distances and network potentials are among the oldest objects in combinatorial optimization: a directed graph with arc lengths, its shortest-path distances, and the "feasible potentials" (vertex labels consistent with those lengths) underlie duality in min-cost flow, scheduling, and difference-constraint systems. Murota's Discrete Convex Analysis (SIAM, 2003) isolates the abstract structure behind these objects — distance functions satisfying the triangle inequality, and their associated sets of admissible potentials — and shows it is governed by exactly the same discrete-convexity machinery as submodular set functions: a one-to-one correspondence with a second family of well-behaved integer point sets, the L-convex sets. Where an M-convex set (chapter 4) is defined by an exchange axiom generalizing matroid base exchange, an L-convex set is defined by closure under coordinatewise lattice operations (∨, ∧) and translation by the all-ones vector — a genuinely different axiom system that nonetheless produces a parallel structural theory: hole-freeness, a polyhedral description via an induced distance function, and integral convexity.

Companion mission 05-lconvex-sets (Discrete Convex Analysis IV) covers this chapter's other half: the hole-free property (Theorem 5.2), the one-to-one correspondence between L-convex sets and integer-valued triangle-inequality distance functions (Theorem 5.5), the intersection properties (Theorem 5.7), and the chapter's discrete separation theorem (Theorem 5.9, its goal). This mission builds the vocabulary those results also need (redeclared here, since sibling drafts cannot yet import one another) and proves the results the chapter leaves for its second half: the fundamental facts connecting a distance function to its admissible potentials (Proposition 5.1), the two-way polyhedral correspondence's supporting propositions (5.3-5.4), Minkowski-sum convexity (Theorem 5.8), and — this mission's goal — the explicit description of an L-convex set's convex hull that establishes its integral convexity (Theorem 5.10).

Setting

Fix a finite ground set VVV. A distance function is a map γ:V×V→R∪{+∞}\gamma : V \times V \to \mathbb R \cup \{+\infty\}γ:V×V→R∪{+∞} with γ(v,v)=0\gamma(v,v) = 0γ(v,v)=0; it may take negative finite values and need not be symmetric. It defines a directed graph Gγ=(V,Aγ)G_\gamma = (V, A_\gamma)Gγ​=(V,Aγ​) with Aγ={(u,v):γ(u,v)<+∞}A_\gamma = \{(u,v) : \gamma(u,v) < +\infty\}Aγ​={(u,v):γ(u,v)<+∞}, arc (u,v)(u,v)(u,v) having length γ(u,v)\gamma(u,v)γ(u,v). Write γˉ(u,v)\bar\gamma(u,v)γˉ​(u,v) for the shortest-path length from uuu to vvv in GγG_\gammaGγ​ (+∞+\infty+∞ if none exists); γ\gammaγ is well defined (γˉ\bar\gammaγˉ​ finite-valued wherever a path exists) exactly when GγG_\gammaGγ​ has no negative cycle. The triangle inequality γ(v1,v2)+γ(v2,v3)≥γ(v1,v3)\gamma(v_1,v_2) + \gamma(v_2,v_3) \ge \gamma(v_1,v_3)γ(v1​,v2​)+γ(v2​,v3​)≥γ(v1​,v3​) defines the class T[R]T[\mathbb R]T[R] (or T[Z]T[\mathbb Z]T[Z] when integer-valued). A vector p∈RVp \in \mathbb R^Vp∈RV is an admissible potential of γ\gammaγ if p(v)−p(u)≤γ(u,v)p(v) - p(u) \le \gamma(u,v)p(v)−p(u)≤γ(u,v) for all u≠vu \ne vu=v; write D(γ)D(\gamma)D(γ) for the set of all such potentials.

A nonempty set D⊆ZVD \subseteq \mathbb Z^VD⊆ZV is L-convex if it satisfies (SBS[Z]): p,q∈D  ⟹  p∨q, p∧q∈Dp, q \in D \implies p \vee q,\ p \wedge q \in Dp,q∈D⟹p∨q, p∧q∈D (coordinatewise max/min), and (TRS[Z]): p∈D  ⟹  p±1∈Dp \in D \implies p \pm \mathbf 1 \in Dp∈D⟹p±1∈D. A set S⊆ZVS \subseteq \mathbb Z^VS⊆ZV is integrally convex if every point of its convex hull S‾\overline SS lies in the convex hull of SSS restricted to that point's integral neighborhood N(p)={y∈ZV:⌊p⌋≤y≤⌈p⌉ coordinatewise}N(p) = \{y \in \mathbb Z^V : \lfloor p \rfloor \le y \le \lceil p \rceil\text{ coordinatewise}\}N(p)={y∈ZV:⌊p⌋≤y≤⌈p⌉ coordinatewise} — a strong, local form of "no holes" saying every real point of the hull is explained by nearby integer points alone.

Formalization targets

Goal: integral convexity of L-convex sets

For an L-convex set D⊆ZVD \subseteq \mathbb Z^VD⊆ZV, writing a=p−⌊p⌋a = p - \lfloor p \rfloora=p−⌊p⌋ for the fractional part of p∈RVp \in \mathbb R^Vp∈RV, α1>⋯>αm\alpha_1 > \cdots > \alpha_mα1​>⋯>αm​ for the distinct nonzero values of aaa, and Ui(p)={v:a(v)≥αi}U_i(p) = \{v : a(v) \ge \alpha_i\}Ui​(p)={v:a(v)≥αi​} (with U0=∅U_0 = \emptysetU0​=∅):

D‾={p∈RV:⌊p⌋+χUi(p)∈D  (i=0,1,…,m)},hence D is integrally convex.\overline D = \{p \in \mathbb R^V : \lfloor p \rfloor + \chi_{U_i(p)} \in D\ \ (i = 0, 1, \ldots, m)\}, \qquad \text{hence } D \text{ is integrally convex}.D={p∈RV:⌊p⌋+χUi​(p)​∈D  (i=0,1,…,m)},hence D is integrally convex.

This is the weakest stable form available: it exhibits an explicit, finite set of at most ∣V∣+1|V|+1∣V∣+1 integer witnesses for every point of the hull, which is what "integrally convex" asserts abstractly, rather than a numerical bound that a sharper construction could later shrink.

Supporting structural targets

Four further results build the correspondence this goal uses: the basic duality between a distance function's admissible potentials, its shortest-path closure, and negative-cycle freedom (Prop. 5.1); the induced-distance-function construction recovering a triangle-inequality distance function from any integer point set, and the convex hull of an L-convex set as its associated polyhedron (Prop. 5.3); the converse construction recovering an L-convex set from an integer-valued distance function (Prop. 5.4); and convexity in Minkowski sum (Thm. 5.8).

Significance

Theorem 5.10 is what makes "L-convex" a genuinely convex-analytic notion rather than a combinatorial curiosity: it shows the convex hull of an L-convex set is not merely a polyhedron (already known from the chapter's polyhedral-description results) but one with the strongest local integrality property discrete convex analysis considers, integral convexity — every real point's hull membership is certified by a small, explicitly constructed set of nearby lattice points, uniformly across the whole set. This is the L-convex counterpart of the corresponding M-convex fact (chapter 4's Theorem 4.24) and is used later in the book wherever L-convex functions (chapter 7) need their epigraphs' local structure. Proposition 5.1 is the combinatorial engine underneath: it is exactly the LP-duality statement between shortest paths and feasible potentials that appears, in various guises, throughout network flow theory, made precise here as the base case the L-convex correspondence rests on.

None of these results are open — Murota presents them as, in his own words, "fundamental facts well known in network flow theory" (Proposition 5.1) systematized into the discrete convex analysis framework. What this mission contributes is a faithful, machine-checked formal statement of each, in the shared Lean vocabulary (LConvexSet, AdmissiblePotentials, ShortestDist) the rest of the Discrete Convex Analysis series can build on; no comparable formalization exists on the platform (see Formalization scope).

Difficulty

The shortest-path closure γˉ\bar\gammaγˉ​ is not a bookkeeping convenience but genuinely graph-theoretic content: proving Proposition 5.1 requires constructing an admissible potential from a shortest-path labeling and, conversely, deriving the negative-cycle-freeness of GγG_\gammaGγ​ from the mere existence of one admissible potential — a min-cost-flow-style LP duality argument, not a direct combinatorial check. Theorem 5.10's difficulty sits in a different place: the naive approach to "DDD is integrally convex" would attempt an inductive argument peeling off one coordinate at a time, but the actual proof constructs a single, uniform family of m+1m+1m+1 witness points from the sorted fractional values of ppp — a Carathéodory-style representation (Eq. (5.11)) that must simultaneously stay inside the integral neighborhood N(p)N(p)N(p) and land in DDD itself via the triangle inequality of DDD's induced distance function, a construction with no one-coordinate-at-a-time shortcut.

Formalization scope

Ground-set elements are a Fintype V with DecidableEq; L-convex sets are Set (V → ℤ); distance functions are V → V → WithTop ℝ; admissible-potential sets are Set (V → ℝ). The shortest-path closure is formalized directly from finite walks (Fin (k+1) → V) rather than via a graph-library shortest-path predicate, matching the book's own construction. The Eq. (5.11) witnesses are built exactly as the book describes them — sorted distinct nonzero fractional values and their level sets — mirroring the Lovász-extension construction of the companion mission 20-ch04b-mconvexsets. No numeric constants are hard-coded anywhere in this mission (rule 7 is vacuous). The goal's explicit witness set (at most ∣V∣+1|V|+1∣V∣+1 points) is not a trivializing special case: it holds for every L-convex set and every point of its hull, with no extra hypothesis narrowing the class. This mission's definitions (LConvexSet, AdmissiblePotentials, DistanceFunction, IsIntegrallyConvex) are redeclared from chunk 05-lconvex-sets (and, for IsIntegrallyConvex/IntegralNeighborhood, from chapter 3's own definitions) rather than imported, since sibling drafts in this series cannot yet reference one another; a later, published version of this book's namespace should consolidate them. Contributions completing any of the five sorrys are welcome; Proposition 5.1's LP-duality argument and the goal's Carathéodory-style construction are the two with the most independent proof content.

Selected references

  • K. Murota, Discrete Convex Analysis, SIAM, 2003. DOI: 10.1137/1.9780898718508.
  • A. J. Hoffman, "On abstract dual linear programs," Naval Research Logistics Quarterly, 10 (1963), pp. 369-373 (feasible-potential duality in network flow theory).
23 thms3 active usersReviewed
CombinatoricsDiscrete GeometryOperations Research+1·Captain: Shuze Chen

Discrete Convex Analysis XIX: Discrete Separation for M-Convex SetsTextbook

Motivation

Submodular set functions are the combinatorial stand-in for convexity: a function ρ:2V→R\rho : 2^V \to \mathbb Rρ:2V→R on the subsets of a finite ground set VVV is submodular if ρ(X)+ρ(Y)≥ρ(X∪Y)+ρ(X∩Y)\rho(X) + \rho(Y) \ge \rho(X \cup Y) + \rho(X \cap Y)ρ(X)+ρ(Y)≥ρ(X∪Y)+ρ(X∩Y), and this single diminishing-returns inequality drives an enormous range of combinatorial optimization — matroid rank functions, graph cut capacities, entropy, coverage functions, and the max-flow min-cut theorem all arise as special or dual cases (Edmonds 1970; Lovász 1983; Fujishige 2005). M-convex sets are the "vector" incarnation of the same idea: subsets BBB of ZV\mathbb Z^VZV satisfying an exchange axiom that generalizes the basis-exchange property of matroids to sets of integer points lying on a common hyperplane. Murota's Discrete Convex Analysis (SIAM, 2003) develops both sides of this correspondence and proves they coincide exactly: M-convex sets are precisely the integer points of the base polyhedra of integer-valued submodular functions. This mission covers the second half of that development — the structural theory (integrality, holes, Minkowski sums) that turns the correspondence into a working calculus, and its capstone, a discrete separation theorem for two disjoint M-convex sets whose separating hyperplane is forced to have {0,1}\{0,1\}{0,1}- or {0,−1}\{0,-1\}{0,−1}-valued coefficients.

Companion mission 04-mconvex-sets (Discrete Convex Analysis III) covers the same chapter's foundational results: the equivalence of the exchange-axiom variants, the one-to-one correspondence between M-convex sets and integer submodular functions (Theorem 4.15), Edmonds's intersection theorem (Theorem 4.18), and Frank's discrete separation theorem for submodular/ supermodular pairs (Theorem 4.17). This mission builds on that vocabulary (redeclared here, since draft missions in the same series cannot yet import one another) and proves the results the chapter leaves for its second half.

Setting

Fix a finite ground set VVV. A vector x∈ZVx \in \mathbb Z^Vx∈ZV assigns an integer x(v)x(v)x(v) to each v∈Vv \in Vv∈V; write x(X)=∑v∈Xx(v)x(X) = \sum_{v \in X} x(v)x(X)=∑v∈X​x(v) for X⊆VX \subseteq VX⊆V. For x,y∈ZVx, y \in \mathbb Z^Vx,y∈ZV, the positive support supp⁡+(x−y)={v:x(v)>y(v)}\operatorname{supp}^+(x-y) = \{v : x(v) > y(v)\}supp+(x−y)={v:x(v)>y(v)} and negative support supp⁡−(x−y)={v:x(v)<y(v)}\operatorname{supp}^-(x-y) = \{v : x(v) < y(v)\}supp−(x−y)={v:x(v)<y(v)} record where xxx exceeds, and falls short of, yyy. A nonempty set B⊆ZVB \subseteq \mathbb Z^VB⊆ZV is M-convex if it satisfies the exchange axiom (B-EXC[Z]): for all x,y∈Bx, y \in Bx,y∈B and u∈supp⁡+(x−y)u \in \operatorname{supp}^+(x-y)u∈supp+(x−y), some v∈supp⁡−(x−y)v \in \operatorname{supp}^-(x-y)v∈supp−(x−y) has both x−χu+χv∈Bx - \chi_u + \chi_v \in Bx−χu​+χv​∈B and y+χu−χv∈By + \chi_u - \chi_v \in By+χu​−χv​∈B, where χu\chi_uχu​ is the characteristic vector of uuu.

A set function ρ:2V→R∪{+∞}\rho : 2^V \to \mathbb R \cup \{+\infty\}ρ:2V→R∪{+∞} with ρ(∅)=0\rho(\emptyset) = 0ρ(∅)=0 and ρ(V)<+∞\rho(V) < +\inftyρ(V)<+∞ is submodular (the class S[R]S[\mathbb R]S[R], or S[Z]S[\mathbb Z]S[Z] when integer-valued) if ρ(X)+ρ(Y)≥ρ(X∪Y)+ρ(X∩Y)\rho(X) + \rho(Y) \ge \rho(X \cup Y) + \rho(X \cap Y)ρ(X)+ρ(Y)≥ρ(X∪Y)+ρ(X∩Y) for all X,YX, YX,Y. Its base polyhedron is B(ρ)={x∈RV:x(X)≤ρ(X) (∀X), x(V)=ρ(V)}B(\rho) = \{x \in \mathbb R^V : x(X) \le \rho(X)\ (\forall X),\ x(V) = \rho(V)\}B(ρ)={x∈RV:x(X)≤ρ(X) (∀X), x(V)=ρ(V)}. The Lovász extension ρ^:RV→R∪{±∞}\hat\rho : \mathbb R^V \to \mathbb R \cup \{\pm\infty\}ρ^​:RV→R∪{±∞} linearly interpolates ρ\rhoρ off {0,1}V\{0,1\}^V{0,1}V: sorting the distinct values of p∈RVp \in \mathbb R^Vp∈RV as p^1>⋯>p^m\hat p_1 > \cdots > \hat p_mp^​1​>⋯>p^​m​ and setting Ui={v:p(v)≥p^i}U_i = \{v : p(v) \ge \hat p_i\}Ui​={v:p(v)≥p^​i​}, it is ρ^(p)=∑i=1m−1(p^i−p^i+1)ρ(Ui)+p^mρ(Um)\hat\rho(p) = \sum_{i=1}^{m-1}(\hat p_i - \hat p_{i+1})\rho(U_i) + \hat p_m \rho(U_m)ρ^​(p)=∑i=1m−1​(p^​i​−p^​i+1​)ρ(Ui​)+p^​m​ρ(Um​).

Formalization targets

Goal: discrete separation for M-convex sets

B1∩B2=∅  ⟹  ∃ p∗∈{0,1}V∪{0,−1}V,inf⁡x∈B1⟨p∗,x⟩−sup⁡x∈B2⟨p∗,x⟩≥1,B_1 \cap B_2 = \emptyset \implies \exists\, p^* \in \{0,1\}^V \cup \{0,-1\}^V,\quad \inf_{x \in B_1}\langle p^*, x\rangle - \sup_{x \in B_2}\langle p^*, x\rangle \ge 1,B1​∩B2​=∅⟹∃p∗∈{0,1}V∪{0,−1}V,x∈B1​inf​⟨p∗,x⟩−x∈B2​sup​⟨p∗,x⟩≥1,

for M-convex sets B1,B2⊆ZVB_1, B_2 \subseteq \mathbb Z^VB1​,B2​⊆ZV (Theorem 4.21). This is the weakest stable form of the result — it asserts only the existence of a combinatorially special separator, not any bound tied to ∣V∣|V|∣V∣ or a particular construction, so it is not invalidated by a sharper algorithm for finding p∗p^*p∗.

Supporting structural targets

Eleven further results build the calculus this goal rests on: the hyperplane property of M-convex sets (Prop. 4.1), an equivalent one-sided exchange axiom (Prop. 4.2), nonemptiness and the support-function identity for B(ρ)B(\rho)B(ρ) (Props. 4.4-4.5), integrality of B(ρ)B(\rho)B(ρ) for integer-valued ρ\rhoρ (Prop. 4.6), the hole-free property identifying an M-convex set with the integer points of its own convex hull (Thm. 4.12), the two-way polyhedral description of M-convex sets via induced submodular functions (Props. 4.13-4.14), the equivalence of submodularity with convexity of the Lovász extension (Thm. 4.16, due to Lovász), integrality of the intersection of M-convex sets (Thm. 4.22), and Minkowski-sum identities for base polyhedra and M-convex sets (Thm. 4.23).

Significance

The discrete separation theorem is what makes M-convexity discrete rather than merely a polyhedral fact: ordinary separation of two disjoint convex sets by a hyperplane is classical, but here the separator is forced into {0,1}V∪{0,−1}V\{0,1\}^V \cup \{0,-1\}^V{0,1}V∪{0,−1}V — a purely combinatorial object — with no loss of strength. This is the mechanism behind integrality results across combinatorial optimization (e.g., that the intersection of two integral base polyhedra is integral, Theorem 4.22, used pervasively in matroid intersection and submodular flow algorithms). The structural results (holes, Minkowski sums, the Lovász-extension convexity equivalence) are the working toolkit every later use of M-convexity in the book — proximity theorems for M-convex functions (chunks 06+), the discrete conjugacy theorem, submodular flows — draws on without restating.

None of these results are open: Murota attributes the exchange-axiom theory to the matroid and submodular-function literature it systematizes, citing Edmonds, Frank, and Lovász by name for the specific theorems. What this mission produces is a machine-checked formal statement of each result exactly as the book states it, in a shared Lean vocabulary (ExchangeAxiomB, BasePolyhedron, LovaszExtension) that the rest of the Discrete Convex Analysis series builds on; no result here has a prior formalization on the platform (see Formalization scope).

Difficulty

The separation theorem is not proved by convex separation directly — the whole point is that the naive proof (apply the ordinary hyperplane separation theorem to the convex hulls of B1,B2B_1, B_2B1​,B2​, then argue the separator can be taken {0,1}\{0,1\}{0,1}-valued) does not go through, because convex separation alone gives no control over the separator's coefficients. The book instead derives it from Edmonds's intersection theorem (Theorem 4.18, chunk 04-mconvex-sets) applied to a submodular/supermodular pair built from B1,B2B_1, B_2B1​,B2​'s associated set functions (Theorem 4.15), routed through Frank's discrete separation theorem (Theorem 4.17) — a genuine two-step reduction, not a direct argument. A second, independent difficulty sits in the supporting results: the hole-free property (Theorem 4.12) requires an explicit induction reducing an arbitrary convex combination representing an integer point to a single element of BBB, a combinatorial exchange argument with no shortcut through general polyhedral theory.

Formalization scope

Ground-set elements are a Fintype V with DecidableEq; M-convex sets are Set (V → ℤ); submodular/supermodular functions are Finset V → WithTop ℝ / WithBot ℝ; base polyhedra are Set (V → ℝ). The Lovász extension is formalized directly from the book's own sorted-values construction (SortedValues, LevelSet, Eq. (4.4)-(4.6)), not via an equivalent closed form. Since WithTop ℝ carries no Module ℝ structure, convexity for Theorem 4.16 is stated via a bespoke nonnegative-scalar action (ScalarWithTop) rather than Mathlib's ConvexOn — this changes no mathematical content, only its packaging (see MODERATION_NOTES.md). No numeric constants are hard-coded anywhere in this mission (rule 7 is vacuous). The goal's hypothesis (ExchangeAxiomB plus Nonempty on each BiB_iBi​) is exactly the book's own definition of M-convexity — no weaker substitute (e.g. requiring a specific ρ\rhoρ witness in the hypothesis rather than deriving one, or dropping the {0,1}/{0,−1}\{0,1\}/\{0,-1\}{0,1}/{0,−1} constraint on p∗p^*p∗ in favor of a generic separator) would be faithful, and both trivializations are ruled out by construction. This mission's definitions (ExchangeAxiomB, BasePolyhedron, SubmodularSetFunction, LovaszExtension) are redeclared from chunk 04-mconvex-sets rather than imported, since sibling drafts in this series cannot yet reference one another; a later, published version of this book's namespace should consolidate them. Contributions completing any of the twelve sorrys are welcome; the hole-free property (Theorem 4.12) and the goal are the two with the most independent proof content.

Selected references

  • K. Murota, Discrete Convex Analysis, SIAM, 2003. DOI: 10.1137/1.9780898718508.
  • J. Edmonds, "Submodular functions, matroids, and certain polyhedra," in Combinatorial Structures and Their Applications, 1970, pp. 69-87.
  • A. Frank, "An algorithm for submodular functions on graphs," Annals of Discrete Mathematics, 16 (1982), pp. 97-120.
  • L. Lovász, "Submodular functions and convexity," in Mathematical Programming: The State of the Art, Springer, 1983, pp. 235-257.
29 thms3 active usersReviewed
Discrete GeometryOperations ResearchOptimization·Captain: Shuze Chen

Discrete Convex Analysis XVIII: Integral Convexity of Minimizer SetsTextbook

Motivation

A classical convex function's global minimality is equivalent to its local minimality — the single fact that makes convex optimization tractable, since checking a small neighborhood suffices to certify a global guarantee. The discrete analogue is not automatic: a function on the integer lattice can fail to have any well-behaved "local" notion at all, and even when a discrete convexity-like property is imposed, the naive candidate (a function's values agreeing with its own convex-hull interpolation) does not by itself guarantee that local optimality implies global optimality. Murota's Discrete Convex Analysis (SIAM, 2003) isolates exactly the extra condition — integral convexity — that restores this guarantee, and shows it is general enough to contain every other discrete convexity notion the book studies (M-convex, L-convex, and their variants), making it the common ancestor of the book's entire hierarchy of classes. This mission completes the chapter's account of integral convexity: how it behaves under sums, restrictions, and linear perturbations, how it transfers between a function and its domain or minimizer sets, and a companion fact about hole-freeness under intersection and Minkowski sums that motivates why integral convexity, not mere hole-freeness, is the right notion to use.

Setting

For f:Zn→R∪{+∞}f : \mathbb Z^n \to \mathbb R \cup \{+\infty\}f:Zn→R∪{+∞} with nonempty effective domain dom⁡Zf\operatorname{dom}_{\mathbb Z} fdomZ​f, the convex closure is fˉ(x)=sup⁡p,α{⟨p,x⟩+α:⟨p,y⟩+α≤f(y) ∀y∈Zn}\bar f(x) = \sup_{p,\alpha} \{\langle p,x\rangle + \alpha : \langle p,y\rangle+\alpha \le f(y)\ \forall y \in \mathbb Z^n\}fˉ​(x)=supp,α​{⟨p,x⟩+α:⟨p,y⟩+α≤f(y) ∀y∈Zn}. The integral neighborhood of x∈Rnx \in \mathbb R^nx∈Rn is N(x)={y∈Zn:⌊xi⌋≤yi≤⌈xi⌉}N(x) = \{y \in \mathbb Z^n : \lfloor x_i \rfloor \le y_i \le \lceil x_i \rceil\}N(x)={y∈Zn:⌊xi​⌋≤yi​≤⌈xi​⌉}, and the local convex extension f~\tilde ff~​ replaces "for all y∈Zny \in \mathbb Z^ny∈Zn" in fˉ\bar ffˉ​'s definition with "for all y∈N(x)y \in N(x)y∈N(x)". A function is integrally convex if f~=fˉ\tilde f = \bar ff~​=fˉ​ everywhere on Rn\mathbb R^nRn. A set S⊆ZnS \subseteq \mathbb Z^nS⊆Zn is integrally convex if its indicator function is; it is hole free if S=Sˉ∩ZnS = \bar S \cap \mathbb Z^nS=Sˉ∩Zn, where Sˉ\bar SSˉ is the real convex hull of SSS. The discrete Minkowski sum is S1+S2={x1+x2:x1∈S1,x2∈S2}S_1+S_2 = \{x_1+x_2 : x_1 \in S_1, x_2 \in S_2\}S1​+S2​={x1​+x2​:x1​∈S1​,x2​∈S2​}. A function is separable convex if f(x)=∑ifi(x(i))f(x) = \sum_i f_i(x(i))f(x)=∑i​fi​(x(i)) for univariate functions fif_ifi​ satisfying the discrete convexity inequality fi(t−1)+fi(t+1)≥2fi(t)f_i(t-1)+f_i(t+1) \ge 2f_i(t)fi​(t−1)+fi​(t+1)≥2fi​(t). For p∈Rnp \in \mathbb R^np∈Rn, f[−p](x)=f(x)−⟨p,x⟩f[-p] (x) = f(x) - \langle p,x \ranglef[−p](x)=f(x)−⟨p,x⟩ and arg⁡min⁡f[−p]\arg\min f[-p]argminf[−p] is its minimizer set.

Formalization targets

Goal (Theorem 3.29). For fff with nonempty bounded effective domain,

f is integrally convex  ⟺  arg⁡min⁡f[−p] is an integrally convex set for every p∈Rn.f \text{ is integrally convex} \iff \arg\min f[-p] \text{ is an integrally convex set for every } p \in \mathbb R^n.f is integrally convex⟺argminf[−p] is an integrally convex set for every p∈Rn.

This leaves the characterization at the level of the two named properties (integral convexity of the function versus of every minimizer set), the strongest statement of this kind that holds without extra hypotheses beyond boundedness of the domain.

Supporting milestones. Proposition 3.17 (four basic containment/equality relations between hole-free sets' intersections, Minkowski sums, and their real closures); Proposition 3.22 (for a periodic integrally convex function, global optimality reduces to a one-sided local check); Proposition 3.24 (an integrally convex function plus a separable convex function is integrally convex); Proposition 3.25 (separable convex functions are integrally convex, and integral convexity survives linear perturbation); Proposition 3.26 (an integrally convex set is hole free); Proposition 3.28 (the effective domain and every minimizer set of an integrally convex function are integrally convex sets — the forward direction of the goal); and Proposition 3.30 (for integer-valued integrally convex functions, a finite infimum is always attained).

Significance

Theorem 3.29 turns a statement about a function on all of Rn\mathbb R^nRn (integral convexity, a condition on f~\tilde ff~​ and fˉ\bar ffˉ​ that is a priori about uncountably many points) into a statement about a countable family of discrete sets (the minimizer sets arg⁡min⁡f[−p]\arg\min f[-p]argminf[−p]), giving a genuinely different and often more tractable way to certify or refute integral convexity. Propositions 3.24–3.25 are the closure properties that make integral convexity useful in practice: without them, verifying integral convexity of a function built from simpler pieces (a sum with a separable cost, a linearly reweighted objective) would require re-deriving the property from scratch each time. Proposition 3.17, by contrast, is a cautionary result: Note 3.27 and Example 3.15 (the two hole-free sets whose Minkowski sum has a hole) show that hole-freeness alone does not inherit good behavior under set operations, which is exactly the gap integral convexity's stronger, locally-checkable condition is built to close — this mission's Proposition 3.17 documents the "obvious"/general-purpose relations that hold regardless, so that the reader can see precisely which inclusion is automatic and which requires more.

Difficulty

The naive approach to Theorem 3.29's converse direction (integral convexity of every minimizer set implies integral convexity of fff) tries to check f~(x)=fˉ(x)\tilde f(x) = \bar f(x)f~​(x)=fˉ​(x) directly at an arbitrary x∈dom⁡fx \in \operatorname{dom} fx∈domf; this is circular, since f~\tilde ff~​ and fˉ\bar ffˉ​ are themselves defined via suprema over affine minorants, not via minimizer sets. The book's actual proof instead sets up a primal-dual pair of linear programs whose optimal solutions witness fˉ(x)\bar f(x)fˉ​(x) and f~(x)\tilde f(x)f~​(x) respectively, uses LP duality's complementary slackness to show the dual optimal solution can be chosen supported inside N(x)N(x)N(x), and only then concludes f~(x)=fˉ(x)\tilde f(x) = \bar f(x)f~​(x)=fˉ​(x) — routing the entire argument through the integral convexity of the specific minimizer set S=arg⁡min⁡f[−p∗]S = \arg\min f[-p^*]S=argminf[−p∗] at the optimal dual price p∗p^*p∗. This is why Theorem 3.29's proof needs LP duality (Theorem 3.10, formalized in the previous mission in this series) as an ingredient, not just the closure-property machinery of Propositions 3.24–3.28.

Formalization scope

All apparatus (ConvexClosure, IntegralNeighborhood, LocalConvexExtension, IntegrallyConvex, ArgMinPerturbed, HoleFree, IntegrallyConvexSet, SeparableConvex, MinkowskiSumZ) is redeclared fresh in DiscreteConvex.IntegralConvexityC, mirroring chunk 03-integral-convexity's already-established constructions (Fin n-indexed, WithTop ℝ-valued functions, EReal-valued convex closures via sSup), since a draft mission cannot import another draft's definitions. IntegrallyConvexSet is defined via the book's own primary definition (indicator function integrally convex) rather than either of its two stated equivalent reformulations, since no result in this mission needs those forms as a named predicate. An integer-valued function (Proposition 3.30) is represented as Zⁿ → WithTop ℤ and cast to WithTop ℝ via a small casting map wherever the real-valued apparatus is needed — a faithful embedding. Boundedness of a discrete set is containment in a finite integer interval. The formalization does not trivialize: Theorem 3.29's hypothesis is exactly "nonempty bounded effective domain", not further restricted to, say, a fixed small dimension or a finite ground set with a fixed cardinality bound, and every milestone is stated at the same generality as Propositions 3.24–3.28 and 3.30 give it (arbitrary nnn, arbitrary integrally convex function). Infrastructure needed beyond Mathlib: all definitions are fresh; a contribution completing any milestone, or the LP-duality-based proof of Theorem 3.29's converse direction, would be a natural entry point, alongside chunk 03's Theorem 3.21 as background.

Selected references

  • K. Murota, Discrete Convex Analysis, SIAM, 2003, DOI 10.1137/1.9780898718508, Chapter 3.
  • K. Murota, A. Shioura, "M-convex function on generalized polymatroid," Mathematics of Operations Research 24 (1999), 95–105 (Lemma 6.13, cited for Proposition 3.30).
28 thms3 active usersReviewed
Discrete GeometryOperations ResearchOptimization·Captain: Shuze Chen

Discrete Convex Analysis XVI: Substitutes and Complements in Network FlowsTextbook

Motivation

In economics, a pair of goods are substitutes if raising the price of one increases demand for the other, and complements if it decreases it; formally, a utility or value function is submodular in the substitutes case and supermodular in the complements case. A natural question is which of these two regimes a given optimization problem's value function falls into, and whether the answer depends on the underlying combinatorial structure of the problem rather than being a coincidence of the particular numbers involved. Murota's Discrete Convex Analysis (SIAM, 2003) answers this question for the maximum-weight circulation problem in a directed network: the value function is submodular in some coordinates and supermodular in others, purely as a consequence of a graph-theoretic distinction — whether the arcs involved are parallel or series — and this chapter shows the distinction is explained precisely by the dual pair of discrete convexity notions (L-natural-convexity and M-natural-convexity) developed elsewhere in the book. This mission also completes the quadratic-forms thread the previous mission in this series (Discrete Convex Analysis XV) began, by formalizing its natural generalization to functions that may take the value +∞+\infty+∞.

Setting

Let G=(V,A)G=(V,A)G=(V,A) be a directed graph with vertex set VVV and arc set AAA; write ∂+a\partial^+a∂+a, ∂−a\partial^-a∂−a for the initial and terminal vertex of arc aaa. For a flow ξ:A→R\xi:A\to\mathbb Rξ:A→R, its boundary is ∂ξ(v)=∑a:∂+a=vξ(a)−∑a:∂−a=vξ(a)\partial\xi(v)=\sum_{a:\partial^+a=v}\xi(a)-\sum_{a:\partial^-a=v}\xi(a)∂ξ(v)=∑a:∂+a=v​ξ(a)−∑a:∂−a=v​ξ(a), the net flow leaving vvv. Given a capacity c:A→R≥0c:A\to\mathbb R_{\ge0}c:A→R≥0​, ξ\xiξ is a feasible circulation for ccc if 0≤ξ(a)≤c(a)0\le\xi(a)\le c(a)0≤ξ(a)≤c(a) for every arc and ∂ξ(v)=0\partial\xi(v)=0∂ξ(v)=0 for every vertex. For a weight w:A→Rw:A\to\mathbb Rw:A→R, F(w,c)=max⁡{⟨w,ξ⟩:ξ feasible for c}F(w,c)=\max\{\langle w,\xi\rangle : \xi\text{ feasible for }c\}F(w,c)=max{⟨w,ξ⟩:ξ feasible for c} is the maximum-weight circulation value, and ξ\xiξ is optimal for www (with capacity ccc) if it is feasible and attains this maximum. A simple cycle is an alternating sequence of pairwise distinct vertices v0,…,vk−1v_0,\dots,v_{k-1}v0​,…,vk−1​ and arcs a1,…,aka_1,\dots,a_ka1​,…,ak​ with {∂+ai,∂−ai}={vi−1,vi}\{\partial^+a_i,\partial^-a_i\}=\{v_{i-1},v_i\}{∂+ai​,∂−ai​}={vi−1​,vi​} (indices mod kkk) and v0=vkv_0=v_kv0​=vk​. Two arcs are parallel if every simple cycle containing both of them orients them oppositely, and series if every such cycle orients them the same way; a set of arcs is parallel (series) if its arcs are pairwise parallel (series). A circuit is a {0,±1}\{0,\pm1\}{0,±1}-valued π:A→R\pi:A\to\mathbb Rπ:A→R with ∂π=0\partial\pi=0∂π=0 whose support forms a simple cycle. For x∈Rnx\in\mathbb R^nx∈Rn, supp⁡+(x)={i:xi>0}\operatorname{supp}^+(x)=\{i:x_i>0\}supp+(x)={i:xi​>0}, supp⁡−(x)={i:xi<0}\operatorname{supp}^-(x)=\{i:x_i<0\}supp−(x)={i:xi​<0}. A function g:Rn→Rg:\mathbb R^n\to\mathbb Rg:Rn→R is submodular if g(p)+g(q)≥g(p∨q)+g(p∧q)g(p)+g(q)\ge g(p\vee q)+g(p\wedge q)g(p)+g(q)≥g(p∨q)+g(p∧q), supermodular with the reverse inequality, and has translation submodularity (is L-natural-convex) if the stronger inequality g(p)+g(q)≥g((p−α1)∨q)+g(p∧(q+α1))g(p)+g(q)\ge g((p-\alpha\mathbf1)\vee q)+g(p\wedge(q+\alpha\mathbf1))g(p)+g(q)≥g((p−α1)∨q)+g(p∧(q+α1)) holds for every α≥0\alpha\ge0α≥0. A function fff has the M-natural exchange property (is M-natural-convex) if for i∈supp⁡+(x−y)i\in\operatorname{supp}^+(x-y)i∈supp+(x−y) there exist j∈supp⁡−(x−y)∪{0}j\in \operatorname{supp}^-(x-y)\cup\{0\}j∈supp−(x−y)∪{0} and α0>0\alpha_0>0α0​>0 with f(x)+f(y)≥f(x−α(χi−χj))+f(y+α(χi−χj))f(x)+f(y)\ge f(x-\alpha(\chi_i-\chi_j))+f(y+\alpha(\chi_i-\chi_j))f(x)+f(y)≥f(x−α(χi​−χj​))+f(y+α(χi​−χj​)) for α∈[0,α0]\alpha\in[0,\alpha_0]α∈[0,α0​]; a function is M-natural-concave or L-natural-concave if its negation is M-natural- or L-natural-convex.

Formalization targets

Goal (Theorem 2.23). For PPP a parallel arc set and SSS a series arc set,

F is L-natural-convex in wP and M-natural-concave in cP,F\text{ is L-natural-convex in }w_P\text{ and M-natural-concave in }c_P,F is L-natural-convex in wP​ and M-natural-concave in cP​, F is M-natural-convex in wS and L-natural-concave in cS,F\text{ is M-natural-convex in }w_S\text{ and L-natural-concave in }c_S,F is M-natural-convex in wS​ and L-natural-concave in cS​,

where wPw_PwP​, cPc_PcP​ denote FFF's dependence on the coordinates of www, ccc indexed by PPP (resp. SSS) with the remaining coordinates held fixed. This is the mission's capstone: it upgrades the plain submodularity/supermodularity split of Theorem 2.22 to the sharper pair of combinatorial convexity classes that explains it.

Supporting milestones. Proposition 2.21 (the classical fact that FFF is convex in www and concave in ccc, with no combinatorial content — the baseline against which Theorem 2.23's sharper claim is measured); Theorem 2.16 (the general, possibly-+∞+\infty+∞-valued extension of the quadratic-form conjugacy from Discrete Convex Analysis XV's Theorem 2.11, to functions restricted to a linear subspace); Theorem 2.22 (plain submodularity/supermodularity of FFF in wP,cPw_P,c_PwP​,cP​ and wS,cSw_S,c_SwS​,cS​, the result Theorem 2.23 strengthens); and Propositions 2.24–2.28 (the graph-theoretic lemmas — sparse intersection of a circuit's support with a parallel or series arc set, merging two circuits along a series set, and three existence statements for optimality-preserving perturbations — that the book's own proof of Theorem 2.23 is built from).

Significance

Theorem 2.23 gives a structural explanation, rather than a case-by-case verification, for a phenomenon well known in network flow theory: that convexity/concavity and submodularity/supermodularity are independent properties, appearing in all four combinations depending on which side of the problem (weights or capacities) and which graph-theoretic role (parallel or series) is varied. Without it, (2.55)'s four combinations would be four separate facts with no common cause; with it, they are corollaries of two applications of a single pair of dual discrete-convexity notions, the same notions the book uses throughout to unify matroid theory, submodular optimization, and convex analysis. Formalizing this mission produces, so far as a platform search shows, the first Lean statement of a combinatorial-convexity classification result for a network optimization value function, together with the graph-theoretic vocabulary (simple cycles, parallel/series arcs, circuits) needed to state it — infrastructure with no prior formalized counterpart on the platform that a later mission on network flows or matroid union could reuse.

Difficulty

The naive approach to Theorem 2.23 tries to verify translation submodularity or the exchange property directly from the linear-programming definition of FFF as a maximum over a polytope, treating wP↦F(w,c)w_P\mapsto F(w,c)wP​↦F(w,c) as an abstract convex-piecewise-linear function; this loses the graph structure entirely and gives at best the plain submodularity of Theorem 2.22, not the sharper L-natural/M-natural classification, because submodularity alone does not distinguish a combinatorially meaningful discrete convexity from an arbitrary submodular function. The book's actual route instead works with explicit optimal circulations for the two perturbed weight vectors and reconstructs a feasible pair achieving the target inequality by rerouting flow along a circuit — and the existence of a usable circuit (one that touches the perturbed arcs in a way compatible with the parallel or series structure) is exactly what Propositions 2.24–2.28 supply via the conformal decomposition of a difference of two circulations into elementary circuits. This is why those five propositions, although individually narrow existence lemmas, are included as milestones: they are the load-bearing combinatorial content the naive convex-analytic argument cannot reach.

Formalization scope

The graph is {V A : Type*} with src dst : A → V rather than a bundled structure, matching the book's own ∂+,∂−\partial^+,\partial^-∂+,∂− notation directly. F(w,c)F(w,c)F(w,c) is a real sSup over feasible circulations' weights (existence of a maximizer is not asserted, since no proof is attempted this pass); IsOptimalCirc is a separate, directly-stated primitive for "ξ\xiξ is optimal for www", matching the book's own working vocabulary in the propositions that need it. A simple cycle is formalized as an injective cyclically-indexed vertex sequence together with a matching arc sequence, exactly as the book's own footnote defines it; parallel and series arcs are defined by quantifying over every such representation of every simple cycle containing the two arcs, which is checked to be independent of which of a cycle's two traversal directions or starting vertex is chosen. Viewing FFF as a function of wPw_PwP​ alone extends a partial vector by a fixed background vector on the complement of PPP, the same partial-application device the book uses informally. M-natural- and L-natural-concavity are recorded as the corresponding convexity property of the negated function, the standard convention. The formalization does not trivialize: parallel and series arc sets are genuine graph-theoretic hypotheses (not, e.g., specialized to ∣P∣=1|P|=1∣P∣=1 or a graph with no simple cycles, which would make the parallel/series distinction vacuous), and Theorem 2.23's four conclusions are stated with the same combinatorial-convexity predicates (TranslationSubmodular, MNatExchangeR) used for the book's sharpest discrete convexity classes, not weakened to plain submodularity/supermodularity. Theorem 2.16 additionally needs Set (V → ℝ)-valued subspaces K, H (following the book's own set-builder notation for ker M and X⊥ rather than bundling them as Mathlib Submodules) and a WithTop ℝ-valued Legendre- Fenchel conjugate. Infrastructure needed beyond Mathlib: all graph, circulation, and combinatorial-convexity vocabulary is defined fresh in DiscreteConvex.CombinatorialC; a contribution proving any of the five graph-theoretic lemmas (Propositions 2.24–2.28) or the convex/concave halves of Proposition 2.21 independently would be a natural entry point.

Selected references

  • K. Murota, Discrete Convex Analysis, SIAM, 2003, DOI 10.1137/1.9780898718508, Chapter 2.
  • K. Murota, A. Shioura, "Conjugacy relationship between M-convex and L-convex functions in continuous variables," Mathematical Programming 101 (2004), 415–433.
  • R. T. Rockafellar, Network Flows and Monotropic Optimization, Wiley, 1984.
41 thms3 active usersReviewed
🏆Completed
CombinatoricsDiscrete GeometryOperations Research+1·Captain: mikedeng1

Lifts of Convex Sets and Cone Factorizations II: Antichain and Face-Count Lower Bounds on the Nonnegative Rank of a PolytopeResearch Paper

Motivation

Many polytopes that arise in combinatorial optimization, such as the matching, cut, stable set and travelling salesman polytopes, have exponentially many facets, yet some of them can be written as the linear projection of a polyhedron with far fewer facets. The smallest number of facets of such a lift decides whether the polytope admits a compact linear-programming formulation. Yannakakis (Expressing combinatorial optimization problems by linear programs, J. Comput. System Sci. 43 (1991)) showed that this number equals the nonnegative rank of the polytope's slack matrix, turning a question about formulations into a question about matrix factorizations. Gouveia, Parrilo and Thomas (arXiv:1111.3164v2) extended this correspondence from polytopes and nonnegative orthants to arbitrary convex bodies and closed convex cones.

Exact nonnegative rank is NP-hard to compute (Vavasis, SIAM J. Optim. 20 (2009)), so lower bounds matter. The oldest ones are combinatorial: they see only which entries of the slack matrix are zero. Goemans (Smallest compact formulation for the permutahedron, Math. Program. 153 (2015)) observed that a polytope with nCn_CnC​ faces needs a lift with at least log⁡2nC\log_2 n_Clog2​nC​ facets. Section 4.2 of Gouveia–Parrilo–Thomas recasts these support-based bounds through the face lattice and derives, alongside Goemans' bound, a sharper antichain bound. This mission formalizes that chain of results.

Setting

Write Rn\mathbb{R}^nRn for Euclidean space with inner product ⟨⋅,⋅⟩\langle\cdot,\cdot\rangle⟨⋅,⋅⟩. A polytope C⊆RnC \subseteq \mathbb{R}^nC⊆Rn is the convex hull of finitely many points; as throughout the paper, the origin is assumed to lie in its interior. The polar of CCC is

C∘={ y∈Rn:⟨x,y⟩≤1 for all x∈C }.C^\circ = \{\, y \in \mathbb{R}^n : \langle x, y\rangle \le 1 \text{ for all } x \in C \,\}.C∘={y∈Rn:⟨x,y⟩≤1 for all x∈C}.

Let ext⁡(C)\operatorname{ext}(C)ext(C) be the set of extreme points of CCC (its vertices). The slack operator SCS_CSC​ is the function SC(x,y)=1−⟨x,y⟩S_C(x, y) = 1 - \langle x, y\rangleSC​(x,y)=1−⟨x,y⟩ on ext⁡(C)×ext⁡(C∘)\operatorname{ext}(C) \times \operatorname{ext}(C^\circ)ext(C)×ext(C∘). The extreme points of C∘C^\circC∘ correspond to the facets of CCC, the facet of yyy being {x∈C:⟨x,y⟩=1}\{x \in C : \langle x, y\rangle = 1\}{x∈C:⟨x,y⟩=1}, so SCS_CSC​ is the canonical vertex–facet slack matrix of CCC and is nonnegative.

An R+k\mathbb{R}^k_+R+k​-factorization of SCS_CSC​ consists of maps A:ext⁡(C)→R+kA : \operatorname{ext}(C) \to \mathbb{R}^k_+A:ext(C)→R+k​ and B:ext⁡(C∘)→R+kB : \operatorname{ext}(C^\circ) \to \mathbb{R}^k_+B:ext(C∘)→R+k​ with SC(x,y)=⟨A(x),B(y)⟩S_C(x, y) = \langle A(x), B(y)\rangleSC​(x,y)=⟨A(x),B(y)⟩. The nonnegative rank rank⁡+(C)\operatorname{rank}_+(C)rank+​(C) is the least such kkk, and +∞+\infty+∞ if there is none.

The support supp⁡(SC)\operatorname{supp}(S_C)supp(SC​) is the 0/10/10/1 matrix with a one where SC(x,y)≠0S_C(x,y) \ne 0SC​(x,y)=0. A Boolean factorization of it of intermediate dimension kkk assigns subsets A(x),B(y)⊆[k]={1,…,k}A(x), B(y) \subseteq [k] = \{1,\dots,k\}A(x),B(y)⊆[k]={1,…,k} with SC(x,y)≠0  ⟺  A(x)∩B(y)≠∅S_C(x,y) \ne 0 \iff A(x) \cap B(y) \ne \emptysetSC​(x,y)=0⟺A(x)∩B(y)=∅; the least such kkk is the Boolean rank.

A face of CCC is the empty set or a set of maximizers in CCC of a linear functional; CCC itself is a face. The face lattice L(C)L(C)L(C) is the set of faces ordered by inclusion, and the Boolean lattice 2[k]2^{[k]}2[k] is the set of subsets of [k][k][k] ordered by inclusion. An embedding φ:L(C)→2[k]\varphi : L(C) \to 2^{[k]}φ:L(C)→2[k] satisfies H⊆F  ⟺  φ(H)⊆φ(F)H \subseteq F \iff \varphi(H) \subseteq \varphi(F)H⊆F⟺φ(H)⊆φ(F).

Formalization targets

Goal: Corollary 4.13 (p. 16)

For a polytope CCC:

(1)rank⁡+(C) ≥ min⁡{k:p≤(k⌊k/2⌋)}\text{(1)}\quad \operatorname{rank}_+(C) \ \ge\ \min\Big\{ k : p \le \tbinom{k}{\lfloor k/2 \rfloor} \Big\}(1)rank+​(C) ≥ min{k:p≤(⌊k/2⌋k​)}

for every antichain of ppp faces of CCC (no face contained in another), and

(2)rank⁡+(C) ≥ log⁡2nC,\text{(2)}\quad \operatorname{rank}_+(C) \ \ge\ \log_2 n_C ,(2)rank+​(C) ≥ log2​nC​,

where nCn_CnC​ is the number of faces of CCC, including ∅\emptyset∅ and CCC.

Milestones

  1. §4.2, p. 15. For a nonnegative matrix MMM, rank⁡B(M)≤rank⁡+(M)\operatorname{rank}_B(M) \le \operatorname{rank}_+(M)rankB​(M)≤rank+​(M): a nonnegative factorization of intermediate dimension kkk yields a Boolean factorization of supp⁡(M)\operatorname{supp}(M)supp(M) of the same dimension.
  2. Theorem 4.11, p. 15. supp⁡(SC)\operatorname{supp}(S_C)supp(SC​) has a Boolean factorization of intermediate dimension kkk if and only if L(C)L(C)L(C) embeds into 2[k]2^{[k]}2[k].
  3. Corollary 4.12, p. 15. rank⁡+(C)≥min⁡{k:L(C) embeds into 2[k]}\operatorname{rank}_+(C) \ge \min\{k : L(C) \text{ embeds into } 2^{[k]}\}rank+​(C)≥min{k:L(C) embeds into 2[k]}.

Significance

Both bounds depend only on the combinatorial type of the polytope. For a square they give rank⁡+≥log⁡210≈3.32\operatorname{rank}_+ \ge \log_2 10 \approx 3.32rank+​≥log2​10≈3.32 and rank⁡+≥4\operatorname{rank}_+ \ge 4rank+​≥4; for a three-dimensional cube log⁡228≈4.81\log_2 28 \approx 4.81log2​28≈4.81 and 666 (p. 16). For the regular nnn-gon, whose slack matrices all have rank 333, the face-count bound gives rank⁡+≥log⁡2n\operatorname{rank}_+ \ge \log_2 nrank+​≥log2​n, which is of the optimal order (Example 4.14). Theorem 4.11 is the statement that the Boolean rank of a slack matrix, also known as its rectangle covering number, is an invariant of the face lattice; the rectangle-covering version is phrased as Theorem 2.9 of Fiorini, Kaibel, Pashkovich and Theis (Combinatorial bounds on nonnegative rank and extended formulations, arXiv:1111.0444), as cited by the paper.

The results are proved in the paper. The formalization provides machine-checked definitions of the polar, the slack operator of a polytope, its nonnegative and Boolean ranks and its face lattice, reusable for later work on extension complexity (for instance, rectangle-covering lower bounds for specific polytopes). No formal proof of these statements is known to exist in Lean or on this platform.

Difficulty

Milestone 1 and the passage from Corollary 4.12 to Corollary 4.13 are short: Sperner's theorem is available in Mathlib as IsAntichain.sperner, and an embedding of L(C)L(C)L(C) into 2[k]2^{[k]}2[k] is injective. The weight lies in Theorem 4.11, which needs facts about polytopes that Mathlib does not state in this form: every vertex is an exposed point, each extreme point of the polar cuts out a face, every face of a polytope is the convex hull of the vertices it contains, and every proper face is the intersection of the facets containing it, with those facets indexed by ext⁡(C∘)\operatorname{ext}(C^\circ)ext(C∘). The last fact is where the origin-in-the-interior assumption and the polar enter, and it fails for faces described by an arbitrary list of inequalities that is not the facet description. A second, smaller difficulty is finiteness: the face-count bound needs the set of faces of a polytope to be finite.

Formalization scope

Rn\mathbb{R}^nRn is EuclideanSpace ℝ (Fin n) with the Euclidean inner product. The polar is the one-sided polar above, not Mathlib's absolute polar. A polytope is the convex hull of a Finset with the origin in its interior; n=0n = 0n=0 is allowed (C={0}C = \{0\}C={0}), and all targets hold there. Faces are Mathlib's exposed faces (IsExposed ℝ C F), which include ∅\emptyset∅ and CCC, as the paper's counts do; for a polytope these are all faces. The factorization maps are total functions on Rn\mathbb{R}^nRn constrained only on extreme points. The nonnegative rank is valued in ℕ∞, the infimum of the empty family being +∞+\infty+∞; part (2) of the goal is stated for every finite value of the rank. Part (1) is stated for every antichain of faces, equivalent to the paper's "largest antichain". "Smallest kkk" is sInf of a set of naturals that is nonempty in each case (the set of kkk with p≤(k⌊k/2⌋)p \le \binom{k}{\lfloor k/2\rfloor}p≤(⌊k/2⌋k​), and the set of kkk admitting an embedding of the finite lattice L(C)L(C)L(C)).

The paper says "lattice embedding". Its proof of Theorem 4.11 constructs, and uses, only a map that preserves and reflects inclusion, and φ(F)=⋃v∈FA(v)\varphi(F) = \bigcup_{v \in F} A(v)φ(F)=⋃v∈F​A(v) need not preserve joins or meets; the formalization reads "lattice embedding" as an order embedding (Face C ↪o Finset (Fin k)) throughout.

Trivializing formalizations are ruled out: the rank is not a natural-number infimum (which would be 000 when no factorization exists); faces are not arbitrary subsets of CCC; and an embedding is order-reflecting, not merely monotone (every poset maps monotonically into 2[0]2^{[0]}2[0]).

Welcome contributions: a proof of milestone 1; a library of polytope facts (vertices are exposed points, faces are convex hulls of their vertices, finiteness of the face lattice, facets from the polar), which is reusable well beyond this mission; then Theorem 4.11 and the corollaries.

Selected references

  • J. Gouveia, P. A. Parrilo, R. R. Thomas, Lifts of Convex Sets and Cone Factorizations, Math. Oper. Res. 38(2):248–264, 2013; arXiv:1111.3164v2. https://arxiv.org/abs/1111.3164
  • M. Yannakakis, Expressing combinatorial optimization problems by linear programs, J. Comput. System Sci. 43(3):441–466, 1991. https://doi.org/10.1016/0022-0000(91)90024-Y
  • M. X. Goemans, Smallest compact formulation for the permutahedron, Math. Program. 153:5–11, 2015. https://doi.org/10.1007/s10107-014-0757-1
  • S. Fiorini, V. Kaibel, K. Pashkovich, D. O. Theis, Combinatorial bounds on nonnegative rank and extended formulations, Discrete Math. 313(1):67–83, 2013; arXiv:1111.0444. https://arxiv.org/abs/1111.0444
  • S. A. Vavasis, On the complexity of nonnegative matrix factorization, SIAM J. Optim. 20(3):1364–1377, 2009. https://doi.org/10.1137/070709967
10 thms3 active usersReviewed
🏆Completed
Functional AnalysisOperations Research·Captain: mikedeng1

On the Maximal Monotonicity of Subdifferential Mappings I: The Subdifferential of a Lower Semicontinuous Proper Convex Function on a Banach Space Is Maximal MonotoneResearch Paper

Motivation

Monotone operators from a Banach space EEE to its dual E∗E^*E∗ are the abstract framework for nonlinear equations, variational inequalities and evolution equations, and for the convergence theory of proximal-point and splitting algorithms in infinite dimensions. Within that framework, the class that behaves well — for surjectivity results, for resolvents, for sums — is the class of maximal monotone operators. The most important source of such operators is convex analysis: the subdifferential of a convex function. Whether every subdifferential of a closed proper convex function is maximal monotone, in an arbitrary Banach space, is therefore a basic question for convex optimization in function spaces.

Timeline:

  • 1964. G. J. Minty proves maximality of the subdifferential for convex functions that are finite and continuous everywhere (Minty, Pacific J. Math. 14 (1964)).
  • 1965. A. Brøndsted and R. T. Rockafellar show that subgradients exist on a dense set and approximate ε-subgradients (Brøndsted–Rockafellar, Proc. AMS 16 (1965)). J.-J. Moreau develops proximal maps and conjugate duality for convex functions in Hilbert space (Moreau, Bull. SMF 93 (1965)); his later lecture notes Fonctionnelles convexes (Collège de France, 1967) are the paper's reference for conjugates in locally convex spaces.
  • 1966. R. T. Rockafellar announces the general Banach-space result, for every lower semicontinuous proper convex function (Rockafellar, Pacific J. Math. 17 (1966)). H. Brézis later points out a gap in that proof: a subgradient chosen in the argument may grow without bound.
  • 1970. Rockafellar gives a complete proof by a different route, valid in nonreflexive spaces, in the paper formalized here (Rockafellar, Pacific J. Math. 33 (1970)).

Setting

Let EEE be a real Banach space with dual E∗E^*E∗ and bidual E∗∗E^{**}E∗∗, and write ⟨x,x∗⟩=x∗(x)\langle x, x^*\rangle = x^*(x)⟨x,x∗⟩=x∗(x). EEE sits in E∗∗E^{**}E∗∗ through the canonical embedding.

A proper convex function on EEE is a function f:E→(−∞,+∞]f : E \to (-\infty, +\infty]f:E→(−∞,+∞], not identically +∞+\infty+∞, such that f((1−λ)x+λy)≤(1−λ)f(x)+λf(y)f((1-\lambda)x + \lambda y) \le (1-\lambda) f(x) + \lambda f(y)f((1−λ)x+λy)≤(1−λ)f(x)+λf(y) for all x,y∈Ex, y \in Ex,y∈E and 0<λ<10 < \lambda < 10<λ<1. It is lower semicontinuous for the norm topology.

The subdifferential of fff is the multivalued map ∂f:E→E∗\partial f : E \to E^*∂f:E→E∗,

∂f(x)={ x∗∈E∗∣f(y)≥f(x)+⟨y−x,x∗⟩  ∀y∈E }.\partial f(x) = \{\, x^* \in E^* \mid f(y) \ge f(x) + \langle y - x, x^* \rangle \ \ \forall y \in E \,\}.∂f(x)={x∗∈E∗∣f(y)≥f(x)+⟨y−x,x∗⟩  ∀y∈E}.

A multivalued map T:E→E∗T : E \to E^*T:E→E∗ is monotone if ⟨x0−x1,x0∗−x1∗⟩≥0\langle x_0 - x_1, x_0^* - x_1^* \rangle \ge 0⟨x0​−x1​,x0∗​−x1∗​⟩≥0 whenever x0∗∈T(x0)x_0^* \in T(x_0)x0∗​∈T(x0​) and x1∗∈T(x1)x_1^* \in T(x_1)x1∗​∈T(x1​). It is maximal monotone if, in addition, its graph {(x,x∗)∣x∗∈T(x)}\{(x, x^*) \mid x^* \in T(x)\}{(x,x∗)∣x∗∈T(x)} is not properly contained in the graph of any other monotone map T′:E→E∗T' : E \to E^*T′:E→E∗.

The conjugate of fff is f∗(x∗)=sup⁡x∈E{⟨x,x∗⟩−f(x)}f^*(x^*) = \sup_{x \in E} \{\langle x, x^*\rangle - f(x)\}f∗(x∗)=supx∈E​{⟨x,x∗⟩−f(x)}, a function on E∗E^*E∗; its subdifferential ∂f∗\partial f^*∂f∗ maps E∗E^*E∗ into E∗∗E^{**}E∗∗. Finally j(x)=12∥x∥2j(x) = \tfrac12 \|x\|^2j(x)=21​∥x∥2.

In Lean these are ProperConvex f, subdiff f, IsMonotoneOp T, IsMaximalMonotone T, conj f and halfSqNorm, all stated over an arbitrary real normed space V so that they apply equally to EEE and to E∗E^*E∗.

Formalization targets

Goal: Theorem A (p. 210)

f lower semicontinuous proper convex on E⟹∂f:E→E∗ is maximal monotone.f \text{ lower semicontinuous proper convex on } E \quad\Longrightarrow\quad \partial f : E \to E^* \text{ is maximal monotone.}f lower semicontinuous proper convex on E⟹∂f:E→E∗ is maximal monotone.

No reflexivity, inner product or finite dimension is assumed.

Milestones, in attack order

  1. (2.2) Fenchel–Young: f(x)+f∗(x∗)≥⟨x,x∗⟩f(x) + f^*(x^*) \ge \langle x, x^* \ranglef(x)+f∗(x∗)≥⟨x,x∗⟩, with equality iff x∗∈∂f(x)x^* \in \partial f(x)x∗∈∂f(x).
  2. §2, p. 210. f∗f^*f∗ is a weak* lower semicontinuous (hence strongly lower semicontinuous) proper convex function on E∗E^*E∗.
  3. §2, p. 211. The restriction of f∗∗f^{**}f∗∗ to EEE is fff.
  4. Proposition 1. x∗∗∈∂f∗(x∗)x^{**} \in \partial f^*(x^*)x∗∗∈∂f∗(x∗) iff there are a net xi∗→x∗x_i^* \to x^*xi∗​→x∗ in norm and a bounded net xi→x∗∗x_i \to x^{**}xi​→x∗∗ weak**, on one directed index set, with xi∗∈∂f(xi)x_i^* \in \partial f(x_i)xi∗​∈∂f(xi​).
  5. (3.1) ∂(f+j)(x)=∂f(x)+∂j(x)\partial(f + j)(x) = \partial f(x) + \partial j(x)∂(f+j)(x)=∂f(x)+∂j(x) for all x∈Ex \in Ex∈E.
  6. §3, p. 213. (f+j)∗(f + j)^*(f+j)∗ is finite and continuous throughout E∗E^*E∗.
  7. §3, p. 213 (Minty). On any real Banach space, a convex function that is finite and continuous everywhere has a maximal monotone subdifferential.

Significance

Theorem A places every closed proper convex function in the maximal monotone class, in every real Banach space. Downstream, it is what allows convex minimization problems to be treated by the general theory: surjectivity of ∂f+λJ\partial f + \lambda J∂f+λJ (with JJJ the duality map) in reflexive spaces, existence for evolution equations governed by subdifferentials, the definition of resolvents and proximal maps, and the convergence of proximal-point and splitting methods for convex problems. Proposition 1 is of independent interest: in a nonreflexive space ∂f∗\partial f^*∂f∗ is not the inverse of ∂f\partial f∂f, but it is still completely determined by ∂f\partial f∂f through bounded weak** nets.

The theorem is classical and fully proved in the literature. What this mission adds is a machine-checked proof of the nonreflexive Banach-space statement, together with the infrastructure it needs: extended-real-valued proper convex functions, the subdifferential and the conjugate on a normed space and its dual, monotone and maximal monotone operators, and the Fenchel–Moreau identity f∗∗∣E=ff^{**}|_E = ff∗∗∣E​=f. None of these exists in Mathlib at the pinned revision, and Mathlib contains no statement of Theorem A, in Hilbert or in Banach spaces.

Difficulty

Monotonicity of ∂f\partial f∂f follows in two lines from the definition; the whole difficulty is maximality. In a Hilbert space the standard argument solves x+∂f(x)∋yx + \partial f(x) \ni yx+∂f(x)∋y by minimizing f+12∥⋅−y∥2f + \tfrac12\|\cdot - y\|^2f+21​∥⋅−y∥2 and uses the identification of EEE with E∗E^*E∗; in a general Banach space there is no such identification, and minimizers need not exist without reflexivity. The 1966 argument tried to approximate subgradients of fff at nearby points, and it failed because those subgradients could become unbounded as the approximation was refined. Any argument that passes through the dual meets a second obstacle: ∂f∗\partial f^*∂f∗ takes values in the bidual E∗∗E^{**}E∗∗, which is strictly larger than EEE when EEE is not reflexive, so ∂f∗\partial f^*∂f∗ is not the inverse of ∂f\partial f∂f. Relating the two is the content of Proposition 1, and its necessity half requires approximation results well beyond the definitions.

Formalization scope

Lean representation and committed conventions:

  • EEE is a real Banach space: NormedAddCommGroup E, NormedSpace ℝ E, CompleteSpace E. E∗E^*E∗ is StrongDual ℝ E with the operator norm; the pairing ⟨x,x∗⟩\langle x, x^*\rangle⟨x,x∗⟩ is x' x; E∗∗E^{**}E∗∗ is StrongDual ℝ (StrongDual ℝ E) and E↪E∗∗E \hookrightarrow E^{**}E↪E∗∗ is NormedSpace.inclusionInDoubleDual ℝ E.
  • The value set (−∞,+∞](-\infty,+\infty](−∞,+∞] is EReal with the clause "never ⊥\bot⊥". Properness also requires some value ≠⊤\ne \top=⊤. Convexity is the paper's inequality for 0<λ<10 < \lambda < 10<λ<1, computed in EReal.
  • Multivalued maps are V → Set (StrongDual ℝ V). Maximality is graph inclusion, quantified over every monotone T', not only over subdifferentials.
  • The conjugate is an EReal supremum over all of VVV; the biconjugate is conj (conj f) on the bidual.
  • (2.2) is stated as ⟨x,x∗⟩≤f(x)+f∗(x∗)\langle x, x^*\rangle \le f(x) + f^*(x^*)⟨x,x∗⟩≤f(x)+f∗(x∗) with the equality case, avoiding EReal subtraction.
  • Weak* lower semicontinuity of f∗f^*f∗ is lower semicontinuity on WeakDual ℝ E.
  • In Proposition 1 a net is a map from a nonempty, directed, partially ordered index type (in the universe of EEE), with convergence along atTop. Weak** convergence is pointwise convergence on E∗E^*E∗ of the canonical images, which is convergence in the weak topology induced on E∗∗E^{**}E∗∗ by E∗E^*E∗. Boundedness is a uniform norm bound.
  • (3.1) reads the printed ∂(f+j)\partial(f+j)∂(f+j) as ∂(f+j)(x)\partial(f+j)(x)∂(f+j)(x); the right side is the pointwise (Minkowski) set sum.
  • "Finite and continuous" for (f+j)∗(f+j)^*(f+j)∗ is the existence of a continuous real-valued hhh on E∗E^*E∗ equal to it everywhere.
  • Minty's case is stated for an arbitrary real Banach space VVV, because the proof applies it on E∗E^*E∗.

A trivializing formalization is ruled out: properness excludes f≡+∞f \equiv +\inftyf≡+∞ (whose empty subdifferential is monotone but not maximal) and −∞-\infty−∞ values, maximality ranges over all monotone operators, and the index set in Proposition 1 is nonempty and directed so that no convergence statement holds vacuously.

Infrastructure needed and reusable beyond this mission: extended-real convex analysis on normed spaces (conjugates, the Fenchel–Moreau theorem via Hahn–Banach separation, lower semicontinuity in the weak and weak* topologies), subdifferential calculus for a sum with a continuous function, nets and weak** approximation in the bidual (Goldstine-type arguments), and the Brøndsted–Rockafellar approximation of ε-subgradients. Contributions are welcome at every milestone; the definitions layer and milestones 1–3 are the natural starting points.

Selected references

  • R. T. Rockafellar, On the maximal monotonicity of subdifferential mappings, Pacific Journal of Mathematics 33 (1970), 209–216. https://doi.org/10.2140/pjm.1970.33.209
  • R. T. Rockafellar, Characterization of the subdifferentials of convex functions, Pacific Journal of Mathematics 17 (1966), 497–510. https://doi.org/10.2140/pjm.1966.17.497
  • G. J. Minty, On the monotonicity of the gradient of a convex function, Pacific Journal of Mathematics 14 (1964), 243–247. https://doi.org/10.2140/pjm.1964.14.243
  • J.-J. Moreau, Proximité et dualité dans un espace hilbertien, Bulletin de la Société Mathématique de France 93 (1965), 273–299. https://doi.org/10.24033/bsmf.1625
  • A. Brøndsted and R. T. Rockafellar, On the subdifferentiability of convex functions, Proceedings of the American Mathematical Society 16 (1965), 605–611. https://doi.org/10.1090/S0002-9939-1965-0178103-8
13 thms3 active usersReviewed
🏆Completed
Functional AnalysisOperations ResearchOptimization·Captain: mikedeng1

A Dynamical Approach to an Inertial Forward-Backward Algorithm for Convex Minimization: The IFB Iterates Minimize the Objective and Converge Weakly to a MinimizerResearch Paper

Motivation

Many problems in signal processing, statistics and operations research ask to minimize a sum Θ=Φ+Ψ\Theta = \Phi + \PsiΘ=Φ+Ψ of a nonsmooth convex term Φ\PhiΦ (a constraint indicator, an ℓ1\ell^1ℓ1 penalty) and a smooth term Ψ\PsiΨ. The standard method is the forward-backward (proximal-gradient) algorithm: an explicit gradient step on Ψ\PsiΨ followed by a proximal step on Φ\PhiΦ. Its classical convergence theory requires Ψ\PsiΨ to be convex and the step size to stay below 2/LΨ2/L_\Psi2/LΨ​, where LΨL_\PsiLΨ​ is the Lipschitz constant of ∇Ψ\nabla\Psi∇Ψ.

Attouch, Peypouquet and Redont (authors' manuscript of SIAM J. Optim. 24 (2014)) derive an inertial forward-backward algorithm (IFB) as a time discretization of a second-order dissipative dynamical system with Hessian-driven damping. The added inertial terms cost essentially nothing to compute, yet they allow step sizes beyond 2/LΨ2/L_\Psi2/LΨ​ and a smooth part Ψ\PsiΨ that is not convex, provided the sum Θ\ThetaΘ is.

Timeline of the relevant results:

  • Heavy-ball-with-friction methods, the inertial discretizations of u¨+αu˙+∇Φ(u)=0\ddot u + \alpha\dot u + \nabla\Phi(u) = 0u¨+αu˙+∇Φ(u)=0, were introduced by Polyak (1964) and developed by Alvarez and Attouch (2001) for proximal schemes.
  • Hessian-driven damping for one potential: Alvarez, Attouch, Bolte and Redont (2002); for a nonsmooth potential plus a smooth one, the continuous dynamics underlying (IFB): Attouch, Maingé and Redont (2012).
  • The discrete algorithm (IFB) and its weak convergence in Hilbert spaces: Attouch, Peypouquet and Redont (2014), the paper of this mission.

Setting

Let HHH be a real Hilbert space with inner product ⟨⋅,⋅⟩\langle\cdot,\cdot\rangle⟨⋅,⋅⟩. Let Φ:H→R∪{+∞}\Phi : H \to \mathbb R\cup\{+\infty\}Φ:H→R∪{+∞} and Ψ:H→R\Psi : H \to \mathbb RΨ:H→R, and write Θ=Φ+Ψ\Theta = \Phi + \PsiΘ=Φ+Ψ and S=Argmin⁡Θ\mathcal S = \operatorname{Argmin}\ThetaS=ArgminΘ. A vector ggg is a subgradient of Φ\PhiΦ at uuu, written g∈∂Φ(u)g \in \partial\Phi(u)g∈∂Φ(u), if Φ(u)<+∞\Phi(u) < +\inftyΦ(u)<+∞ and Φ(u)+⟨g,v−u⟩≤Φ(v)\Phi(u) + \langle g, v - u\rangle \le \Phi(v)Φ(u)+⟨g,v−u⟩≤Φ(v) for all vvv.

Hypothesis H fixes positive constants LΨL_\PsiLΨ​, aaa, bbb and a step size λ\lambdaλ with:

  • HΦH_\PhiHΦ​: Φ\PhiΦ is proper, lower semicontinuous and convex;
  • HΨH_\PsiHΨ​: Ψ\PsiΨ is differentiable and ∇Ψ\nabla\Psi∇Ψ is LΨL_\PsiLΨ​-Lipschitz;
  • HλH_\lambdaHλ​: 0<λ<Λ=min⁡{1/a, 2(a+b)/(bLΨ)}0 < \lambda < \Lambda = \min\{1/a,\ 2(a+b)/(bL_\Psi)\}0<λ<Λ=min{1/a, 2(a+b)/(bLΨ​)};
  • HΘH_\ThetaHΘ​: Θ\ThetaΘ is convex and bounded from below.

Algorithm (IFB). From any (u0,y0)∈H×H(u_0, y_0) \in H \times H(u0​,y0​)∈H×H, compute for k≥0k \ge 0k≥0

0∈uk+1−ukλ+∂Φ(uk+1)+auk−byk,0=yk+1−ykλ+∇Ψ(uk+1)−auk+1+byk+1.0 \in \frac{u_{k+1}-u_k}{\lambda} + \partial\Phi(u_{k+1}) + a u_k - b y_k, \qquad 0 = \frac{y_{k+1}-y_k}{\lambda} + \nabla\Psi(u_{k+1}) - a u_{k+1} + b y_{k+1}.0∈λuk+1​−uk​​+∂Φ(uk+1​)+auk​−byk​,0=λyk+1​−yk​​+∇Ψ(uk+1​)−auk+1​+byk+1​.

A sequence uku_kuk​ converges weakly to ppp, written uk⇀pu_k \rightharpoonup puk​⇀p, if ⟨uk,v⟩→⟨p,v⟩\langle u_k, v\rangle \to \langle p, v\rangle⟨uk​,v⟩→⟨p,v⟩ for every v∈Hv \in Hv∈H. The analysis uses the velocity ξk=uk−uk−1\xi_k = u_k - u_{k-1}ξk​=uk​−uk−1​, the energy Ek=Θ(uk)+γ∥ξk∥2E_k = \Theta(u_k) + \gamma\|\xi_k\|^2Ek​=Θ(uk​)+γ∥ξk​∥2 with γ=(1−aλ)/(2bλ2)\gamma = (1-a\lambda)/(2b\lambda^2)γ=(1−aλ)/(2bλ2), and two auxiliary real sequences Gk(q)G_k(q)Gk​(q) and Fk(q)F_k(q)Fk​(q), defined from uuu, yyy and a reference point qqq by (17) and (18) of the paper.

Formalization targets

Goal: Theorem 1

Under Hypothesis H, for every sequence generated by (IFB),

lim⁡k→∞Θ(uk)=inf⁡Θ;\lim_{k\to\infty}\Theta(u_k) = \inf\Theta;k→∞lim​Θ(uk​)=infΘ;

if S≠∅\mathcal S \ne \emptysetS=∅ and one of (i) S\mathcal SS is a singleton, (ii) Φ\PhiΦ is differentiable with weak-to-weak sequentially continuous gradient, (iii) ∇Ψ\nabla\Psi∇Ψ is weak-to-weak sequentially continuous, (iv) Ψ\PsiΨ is convex, holds, then

uk⇀pfor some p∈S;u_k \rightharpoonup p \quad\text{for some } p \in \mathcal S;uk​⇀pfor some p∈S;

and if S=∅\mathcal S = \emptysetS=∅, then ∥uk∥→+∞\|u_k\| \to +\infty∥uk​∥→+∞.

Milestones

In the order of the paper's argument: Proposition 2 (energy decrease, ∑∥ξk∥2<∞\sum\|\xi_k\|^2 < \infty∑∥ξk​∥2<∞); Proposition 3 (the identity and inequality (19) for Fk(q)F_k(q)Fk​(q)); Proposition 4 (Gk(q)G_k(q)Gk​(q) is bounded above for q∈dom⁡Φq\in\operatorname{dom}\Phiq∈domΦ); the lower bound (28) on Fk(q)F_k(q)Fk​(q); Lemma 5 (a real-sequence lemma); Proposition 6 (Θ(uk)→inf⁡Θ\Theta(u_k)\to\inf\ThetaΘ(uk​)→infΘ, weak cluster points lie in S\mathcal SS); Lemma 7 (a boundedness lemma); Proposition 8 (boundedness of (uk)(u_k)(uk​) and convergence of Fk(q)F_k(q)Fk​(q) when S≠∅\mathcal S \ne\emptysetS=∅).

Significance

The result gives convergence of a forward-backward type method under a step-size bound Λ\LambdaΛ that can be made arbitrarily large by choosing aaa small, and for a smooth term Ψ\PsiΨ that need not be convex. The special case Φ=δC\Phi = \delta_CΦ=δC​ (indicator of a closed convex set) yields an inertial gradient-projection method, and the paper applies the theorem to feasibility problems, the CQ algorithm, Pareto fronts and ℓ1\ell^1ℓ1 signal recovery.

The theorem is proved in the paper; to our knowledge it is not formalized anywhere. A complete formalization would provide a machine-checked Liapunov analysis of an inertial proximal method in an infinite-dimensional Hilbert space, including the passage from a minimizing sequence to weak convergence. The milestones Proposition 2, 3 and 8 are energy estimates that also underlie other inertial and proximal schemes.

Difficulty

The energy EkE_kEk​ controls the values Θ(uk)\Theta(u_k)Θ(uk​) and the velocities ξk\xi_kξk​, but not the iterates themselves. The first idea, proving that ∥uk−q∥\|u_k - q\|∥uk​−q∥ is nonincreasing for every q∈Sq \in \mathcal Sq∈S (Fejér monotonicity, the standard route for the classical forward-backward method), does not come out of the energy estimates for (IFB): the inertial variable yky_kyk​ couples consecutive steps, and the distance to a minimizer is not a Liapunov function. The paper's replacement, the sequence Fk(q)F_k(q)Fk​(q), carries the auxiliary sum Gk(q)G_k(q)Gk​(q), whose upper bound already requires the full Hypothesis H. Because HHH is infinite-dimensional, bounded sequences have only weakly convergent subsequences, so the minimizing property has to pass through weak lower semicontinuity of Θ\ThetaΘ, and the final step, uniqueness of the weak cluster point, needs a separate argument in each of the cases (i)–(iv) together with Opial's lemma, which is not in Mathlib.

Formalization scope

  • HHH is a general real Hilbert space (InnerProductSpace ℝ H with CompleteSpace H); nothing is specialized to finite dimension.
  • Φ\PhiΦ and Θ\ThetaΘ take values in EReal. Properness excludes −∞-\infty−∞. Convexity of an extended-valued function is convexity of its epigraph in H×RH\times\mathbb RH×R, because Mathlib's ConvexOn needs a scalar action that EReal lacks. The subgradient predicate requires Φ(u)<+∞\Phi(u) < +\inftyΦ(u)<+∞, so ∂Φ(u)=∅\partial\Phi(u) = \emptyset∂Φ(u)=∅ off dom⁡Φ\operatorname{dom}\PhidomΦ.
  • (IFB) is encoded as the subgradient inclusion, not through the proximity operator. Weak convergence is convergence of all inner products ⟨uk,v⟩\langle u_k, v\rangle⟨uk​,v⟩; weak cluster points are weak limits along strictly increasing subsequences.
  • LΨ>0L_\Psi > 0LΨ​>0 is assumed (harmless: a Lipschitz gradient is Lipschitz with every larger constant). The step size λ\lambdaλ is written lam.
  • ξk\xi_kξk​, zkz_kzk​, EkE_kEk​, GkG_kGk​, FkF_kFk​ are defined on all natural indices, and each statement quantifies k≥1k \ge 1k≥1 (or k≥2k \ge 2k≥2 for GkG_kGk​) as the paper does. Energies and values are never truncated to real numbers, so no statement becomes true through the convention EReal.toReal ⊤ = 0.
  • Deviation from the printed text: Proposition 4 is printed under HΦH_\PhiHΦ​ and HΨH_\PsiHΨ​ only, but its proof invokes Proposition 2, which needs all of Hypothesis H, and the printed statement is false for step sizes above Λ\LambdaΛ (e.g. H=RH=\mathbb RH=R, Φ=x2/2\Phi = x^2/2Φ=x2/2, Ψ=3x2/2\Psi = 3x^2/2Ψ=3x2/2, a=2a=2a=2, b=0.02b=0.02b=0.02, λ=10\lambda = 10λ=10). The milestone is stated under the full Hypothesis H.
  • A formalization in which ∂Φ(u)\partial\Phi(u)∂Φ(u) is nonempty at points of infinite value, in which the energy is converted to a real number, or in which Hypothesis H cannot be satisfied, would make these statements trivial or vacuous, and is ruled out by the definitions above.

A complete development needs Opial's lemma, weak sequential compactness of bounded sets in Hilbert space, weak lower semicontinuity of lower semicontinuous convex functions, the descent lemma for functions with Lipschitz gradient, and monotonicity of the subdifferential. These are reusable well beyond this mission; contributions of any of them, and of the milestones in any order, are welcome.

Selected references

  • H. Attouch, J. Peypouquet, P. Redont, A Dynamical Approach to an Inertial Forward-Backward Algorithm for Convex Minimization, SIAM J. Optim. 24(1), 2014 (statements cited from the authors' manuscript of Aug 2013). https://doi.org/10.1137/130910294
  • H. Attouch, P.-E. Maingé, P. Redont, A second-order differential system with Hessian-driven damping; application to non-elastic shock laws, Differential Equations and Applications 4(1), 2012. https://doi.org/10.7153/dea-04-02
  • F. Alvarez, H. Attouch, An inertial proximal method for maximal monotone operators via discretization of a nonlinear oscillator with damping, Set-Valued Analysis 9, 2001. https://doi.org/10.1023/A:1011253113155
  • F. Alvarez, H. Attouch, J. Bolte, P. Redont, A second-order gradient-like dissipative dynamical system with Hessian-driven damping, J. Math. Pures Appl. 81(8), 2002. https://doi.org/10.1016/S0021-7824(01)01253-3
  • B. T. Polyak, Some methods of speeding up the convergence of iteration methods, USSR Comput. Math. Math. Phys. 4(5), 1964. https://doi.org/10.1016/0041-5553(64)90137-5
  • Z. Opial, Weak convergence of the sequence of successive approximations for nonexpansive mappings, Bull. Amer. Math. Soc. 73, 1967. https://doi.org/10.1090/S0002-9904-1967-11761-0
12 thms3 active usersReviewed
🏆Completed
Operations ResearchOptimizationProbability·Captain: mikedeng1

Robust Control of Markov Decision Processes with Uncertain Transition Matrices 4: The Dual of the Worst-Case Expectation over a Kullback-Leibler BallResearch Paper

Motivation

A robust Markov decision process replaces the unknown transition probabilities of an MDP by sets of plausible values and optimises against the worst case. Nilim and El Ghaoui (Oper. Res. 53 (2005)) showed that, when the uncertainty is rectangular (each row of each transition matrix varies independently in its own set), the robust problem is solved by a Bellman-type recursion. Each step of that recursion needs, for every state and action, the value of an inner problem: the largest expectation of the next-stage value vector over the uncertainty set of one transition row. The recursion is only as tractable as this inner problem.

The paper studies several uncertainty models built from statistical estimates of the transition rows. In the entropy model the uncertain row is any distribution within a prescribed Kullback–Leibler divergence of a nominal distribution. For this model the paper reduces the inner problem to the minimisation of a scalar convex function, which is then solved by bisection. Iyengar (Math. Oper. Res. 30 (2005)) obtained the same robust recursion independently, and the same scalar reduction is the basic computation in later KL-constrained distributionally robust optimisation. This mission formalizes that reduction and the properties of the scalar function that the paper derives from it.

Setting

Let n≥1n\ge 1n≥1 and let Δn={p∈Rn:p≥0, ∑jp(j)=1}\Delta_n=\{p\in\mathbb R^n : p\ge 0,\ \sum_j p(j)=1\}Δn​={p∈Rn:p≥0, ∑j​p(j)=1} be the probability simplex. For p,q∈Rnp,q\in\mathbb R^np,q∈Rn the Kullback–Leibler divergence is

D(p∥q)=∑jp(j)log⁡p(j)q(j),D(p\|q)=\sum_j p(j)\log\frac{p(j)}{q(j)},D(p∥q)=j∑​p(j)logq(j)p(j)​,

with 0log⁡0=00\log 0=00log0=0. Fix a nominal distribution q∈Δnq\in\Delta_nq∈Δn​ with q(j)>0q(j)>0q(j)>0 for every jjj, and a level β>0\beta>0β>0. The entropy uncertainty set is

P={p∈Δn:D(p∥q)≤β}.\mathcal P=\{p\in\Delta_n : D(p\|q)\le\beta\}.P={p∈Δn​:D(p∥q)≤β}.

For a vector v∈Rnv\in\mathbb R^nv∈Rn (in the MDP, the value function of the next stage), the inner problem (17) is

σP(v)=max⁡p∈PpTv.\sigma_{\mathcal P}(v)=\max_{p\in\mathcal P} p^{\mathsf T}v .σP​(v)=p∈Pmax​pTv.

The paper's scalar dual function (47) is, for λ>0\lambda>0λ>0,

σ(λ)=λlog⁡(∑jq(j) ev(j)/λ)+βλ.\sigma(\lambda)=\lambda\log\Big(\sum_j q(j)\,e^{v(j)/\lambda}\Big)+\beta\lambda .σ(λ)=λlog(j∑​q(j)ev(j)/λ)+βλ.

Write vmax⁡=max⁡jv(j)v_{\max}=\max_j v(j)vmax​=maxj​v(j) and Q(v)=∑j: v(j)=vmax⁡q(j)Q(v)=\sum_{j:\,v(j)=v_{\max}}q(j)Q(v)=∑j:v(j)=vmax​​q(j), the qqq-mass of the maximisers of vvv. The tilted distribution at λ>0\lambda>0λ>0 is p∗(j)=q(j)ev(j)/λ/∑iq(i)ev(i)/λp^*(j)=q(j)e^{v(j)/\lambda}/\sum_i q(i)e^{v(i)/\lambda}p∗(j)=q(j)ev(j)/λ/∑i​q(i)ev(i)/λ.

In Lean, vectors are Fin n → ℝ, Δn\Delta_nΔn​ is stdSimplex ℝ (Fin n), and DDD, P\mathcal PP, σ\sigmaσ, p∗p^*p∗, vmax⁡v_{\max}vmax​, Q(v)Q(v)Q(v) are klDiv, klBall, dualFn, tiltedDist, vmax, maxMass in the namespace RobustMDP.EntropyInner.

Formalization targets

Goal: the dual of the inner problem (§6.2, Eq. (47), p. 791)

max⁡p∈PpTv=inf⁡λ>0σ(λ),\max_{p\in\mathcal P} p^{\mathsf T}v=\inf_{\lambda>0}\sigma(\lambda),p∈Pmax​pTv=λ>0inf​σ(λ),

with the maximum attained. This is kl_ball_inner_problem_dual. It holds for every nnn, every vvv, every q>0q>0q>0 in Δn\Delta_nΔn​ and every β>0\beta>0β>0.

Milestones

  1. §6.1: max⁡p∈ΔnD(p∥q)=max⁡i(−log⁡qi)\max_{p\in\Delta_n}D(p\|q)=\max_i(-\log q_i)maxp∈Δn​​D(p∥q)=maxi​(−logqi​), and for β≥max⁡i(−log⁡qi)\beta\ge\max_i(-\log q_i)β≥maxi​(−logqi​) the set P\mathcal PP is all of Δn\Delta_nΔn​ and the inner value is vmax⁡v_{\max}vmax​.
  2. Eq. (48): qTv+βλ≤σ(λ)≤vmax⁡+βλq^{\mathsf T}v+\beta\lambda\le\sigma(\lambda)\le v_{\max}+\beta\lambdaqTv+βλ≤σ(λ)≤vmax​+βλ for λ>0\lambda>0λ>0.
  3. §6.2, the optimal distribution: pTv−λD(p∥q)≤λlog⁡∑jq(j)ev(j)/λp^{\mathsf T}v-\lambda D(p\|q)\le\lambda\log\sum_j q(j)e^{v(j)/\lambda}pTv−λD(p∥q)≤λlog∑j​q(j)ev(j)/λ on Δn\Delta_nΔn​, with equality at p∗p^*p∗.
  4. §6.2, elimination of μ\muμ: min⁡μ[μ+βλ+λ∑jq(j)e(v(j)−μ)/λ−1]=σ(λ)\min_{\mu}\big[\mu+\beta\lambda+\lambda\sum_j q(j)e^{(v(j)-\mu)/\lambda-1}\big]=\sigma(\lambda)minμ​[μ+βλ+λ∑j​q(j)e(v(j)−μ)/λ−1]=σ(λ).
  5. Eq. (49): σ(λ)=vmax⁡+(β+log⁡Q(v))λ+o(λ)\sigma(\lambda)=v_{\max}+(\beta+\log Q(v))\lambda+o(\lambda)σ(λ)=vmax​+(β+logQ(v))λ+o(λ) as λ→0+\lambda\to0^+λ→0+.
  6. Eq. (50): σ(λ)=qTv+βλ+o(1)\sigma(\lambda)=q^{\mathsf T}v+\beta\lambda+o(1)σ(λ)=qTv+βλ+o(1) as λ→∞\lambda\to\inftyλ→∞.
  7. §6.3: if β≥−log⁡Q(v)\beta\ge-\log Q(v)β≥−logQ(v), then inf⁡λ>0σ=vmax⁡\inf_{\lambda>0}\sigma=v_{\max}infλ>0​σ=vmax​ and the inner value is vmax⁡v_{\max}vmax​.

Significance

The goal turns an nnn-dimensional optimisation over a nonpolyhedral convex set into a one-dimensional convex minimisation whose objective costs O(n)O(n)O(n) to evaluate. Combined with the bisection bracket from (48) and the behaviour at 000 from (49), it gives the paper's O(nlog⁡(vmax⁡/δ))O(n\log(v_{\max}/\delta))O(nlog(vmax​/δ)) cost per inner problem (§6.4), and hence the per-step cost of the robust Bellman recursion under entropy uncertainty. Milestone 7 identifies exactly when the uncertainty set is large enough that the robust step ignores the nominal model; unlike the cruder threshold of milestone 1, it depends on vvv.

The result is proved in the paper modulo "standard duality arguments". The paper gives no proof of the duality step itself, and its expansions (49)–(50) are proved only in outline in Appendix C. No formal proof of any of these statements is known to exist; Mathlib has the measure-theoretic Donsker–Varadhan ingredients but not the finite, constrained dual stated here. The mission produces a machine-checked version of the whole chain, with the attainment questions (which side is a max, which is only an infimum) settled explicitly.

Difficulty

The inequality max⁡PpTv≤σ(λ)\max_{\mathcal P}p^{\mathsf T}v\le\sigma(\lambda)maxP​pTv≤σ(λ) for every λ>0\lambda>0λ>0 is the routine half. The obstacle is the reverse inequality. The paper appeals to Lagrangian strong duality under a Slater condition, but the Lagrangian dual function equals σ(λ)\sigma(\lambda)σ(λ) only for λ>0\lambda>0λ>0; at λ=0\lambda=0λ=0 it is vmax⁡v_{\max}vmax​, and the dual infimum may be approached only as λ→0+\lambda\to0^+λ→0+. A proof that looks for a minimiser λ∗>0\lambda^*>0λ∗>0 and a matching primal point p∗p^*p∗ fails in precisely the regime β≥−log⁡Q(v)\beta\ge-\log Q(v)β≥−logQ(v) of milestone 7, where no such λ∗\lambda^*λ∗ exists and the primal optimum sits on the face of the simplex spanned by the maximisers of vvv. The strong-duality argument must also handle the boundary of Δn\Delta_nΔn​, where D(⋅∥q)D(\cdot\|q)D(⋅∥q) is not differentiable.

Formalization scope

  • Vectors are Fin n → ℝ; Δn\Delta_nΔn​ is stdSimplex ℝ (Fin n). D(p∥q)D(p\|q)D(p∥q) is a local finite sum with Lean's log⁡0=0\log 0=0log0=0, which gives 0log⁡0=00\log0=00log0=0; Mathlib's measure-valued InformationTheory.klDiv is not used.
  • Standing hypotheses in every theorem: q∈Δnq\in\Delta_nq∈Δn​, q(j)>0q(j)>0q(j)>0 for all jjj, and β>0\beta>0β>0, as in §6.1. No restriction on vvv is imposed; the "without loss of generality v≥0v\ge0v≥0" of the paper's §5 is not assumed here.
  • The primal "max" is stated with IsGreatest (attained, since the KL ball is compact). The paper's "min⁡λ>0σ(λ)\min_{\lambda>0}\sigma(\lambda)minλ>0​σ(λ)" is an infimum, stated with IsGLB over {σ(λ):λ>0}\{\sigma(\lambda):\lambda>0\}{σ(λ):λ>0}: it is not attained when β≥−log⁡Q(v)\beta\ge-\log Q(v)β≥−logQ(v).
  • dualFn is total in λ\lambdaλ and equals 000 at λ=0\lambda=0λ=0 (division by zero), not the paper's σ(0)=vmax⁡\sigma(0)=v_{\max}σ(0)=vmax​. Every statement uses λ>0\lambda>0λ>0; the value at 000 appears as the one-sided limit of (49). Accordingly (48) is stated for λ>0\lambda>0λ>0.
  • vmax⁡v_{\max}vmax​ is ⨆ j, v j, the attained maximum over the finite nonempty index set; max⁡i(−log⁡qi)\max_i(-\log q_i)maxi​(−logqi​) likewise.
  • (49) is stated as a limit along 𝓝[>] 0 together with a little-o remainder; (50) as a limit along atTop.
  • Milestone 7 uses the non-strict condition β≥−log⁡Q(v)\beta\ge-\log Q(v)β≥−logQ(v) of the paper's first sentence, which contains the strict version of its second.
  • Trivializing formalizations are excluded: the statements quantify over all nnn, vvv and qqq, so a constant vvv, n=1n=1n=1, or the whole-simplex case of milestone 1 does not discharge the goal.

Useful infrastructure: a finite Gibbs variational inequality, compactness of the KL ball, and convexity and one-sided asymptotics of the log-sum-exp function in the temperature parameter. These are reusable for any KL-constrained robust optimisation mission. Proofs of the milestones, alternative proofs of the goal that avoid a general strong-duality theorem, and the sharper O(λe−t/λ)O(\lambda e^{-t/\lambda})O(λe−t/λ) remainder of Appendix C are all welcome.

Selected references

  • A. Nilim and L. El Ghaoui, Robust Control of Markov Decision Processes with Uncertain Transition Matrices, Operations Research 53(5):780–798, 2005. https://doi.org/10.1287/opre.1050.0216
  • G. N. Iyengar, Robust Dynamic Programming, Mathematics of Operations Research 30(2):257–280, 2005. https://doi.org/10.1287/moor.1040.0129
  • M. D. Donsker and S. R. S. Varadhan, Asymptotic evaluation of certain Markov process expectations for large time, I, Communications on Pure and Applied Mathematics 28(1):1–47, 1975. https://doi.org/10.1002/cpa.3160280102
10 thms3 active usersReviewed
🏆Completed
Linear OptimizationOperations ResearchOptimization·Captain: mikedeng1

Cones of Matrices and Set-Functions and 0–1 Optimization I: n Rounds of the Lovász–Schrijver N Operator Give the 0–1 HullResearch Paper

Motivation

A 0–1 integer program asks for the best 0–1 vector satisfying a system of linear inequalities. Its linear relaxation is easy to optimize over, but the relaxation is usually much larger than the convex hull of the 0–1 solutions. Lift-and-project methods close this gap systematically: they lift the relaxation to a higher-dimensional space, add constraints that every 0–1 point satisfies there, and project back, obtaining a tighter relaxation that still contains every 0–1 solution.

L. Lovász and A. Schrijver introduced one of the two standard lift-and-project hierarchies in Cones of matrices and set-functions and 0–1 optimization (SIAM J. Optim., 1991). Their operators NNN and N+N_+N+​ represent a 0–1 point xxx by the matrix xxTxx^{\mathsf T}xxT, impose linear (and for N+N_+N+​ semidefinite) constraints on such matrices, and project back to Rn+1\mathbb R^{n+1}Rn+1. The same paper applies the operators to the stable set polytope, where one round already produces the odd hole, odd wheel, clique and odd antihole constraints. The Lovász–Schrijver hierarchy, the Sherali–Adams hierarchy (1990) and Lasserre's semidefinite hierarchy (2001) are the three reference lift-and-project methods; their rank lower bounds are a standard tool for proving that a relaxation cannot solve a combinatorial problem in few rounds.

This mission formalizes the first structural fact about the operator NNN: iterating it nnn times on any relaxation in nnn variables yields exactly the 0–1 hull (Theorem 1.4 of the paper).

Setting

Vectors live in Rn+1\mathbb R^{n+1}Rn+1 with coordinates x0,x1,…,xnx_0, x_1, \dots, x_nx0​,x1​,…,xn​; the space Rn\mathbb R^nRn of the original problem is the hyperplane x0=1x_0 = 1x0​=1, and polytopes are replaced by the convex cones they generate.

  • A convex cone is a nonempty set closed under addition and nonnegative scaling. For a set SSS, cone⁡(S)\operatorname{cone}(S)cone(S) is the set of nonnegative combinations of finitely many vectors of SSS.
  • The polar cone of KKK is K∗={u:uTx≥0 for all x∈K}K^* = \{u : u^{\mathsf T}x \ge 0 \text{ for all } x \in K\}K∗={u:uTx≥0 for all x∈K}.
  • A 0–1 vector has every coordinate, x0x_0x0​ included, equal to 000 or 111. The cube cone QQQ is the cone spanned by the 0–1 vectors with x0=1x_0 = 1x0​=1; it is the cone over the unit cube.
  • For a convex cone KKK, K∘K^\circK∘ is the cone spanned by the 0–1 vectors in KKK. For K⊆QK \subseteq QK⊆Q this is the cone over the convex hull of the 0–1 points of the relaxation.

For convex cones K1,K2⊆QK_1, K_2 \subseteq QK1​,K2​⊆Q, the matrix cone M(K1,K2)M(K_1, K_2)M(K1​,K2​) consists of the (n+1)×(n+1)(n+1)\times(n+1)(n+1)×(n+1) real matrices Y=(yij)Y = (y_{ij})Y=(yij​) such that

  1. YYY is symmetric;
  2. yii=y0iy_{ii} = y_{0i}yii​=y0i​ for 1≤i≤n1 \le i \le n1≤i≤n (the diagonal equals the 0th column);
  3. uTYv≥0u^{\mathsf T} Y v \ge 0uTYv≥0 for every u∈K1∗u \in K_1^*u∈K1∗​ and v∈K2∗v \in K_2^*v∈K2∗​.

M+(K1,K2)M_+(K_1, K_2)M+​(K1​,K2​) adds the condition that YYY is positive semidefinite. The projections are N(K1,K2)={Ye0:Y∈M(K1,K2)}N(K_1, K_2) = \{Ye_0 : Y \in M(K_1, K_2)\}N(K1​,K2​)={Ye0​:Y∈M(K1​,K2​)} and N+(K1,K2)={Ye0:Y∈M+(K1,K2)}N_+(K_1, K_2) = \{Ye_0 : Y \in M_+(K_1, K_2)\}N+​(K1​,K2​)={Ye0​:Y∈M+​(K1​,K2​)}, where e0e_0e0​ is the 0th unit vector. The cut operator is N(K)=N(K,Q)N(K) = N(K, Q)N(K)=N(K,Q), and its iterates are N0(K)=KN^0(K) = KN0(K)=K, Nt(K)=N(Nt−1(K))N^t(K) = N(N^{t-1}(K))Nt(K)=N(Nt−1(K)).

Two families of hyperplanes appear in the proofs: Hi={x:xi=0}H_i = \{x : x_i = 0\}Hi​={x:xi​=0} and Gi={x:xi=x0}G_i = \{x : x_i = x_0\}Gi​={x:xi​=x0​}, the hyperplanes through the two opposite facets of QQQ in direction iii.

Formalization targets

Goal: Theorem 1.4

For every closed convex cone K⊆QK \subseteq QK⊆Q,

Nn(K)=K∘.N^n(K) = K^\circ .Nn(K)=K∘.

The statement is uniform in nnn and in KKK: no polyhedrality, no bound on the number of constraints, and no assumption that KKK contains a 0–1 point.

Milestones

  1. Condition (iii″). For a closed convex cone K⊆QK \subseteq QK⊆Q and a symmetric YYY with yii=y0iy_{ii} = y_{0i}yii​=y0i​: Y∈M(K,Q)Y \in M(K, Q)Y∈M(K,Q) if and only if every column of YYY is in KKK and the difference of the first column and any other column is in KKK.
  2. Lemma 1.1. For closed convex cones K1,K2⊆QK_1, K_2 \subseteq QK1​,K2​⊆Q,
(K1∩K2)∘⊆N+(K1,K2)⊆N(K1,K2)⊆K1∩K2.(K_1 \cap K_2)^\circ \subseteq N_+(K_1, K_2) \subseteq N(K_1, K_2) \subseteq K_1 \cap K_2 .(K1​∩K2​)∘⊆N+​(K1​,K2​)⊆N(K1​,K2​)⊆K1​∩K2​.
  1. Lemma 1.3. For a closed convex cone K⊆QK \subseteq QK⊆Q and every 1≤i≤n1 \le i \le n1≤i≤n,
N(K)⊆(K∩Hi)+(K∩Gi).N(K) \subseteq (K \cap H_i) + (K \cap G_i).N(K)⊆(K∩Hi​)+(K∩Gi​).
  1. Claim (4) in the proof of Theorem 1.4. For every set TTT of t≥1t \ge 1t≥1 coordinates, with Fˉ\bar FFˉ the union of the faces of the unit cube that fix the coordinates in TTT to 000 or 111,
Nt(K)⊆cone⁡(K∩Fˉ).N^t(K) \subseteq \operatorname{cone}(K \cap \bar F).Nt(K)⊆cone(K∩Fˉ).
  1. The remark after Lemma 1.1. N(K1∩K2,K1∩K2)⊆N(K1,K2)⊆N(K1∩K2,Q)N(K_1 \cap K_2, K_1 \cap K_2) \subseteq N(K_1, K_2) \subseteq N(K_1 \cap K_2, Q)N(K1​∩K2​,K1​∩K2​)⊆N(K1​,K2​)⊆N(K1​∩K2​,Q).

Significance

Theorem 1.4 is what makes NNN a hierarchy rather than a single cut: the relaxations K⊇N(K)⊇N2(K)⊇…K \supseteq N(K) \supseteq N^2(K) \supseteq \dotsK⊇N(K)⊇N2(K)⊇… reach the 0–1 hull after at most nnn rounds, so the NNN-rank of a valid inequality (the least ttt with the inequality valid for Nt(K)N^t(K)Nt(K)) is a well-defined number between 000 and nnn. The rest of the paper measures combinatorial constraints by this rank: odd hole constraints have rank one on the stable set polytope, and the rank of a stable set inequality is bounded by its defect. Rank lower bounds for lift-and-project hierarchies, in the literature that followed, all presuppose this finite convergence.

The theorem is proved in the paper; to the best of available knowledge none of the Lovász–Schrijver operators has been formalized in a proof assistant. A formalization provides machine-checked definitions of the matrix cones and the cut operators that later missions in this series (odd holes, the defect bound, the N+N_+N+​ constraints) state their results against, and a checked proof of the column characterization (iii″) that all of those proofs use.

Difficulty

The inclusion K∘⊆Nn(K)K^\circ \subseteq N^n(K)K∘⊆Nn(K) follows from Lemma 1.1 once each Nt(K)N^t(K)Nt(K) is known to be a convex cone. The reverse inclusion is the content. A first attempt shows that one round of NNN forces one coordinate to be integral, and then iterates; but N(K)N(K)N(K) is not contained in the union of K∩HiK \cap H_iK∩Hi​ and K∩GiK \cap G_iK∩Gi​, only in their Minkowski sum (Lemma 1.3), so a point of N(K)N(K)N(K) is not itself integral in any coordinate. The induction must carry a statement about cones spanned by intersections with unions of cube faces, and it needs each iterate Nt(K)N^t(K)Nt(K) to again be a closed convex cone inside QQQ so that Lemma 1.3 can be reapplied. Closedness of the projection N(K)N(K)N(K) is not automatic: a linear image of a closed cone need not be closed.

Formalization scope

  • Coordinates of Rn+1\mathbb R^{n+1}Rn+1 are indexed by Option ι for a finite type ι; none is x0x_0x0​ and some i is xix_ixi​, and nnn is the cardinality of ι, which may be 000.
  • cone⁡(S)\operatorname{cone}(S)cone(S) is Mathlib's PointedCone.hull ℝ S; QQQ and K∘K^\circK∘ are defined as spans of 0–1 vectors, as on the page, not by the inequality description 0≤xi≤x00 \le x_i \le x_00≤xi​≤x0​.
  • M(K1,K2)M(K_1, K_2)M(K1​,K2​) is defined by condition (iii) through the polar cones; the column form (iii″) is a milestone, not the definition.
  • The operators NNN, N+N_+N+​ and the iterates are defined on arbitrary sets; the hypotheses (convex cone, contained in QQQ, closed) are carried by the theorems.
  • Closedness. The paper tacitly takes its cones closed (they are polyhedral in all its applications), and the rewriting (iii′) on p. 169 needs it. Every statement here assumes the cones closed. Without this the goal is false: for K={x:0<x1<x0}∪{0}K = \{x : 0 < x_1 < x_0\} \cup \{0\}K={x:0<x1​<x0​}∪{0} in R2\mathbb R^2R2, K∘={0}K^\circ = \{0\}K∘={0} while N(K)=QN(K) = QN(K)=Q.
  • In the proof of Theorem 1.4 the page places the cube Q′Q'Q′ in the hyperplane "x0=0x_0 = 0x0​=0"; this is a misprint for x0=1x_0 = 1x0​=1, and claim (4) is formalized with x0=1x_0 = 1x0​=1.
  • Not formalized in this mission: Lemma 1.2 (the dual description of N(K)∗N(K)^*N(K)∗), Lemma 1.5 (the N+N_+N+​ analogue of Lemma 1.3, part of a later mission), and the algorithmic results of Section 1.c.

Contributions welcome: proofs that N(K)N(K)N(K) is a closed convex cone contained in QQQ whenever KKK is, a proof of Q∗=cone⁡{ei,e0−ei}Q^* = \operatorname{cone}\{e_i, e_0 - e_i\}Q∗=cone{ei​,e0​−ei​}, and lemmas on cones spanned by the intersection of a generating set with a supporting hyperplane; these are reusable by the other missions of the series.

Selected references

  • L. Lovász and A. Schrijver, Cones of matrices and set-functions and 0–1 optimization, SIAM Journal on Optimization 1(2) (1991) 166–190. https://doi.org/10.1137/0801013
  • H. D. Sherali and W. P. Adams, A hierarchy of relaxations between the continuous and convex hull representations for zero-one programming problems, SIAM Journal on Discrete Mathematics 3(3) (1990) 411–430. https://doi.org/10.1137/0403036
  • J. B. Lasserre, Global optimization with polynomials and the problem of moments, SIAM Journal on Optimization 11(3) (2001) 796–817. https://doi.org/10.1137/S1052623400366802
  • M. Laurent, A comparison of the Sherali–Adams, Lovász–Schrijver, and Lasserre relaxations for 0–1 programming, Mathematics of Operations Research 28(3) (2003) 470–496. https://doi.org/10.1287/moor.28.3.470.16391
8 thms3 active usersReviewed
🏆Completed
Numerical AnalysisOperations ResearchOptimization·Captain: mikedeng1

Golden Ratio Algorithms for Variational Inequalities I: The Golden Ratio Algorithm with a Fixed Step Converges to a Solution of a Monotone Variational InequalityResearch Paper

Motivation

A monotone variational inequality asks for a point at which a monotone operator and a convex function are in equilibrium. It unifies convex minimization (where FFF is a gradient), convex–concave saddle-point problems (where FFF is the skew gradient of a Lagrangian), Nash equilibria of monotone games, and complementarity problems in economics and traffic assignment. In operations research, first-order methods for such problems are the workhorse behind large-scale saddle-point formulations of linear and conic programs, where only one operator evaluation and one projection or proximal step per iteration are affordable.

The classical method for Lipschitz monotone operators is Korpelevich's extragradient method (1976) and its proximal variant, Tseng's forward–backward–forward method (2000); both need two evaluations of FFF per iteration. The reflected projected gradient method of Malitsky (SIAM J. Optim., 2015) uses one evaluation of FFF but evaluates it at 2zk−zk−12z^k-z^{k-1}2zk−zk−1, a point that may lie outside the domain of ggg. Malitsky's Golden Ratio Algorithm (GRAAL), introduced in Golden Ratio Algorithms for Variational Inequalities (preprint 2018; published in Mathematical Programming, doi:10.1007/s10107-019-01416-w), uses one evaluation of FFF, always at a feasible point, and one proximal step per iteration. Its fixed-step version, Theorem 1 of that paper, is the subject of this mission; the explicit, adaptive-step version (Theorem 2) is a separate mission of this series.

Setting

Let E\mathcal EE be a finite-dimensional real inner product space with inner product ⟨⋅,⋅⟩\langle\cdot,\cdot\rangle⟨⋅,⋅⟩ and norm ∥⋅∥=⟨⋅,⋅⟩\|\cdot\| = \sqrt{\langle\cdot,\cdot\rangle}∥⋅∥=⟨⋅,⋅⟩​. Let g:E→(−∞,+∞]g:\mathcal E\to(-\infty,+\infty]g:E→(−∞,+∞] and write dom⁡g={x:g(x)<+∞}\operatorname{dom} g = \{x : g(x)<+\infty\}domg={x:g(x)<+∞}. Let F:dom⁡g→EF:\operatorname{dom} g\to\mathcal EF:domg→E. The variational inequality is

find z∗∈Esuch that⟨F(z∗),z−z∗⟩+g(z)−g(z∗) ≥ 0∀z∈E.(1)\text{find } z^*\in\mathcal E \quad\text{such that}\quad \langle F(z^*), z-z^*\rangle + g(z)-g(z^*)\ \ge\ 0\qquad \forall z\in\mathcal E. \tag{1}find z∗∈Esuch that⟨F(z∗),z−z∗⟩+g(z)−g(z∗) ≥ 0∀z∈E.(1)

The standing assumptions are:

  • (C1) the solution set SSS of (1) is nonempty;
  • (C2) ggg is proper (never −∞-\infty−∞, finite somewhere), convex, and lower semicontinuous;
  • (C3) FFF is monotone: ⟨F(u)−F(v),u−v⟩≥0\langle F(u)-F(v),u-v\rangle\ge0⟨F(u)−F(v),u−v⟩≥0 for all u,v∈dom⁡gu,v\in\operatorname{dom} gu,v∈domg.

The proximal operator of ggg is prox⁡g(z)=argmin⁡x{g(x)+12∥x−z∥2}\operatorname{prox}_g(z) = \operatorname{argmin}_x\{g(x)+\tfrac12\|x-z\|^2\}proxg​(z)=argminx​{g(x)+21​∥x−z∥2}. Let φ=5+12\varphi = \frac{\sqrt5+1}{2}φ=25​+1​ be the golden ratio, so that φ2=1+φ\varphi^2 = 1+\varphiφ2=1+φ. For a step λ>0\lambda>0λ>0 and arbitrary starting points z1,zˉ0∈Ez^1,\bar z^0\in\mathcal Ez1,zˉ0∈E, the Golden Ratio Algorithm generates, for k≥1k\ge1k≥1,

zˉk=(φ−1)zk+zˉk−1φ,zk+1=prox⁡λg(zˉk−λF(zk)).(6)\bar z^k = \frac{(\varphi-1)z^k + \bar z^{k-1}}{\varphi},\qquad z^{k+1} = \operatorname{prox}_{\lambda g}\big(\bar z^k - \lambda F(z^k)\big). \tag{6}zˉk=φ(φ−1)zk+zˉk−1​,zk+1=proxλg​(zˉk−λF(zk)).(6)

The first line is a convex combination of the newest iterate and the previous average; the second is a forward–backward step taken from the average rather than from zkz^kzk.

Formalization targets

Goal: Theorem 1

If FFF is LLL-Lipschitz on dom⁡g\operatorname{dom} gdomg (L>0L>0L>0), (C1)–(C3) hold, and λ∈(0,φ2L]\lambda\in\big(0,\frac{\varphi}{2L}\big]λ∈(0,2Lφ​], then there is z∗∈Sz^*\in Sz∗∈S with

zk→z∗andzˉk→z∗(k→∞).z^k\to z^*\qquad\text{and}\qquad \bar z^k\to z^*\qquad(k\to\infty).zk→z∗andzˉk→z∗(k→∞).

Both sequences converge, to one and the same solution. The goal is stated with the paper's exact step range; no rate is claimed, as the paper claims none.

Milestones

  1. Eq. (4), the prox-inequality: for proper convex lsc ggg,
xˉ=prox⁡gz  ⟺  ⟨xˉ−z,x−xˉ⟩≥g(xˉ)−g(x)∀x∈E.\bar x = \operatorname{prox}_g z \iff \langle\bar x - z, x-\bar x\rangle\ge g(\bar x)-g(x)\quad\forall x\in\mathcal E.xˉ=proxg​z⟺⟨xˉ−z,x−xˉ⟩≥g(xˉ)−g(x)∀x∈E.
  1. Eq. (12), an identity using only the averaging step of (6): for every point z∗z^*z∗,
∥zk+1−z∗∥2=(1+φ)∥zˉk+1−z∗∥2−φ∥zˉk−z∗∥2+1φ∥zk+1−zˉk∥2.\|z^{k+1}-z^*\|^2 = (1+\varphi)\|\bar z^{k+1}-z^*\|^2-\varphi\|\bar z^k-z^*\|^2+\tfrac1\varphi\|z^{k+1}-\bar z^k\|^2 .∥zk+1−z∗∥2=(1+φ)∥zˉk+1−z∗∥2−φ∥zˉk−z∗∥2+φ1​∥zk+1−zˉk∥2.
  1. Eq. (14), the energy inequality: for z∗∈Sz^*\in Sz∗∈S and k≥2k\ge2k≥2,
(1+φ)∥zˉk+1−z∗∥2+φ2∥zk+1−zk∥2≤(1+φ)∥zˉk−z∗∥2+φ2∥zk−zk−1∥2−φ∥zk−zˉk∥2.(1+\varphi)\|\bar z^{k+1}-z^*\|^2+\tfrac\varphi2\|z^{k+1}-z^k\|^2\le(1+\varphi)\|\bar z^k-z^*\|^2+\tfrac\varphi2\|z^k-z^{k-1}\|^2-\varphi\|z^k-\bar z^k\|^2 .(1+φ)∥zˉk+1−z∗∥2+2φ​∥zk+1−zk∥2≤(1+φ)∥zˉk−z∗∥2+2φ​∥zk−zk−1∥2−φ∥zk−zˉk∥2.
  1. Lemma 1 (Bauschke–Combettes, Theorem 5.5): a sequence that is Fejér monotone with respect to a nonempty set CCC and whose cluster points all lie in CCC converges to a point of CCC.

Significance

The result. Theorem 1 shows that monotone variational inequalities with a Lipschitz operator can be solved with one operator evaluation and one proximal step per iteration, with FFF evaluated only at points of dom⁡g\operatorname{dom} gdomg, where it is defined. This matters when FFF is expensive (a large matrix–vector product, a simulation) or undefined outside the feasible set (for instance an operator involving log⁡x\log xlogx on the positive orthant). The analysis also explains the constant: the averaging weight φ\varphiφ is the largest ccc with 1/c≥c−11/c\ge c-11/c≥c−1, and the step bound φ/(2L)\varphi/(2L)φ/(2L) follows from it. The fixed-step analysis is the template for the explicit, adaptive-step EGRAAL of the same paper (Theorem 2), which needs only local Lipschitz continuity of FFF.

The formalization. The theorem has a published proof, and no machine-checked version of it or of GRAAL is known. Mathlib contains the golden ratio, Lipschitz conditions, lower semicontinuity and cluster points, but no proximal operator of an extended-valued function, no prox-inequality and no Fejér-monotonicity convergence lemma. This mission produces those pieces and a complete convergence proof for a first-order VI method, which are reusable for projected gradient, forward–backward, extragradient and reflected-gradient analyses.

Difficulty

The naive approach, to show that ∥zk−z∗∥\|z^k-z^*\|∥zk−z∗∥ decreases, fails: GRAAL is not Fejér monotone in zkz^kzk, because the forward step is taken from the average zˉk\bar z^kzˉk and uses F(zk)F(z^k)F(zk) rather than FFF at the new point. The quantity that decreases is an energy mixing ∥zˉk−z∗∥2\|\bar z^k-z^*\|^2∥zˉk−z∗∥2 with the successive difference ∥zk−zk−1∥2\|z^k-z^{k-1}\|^2∥zk−zk−1∥2, and both the averaging identity and the Lipschitz estimate must produce matching coefficients for the cross terms to cancel. The energy inequality alone gives only boundedness and vanishing successive differences; convergence of the whole sequence, and the fact that the limit solves (1) when ggg is merely lower semicontinuous and extended-valued, is a separate step. On the formal side, ggg takes the value +∞+\infty+∞, so the prox-inequality and the variational inequality must be handled in extended arithmetic without letting ∞−∞\infty-\infty∞−∞ decide anything.

Formalization scope

  • E\mathcal EE is a type E with [NormedAddCommGroup E] [InnerProductSpace ℝ E] [FiniteDimensional ℝ E].
  • ggg is E → EReal. (C2) is IsProperConvexLSC g: never ⊥\bot⊥, somewhere finite, convex epigraph {(x,t)∈E×R:g(x)≤t}\{(x,t)\in E\times\mathbb R: g(x)\le t\}{(x,t)∈E×R:g(x)≤t}, and LowerSemicontinuous g on all of E. dom⁡g\operatorname{dom} gdomg is effDom g = {x | g x ≠ ⊤}.
  • FFF is a total function E → E; monotonicity and the Lipschitz bound ∥F(u)−F(v)∥≤L∥u−v∥\|F(u)-F(v)\|\le L\|u-v\|∥F(u)−F(v)∥≤L∥u−v∥ are required on effDom g only. The step range is 0 < λ, λ ≤ φ / (2 * L) with 0 < L and φ = Real.goldenRatio.
  • SSS is solutionSet g F: points of effDom g satisfying (1) for every z∈Ez\in Ez∈E, evaluated in EReal.
  • The proximal step is the argmin predicate IsProxPoint (fun x => λ * g x) w z⁺, not a choice function, so no junk value is involved. A run of (6) is IsGRAALRun g F λ z zbar on sequences ℕ → E indexed as in the paper: z1z^1z1 and zˉ0\bar z^0zˉ0 are free and the entry z0z^0z0 is unused.
  • The conclusion is ∃ zs ∈ solutionSet g F, Tendsto z atTop (𝓝 zs) ∧ Tendsto zbar atTop (𝓝 zs).

The hypotheses of the goal are jointly satisfiable, so the theorem is not vacuous: for g≡0g\equiv0g≡0 and F≡0F\equiv0F≡0 every point is a solution and constant sequences form a run of (6); a formalization under which IsGRAALRun has no instances, or in which SSS may be empty, is ruled out. Two hypotheses are added to printed statements and flagged in their notes: C≠∅C\neq\emptysetC=∅ in Lemma 1, which is false without it, and z1∈dom⁡gz^1\in\operatorname{dom} gz1∈domg in Eq. (14), needed at k=2k=2k=2 because the paper's FFF is only defined on dom⁡g\operatorname{dom} gdomg.

Welcome contributions: existence and uniqueness of the proximal point of a proper convex lsc function in finite dimensions; the prox-inequality; Fejér-monotonicity lemmas; the energy inequality; and the final convergence argument. The prox and Fejér infrastructure is independent of the golden ratio and is shared with the second mission of this series.

Selected references

  • Y. Malitsky, Golden Ratio Algorithms for Variational Inequalities, preprint, Optimization Online 6598, 2018. https://optimization-online.org/wp-content/uploads/2018/05/6598.pdf ; published in Mathematical Programming. https://doi.org/10.1007/s10107-019-01416-w
  • H. H. Bauschke, P. L. Combettes, Convex Analysis and Monotone Operator Theory in Hilbert Spaces, Springer, 2011 (2nd ed. 2017). https://doi.org/10.1007/978-3-319-48311-5
  • G. M. Korpelevich, The extragradient method for finding saddle points and other problems, Ekonomika i Matematicheskie Metody 12 (1976) 747–756.
  • P. Tseng, A modified forward–backward splitting method for maximal monotone mappings, SIAM J. Control Optim. 38 (2000) 431–446. https://doi.org/10.1137/S0363012998338806
  • Y. Malitsky, Projected reflected gradient methods for monotone variational inequalities, SIAM J. Optim. 25 (2015) 502–520. https://doi.org/10.1137/14097238X
8 thms3 active usersReviewed
🏆Completed
Machine LearningNumerical AnalysisOptimization·Captain: mikedeng1

Proximal Newton-Type Methods for Minimizing Composite Functions II: Local Linear and Superlinear Convergence of the Inexact Proximal Newton MethodResearch Paper

Motivation

Many estimation problems in statistics, signal processing and bioinformatics minimize a composite function f=g+hf = g + hf=g+h: a smooth convex loss ggg plus a convex but nonsmooth penalty or constraint hhh, such as the lasso's ℓ1\ell_1ℓ1​ norm or the indicator of a convex set. Proximal Newton-type methods handle such problems by minimizing, at each iterate xkx_kxk​, a model f^k=g^k+h\hat f_k = \hat g_k + hf^​k​=g^​k​+h in which ggg is replaced by its second-order Taylor expansion. Widely used solvers of this kind (glmnet, newGLMNET, QUIC) never solve these model subproblems exactly; they stop an inner iterative solver early by some heuristic. Lee, Sun and Saunders (arXiv:1206.1623v13, 2014) proposed an adaptive stopping rule for the inner solver and proved that it preserves fast local convergence. This mission formalizes that local convergence theory (§3.4 of the paper).

Timeline:

  • 1982: Dembo, Eisenstat and Steihaug introduce inexact Newton methods for smooth equations and prove local linear and superlinear convergence under a relative-residual condition with forcing terms ηk\eta_kηk​ (doi:10.1137/0719025).
  • 1996: Eisenstat and Walker propose self-adjusting forcing terms that avoid oversolving (doi:10.1137/0917003).
  • 2012–2014: Lee, Sun and Saunders transfer the relative-residual condition to composite functions, replacing gradients by composite gradient steps, and prove Theorems 3.10 and 3.11.
  • 2016: Byrd, Nocedal and Oztoprak analyze inexact proximal Newton methods for ℓ1\ell_1ℓ1​-regularized problems under an additional sufficient-descent condition on the subproblem (doi:10.1007/s10107-015-0941-y).

Setting

Work in Rn\mathbb R^nRn with the Euclidean inner product. The smooth part g:Rn→Rg:\mathbb R^n\to\mathbb Rg:Rn→R is twice continuously differentiable and strongly convex with constant m>0m>0m>0: g(y)≥g(x)+∇g(x)T(y−x)+m2∥x−y∥2g(y)\ge g(x)+\nabla g(x)^T(y-x)+\frac m2\|x-y\|^2g(y)≥g(x)+∇g(x)T(y−x)+2m​∥x−y∥2 for all x,yx,yx,y. Its gradient ∇g\nabla g∇g is Lipschitz with constant L1L_1L1​, its Hessian ∇2g\nabla^2 g∇2g is Lipschitz with constant L2L_2L2​, and ∇2g(x)⪯MI\nabla^2 g(x)\preceq MI∇2g(x)⪯MI for a constant M>0M>0M>0. The nonsmooth part hhh is proper, closed and convex, and may take the value +∞+\infty+∞; it is given by its domain DDD and its values on DDD. The problem is min⁡xf(x)=g(x)+h(x)\min_x f(x)=g(x)+h(x)minx​f(x)=g(x)+h(x), and x⋆x^\starx⋆ denotes its (unique) optimal solution.

The proximal mapping of hhh is prox⁡h(v)=arg⁡min⁡yh(y)+12∥y−v∥2\operatorname{prox}_h(v)=\arg\min_y h(y)+\frac12\|y-v\|^2proxh​(v)=argminy​h(y)+21​∥y−v∥2. The composite gradient step with step length t>0t>0t>0 is

Gtf(x)=1t(x−prox⁡th(x−t∇g(x))),G_{tf}(x)=\tfrac1t\big(x-\operatorname{prox}_{th}(x-t\nabla g(x))\big),Gtf​(x)=t1​(x−proxth​(x−t∇g(x))),

with Gf=G1fG_f=G_{1f}Gf​=G1f​; it vanishes exactly at minimizers of fff and plays the role of the gradient. The step Gf/MG_{f/M}Gf/M​ is the unit step on f/M=g/M+h/Mf/M=g/M+h/Mf/M=g/M+h/M. The model at xkx_kxk​ is f^k=g^k+h\hat f_k=\hat g_k+hf^​k​=g^​k​+h with g^k(y)=g(xk)+∇g(xk)T(y−xk)+12(y−xk)T∇2g(xk)(y−xk)\hat g_k(y)=g(x_k)+\nabla g(x_k)^T(y-x_k)+\frac12(y-x_k)^T\nabla^2 g(x_k)(y-x_k)g^​k​(y)=g(xk​)+∇g(xk​)T(y−xk​)+21​(y−xk​)T∇2g(xk​)(y−xk​).

The inexact proximal Newton method with unit step lengths produces xk+1=xk+Δxkx_{k+1}=x_k+\Delta x_kxk+1​=xk​+Δxk​, where the direction Δxk\Delta x_kΔxk​ is any point satisfying the adaptive stopping condition

∥Gf^k/M(xk+Δxk)∥≤ηk ∥Gf/M(xk)∥(2.24)\|G_{\hat f_k/M}(x_k+\Delta x_k)\|\le\eta_k\,\|G_{f/M}(x_k)\|\qquad(2.24)∥Gf^​k​/M​(xk​+Δxk​)∥≤ηk​∥Gf/M​(xk​)∥(2.24)

for a forcing term ηk≥0\eta_k\ge0ηk​≥0. The Eisenstat–Walker choice is

ηk=min⁡{m2, ∥Gf^k−1/M(xk)−Gf/M(xk)∥∥Gf/M(xk−1)∥}.(2.25)\eta_k=\min\Big\{\frac m2,\ \frac{\|G_{\hat f_{k-1}/M}(x_k)-G_{f/M}(x_k)\|}{\|G_{f/M}(x_{k-1})\|}\Big\}.\qquad(2.25)ηk​=min{2m​, ∥Gf/M​(xk−1​)∥∥Gf^​k−1​/M​(xk​)−Gf/M​(xk​)∥​}.(2.25)

Formalization targets

Goal: Theorem 3.10 (p. 17)

  1. There are ηˉ∈(0,m/2)\bar\eta\in(0,m/2)ηˉ​∈(0,m/2), δ>0\delta>0δ>0 and r∈[0,1)r\in[0,1)r∈[0,1) such that, whenever 0≤ηk≤ηˉ0\le\eta_k\le\bar\eta0≤ηk​≤ηˉ​ for all kkk and ∥x0−x⋆∥<δ\|x_0-x^\star\|<\delta∥x0​−x⋆∥<δ,
∥xk+1−x⋆∥≤r ∥xk−x⋆∥for all k.\|x_{k+1}-x^\star\|\le r\,\|x_k-x^\star\|\quad\text{for all }k.∥xk+1​−x⋆∥≤r∥xk​−x⋆∥for all k.
  1. For every forcing sequence with ηk≥0\eta_k\ge0ηk​≥0, ηk→0\eta_k\to0ηk​→0, there is δ>0\delta>0δ>0 such that every run with ∥x0−x⋆∥<δ\|x_0-x^\star\|<\delta∥x0​−x⋆∥<δ converges to x⋆x^\starx⋆ q-superlinearly: for every ε>0\varepsilon>0ε>0, eventually ∥xk+1−x⋆∥≤ε∥xk−x⋆∥\|x_{k+1}-x^\star\|\le\varepsilon\|x_k-x^\star\|∥xk+1​−x⋆∥≤ε∥xk​−x⋆∥.

Both parts are asserted together. The statement fixes no constant beyond the existence of ηˉ\bar\etaηˉ​, δ\deltaδ and rrr.

Milestones

  • §2.1, property 3: Gf(x)=0G_f(x)=0Gf​(x)=0 if and only if xxx minimizes fff.
  • Lemma 2.2: ∥Gf(x)∥≤(L1+1)∥x−x⋆∥\|G_f(x)\|\le(L_1+1)\|x-x^\star\|∥Gf​(x)∥≤(L1​+1)∥x−x⋆∥.
  • Lemma 3.8: ∥Gf(x)−Gf^k(x)∥≤L22∥x−xk∥2\|G_f(x)-G_{\hat f_k}(x)\|\le\frac{L_2}2\|x-x_k\|^2∥Gf​(x)−Gf^​k​​(x)∥≤2L2​​∥x−xk​∥2.
  • Lemma 3.9: (x−y)T(Gtf(x)−Gtf(y))≥m2∥x−y∥2(x-y)^T(G_{tf}(x)-G_{tf}(y))\ge\frac m2\|x-y\|^2(x−y)T(Gtf​(x)−Gtf​(y))≥2m​∥x−y∥2 for 0<t≤1/L10<t\le1/L_10<t≤1/L1​.
  • Theorem 3.11: with the forcing terms (2.25), the method converges q-superlinearly from every start sufficiently close to x⋆x^\starx⋆.

Significance

Theorem 3.10 justifies stopping the inner solver of a proximal Newton method at a relative accuracy that is set by the current optimality measure ∥Gf/M(xk)∥\|G_{f/M}(x_k)\|∥Gf/M​(xk​)∥: a constant small forcing term keeps linear convergence, and forcing terms that decay to zero recover superlinear convergence, with no sufficient-descent condition on the subproblem and for a generic nonsmooth hhh. Theorem 3.11 shows that the self-adjusting choice (2.25) achieves the superlinear regime automatically. Together they are the composite analogue of the inexact Newton theory used in most large-scale smooth solvers.

The results are proved in the paper. No machine-checked proof of any of them is known, and the platform contains no proximal mapping, composite gradient step or inexact Newton condition. A formalization adds a checked proximal-operator toolkit (existence and nonexpansiveness of prox⁡\operatorname{prox}prox, the optimality characterization of GfG_fGf​, strong monotonicity of GtfG_{tf}Gtf​) and a precise form of the theorem: the paper's proofs mix two scalings of the composite step and cite a lemma where another is meant, so the formal proof settles which constants are valid.

Difficulty

The obvious argument compares the inexact step with the exact proximal Newton step and treats the gap as a perturbation. For composite functions this fails: the exact step is defined by a nonsmooth inclusion, and the stopping condition bounds a residual of the model's composite gradient step, not the distance to the model's minimizer. The link between the two is strong monotonicity of the composite gradient step (Lemma 3.9), which requires controlling the proximal mapping of a general closed convex hhh jointly with the curvature of ggg; for h=0h=0h=0 it is immediate, and for general hhh it is the central step. A second difficulty is that the threshold on ηk\eta_kηk​ is not scale invariant: a threshold below m/2m/2m/2 chosen arbitrarily does not give convergence, so the admissible ηˉ\bar\etaηˉ​ has to come out of the analysis.

Formalization scope

The space is EuclideanSpace ℝ (Fin n). The nonsmooth part is a pair (D,h)(D,h)(D,h): DDD nonempty and convex, hhh convex on DDD, and the extended function (hhh on DDD, +∞+\infty+∞ off DDD) lower semicontinuous; indicator functions of closed convex sets are included. The proximal mapping is a total function chosen among the minimizers over DDD, which exist uniquely under these hypotheses. Gf/MG_{f/M}Gf/M​, Gf^k/MG_{\hat f_k/M}Gf^​k​/M​ and GtfG_{tf}Gtf​ are functions of the split (g,D,h)(g,D,h)(g,D,h) and a scalar, never of fff alone. The Hessian is the derivative of the gradient map, measured in operator norm. Sequences are indexed from k=0k=0k=0; a run requires x0∈Dx_0\in Dx0​∈D and xk+Δxk∈Dx_k+\Delta x_k\in Dxk​+Δxk​∈D. Rates are stated without quotients.

"x0x_0x0​ sufficiently close to x⋆x^\starx⋆" is an existential radius chosen before the run; assuming xk→x⋆x_k\to x^\starxk​→x⋆, letting the radius depend on the run, or reading part 1 as "for every ηˉ<m/2\bar\eta<m/2ηˉ​<m/2" (which is false: g(x)=2x2g(x)=2x^2g(x)=2x2, h=0h=0h=0, ηk≡32\eta_k\equiv\frac32ηk​≡23​ diverges) are ruled out. The forcing sequence of Theorem 3.10 is fixed in advance; that of Theorem 3.11 depends on the iterates through (2.25), with a free first term η0∈[0,m/2]\eta_0\in[0,m/2]η0​∈[0,m/2].

A complete development needs existence, uniqueness and firm nonexpansiveness of the proximal mapping of an extended-valued closed convex function, the subgradient characterization of prox⁡\operatorname{prox}prox, and a second-order Taylor bound for C2C^2C2 functions with Lipschitz Hessian. These are reusable well beyond this mission. Contributions of any of them, of the milestones, or of alternative proofs of Lemma 3.9 are welcome.

Selected references

  • J. D. Lee, Y. Sun, M. A. Saunders, Proximal Newton-type methods for minimizing composite functions, arXiv:1206.1623v13, 2014; SIAM J. Optim. 24(3), 2014. https://arxiv.org/abs/1206.1623
  • R. S. Dembo, S. C. Eisenstat, T. Steihaug, Inexact Newton methods, SIAM J. Numer. Anal. 19(2), 1982. https://doi.org/10.1137/0719025
  • S. C. Eisenstat, H. F. Walker, Choosing the forcing terms in an inexact Newton method, SIAM J. Sci. Comput. 17(1), 1996. https://doi.org/10.1137/0917003
  • R. H. Byrd, J. Nocedal, F. Oztoprak, An inexact successive quadratic approximation method for L-1 regularized optimization, Math. Program. 157, 2016. https://doi.org/10.1007/s10107-015-0941-y
9 thms3 active usersReviewed
🏆Completed
Machine LearningNumerical AnalysisOptimization·Captain: mikedeng1

Proximal Newton-Type Methods for Minimizing Composite Functions I: Proximal Quasi-Newton Methods Converge Q-Superlinearly under the Dennis–Moré CriterionResearch Paper

Motivation

Many estimation problems in statistics, machine learning and signal processing minimize a composite function, the sum of a smooth loss and a convex but nonsmooth regularizer or constraint: the lasso and ℓ1\ell_1ℓ1​-regularized logistic regression, the graphical lasso for sparse inverse covariance estimation, and constrained least squares, where the nonsmooth part is the indicator function of a convex set. First-order proximal gradient methods (ISTA, FISTA, SpaRSA) are the standard tools, and their convergence is at best linear. Practical solvers such as glmnet, newGLMNET and QUIC instead minimize a local quadratic model of the smooth part plus the nonsmooth part at every iteration, and in practice they need far fewer iterations.

Lee, Sun and Saunders (arXiv:1206.1623, SIAM J. Optim. 2014) put these methods into one framework, proximal Newton-type methods, and proved that they inherit the local convergence rates of Newton and quasi-Newton methods for smooth problems. This mission formalizes the exact-subproblem half of their analysis, ending with q-superlinear convergence of proximal quasi-Newton methods whose Hessian approximations satisfy the Dennis–Moré criterion.

Timeline. Dennis and Moré (1974) characterized superlinear convergence of quasi-Newton methods for smooth equations and minimization by what is now called the Dennis–Moré condition. Tseng and Yun (2009) analyzed coordinate gradient descent for composite problems with a scaled quadratic model. Byrd, Nocedal and Oztoprak (2013) studied inexact proximal Newton methods for ℓ1\ell_1ℓ1​-regularized problems. Lee, Sun and Saunders (2012–2014) proved quadratic and superlinear local convergence for a generic closed convex hhh.

Setting

The problem is

min⁡x∈Rnf(x):=g(x)+h(x).(1.1)\min_{x\in\mathbb R^n} f(x) := g(x) + h(x). \qquad (1.1)x∈Rnmin​f(x):=g(x)+h(x).(1.1)

The smooth part g:Rn→Rg:\mathbb R^n\to\mathbb Rg:Rn→R is twice continuously differentiable and strongly convex with constant m>0m>0m>0, meaning g(y)≥g(x)+∇g(x)T(y−x)+m2∥x−y∥2g(y)\ge g(x)+\nabla g(x)^T(y-x)+\tfrac m2\|x-y\|^2g(y)≥g(x)+∇g(x)T(y−x)+2m​∥x−y∥2 for all x,yx,yx,y (Definition 3.2). Its gradient ∇g\nabla g∇g and Hessian ∇2g\nabla^2 g∇2g are Lipschitz continuous with constants L1L_1L1​ and L2L_2L2​. The nonsmooth part hhh is a proper closed convex function that may take the value +∞+\infty+∞. Its effective domain D=dom⁡hD=\operatorname{dom} hD=domh is nonempty and convex, and x⋆x^\starx⋆ denotes the optimal solution of (1.1), which is unique by strong convexity.

At an iterate xkx_kxk​ the method chooses a symmetric positive definite matrix HkH_kHk​ and computes the search direction Δxk\Delta x_kΔxk​, the minimizer of the model subproblem

Δxk=arg⁡min⁡d ∇g(xk)Td+12dTHkd+h(xk+d).(2.9)\Delta x_k=\arg\min_d\ \nabla g(x_k)^Td+\tfrac12 d^TH_kd+h(x_k+d). \qquad (2.9)Δxk​=argdmin​ ∇g(xk​)Td+21​dTHk​d+h(xk​+d).(2.9)

The predicted decrease is λk=∇g(xk)TΔxk+h(xk+Δxk)−h(xk)\lambda_k=\nabla g(x_k)^T\Delta x_k+h(x_k+\Delta x_k)-h(x_k)λk​=∇g(xk​)TΔxk​+h(xk​+Δxk​)−h(xk​). A step length ttt satisfies the sufficient descent condition (2.19) if f(xk+tΔxk)≤f(xk)+αtλkf(x_k+t\Delta x_k)\le f(x_k)+\alpha t\lambda_kf(xk​+tΔxk​)≤f(xk​)+αtλk​ for a fixed α∈(0,12)\alpha\in(0,\tfrac12)α∈(0,21​). A backtracking line search with factor β∈(0,1)\beta\in(0,1)β∈(0,1) takes tk=βjt_k=\beta^{j}tk​=βj for the least j≥0j\ge0j≥0 that passes, so the unit step is tried first. The update is xk+1=xk+tkΔxkx_{k+1}=x_k+t_k\Delta x_kxk+1​=xk​+tk​Δxk​ (Algorithm 1). With Hk=∇2g(xk)H_k=\nabla^2 g(x_k)Hk​=∇2g(xk​) this is the proximal Newton method. With any other choice of HkH_kHk​ it is a proximal quasi-Newton method. The sequence {Hk}\{H_k\}{Hk​} satisfies the Dennis–Moré criterion if

∥(Hk−∇2g(x⋆))(xk+1−xk)∥∥xk+1−xk∥→0.(3.2)\frac{\|(H_k-\nabla^2 g(x^\star))(x_{k+1}-x_k)\|}{\|x_{k+1}-x_k\|}\to0. \qquad (3.2)∥xk+1​−xk​∥∥(Hk​−∇2g(x⋆))(xk+1​−xk​)∥​→0.(3.2)

Formalization targets

Goal: Theorem 3.7

If mI⪯Hk⪯MImI\preceq H_k\preceq MImI⪯Hk​⪯MI for all kkk, with 0<m≤M0<m\le M0<m≤M, and {Hk}\{H_k\}{Hk​} satisfies (3.2), then every run of Algorithm 1 from any x0∈Dx_0\in Dx0​∈D satisfies

xk→x⋆,∥xk+1−x⋆∥=o(∥xk−x⋆∥).x_k\to x^\star,\qquad \|x_{k+1}-x^\star\|=o(\|x_k-x^\star\|).xk​→x⋆,∥xk+1​−x⋆∥=o(∥xk​−x⋆∥).

The goal fixes no rate constant. It asserts only the shape of the convergence.

Milestones

In the order the proof uses them:

  1. Proposition 2.4: λ≤−ΔxTHΔx\lambda\le-\Delta x^TH\Delta xλ≤−ΔxTHΔx and f(x+tΔx)≤f(x)+tλ+O(t2)f(x+t\Delta x)\le f(x)+t\lambda+O(t^2)f(x+tΔx)≤f(x)+tλ+O(t2).
  2. Proposition 2.5: xxx is optimal if and only if Δx=0\Delta x=0Δx=0 at xxx.
  3. Lemma 2.6: every t≤min⁡{1,(2m/L1)(1−α)}t\le\min\{1,(2m/L_1)(1-\alpha)\}t≤min{1,(2m/L1​)(1−α)} satisfies (2.19).
  4. Theorem 3.1 (global convergence), restated under the assumptions of §3.3: xk→x⋆x_k\to x^\starxk​→x⋆.
  5. Lemma 3.3: the proximal Newton method eventually accepts the unit step.
  6. Theorem 3.4: the proximal Newton method converges q-quadratically, with eventually
∥xk+1−x⋆∥≤L22m∥xk−x⋆∥2.\|x_{k+1}-x^\star\|\le\frac{L_2}{2m}\|x_k-x^\star\|^2 .∥xk+1​−x⋆∥≤2mL2​​∥xk​−x⋆∥2.
  1. Lemma 3.5 / A.1: under (3.2) the unit step is eventually accepted.
  2. Proposition 3.6: ∥Δx1−Δx2∥≤(1+θˉ)/m ∥(H2−H1)Δx1∥1/2∥Δx1∥1/2\|\Delta x_1-\Delta x_2\|\le\sqrt{(1+\bar\theta)/m}\,\|(H_2-H_1)\Delta x_1\|^{1/2}\|\Delta x_1\|^{1/2}∥Δx1​−Δx2​∥≤(1+θˉ)/m​∥(H2​−H1​)Δx1​∥1/2∥Δx1​∥1/2, with θˉ\bar\thetaθˉ depending only on the eigenvalue bounds.

Significance

The result. Theorem 3.7 is the composite counterpart of the Dennis–Moré theorem. It says that the rate of a proximal quasi-Newton method is governed by how well HkH_kHk​ approximates the Hessian of the smooth part along the steps actually taken, whatever the nonsmooth part is. It covers proximal BFGS-type methods for ℓ1\ell_1ℓ1​-regularized and constrained problems, and it explains why solvers built on these methods reach high accuracy in few iterations. Theorem 3.4 gives the corresponding quadratic rate when the exact Hessian is used.

Formalizing it. The results are proved in the paper. None of them has a machine-checked proof: the platform currently has Newton's method only for smooth objectives (Boyd–Vandenberghe's quadratic phase in the mission Convex Optimization V: Newton's Method), and nothing on proximal or composite Newton-type methods. The formalization also settles two defects of the printed text. Theorem 3.1 is false as printed, since it lacks an upper bound on HkH_kHk​: with g(x)=x2/2g(x)=x^2/2g(x)=x2/2, h=0h=0h=0 and Hk=2k+1H_k=2^{k+1}Hk​=2k+1 the iterates stall at about 0.289 x00.289\,x_00.289x0​. It is therefore stated here under the assumptions of §3.3. Proposition 3.6 uses an undefined constant m1m_1m1​ (read as mmm), and the first-order inequalities in its printed proof contain a typo. The explicit constant L2/(2m)L_2/(2m)L2​/(2m) in Theorem 3.4 is the one the paper's proof derives.

Difficulty

The difficulty is the nonsmooth part. For smooth ggg the Newton step solves a linear system, and the classical analysis works with that closed form. Here Δxk\Delta x_kΔxk​ is defined only as the minimizer of a nonsmooth subproblem, and every estimate on it has to come from the optimality of that minimizer, i.e. from the firm nonexpansiveness of scaled proximal maps in a norm that changes with HkH_kHk​. A natural first idea is to apply the smooth Dennis–Moré argument to ∇f\nabla f∇f. It fails because fff is not differentiable and may be +∞+\infty+∞ outside DDD. The superlinear rate also depends on the line search eventually accepting the unit step. That acceptance comes only from a third-order Taylor bound combined with (2.15) and the Dennis–Moré residual, and a line search that may return any admissible step does not give it.

Formalization scope

  • Space. The space is EuclideanSpace ℝ (Fin n), and matrices are continuous linear operators. ∇g\nabla g∇g is Mathlib's gradient, and ∇2g\nabla^2 g∇2g is fderiv ℝ (gradient g). "Positive definite" includes symmetry, and mI⪯H⪯MImI\preceq H\preceq MImI⪯H⪯MI is stated through quadratic forms of a symmetric HHH.
  • The nonsmooth part. hhh is encoded by its domain DDD and its values on DDD: DDD is nonempty and convex, hhh is convex on DDD, and the +∞+\infty+∞-extension of hhh is lower semicontinuous. The objective fff is extended-valued. Only comparisons are made in EReal, never arithmetic. Replacing hhh by a real-valued function on all of Rn\mathbb R^nRn would exclude indicator functions and is not the paper's setting.
  • Algorithm. The search direction is a predicate: it minimizes (2.9) over {d:x+d∈D}\{d : x+d\in D\}{d:x+d∈D}. Backtracking is the least-jjj rule with factor β∈(0,1)\beta\in(0,1)β∈(0,1), the convention of Boyd and Vandenberghe, whom the paper cites for its line search. Runs are infinite and indexed from k=0k=0k=0, with no stopping test.
  • Rates. o(⋅)o(\cdot)o(⋅) and (3.2) are stated without quotients: for every ε>0\varepsilon>0ε>0 the inequality holds eventually.
  • Ruling out trivial versions. A line search allowed to return any step satisfying (2.19) would make Theorems 3.4 and 3.7 false. Taking x⋆x^\starx⋆ to be an arbitrary point instead of the minimizer, or letting θˉ\bar\thetaθˉ in Proposition 3.6 depend on the data, would empty the statements. None of these readings is used.
  • Infrastructure. A complete development needs: existence and uniqueness of minimizers of strongly convex, lower semicontinuous extended functions; first-order optimality for the subproblem; firm nonexpansiveness of scaled proximal maps in the HHH-norm; and second- and third-order Taylor bounds from Lipschitz derivatives. These pieces are reusable across proximal methods. Contributions of any milestone, of these supporting lemmas, or of the goal directly are welcome.

Selected references

  • J. D. Lee, Y. Sun, M. A. Saunders, Proximal Newton-type methods for minimizing composite functions, arXiv:1206.1623v13 (2014); SIAM J. Optim. 24(3), 2014. https://arxiv.org/abs/1206.1623
  • J. E. Dennis, J. J. Moré, A characterization of superlinear convergence and its application to quasi-Newton methods, Math. Comp. 28 (1974), 549–560. https://doi.org/10.1090/S0025-5718-1974-0343581-1
  • P. Tseng, S. Yun, A coordinate gradient descent method for nonsmooth separable minimization, Math. Program. 117 (2009), 387–423. https://doi.org/10.1007/s10107-007-0170-0
  • R. H. Byrd, J. Nocedal, F. Oztoprak, An inexact successive quadratic approximation method for convex L-1 regularized optimization, Math. Program. 157 (2016), 375–396; arXiv:1309.3529. https://arxiv.org/abs/1309.3529
  • S. Boyd, L. Vandenberghe, Convex Optimization, Cambridge University Press, 2004. https://web.stanford.edu/~boyd/cvxbook/
10 thms3 active usersReviewed
🏆Completed
Operations ResearchOptimization·Captain: mikedeng1

Robust Solutions to Uncertain Semidefinite Programs IV: Closed-Form Robust Counterparts under Unstructured PerturbationsResearch Paper

Motivation

A semidefinite program (SDP) minimizes a linear objective cTxc^TxcTx subject to a linear matrix inequality (LMI) F(x)=F0+∑i=1mxiFi⪰0F(x) = F_0 + \sum_{i=1}^m x_i F_i \succeq 0F(x)=F0​+∑i=1m​xi​Fi​⪰0. In applications the coefficient matrices FiF_iFi​ are measured, estimated or rounded. A solution that is feasible for the nominal data can become infeasible for data that differ from it by an arbitrarily small amount.

El Ghaoui, Oustry and Lebret (SIAM J. Optim. 9(1), 1998) introduced robust semidefinite programs (RSDPs): the constraint must hold for every admissible perturbation of the data, and the robust solution is the best point that survives all of them. Their §5 works out the examples in which the robust counterpart has a closed form. The simplest and most widely quoted is the case where every coefficient matrix is perturbed independently and without structure (§5.1): the robust LMI becomes the single convex constraint F(x)⪰2ρ∥x∥2+1 IF(x) \succeq 2\rho\sqrt{\|x\|^2+1}\,IF(x)⪰2ρ∥x∥2+1​I. The same computation gives closed-form robust versions of linear programs (§5.3), of largest-eigenvalue minimization (§5.4) and of matrix-norm minimization (§5.6), each of which is the nominal problem plus a Tikhonov-type term ρ∥x∥2+1\rho\sqrt{\|x\|^2+1}ρ∥x∥2+1​. Robust linear programming under ellipsoidal uncertainty was developed at the same time by Ben-Tal and Nemirovski (Math. Oper. Res., 1998); robust least squares, the prototype of §5.6, by El Ghaoui and Lebret (SIAM J. Matrix Anal. Appl., 1997).

Setting

Fix m,n∈Nm, n \in \mathbb{N}m,n∈N, a level ρ>0\rho > 0ρ>0, and symmetric matrices F0,…,Fm∈Rn×nF_0, \dots, F_m \in \mathbb{R}^{n\times n}F0​,…,Fm​∈Rn×n. For x∈Rmx \in \mathbb{R}^mx∈Rm write F(x)=F0+∑i=1mxiFiF(x) = F_0 + \sum_{i=1}^m x_i F_iF(x)=F0​+∑i=1m​xi​Fi​ and ∥x∥2=∑i=1mxi2\|x\|^2 = \sum_{i=1}^m x_i^2∥x∥2=∑i=1m​xi2​ (the Euclidean norm). For a matrix MMM, ∥M∥\|M\|∥M∥ is its spectral norm, the largest singular value, and X⪰0X \succeq 0X⪰0 means that XXX is symmetric positive semidefinite.

An unstructured perturbation is a block row Δ=[Δ0 ⋯ Δm]\Delta = [\Delta_0 \ \cdots \ \Delta_m]Δ=[Δ0​ ⋯ Δm​] of n×nn\times nn×n blocks, viewed as one n×n(m+1)n \times n(m+1)n×n(m+1) matrix. It perturbs each coefficient independently:

F(x,Δ)=F(x)+Δ0+Δ0T+∑i=1mxi(Δi+ΔiT).\mathbf{F}(x,\Delta) = F(x) + \Delta_0 + \Delta_0^T + \sum_{i=1}^m x_i(\Delta_i + \Delta_i^T).F(x,Δ)=F(x)+Δ0​+Δ0T​+i=1∑m​xi​(Δi​+ΔiT​).

The robust feasible set is

Xρ={x∈Rm:F(x,Δ)⪰0 for every Δ with ∥Δ∥≤ρ},\mathcal{X}_\rho = \{x \in \mathbb{R}^m : \mathbf{F}(x,\Delta) \succeq 0 \text{ for every } \Delta \text{ with } \|\Delta\| \le \rho\},Xρ​={x∈Rm:F(x,Δ)⪰0 for every Δ with ∥Δ∥≤ρ},

and the RSDP is: minimize cTxc^TxcTx over Xρ\mathcal{X}_\rhoXρ​. With R(x)=[1; x]⊗IR(x) = [1;\,x]\otimes IR(x)=[1;x]⊗I, the n(m+1)×nn(m+1)\times nn(m+1)×n matrix whose iii-th block is x~iI\tilde x_i Ix~i​I for x~=(1,x1,…,xm)\tilde x = (1, x_1, \dots, x_m)x~=(1,x1​,…,xm​), the perturbation reads F(x,Δ)=F(x)+ΔR(x)+R(x)TΔT\mathbf{F}(x,\Delta) = F(x) + \Delta R(x) + R(x)^T\Delta^TF(x,Δ)=F(x)+ΔR(x)+R(x)TΔT (the paper's (19)).

Three further models use the same pattern. In a robust LP, the data [aiT bi]T[a_i^T\ b_i]^T[aiT​ bi​]T of each constraint aiTx≥bia_i^Tx \ge b_iaiT​x≥bi​ are shifted by an independent δi∈Rm+1\delta_i \in \mathbb{R}^{m+1}δi​∈Rm+1 with ∥δi∥2≤ρ\|\delta_i\|_2 \le \rho∥δi​∥2​≤ρ. In robust eigenvalue minimization one minimizes the worst case over ∥Δ∥≤ρ\|\Delta\|\le\rho∥Δ∥≤ρ of λmax⁡(F(x,Δ))\lambda_{\max}(\mathbf{F}(x,\Delta))λmax​(F(x,Δ)). In robust maximum-norm minimization, H(x)=H0+∑ixiHiH(x) = H_0 + \sum_i x_i H_iH(x)=H0​+∑i​xi​Hi​ with Hi∈Rp×qH_i \in \mathbb{R}^{p\times q}Hi​∈Rp×q, H(x,Δ)=H0+Δ0+∑ixi(Hi+Δi)\mathbf{H}(x,\Delta) = H_0 + \Delta_0 + \sum_i x_i(H_i + \Delta_i)H(x,Δ)=H0​+Δ0​+∑i​xi​(Hi​+Δi​), and one minimizes max⁡∥Δ∥≤ρ∥H(x,Δ)∥\max_{\|\Delta\|\le\rho}\|\mathbf{H}(x,\Delta)\|max∥Δ∥≤ρ​∥H(x,Δ)∥.

Formalization targets

Goal: Theorem 5.1 (first sentence)

For every x∈Rmx \in \mathbb{R}^mx∈Rm,

x∈Xρ  ⟺  F(x)⪰2ρ∥x∥2+1  I.x \in \mathcal{X}_\rho \iff F(x) \succeq 2\rho\sqrt{\|x\|^2+1}\; I .x∈Xρ​⟺F(x)⪰2ρ∥x∥2+1​I.

The RSDP and problem (21), "minimize cTxc^TxcTx subject to F(x)⪰2ρ∥x∥2+1 IF(x) \succeq 2\rho\sqrt{\|x\|^2+1}\,IF(x)⪰2ρ∥x∥2+1​I", therefore have the same feasible set, optimal value and solutions. The goal fixes no numerical data: F0,…,FmF_0, \dots, F_mF0​,…,Fm​, mmm, nnn and ρ>0\rho > 0ρ>0 are arbitrary.

Milestones on the way (§5.1)

  1. (19)–(20): x∈Xρx \in \mathcal{X}_\rhox∈Xρ​ iff there is τ∈R\tau \in \mathbb{R}τ∈R with [F(x)−τIρR(x)TρR(x)τI]⪰0\begin{bmatrix} F(x) - \tau I & \rho R(x)^T \\ \rho R(x) & \tau I\end{bmatrix} \succeq 0[F(x)−τIρR(x)​ρR(x)TτI​]⪰0.
  2. Positivity of τ\tauτ and the Schur form (for n≥1n \ge 1n≥1): that block matrix is ⪰0\succeq 0⪰0 iff τ>0\tau > 0τ>0 and F(x)⪰(τ+ρ2(1+∥x∥2)/τ)IF(x) \succeq \bigl(\tau + \rho^2(1+\|x\|^2)/\tau\bigr) IF(x)⪰(τ+ρ2(1+∥x∥2)/τ)I.
  3. (21): some τ>0\tau > 0τ>0 satisfies the Schur form iff F(x)⪰2ρ∥x∥2+1 IF(x) \succeq 2\rho\sqrt{\|x\|^2+1}\, IF(x)⪰2ρ∥x∥2+1​I.

Further milestones: the value halves of Theorems 5.2–5.4

  • Theorem 5.2: the robust LP constraints hold iff aiTx−ρ∥x∥22+1≥bia_i^Tx - \rho\sqrt{\|x\|_2^2+1} \ge b_iaiT​x−ρ∥x∥22​+1​≥bi​ for all iii (problem (23)).
  • Theorem 5.3: for every ttt, tI⪰F(x,Δ)tI \succeq \mathbf{F}(x,\Delta)tI⪰F(x,Δ) for all ∥Δ∥≤ρ\|\Delta\| \le \rho∥Δ∥≤ρ iff (t−2ρ∥x∥2+1)I⪰F(x)\bigl(t - 2\rho\sqrt{\|x\|^2+1}\bigr) I \succeq F(x)(t−2ρ∥x∥2+1​)I⪰F(x); that is, the worst-case largest eigenvalue is λmax⁡(F(x))+2ρ∥x∥2+1\lambda_{\max}(F(x)) + 2\rho\sqrt{\|x\|^2+1}λmax​(F(x))+2ρ∥x∥2+1​ (problem (25)).
  • Theorem 5.4: for p,q≥1p, q \ge 1p,q≥1, max⁡∥Δ∥≤ρ∥H(x,Δ)∥=∥H(x)∥+ρ∥x∥2+1\max_{\|\Delta\|\le\rho}\|\mathbf{H}(x,\Delta)\| = \|H(x)\| + \rho\sqrt{\|x\|^2+1}max∥Δ∥≤ρ​∥H(x,Δ)∥=∥H(x)∥+ρ∥x∥2+1​, and the maximum is attained (problem (29)).

Significance

The goal shows that robustness against unstructured perturbations costs no more than the nominal problem: the robust counterpart is an LMI of the same size n×nn\times nn×n, with a right-hand side that is a convex function of xxx and grows like 2ρ∥x∥2\rho\|x\|2ρ∥x∥. The sets Xρ\mathcal{X}_\rhoXρ​ have no flat faces, which the paper's §5.2 uses to define the robust center of an LMI and which underlies the uniqueness and continuity of the robust solution (the second sentences of Theorems 5.1–5.4, from §4 under hypotheses H1–H3). Theorems 5.3 and 5.4 exhibit robustification as a Tikhonov regularization with parameter 2ρ2\rho2ρ or ρ\rhoρ, and Theorem 5.2 turns a robust LP into a second-order cone program.

All four closed forms are proved in the paper, partly by appeal to the general SDP reformulation of its §3. No machine-checked version of any of them exists, to our knowledge. The mission produces the robust counterparts as identities of feasible sets, stated for every xxx, together with the three intermediate steps of §5.1, so that later missions on the uniqueness and stability halves can import them.

Difficulty

The goal is an exchange of a universal quantifier over an infinite family of matrices with a single matrix inequality. The inequality F(x,Δ)⪰F(x)−2ρ∥x∥2+1 I\mathbf{F}(x,\Delta) \succeq F(x) - 2\rho\sqrt{\|x\|^2+1}\,IF(x,Δ)⪰F(x)−2ρ∥x∥2+1​I bounds each perturbation, but the converse needs, for each failing direction, one admissible perturbation that attains the bound; the constant 222 comes from the two copies ΔR(x)\Delta R(x)ΔR(x) and R(x)TΔTR(x)^T\Delta^TR(x)TΔT, and the constant ∥x∥2+1\sqrt{\|x\|^2+1}∥x∥2+1​ is the spectral norm of R(x)R(x)R(x), which holds only because Δ\DeltaΔ is normed as one block row. Normed block by block, the worst case and the constant change. In the milestone route, the positivity of τ\tauτ needs a separate argument before any Schur complement can be taken, since the Schur complement with respect to τI\tau IτI is undefined at τ=0\tau = 0τ=0, and the elimination of τ\tauτ needs the attainment of min⁡τ>0τ+a/τ\min_{\tau>0} \tau + a/\tauminτ>0​τ+a/τ. For Theorem 5.4 the difficulty is the attainment: an upper bound on the maximum is immediate, while the lower bound requires exhibiting an admissible perturbation that attains it.

Formalization scope

Matrices are Matrix (Fin r) (Fin c) ℝ. Coefficients are indexed by Fin (m + 1) with index 0 the constant term. A block row Δ\DeltaΔ is one matrix with columns indexed by pairs (i, b) : Fin (m + 1) × Fin n (or Fin q), and ∥Δ∥\|\Delta\|∥Δ∥ is Mathlib's ℓ2\ell^2ℓ2 operator norm (open scoped Matrix.Norms.L2Operator), the largest singular value, never the default entrywise norm. The vector norm ∥x∥2\|x\|^2∥x∥2 is written as ∑ixi2\sum_i x_i^2∑i​xi2​, never as Mathlib's sup norm on Fin m → ℝ. A⪰BA \succeq BA⪰B is (A - B).PosSemidef. Standing assumptions made explicit: F0,…,FmF_0, \dots, F_mF0​,…,Fm​ symmetric; ρ>0\rho > 0ρ>0 (§3, p. 36); n≥1n \ge 1n≥1 in milestone 2 (at n=0n = 0n=0 every τ\tauτ is feasible); p,q≥1p, q \ge 1p,q≥1 in Theorem 5.4 (empty matrices have norm 000).

Readings and corrections of the printed text:

  1. "The optimal value of the RSDP can be computed by solving (21)" is stated as the identity of the two feasible sets for every xxx, which implies equality of values and of solutions. Theorems 5.2 and 5.4 are stated the same way (5.4 through the pointwise worst-case value, with attainment), and Theorem 5.3 in epigraph form, λmax⁡(M)≤t  ⟺  tI−M⪰0\lambda_{\max}(M) \le t \iff tI - M \succeq 0λmax​(M)≤t⟺tI−M⪰0.
  2. Only the first sentence of each theorem is in scope. Uniqueness, regularity, Lipschitz stability and the limit ρ→0\rho \to 0ρ→0 rest on Theorem 4.3 and on external results ([31], [3]) and are not stated.
  3. In (19) the paper writes D=Rn×nm\mathcal D = \mathbb R^{n\times nm}D=Rn×nm and "the representation in section 5"; Δ\DeltaΔ has m+1m+1m+1 blocks, so D=Rn×n(m+1)\mathcal D = \mathbb R^{n\times n(m+1)}D=Rn×n(m+1), and the representation is that of §2.2.
  4. The paper derives (20) from Lemma 3.2 and (29) from Theorem 3.2, which give only sufficient conditions; the exact equivalences are the full-perturbation Lemma 3.1 / Theorem 3.1.
  5. Before (21) the paper says "the scalar in the left-hand side" (it is on the right) and "the RSDP (1)" (it means the RSDP (4)). Theorem 5.3's "min-max problem (24)" is the robust version of the nominal problem (24).

A formalization in which ∥Δ∥\|\Delta\|∥Δ∥ is an entrywise or blockwise norm, ∥x∥\|x\|∥x∥ is the sup norm, or the robust set quantifies over a single block, changes the constant 2ρ∥x∥2+12\rho\sqrt{\|x\|^2+1}2ρ∥x∥2+1​ and is not this theorem; the statements here rule these out by construction.

Useful, reusable infrastructure: the spectral norm of [1; x]⊗I[1;\,x] \otimes I[1;x]⊗I, Schur complements for positive semidefinite block matrices, and spectral norms of rank-one matrices. Proofs of the three §5.1 milestones and direct proofs of the goal are both welcome.

Selected references

  • L. El Ghaoui, F. Oustry, H. Lebret, Robust Solutions to Uncertain Semidefinite Programs, SIAM J. Optim. 9(1):33–52, 1998. https://doi.org/10.1137/S1052623496305717
  • L. El Ghaoui, H. Lebret, Robust Solutions to Least-Squares Problems with Uncertain Data, SIAM J. Matrix Anal. Appl. 18(4):1035–1064, 1997. https://doi.org/10.1137/S0895479896298130
  • A. Ben-Tal, A. Nemirovski, Robust Convex Optimization, Math. Oper. Res. 23(4):769–805, 1998. https://doi.org/10.1287/moor.23.4.769
8 thms3 active usersReviewed
Functional AnalysisOptimization·Captain: mikedeng1

Strong Convergence of a Proximal-Type Algorithm in a Banach Space: The Algorithm Converges Strongly to the Generalized Projection of x0 onto the Zeros of a Maximal Monotone OperatorResearch Paper

Motivation

Many problems in optimization and variational analysis reduce to finding a zero of a maximal monotone operator TTT: minimizers of a proper convex lower semicontinuous function are the zeros of its subdifferential, and saddle points and solutions of variational inequalities are zeros of associated monotone operators. The classical tool is Rockafellar's proximal point algorithm (Rockafellar 1976), which in a Hilbert space converges weakly but, as Güler showed (Güler 1991), not strongly in general.

Solodov and Svaiter (Math. Program. 87, 2000) modified the method in a Hilbert space HHH: after each proximal step they project the starting point x0x_0x0​ onto the intersection of two half-spaces, and they proved that the resulting sequence converges strongly to the metric projection of x0x_0x0​ onto T−10T^{-1}0T−10. Kamimura and Takahashi (SIAM J. Optim. 13, 2003) extended this result to Banach spaces such as LpL^pLp, 1<p<∞1<p<\infty1<p<∞, replacing the identity by the duality mapping and the metric projection by a generalized projection defined through the duality mapping. This mission formalizes that extension.

Setting

Let EEE be a real Banach space with dual E∗E^*E∗, and write ⟨x,f⟩\langle x,f\rangle⟨x,f⟩ for the value of f∈E∗f\in E^*f∈E∗ at x∈Ex\in Ex∈E.

  • The duality mapping is Jx={v∈E∗:⟨x,v⟩=∥x∥2=∥v∥2}Jx=\{v\in E^*:\langle x,v\rangle=\|x\|^2=\|v\|^2\}Jx={v∈E∗:⟨x,v⟩=∥x∥2=∥v∥2}. When EEE is smooth (the limit lim⁡t→0(∥x+ty∥−∥x∥)/t\lim_{t\to0}(\|x+ty\|-\|x\|)/tlimt→0​(∥x+ty∥−∥x∥)/t exists for all unit x,yx,yx,y), JJJ is single valued. EEE is uniformly smooth if this limit is attained uniformly over unit x,yx,yx,y, and uniformly convex if ∥xn−yn∥→0\|x_n-y_n\|\to0∥xn​−yn​∥→0 whenever ∥xn∥=∥yn∥=1\|x_n\|=\|y_n\|=1∥xn​∥=∥yn​∥=1 and ∥(xn+yn)/2∥→1\|(x_n+y_n)/2\|\to1∥(xn​+yn​)/2∥→1.
  • An operator T:E→2E∗T:E\to2^{E^*}T:E→2E∗ is monotone if ⟨x1−x2,y1−y2⟩≥0\langle x_1-x_2,y_1-y_2\rangle\ge0⟨x1​−x2​,y1​−y2​⟩≥0 for yi∈Txiy_i\in Tx_iyi​∈Txi​, and maximal monotone if no other monotone operator has a strictly larger graph. T−10={x:0∈Tx}T^{-1}0=\{x:0\in Tx\}T−10={x:0∈Tx}.
  • For smooth EEE, φ(x,y)=∥x∥2−2⟨x,Jy⟩+∥y∥2\varphi(x,y)=\|x\|^2-2\langle x,Jy\rangle+\|y\|^2φ(x,y)=∥x∥2−2⟨x,Jy⟩+∥y∥2. The generalized projection QCxQ_CxQC​x of xxx onto a nonempty closed convex set CCC is the unique minimizer of φ(⋅,x)\varphi(\cdot,x)φ(⋅,x) over CCC (it exists and is unique in reflexive, strictly convex, smooth spaces).
  • The algorithm (3.1): from x0∈Ex_0\in Ex0​∈E and positive reals rnr_nrn​,
0=vn+1rn(Jyn−Jxn), vn∈Tyn,Hn={z:⟨z−yn,vn⟩≤0},Wn={z:⟨z−xn,Jx0−Jxn⟩≤0},xn+1=QHn∩Wnx0.0=v_n+\tfrac1{r_n}(Jy_n-Jx_n),\ v_n\in Ty_n,\quad H_n=\{z:\langle z-y_n,v_n\rangle\le0\},\quad W_n=\{z:\langle z-x_n,Jx_0-Jx_n\rangle\le0\},\quad x_{n+1}=Q_{H_n\cap W_n}x_0 .0=vn​+rn​1​(Jyn​−Jxn​), vn​∈Tyn​,Hn​={z:⟨z−yn​,vn​⟩≤0},Wn​={z:⟨z−xn​,Jx0​−Jxn​⟩≤0},xn+1​=QHn​∩Wn​​x0​.

In Lean, JJJ is J : E → StrongDual ℝ E with ∀ x, J x ∈ dualityMap x, φ\varphiφ is phi J, "z=QCxz=Q_Cxz=QC​x" is IsGenProj J C x z, and a run of (3.1) is IsHybridRun T J r x y v with starting point x 0.

Formalization targets

Goal: Theorem 8

If EEE is uniformly convex and uniformly smooth, TTT is maximal monotone, T−10≠∅T^{-1}0\neq\emptysetT−10=∅, rn>0r_n>0rn​>0 and lim inf⁡nrn>0\liminf_n r_n>0liminfn​rn​>0, then every sequence generated by (3.1) satisfies

xn ⟶ QT−10 x0in norm.x_n\ \longrightarrow\ Q_{T^{-1}0}\,x_0\quad\text{in norm}.xn​ ⟶ QT−10​x0​in norm.

Milestones

In the order of the paper: the single-valuedness of JJJ on smooth spaces and its uniform continuity on bounded sets for uniformly smooth spaces (§2, properties 2 and 4); Xu's characterization of uniform convexity (Proposition 1); φ(yn,zn)→0\varphi(y_n,z_n)\to0φ(yn​,zn​)→0 with one bounded sequence implies yn−zn→0y_n-z_n\to0yn​−zn​→0 (Proposition 2); existence and uniqueness of QCxQ_CxQC​x (Proposition 3); its variational characterization ⟨z−x0,Jx0−Jx⟩≥0\langle z-x_0,Jx_0-Jx\rangle\ge0⟨z−x0​,Jx0​−Jx⟩≥0 (Proposition 4); the inequality φ(y,QCx)+φ(QCx,x)≤φ(y,x)\varphi(y,Q_Cx)+\varphi(Q_Cx,x)\le\varphi(y,x)φ(y,QC​x)+φ(QC​x,x)≤φ(y,x) (Proposition 5); Rockafellar's surjectivity theorem R(J+rT)=E∗R(J+rT)=E^*R(J+rT)=E∗ (Theorem 6); well-definedness of (3.1) (Proposition 7); T−10⊆Hn∩WnT^{-1}0\subseteq H_n\cap W_nT−10⊆Hn​∩Wn​ (Remark 1); and the monotonicity step

φ(xn+1,xn)+φ(xn,x0)≤φ(xn+1,x0).(3.2)\varphi(x_{n+1},x_n)+\varphi(x_n,x_0)\le\varphi(x_{n+1},x_0).\tag{3.2}φ(xn+1​,xn​)+φ(xn​,x0​)≤φ(xn+1​,x0​).(3.2)

Significance

The theorem gives a strongly convergent method for finding zeros of maximal monotone operators in a class of Banach spaces that includes LpL^pLp and ℓp\ell^pℓp for 1<p<∞1<p<\infty1<p<∞, and it identifies the limit: it is not an arbitrary zero but the generalized projection of the starting point. Applied to T=∂fT=\partial fT=∂f it yields a strongly convergent minimization method for proper convex lower semicontinuous functions (§4 of the paper). The generalized projection QCQ_CQC​, the function φ\varphiφ and the hybrid (CQ-type) projection scheme became standard tools in the later Banach-space fixed-point and splitting literature.

The result is proved in the paper; the mission's contribution is a machine-checked proof. As far as the platform catalog and Mathlib show, none of its ingredients is formalized: Mathlib has uniformly convex and strictly convex spaces and the double dual, but no duality mapping, no notion of smoothness, no monotone operators and no generalized projection.

Difficulty

The obvious route, copying the Hilbert-space proof of Solodov and Svaiter, fails at every place where that proof uses the inner product: the projection onto Hn∩WnH_n\cap W_nHn​∩Wn​ is no longer characterized by orthogonality, ∥x−y∥2\|x-y\|^2∥x−y∥2 is not a Bregman-type distance, and weak convergence of xnix_{n_i}xni​​ together with ∥xni∥→∥w∥\|x_{n_i}\|\to\|w\|∥xni​​∥→∥w∥ no longer yields strong convergence for free. The paper replaces these steps with properties of φ\varphiφ and of JJJ, which in turn rest on the geometry of EEE: uniform convexity (through Proposition 1) and uniform smoothness (through the uniform continuity of JJJ). In Lean, these geometric facts, reflexivity of uniformly convex spaces (Milman–Pettis) and Rockafellar's surjectivity theorem are all absent and have to be built.

Formalization scope

  • EEE is a real Banach space (NormedAddCommGroup, NormedSpace ℝ, CompleteSpace). The dual is StrongDual ℝ E with the operator norm; ⟨x,f⟩\langle x,f\rangle⟨x,f⟩ is f x. Sequences are indexed by N\mathbb NN from 000.
  • Uniform convexity is Mathlib's UniformConvexSpace (ε–δ form, equivalent to the sequential definition); strict convexity is StrictConvexSpace ℝ E; reflexivity is surjectivity of NormedSpace.inclusionInDoubleDual. Smoothness and uniform smoothness are defined from the limit (2.1) over real t≠0t\neq0t=0; uniform smoothness uses one δ\deltaδ for all unit x,yx,yx,y.
  • Maximality quantifies over all monotone operators whose graph contains that of TTT.
  • The single-valued JJJ is a function constrained by ∀ x, J x ∈ dualityMap x in every statement that uses it; on a smooth space this determines JJJ (a milestone).
  • QCQ_CQC​ and the algorithm are relations, not functions; the goal is stated for every run of (3.1) and asserts the existence of a generalized projection zzz of x0x_0x0​ onto T−10T^{-1}0T−10 with xn→zx_n\to zxn​→z. lim inf⁡rn>0\liminf r_n>0liminfrn​>0 is "some c>0c>0c>0 bounds rnr_nrn​ below eventually", and rn>0r_n>0rn​>0 is a separate hypothesis.
  • The goal assumes neither reflexivity, strict convexity nor smoothness (they follow from the uniform hypotheses), nor that T−10T^{-1}0T−10 is closed or convex (that follows from maximality).
  • Trivializing formalizations are ruled out: JJJ must be the duality mapping, runs of (3.1) exist (Proposition 7), and the limit must be identified as QT−10x0Q_{T^{-1}0}x_0QT−10​x0​, not merely shown to exist.

Reusable infrastructure: the duality mapping and its properties, smooth and uniformly smooth spaces, Milman–Pettis, monotone operators and Rockafellar's surjectivity theorem, and the generalized projection. Contributions to any of these are welcome independently of the goal.

Selected references

  • S. Kamimura and W. Takahashi, Strong convergence of a proximal-type algorithm in a Banach space, SIAM J. Optim. 13(3):938–945, 2003. https://doi.org/10.1137/S105262340139611X
  • M. V. Solodov and B. F. Svaiter, Forcing strong convergence of proximal point iterations in a Hilbert space, Math. Program. 87:189–202, 2000. https://doi.org/10.1007/s101070050002
  • R. T. Rockafellar, Monotone operators and the proximal point algorithm, SIAM J. Control Optim. 14(5):877–898, 1976. https://doi.org/10.1137/0314056
  • R. T. Rockafellar, On the maximality of sums of nonlinear monotone operators, Trans. Amer. Math. Soc. 149:75–88, 1970. https://doi.org/10.1090/S0002-9947-1970-0282272-5
  • O. Güler, On the convergence of the proximal point algorithm for convex minimization, SIAM J. Control Optim. 29(2):403–419, 1991. https://doi.org/10.1137/0329022
  • H.-K. Xu, Inequalities in Banach spaces with applications, Nonlinear Anal. 16(12):1127–1138, 1991. https://doi.org/10.1016/0362-546X(91)90200-K
13 thms3 active usersReviewed
🏆Completed
Control TheoryOperations ResearchOptimization·Captain: mikedeng1

Robust Solutions to Uncertain Semidefinite Programs I: Exact SDP Reformulation of the Robust LMI under Full Linear-Fractional PerturbationsResearch Paper

Motivation

A semidefinite program (SDP) minimizes a linear objective cTxc^TxcTx subject to a linear matrix inequality (LMI) F(x)=F0+∑i=1mxiFi⪰0F(x) = F_0 + \sum_{i=1}^m x_iF_i \succeq 0F(x)=F0​+∑i=1m​xi​Fi​⪰0. SDPs model problems in control, combinatorial optimization, statistics and engineering design, and they are solved efficiently by interior-point methods. In applications the data F0,…,FmF_0,\dots,F_mF0​,…,Fm​ are rarely known exactly: they come from measurements, from linearized models, or from rounding. A solution that is optimal for the nominal data may violate the constraint for data that differ only slightly.

El Ghaoui, Oustry and Lebret (SIAM J. Optim. 9(1), 1998) asked for robust solutions: points xxx that satisfy the constraint for every admissible value of an unknown but bounded perturbation, and among them one that minimizes cTxc^TxcTx. Their paper, together with the contemporaneous work of Ben-Tal and Nemirovski on robust convex optimization (Math. Oper. Res. 23(4), 1998), founded robust semidefinite programming. The perturbation model they use, the linear-fractional representation (LFR), is the standard uncertainty model of robust control, where the same exact reformulation appears as the multiplier characterization of quadratic stability under norm-bounded uncertainty.

This mission formalizes the first main result of the paper: when the perturbation is full (an arbitrary matrix of bounded spectral norm), the robust problem is exactly an SDP with one extra scalar variable.

Setting

Fix natural numbers m,n,p,qm, n, p, qm,n,p,q and a decision vector x∈Rmx \in \mathbb{R}^mx∈Rm. The data are:

  • symmetric matrices F0,…,Fm∈Rn×nF_0,\dots,F_m \in \mathbb{R}^{n\times n}F0​,…,Fm​∈Rn×n, defining the affine map F(x)=F0+∑ixiFiF(x) = F_0 + \sum_i x_iF_iF(x)=F0​+∑i​xi​Fi​;
  • matrices R0,…,Rm∈Rq×nR_0,\dots,R_m \in \mathbb{R}^{q\times n}R0​,…,Rm​∈Rq×n, defining R(x)=R0+∑ixiRiR(x) = R_0 + \sum_i x_iR_iR(x)=R0​+∑i​xi​Ri​;
  • fixed matrices L∈Rn×pL \in \mathbb{R}^{n\times p}L∈Rn×p and D∈Rq×pD \in \mathbb{R}^{q\times p}D∈Rq×p;
  • a level ρ>0\rho > 0ρ>0.

For a matrix XXX, ∥X∥\|X\|∥X∥ denotes its largest singular value (the spectral norm), and X⪰0X \succeq 0X⪰0 means that XXX is symmetric positive semidefinite. A perturbation is a matrix Δ∈Rp×q\Delta \in \mathbb{R}^{p\times q}Δ∈Rp×q. The perturbed constraint matrix is the LFR (5)

F(x,Δ)=F(x)+LΔ(I−DΔ)−1R(x)+R(x)T(I−ΔTDT)−1ΔTLT,\mathbf{F}(x,\Delta) = F(x) + L\Delta(I - D\Delta)^{-1}R(x) + R(x)^T(I - \Delta^TD^T)^{-1}\Delta^TL^T,F(x,Δ)=F(x)+LΔ(I−DΔ)−1R(x)+R(x)T(I−ΔTDT)−1ΔTLT,

which is well defined exactly when det⁡(I−DΔ)≠0\det(I - D\Delta) \neq 0det(I−DΔ)=0. For a linear subspace D\mathcal{D}D of Rp×q\mathbb{R}^{p\times q}Rp×q, the robust feasible set (2) is

Xρ={x∈Rm:for every Δ∈D with ∥Δ∥≤ρ, F(x,Δ) is well defined and F(x,Δ)⪰0},\mathcal{X}_\rho = \bigl\{x \in \mathbb{R}^m : \text{for every } \Delta \in \mathcal{D} \text{ with } \|\Delta\| \le \rho,\ \mathbf{F}(x,\Delta) \text{ is well defined and } \mathbf{F}(x,\Delta) \succeq 0\bigr\},Xρ​={x∈Rm:for every Δ∈D with ∥Δ∥≤ρ, F(x,Δ) is well defined and F(x,Δ)⪰0},

and the robust SDP (4) is: minimize cTxc^TxcTx subject to x∈Xρx \in \mathcal{X}_\rhox∈Xρ​, for a given c∈Rm∖{0}c \in \mathbb{R}^m \setminus \{0\}c∈Rm∖{0}. In this mission D=Rp×q\mathcal{D} = \mathbb{R}^{p\times q}D=Rp×q, the full perturbation case, and the paper's standing assumption of §3.1 is ∥D∥<ρ−1\|D\| < \rho^{-1}∥D∥<ρ−1.

Formalization targets

Goal: Theorem 3.1 (p. 36), as a set identity

Under ρ>0\rho > 0ρ>0, ∥D∥<ρ−1\|D\| < \rho^{-1}∥D∥<ρ−1, q≥1q \ge 1q≥1 and L≠0L \ne 0L=0, for every x∈Rmx \in \mathbb{R}^mx∈Rm,

x∈Xρ  ⟺  ∃ τ∈R: [F(x)−τLLTR(x)T−τLDTR(x)−τDLTτ(ρ−2I−DDT)]⪰0.(10)x \in \mathcal{X}_\rho \iff \exists\,\tau \in \mathbb{R}:\ \begin{bmatrix} F(x) - \tau LL^T & R(x)^T - \tau LD^T \\ R(x) - \tau DL^T & \tau(\rho^{-2}I - DD^T)\end{bmatrix} \succeq 0. \qquad (10)x∈Xρ​⟺∃τ∈R: [F(x)−τLLTR(x)−τDLT​R(x)T−τLDTτ(ρ−2I−DDT)​]⪰0.(10)

The paper states that the robust SDP and a corresponding solution can be computed by solving the SDP "minimize cTxc^TxcTx subject to (10)" in the variables (x,τ)(x, \tau)(x,τ). Both problems have the objective cTxc^TxcTx, so the identity above, between Xρ\mathcal{X}_\rhoXρ​ and the xxx-projection of the feasible set of (10), is the content of that sentence. A companion item states the solution correspondence explicitly: xxx is optimal for the robust SDP if and only if (x,τ)(x,\tau)(x,τ) is optimal for (10) for some τ\tauτ.

Milestones

  1. Well-posedness (§3.1, p. 36). For ρ>0\rho > 0ρ>0: det⁡(I−DΔ)≠0\det(I - D\Delta) \ne 0det(I−DΔ)=0 for every Δ\DeltaΔ with ∥Δ∥≤ρ\|\Delta\| \le \rho∥Δ∥≤ρ if and only if ∥D∥<ρ−1\|D\| < \rho^{-1}∥D∥<ρ−1.
  2. Lemma 3.1 (p. 36). For F=FTF = F^TF=FT, q≥1q \ge 1q≥1 and L≠0L \ne 0L=0: det⁡(I−DΔ)≠0\det(I - D\Delta) \ne 0det(I−DΔ)=0 and F+LΔ(I−DΔ)−1R+RT(I−DΔ)−TΔTLT⪰0F + L\Delta(I - D\Delta)^{-1}R + R^T(I - D\Delta)^{-T}\Delta^TL^T \succeq 0F+LΔ(I−DΔ)−1R+RT(I−DΔ)−TΔTLT⪰0 for every ∥Δ∥≤1\|\Delta\| \le 1∥Δ∥≤1 if and only if ∥D∥<1\|D\| < 1∥D∥<1 and some scalar τ\tauτ satisfies
[F−τLLTRT−τLDTR−τDLTτ(I−DDT)]⪰0.\begin{bmatrix} F - \tau LL^T & R^T - \tau LD^T \\ R - \tau DL^T & \tau(I - DD^T)\end{bmatrix} \succeq 0.[F−τLLTR−τDLT​RT−τLDTτ(I−DDT)​]⪰0.

The paper cites the S-procedure as the classical result behind Lemma 3.1; it is already proved on the platform (ConvexOptimization.s_procedure) and is included as a reference item.

Significance

The robust feasible set is defined by infinitely many matrix inequalities, one per perturbation, each rational in Δ\DeltaΔ; in general such a set is convex but has no tractable description, and the paper notes that the structured version of the problem is NP-hard. Theorem 3.1 shows that for full perturbations nothing is lost by replacing that semi-infinite constraint with a single LMI of size n+qn + qn+q in one extra variable. Consequences: the robust problem is solved by a standard SDP solver; the largest admissible perturbation level is a generalized eigenvalue problem; and the exact result is the benchmark against which the paper's sufficient conditions for structured perturbations (Theorem 3.2) and its closed-form counterparts for unstructured perturbations (Theorem 5.1) are measured.

The result is proved in the paper (from the S-procedure, with the details deferred to a cited report). To the best of available knowledge it has no machine-checked proof. The mission produces a formal statement of the LFR model and of the robust feasible set that later missions on robust SDPs can reuse, a formal proof of the well-posedness condition, and a formal proof of the exact reformulation built on the platform's S-procedure. Formalizing it also records two points the printed statement leaves implicit: the result needs L≠0L \ne 0L=0 and a nonempty perturbation output dimension q≥1q \ge 1q≥1.

Difficulty

The direction from the LMI to robust feasibility is elementary. The converse is the substance: robust feasibility is a statement about a continuum of perturbations, each entering rationally, and testing the LMI against finitely many extreme perturbations does not produce a multiplier τ\tauτ. The exactness of the reformulation rests on a lossless certificate for an implication between quadratic inequalities, which holds only under a strict feasibility condition; that condition is where L≠0L \ne 0L=0 enters, and without it the lemma is false. The well-posedness milestone requires showing that ∥D∥<ρ−1\|D\| < \rho^{-1}∥D∥<ρ−1 is also necessary, which is not a norm estimate but needs a perturbation that makes I−DΔI - D\DeltaI−DΔ singular.

Formalization scope

Matrices are Mathlib Matrix (Fin a) (Fin b) ℝ. The affine maps are given by coefficient lists indexed by Fin (m + 1), the constant term first. The norm on matrices is the ℓ2\ell^2ℓ2 operator norm, opened with open scoped Matrix.Norms.L2Operator; it is the largest singular value, and no other matrix norm is used. X⪰0X \succeq 0X⪰0 is Matrix.PosSemidef, which includes symmetry. Block matrices are Matrix.fromBlocks over the index type Fin n ⊕ Fin q, with R(x)T−τLDTR(x)^T - \tau LD^TR(x)T−τLDT top-right and R(x)−τDLTR(x) - \tau DL^TR(x)−τDLT bottom-left. Mathlib's matrix inverse returns 000 at a singular matrix, so the condition det⁡(I−DΔ)≠0\det(I - D\Delta) \ne 0det(I−DΔ)=0 appears in the robust feasible set in the same universally quantified clause as positive semidefiniteness, as the paper's "well defined" requires; dropping it, or using an entrywise matrix norm, would change the set and is excluded.

Readings and corrections of the printed statements:

  • "The RSDP (4) and a corresponding solution xxx can be computed by solving the SDP" is read as the identity of Xρ\mathcal{X}_\rhoXρ​ with the xxx-projection of the feasible set of (10), for every xxx, together with the solution correspondence item. A statement of equal optimal values alone would be weaker and is not used.
  • Correction: L≠0L \ne 0L=0 is added to Lemma 3.1 and Theorem 3.1. The printed statements fail for L=0L = 0L=0: with n=p=q=1n = p = q = 1n=p=q=1, F=0F = 0F=0, L=0L = 0L=0, D=0D = 0D=0, R=1R = 1R=1, the perturbation does not enter, so the robust condition holds, while the LMI reads [011⋅]⪰0\begin{bmatrix}0 & 1\\1 & \cdot\end{bmatrix} \succeq 0[01​1⋅​]⪰0, which is infeasible.
  • q≥1q \ge 1q≥1 makes "matrices of appropriate size" explicit; for q=0q = 0q=0 the lower-right block is empty and the equivalence fails.
  • The standing assumptions ρ>0\rho > 0ρ>0 (§3) and ∥D∥<ρ−1\|D\| < \rho^{-1}∥D∥<ρ−1 (§3.1) are hypotheses of the goal. In Lemma 3.1, ∥D∥<1\|D\| < 1∥D∥<1 is part of the conclusion, as printed, and τ\tauτ carries no sign constraint, as printed.
  • The paper's standing assumption that the nominal problem is feasible (X0≠∅\mathcal{X}_0 \ne \emptysetX0​=∅) is not needed for the identity and is not added.

Welcome contributions: proofs of the well-posedness milestone (a spectral-norm and singular-vector argument, reusable wherever I−DΔI - D\DeltaI−DΔ must be invertible); of Lemma 3.1 from the S-procedure (the reachability lemma for norm-bounded perturbations is reusable in robust control); of the goal from Lemma 3.1 by rescaling; and general lemmas on the spectral norm of rank-one matrices and on Schur complements of block matrices.

Selected references

  • L. El Ghaoui, F. Oustry and H. Lebret, Robust Solutions to Uncertain Semidefinite Programs, SIAM J. Optim. 9(1), 33–52, 1998. https://doi.org/10.1137/S1052623496305717
  • A. Ben-Tal and A. Nemirovski, Robust Convex Optimization, Math. Oper. Res. 23(4), 769–805, 1998. https://doi.org/10.1287/moor.23.4.769
  • S. Boyd, L. El Ghaoui, E. Feron and V. Balakrishnan, Linear Matrix Inequalities in System and Control Theory, SIAM, 1994. https://doi.org/10.1137/1.9781611970777
  • S. Boyd and L. Vandenberghe, Convex Optimization, Cambridge University Press, 2004, Appendix B.2 (the S-procedure). https://web.stanford.edu/~boyd/cvxbook/
5 thms3 active usersReviewed
PreviousPage 3 of 10Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me