A Distributional Interpretation of Robust Optimization I: Robust Optimization over Overlapping Uncertainty Sets Equals a Distributionally Robust Stochastic ProgramResearch Paper
Motivation
Robust optimization (RO) protects a decision against every realisation of an uncertain parameter in a prescribed uncertainty set; distributionally robust stochastic programming (DRSP) protects it against every probability distribution in a prescribed distribution set. The two paradigms are usually treated separately. When the n uncertain parameters live in different spaces, it is folklore that RO over a product of sets is DRSP over the distributions supported on that product (Delage and Ye, Operations Research 2010).
In data-driven problems the situation is different: the parameters are samples, and all of them lie in the same space . Robustifying each sample by its own uncertainty set gives the objective , and the sets typically overlap. Xu, Caramanis and Mannor (Math. Oper. Res. 2012) show that this objective is again a worst-case expectation, now over distributions on itself rather than on . This equivalence is what the same paper uses to prove that box-robust sample average optimisation is statistically consistent, and to explain the shrinkage heuristic of RO.
Setting
Let and write . Let be the set of Borel probability measures on . The data are:
- a measurable utility (the decision variable is suppressed);
- weights with ;
- nonempty Borel uncertainty sets , which may intersect or coincide.
For write and . The distribution set is
Each must give every union of uncertainty sets at least the total weight of its indices. For the expectation is the extended integral .
Formalization targets
Goal: Theorem 2.1 (Eq. (4), pp. 96–97)
as an identity in , with no boundedness assumption on and no disjointness assumption on the .
Milestones (proof of Theorem 2.1, p. 97)
- Every satisfies , hence .
- Weak duality. With finite, every satisfying on and for obeys .
- The nested dual solution. If , the vector with , and all other coordinates is feasible and has objective .
Further statements
- For pairwise disjoint : (p. 97).
- Corollary 2.1 (Eq. (5)): .
- Corollary 5.2 (nested distributions, p. 107): for and ,
Significance
The result. Theorem 2.1 turns a robust problem with overlapping uncertainty sets into a distributionally robust one on the original space . This is what allows distributions in to be compared with the true data-generating distribution as grows: in §3 of the paper a kernel density estimator is shown to lie in for box uncertainty sets, which yields consistency of box-robust sample average optimisation (Theorem 3.1); in §4.2 the nested-distribution form (Corollary 5.2) explains why shrinking an uncertainty set approximates a two-scenario DRSP (Theorem 4.1). The disjoint case recovers the classical product-space equivalence.
Formalizing it. The result is proved in the paper, through the strong duality of a semi-infinite linear program (Isii 1962). It has no machine-checked proof. The mission produces the equivalence as an identity of extended reals, together with a reusable definition of the union-mass distribution set. A proof need not follow the paper's duality route; any correct argument is welcome.
Difficulty
The inequality from the left side is the easy half: point masses with belong to . The substance is the reverse bound, that no can do better than . For disjoint sets this is immediate, since . For overlapping sets a measure may place mass in intersections, and a single point of can serve several indices at once; the constraint family over all subsets is what prevents this, and the bound has to exploit the whole family, not the singleton constraints. The paper does this by appeal to semi-infinite LP duality, a theorem that Mathlib does not contain. Measure-theoretic side conditions (unbounded , infinite integrals, infima equal to ) must also be handled rather than assumed away.
Formalization scope
- is
Fin m → ℝwith its Borel -algebra; no norm is used. Indices areFin n, subsets areFinset (Fin n), and isFinset.Iic i. - is a
Set (Measure (Fin m → ℝ))whose membership includesIsProbabilityMeasure; the constraint is imposed for every subset, and included. - is
expect μ f, defined inERealas the difference of two lower Lebesgue integrals, . The Bochner integral is not used, because its value on non-integrable functions would falsify Eq. (4). Both sides of Eq. (4) areERealinfima; the left infimum ranges over the nonempty set . - Readings of the printed statements. (i) The paper allows to take the value ; here is real-valued. The excluded case is the one the proof disposes of in its first sentence, where both sides are . (ii) No boundedness hypothesis is added: when some both sides are , and otherwise every has a finite negative part. (iii) Corollary 2.1 prints "" without a domain; it is read as . (iv) Corollary 5.2 is corrected: the paper prints the coefficient , while its proof sets ; the printed version is false (for , , , , the left side is and the printed right side ). The mission states . (v) The standing hypotheses of Theorem 2.1 ( measurable, nonempty Borel) are made explicit in Corollary 5.2.
- The ordering is a hypothesis of the nested-dual milestone only, as the proof's "without loss of generality"; the goal does not assume it. Milestones 2 and 3 assume bounded below on each (the proof's first reduction), so that is a real number.
- Ruled out. A Bochner-integral formulation, a restriction to disjoint sets, a distribution set containing non-probability measures, or a set defined by the singleton constraints alone would each change or trivialise the theorem; none is used.
- Definitions (file
Model): the set , the extended expectation, dual feasibility, and the nested dual vector. The extended expectation and the union-mass distribution set are reusable beyond this mission. Welcome contributions: a proof through semi-infinite LP duality, a direct measure-theoretic proof (for instance a layer-cake argument for the lower bound), and proofs of the corollaries from the goal.
Selected references
- H. Xu, C. Caramanis, S. Mannor, A Distributional Interpretation of Robust Optimization, Mathematics of Operations Research 37(1):95–110, 2012. https://doi.org/10.1287/moor.1110.0531
- E. Delage, Y. Ye, Distributionally Robust Optimization Under Moment Uncertainty with Application to Data-Driven Problems, Operations Research 58(3):595–612, 2010. https://doi.org/10.1287/opre.1090.0741
- K. Isii, On sharpness of Tchebycheff-type inequalities, Annals of the Institute of Statistical Mathematics 14:185–197, 1962. https://doi.org/10.1007/BF02868641
- A. Ben-Tal, L. El Ghaoui, A. Nemirovski, Robust Optimization, Princeton University Press, 2009. https://doi.org/10.1515/9781400831050