The Data-Driven Newsvendor Problem: New Bounds and Insights II: Every Log-Concave Demand Has Weighted Mean Spread at Least min(b,h)/(b+h)Research Paper
Motivation
The newsvendor problem is the basic single-period inventory model: a decision maker orders units before a random demand is observed, pays per unit of unmet demand and per unit left over, and minimizes the expected cost . When the distribution of is known, the optimal order is the quantile of . In practice the distribution is unknown and only a sample of past demands is available; the standard data-driven order is the sample average approximation (SAA), the quantile of the empirical distribution.
R. Levi, G. Perakis and J. Uichanco, The Data-Driven Newsvendor Problem: New Bounds and Insights (Operations Research 63(6), 2015), ask how many samples guarantee that the SAA order is -optimal with high probability. Levi, Roundy and Shmoys (2007) gave a distribution-free bound. Levi, Perakis and Uichanco show that, asymptotically in , the right measure of difficulty is a single scalar of the demand law, the weighted mean spread at the critical quantile, and that for the class of log-concave demand distributions (normal, uniform, exponential, logistic, Laplace and many others used in inventory theory) this scalar is bounded below by . That uniform bound turns a distribution-dependent sample-size guarantee into one that holds for every log-concave demand, and is markedly tighter than the distribution-free one.
This mission formalizes the bound (Proposition 2) and the chain of lemmas the paper uses to prove it. The source is the authors' accepted manuscript of the paper (MIT DSpace), cited by its own page numbers.
Setting
Fix costs , and the critical ratio . A demand law is given by a probability density : measurable, nonnegative, with . Its cdf is , and its quantile is
The absolute mean spread (AMS, Definition 1) at is the gap between the conditional means above and below ,
and the weighted mean spread (WMS, Definition 2) is .
A density is log-concave (Definition 3) if is concave on its support. Equivalently, for all and ; this form allows to vanish outside an interval.
For a log-concave and a point with , the number is a supergradient of at , written , if for all with . The paper splits the class of log-concave densities into the subclasses of densities with quantile , and , and minimizes the AMS over each subclass (problem (11)). The minimizer is the truncated exponential density
and zero elsewhere (display (12)), with AMS in closed form.
The Lean development uses the names IsPdf, cdfOf, quantileOf, ams, IsLogSupergradient, tildeF and zStar for these objects, in the namespace DataDrivenNV.WMS.
Formalization targets
Goal: Proposition 2
For every log-concave density ,
The statement has no further hypothesis: no moment condition, no continuity, no restriction on .
Milestones, in the order of the paper's proof
- Lemma 1: at the quantile, .
- Lemma 2: for every .
- Lemma 3 (Domination Lemma): a density dominated on the support of another, with the same mass left of , has the larger AMS at .
- Proposition 1: belongs to and minimizes the AMS there.
- The closed form: .
- Lemma 4: three elementary inequalities in and .
Significance
The proposition is what makes the paper's log-concave sample-size bound (Theorem 4) parameter-free: the probability that the biased SAA order is -optimal is, asymptotically, at least (Theorem 3), and Proposition 2 replaces the unknown by . A manager who only knows that demand is log-concave can then size a sample without estimating any parameter of the law.
The result is proved in the paper; nothing about it is open. As far as is known it has no machine-checked proof. Formalizing it produces a checked lower bound for an inventory-theory quantity together with reusable facts about log-concave densities on the line: exponential envelopes from a supergradient, the quantile-and-slope constraints of Lemma 1, and the comparison of conditional means behind the Domination Lemma.
Difficulty
The definitions are elementary, but the proof passes through an infinite-dimensional optimization problem over a class of densities. The obvious first step, "the AMS is minimized by the most concentrated density", has no direct meaning without fixing the density value and the slope of at the quantile; after fixing them, one needs the envelope of Lemma 2, a stochastic comparison (Lemma 3) and an explicit integral of a truncated exponential. The Domination Lemma as printed is false (a density whose support has a gap to the right of is a counterexample), so it is formalized under the hypothesis that the dominating density is positive exactly on an interval around , which is how Proposition 1 uses it. The case (uniform minimizer) and the two boundary values of (one-sided exponential minimizers) are not covered by the closed form (12) and must be handled separately in a proof of the goal. Finally, Lemma 1 rests on the monotonicity of the failure rate and the reversed hazard rate of log-concave laws, which must be proved from log-concavity.
Formalization scope
Densities are functions ℝ → ℝ with IsPdf f (measurable, nonnegative everywhere, integrable, total integral 1); the law of is never introduced separately. Log-concavity is the published definition ConvexOptimization.LogConcaveOn Set.univ f (power form, zeros allowed). Concavity of Real.log ∘ f is not used, because Real.log 0 = 0 would treat as off the support. The quantile is an sInf; for its defining set is nonempty and bounded below. The AMS is the difference of two ratios of integrals. At the quantile both denominators are positive, and the goal and Proposition 1 assume no integrability of , since log-concave densities have exponential tails. The value is taken pointwise; lies in the interior of the support, where a log-concave density is continuous.
Conventions and disclosed departures from the page:
- ", the set of all subgradients" is read as the superdifferential of the concave on .
- Lemma 3 carries three added hypotheses: vanishes outside some and is positive on ; ; and , are integrable. The first repairs the printed statement; the other two are the conditions under which Definition 1 makes sense for general densities.
- Proposition 1 and the closed form of are stated for and strictly inside the interval of Lemma 1, where (12) is a finite interval.
- The goal has no such restriction.
Assumption 1 of the paper (monotonicity of beyond ) and the continuity assumption of §3 are hypotheses of Theorems 3–4 only and are not used here. A formalization in which or takes a junk value (a non-integrable , a zero denominator) would make the goal trivially true or false; the hypotheses above exclude this, and no statement assumes the conclusion of another.
Contributions welcome: proofs of the milestones in any order; general lemmas on log-concave densities on (exponential tails, integrability of moments, monotone hazard rates, continuity in the interior of the support); and the boundary cases of problem (11).
Selected references
- R. Levi, G. Perakis, J. Uichanco, The Data-Driven Newsvendor Problem: New Bounds and Insights, Operations Research 63(6):1294–1306, 2015. Authors' accepted manuscript, MIT DSpace. https://doi.org/10.1287/opre.2015.1422
- R. Levi, R. O. Roundy, D. B. Shmoys, Provably Near-Optimal Sampling-Based Policies for Stochastic Inventory Control Models, Mathematics of Operations Research 32(4):821–839, 2007. https://doi.org/10.1287/moor.1070.0272