Inventory Control in a Fluctuating Demand Environment III: Under Stochastic Monotonicity, the Myopic and Optimal Basestock Levels Are Nondecreasing in the World StateResearch Paper
Motivation
Demand for many products does not arrive at a constant rate. It moves with an underlying environment: the economy, the season, a product's life-cycle stage, the state of a customer's own operations. Song and Zipkin (Oper. Res. 41(2):351–370, 1993) modelled this environment as a continuous-time Markov chain, the world, whose current state sets the Poisson demand rate, and showed that a basestock policy whose level depends on the current world state is optimal under linear order costs. Missions I and II of this series formalize those optimality results.
A practitioner who uses such a policy wants to know how the levels depend on the world. If a higher world state means more demand now and more demand later, a higher level should be kept. That is what intuition says, but the optimal level depends on the whole future of the world chain, not only on the current demand rate. §4 of the paper answers it for a world with an arbitrary partial order, which covers several independent demand drivers at once.
Setting
The world is a continuous-time Markov chain on a countable set with generator , , and bounded rates , . While , unit demands arrive at rate , all demand is backlogged, and orders arrive after a random lead time that is independent of the world and the demand. Costs are discounted at rate . With the unit order cost , holding rate and penalty rate , set and
where is the demand during a lead time when the world starts in . Uniformizing at a rate with and , the myopic cost is . The linear-cost model () is solved by value iteration from :
, with limits and . The myopic level , the finite-horizon levels and the optimal level are the smallest minimizers of , and , and . Throughout, (Assumption 1).
The world states carry a partial order . The chain is stochastically partial-monotone (display (14)) if for every there is a probability space carrying copies of started at and at whose paths satisfy for all almost surely. Condition 1 requires this together with nondecreasing in .
Formalization targets
Goal: Theorem 8
Under Condition 1, the three families of levels exist and are nondecreasing along :
Milestones
- Lemma 8, with its fixed-lead-time form from the proof: given is stochastically smaller than given for each , and .
- Lemma 9: for .
- Theorem 7: for all and fixed , and are nonincreasing in , and is nondecreasing in .
- Theorem 9 (companion): if only for , then , so the myopic policy is optimal.
- Theorem 10 (companion): with a fixed order cost , the bounds , , , on the optimal parameters are nondecreasing in .
Significance
Theorem 8 turns an optimal policy into a structured one. A world-dependent basestock policy has one level per world state; monotonicity says the levels follow the order of the states, which reduces search, makes the levels interpretable, and gives sanity checks for computed solutions. Theorem 9 identifies when nothing beyond the one-step cost needs to be computed at all. Theorem 10 is the paper's substitute for an open question: the authors could not show that the optimal parameters are monotone, and instead bound them between monotone functions.
All of these results are proved in the paper. None of them has been machine-checked. The formalization requires a value-iteration argument for a model with unbounded one-period costs, a coupling argument for Markov-modulated Poisson demand, and the passage to the limit in the levels. These are the ingredients of most monotone-policy results in inventory theory with Markov-modulated demand.
Difficulty
The obvious argument fails at the generator. For a single scalar world, stochastic monotonicity is equivalent to the expectation inequality (15) for nondecreasing functions, and the inductive step of Theorem 7 only needs that. For a partial order, the expectation inequality is strictly weaker than the coupling (14) (Massey 1987). The induction must also handle the cross term , which requires an embedded discrete-time chain whose one-step kernel preserves the order. The paper's Lemma 7 asserts that the embedded chain is monotone for every . As printed, this is false at : for two states with , swaps the states. A complete proof cannot rely on that lemma as printed.
A second difficulty is that the one-period cost is unbounded. The classical theorems that ordered differences survive value iteration (Denardo, Lovejoy) assume bounded costs, so the induction has to be carried out by hand, and the limits , must be justified by Lemma 4's uniform bounds.
Formalization scope
The Lean development lives in the namespace SongZipkinFluct.Monotone. World states form a countable nonempty type with a PartialOrder instance; no linear order is assumed. Inventory positions are integers. The demand-count law and the world transition function are defined by uniformization at the model's rate , the paper's own device. The lead-time law is a probability measure on , and is the series of display (16). uses an infimum over integers , and , are suprema over , which equal the limits because the sequences are nondecreasing and bounded. Monotonicity in is Monotone/Antitone with respect to . Smallest minimizers, maxima and minima are IsLeast/IsGreatest characterizations, never sInf on .
Condition 1(a) is encoded as the coupling (14) itself, with one probability space per pair and copies identified by their finite-dimensional distributions. Replacing it by the expectation inequality (15), or the partial order by a total order, would change the theorem and is ruled out. Every goal statement asserts the existence of the levels it constrains before constraining them, so no conclusion holds vacuously. The standing hypotheses together with Condition 1 are satisfiable: a one-state instance is checked in Lean.
Lemma 7 is not included because it is false as printed. A guarded version (for instance with ) would be a welcome contribution. Reusable parts include the uniformized Markov-modulated Poisson process, the coupling definition of stochastic monotonicity for a countable partially ordered state space, and the usual stochastic order on . Proofs of Lemma 9 and Theorem 7 that avoid Lemma 7 are particularly welcome.
Selected references
- J.-S. Song and P. Zipkin, Inventory Control in a Fluctuating Demand Environment, Operations Research 41(2):351–370, 1993. https://doi.org/10.1287/opre.41.2.351
- W. A. Massey, Stochastic orderings for Markov processes on partially ordered spaces, Mathematics of Operations Research 12(2):350–367, 1987. https://doi.org/10.1287/moor.12.2.350
- J. Keilson and A. Kester, Monotone matrices and monotone Markov processes, Stochastic Processes and their Applications 5(3):231–241, 1977. https://doi.org/10.1016/0304-4149(77)90033-3
- A. F. Veinott Jr., Optimal policy for a multi-product, dynamic, nonstationary inventory problem, Management Science 12(3):206–222, 1965. https://doi.org/10.1287/mnsc.12.3.206
- W. S. Lovejoy, Ordered solutions for dynamic programs, Mathematics of Operations Research 12(2):269–276, 1987. https://doi.org/10.1287/moor.12.2.269