Average Cost Markov Decision Processes with Weakly Continuous Transition Probabilities: Assumptions (W*) and (B̲) Give the Average Cost Optimality Inequality and a Stationary Optimal PolicyResearch Paper
A Markov decision process (MDP) with the average cost per unit time criterion models a controller who runs a stochastic system indefinitely and cares about long-run cost rather than any finite horizon: inventory control, queueing control, and maintenance are standard examples. The basic questions are whether an optimal policy exists, whether it can be taken …