Linear Programming and Markov Decision Chains 1: A Pure Policy Read Off a Simplex-Optimal Solution of One Dual LP Is Average Optimal in Every Finite Multichain MDPResearch Paper
A Markov decision chain with finitely many states and actions is the basic model of sequential decision making under uncertainty in operations research. Inventory control, maintenance, queueing control and many other problems reduce to it. Under the average reward criterion the decision maker optimizes the long-run reward per period. For the discounted…