Markov Decision Processes with Applications to Finance XII: The Primal and Dual Linear Programs of a Contracting Markov Decision Problem Have Equal Values and Optimal SolutionsTextbook
A discounted Markov Decision Problem asks for a policy that maximizes the expected discounted sum of rewards of a controlled Markov chain. Besides value iteration and policy iteration, the third classical way to compute such policies is linear programming: the value function is the smallest function satisfying a family of linear inequalities, and the dual…