Global Optimality Guarantees for Policy Gradient Methods 1: If the Policy Class Is Closed Under Policy Improvement, Every Stationary Point of the Policy Gradient Objective Is Globally OptimalResearch Paper
Policy gradient methods optimize a parameterized policy for a Markov decision process by running gradient descent on its expected cost. They underlie most large-scale reinforcement learning, from robotics to game playing, and are also natural in operations research, where structured policy classes (linear feedback, base-stock levels, thresholds) are…