Efficiently Breaking the Curse of Horizon in Off-Policy Evaluation with Double Reinforcement Learning: Cross-Fitted DRL Is Asymptotically Linear and Normal at the MDP Efficiency BoundResearch Paper
Off-policy evaluation (OPE) asks for the long-run value of a target decision policy, using only data collected under a different policy. It arises wherever running the target policy is expensive or unsafe: a new treatment rule in medicine, a new recommendation or pricing rule, a candidate controller in reinforcement learning. Importance-sampling estimators…