Pigeonhole Design: Balancing Sequential Experiments from an Online Matching Perspective 1: With T^η Uniform Pigeonholes on [0,1] the Expected Discrepancy Is O(T^(1/2−η/2) + T^(η/2)(log T)^(1/2))Research Paper
Online platforms run controlled experiments in which subjects (users, sessions, sellers) arrive one at a time and must be assigned to control or treatment on arrival, before later subjects are seen. A good design makes the two groups look alike in their observed covariates, because covariate imbalance inflates the variance of treatment-effect estimates.…