Adaptive Data Analysis and Adversarial Robustness on Insertion-Deletion StreamsResearch Paper
Statistical analyses are often adaptive: an analyst inspects earlier results on a data set before choosing the next test. When the tests are chosen this way, the empirical answers on a fixed sample can overfit, and a result that looks significant may only reflect the sample [HU14, SU15, DFH+15b]. Adaptive data analysis turns this into a question about…