Distribution-Free, Risk-Controlling Prediction Sets I: Upper Confidence Bound Calibration Selects a λ̂ Whose Risk Is at Most α with Probability at Least 1 − δ (Theorem 1)Research Paper
A trained classifier or regressor returns a point prediction, but many uses of machine learning need a prediction set: a set of plausible labels together with a guarantee about how often, or how badly, it misses the truth. Medical imaging, protein structure prediction and multi-label classification are examples where a user wants a set whose expected loss…