Support Vector Machines I: Zhang's Inequality Relating the Hinge Risk and the Classification RiskTextbook
Binary classification asks for a rule that predicts a label from an observation . The natural loss for this task, the classification loss , is a step function: minimizing its empirical average over a class of functions is generally NP-hard, because the objective is non-convex and discontinuous in . Every practical…