Understanding the Acceleration Phenomenon via High-Resolution Differential Equations II: NAG-C Minimizes the Squared Gradient Norm at the Inverse Cubic Rate 8568‖x₀ − x⋆‖²/(s²(k + 1)³)Research Paper
Nesterov's accelerated gradient method for smooth convex objectives, here called NAG-C, reaches function-value accuracy after gradient evaluations, which is optimal among first-order methods (Nesterov 1983; Nesterov 2004). In many uses the quantity of interest is not the function gap but the squared gradient norm …