From Error Bounds to the Complexity of First-Order Descent Methods for Convex Functions 1: Subgradient Descent Sequences of Convex KL Functions Obey f(x_k) ≤ ψ(α_k) for a 1-D Worst-Case Prox SequenceResearch Paper
Many first-order methods for convex minimization — the forward–backward (proximal gradient) method, alternating minimization, trust-region and majorization–minimization schemes — produce sequences that decrease the objective by an amount proportional to the squared step and whose step controls a subgradient at the new point. Luo and Tseng (Ann. Oper. Res.…