A Proximal Alternating Direction Method of Multiplier for Linearly Constrained Nonconvex Minimization: With Small Stepsizes the Smoothed Proximal ADMM Iterates Approach the KKT SetResearch Paper
The alternating direction method of multipliers (ADMM) and the closely related augmented Lagrangian method are workhorses for linearly constrained optimization: they split a problem into cheap primal steps and a dual (multiplier) update, and they scale to large and distributed instances (Boyd et al., 2011). For convex objectives their convergence theory is…