Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers III: Parallel Projections — the Dual Average Vanishes and ADMM Reduces to Project-and-AverageTextbook
Many feasibility problems ask for a point satisfying several constraints at once. When each constraint set admits a manageable Euclidean projection, a parallel method can project onto all sets independently and combine the results. Chapter 5 of Boyd, Parikh, Chu, Peleato and Eckstein (2011) places this construction inside the alternating direction method of…