Global Convergence Properties of Conjugate Gradient Methods for Optimization I: Conjugate Gradient Methods with |β_k| ≤ β_k^FR Are Globally Convergent under Strong Wolfe Line SearchesResearch Paper
Nonlinear conjugate gradient methods minimize a smooth function of variables using only function values, gradients and a few vectors of storage. They are the method of choice when is so large that quasi-Newton matrices cannot be stored, and they remain a standard component of large-scale optimization software. Their convergence theory is delicate: the…