Proposition 15 — Riemannian Fletcher–Reeves CG with strong Wolfe steps, c₂ < 1/2, non-expansive transport: liminf ‖Df(x_k)‖ = 0
ProvedRiemOpt.FR.proposition_15Let be a smooth manifold modelled on a real Hilbert space with a Riemannian metric, differentiable with gradient , and a retraction family with transport . Consider the Fletcher–Reeves nonlinear conjugate gradient iteration
with step lengths satisfying the strong Wolfe conditions (1a), (2) with , and assume that it never stops ( for all ). Suppose that
- the transport does not increase the norm of the search direction: for all ;
- is bounded below;
- the pull-backs are Lipschitz continuously differentiable on with a uniform constant : is differentiable and .
Then
This is the Riemannian counterpart of the classical global convergence result of Al-Baali for the Fletcher–Reeves method: on a manifold the only extra ingredient is the non-expansiveness of the transport attached to the retraction.
Formalization Note Hypotheses 2 and 3 are those of Zoutendijk's theorem (Theorem 2), which the paper's proof invokes; they are not among the conditions of Lemma 14 and are stated explicitly. Descent of is not assumed (Lemma 14 proves it). The run never stops, since divides by . The is stated explicitly: for every and every there is with . One retraction family is used for all ; the step equation identifies with , whose norm is used in hypothesis 1.
import Mathlib import Definitions.Def_RiemOpt_FR_Setting open Bundle Manifold open scoped ContDiff
namespace RiemOpt.FR
variable {E : Type*} [NormedAddCommGroup E] [InnerProductSpace ℝ E] [CompleteSpace E]
{M : Type*} [TopologicalSpace M] [ChartedSpace E M] [IsManifold 𝓘(ℝ, E) ∞ M]
[RiemannianBundle (fun x : M ↦ TangentSpace 𝓘(ℝ, E) x)]
[IsContMDiffRiemannianBundle 𝓘(ℝ, E) ∞ E (fun x : M ↦ TangentSpace 𝓘(ℝ, E) x)]
theorem proposition_15
(f : M → ℝ) (R : (x : M) → TangentSpace 𝓘(ℝ, E) x → M)
(grad : (x : M) → TangentSpace 𝓘(ℝ, E) x) (c₁ c₂ : ℝ)
(x : ℕ → M) (p : (k : ℕ) → TangentSpace 𝓘(ℝ, E) (x k)) (α : ℕ → ℝ)
(hrun : IsFRRun f R grad c₁ c₂ x p α) (hc₂ : c₂ < 1 / 2)
(hT : ∀ k : ℕ, ‖transportedDir R x p α k‖ ≤ ‖p k‖)
(hbdd : BddBelow (Set.range f)) (L : ℝ) (hL : 0 < L) (hlip : LineLipschitz f R x p L) :
∀ ε > 0, ∀ N : ℕ, ∃ k ≥ N, ‖RiemOpt.BFGS.Df (E := E) f (x k)‖ < ε := by sorry
end RiemOpt.FR
Confirmed by the mission captain (proposal self-audit).
Confirmed by the moderator at approval.