KKT conditions characterize optimality under Slater's condition
ProvedConvexOptimization.kkt_iff_optimal_slaterThe KKT conditions characterize optimality for convex problems satisfying Slater's condition — the goal of this mission.
Consider the standard problem on ,
and assume: and every are convex and differentiable, with gradient fields , ; the vectors are linearly independent; and Slater's condition holds — some satisfies for all and for all . Then for any point ,
where being a KKT point means , , , and .
This is the theorem that makes the KKT system the working definition of optimality in convex optimization: the conditions are not merely necessary, and not merely sufficient, but an exact characterization. Sufficiency holds for any convex problem; necessity is where Slater's condition is used, via strong duality with attained dual optimum. Almost every algorithm and every hand derivation in the field is an attempt to solve this system.
Formalization Note The right-hand side uses the mission's IsKKTPoint predicate; optimality is IsMinOn f₀ (feasibleSet fc a b) x⋆ and convexity is asserted on Set.univ, matching the total-function form of the problem. Slater's point and the independence of the a j appear as explicit hypotheses of the whole iff, so both directions are stated under them even though sufficiency does not need them. Source: B&V §5.5.3, p. 244, conditions (5.49).
import Mathlib import Definitions.Def_ConvexOptimization_lagrangeDuality import Definitions.Def_ConvexOptimization_IsKKTPoint open scoped RealInnerProductSpace ENNReal open MeasureTheory
theorem ConvexOptimization.kkt_iff_optimal_slater {n mm p : ℕ}
(f₀ : EuclideanSpace ℝ (Fin n) → ℝ) (hf₀ : ConvexOn ℝ Set.univ f₀)
(fc : Fin mm → EuclideanSpace ℝ (Fin n) → ℝ)
(hfc : ∀ i, ConvexOn ℝ Set.univ (fc i))
(a : Fin p → EuclideanSpace ℝ (Fin n)) (ha : LinearIndependent ℝ a)
(b : Fin p → ℝ)
(f₀' : EuclideanSpace ℝ (Fin n) → EuclideanSpace ℝ (Fin n))
(hf₀' : ∀ x, HasGradientAt f₀ (f₀' x) x)
(fc' : Fin mm → EuclideanSpace ℝ (Fin n) → EuclideanSpace ℝ (Fin n))
(hfc' : ∀ i x, HasGradientAt (fc i) (fc' i x) x)
(xsl : EuclideanSpace ℝ (Fin n)) (hxsl_ineq : ∀ i, fc i xsl < 0)
(hxsl_eq : ∀ j, ⟪a j, xsl⟫ = b j)
(xs : EuclideanSpace ℝ (Fin n)) :
(xs ∈ feasibleSet fc a b ∧ IsMinOn f₀ (feasibleSet fc a b) xs) ↔
∃ (lam : Fin mm → ℝ) (nu : Fin p → ℝ),
IsKKTPoint fc a b f₀' fc' xs lam nu := by
sorry
Read-back
What the Lean code literally says, in plain math · claude-fable-5
Theorem. Fix implicit and assume: (a) convex on all of ; (b) each convex on all of ; (c) the family is linearly independent over (vacuous when ); (d) with having gradient at every ; (e) for each , with having gradient at every ; (f) a Slater point with strictly for every (vacuous when ) and for every . Then, for an arbitrary point , the following are equivalent:
- Left: is feasible ( for all and for all ) and for every feasible ;
- Right: there exist and such that is a KKT point for , i.e.: for all ; for all ; for all ; for all ; and as vectors of (no sign constraint on ). The equivalence is a genuine if-and-only-if for this single point ; existence of multipliers is asserted, not uniqueness, and nothing is claimed about the existence of an optimal . Note the right side's first two clauses already contain feasibility of , so the equivalence's real content in the forward direction is producing multipliers for an optimal feasible point, and in the backward direction it is global minimality over the feasible set.
Confirmed by the mission captain (proposal self-audit).