Outline of the proof of Theorem 1 — for the square loss and the cost (corrected at )
ProvedRWPI.SqrtLasso.phi_Nq_closed_formdistributionally-robust-optimizationlinear-regressionp2o-batch-pfp2bp2o-gran-per-chapterp2o-plan-paperp2o-v1
Fix and let satisfy . Let and , and write . For the square loss and the cost of (14), let
where points with (infinite cost) do not contribute. Then for every
With this formula and Proposition 1, the worst-case square loss of Theorem 1 becomes a one-dimensional minimization over .
Correction of the printed statement. The page gives for every (and writes for and for ). At the supremum is finite when (value ) or when (then and the value is ). The correction does not affect Theorem 1.
Formalization Note is the mission's phi with the cost ; the convention that infinite-cost points never contribute holds for every , including . Values are in .
Preamble
import Mathlib import Definitions.Def_RWPI_SqrtLasso_phi import Definitions.Def_RWPI_SqrtLasso_squareLoss import Definitions.Def_RWPI_SqrtLasso_Nq
Formal statement
namespace RWPI.SqrtLasso
/-- Outline of the proof of Theorem 1, last display (App. A.1, p. 29), corrected at the boundary:
`φ_γ` for the square loss and the cost `N_q²`. With `a = y − βᵀx`, `1/p + 1/q = 1` and `γ ≥ 0`:
`φ_γ((x, y); β) = γ/(γ − ‖β‖_p²) · a²` if `γ > ‖β‖_p²`; `a²` if `γ = ‖β‖_p²` and (`a = 0` or
`β = 0`); `+∞` otherwise. (The page prints `+∞` for all `γ ≤ ‖β‖_p²`.) -/
theorem phi_Nq_closed_form {d : ℕ} (q p : ENNReal) (hq : 1 < q) (hpq : p.HolderConjugate q)
(β : Fin d → ℝ) (z : (Fin d → ℝ) × ℝ) (γ : ℝ) (hγ : 0 ≤ γ) :
phi (fun u w => Nq q u w ^ 2) (squareLoss β) γ z =
if ‖WithLp.toLp p β‖ ^ 2 < γ then
ENNReal.ofReal (γ / (γ - ‖WithLp.toLp p β‖ ^ 2) * (z.2 - ∑ j, β j * z.1 j) ^ 2)
else if γ = ‖WithLp.toLp p β‖ ^ 2 ∧ (z.2 - ∑ j, β j * z.1 j = 0 ∨ β = 0) then
ENNReal.ofReal ((z.2 - ∑ j, β j * z.1 j) ^ 2)
else ⊤ := by sorry
end RWPI.SqrtLasso
Source
Blanchet, Kang & Murthy, Robust Wasserstein Profile Inference and Applications to Machine Learning, arXiv:1610.05627v4, p. 29, App. A.1, outline of a proof of Theorem 1, last display
Human review
Confirmed by the mission captain (proposal self-audit).
Confirmed by the moderator at approval.