Proof of Theorem 4.5, p. 12 — off-diagonal blocks: ⟨∂ℱ/∂a^(n1)_{i r1}, ∂ℱ/∂a^(n2)_{j r2}⟩ = w^{n1,n2}_{r1r2} a^(n1)_{i r2} ā^(n2)_{j r1}
ProvedTensorBTD.Gramian.off_diagonal_blockscanonical-polyadic-decompositiongramianjacobianp2o-batch-pfp2ap2o-gran-per-chapterp2o-plan-paperp2o-v1tensor-decomposition
In the setting of the unstructured CPD in rank-one terms, with factor matrices and residual , let , with entries . Then for every pair of distinct modes , columns , a row of mode and a row of mode :
- the tensor inner product (conjugate on the first argument) of the two partial derivatives is
- consequently the block of the Gramian of the CPD Jacobian, at rows belonging to column and columns belonging to , is the rank-one matrix
Note the crossed column indices: the block involves column of and column of . These are the off-diagonal blocks of (4.12). The statement holds for every tensor and every choice of factor matrices.
Formalization Note. Indices are 0-based. The rank-one matrix is written with Mathlib's vecMulVec u (conj v).
Preamble
import Mathlib import Definitions.Def_TensorBTD_Gramian_Setting
Formal statement
namespace TensorBTD.Gramian
open Matrix
theorem off_diagonal_blocks {P Q R : ℕ} {I : Fin P ⊕ Fin Q → ℕ} {L : Fin R → ℕ}
(T : Tensor I) (x : GIdx I L → ℂ) (n1 n2 : Fin P ⊕ Fin Q) (hn : n1 ≠ n2) (r1 r2 : Col L) :
(∀ (i : Fin (I n1)) (j : Fin (I n2)),
tensorInner (fun ι => jac (cpdResidual T) x ι ⟨n1, (r1, i)⟩)
(fun ι => jac (cpdResidual T) x ι ⟨n2, (r2, j)⟩) =
W {n1, n2} (cpdFactor x) r1 r2 * cpdFactor x n1 i r2 *
starRingEnd ℂ (cpdFactor x n2 j r1)) ∧
(Matrix.of fun (i : Fin (I n1)) (j : Fin (I n2)) =>
((jac (cpdResidual T) x)ᴴ * jac (cpdResidual T) x) ⟨n1, (r1, i)⟩ ⟨n2, (r2, j)⟩) =
W {n1, n2} (cpdFactor x) r1 r2 •
Matrix.vecMulVec (fun i => cpdFactor x n1 i r2)
(fun j => starRingEnd ℂ (cpdFactor x n2 j r1)) := by sorry
end TensorBTD.Gramian
Source
Sorber, Van Barel & De Lathauwer, Optimization-Based Algorithms for Tensor Decompositions, SIAM J. Optim. 23(2) (2013), doi:10.1137/120868323, authors' manuscript (Lirias), p. 12, proof of Theorem 4.5, "Off-diagonal blocks" displays
Human review
Confirmed by the mission captain (proposal self-audit).
Confirmed by the moderator at approval.