Level conditional, Eq. (2)
ProvedNestedCRP.level_conditionalbayesian-nonparametricsp2o-gran-per-chapterp2o-plan-paperp2o-v1topic-models
Fix a state and a site . The level weights are positive and summable with positive total, and for all levels ,
So the full conditional of given everything else is the level prior of §5.1 times the normalized word predictive. This is the distribution step (b) of the sampler draws from.
Differences from the source:
- reading: Eq. (2) with the second factor as printed in Eq. (3) → the second factor is the normalized predictive; reason: the only reading under which Eq. (2) holds; see word_predictive
- reading: Eq. (2) writes ∝ with no normalizing claim → the weights are positive and summable with positive total; reason: ∝ over infinitely many levels presupposes a finite positive normalizer
- encoding: proportionality → a cross-multiplied identity over pairs of levels; reason: equivalent since the weights are positive
Preamble
import Mathlib import Definitions.Def_NestedCRP_levelWeight import Definitions.Def_NestedCRP_posterior
Formal statement
namespace NestedCRP
/-- Eq. (2): as a function of the level of site `s₀`, the joint is proportional to the level weight.
The weights are positive and summable with positive total, so the conditional law they define
exists. Blei–Griffiths–Jordan, *The nested Chinese restaurant process and Bayesian nonparametric
inference of topic hierarchies*, J. ACM 57(2), Article 7 (2010), Eq. (2), p.7:16. -/
theorem level_conditional {V D : ℕ} (H : Hyper) (C : Corpus V D) (x : C.State) (s₀ : C.Site) :
(∀ k, 0 < levelWeight H C x s₀ k) ∧ Summable (levelWeight H C x s₀) ∧
0 < ∑' k, levelWeight H C x s₀ k ∧
∀ k k', joint H C (x.1, C.setLevel x.2 s₀ k) * levelWeight H C x s₀ k' =
joint H C (x.1, C.setLevel x.2 s₀ k') * levelWeight H C x s₀ k := by sorry
end NestedCRP
Source
Blei–Griffiths–Jordan, The nested Chinese restaurant process and Bayesian nonparametric inference of topic hierarchies, J. ACM 57(2), Article 7 (2010), https://doi.org/10.1145/1667053.1667056, Eq. (2), p.7:16
Human review
Confirmed by the mission captain (proposal self-audit).
Confirmed by the moderator at approval.