Flows and Decompositions of Games: Harmonic and Potential Games 1: Every Finite Game Decomposes Uniquely into Potential, Harmonic and Nonstrategic ComponentsResearch Paper
Motivation
Potential games (Monderer and Shapley, 1996) are the finite games whose incentives are captured by a single function on strategy profiles: every unilateral change of strategy changes the deviator's payoff by exactly the change of a common potential. They have pure Nash equilibria, and natural learning dynamics such as better-reply and fictitious play converge in them. Most games are not potential games, however, and before Candogan, Menache, Ozdaglar and Parrilo there was no canonical way to say how far a given game is from one, or what the remainder looks like.
Their paper (arXiv:1005.2405; Math. Oper. Res. 36(3), 2011) answers this by viewing a game as a flow on a graph. The payoff differences between profiles that differ in one player's strategy form an edge flow on the game graph, and the classical Helmholtz (Hodge) decomposition of edge flows into gradient, harmonic and curl parts (Jiang, Lim, Yao, Ye, 2011) pulls back to a decomposition of the game itself. Every finite game becomes the sum of a potential game, a harmonic game and a component that carries no strategic information. The decomposition is the basis for the rest of the paper (equilibria of harmonic games, projections onto potential games, approximate equilibria) and for later work on dynamics in near-potential games.
Setting
Fix a finite set of players and, for each player , a finite nonempty strategy set with elements. A strategy profile is , and denotes the strategies of the players other than . A game is a family of utilities with , so the space of games is , where with .
Two profiles are -comparable if they are distinct and differ only in player 's strategy. The game graph has the profiles as nodes and an edge between comparable profiles. An edge flow is a function that is antisymmetric on edges and zero off edges; the space of edge flows carries . Triangular flows live on ordered 3-cliques.
The operators are: the gradient , with the edge indicator; the curl on 3-cliques; the per-player gradient , with the indicator of -comparability; and , , the flow of pairwise comparisons of . Adjoints are written and Moore–Penrose pseudoinverses . The space carries the unweighted inner product . Further, , , , and .
A game is normalized if for all and (Definition 4.1). The potential, harmonic and nonstrategic subspaces are (Definition 4.2)
Formalization targets
Goal: Theorem 4.1
and every game splits as with
where is a potential function of , i.e. .
Milestones
- Theorem 3.1 (Helmholtz decomposition), on an arbitrary finite graph: , orthogonally, with .
- Lemma 4.1: .
- Lemma 4.2: , with an explicit basis indexed by .
- Lemma 4.4 (i)–(v): ; ; ; ; .
- Lemma 4.5: normalized for all .
Lemma 4.6 (the unique normalized game with the same pairwise comparisons is ) is included as a supporting theorem.
Significance
The decomposition turns questions about a game into questions about its three components. The potential component inherits the equilibrium and convergence theory of potential games. The harmonic component has a sharply different structure: harmonic games generically have no pure equilibrium, and in each of them the uniformly mixed profile is a mixed equilibrium. The nonstrategic component does not affect any equilibrium notion. The closed-form expressions also give the potential game closest to a given game, and with it bounds relating the approximate equilibria of the two games. The other missions of this series formalize those consequences; all of them rest on the operator layer and the subspaces defined here.
Theorem 4.1 is proved in the paper; to our knowledge it has not been machine-checked. A formal development produces graph-flow infrastructure that Mathlib does not yet have: edge and triangular flows with their inner products, the combinatorial gradient and curl, the Helmholtz decomposition of a finite graph, and an operator Moore–Penrose pseudoinverse on finite-dimensional inner product spaces. The paper leaves Theorem 3.1 to the literature, so a full development needs a proof of it. The pseudoinverse identities of Lemma 4.4 also have a short appendix argument in the paper that a formal proof has to make complete.
Difficulty
The decomposition is not orthogonal decomposition along a single map. The subspaces and are defined through , which is assembled player by player from the , while the flow conditions involve and the combined operator . Connecting the two requires the player operators to have mutually orthogonal ranges ( for ) and the explicit form of as a scaled projection. Without these, (Lemma 4.4 (iv)) and (Lemma 4.4 (v)) are not available, and they are what make the formulas for and land in and . A direct attempt to apply the Helmholtz decomposition to produces a flow decomposition, not a game decomposition; the pullback through is not formal, because is neither injective nor surjective.
Formalization scope
Players form a Fintype ι; strategy sets are E : ι → Type with Fintype, DecidableEq and Nonempty instances, and is Fintype.card (E m). Profiles are ∀ m, E m, and is Function.update p m q. The game graph is a Mathlib SimpleGraph; comparability requires , so the graph has no loops, as the Laplacian (15) requires. is EuclideanSpace ℝ on profiles. and are type synonyms of the subspaces of antisymmetric (resp. alternating) functions, with inner products built from (7), including the factor on . Lemma 4.4 (i) fails without it. The space of games is PiLp 2 of copies of , whose inner product is the unweighted sum used on p. 14, not the weighted inner product of the paper's Section 6. Adjoints are LinearMap.adjoint. The pseudoinverse is defined explicitly as the inverse of on composed with the orthogonal projection onto .
, and are defined by (28), not as the ranges of the component maps; the direct-sum part of the goal is stated independently of the formulas, so the goal cannot be satisfied by construction. Lemma 4.4 is split into five items, one per identity. "Orthogonal decomposition" in Theorem 3.1 is stated as pairwise orthogonality plus spanning. The paper's statements have no hypotheses beyond the setting, and none were added except nonemptiness of the strategy sets, which the paper assumes by writing .
Welcome contributions: a proof of the Helmholtz decomposition on a finite simple graph, general facts about the pseudoinverse (Penrose identities, is the projection onto , invariance under rescaling of inner products), and the explicit adjoint formulas (12) and (22).
Selected references
- O. Candogan, I. Menache, A. Ozdaglar, P. A. Parrilo, Flows and Decompositions of Games: Harmonic and Potential Games, arXiv:1005.2405v2, 2010; Mathematics of Operations Research 36(3):474–503, 2011. https://arxiv.org/abs/1005.2405, https://doi.org/10.1287/moor.1110.0500
- D. Monderer, L. S. Shapley, Potential Games, Games and Economic Behavior 14(1):124–143, 1996. https://doi.org/10.1006/game.1996.0044
- X. Jiang, L.-H. Lim, Y. Yao, Y. Ye, Statistical Ranking and Combinatorial Hodge Theory, Mathematical Programming 127:203–244, 2011. https://arxiv.org/abs/0811.1067
- R. Penrose, A generalized inverse for matrices, Mathematical Proceedings of the Cambridge Philosophical Society 51(3):406–413, 1955. https://doi.org/10.1017/S0305004100030401