An Application of Simultaneous Diophantine Approximation in Combinatorial Optimization: A Small Integral Objective with the Same Optimal Solutions and Dual BasesResearch Paper
Motivation
An algorithm for linear programming is strongly polynomial if the number of arithmetic operations it performs is bounded by a polynomial in the dimension of the problem alone (the number of variables and constraints), independently of the bit lengths of the numbers in the input. Many combinatorial optimization problems are linear programs over polyhedra of the form whose constraint matrix has entries , but whose objective vector is an arbitrary rational weight vector. Polynomial-time algorithms for such problems (for instance the ellipsoid-based algorithms of Grötschel, Lovász and Schrijver for maximum-weight cliques in perfect graphs, submodular flows, and matroid polyhedra) have running times that depend on the length of .
Frank and Tardos (Combinatorica 1987) remove this dependence once and for all: they replace by an integral objective whose entries have bits and which has exactly the same optimal solutions and the same optimal dual bases as over every such polyhedron. Any algorithm that is polynomial in and in the length of the objective then becomes strongly polynomial. The tool is simultaneous Diophantine approximation, used through the lattice-basis-reduction algorithm of Lenstra, Lenstra and Lovász (Math. Ann. 1982). The technique extends Tardos's strongly polynomial algorithm for linear programs with small constraint matrices (Oper. Res. 1986), which applies only to explicitly given programs.
Setting
For write and ; takes the values .
Decomposition. Fix a positive integer . A decomposition of is an expression
It satisfies condition (iii) if for the vector is nonzero and : the coefficients decrease so quickly that each term is negligible against the previous one.
Preprocessing. Given a rational and , the paper's preprocessing algorithm finds a decomposition with , condition (iii), and the size bound (ii)' , and outputs
Linear programs. Let be an matrix with entries in and . The primal program is and the dual program is . A point is -maximal if . A dual basis is a maximal set of row indices of whose rows are linearly independent; it determines at most one with supported on it (the basic dual solution), and it is an optimal dual basis if that exists and is optimal for the dual program.
Formalization targets
Goal — Theorem 4.2 (p. 58)
For every , with , there is with
such that for every matrix with columns and every : (i) is -maximal if and only if it is -maximal; (ii) a set of rows of is an optimal dual basis for if and only if it is one for . The vector depends on only, not on or .
Milestones
- Dirichlet's theorem (p. 52): for and there are and with for all .
- Theorem 3.1 (p. 53): every has a decomposition with , and condition (iii).
- Lemma 3.2 (pp. 54–55): under condition (iii), for integral with , for the smallest with , and if there is no such .
- Theorem 3.3 (p. 56): the preprocessed satisfies and for all integral with .
- The case (p. 55): an integral with and for all subsets of coordinates.
- Lemma 4.1 (i) (p. 57): if for all integral with , then and have the same maximizers over for every matrix .
- Lemma 4.1 (ii) (p. 57): under the same hypothesis, a dual basis is optimal for if and only if it is optimal for .
Significance
The result gives a general reduction: whenever a class of polyhedra with constraint matrices admits an optimization algorithm that is polynomial in and in the length of the objective, it admits a strongly polynomial one. The paper applies this to maximum-weight cliques in perfect graphs, optimization over submodular flow polyhedra, and matroid polyhedra membership, and its Section 5 applies the same rounding to the integer programming algorithms of Lenstra and Kannan. The subset-sum corollary (milestone 5) is independently useful: every rational weight function on a finite set can be replaced by an integral one with -bit entries that orders all subset sums identically.
All statements of this mission have been proved on paper since 1987. None is formalized on Prove2Me, and Mathlib contains only the one-dimensional Dirichlet approximation theorem. The mission produces a machine-checked version of the exact statements, with the explicit constants of the paper; the complexity claims (operation counts, strong polynomiality) are not part of it.
Difficulty
The goal combines two independent parts. The number-theoretic part (milestones 1–5) needs a multidimensional Dirichlet theorem, an induction producing the decomposition, and exact inequality chains with the constants and . The linear-programming part (milestones 6–7) needs bounds on the entries of inverses of nonsingular submatrices, the existence of optimal dual solutions supported on a dual basis, LP duality and complementary slackness. The obvious first idea, scaling to an integer vector by a common denominator, preserves every sign but gives no bound on in terms of ; the bound is the content of the theorem. Likewise, rounding each coordinate of separately to a fixed precision does not preserve the sign of when is tiny but nonzero.
Formalization scope
Vectors are functions on Fin n: the input is rational (Fin n → ℚ) in the goal, in Theorem 3.3 and in the subset-sum corollary, as in the algorithm's input line; it is real in Theorem 3.1, Lemma 3.2 and Lemma 4.1, as on the page. Integral vectors are Fin n → ℤ, and is a Matrix (Fin m) (Fin n) ℤ with every entry in , cast to ; is unrestricted. Decompositions are indexed by as in the paper. is always the explicit sum , compared with in ; of an integer vector is a natural number (supNorm). Sign equality uses SignType.sign and includes the zero case. Condition (iii) is stated multiplicatively together with , which the paper's quotient presupposes; without Lemma 3.2 fails. An optimal dual basis is a maximal linearly independent set of row indices together with an optimal dual solution supported on it.
Two formalizations would make the goal trivial and are excluded: dropping the bound on (a multiple of then works), and letting depend on and (the goal states before ). The assumption on is part of every Section 4 statement.
A complete development needs a multidimensional pigeonhole argument, determinant and adjugate bounds for matrices, and basic LP duality (strong duality, complementary slackness, basic optimal dual solutions); the last two are reusable across linear-programming missions. Proofs of individual milestones, reusable lemmas on LP duality, and alternative proofs of Dirichlet's theorem are all welcome.
Selected references
- A. Frank and É. Tardos, An application of simultaneous diophantine approximation in combinatorial optimization, Combinatorica 7(1) (1987) 49–65. https://doi.org/10.1007/BF02579200
- A. K. Lenstra, H. W. Lenstra Jr. and L. Lovász, Factoring polynomials with rational coefficients, Math. Ann. 261 (1982) 515–534. https://doi.org/10.1007/BF01457454
- É. Tardos, A strongly polynomial algorithm to solve combinatorial linear programs, Operations Research 34(2) (1986) 250–256. https://doi.org/10.1287/opre.34.2.250
- M. Grötschel, L. Lovász and A. Schrijver, The ellipsoid method and its consequences in combinatorial optimization, Combinatorica 1 (1981) 169–197. https://doi.org/10.1007/BF02579273
- J. W. S. Cassels, An Introduction to the Theory of Numbers (title as printed in the paper's reference [2]), Springer, Berlin, 1971; cited in the paper as [2, Sect. 1.10] for Dirichlet's theorem.