A Branch and Bound Algorithm for the Generalized Assignment Problem: The Knapsack Penalty Bound Equals the Lagrangean Bound at Second-Smallest CostsResearch Paper
Motivation
The generalized assignment problem (GAP) asks for the cheapest way to give each of tasks to exactly one of agents when every agent has a limited amount of a resource and different agents consume different amounts of it for the same task. It models assigning jobs to machines or computers, software tasks to programmers, commercials to time slots, and customers to single-source plants in capacitated facility location. The problem is NP-hard, so exact methods rely on lower bounds that are cheap to compute and strong enough to prune a branch and bound tree.
G. Terry Ross and Richard M. Soland (Mathematical Programming 8, 1975) gave such a bound. The relaxation that ignores the resource limits is solved by giving every task to its cheapest agent; the overloaded agents are then repaired by one small binary knapsack problem each, whose optimal values are added as penalties. Their paper then shows that this repaired bound is not an ad hoc heuristic: it is exactly the value of a Lagrangean relaxation of the GAP at an explicit choice of multipliers. This identity made the Ross–Soland bound the reference point for the later Lagrangean and column-generation methods for the GAP (for example Fisher, Jaikumar and Van Wassenhove, Management Science 1986 and Savelsbergh, Operations Research 1997).
Setting
Agents are and tasks . Giving task to agent costs and uses units of agent 's resource; agent has units. The problem is
Dropping the resource constraints gives the relaxation (PR). It is solved by choosing, for each task , a cheapest agent with and setting ; its value is . Let be the tasks this solution gives to agent , the overloaded agents, and the excess of agent . The penalty of moving task away from is . For the binary knapsack problem
chooses the cheapest set of tasks to move off agent ; call its optimal value . The knapsack bound is
Dualizing the assignment constraints with multipliers gives the Lagrangean relaxation
Finally and are the smallest and second smallest of , counted with multiplicity.
Formalization targets
Goal: the knapsack bound is the Lagrangean bound at
For every cheapest-agent choice and every choice of optimal knapsack solutions,
the minimum being attained, and consequently for every feasible for (P). This is the paper's "principal result of this Lagrangean analysis" (§2, p. 96). It has no constants to improve; it is an identity between two optimization problems.
Milestones
In the paper's order of use: (PR) is solved by the cheapest agents (pp. 93–94); every lower bound on (PR) is a lower bound on (P) (p. 95); (PR) separates into one binary knapsack per agent (p. 95); at the variables that are zero in the (PR) solution can be fixed at zero, the substitution turns agent 's part into (PK), , and agent 's part has value (p. 96). Two side results close the section: the solution obtained by moving the tasks the knapsacks select has cost exactly LB, so it is optimal whenever it is feasible (pp. 94–95); and the optimal dual multipliers of the bounded-variable linear program (PR) are exactly the vectors with (pp. 95–96).
Significance
The identity says that a bound computed from one sorting pass and a handful of small knapsacks equals a Lagrangean dual bound at a closed-form multiplier. Validity of LB for (P) then follows from weak Lagrangean duality alone, and the multiplier is the upper end of the range of optimal dual multipliers of the linear program (PR), which the paper singles out as a suitable choice of multipliers. The rebuilt solution gives the algorithm a feasible incumbent at no extra cost whenever the knapsack repairs happen to respect all budgets.
The result is proved in the paper, in one sentence. The mission turns that sentence into checked statements: the separation of (PR), the reduction of each agent's subproblem to (PK), the handling of ties among cheapest agents, and the role of nonnegative resources. As far as a search of the platform shows, nothing about the generalized assignment problem or its Lagrangean bounds has been formalized; the definitions here (assignment relaxations, per-agent knapsacks, bounded-variable duals) are reusable for other GAP and facility-location missions.
Difficulty
The Lagrangean relaxation at is a larger problem than the knapsack bound suggests: a feasible may give a task to several agents or to none, and may use any agent, not only the cheapest one. The knapsack bound, by contrast, only looks at the tasks each agent receives in the (PR) solution. The paper bridges the two in one sentence of three observations, and each observation depends on a condition the sentence does not state: the sign of the resource coefficients, the treatment of agents that are not overloaded (for which no knapsack is solved), and ties among cheapest agents, which make some penalties zero and require the statement to hold for every tie-break. An inequality in one direction only (LB is a valid bound) is not the claim; the equality needs a feasible point of (PR) whose value is exactly LB.
Formalization scope
Agents are Fin m and tasks Fin n, indexed from 0. Costs, resources, budgets, multipliers and variables are real numbers; a 0-1 variable is a real equal to 0 or 1, so the paper's sums are literal. The cheapest-agent selection is an arbitrary function a : Fin n → Fin m with IsCheapest c a, so every statement holds for every tie-break. and are minima over the other agents, which requires (hm : 1 < m); is proved to be the second smallest cost with multiplicity. Optimal values are never encoded as sInf: is the objective of a given optimal knapsack solution, and "the bound provided by (PR)" is stated as a lower bound over all feasible points that is attained.
Standing hypotheses: (printed on p. 92), (implicit in "the resource required", and necessary: with a negative both (PR) and (P) can fall below LB), and . All costs are finite; the "not permissible" pairs of the paper's numerical example are outside the model.
A formalization that states only every (PR) value, or that restricts the (PR) competitors to the (PR) support or to at most one agent per task, would be a weaker theorem and does not meet the goal. The (PR) dual is written out explicitly with multipliers for the bounds ; "each optimal dual multiplier lies anywhere in the range " is read as "the optimal multipliers are exactly this box".
Needed infrastructure is only finite sums over Fin and Finset.inf'. Proofs of the milestones, and lemmas on separable binary programs that could serve other Lagrangean-relaxation missions, are welcome.
Selected references
- G. T. Ross and R. M. Soland, A branch and bound algorithm for the generalized assignment problem, Mathematical Programming 8 (1975) 91–103. https://doi.org/10.1007/BF01580430
- A. M. Geoffrion, Lagrangean relaxation for integer programming, Mathematical Programming Study 2 (1974) 82–114. https://doi.org/10.1007/BFb0120690
- M. L. Fisher, R. Jaikumar and L. N. Van Wassenhove, A multiplier adjustment method for the generalized assignment problem, Management Science 32 (1986) 1095–1103. https://doi.org/10.1287/mnsc.32.9.1095
- M. Savelsbergh, A branch-and-price algorithm for the generalized assignment problem, Operations Research 45 (1997) 831–841. https://doi.org/10.1287/opre.45.6.831