Resource Allocation and Cross-Layer Control in Wireless Networks III: Lyapunov Optimization for Utility and FairnessTextbook
Motivation
Chapters 3-4 of Georgiadis, Neely & Tassiulas's survey Resource Allocation and Cross-Layer Control in Wireless Networks (Foundations and Trends in Networking, 2006) answer "can the network stay stable?" — the backpressure algorithm's throughput optimality (Theorem 4.5) says yes, for any arrival rate inside the capacity region. But networks are usually operated with plenty of unused capacity precisely so that they can also serve a second goal: maximizing some concave utility (throughput, fairness, revenue) of the rates actually delivered. Answering "how close to utility-optimal can a stable policy get, and at what congestion cost?" needs a single theorem that treats stability and utility optimization in one drift analysis. Theorem 5.4, adapted from Neely, Modiano & Li [108], Georgiadis, Neely & Tassiulas [115] and Neely [116], is that theorem, and it is the technique — "Lyapunov optimization" or "drift-plus-penalty" — behind a large fraction of the cross-layer control literature that followed this book.
Setting
A network of queues has backlog vector , and a -dimensional control process influencing the system's dynamics (e.g. admitted data rates). For any nonnegative function of the backlog vector, the one-step Lyapunov drift is , the expected one-slot change in conditioned on the current backlog. Given any scalar-valued concave utility function of a -dimensional rate vector and an arbitrary target value , the goal is to stabilize while making the time-average utility of close to . The time-average rate vector is (5.18), and the achieved long-run utility is .
Formalization targets
Milestone — Lemma 5.3 (Lyapunov Drift)
The most abstract drift lemma in the whole book: are arbitrary scalar processes, not necessarily linear or even a function of .
Goal — Theorem 5.4 (Lyapunov Optimization)
This is the weakest, most general level — a drift-minus-utility condition, checked against an arbitrary target , with no reference to any specific control policy.
Significance
Theorem 5.4 is the abstract engine that every concrete utility-maximizing algorithm in the rest of the chapter (the CLC1 joint flow-control/routing/scheduling algorithm of Theorem 5.1, and its robustness variant under approximate scheduling, Corollary 5.2) instantiates by exhibiting a control rule whose per-slot decision satisfies (5.19) for some — the drift condition does the work of turning a per-slot optimization rule into a global performance guarantee. Its tradeoff (utility gap shrinks like , congestion grows like ) is the quantitative signature of every "Lyapunov optimization"/"drift-plus-penalty" algorithm in the cross-layer control literature that followed this book, making Theorem 5.4 the single result a reader needs to understand that entire family of algorithms at once, independent of which specific control problem it is applied to.
Formalizing it. No result in this mission has a machine-checked proof anywhere; nothing adjacent exists on the platform (searched for Lyapunov optimization, drift-plus-penalty, utility fairness, concave utility — no hits at all, not even an adjacent object). This mission is the first formalization of the book's utility-optimization engine.
Difficulty
The central subtlety, flagged explicitly by the book's own notation, is that (5.20) and (5.21) compare two different kinds of quantity that are easy to conflate: is a limsup of an expectation of utility, , while in (5.21) is the utility evaluated at the time-averaged expected rate. Jensen's inequality (using 's concavity) is exactly what would relate to — and it is not proved or needed by this theorem's own statement, only by later results that connect the two more tightly. A formalization that silently merges these into one "utility" quantity would be proving something the book does not claim. The second trap is the target : it is a free parameter of the hypothesis, not the true optimal utility — the theorem's strength is exactly that it says nothing special about how was chosen, so a formalization must not add a hidden side condition forcing to equal a genuine optimum.
Formalization scope
∆(U(t)) is restated locally in this chunk's own sub-namespace (drafts cannot import chunk
04-backpressure's copy), via Mathlib's condExp on the σ-algebra generated by the current
backlog vector, exactly as in Chapter 4. Explicit Measurable/Integrable guards on U, R,
g∘R and every drift term prevent condExp/∫ from silently defaulting to 0 (a trivializing
formalization this mission rules out: without these guards, a non-integrable process would satisfy
the hypotheses vacuously and "prove" a stability/utility conclusion for a process that is not
actually controlled). r(t) and \bar g are written inline as their defining Cesàro averages
rather than as separate named definitions, since each is used exactly once. Out of scope for
this mission: Theorem 5.1 (the CLC1 algorithm's concrete instantiation), Corollary 5.2 (the
robustness-to-suboptimal-scheduling variant), and Lemma 5.5 (continuity of near-optimal solutions,
which needs the capacity region Λ as a hypothesis object). All three need substantially more
setup (a named algorithm, or the capacity-region machinery of Chapter 3) than this session's time
budget allowed without approximating either — left for a future mission rather than approximated.
Selected references
- Georgiadis, Neely & Tassiulas, Resource Allocation and Cross-Layer Control in Wireless Networks, Foundations and Trends in Networking, Vol. 1, No. 1 (2006), pp. 1-144. https://doi.org/10.1561/1300000001
- Neely, Modiano & Li, "Fairness and optimal stochastic control for heterogeneous networks", IEEE/ACM Transactions on Networking, 16(2), 2008. https://doi.org/10.1109/TNET.2007.900405
- Neely, "Energy optimal control for time-varying wireless networks", IEEE Transactions on Information Theory, 52(7), 2006. https://doi.org/10.1109/TIT.2006.876219