Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in
← Collections

Online Algorithms

Competitive analysis: paging, k-server, metrical task systems, online primal-dual, secretary problems, and online matching.

52 missions

Missions

21–40 of 52
OpenCompletedAll
🏆Completed
CombinatoricsOperations ResearchTheoretical Computer Science·Captain: mikedeng1

Competitive Paging Algorithms IV: An Algorithm Competitive against Several Others Exists iff the Reciprocal Ratios Sum to at Most 1Research Paper

Motivation

Paging is the problem of managing a fast memory that holds kkk pages out of nnn: when a requested page is not in fast memory (a page fault), some resident page must be evicted, and the cost of an algorithm is its number of faults. Practitioners have many eviction rules. Least-recently-used (LRU) performs well on real workloads but can be kkk times worse than the optimal off-line schedule; the randomized marking algorithm of the same paper is 2Hk2H_k2Hk​-competitive and so has better worst-case guarantees. Fiat, Karp, Luby, McGeoch, Sleator and Young asked in 1991 whether one on-line algorithm can combine the advantages of several given ones, and answered the question exactly: the attainable combinations of ratios are characterized by one inequality (arXiv:cs/0205038, §6).

The question of combining on-line algorithms has since become a theme of its own: combining heuristics with worst-case-safe algorithms, and, more recently, combining machine-learned predictions with robust fallbacks, both ask for the same kind of guarantee against several reference algorithms at once.

Setting

A type (k,n)(k,n)(k,n) consists of kkk servers and a finite set MMM of nnn vertices with the uniform metric: two distinct vertices are at distance 111. This is paging: vertices are pages, the vertices covered by servers are the pages in fast memory, and a server move is a page fault.

A deterministic on-line algorithm AAA of type (k,n)(k,n)(k,n) has an initial configuration of its kkk servers and, after each request r∈Mr\in Mr∈M, moves servers so that some server covers rrr; its configuration after a request sequence depends only on that sequence. Its cost CA(σ)C_A(\sigma)CA​(σ) on a request sequence σ\sigmaσ is the total distance its servers travel, i.e. the number of server moves.

For algorithms AAA and BBB of the same type and a constant ccc, AAA is ccc-competitive against BBB if there is a constant aaa such that for every request sequence σ\sigmaσ

CA(σ)≤c⋅CB(σ)+a.C_A(\sigma)\le c\cdot C_B(\sigma)+a .CA​(σ)≤c⋅CB​(σ)+a.

A sequence c∗=(c(1),…,c(m))c^*=(c(1),\dots,c(m))c∗=(c(1),…,c(m)) of positive reals is realizable if for every type (k,n)(k,n)(k,n) and every mmm deterministic on-line algorithms B(1),…,B(m)B(1),\dots,B(m)B(1),…,B(m) of that type there is a deterministic on-line algorithm AAA of the same type that is c(i)c(i)c(i)-competitive against B(i)B(i)B(i) for every iii.

Formalization targets

Goal: Theorem 6

For m≥1m\ge1m≥1 and positive reals c(1),…,c(m)c(1),\dots,c(m)c(1),…,c(m),

c∗ is realizable  ⟺  ∑1≤i≤m1c(i)≤1.c^*\ \text{is realizable}\iff \sum_{1\le i\le m}\frac1{c(i)}\le 1 .c∗ is realizable⟺1≤i≤m∑​c(i)1​≤1.

Milestones

In the order of the paper's proof:

  1. Punishments are paid for. If AAA punishes BBB at a time step (an AAA-interval on a vertex vvv ends at that step and contains the end of a BBB-interval on vvv that began no later), then BBB has moved a server; the number of such steps is at most CB(σ)C_B(\sigma)CB​(σ).
  2. A fault leaves room to punish. If ∣SA∣=k|S_A|=k∣SA​∣=k, ∣SB∣≤k|S_B|\le k∣SB​∣≤k, x∈SBx\in S_Bx∈SB​ and x∉SAx\notin S_Ax∈/SA​, then some u∈SAu\in S_Au∈SA​ is not in SBS_BSB​.
  3. The greedy quota claim. If ∑i1/c(i)≤1\sum_i 1/c(i)\le 1∑i​1/c(i)≤1 and each unit of cost punishes the B(i)B(i)B(i) minimizing c(i)(PUN(i)+1)c(i)(\mathrm{PUN}(i)+1)c(i)(PUN(i)+1) (other algorithms may be punished incidentally), then after cost rrr every B(i)B(i)B(i) has been punished at least ⌊r/c(i)⌋\lfloor r/c(i)\rfloor⌊r/c(i)⌋ times.
  4. Shuttle algorithms. With 2m−12m-12m−1 servers on 2m2m2m vertices there are mmm algorithms, each keeping all vertices outside its own pair covered, no two of which move at the same step; in particular their total cost on any σ\sigmaσ is at most ∣σ∣|\sigma|∣σ∣.
  5. A forcing adversary. With 2m−12m-12m−1 servers on 2m2m2m vertices every algorithm can be forced to move at each of NNN steps, so CA(τ(N))≥NC_A(\tau(N))\ge NCA​(τ(N))≥N.

Significance

The result. Theorem 6 is an exact characterization, not a bound: the region of simultaneously attainable ratios against arbitrary deterministic paging algorithms is {c:∑1/c(i)≤1}\{c:\sum 1/c(i)\le 1\}{c:∑1/c(i)≤1}. For example, any two paging algorithms can be combined into one that is 222-competitive against each, and no better symmetric pair is possible in general. Combined with Theorem 7 of the same paper (not part of this mission), the same region is attainable against randomized algorithms, which is how LRU's practical behaviour and the marking algorithm's 2Hk2H_k2Hk​ worst-case guarantee can be obtained within constant factors by one algorithm.

Formalizing it. The theorem has been proved since 1991; no machine-checked proof is known. A formal proof produces a reusable notion of competitiveness of one on-line algorithm against another, built on the published KServer_model definitions, and a formal account of the scheduling fact at the core of the sufficiency proof.

Difficulty

Sufficiency looks like an averaging argument, but the combined algorithm cannot simulate the B(i)B(i)B(i) and follow one of them: switching between their configurations costs up to kkk per switch, which no additive constant absorbs. The accounting has to charge each of AAA's faults to a specific move of a specific B(i)B(i)B(i), and the charge must be injective; the paper's claim that CB(σ)C_B(\sigma)CB​(σ) is at least the number of punishments is where this happens, and it depends on how server intervals are matched. The allocation of faults to algorithms is then a deadline-scheduling problem whose feasibility is exactly ∑1/c(i)≤1\sum 1/c(i)\le 1∑1/c(i)≤1, and the floor functions make the counting delicate at the boundary. The paper's own definition of punishment only counts intervals that start with a move, so the first kkk faults of AAA (servers on their initial vertices) need separate treatment; they are absorbed by the additive constant.

Necessity needs the right family of hard instances: the mmm algorithms must never move at the same step, which pins the type to (2m−1,2m)(2m-1,2m)(2m−1,2m).

Formalization scope

The Lean development works in the namespace CompetitivePaging.Combining and imports the published KServer_model definitions: KServer.OnlineAlgorithm k M (a configuration map from request prefixes to Fin k → M with a serving condition) and OnlineAlgorithm.cost. Committed conventions:

  • a type (k,n)(k,n)(k,n) is any k : ℕ and any finite M : Type with a metric in which distinct points are at distance 111; realizability quantifies over all of them, never over one fixed type;
  • servers are labelled; each algorithm has its own initial configuration, and the additive constant aaa is chosen before the request sequence;
  • c(i)>0c(i)>0c(i)>0 and m≥1m\ge1m≥1 are hypotheses of the goal, as in the paper; without positivity, 1/0=01/0=01/0=0 in Lean would make a zero ratio free;
  • time ttt is the step processing the ttt-th request; the paper's PUN\mathrm{PUN}PUN counts time steps.

Trivializing encodings are ruled out: realizability is not stated for a single fixed type, the metric is not the metric of Fin n, and the competitive constant is not allowed to depend on the request sequence.

A complete proof needs the construction of the punishing algorithm as a KServer.OnlineAlgorithm (a lazy, injective algorithm whose moves depend on the prefix and on the B(i)B(i)B(i)'s configurations), the injective charging argument, the scheduling lemma, and the explicit shuttle algorithms. The scheduling lemma and the charging lemma are independent of paging and reusable. Proofs of any milestone are welcome, as are alternative statements of the sufficiency construction.

Selected references

  • A. Fiat, R. M. Karp, M. Luby, L. A. McGeoch, D. D. Sleator, N. E. Young, Competitive Paging Algorithms, J. Algorithms 12(4):685–699, 1991. doi:10.1016/0196-6774(91)90041-V; preprint arXiv:cs/0205038.
  • D. D. Sleator, R. E. Tarjan, Amortized efficiency of list update and paging rules, Comm. ACM 28(2):202–208, 1985. doi:10.1145/2786.2793
  • M. S. Manasse, L. A. McGeoch, D. D. Sleator, Competitive algorithms for server problems, J. Algorithms 11(2):208–230, 1990. doi:10.1016/0196-6774(90)90003-W
9 thms5 active usersReviewed
🏆Completed
Linear OptimizationOperations ResearchProbability+1·Captain: mikedeng1

Competitive Randomized Algorithms for Nonuniform Problems I: Optimal Competitiveness of Randomized Block Snoopy CachingResearch Paper

Motivation

In a shared-memory multiprocessor, each processor keeps copies of memory blocks in its own cache, and all caches listen ("snoop") on a common bus. Every bus cycle spent keeping these copies consistent is a cycle not available for useful work, so the protocol that decides when a block is shared by several caches and when it is private to one cache directly controls bus traffic. The decision has to be made on-line, without knowing which processor will touch the block next.

Karlin, Manasse, Rudolph and Sleator (Algorithmica 1988) introduced competitive analysis for this problem and gave a deterministic algorithm with competitive ratio 222, which is optimal among deterministic algorithms. Karlin, Manasse, McGeoch and Owicki (Algorithmica 1994) showed that randomization helps: against an oblivious adversary the optimal ratio for block snoopy caching is ep/(ep−1)e_p/(e_p-1)ep​/(ep​−1), where ppp is the cost of transferring a block. The same paper develops a general method for "nonuniform" problems, in which some state transitions are much more expensive than others, and the snoopy-caching result is its first application.

Setting

Fix nnn processors and one memory block BBB holding p−1p-1p−1 variables; transferring BBB over the bus costs ppp bus cycles. The block is in one of n+1n+1n+1 states: shared between all caches, or private to the cache of processor iii.

A request is a read Ri\mathrm{R}_iRi​ or a write Wi\mathrm{W}_iWi​ by processor iii. Moving from a private state to any other state costs ppp; moving from the shared state is free. A read Ri\mathrm{R}_iRi​ costs 000 if BBB is shared or private to iii and +∞+\infty+∞ otherwise. A write Wi\mathrm{W}_iWi​ costs 000 if BBB is private to iii, 111 if BBB is shared (one bus cycle broadcasts the new value), and +∞+\infty+∞ otherwise.

Before request jjj the system is in state sj−1s_{j-1}sj−1​. A read is a look-ahead-one request: the algorithm may change state at the moment of the request, after seeing it. A write is a look-ahead-zero request: it is served in whatever state the system is in. After either kind, the algorithm may move again. The cost of a request is the cost of the move to the serving state, plus the task cost there, plus the cost of the move afterwards. Every write is preceded by a read to the same block, so in an admissible sequence each write Wi\mathrm{W}_iWi​ directly follows Ri\mathrm{R}_iRi​ or Wi\mathrm{W}_iWi​.

The off-line optimum Copt(s0,σ)C_{opt}(s_0,\sigma)Copt​(s0​,σ) is the least total cost of serving σ\sigmaσ from the initial state s0s_0s0​ with full knowledge of σ\sigmaσ. A randomized on-line algorithm AAA is a probability distribution over deterministic on-line algorithms; its expected cost on σ\sigmaσ is ECA(σ)\mathbf{E}C_A(\sigma)ECA​(σ). AAA is ccc-competitive against an oblivious adversary from s0s_0s0​ if there is a constant aaa with

ECA(σ)≤c⋅Copt(s0,σ)+a\mathbf{E}C_A(\sigma)\le c\cdot C_{opt}(s_0,\sigma)+aECA​(σ)≤c⋅Copt​(s0​,σ)+a

for every admissible σ\sigmaσ. Put

ep=(1+1p)p.e_p=\left(1+\frac1p\right)^p .ep​=(1+p1​)p.

Formalization targets

Goal: Theorem 4

For n≥2n\ge 2n≥2, p≥1p\ge 1p≥1 and every initial state s0s_0s0​:

(∀A ∀c: A is c-competitive from s0⇒c≥epep−1) ∧ ∃A: A is epep−1-competitive from s0.\Big(\forall A\ \forall c:\ A \text{ is } c\text{-competitive from } s_0 \Rightarrow c\ge \tfrac{e_p}{e_p-1}\Big)\ \wedge\ \exists A:\ A \text{ is } \tfrac{e_p}{e_p-1}\text{-competitive from } s_0 .(∀A ∀c: A is c-competitive from s0​⇒c≥ep​−1ep​​) ∧ ∃A: A is ep​−1ep​​-competitive from s0​.

The two conjuncts are milestones of their own: the lower bound (Theorem 4, first claim) and attainment (Theorem 4, second claim).

The phase linear program (§3.2, pp. 552–554)

For p≥1p\ge1p≥1, real π1,…,πp+1\pi_1,\dots,\pi_{p+1}π1​,…,πp+1​ with πp+1=1\pi_{p+1}=1πp+1​=1, and real α\alphaα with

πk+1p+∑i=1k(1−πi)≤αk(k=0,…,p),\pi_{k+1}p+\sum_{i=1}^{k}(1-\pi_i)\le\alpha k\qquad(k=0,\dots,p),πk+1​p+i=1∑k​(1−πi​)≤αk(k=0,…,p),

one has α≥ep/(ep−1)\alpha\ge e_p/(e_p-1)α≥ep​/(ep​−1). Conversely, at α=ep/(ep−1)\alpha=e_p/(e_p-1)α=ep​/(ep​−1) the choice πk=(α−1)(((p+1)/p)k−1−1)\pi_k=(\alpha-1)\big(((p+1)/p)^{k-1}-1\big)πk​=(α−1)(((p+1)/p)k−1−1) satisfies πp+1=1\pi_{p+1}=1πp+1​=1, 0≤π1≤⋯≤πp+10\le\pi_1\le\dots\le\pi_{p+1}0≤π1​≤⋯≤πp+1​, and makes every constraint an equality.

Significance

The theorem settles the randomized competitive ratio of block snoopy caching exactly: 222 at p=1p=1p=1, 9/59/59/5 at p=2p=2p=2, decreasing to e/(e−1)≈1.582e/(e-1)\approx1.582e/(e−1)≈1.582 as p→∞p\to\inftyp→∞, against the deterministic optimum 222. The same ratio e/(e−1)e/(e-1)e/(e−1) is the randomized optimum for the continuous ski-rental and spin-block problems treated later in the paper, and the snoopy-caching case is its discrete counterpart with ratio ep/(ep−1)e_p/(e_p-1)ep​/(ep​−1). The phase-LP method used here recurs in the paper's two-server results.

The result is proved in the paper; to our knowledge it has no machine-checked proof. This mission produces a formal model of the snoopy-caching task system with look-ahead-zero requests, of randomized algorithms against an oblivious adversary with infinite task costs allowed, and of the off-line optimum, together with the exact optimal ratio. The platform's fractional ski-rental result (PrimalDualOnline.SkiRental.fractional_competitive) proves an eB/(eB−1)e_B/(e_B-1)eB​/(eB​−1) bound for a different model: one deterministic fractional algorithm, with no lower bound over randomized algorithms. It is related work, not a special case.

Difficulty

The linear program is elementary. The gap is between the LP and the algorithms. The paper's lower bound reduces arbitrary randomized algorithms to phase-based ones, whose state distribution at the end of each phase agrees with the optimal algorithm's known state, and whose behaviour inside a phase depends only on the number of writes so far. This reduction (Theorems 1 and 3 of the paper, pp. 545–549) is where the argument is not routine. An algorithm may keep the block private to a processor that is not the active one, may randomize over histories rather than over phase lengths, and the off-line optimum is not a sum of per-phase costs at the ends of the sequence. The obvious approach, bounding a single adversarial phase, does not suffice, because an algorithm may pay more in one phase and recover it in the next; the additive constant aaa and the infinite horizon have to be handled. For attainment, the mixture of threshold algorithms must be written as a genuine distribution over on-line algorithms, with the initial phase from a private state absorbed into the additive constant.

Formalization scope

Everything lives in the namespace NonuniformCompetitive.Snoopy. States are Option (Fin n) (none = shared). Costs are in ℝ≥0∞; +∞+\infty+∞ is a genuine outcome, so an algorithm that ever pays +∞+\infty+∞ with positive probability on an admissible sequence is not competitive. A deterministic on-line algorithm is a pair of functions of the request prefix (the state at the moment of the last request, and the state after it), with the look-ahead-zero rule as a field. Moves "immediately before" a request are made without knowledge of it and are recorded as moves after the previous request. A randomized algorithm is a probability space with a measurable cost on every sequence, and its expected cost is a lower Lebesgue integral. The off-line optimum is an infimum in ℝ≥0∞ over schedules starting in s0s_0s0​; it is finite on admissible sequences.

Conventions added to the printed statement, all from the paper's setting: (i) n≥2n\ge2n≥2, since with one processor the block can stay private for free; (ii) one block, since the proof of Theorem 4 splits a multi-block system into independent blocks (p. 551); (iii) admissibility in the form "each write of iii directly follows a read or write of iii", the reading of "every write is preceded by a read to the same block" that the proof uses; without it every algorithm is defeated by a write from a processor whose block copy was invalidated; (iv) p∈Np\in\mathbb{N}p∈N, p≥1p\ge1p≥1; (v) both claims from every initial state, with an additive constant depending on nnn, ppp, s0s_0s0​.

The lower bound is over all randomized algorithms, not over phase-based or deterministic ones; a statement restricted to phase-based algorithms, or the LP alone in place of the goal, would not be Theorem 4. The LP variables are free, as in the paper.

Welcome contributions: a formal version of the phase reduction (Theorems 1 and 3 of the paper) for this task system, which is reusable for the paper's other nonuniform problems; the threshold algorithms and their mixture; and a proof that the off-line optimum decomposes by write runs up to a bounded error.

Selected references

  • A. R. Karlin, M. S. Manasse, L. A. McGeoch, S. Owicki, Competitive Randomized Algorithms for Nonuniform Problems, Algorithmica 11 (1994), 542–571. https://doi.org/10.1007/BF01189993
  • A. R. Karlin, M. S. Manasse, L. Rudolph, D. D. Sleator, Competitive Snoopy Caching, Algorithmica 3 (1988), 79–119. https://doi.org/10.1007/BF01762111
  • A. Borodin, R. El-Yaniv, Online Computation and Competitive Analysis, Cambridge University Press, 1998.
8 thms3 active usersReviewed
🏆Completed
Operations ResearchProbabilityTheoretical Computer Science·Captain: mikedeng1

Competitive Randomized Algorithms for Nonuniform Problems II: Optimal Competitiveness for the Spin-Block ProblemResearch Paper

Motivation

A process on a shared-memory multiprocessor that finds a lock held must decide what to do while it waits. It can spin, repeatedly testing the lock and occupying its processor, or it can block, giving the processor to another process and paying a fixed context-switch cost CCC to be descheduled and later restored. Spinning is cheap when the lock is released soon; blocking is cheap when the wait is long. The waiting time is not known in advance, so the choice has to be made on-line. This is the spin-block problem, studied by Karlin, Manasse, McGeoch and Owicki in Competitive Randomized Algorithms for Nonuniform Problems (Algorithmica 11, 1994, doi:10.1007/BF01189993), §4. Mathematically it is the continuous form of the ski-rental problem, and the same rent-or-buy structure recurs in power-down policies and in TCP acknowledgement (Karlin, Kenyon, Randall, STOC 2001).

Timeline:

  • Karlin, Manasse, Rudolph and Sleator (1988, doi:10.1007/BF01762111) introduced competitive analysis of snoopy caching and showed that 222 is the optimal deterministic factor there. The spin-block analogue is recorded in the 1994 paper (pp. 558–559): spinning for time CCC and then blocking is 222-competitive, and no deterministic algorithm does better.
  • Karlin, Manasse, McGeoch and Owicki (SODA 1990; Algorithmica 1994) found the optimal randomized factors for snoopy caching and spin-block. For spin-block, Theorem 10 (p. 559) gives e/(e−1)≈1.582e/(e-1)\approx1.582e/(e−1)≈1.582 against an oblivious adversary. Theorem 9 (p. 559) shows that against an adaptive on-line adversary randomization does not help: the factor stays 222.

Setting

Fix a context-switch cost C>0C>0C>0. A lock wait is described by its release time τ≥0\tau\ge0τ≥0. An algorithm handling the wait chooses a blocking time b∈[0,∞]b\in[0,\infty]b∈[0,∞]: it spins until time bbb and then blocks (b=∞b=\inftyb=∞: never block). The cost of the wait is

waitCostC(b,τ)={τ,τ≤b,b+C,b<τ,\mathrm{waitCost}_C(b,\tau)=\begin{cases}\tau,&\tau\le b,\\ b+C,&b<\tau,\end{cases}waitCostC​(b,τ)={τ,b+C,​τ≤b,b<τ,​

so a lock released exactly at the blocking time costs τ\tauτ. The optimal off-line algorithm, which knows τ\tauτ, pays min⁡(τ,C)\min(\tau,C)min(τ,C).

An input is a finite sequence σ=(τ0,…,τn−1)\sigma=(\tau_0,\dots,\tau_{n-1})σ=(τ0​,…,τn−1​) of lock waits. A deterministic on-line algorithm chooses the blocking time of wait jjj as a function of τ0,…,τj−1\tau_0,\dots,\tau_{j-1}τ0​,…,τj−1​, the release times it has already observed. Its cost CA(σ)C_A(\sigma)CA​(σ) is the sum of the wait costs, and the off-line cost is Copt(σ)=∑jmin⁡(τj,C)C_{opt}(\sigma)=\sum_j\min(\tau_j,C)Copt​(σ)=∑j​min(τj​,C).

A randomized on-line algorithm is a probability distribution over deterministic on-line algorithms: a probability space (I,μ)(I,\mu)(I,μ) and a deterministic algorithm AiA_iAi​ for each i∈Ii\in Ii∈I, with i↦CAi(σ)i\mapsto C_{A_i}(\sigma)i↦CAi​​(σ) measurable for every σ\sigmaσ. Its expected cost is ECA(σ)=∫CAi(σ) dμ(i)\mathbf{E}C_A(\sigma)=\int C_{A_i}(\sigma)\,d\mu(i)ECA​(σ)=∫CAi​​(σ)dμ(i). Following §1 of the paper, AAA is ccc-competitive against an oblivious adversary if there is a constant aaa with

ECA(σ)≤c⋅Copt(σ)+afor every input σ.\mathbf{E}C_A(\sigma)\le c\cdot C_{opt}(\sigma)+a\qquad\text{for every input }\sigma .ECA​(σ)≤c⋅Copt​(σ)+afor every input σ.

The adversary is oblivious: it fixes σ\sigmaσ before the algorithm's random choices are made.

The paper's algorithm blocks at a random time with cumulative distribution

π(t)={et/C−1e−1,0≤t≤C,1,t>C,\pi(t)=\begin{cases}\dfrac{e^{t/C}-1}{e-1},&0\le t\le C,\\[1ex] 1,&t>C,\end{cases}π(t)=⎩⎨⎧​e−1et/C−1​,1,​0≤t≤C,t>C,​

where π(t)\pi(t)π(t) is the probability of blocking before time ttt.

Formalization targets

Goal: Theorem 10 (p. 559)

For every C>0C>0C>0:

(∀A ∀c, A is c-competitive ⇒ c≥ee−1)and∃A, A is ee−1-competitive.\Big(\forall A\ \forall c,\ A\ \text{is } c\text{-competitive}\ \Rightarrow\ c\ge\tfrac{e}{e-1}\Big)\quad\text{and}\quad\exists A,\ A\ \text{is } \tfrac{e}{e-1}\text{-competitive}.(∀A ∀c, A is c-competitive ⇒ c≥e−1e​)and∃A, A is e−1e​-competitive.

Milestones

  1. Expected cost of one wait (§4.1, p. 560). For a blocking time with law ν\nuν and release time τ\tauτ,
E waitCostC(b,τ)=π(τ) C+∫0τ(1−π(t)) dt,π(t)=ν{b<t}.\mathbf{E}\,\mathrm{waitCost}_C(b,\tau)=\pi(\tau)\,C+\int_0^\tau(1-\pi(t))\,dt,\qquad \pi(t)=\nu\{b<t\}.EwaitCostC​(b,τ)=π(τ)C+∫0τ​(1−π(t))dt,π(t)=ν{b<t}.
  1. The ratio of the paper's distribution (§4.1, p. 560). With the π\piπ above, for all τ≥0\tau\ge0τ≥0,
π(τ) C+∫0τ(1−π(t)) dt≤ee−1min⁡(τ,C).\pi(\tau)\,C+\int_0^\tau(1-\pi(t))\,dt\le\tfrac{e}{e-1}\min(\tau,C).π(τ)C+∫0τ​(1−π(t))dt≤e−1e​min(τ,C).
  1. Theorem 10, first claim: the lower bound c≥e/(e−1)c\ge e/(e-1)c≥e/(e−1) for every ccc-competitive randomized algorithm.
  2. Theorem 10, second claim: existence of an e/(e−1)e/(e-1)e/(e−1)-competitive randomized algorithm.

Significance

Theorem 10 settles the randomized competitive ratio of the continuous ski-rental problem: e/(e−1)e/(e-1)e/(e−1) is achievable and cannot be improved by any on-line algorithm, randomized or not, against an oblivious adversary. The same constant is the limit of the paper's snoopy-caching ratios ep/(ep−1)e_p/(e_p-1)ep​/(ep​−1) as the block size grows, and it recurs in randomized rent-or-buy problems and in on-line primal-dual analyses.

The result is proved in the literature, and the mission's work is to formalize it. The platform has related material but not this statement: Primal-Dual Online Algorithms I: Fractional Ski Rental proves a deterministic, fractional, discrete-day bound (PrimalDualOnline.SkiRental.fractional_competitive), which is a different model and contains no lower bound. A complete formalization produces a reusable model of randomized on-line algorithms with history-dependent decisions and an exact lower bound for them.

Difficulty

The upper bound per lock wait is an explicit computation. The difficulty lies elsewhere. First, the on-line algorithm is allowed to adapt to the release times of all previous waits, so a bound for a single wait does not by itself bound a sequence: the randomized algorithm must be assembled so that each wait is handled with the right blocking law, whatever happened before. Second, the lower bound is a statement about every randomized algorithm and must survive the additive constant aaa: a single hard lock wait proves nothing, because aaa absorbs any bounded loss. It has to be shown that on long sequences of waits every algorithm loses a factor e/(e−1)e/(e-1)e/(e−1) on average. The natural first idea, to exhibit one bad release time for each algorithm, fails for randomized algorithms facing an oblivious adversary.

Formalization scope

All objects live in the namespace NonuniformCompetitive.SpinBlock. Release times are ℝ≥0, blocking times ℝ≥0∞, wait costs ℝ≥0∞, and the off-line cost is real. Committed conventions:

  • C>0C>0C>0 is a hypothesis of every theorem (the paper's "some large cost CCC"); at C=0C=0C=0 blocking at once is free and the lower bound fails.
  • A tie b=τb=\taub=τ costs τ\tauτ; this matches "π(t)\pi(t)π(t) is the probability that the algorithm blocks sometime before time ttt".
  • Inputs are finite sequences of lock waits and competitiveness carries the additive constant aaa of §1 (p. 543). A formalization with a single wait and no additive constant would be a different, easier lower bound and is ruled out.
  • The on-line algorithm sees the release times of earlier waits (the information used by the paper's adaptive algorithms, p. 561). This enlarges the class of algorithms: it strengthens the lower bound and does not affect the upper bound.
  • A randomized algorithm is a mixed strategy whose cost on each fixed input is measurable in the random outcome; the expected cost is a lower Lebesgue integral. Without measurability the lower integral would not be the expectation and the upper bound would become easier than the paper's.
  • Milestone 1 is stated for every blocking law, not only for the paper's π\piπ. Milestone 2 keeps the paper's inequality, although equality holds.

Infrastructure a complete development needs: Lebesgue integrals of functions of a random variable (the layer-cake formula), interval integrals of the exponential, the construction of a probability measure on [0,∞][0,\infty][0,∞] with a prescribed continuous distribution function, and a Yao-type averaging argument over finitely supported input distributions for the lower bound. The model of randomized on-line algorithms with history-dependent decisions is reusable for other rent-or-buy problems. Contributions welcome: proofs of the milestones, and intermediate lemmas such as the discretised lower bound for a fixed step C/pC/pC/p.

Selected references

  • A. R. Karlin, M. S. Manasse, L. A. McGeoch, S. Owicki, Competitive Randomized Algorithms for Nonuniform Problems, Algorithmica 11 (1994), 542–571. doi:10.1007/BF01189993
  • A. R. Karlin, M. S. Manasse, L. Rudolph, D. D. Sleator, Competitive Snoopy Caching, Algorithmica 3 (1988), 79–119. doi:10.1007/BF01762111
  • A. Borodin, R. El-Yaniv, Online Computation and Competitive Analysis, Cambridge University Press, 1998.
  • A. R. Karlin, C. Kenyon, D. Randall, Dynamic TCP Acknowledgement and Other Stories about e/(e−1), STOC 2001, 502–509. doi:10.1145/380752.380845
  • N. Buchbinder, J. Naor, The Design of Competitive Online Algorithms via a Primal–Dual Approach, Foundations and Trends in Theoretical Computer Science 3 (2009). doi:10.1561/0400000024
8 thms2 active usersReviewed
🏆Completed
Linear OptimizationOperations ResearchProbability+1·Captain: mikedeng1

Competitive Randomized Algorithms for Nonuniform Problems III: The Optimal Randomized Two-Server Ratio on the 1-d-d Isosceles TriangleResearch Paper

Motivation

The k-server problem of Manasse, McGeoch and Sleator (J. Algorithms 11 (1990)) asks how kkk mobile servers in a metric space should respond, on-line, to a sequence of requests at points of the space, each of which must be covered by a server. It is the central model of on-line computation: paging is the special case of a uniform metric, and many caching and scheduling problems reduce to it. For two servers the deterministic picture is complete: the optimal competitive ratio is 222 on every metric space with at least three points.

Randomization changes the picture, and the smallest nontrivial case already shows how. On the equilateral triangle the optimal randomized ratio against an oblivious adversary is 3/23/23/2. Karlin, Manasse, McGeoch and Owicki (Algorithmica 11 (1994) 542–571) computed the exact optimal randomized ratio for several nonuniform triangles, where the distances differ, and showed that it depends on the geometry. Their Theorem 12 settles the whole family of isosceles triangles with edge lengths 111, ddd, ddd. These exact values are among the few known optimal randomized ratios for server problems.

Timeline:

  • 1990: Manasse, McGeoch and Sleator introduce the kkk-server problem and prove the deterministic two-server ratio is 222.
  • 1990–1994: Karlin, Manasse, McGeoch and Owicki submit this paper (received August 1990, revised September 1991) and publish it in Algorithmica in 1994, with the isosceles-triangle ratios of Theorem 12 and the 3-4-5 triangle ratio 1652/10691652/10691652/1069 of Theorem 13.
  • Later: Karloff, Rabani and Ravid extend the technique to Ω(log⁡log⁡k)\Omega(\log\log k)Ω(loglogk) and Ω(log⁡k)\Omega(\log k)Ω(logk) randomized lower bounds (cited on p. 564); Bubeck, Coester and Rabani (STOC 2023) refute the randomized kkk-server conjecture.

Setting

Fix an integer d≥1d\ge1d≥1. The isosceles triangle MMM has three points aaa, bbb, ccc with

dist⁡(a,b)=1,dist⁡(a,c)=dist⁡(b,c)=d.\operatorname{dist}(a,b)=1,\qquad \operatorname{dist}(a,c)=\operatorname{dist}(b,c)=d.dist(a,b)=1,dist(a,c)=dist(b,c)=d.

A configuration C:{0,1}→MC:\{0,1\}\to MC:{0,1}→M places two labelled servers on points of MMM. A deterministic on-line algorithm assigns to every finite request sequence σ=(r1,…,rn)\sigma=(r_1,\dots,r_n)σ=(r1​,…,rn​) a configuration, computed from σ\sigmaσ alone and covering the last request; its value on the empty sequence is its initial configuration. Its cost CA(σ)C_A(\sigma)CA​(σ) is the total distance its servers move while serving σ\sigmaσ request by request. The off-line optimum Copt(σ)C_{opt}(\sigma)Copt​(σ) from an initial configuration C0C_0C0​ is the least total movement of any schedule that starts at C0C_0C0​ and covers each request in turn, knowing σ\sigmaσ in advance.

A randomized algorithm is a probability distribution on deterministic on-line algorithms; its expected cost is ECA(σ)\mathbf{E}C_A(\sigma)ECA​(σ). It is ρ\rhoρ-competitive against an oblivious adversary from C0C_0C0​ if every algorithm in its support starts at C0C_0C0​ and there is a constant aaa such that

ECA(σ)≤ρ⋅Copt(σ)+afor every request sequence σ.\mathbf{E}C_A(\sigma)\le\rho\cdot C_{opt}(\sigma)+a\qquad\text{for every request sequence }\sigma.ECA​(σ)≤ρ⋅Copt​(σ)+afor every request sequence σ.

The request sequence is fixed in advance and does not react to the algorithm's coin flips.

Write ep=(1+1/p)pe_p=(1+1/p)^pep​=(1+1/p)p and

αd=e2d−1+1/4d(e2d−1−1)+1/2d,e2d−1=(2d2d−1)2d−1.\alpha_d=\frac{e_{2d-1}+1/4d}{(e_{2d-1}-1)+1/2d},\qquad e_{2d-1}=\left(\frac{2d}{2d-1}\right)^{2d-1}.αd​=(e2d−1​−1)+1/2de2d−1​+1/4d​,e2d−1​=(2d−12d​)2d−1.

In Lean this is NonuniformCompetitive.Isosceles.isoscelesRatio d.

Formalization targets

Goal: Theorem 12

For every d≥1d\ge1d≥1 and every initial configuration C0C_0C0​:

∀A, ∀ρ,A is ρ-competitive from C0 ⟹ ρ≥αd,\forall A,\ \forall\rho,\quad A\text{ is }\rho\text{-competitive from }C_0\ \Longrightarrow\ \rho\ge\alpha_d,∀A, ∀ρ,A is ρ-competitive from C0​ ⟹ ρ≥αd​, ∃A: A is αd-competitive from C0.\exists A:\ A\text{ is }\alpha_d\text{-competitive from }C_0.∃A: A is αd​-competitive from C0​.

The two claims are also milestones of their own (no_better_ratio, ratio_attained).

The phase LP (§5, pp. 565–566)

For free real π1,…,π2d−1\pi_1,\dots,\pi_{2d-1}π1​,…,π2d−1​ and real α\alphaα with

(πk)2d+∑i=1k(1−πi)≤αk  (1≤k<2d),2d+∑i=12d−1(1−πi)+12≤α⋅2d,(\pi_k)2d+\sum_{i=1}^k(1-\pi_i)\le\alpha k\ \ (1\le k<2d),\qquad 2d+\sum_{i=1}^{2d-1}(1-\pi_i)+\tfrac12\le\alpha\cdot2d,(πk​)2d+i=1∑k​(1−πi​)≤αk  (1≤k<2d),2d+i=1∑2d−1​(1−πi​)+21​≤α⋅2d,

one has α≥αd\alpha\ge\alpha_dα≥αd​ (lp_lower_bound); and πk=(αd−1)((2d/(2d−1))k−1)\pi_k=(\alpha_d-1)\big((2d/(2d-1))^k-1\big)πk​=(αd​−1)((2d/(2d−1))k−1), π2d=1\pi_{2d}=1π2d​=1 is nondecreasing from π1≥0\pi_1\ge0π1​≥0 to 111 and makes every constraint an equality (lp_attained).

The limit remark (§5, p. 566)

α1<α2<α3<⋯ ,lim⁡d→∞αd=ee−1\alpha_1<\alpha_2<\alpha_3<\cdots,\qquad \lim_{d\to\infty}\alpha_d=\frac{e}{e-1}α1​<α2​<α3​<⋯,d→∞lim​αd​=e−1e​

(ratio_increases_to_e_ratio).

Significance

The theorem gives an exact optimal randomized ratio for an infinite family of metric spaces. It shows that the optimal randomized two-server ratio is not a constant: it runs from 3/23/23/2 on the equilateral triangle to e/(e−1)≈1.582e/(e-1)\approx1.582e/(e−1)≈1.582 as the triangle becomes long and thin, where the problem resembles ski rental. With the deterministic ratio 222, it quantifies exactly how much randomization gains on these spaces.

The results are proved in the paper; none is formalized on Prove2Me, and no machine-checked proof of them is known. A formal proof would require the paper's phase framework (Theorems 1–3 and the appendix's Theorem 15) for server problems, which this mission does not state separately, and a concrete randomized algorithm as a measurable mixed strategy. Both would be reusable for Theorem 13 (the 3-4-5 triangle) and for other exact ratios on small metric spaces.

Difficulty

The phase LP milestones are finite real arithmetic. The difficulty is the passage between them and the goal. The lower bound must hold for every randomized algorithm, not only phase-based lazy ones: an arbitrary algorithm may condition on the whole history, move non-lazily, and randomize in ways that do not reduce to the probabilities πk\pi_kπk​. The paper handles this with Theorem 3, which says that the LP bound of phase-based algorithms bounds the competitive factor of all algorithms; its proof uses an averaging argument over histories that must be made rigorous. The upper bound needs a mixed strategy over infinitely many phases, with measurable costs, an explicit additive constant covering the first partial phase from an arbitrary initial configuration, and an accounting of CoptC_{opt}Copt​ across phase boundaries.

Formalization scope

The model is the platform's published KServer_model and KServer_randomized (reference items): labelled servers Fin 2 → M; a deterministic on-line algorithm as a map from request prefixes to configurations; a randomized algorithm as a probability measure over deterministic algorithms, with the cost of each fixed sequence measurable in the random outcome; expected cost as a lower Lebesgue integral in [0,∞][0,\infty][0,∞]; the off-line optimum as a real infimum over schedules from C0C_0C0​ (nonempty and bounded below by 000); and IsCompetitiveFrom A C₀ c with a real additive constant.

Committed conventions:

  • The triangle is any metric space whose points are exactly a,b,ca,b,ca,b,c at distances 1,d,d1,d,d1,d,d, with ddd a natural number and d≥1d\ge1d≥1. Every such space is isometric to the paper's triangle; at d=0d=0d=0 it would not be a triangle.
  • Both claims are stated for every initial configuration, including both servers on one point. The paper treats the initial state {a,b}\{a,b\}{a,b} separately and absorbs the first partial phase into the additive constant.
  • The lower bound quantifies over all randomized algorithms (deterministic ones are point masses), never over phase-based ones only.
  • In the LP milestones the πk\pi_kπk​ are free reals, as printed; no box 0≤πk≤10\le\pi_k\le10≤πk​≤1 is imposed.
  • "Grows" in the limit remark is read as strictly increasing.
  • The paper prints the recurrence on p. 565 as πk=α−1+(πk−1)2d−12d\pi_k=\frac{\alpha-1+(\pi_{k-1})2d-1}{2d}πk​=2dα−1+(πk−1​)2d−1​; the equations (∗)(*)(∗) give πk=α−1+2d πk−12d−1\pi_k=\frac{\alpha-1+2d\,\pi_{k-1}}{2d-1}πk​=2d−1α−1+2dπk−1​​. The recurrence is not used; the closed form printed on p. 566 is correct and is the one stated.

Without the measurability field of a randomized algorithm the lower integral would under-report expected cost and the attainment claim would become easier than the paper's; the published definition includes it. The lower bound is not vacuous: the triangle hypotheses are satisfiable for every d≥1d\ge1d≥1.

Welcome contributions: a formal version of the phase framework (Theorems 1–3, 15) for finite metric spaces, reusable across missions III and IV; a measurable construction of phase-based randomized algorithms; and proofs of the LP milestones.

Selected references

  • A. R. Karlin, M. S. Manasse, L. A. McGeoch, S. Owicki, Competitive Randomized Algorithms for Nonuniform Problems, Algorithmica 11 (1994) 542–571. https://doi.org/10.1007/BF01189993
  • M. S. Manasse, L. A. McGeoch, D. D. Sleator, Competitive Algorithms for Server Problems, J. Algorithms 11 (1990) 208–230. https://doi.org/10.1016/0196-6774(90)90003-W
  • H. Karloff, Y. Rabani, Y. Ravid, Lower Bounds for Randomized k-Server and Motion-Planning Algorithms, SIAM J. Comput. 23 (1994) 293–312. https://doi.org/10.1137/S0097539792224838
  • S. Bubeck, C. Coester, Y. Rabani, The Randomized k-Server Conjecture Is False!, STOC 2023. https://arxiv.org/abs/2211.05753
9 thms4 active usersReviewed
🏆Completed
Linear OptimizationOperations ResearchProbability+1·Captain: mikedeng1

Competitive Randomized Algorithms for Nonuniform Problems IV: The Optimal Randomized Two-Server Ratio 1652/1069 on the 3-4-5 TriangleResearch Paper

Motivation

The kkk-server problem is a basic model of on-line decision making. kkk mobile servers move in a metric space, requests for points arrive one at a time, and each request has to be covered by a server before the next one arrives. The cost is the total distance the servers move. The problem includes paging, caching and disk-head scheduling as special cases (Manasse, McGeoch, Sleator 1990). An on-line algorithm is judged by its competitive factor: how much its cost can exceed that of an off-line algorithm that knows the whole request sequence in advance.

For randomized algorithms against an oblivious adversary (one that fixes the whole request sequence before the algorithm flips any coins), the best-understood case is paging, which is the kkk-server problem on a uniform metric space. There the optimal factor is the harmonic number Hk=∑i=1k1/iH_k=\sum_{i=1}^k 1/iHk​=∑i=1k​1/i. Fiat et al. proved the lower bound (1991) and McGeoch and Sleator the matching upper bound (1991). Karlin, Manasse, McGeoch and Owicki (Algorithmica 11, 1994, §5) asked whether HkH_kHk​-competitive algorithms also exist when the metric space is not uniform. They answered no, already for two servers on three points: on certain triangles the optimal randomized factor is strictly larger than H2=3/2H_2 = 3/2H2​=3/2. This mission formalizes their Theorem 13, which gives the exact optimal factor on the triangle with edge lengths 3, 4 and 5.

Timeline:

  • 1990: Manasse, McGeoch and Sleator introduce the kkk-server problem; kkk is the deterministic optimum for k=2k=2k=2.
  • 1991: Fiat, Karp, Luby, McGeoch, Sleator and Young prove the HkH_kHk​ lower bound for randomized paging. McGeoch and Sleator give an HkH_kHk​-competitive paging algorithm.
  • 1994: Karlin, Manasse, McGeoch and Owicki determine the optimal randomized two-server factors on the isosceles triangles 111-ddd-ddd (Theorem 12) and on the 3-4-5 triangle (Theorem 13, the ratio 1652/10691652/10691652/1069). Both exceed 3/23/23/2.

Setting

Let MMM be a metric space with exactly three points a,b,ca, b, ca,b,c, where d(a,b)=3d(a,b)=3d(a,b)=3, d(a,c)=5d(a,c)=5d(a,c)=5 and d(b,c)=4d(b,c)=4d(b,c)=4. A configuration CCC gives the positions of two labelled servers in MMM. A request sequence σ\sigmaσ is a finite list of points of MMM.

A deterministic on-line algorithm assigns to each prefix of a request sequence a configuration, in which the last request is covered. Its configuration after a prefix therefore cannot depend on later requests. Its initial configuration is the one it assigns to the empty prefix, and its cost CA(σ)C_A(\sigma)CA​(σ) on σ\sigmaσ is the total distance its servers move while serving σ\sigmaσ request by request.

The optimal off-line cost Copt(σ)C_{opt}(\sigma)Copt​(σ) from an initial configuration C0C_0C0​ is the infimum, over all schedules that start at C0C_0C0​ and cover each request of σ\sigmaσ in turn, of the total distance moved.

A randomized on-line algorithm AAA is a probability distribution over deterministic on-line algorithms, all starting at C0C_0C0​. The cost on each fixed σ\sigmaσ is required to be measurable in the random choice, and ECA(σ)\mathbf{E}C_A(\sigma)ECA​(σ) is the expected cost. AAA is ρ\rhoρ-competitive against an oblivious adversary if there is a constant aaa such that for every request sequence σ\sigmaσ,

ECA(σ)≤ρ⋅Copt(σ)+a.\mathbf{E}C_A(\sigma) \le \rho\cdot C_{opt}(\sigma) + a .ECA​(σ)≤ρ⋅Copt​(σ)+a.

These are the definitions of p. 543 of the paper. They are the platform's published KServer_model and KServer_randomized, which this mission reuses unchanged: KServer.RandomizedAlgorithm 2 M and A.IsCompetitiveFrom C₀ ρ.

Formalization targets

Goal: Theorem 13

For every initial configuration C0C_0C0​ of the two servers,

(∀A, ∀ρ, A is ρ-competitive from C0⇒ρ≥16521069) ∧ (∃A, A is 16521069-competitive from C0).\Big(\forall A,\ \forall \rho,\ A \text{ is } \rho\text{-competitive from } C_0 \Rightarrow \rho \ge \tfrac{1652}{1069}\Big)\ \wedge\ \Big(\exists A,\ A \text{ is } \tfrac{1652}{1069}\text{-competitive from } C_0\Big).(∀A, ∀ρ, A is ρ-competitive from C0​⇒ρ≥10691652​) ∧ (∃A, A is 10691652​-competitive from C0​).

The first claim is quantified over all randomized algorithms, so it also covers deterministic ones (point masses). The second claim asks for one algorithm. Together they say that 1652/1069≈1.5451652/1069 \approx 1.5451652/1069≈1.545 is the exact optimal randomized factor on this triangle.

Milestones

  1. The phase LP lower bound (p. 568). Twelve linear constraints in nine probabilities π1,…,π9\pi_1,\dots,\pi_9π1​,…,π9​, three potentials Φab,Φac,Φbc\Phi_{ab},\Phi_{ac},\Phi_{bc}Φab​,Φac​,Φbc​ and a ratio α\alphaα, one constraint for each possible phase of the request sequence, of the form
A’s cost≤α⋅(opt’s cost)+Φinitial−Φfinal.\text{A's cost} \le \alpha\cdot(\text{opt's cost}) + \Phi_{\text{initial}} - \Phi_{\text{final}}.A’s cost≤α⋅(opt’s cost)+Φinitial​−Φfinal​.

Every real solution has α≥1652/1069\alpha \ge 1652/1069α≥1652/1069. 2. The LP attainment (p. 568). The paper's printed probabilities lie in [0,1][0,1][0,1], and with suitable potentials they satisfy all twelve constraints at α=1652/1069\alpha = 1652/1069α=1652/1069. 3. Theorem 13, first claim: the lower bound for every randomized algorithm. 4. Theorem 13, second claim: a 1652/10691652/10691652/1069-competitive randomized algorithm exists.

Significance

The result. Theorem 13 shows that the HkH_kHk​ behaviour of randomized paging does not carry over to general metric spaces. Two servers on a three-point space already force a factor above 3/23/23/2. The value is exact, which makes this triangle a test case for any general theory of randomized kkk-server algorithms on small metric spaces. With Theorem 12 (the isosceles triangles, a companion mission of this series), it is one of the few non-uniform metric spaces with a known optimal randomized factor.

Formalizing it. The result has been proved since 1994. To our knowledge there is no machine-checked proof. The paper derives both bounds from two framework theorems for phase-based algorithms: Theorem 3 (an LP lower bound for phase-based algorithms bounds every algorithm) and Theorem 2 (a lazy phase-based algorithm with LP bound α\alphaα is α\alphaα-competitive). The phase tables themselves (which phases can occur and what they cost) are stated without detailed proof. A formal proof has to supply both framework arguments for this space and verify the phase tables, as well as the finite linear algebra of milestones 1 and 2. The milestones isolate the exact-arithmetic core so that it can be closed independently of the probabilistic part.

Difficulty

The two LP milestones are finite exact-arithmetic facts. The hard part is linking them to Theorem 13.

For the lower bound, an algorithm need not be phase-based at all. Its probabilities may depend on the whole history, not only on the current phase, and it may leave the configuration of the off-line optimum at the end of a phase. The obvious attempt is to fix one hard request sequence and compare costs, but that cannot work: randomization defeats any single sequence. The reduction from arbitrary algorithms to phase-based ones (the paper's Theorem 3) is the substantive step.

For the upper bound, the printed probabilities describe the algorithm's marginal position after each prefix of a phase. They have to be realized as a single probability distribution over deterministic on-line algorithms that is lazy (it moves only to serve a request) and whose expected cost per phase equals the table's entry. On top of this, the LP accounting has to be turned into a bound on arbitrary request sequences, including partial phases and a start away from the optimum's configuration.

Formalization scope

  • Model. The platform definitions KServer_model and KServer_randomized are used unchanged. Servers are labelled (Config 2 M = Fin 2 → M). A deterministic algorithm is a function of the request prefix, which makes it on-line by construction. A randomized algorithm is a mixed strategy with a probability measure and a measurability field, and its expected cost is the lower Lebesgue integral of the nonnegative cost. The off-line optimum is a real infimum over schedules from C0C_0C0​; the set is nonempty and bounded below by 000. Competitiveness allows any real additive constant.
  • The triangle is given by hypotheses on an arbitrary metric space: every point equals aaa, bbb or ccc, and d(a,b)=3d(a,b)=3d(a,b)=3, d(a,c)=5d(a,c)=5d(a,c)=5, d(b,c)=4d(b,c)=4d(b,c)=4. These hypotheses are satisfiable (3+4≥53+4\ge53+4≥5) and force three distinct points.
  • Initial configuration. Both claims are stated for every initial configuration C0C_0C0​, including both servers on one point. The paper does not fix the start; the additive constant absorbs it.
  • LP milestones. The thirteen LP variables are free reals, with no box 0≤πi≤10\le\pi_i\le 10≤πi​≤1, exactly as the paper permits. This makes milestone 1 stronger than the boxed version; the minimum is the same either way. The twelve constraints are written out one per hypothesis, in the table's order, with the potential difference Φinitial−Φfinal\Phi_{\text{initial}} - \Phi_{\text{final}}Φinitial​−Φfinal​ on the right. In milestone 2 the potentials are existentially quantified, since the paper names none.
  • Not stated. The paper's Theorems 2 and 3 (the phase framework) and the phase tables are not separate milestones. Milestone 1 feeds the first claim through Theorem 3, and milestone 2 feeds the second claim through Theorem 2. Contributions formalizing phase-based algorithms, laziness and the LP-bound reduction for finite metric spaces would be reusable for Theorem 12 and Theorem 14 of the same paper.
  • Ruled out. The lower bound is not restricted to deterministic or to phase-based algorithms, and it is not stated as "one sequence defeats every algorithm". The constant is exactly 1652/10691652/10691652/1069, not an approximation, and the attainment claim is not weakened to "for some initial configuration".

Selected references

  • A. R. Karlin, M. S. Manasse, L. A. McGeoch, S. Owicki, Competitive Randomized Algorithms for Nonuniform Problems, Algorithmica 11 (1994) 542–571. https://doi.org/10.1007/BF01189993
  • M. S. Manasse, L. A. McGeoch, D. D. Sleator, Competitive Algorithms for Server Problems, Journal of Algorithms 11 (1990) 208–230. https://doi.org/10.1016/0196-6774(90)90003-W
  • A. Fiat, R. M. Karp, M. Luby, L. A. McGeoch, D. D. Sleator, N. E. Young, Competitive Paging Algorithms, Journal of Algorithms 12 (1991) 685–699. https://doi.org/10.1016/0196-6774(91)90041-V
  • L. A. McGeoch, D. D. Sleator, A Strongly Competitive Randomized Paging Algorithm, Algorithmica 6 (1991) 816–825. https://doi.org/10.1007/BF01759073
7 thms3 active usersReviewed
Machine LearningOperations ResearchProbability+1·Captain: mikedeng1

Competitive Caching with Machine Learned Advice: The Competitive Ratio of Predictive MarkerResearch Paper

Motivation

Caching (online paging) is one of the oldest problems in online algorithms: a fast memory of kkk slots serves a sequence of requests, and every request for an element not in the fast memory is a cache miss that forces the element to be loaded, possibly evicting another one. With the whole request sequence known in advance, evicting the element whose next request is furthest in the future is optimal (Bélády, 1966). Without that knowledge, no deterministic algorithm is better than kkk-competitive, and the best randomized algorithms are Θ(log⁡k)\Theta(\log k)Θ(logk)-competitive (Fiat, Karp, Luby, McGeoch, Sleator and Young, 1991).

Lykouris and Vassilvitskii asked what happens in between: an online algorithm receives, with every request, a machine-learned prediction of the element's next arrival time. A good predictor should make the algorithm nearly as good as Bélády's rule (consistency), and a bad predictor should never make it worse than a classical algorithm (robustness). Their paper (arXiv:1802.05399v4; J. ACM 2021) is one of the founding papers of learning-augmented algorithms, and its algorithm, Predictive Marker, is the reference point for the later literature on caching with predictions.

Timeline.

  • 1966: Bélády's furthest-in-future rule is optimal offline.
  • 1985: Sleator and Tarjan show that deterministic online paging is at best kkk-competitive.
  • 1991: Fiat et al. introduce the Marker algorithm, 2Hk2H_k2Hk​-competitive, and the clean-element lower bound on the optimum.
  • 2018: Lykouris and Vassilvitskii (arXiv:1802.05399) introduce Predictive Marker, with ratio 2min⁡(1+2Sℓ(ϵ),2Hk)2\min(1+2S_\ell(\epsilon), 2H_k)2min(1+2Sℓ​(ϵ),2Hk​) for an ϵ\epsilonϵ-accurate predictor.
  • 2020: Rohatgi (arXiv:1910.12172, SODA 2020) and Wei (arXiv:2005.13716, APPROX/RANDOM 2020) improve the dependence on the error.

Setting

A request sequence σ=(z1,…,zn)\sigma = (z_1, \dots, z_n)σ=(z1​,…,zn​) lists elements of a set ZZZ. A cache of size k≥1k \ge 1k≥1 starts empty. A request for a cached element is a hit; otherwise it is a miss, the element is loaded, and if the cache is full some element is evicted first. The offline optimum Opt(σ)\mathrm{Opt}(\sigma)Opt(σ) is the least number of misses over all eviction schedules chosen with knowledge of σ\sigmaσ.

With each request ziz_izi​ the algorithm receives a real prediction hih_ihi​. The true label yiy_iyi​ is the position of the next request of ziz_izi​, or n+1n+1n+1 if there is none. For a loss function ℓ≥0\ell \ge 0ℓ≥0, the error of the predictions is ηℓ(h,σ)=∑iℓ(yi,hi)\eta_\ell(h,\sigma) = \sum_i \ell(y_i, h_i)ηℓ​(h,σ)=∑i​ℓ(yi​,hi​), and the predictions are ϵ\epsilonϵ-accurate when ηℓ(h,σ)≤ϵ⋅Opt(σ)\eta_\ell(h,\sigma) \le \epsilon \cdot \mathrm{Opt}(\sigma)ηℓ​(h,σ)≤ϵ⋅Opt(σ).

The spread of ℓ\ellℓ measures how cheaply a predictor can get the order of arrivals completely wrong: Sℓ(m)S_\ell(m)Sℓ​(m) is the least length T≥1T \ge 1T≥1 such that every strictly increasing integer sequence a1<⋯<aTa_1 < \dots < a_Ta1​<⋯<aT​ and every non-increasing real sequence b1≥⋯≥bTb_1 \ge \dots \ge b_Tb1​≥⋯≥bT​ have total loss ∑iℓ(ai,bi)≥m\sum_i \ell(a_i, b_i) \ge m∑i​ℓ(ai​,bi​)≥m.

Predictive Marker (Algorithm 1) works in the phases of the Marker algorithm. Requested elements are marked. A phase ends when the cache is full, every cached element is marked, and a miss occurs; then all marks are removed. An element requested in a phase but not in the previous one is clean, and Q(σ)Q(\sigma)Q(σ) is the total number of clean elements. Each clean miss starts a chain. An element evicted in the current phase that is requested again (a stale miss) extends the chain in which it was evicted. Evictions are among unmarked elements. As long as the chain's length n(r,c)n(r,c)n(r,c) is at most Hk=1+12+⋯+1kH_k = 1 + \tfrac12 + \dots + \tfrac1kHk​=1+21​+⋯+k1​, the evicted element is one with the largest prediction. After that it is chosen uniformly at random. The expected number of misses of Predictive Marker is costPM(σ)\mathrm{cost}_{PM}(\sigma)costPM​(σ).

Formalization targets

Goal: Theorem 3.3

If SSS is concave on [0,∞)[0,\infty)[0,∞) and majorizes the spread, then for every ϵ≥0\epsilon \ge 0ϵ≥0, every tie-breaking rule, and every sequence with ϵ\epsilonϵ-accurate predictions,

E[costPM(σ)]≤2⋅min⁡(1+2S(ϵ), 2Hk)⋅Opt(σ).\mathbb E\bigl[\mathrm{cost}_{PM}(\sigma)\bigr] \le 2\cdot\min\bigl(1 + 2S(\epsilon),\ 2H_k\bigr)\cdot \mathrm{Opt}(\sigma).E[costPM​(σ)]≤2⋅min(1+2S(ϵ), 2Hk​)⋅Opt(σ).

Milestones

  • Claim 1 (Fiat et al.): Q(σ)≤2 Opt(σ)Q(\sigma) \le 2\,\mathrm{Opt}(\sigma)Q(σ)≤2Opt(σ).
  • Proof of Theorem 3.3, last sentence: Opt(σ)≤Q(σ)\mathrm{Opt}(\sigma) \le Q(\sigma)Opt(σ)≤Q(σ).
  • Lemma 3.3: a chain that evicts by the predictions only has length n(r,c)≤1+S(ηr,c)n(r,c) \le 1 + S(\eta_{r,c})n(r,c)≤1+S(ηr,c​), where ηr,c\eta_{r,c}ηr,c​ is the error of the predictions on the elements evicted into it.
  • Lemma 3.4: E[n(r,c)]≤E[min⁡(1+2S(ηr,c),2Hk)]\mathbb E[n(r,c)] \le \mathbb E[\min(1 + 2S(\eta_{r,c}), 2H_k)]E[n(r,c)]≤E[min(1+2S(ηr,c​),2Hk​)].

Significance

The result. Theorem 3.3 gives both guarantees at once. For an exact predictor (ϵ=0\epsilon = 0ϵ=0) the ratio is a constant, 2(1+2S(0))2(1 + 2S(0))2(1+2S(0)), independent of kkk; for an arbitrary predictor it is 4Hk4H_k4Hk​, within a constant factor of the optimal randomized ratio. In between, the ratio degrades with the error at the rate of the spread: for the absolute loss the spread grows like m\sqrt mm​, so the ratio grows like ϵ\sqrt\epsilonϵ​. The spread and the chain decomposition are the tools later papers build on to trade consistency against robustness.

Formalizing it. The theorem is proved on paper; no machine-checked proof of it, of the Marker analysis, or of the clean-element bound of Fiat et al. is known. A formalization supplies a precise model of a randomized online algorithm with predictions. It also settles the details the paper leaves implicit: the eviction missing from the clean branch of Algorithm 1 as printed, the cap 2Hk2H_k2Hk​ printed as 2log⁡k2\log k2logk in Lemma 3.4, and the behaviour of the spread at 000.

Difficulty

The obvious argument charges every miss to a chain and bounds each chain separately. That works for chains that follow the predictions, but a chain that switches to random evictions interacts with every other chain of the phase, because all of them evict from the same pool of unmarked elements. A bound on its expected length must hold whatever the other chains evict, including evictions that depend on earlier coin flips. A second difficulty is summing. The chain errors ηr,c\eta_{r,c}ηr,c​ and the chain lengths are both random, while the hypothesis controls only the total error ηℓ(h,σ)\eta_\ell(h,\sigma)ηℓ​(h,σ) against Opt(σ)\mathrm{Opt}(\sigma)Opt(σ), not the number of chains Q(σ)Q(\sigma)Q(σ) in which the error is spread.

Formalization scope

Elements form a type with decidable equality. A request sequence is a list; predictions are one real per request, and every real sequence is allowed. Labels are 1-based next-arrival positions, with n+1n+1n+1 for elements never requested again. The paper prints the label with equal features; the element is meant. Opt\mathrm{Opt}Opt is computed as the minimum over all demand-paging schedules from the empty cache, which loses no generality. HkH_kHk​ is harmonic k as a real number, never log⁡k\log klogk.

Predictive Marker is a PMF over final states. The random eviction of line 21 is uniform over the unmarked cached elements, and ties in the arg max are a parameter quantified universally. The eviction of lines 23–24 is also performed after a clean miss; as printed, it sits only in the stale branch. The expected cost lies in [0,∞][0,\infty][0,∞].

The spread takes real arguments and lengths T≥1T \ge 1T≥1. SSS must be concave on [0,∞)[0,\infty)[0,∞), finite, and at least the spread. It must also be continuous at 000, which the paper does not say: without it the chain lemma fails for losses whose minimal reversed-order loss stays 000 over several lengths. ϵ\epsilonϵ-accuracy is the pointwise condition on the given pair (σ,h)(\sigma, h)(σ,h). The competitive ratio is written as a product, so Opt(σ)=0\mathrm{Opt}(\sigma) = 0Opt(σ)=0 needs no special case. Lemma 3.3 is stated pointwise for chains without random evictions, as its proof shows. Lemma 3.4 has 2Hk2H_k2Hk​ in place of the printed 2log⁡k2\log k2logk, with the minimum inside the expectation because ηr,c\eta_{r,c}ηr,c​ is random.

The statement must not be trivialized. Opt\mathrm{Opt}Opt is the true offline optimum, not Bélády's rule applied to the predictions. The expectation is taken over Predictive Marker's own run, never compared with itself. The spread hypothesis is satisfiable; for example, the constant loss 111 has spread max⁡(1,⌈m⌉)≤m+1\max(1,\lceil m\rceil) \le m + 1max(1,⌈m⌉)≤m+1.

Out of scope: Lemma 3.2 (the special-marking algorithm SM, which enters only through Lemma 3.4's proof); Lemma 3.1 and Corollaries 1–2, whose printed constants are false for small mmm or disagree with Theorem 3.3; the lower bounds of §3.1 and §3.4; the extensions of §4; the experiments of §5; running time and learnability.

Welcome contributions: the Marker phase structure and its equivalence with the combinatorial phases, the clean-element bounds Q/2≤Opt≤QQ/2 \le \mathrm{Opt} \le QQ/2≤Opt≤Q (reusable for any marking algorithm), and a bound on the expected number of misses caused by elements evicted uniformly at random within a phase.

Selected references

  • T. Lykouris, S. Vassilvitskii, Competitive Caching with Machine Learned Advice, arXiv:1802.05399v4, 2020; J. ACM 68(4), 2021. https://arxiv.org/abs/1802.05399v4
  • A. Fiat, R. M. Karp, M. Luby, L. A. McGeoch, D. D. Sleator, N. E. Young, Competitive paging algorithms, J. Algorithms 12(4), 1991. https://doi.org/10.1016/0196-6774(91)90041-V
  • L. A. Bélády, A study of replacement algorithms for a virtual-storage computer, IBM Systems Journal 5(2), 1966. https://doi.org/10.1147/sj.52.0078
  • D. D. Sleator, R. E. Tarjan, Amortized efficiency of list update and paging rules, Comm. ACM 28(2), 1985. https://doi.org/10.1145/2786.2793
  • D. Rohatgi, Near-optimal bounds for online caching with machine learned advice, SODA 2020. https://arxiv.org/abs/1910.12172
  • A. Wei, Better and simpler learning-augmented online caching, APPROX/RANDOM 2020. https://arxiv.org/abs/2005.13716
10 thms1 active userReviewed
🏆Completed
Algorithmic Game TheoryLinear OptimizationOperations Research+1·Captain: mikedeng1

Online Primal-Dual Algorithms for Maximizing Ad-Auctions Revenue: The Competitive Ratio of the Primal-Dual Allocation AlgorithmResearch Paper

Motivation

Search engines sell advertisement slots next to their results through ad-auctions. Advertisers bid on keywords, and each advertiser also sets a daily budget: the most it is willing to pay in a day. Queries arrive one at a time and each must be assigned to an advertiser at once, with no knowledge of the queries still to come. The seller's revenue from an advertiser is capped by its budget, so an allocation rule that ignores budgets can exhaust a high bidder early and forgo revenue that a more even allocation would have collected. The question is how much of the offline optimum an online rule can guarantee against every arrival sequence.

Mehta, Saberi, Vazirani and Vazirani (FOCS 2005 / J. ACM 2007) gave a deterministic algorithm whose competitive ratio tends to 1−1/e1 - 1/e1−1/e when bids are small compared with budgets, and showed that no deterministic algorithm does better. Their algorithm builds on online bipartite matching (Karp, Vazirani and Vazirani, STOC 1990) and online bbb-matching (Kalyanasundaram and Pruhs, 2000). Buchbinder, Jain and Naor (ESA 2007) rederived the 1−1/e1 - 1/e1−1/e bound with an online primal-dual algorithm, which gives the ratio in closed form for every value of the bid-to-budget ratio and extends to multiple slots, stochastic information, bounded degree and budget flexibility. This mission formalizes the basic algorithm of that paper and its Theorem 1.

Setting

There is a finite nonempty set III of buyers. Buyer iii has a known budget B(i)>0B(i) > 0B(i)>0. Products j=1,…,mj = 1, \dots, mj=1,…,m arrive one by one; when product jjj arrives, every buyer's bid b(i,j)≥0b(i,j) \ge 0b(i,j)≥0 on it is revealed. The bid-to-budget ratio is

Rmax⁡=max⁡i∈I, jb(i,j)B(i).R_{\max} = \max_{i \in I,\, j} \frac{b(i,j)}{B(i)} .Rmax​=i∈I,jmax​B(i)b(i,j)​.

A fractional allocation y(i,j)≥0y(i,j) \ge 0y(i,j)≥0 assigns fractions of products to buyers; the revenue from buyer iii is the minimum of ∑jb(i,j) y(i,j)\sum_j b(i,j)\,y(i,j)∑j​b(i,j)y(i,j) and B(i)B(i)B(i).

The offline fractional problem is the packing LP, which the paper calls the dual:

max⁡∑j∑ib(i,j) y(i,j)s.t.∑iy(i,j)≤1  ∀j,∑jb(i,j) y(i,j)≤B(i)  ∀i,y≥0.\max \sum_{j}\sum_{i} b(i,j)\,y(i,j) \quad\text{s.t.}\quad \sum_i y(i,j) \le 1 \ \ \forall j,\qquad \sum_j b(i,j)\,y(i,j) \le B(i)\ \ \forall i,\qquad y \ge 0 .maxj∑​i∑​b(i,j)y(i,j)s.t.i∑​y(i,j)≤1  ∀j,j∑​b(i,j)y(i,j)≤B(i)  ∀i,y≥0.

Its LP dual, the paper's primal, is the covering LP:

min⁡∑iB(i) x(i)+∑jz(j)s.t.b(i,j) x(i)+z(j)≥b(i,j)  ∀i,j,x,z≥0.\min \sum_i B(i)\,x(i) + \sum_j z(j) \quad\text{s.t.}\quad b(i,j)\,x(i) + z(j) \ge b(i,j)\ \ \forall i,j,\qquad x, z \ge 0 .mini∑​B(i)x(i)+j∑​z(j)s.t.b(i,j)x(i)+z(j)≥b(i,j)  ∀i,j,x,z≥0.

The Allocation Algorithm has a parameter c>1c > 1c>1 and starts from x≡0x \equiv 0x≡0. When product jjj arrives it takes a buyer iii maximizing b(i,j)(1−x(i))b(i,j)(1 - x(i))b(i,j)(1−x(i)). If x(i)≥1x(i) \ge 1x(i)≥1, the product is not sold. Otherwise it charges iii the minimum of b(i,j)b(i,j)b(i,j) and iii's remaining budget, sets y(i,j)←1y(i,j) \leftarrow 1y(i,j)←1 and z(j)←b(i,j)(1−x(i))z(j) \leftarrow b(i,j)(1 - x(i))z(j)←b(i,j)(1−x(i)), and updates

x(i)←x(i)(1+b(i,j)B(i))+b(i,j)(c−1) B(i).x(i) \leftarrow x(i)\Big(1 + \frac{b(i,j)}{B(i)}\Big) + \frac{b(i,j)}{(c-1)\,B(i)} .x(i)←x(i)(1+B(i)b(i,j)​)+(c−1)B(i)b(i,j)​.

Its revenue is the total amount charged.

Formalization targets

Goal: Theorem 1

For every instance and every bound R>0R > 0R>0 with b(i,j)≤R B(i)b(i,j) \le R\,B(i)b(i,j)≤RB(i) for all i,ji, ji,j, the Allocation Algorithm run with c=(1+R)1/Rc = (1+R)^{1/R}c=(1+R)1/R, under any tie-breaking of the maximum, satisfies for every feasible y′y'y′ of the packing LP

Revenue  ≥  (1−1c)(1−R)∑j∑ib(i,j) y′(i,j).\mathrm{Revenue} \;\ge\; \Big(1 - \frac1c\Big)(1 - R)\sum_{j}\sum_{i} b(i,j)\,y'(i,j).Revenue≥(1−c1​)(1−R)j∑​i∑​b(i,j)y′(i,j).

With R=Rmax⁡R = R_{\max}R=Rmax​ this is the paper's statement that the algorithm is (1−1/c)(1−Rmax⁡)(1 - 1/c)(1 - R_{\max})(1−1/c)(1−Rmax​)-competitive; the fractional optimum bounds every integral offline allocation.

Milestones

The proof of Theorem 1 rests on three claims and three auxiliary facts, each a milestone:

  1. the inequality ln⁡(1+x)/x≥ln⁡(1+y)/y\ln(1+x)/x \ge \ln(1+y)/yln(1+x)/x≥ln(1+y)/y for 0<x≤y≤10 < x \le y \le 10<x≤y≤1;
  2. Claim (1): the final (x,z)(x, z)(x,z) is feasible for the covering LP;
  3. Claim (2): the covering cost of the run equals (1+1/(c−1))(1 + 1/(c-1))(1+1/(c−1)) times the packing value of the run's own yyy;
  4. Inequality (1): x(i)≥1c−1(c∑jb(i,j)y(i,j)/B(i)−1)x(i) \ge \frac{1}{c-1}\big(c^{\sum_j b(i,j) y(i,j)/B(i)} - 1\big)x(i)≥c−11​(c∑j​b(i,j)y(i,j)/B(i)−1) at every stage of the run;
  5. Claim (3): ∑jb(i,j) y(i,j)≤B(i)+max⁡jb(i,j)\sum_j b(i,j)\,y(i,j) \le B(i) + \max_j b(i,j)∑j​b(i,j)y(i,j)≤B(i)+maxj​b(i,j), and the amount charged to iii is at least (1−R)∑jb(i,j) y(i,j)(1 - R)\sum_j b(i,j)\,y(i,j)(1−R)∑j​b(i,j)y(i,j);
  6. weak duality for the LP pair above;

and, separately, the second sentence of Theorem 1,

lim⁡R→0+(1−1(1+R)1/R)(1−R)=1−1e.\lim_{R\to 0^+}\Big(1 - \frac{1}{(1+R)^{1/R}}\Big)(1-R) = 1 - \frac1e .R→0+lim​(1−(1+R)1/R1​)(1−R)=1−e1​.

Significance

Theorem 1 gives an explicit ratio for every value of Rmax⁡R_{\max}Rmax​, not only in the limit. It tends to the optimal deterministic ratio 1−1/e1 - 1/e1−1/e as bids become small, and it quantifies how the guarantee degrades as single bids become a larger share of a budget. The primal-dual analysis is the template for the paper's later sections and for a line of work on online packing and covering problems, surveyed in Buchbinder and Naor's monograph The Design of Competitive Online Algorithms via a Primal-Dual Approach (Foundations and Trends in TCS, 2009).

The result is proved in the paper, and the proof is short. What this mission adds is a machine-checked proof about an algorithm that is defined, not described: the run is computed by recursion from the instance, and the guarantee is proved for that run and every tie-breaking. A related private mission on the platform, The Design of Competitive Online Algorithms via a Primal-Dual Approach VI: Maximizing Ad-Auctions Revenue, states the monograph's Theorem 10.1, which is this theorem, in a form that takes the analysis's intermediate inequalities as hypotheses over arbitrary lists of won bids; the present mission states it for the algorithm itself. No machine-checked proof of Theorem 1 is known to this mission.

Difficulty

Each step of the proof is elementary; the difficulty is the bookkeeping of an online process. Claims (1) and (2) are statements about a single iteration that must be lifted to the whole run: Claim (1) uses that xxx only increases, and Claim (2) that each product is processed once. Inequality (1) is an induction over the iterations that allocate to one buyer, interleaved with iterations that allocate to others and is the only place where the value of ccc matters. Claim (3) needs a further invariant: the amount charged equals the minimum of the allocated bids and the budget.

A tempting shortcut is to take Inequality (1) and the "at most one undercharge" fact as hypotheses about some list of bids. That does not describe the algorithm and is not the theorem; here the only hypotheses are on the instance and on the tie-breaking rule.

Formalization scope

Buyers are a type I with [Fintype I] and [Nonempty I]; products are Fin m, whose order is the arrival order. Bids and budgets are real, with B(i)>0B(i) > 0B(i)>0 and b(i,j)≥0b(i,j) \ge 0b(i,j)≥0. The state of the algorithm records xxx, the amounts charged, yyy and zzz; one iteration is step, the run after kkk products is runPrefix, and revenue sums the charges of the final state. The tie-breaking rule is a function sel of the current xxx and the product, required to return a maximizer of b(i,j)(1−x(i))b(i,j)(1-x(i))b(i,j)(1−x(i)); the theorem holds for every such rule. The constant c=(1+R)1/Rc = (1+R)^{1/R}c=(1+R)1/R is a real power and requires R>0R > 0R>0. The theorem is stated for any bound RRR on the ratios, of which the exact maximum is one instance. Claims (1) and (2) are stated for every c>1c > 1c>1, which covers the paper's choice. The paper's inequality for ln⁡(1+x)/x\ln(1+x)/xln(1+x)/x allows x=0x = 0x=0, read as a limit; the Lean statement requires x>0x > 0x>0.

A statement over an unconstrained allocation, or one conditioned on the proof's own intermediate inequalities, would be trivially true or false; the targets here concern only the run the definitions compute.

The development needs finite sums, real powers and logarithms from Mathlib and an induction principle for the run. The LP pair and weak duality are reusable for the paper's extensions, and the run invariants for any primal-dual online algorithm with multiplicative updates. Proofs of any milestone are welcome, as are sharper variants, such as the exact-Rmax⁡R_{\max}Rmax​ form or the bound against integral allocations.

Selected references

  • N. Buchbinder, K. Jain, J. Naor, Online Primal-Dual Algorithms for Maximizing Ad-Auctions Revenue, Algorithms – ESA 2007, LNCS 4698, 2007. https://doi.org/10.1007/978-3-540-75520-3_24
  • A. Mehta, A. Saberi, U. Vazirani, V. Vazirani, AdWords and Generalized Online Matching, Journal of the ACM 54(5), 2007. https://doi.org/10.1145/1284320.1284321
  • R. M. Karp, U. V. Vazirani, V. V. Vazirani, An Optimal Algorithm for On-line Bipartite Matching, STOC 1990. https://doi.org/10.1145/100216.100262
  • B. Kalyanasundaram, K. R. Pruhs, An Optimal Deterministic Algorithm for Online b-Matching, Theoretical Computer Science 233(1–2), 2000. https://doi.org/10.1016/S0304-3975(99)00140-1
  • N. Buchbinder, J. Naor, The Design of Competitive Online Algorithms via a Primal-Dual Approach, Foundations and Trends in Theoretical Computer Science 3(2–3), 2009. https://doi.org/10.1561/0400000024
10 thms3 active usersReviewed
CombinatoricsOperations ResearchOptimization+1·Captain: mikedeng1

Online Scheduling of a Single Machine to Minimize Total Weighted Completion Time: Delayed SWPT Has Competitive Ratio 2Research Paper

Motivation

A single machine must process nnn jobs that arrive over time. Job jjj is released at time rjr_jrj​, needs pjp_jpj​ units of uninterrupted processing, and has weight wj>0w_j > 0wj​>0; the goal is to minimize the total weighted completion time ∑jwjCj\sum_j w_j C_j∑j​wj​Cj​. Offline, with all release dates equal to zero, Smith's rule (sequence by nondecreasing pj/wjp_j/w_jpj​/wj​) is optimal (Smith 1956); with arbitrary release dates the problem 1 ∣ rj ∣ ∑wjCj1\,|\,r_j\,|\,\sum w_j C_j1∣rj​∣∑wj​Cj​ is strongly NP-hard (Lenstra, Rinnooy Kan and Brucker 1977).

In the online version the scheduler learns of job jjj only at time rjr_jrj​, and at each moment must either start a released job or keep the machine idle. Its quality is measured by its competitive ratio: the worst case, over all instances, of the ratio between the online schedule's cost and the offline optimum. Release-date scheduling is one of the basic test cases of online optimization.

Timeline:

  • 1996. Hoogeveen and Vestjens show that no online algorithm has competitive ratio below 2, even with equal weights, and give the 2-competitive algorithm Delayed SPT for equal weights.
  • 1997. Hall, Schulz, Shmoys and Wein give a (3+ε)(3+\varepsilon)(3+ε)-competitive algorithm for arbitrary weights, based on geometric intervals and linear programming.
  • 1998. Phillips, Stein and Wein give another 2-competitive algorithm for equal weights, which does not extend to arbitrary weights.
  • 2002. Goemans, Queyranne, Schulz, Skutella and Wang obtain a (1+2)(1+\sqrt2)(1+2​)-competitive deterministic algorithm from an LP relaxation.
  • 2004. Anderson and Potts show that Delayed SWPT has competitive ratio exactly 2 for arbitrary positive weights, matching the lower bound.

Setting

An instance has jobs j∈J={1,…,n}j \in J = \{1,\dots,n\}j∈J={1,…,n} with integer release dates rj≥0r_j \ge 0rj​≥0, integer processing times pj≥1p_j \ge 1pj​≥1 and real weights wj>0w_j > 0wj​>0. A schedule assigns each job an integer start time SjS_jSj​. It is feasible if Sj≥rjS_j \ge r_jSj​≥rj​ for every jjj and no two intervals [Sj,Sj+pj)[S_j, S_j + p_j)[Sj​,Sj​+pj​) overlap; idle time is allowed. Its cost is C(S)=∑jwj(Sj+pj)C(S) = \sum_j w_j (S_j + p_j)C(S)=∑j​wj​(Sj​+pj​).

Delayed SWPT runs over unit time slots [t,t+1)[t, t+1)[t,t+1). When the machine is available at time ttt, it looks at the jobs released by ttt and not yet started, and selects one with the smallest ratio pj/wjp_j/w_jpj​/wj​. Ties go to the smaller pjp_jpj​, then to the smaller index. If pj≤tp_j \le tpj​≤t, it starts jjj at ttt and the machine is busy until t+pjt + p_jt+pj​. Otherwise the machine stays idle and the rule is applied again at t+1t+1t+1. The resulting schedule is written π\piπ, or dswpt I in Lean. In particular no job starts before time pjp_jpj​.

The proof uses three auxiliary problems:

  • the doubled problem (2P), with data (2rj,2pj,wj)(2r_j, 2p_j, w_j)(2rj​,2pj​,wj​);
  • the extended problem (E), with release dates rj′=max⁡{pj,f(rj)}r'_j = \max\{p_j, f(r_j)\}rj′​=max{pj​,f(rj​)}, where f(t)f(t)f(t) is the first time at or after ttt at which π\piπ leaves the machine free;
  • one unit-length gap job gtg_tgt​ for each slot [t,t+1)[t,t+1)[t,t+1) in which Delayed SWPT idles although a job jjj is available. The gap job has release date f(rj)f(r_j)f(rj​) and weight wj/pjw_j/p_jwj​/pj​.

The schedule πE\pi_EπE​ of (E) runs the original jobs as in π\piπ and each gtg_tgt​ in [t,t+1)[t,t+1)[t,t+1).

Formalization targets

Goal: Theorem 8

min⁡{ρ  :  ∑jwjCj(π)≤ρ∑jwjCj(S) for every instance and every feasible schedule S}=2.\min\Bigl\{\rho \;:\; \sum_j w_j C_j(\pi) \le \rho \sum_j w_j C_j(S)\ \text{for every instance and every feasible schedule } S\Bigr\} = 2.min{ρ:j∑​wj​Cj​(π)≤ρj∑​wj​Cj​(S) for every instance and every feasible schedule S}=2.

Lean: IsLeast {ρ | ∀ n I S, IsFeasible I.r I.p S → cost I.w I.p (dswpt I) ≤ ρ * cost I.w I.p S} 2. Both halves are required: the upper bound 222 and the fact that no smaller constant is valid for this algorithm.

Milestones

  1. πj≥pj\pi_j \ge p_jπj​≥pj​ for every job (§2) and rj′≤max⁡{2rj,pj}r'_j \le \max\{2r_j, p_j\}rj′​≤max{2rj​,pj​} (§3.2).
  2. πE\pi_EπE​ is feasible for (E) (§3.2).
  3. Lemma 1. If π∗\pi^*π∗ and μ∗\mu^*μ∗ are optimal for (P) and (2P), then C(μ∗)=2 C(π∗)C(\mu^*) = 2\,C(\pi^*)C(μ∗)=2C(π∗).
  4. Lemma 2. πE\pi_EπE​ is optimal for (E).
  5. Lemma 3. If μ∗\mu^*μ∗ is optimal for (2P) and a feasible σE\sigma_EσE​ for (E) satisfies
∑j∈JwjCj(σE)+∑g∈GwgCg(σE)≤∑j∈JwjCj(μ∗)+∑g∈GwgCg(πE),(1)\sum_{j\in J} w_j C_j(\sigma_E) + \sum_{g\in G} w_g C_g(\sigma_E) \le \sum_{j\in J} w_j C_j(\mu^*) + \sum_{g\in G} w_g C_g(\pi_E), \tag{1}j∈J∑​wj​Cj​(σE​)+g∈G∑​wg​Cg​(σE​)≤j∈J∑​wj​Cj​(μ∗)+g∈G∑​wg​Cg​(πE​),(1)

then C(π)≤2 C(S)C(\pi) \le 2\,C(S)C(π)≤2C(S) for every feasible SSS. 6. Inequality (1) holds for some feasible σE\sigma_EσE​, for every optimal μ∗\mu^*μ∗ of (2P) (§§3.4–3.6).

Significance

The theorem shows that a deterministic online algorithm can match the lower bound of Hoogeveen and Vestjens for arbitrary positive weights. This settles the best competitive ratio for deterministic online algorithms for 1 ∣ rj ∣ ∑wjCj1\,|\,r_j\,|\,\sum w_j C_j1∣rj​∣∑wj​Cj​. The algorithm needs no linear program. The analysis also does not compare the algorithm with a lower bound on the optimum. Instead it shows that the online schedule is optimal for a modified problem (E), and it converts an optimal schedule of (2P) into a schedule of (E).

The result was proved on paper in 2004. Neither Mathlib nor the Prove2Me catalog contains a machine-checked proof of it, or of any competitive ratio for online scheduling with release dates. This mission provides several reusable pieces:

  • an executable, verified-terminating definition of an online scheduling rule;
  • the doubling lemma for release-date problems;
  • the optimality criterion behind Lemma 2;
  • the block-by-block exchange argument of §§3.3–3.6.

Difficulty

The obvious argument fails at Lemma 2. Delayed SWPT is far from optimal for (P) itself, and its idle time is unbounded in relative terms. The proof therefore has to show that the inserted gap jobs make every idle slot "justified", so that a preemptive best-available argument becomes valid for (E). That argument rests on an optimality criterion of Belouadah, Posner and Potts (1992), which is not in Mathlib.

The second difficulty is inequality (1). Once μ∗\mu^*μ∗ is doubled and the gap jobs are inserted, nongap jobs must be shifted, and the gain of each gap-generating job must be charged against the delay of the gap jobs in its block. That accounting (Lemmas 4–7 of the paper) is an induction over blocks with signed differences of completion times.

The natural first idea, plain online SWPT (start the available job with the smallest pj/wjp_j/w_jpj​/wj​ whenever the machine is free), has no finite competitive ratio (Example 1 of the paper), so the delay πj≥pj\pi_j \ge p_jπj​≥pj​ is essential to the bound and must be tracked through the whole argument.

Formalization scope

Conventions committed to in Lean:

  • Data. Jobs are Fin n (0-based, so "smallest index" is the order of Fin n). Times are natural numbers, the paper's standing integer-data assumption (p. 688), and weights are real. Every instance carries pj≥1p_j \ge 1pj​≥1 and wj>0w_j > 0wj​>0.
  • Schedules and optimality. Schedules are integer start times. Feasibility, cost and optimality are defined for any finite job type, so (E), with job type Fin n ⊕ gapTimes I, uses the same notions. "Optimal" means optimal among all feasible nonpreemptive schedules with integer start times.
  • The algorithm. Delayed SWPT is a def: a unit-time simulation that compares ratios by cross-multiplication and re-applies the rule at every slot. It runs to the horizon ∑j(rj+2pj)+1\sum_j (r_j + 2p_j) + 1∑j​(rj​+2pj​)+1. A sorry-free check (not uploaded) shows that every job has started by then, and that the simulation reproduces Examples 3 and 4 of the paper, including the gap times 0,2,3,4,5,60,2,3,4,5,60,2,3,4,5,6 of Table 2.
  • Completion times. In (2P) the completion time is μj∗+2pj\mu^*_j + 2p_jμj∗​+2pj​, and gap jobs have unit length.

The goal quantifies over every feasible schedule of every instance. It cannot be met by restricting the competitor to schedules without idle time or to list schedules, by dropping release-date feasibility, or by leaving jobs unscheduled.

Out of scope:

  • The general lower bound "no online algorithm beats 2" (Example 2 of the paper, due to Hoogeveen and Vestjens) is not part of the mission. The lower half of the goal concerns Delayed SWPT only.
  • The Belouadah–Posner–Potts optimality criterion is an external ingredient of Lemma 2. Solvers may formalize it as a supporting theorem.

Infrastructure that a complete development needs:

  • simulation invariants for the algorithm;
  • exchange and left-shift arguments for single-machine schedules;
  • the job-splitting relaxation behind the best-available criterion.

The schedule vocabulary and the criterion are reusable for other release-date scheduling results. Contributions toward the block lemmas of §§3.3–3.6 (Lemmas 4–7, the bound (9)) are welcome as supporting theorems.

Selected references

  • E. J. Anderson and C. N. Potts, Online Scheduling of a Single Machine to Minimize Total Weighted Completion Time, Mathematics of Operations Research 29(3), 686–697, 2004. https://doi.org/10.1287/moor.1040.0092
  • J. A. Hoogeveen and A. P. A. Vestjens, Optimal On-Line Algorithms for Single-Machine Scheduling, IPCO 1996, LNCS 1084, 404–414. https://doi.org/10.1007/3-540-61310-2_30
  • L. A. Hall, A. S. Schulz, D. B. Shmoys and J. Wein, Scheduling to Minimize Average Completion Time: Off-line and On-line Approximation Algorithms, Mathematics of Operations Research 22(3), 513–544, 1997. https://doi.org/10.1287/moor.22.3.513
  • C. Phillips, C. Stein and J. Wein, Minimizing Average Completion Time in the Presence of Release Dates, Mathematical Programming 82, 199–223, 1998. https://doi.org/10.1007/BF01585872
  • M. X. Goemans, M. Queyranne, A. S. Schulz, M. Skutella and Y. Wang, Single Machine Scheduling with Release Dates, SIAM Journal on Discrete Mathematics 15(2), 165–192, 2002. https://doi.org/10.1137/S089548019936223X
  • H. Belouadah, M. E. Posner and C. N. Potts, Scheduling with Release Dates on a Single Machine to Minimize Total Weighted Completion Time, Discrete Applied Mathematics 36(3), 213–231, 1992. https://doi.org/10.1016/0166-218X(92)90255-9
  • J. K. Lenstra, A. H. G. Rinnooy Kan and P. Brucker, Complexity of Machine Scheduling Problems, Annals of Discrete Mathematics 1, 343–362, 1977. https://doi.org/10.1016/S0167-5060(08)70743-X
  • W. E. Smith, Various Optimizers for Single-Stage Production, Naval Research Logistics Quarterly 3, 59–66, 1956. https://doi.org/10.1002/nav.3800030106
11 thms3 active usersReviewed
🏆Completed
Operations ResearchProbabilityTheoretical Computer Science·Captain: mikedeng1

Secretary Problems: Weights and Discounts 2: An Ω(log n / log log n) Lower Bound on the Competitive Ratio of the Discounted Secretary ProblemResearch Paper

Motivation

In the classical secretary problem a decision maker sees nnn candidates in uniformly random order, learns each candidate's value on arrival, and must accept or reject it on the spot; the goal is to pick a valuable one. A simple sample-then-select rule picks the best candidate with probability at least 1/e1/e1/e, so the problem is constant-competitive. The secretary problem is also a model of online mechanism design: a rule that accepts the first agent above a threshold computed from earlier agents is a truthful posted-price mechanism (as the paper notes in §1).

Babaioff, Dinitz, Gupta, Immorlica and Talwar (SODA 2009; authors' version) study the discounted secretary problem, where accepting at time ttt is worth d(t) v(e)d(t)\,v(e)d(t)v(e) for a known discount function ddd. Discounts model settings where a sale is worth more at some times than at others. The case d(t)=βtd(t)=\beta^td(t)=βt had been studied before (Rasmussen and Pliska 1976); the paper asks what happens for arbitrary ddd. Its answer has two sides: an O(log⁡n)O(\log n)O(logn)-competitive algorithm, and the result of this mission, a lower bound showing that no online algorithm is better than Ω(log⁡n/log⁡log⁡n)\Omega(\log n/\log\log n)Ω(logn/loglogn)-competitive. So, unlike the classical problem, the discounted problem with a general discount is not constant-competitive.

Setting

There are nnn elements e∈{0,…,n−1}e\in\{0,\dots,n-1\}e∈{0,…,n−1} with values v(e)≥0v(e)\ge 0v(e)≥0, and a discount function ddd on the times. The elements arrive in a uniformly random order π\piπ: element π(t)\pi(t)π(t) arrives at time ttt. A randomized online stopping rule AAA specifies, for each time ttt and each sequence of values seen so far h=(v(π(0)),…,v(π(t)))h=(v(\pi(0)),\dots,v(\pi(t)))h=(v(π(0)),…,v(π(t))), a probability pt(h)∈[0,1]p_t(h)\in[0,1]pt​(h)∈[0,1] of stopping at ttt if it has not stopped yet. Stopping at ttt selects π(t)\pi(t)π(t) and earns d(t) v(π(t))d(t)\,v(\pi(t))d(t)v(π(t)); the rule selects at most one element and may select none. The rule knows nnn and ddd, but it sees only values, only as they arrive, and it is not told which instance it is facing.

The expected value of AAA is

E[A]=Eπ[∑td(t) v(π(t)) pt(ht)∏s<t(1−ps(hs))],\mathbb E[A]=\mathbb E_\pi\Bigl[\sum_t d(t)\,v(\pi(t))\,p_t(h_t)\prod_{s<t}\bigl(1-p_s(h_s)\bigr)\Bigr],E[A]=Eπ​[t∑​d(t)v(π(t))pt​(ht​)s<t∏​(1−ps​(hs​))],

and the benchmark is the expected offline optimum

E[OPT]=Eπ[max⁡td(t) v(π(t))],\mathbb E[\mathrm{OPT}]=\mathbb E_\pi\Bigl[\max_t d(t)\,v(\pi(t))\Bigr],E[OPT]=Eπ​[tmax​d(t)v(π(t))],

which is itself a random variable averaged over the order. AAA is α\alphaα-competitive on an instance when E[OPT]≤α E[A]\mathbb E[\mathrm{OPT}]\le\alpha\,\mathbb E[A]E[OPT]≤αE[A].

The hard family (§4.1.1 of the paper): fix an integer c≥1c\ge1c≥1 and put L=cL=cL=c, n=L4cn=L^{4c}n=L4c, nt=L2tn_t=L^{2t}nt​=L2t for t≤2ct\le 2ct≤2c, and K=n2K=n^2K=n2. The step discount is d(j)=L−1d(j)=L^{-1}d(j)=L−1 on the times 1≤j≤n11\le j\le n_11≤j≤n1​ and d(j)=L−td(j)=L^{-t}d(j)=L−t on nt−1<j≤ntn_{t-1}<j\le n_tnt−1​<j≤nt​. The instance I1\mathcal I_1I1​ has n/n1n/n_1n/n1​ elements of value KKK and the rest 000; It+1\mathcal I_{t+1}It+1​ is obtained from It\mathcal I_tIt​ by raising n/nt+1n/n_{t+1}n/nt+1​ of its values KtK^tKt to Kt+1K^{t+1}Kt+1, so It\mathcal I_tIt​ has n/ntn/n_tn/nt​ elements of value KtK^tKt.

Formalization targets

Goal: Theorem 4.3 in the form its proof establishes

For every integer c≥1c\ge1c≥1 and every randomized online stopping rule AAA for horizon n=c4cn=c^{4c}n=c4c and the step discount,

∃ t∈{1,…,2c}:c⋅E[A(It)] < 10⋅E[OPT(It)].\exists\,t\in\{1,\dots,2c\}:\qquad c\cdot\mathbb E[A(\mathcal I_t)]\ <\ 10\cdot\mathbb E[\mathrm{OPT}(\mathcal I_t)].∃t∈{1,…,2c}:c⋅E[A(It​)] < 10⋅E[OPT(It​)].

That is, no online rule is c/10c/10c/10-competitive on all of I1,…,I2c\mathcal I_1,\dots,\mathcal I_{2c}I1​,…,I2c​.

Milestones

  1. Lemma 4.1: E[OPT(It)]≥(1−1/e)KtL−t\mathbb E[\mathrm{OPT}(\mathcal I_t)]\ge(1-1/e)K^tL^{-t}E[OPT(It​)]≥(1−1/e)KtL−t for 1≤t≤2c1\le t\le 2c1≤t≤2c.
  2. Coupling step of Lemma 4.2's proof: for every rule and 1≤t<2c1\le t<2c1≤t<2c, the probability of stopping among the first ntn_tnt​ arrivals drops by at most 1/L21/L^21/L2 from It\mathcal I_tIt​ to It+1\mathcal I_{t+1}It+1​.
  3. Lemma 4.2: a rule that is c/10c/10c/10-competitive on I1,…,I2c\mathcal I_1,\dots,\mathcal I_{2c}I1​,…,I2c​ stops among the first ntn_tnt​ arrivals of It\mathcal I_tIt​ with probability at least t/ct/ct/c.
  4. Theorem 4.3, asymptotic form: for c≥2c\ge2c≥2 and n=c4cn=c^{4c}n=c4c, every rule has some It\mathcal I_tIt​ with
140⋅log⁡nlog⁡log⁡n⋅E[A(It)]<E[OPT(It)].\frac1{40}\cdot\frac{\log n}{\log\log n}\cdot\mathbb E[A(\mathcal I_t)]<\mathbb E[\mathrm{OPT}(\mathcal I_t)].401​⋅loglognlogn​⋅E[A(It​)]<E[OPT(It​)].

Significance

The result separates the discounted secretary problem from its classical and weighted relatives, which admit constant-competitive algorithms (the paper's Theorem 3.4 and the eee-competitive classical rule). Together with the paper's O(log⁡n)O(\log n)O(logn) upper bound (Theorem 4.4) it pins the competitive ratio for general discounts between log⁡n/log⁡log⁡n\log n/\log\log nlogn/loglogn and log⁡n\log nlogn up to constants, and it motivates the paper's known-OPT\mathrm{OPT}OPT model (§4.2), where an estimate of E[OPT]\mathbb E[\mathrm{OPT}]E[OPT] restores a constant ratio. The construction is a template for lower bounds against randomized online algorithms in random-order models: geometrically nested instances that a rule cannot tell apart early, played against a discount that punishes waiting.

The theorem is proved in the paper, in about a page. To our knowledge no part of it has a machine-checked proof. This mission produces the formal model of randomized online stopping rules in the random-order discounted setting, a reusable object for the paper's other discounted results (the O(log⁡n)O(\log n)O(logn) upper bound, and the 2\sqrt22​ lower bound with known values of Theorem 4.6), and a checked version of the lower bound with explicit constants.

Difficulty

The obvious attempt is to fix one instance and show that every rule loses on it. That fails: for any single instance there is a rule tuned to it (a rule that waits exactly as long as that instance warrants). The lower bound has to play the 2c2c2c instances against each other. A rule that does well on It\mathcal I_tIt​ must commit early, within the first ntn_tnt​ steps, yet the rule cannot distinguish It\mathcal I_tIt​ from It+1\mathcal I_{t+1}It+1​ during those steps except with probability L−2L^{-2}L−2. Making "cannot distinguish" precise is the central step: it needs a coupling of the two runs over the same random order and the same internal randomness, which works only because the rule's decision at time ttt depends on the values observed so far and nothing else. The accounting then has to show that the rule's early earnings on It+1\mathcal I_{t+1}It+1​ and its late earnings are both small compared with E[OPT(It+1)]\mathbb E[\mathrm{OPT}(\mathcal I_{t+1})]E[OPT(It+1​)], which uses L≥2L\ge 2L≥2 and that K=n2K=n^2K=n2 dwarfs L2cL^{2c}L2c.

Formalization scope

  • Elements and times are Fin n, 0-based: index jjj is the paper's time j+1j+1j+1, so the paper's block (nt−1,nt](n_{t-1},n_t](nt−1​,nt​] is the index range [nt−1,nt)[n_{t-1},n_t)[nt−1​,nt​). The random order is π : Equiv.Perm (Fin n) read as time ↦\mapsto↦ element, and every expectation over it is the finite average 1n!∑π\frac1{n!}\sum_\pin!1​∑π​. Values and discounts are real.
  • Algorithms are the structure StoppingRule n: stopping probabilities pt(h)∈[0,1]p_t(h)\in[0,1]pt​(h)∈[0,1] indexed by time and the arrival-ordered value sequence, with the non-anticipation condition that pt(h)p_t(h)pt​(h) depends only on h0,…,hth_0,\dots,h_th0​,…,ht​. The theorem quantifies over all such rules, so it covers deterministic and randomized online algorithms that observe values only. A rule may depend on nnn and ddd but not on the instance index.
  • OPT is Eπ[max⁡td(t)v(π(t))]\mathbb E_\pi[\max_t d(t)v(\pi(t))]Eπ​[maxt​d(t)v(π(t))] (a supremum over the finite type Fin n), and competitiveness is multiplicative, E[OPT]≤α E[A]\mathbb E[\mathrm{OPT}]\le\alpha\,\mathbb E[A]E[OPT]≤αE[A], never a quotient.
  • Constants. The goal uses the paper's constant 101010 (from "if AAA is c/10c/10c/10-competitive"); the asymptotic form uses 1/401/401/40, from log⁡n/log⁡log⁡n≤4c\log n/\log\log n\le 4clogn/loglogn≤4c for c≥2c\ge2c≥2, with the natural logarithm. K=n2K=n^2K=n2, the value the paper suggests.
  • The construction (nnn, ntn_tnt​, ddd, KKK, It\mathcal I_tIt​) is fixed by explicit formulas in the definition file. A solver cannot choose the discount or the instances, and the goal is not stated for a restricted class of algorithms; a formalization that let the rule see the instance index or future values, or quantified only over threshold rules, would be a different and trivial or weaker theorem. For c<10c<10c<10 the goal is immediate, since E[A]≤E[OPT]\mathbb E[A]\le\mathbb E[\mathrm{OPT}]E[A]≤E[OPT] and E[OPT(It)]>0\mathbb E[\mathrm{OPT}(\mathcal I_t)]>0E[OPT(It​)]>0; the content lies in c≥10c\ge10c≥10. The bound is stated only for the horizons n=c4cn=c^{4c}n=c4c the paper constructs.
  • Needed infrastructure: counting arguments over permutations of Fin n (the probability that a set of mmm elements misses the first kkk positions), the coupling of two value sequences that agree on a prefix, and elementary estimates on geometric sums. The rule model and the permutation-counting lemmas are reusable for the paper's other discounted results. Contributions of these supporting lemmas, as well as proofs of the milestones, are welcome.

Selected references

  • M. Babaioff, M. Dinitz, A. Gupta, N. Immorlica, K. Talwar, Secretary Problems: Weights and Discounts, Proceedings of the 20th ACM-SIAM Symposium on Discrete Algorithms (SODA), 2009. https://doi.org/10.1137/1.9781611973068.135 (authors' full version, the one cited here: https://www.cs.jhu.edu/~mdinitz/papers/secretary.pdf)
  • E. B. Dynkin, Optimal choice of the stopping moment of a Markov process, Doklady Akademii Nauk SSSR, 1963.
  • W. T. Rasmussen, S. R. Pliska, Choosing the maximum from a sequence with a discount function, Applied Mathematics and Optimization 2(3), 1976.
  • T. S. Ferguson, Who solved the secretary problem?, Statistical Science 4(3), 1989. https://doi.org/10.1214/ss/1177012493
7 thms2 active usersReviewed
🏆Completed
Operations ResearchProbabilityTheoretical Computer Science·Captain: mikedeng1

Secretary Problems: Weights and Discounts 4: A Threshold Rule Earns Z/4 for Any Z ≤ E[OPT] in the Discounted Secretary ProblemResearch Paper

Motivation

In the classical secretary problem a decision maker sees nnn candidates in a uniformly random order and must accept or reject each one on arrival, irrevocably, aiming to accept a valuable one. Its online, random-order structure models hiring, selling an item to sequentially arriving buyers, and posting prices in online markets. Babaioff, Dinitz, Gupta, Immorlica and Talwar (SODA 2009) study the discounted secretary problem, where the reward of a selection depends on when it is made: a candidate accepted late is worth less (or more) by a time-dependent factor, as with a seller whose revenue decays with time, or a firm that loses value the longer a position stays empty.

Timeline of the setting:

  • Dynkin (1963) introduced the classical problem; the rule "observe a 1/e1/e1/e fraction, then accept the first record" selects the best candidate with probability tending to 1/e1/e1/e.
  • Rasmussen and Pliska (1975/76) and Mahdian, McAfee and Pennock (2008, personal communication cited by the paper) studied secretary problems with specific "well-behaved" discount functions such as d(t)=βtd(t)=\beta^td(t)=βt.
  • Babaioff et al. (2009) treat an arbitrary discount function ddd. Without prior knowledge, no algorithm is better than Ω(log⁡n/log⁡log⁡n)\Omega(\log n/\log\log n)Ω(logn/loglogn)-competitive (their Theorem 4.3), and O(log⁡n)O(\log n)O(logn) is achievable (Theorem 4.4). If the algorithm knows a good estimate ZZZ of the expected offline optimum, a single threshold rule recovers a constant fraction (Theorem 4.7, headlined as Theorem 1.2). This mission formalizes that last result.

Setting

There are n≥1n\ge1n≥1 elements, indexed by Fin n\mathrm{Fin}\,nFinn. Element eee has a value v(e)≥0v(e)\ge0v(e)≥0, and each time t∈{1,…,n}t\in\{1,\dots,n\}t∈{1,…,n} has a discount d(t)≥0d(t)\ge0d(t)≥0. The elements arrive in a uniformly random order π\piπ, a bijection from times to elements: element π(t)\pi(t)π(t) arrives at time ttt. Selecting the element that arrives at time iii earns d(i) v(π(i))d(i)\,v(\pi(i))d(i)v(π(i)), and an algorithm selects at most one element.

The offline optimum on the order π\piπ is OPT(π)=max⁡i=1nd(i) v(π(i))\mathrm{OPT}(\pi)=\max_{i=1}^n d(i)\,v(\pi(i))OPT(π)=maxi=1n​d(i)v(π(i)). It is a random variable, and the benchmark is its expectation

E[OPT]=∑π∈Sn1n!max⁡i=1n{d(i) v(π(i))}.\mathbf E[\mathrm{OPT}]=\sum_{\pi\in S_n}\frac1{n!}\max_{i=1}^n\{d(i)\,v(\pi(i))\}.E[OPT]=π∈Sn​∑​n!1​i=1maxn​{d(i)v(π(i))}.

For a real parameter ZZZ, algorithm A\mathcal AA selects the first time jjj at which d(j) v(π(j))≥Z/2d(j)\,v(\pi(j))\ge Z/2d(j)v(π(j))≥Z/2 and earns that product; if no time qualifies, it selects nothing and earns 000. It knows ZZZ and ddd, sees the values one at a time, and never sees the future of π\piπ. Its expected value is E[A]=∑π∈Sn1n! A(π)\mathbf E[\mathcal A]=\sum_{\pi\in S_n}\frac1{n!}\,\mathcal A(\pi)E[A]=∑π∈Sn​​n!1​A(π).

The proof uses three derived objects:

  • the accepting permutations Sacc={π:max⁡id(i)v(π(i))≥Z/2}S_{acc}=\{\pi:\max_i d(i)v(\pi(i))\ge Z/2\}Sacc​={π:maxi​d(i)v(π(i))≥Z/2}, on which A\mathcal AA selects something;
  • their contribution L=∑π∈Sacc1n!max⁡id(i)v(π(i))L=\sum_{\pi\in S_{acc}}\frac1{n!}\max_i d(i)v(\pi(i))L=∑π∈Sacc​​n!1​maxi​d(i)v(π(i)) to E[OPT]\mathbf E[\mathrm{OPT}]E[OPT];
  • for a time iii and an element jjj, the set GijG_{ij}Gij​ of orders on which A\mathcal AA selects jjj at time iii. These are the orders with π(i)=j\pi(i)=jπ(i)=j and d(k)v(π(k))<Z/2d(k)v(\pi(k))<Z/2d(k)v(π(k))<Z/2 for every k<ik<ik<i.

Formalization targets

Goal: Theorem 4.7

For every n≥1n\ge1n≥1, all discounts d≥0d\ge0d≥0, all values v≥0v\ge0v≥0 and every real ZZZ,

Z≤E[OPT] ⟹ E[A] ≥ Z4.Z\le\mathbf E[\mathrm{OPT}]\ \Longrightarrow\ \mathbf E[\mathcal A]\ \ge\ \frac Z4.Z≤E[OPT] ⟹ E[A] ≥ 4Z​.

Taking Z=E[OPT]Z=\mathbf E[\mathrm{OPT}]Z=E[OPT] gives E[OPT]≤4 E[A]\mathbf E[\mathrm{OPT}]\le4\,\mathbf E[\mathcal A]E[OPT]≤4E[A], a 444-competitive algorithm when the expected optimum is known.

Milestones (in the order of the paper's proof, p. 8)

  1. Eq. (4.1). If Z≤E[OPT]Z\le\mathbf E[\mathrm{OPT}]Z≤E[OPT] then L≥Z/2L\ge Z/2L≥Z/2.
  2. Eq. (4.3). If Z≤E[OPT]Z\le\mathbf E[\mathrm{OPT}]Z≤E[OPT] then
∑i=1n∑j: d(i)v(j)≥Z/21n d(i)v(j) ≥ Z2.\sum_{i=1}^n\sum_{j:\,d(i)v(j)\ge Z/2}\frac1n\,d(i)v(j)\ \ge\ \frac Z2.i=1∑n​j:d(i)v(j)≥Z/2∑​n1​d(i)v(j) ≥ 2Z​.
  1. Eq. (4.4). E[A]=∑i=1n∑j: d(i)v(j)≥Z/2d(i)v(j) ∣Gij∣∣Sn∣\displaystyle\mathbf E[\mathcal A]=\sum_{i=1}^n\sum_{j:\,d(i)v(j)\ge Z/2}d(i)v(j)\,\frac{|G_{ij}|}{|S_n|}E[A]=i=1∑n​j:d(i)v(j)≥Z/2∑​d(i)v(j)∣Sn​∣∣Gij​∣​.
  2. Claim 4.8. For every i,ji,ji,j with d(i)v(j)≥Z/2d(i)v(j)\ge Z/2d(i)v(j)≥Z/2, n∣Gij∣≥∣Sn∖Sacc∣n|G_{ij}|\ge|S_n\setminus S_{acc}|n∣Gij​∣≥∣Sn​∖Sacc​∣; and if 2∣Sacc∣≤n!2|S_{acc}|\le n!2∣Sacc​∣≤n! then 2n∣Gij∣≥n!2n|G_{ij}|\ge n!2n∣Gij​∣≥n!.

Significance

The result. The discounted problem separates sharply by information: a logarithmic gap is unavoidable without prior knowledge, while knowledge of the single number E[OPT]\mathbf E[\mathrm{OPT}]E[OPT], or of any lower estimate ZZZ of it, closes the gap to a constant. The algorithm is a fixed posted threshold, so read as a mechanism it is a posted price, which is truthful for single-parameter agents (§1). The paper also notes that when all values are known, E[OPT]\mathbf E[\mathrm{OPT}]E[OPT] can be estimated by sampling (its Lemma A.1), which yields a constant-competitive algorithm in that setting. The companion lower bound (Theorem 4.6) shows that even complete knowledge of the values does not give a ratio better than 2\sqrt22​.

Formalizing it. The result is proved on paper; no machine-checked proof is known. The formalization yields a checked version of the paper's counting argument on permutations (Claim 4.8) and of the tie-breaking step behind Eq. (4.3), and reusable finite random-order bookkeeping: expectations over SnS_nSn​ as averages, threshold stopping rules, and the decomposition of an online algorithm's value by the time and element it selects.

Difficulty

The obvious argument fails when A\mathcal AA rarely selects. A\mathcal AA earns at least Z/2Z/2Z/2 whenever it selects anything, so E[A]≥Z2Pr⁡[A selects]\mathbf E[\mathcal A]\ge\frac Z2\Pr[\mathcal A\text{ selects}]E[A]≥2Z​Pr[A selects]. That settles the case Pr⁡[A selects]≥1/2\Pr[\mathcal A\text{ selects}]\ge1/2Pr[A selects]≥1/2 and nothing else: the probability of selecting can be tiny while E[OPT]\mathbf E[\mathrm{OPT}]E[OPT] is still large, because the optimum may be concentrated on a few orders with a large product. In that case the bound must come from comparing the algorithm with the optimum pair by pair: every time–element pair (i,j)(i,j)(i,j) with d(i)v(j)≥Z/2d(i)v(j)\ge Z/2d(i)v(j)≥Z/2 must be realized by A\mathcal AA on a positive fraction of the orders.

Two points need care in a formal proof:

  • Eq. (4.2) rewrites LLL as a sum over pairs weighted by the conditional probability that d(i)v(j)d(i)v(j)d(i)v(j) is the highest product. It relies on a consistent tie-breaking rule, which the paper leaves implicit.
  • Claim 4.8 is a counting argument on SnS_nSn​. A map from the rejecting orders into GijG_{ij}Gij​ swaps element jjj into position iii, and must be shown to be at most nnn-to-111 and to land in GijG_{ij}Gij​.

Neither (4.2) nor the map appears in the statements, so solvers may replace either with any argument they like.

Formalization scope

  • Types. Times and elements are Fin n; the paper's time ttt is the index t−1t-1t−1. An order is π : Equiv.Perm (Fin n), read as time ↦ element, as on p. 3. The instance [NeZero n] encodes n≥1n\ge1n≥1, so the maximum over times is a genuine maximum (Finset.sup').
  • Expectations. Expectations over the uniform order are finite averages 1n!∑π\frac1{n!}\sum_\pin!1​∑π​. No measure theory is used.
  • Values and constants. Values, discounts and ZZZ are real numbers, and the hypotheses d≥0d\ge0d≥0, v≥0v\ge0v≥0 are explicit. The constant 1/41/41/4 is the paper's. The bound is stated multiplicatively, Z/4≤E[A]Z/4\le\mathbf E[\mathcal A]Z/4≤E[A], never as a ratio.
  • Thresholds and ties. Every threshold is non-strict (≥Z/2\ge Z/2≥Z/2), exactly as on pp. 7–8. A\mathcal AA selects the first qualifying time, so it needs no tie-breaking. The tie-breaking remark at Eq. (4.2) concerns only the paper's intermediate identity (4.2), which is not a milestone.
  • Claim 4.8. Both inequalities are stated with cleared denominators. The second carries the proof's case hypothesis 2∣Sacc∣≤n!2|S_{acc}|\le n!2∣Sacc​∣≤n!, which the paper uses in the same place ("at most half the permutations are in SaccS_{acc}Sacc​").
  • What is not this theorem. A\mathcal AA is the online threshold rule with threshold Z/2Z/2Z/2 applied to π\piπ as it unfolds. An algorithm that inspects the whole order, or that chooses its threshold after seeing the values, would make the bound trivial and is not this theorem.
  • Contributions welcome. Proofs of each milestone, including the counting argument of Claim 4.8. Lemmas on averages over Equiv.Perm (Fin n) and on first-hitting times are reusable beyond this mission.

Selected references

  • M. Babaioff, M. Dinitz, A. Gupta, N. Immorlica, K. Talwar, Secretary Problems: Weights and Discounts, Proceedings of the 20th ACM-SIAM Symposium on Discrete Algorithms (SODA), 2009.
  • E. B. Dynkin, Optimal choice of the stopping moment of a Markov process, Doklady Akademii Nauk SSSR 150:238–240, 1963.
  • W. T. Rasmussen, S. R. Pliska, Choosing the maximum from a sequence with a discount function, Applied Mathematics and Optimization 2(3):279–289, 1975/76.
  • M. Mahdian, P. McAfee, D. Pennock, The secretary problem with durable employment, personal communication, 2008 (cited as [MMP08]).
  • M. Babaioff, N. Immorlica, R. Kleinberg, Matroids, secretary problems, and online mechanisms, SODA 2007, pp. 434–443.
6 thms2 active usersReviewed
CombinatoricsOperations ResearchProbability+1·Captain: mikedeng1

A Polylogarithmic-Competitive Algorithm for the k-Server Problem: Randomized k-Server Is O(log² k · log³ n · log log n)-Competitive on Every n-Point MetricResearch Paper

Motivation

The k-server problem (Manasse, McGeoch and Sleator, 1990) is the central problem of online computation: kkk servers sit on points of a metric space, requests arrive one at a time at points of the space, and each request must be served by moving a server to it, at a cost equal to the distance travelled. An online algorithm decides without knowing future requests; its quality is its competitive ratio, the worst-case ratio between its cost and the cost of an optimal offline schedule. Paging (caching) is the special case of a uniform metric, and weighted paging the case of a weighted star.

Timeline of the upper bounds for general metrics:

  • 1990: Manasse, McGeoch and Sleator prove that every deterministic algorithm has ratio at least kkk and conjecture that kkk is achievable.
  • 1991: Fiat, Rabani and Ravid give the first ratio depending on kkk only (exponential in kkk).
  • 1995: Koutsoupias and Papadimitriou prove that the work function algorithm is (2k−1)(2k-1)(2k−1)-competitive.
  • For randomized algorithms against an oblivious adversary, the conjectured answer is O(log⁡k)O(\log k)O(logk), achieved for paging (Fiat et al., 1991), but until 2011 nothing better than the deterministic 2k−12k-12k−1 was known for general metrics, even when the ratio may depend on the number of points nnn.
  • 2011: Bansal, Buchbinder, Mądry and Naor give the first polylogarithmic bound, O(log⁡2klog⁡3nlog⁡log⁡n)O(\log^2 k\log^3 n\log\log n)O(log2klog3nloglogn) (arXiv:1110.1580; J. ACM 62(5), 2015, DOI 10.1145/2783434), the result of this mission.

Setting

Let (M,dist)(M,\mathrm{dist})(M,dist) be a finite metric space with nnn points and kkk a number of servers. A configuration C:{1,…,k}→MC:\{1,\dots,k\}\to MC:{1,…,k}→M places server iii at C(i)C(i)C(i). A deterministic online algorithm maps each prefix of the request sequence to a configuration that has a server at the last request; its cost on a sequence ρ\rhoρ is the total distance travelled. OPT(C0,ρ)\mathrm{OPT}(C_0,\rho)OPT(C0​,ρ) is the least cost of any schedule serving ρ\rhoρ from the initial configuration C0C_0C0​. A randomized algorithm is a probability distribution over deterministic online algorithms, all starting at C0C_0C0​; it is ccc-competitive if there is a constant aaa such that its expected cost on every request sequence ρ\rhoρ is at most c⋅OPT(C0,ρ)+ac\cdot\mathrm{OPT}(C_0,\rho)+ac⋅OPT(C0​,ρ)+a.

The paper works with three auxiliary objects. A σ-HST is a rooted tree whose leaves are the points, in which all edges from a node to its children have one common length, equal to 1/σ1/\sigma1/σ times the length of the edge above that node; the distance between two leaves is the length of the tree path. A weighted σ-HST only requires that the edge above a non-root internal node be at least σ\sigmaσ times each edge below it. In the fractional k-server problem on a tree, the state is a vector xxx of server probabilities on the leaves with 0≤xi≤10\le x_i\le10≤xi​≤1 and ∑ixi=k\sum_i x_i=k∑i​xi​=k, a request at leaf iii forces xi=1x_i=1xi​=1, and moving from xxx to x′x'x′ costs ∑vW(v) ∣xv′−xv∣\sum_v W(v)\,|x'_v-x_v|∑v​W(v)∣xv′​−xv​∣, where xvx_vxv​ is the mass below node vvv and W(v)W(v)W(v) the length of the edge above vvv. In the allocation problem on a weighted star with weights wiw_iwi​, requests carry a location iti^tit, a monotone cost vector ht(0)≥⋯≥ht(k)≥0h^t(0)\ge\dots\ge h^t(k)\ge0ht(0)≥⋯≥ht(k)≥0 (the cost of serving with jjj servers there) and a server quota κ(t)≤k\kappa(t)\le kκ(t)≤k.

Formalization targets

Goal: Theorem 1

There is a universal constant C>0C>0C>0 such that for all k≥2k\ge2k≥2, every metric space MMM with n≥3n\ge3n≥3 points and every initial configuration C0C_0C0​, some randomized online algorithm starting at C0C_0C0​ is

C log⁡2k log⁡3n log⁡log⁡n-competitive.C\,\log^2 k\,\log^3 n\,\log\log n\text{-competitive.}Clog2klog3nloglogn-competitive.

Milestones

In the order the proof uses them:

  1. Claim 15: the fix-stage inequality behind the allocation algorithm's analysis.
  2. Theorem 5: for every 0<ε≤10<\varepsilon\le10<ε≤1, a fractional allocation algorithm whose hit cost is at most (1+ε)(Opt+wmax⁡g(κ))+a(1+\varepsilon)(\mathrm{Opt}+w_{\max}g(\kappa))+a(1+ε)(Opt+wmax​g(κ))+a and whose movement cost is at most O(log⁡(k/ε))(Opt+wmax⁡g(κ))+aO(\log(k/\varepsilon))(\mathrm{Opt}+w_{\max}g(\kappa))+aO(log(k/ε))(Opt+wmax​g(κ))+a, where g(κ)=∑t∣κ(t)−κ(t−1)∣g(\kappa)=\sum_t|\kappa(t)-\kappa(t-1)|g(κ)=∑t​∣κ(t)−κ(t−1)∣.
  3. Theorem 6: given such allocation algorithms, an O(ℓlog⁡(kℓ))O(\ell\log(k\ell))O(ℓlog(kℓ))-competitive fractional k-server algorithm on every weighted σ-HST of depth ℓ\ellℓ with σ=Ω(ℓlog⁡(kℓ))\sigma=\Omega(\ell\log(k\ell))σ=Ω(ℓlog(kℓ)).
  4. Theorem 8: every σ-HST with nnn leaves becomes a weighted σ-HST of depth O(log⁡n)O(\log n)O(logn) on the same leaves, with distances distorted by at most 2σ/(σ−1)2\sigma/(\sigma-1)2σ/(σ−1).
  5. Lemma 25 and Theorem 24: on a σ-HST with σ>5\sigma>5σ>5, randomized states consistent with a changing fractional state can be maintained online at cost O(ct)O(c_t)O(ct​) per step.
  6. Theorem 7: on a σ-HST with σ>5\sigma>5σ>5, a ccc-competitive fractional algorithm yields an O(c)O(c)O(c)-competitive randomized one.

Significance

The theorem broke the exponential gap between the Ω(log⁡k)\Omega(\log k)Ω(logk) lower bound and the 2k−12k-12k−1 upper bound for randomized k-server, and showed that randomization helps on every finite metric, not only on uniform or specially structured ones. Its two-level method (a fractional algorithm on trees driven by per-node allocation problems, followed by an online rounding) became the template for later work, including the O(log⁡2k)O(\log^2 k)O(log2k) bound on HSTs of Bubeck, Cohen, Lee, Lee and Mądry (STOC 2018) and Lee's O(log⁡6k)O(\log^6 k)O(log6k) bound on general metrics (FOCS 2018).

The result is proved, in this paper. As far as is known it has no machine-checked proof. Formalizing it means formalizing the analysis of an online algorithm driven by a continuous-time process, a potential-function argument with exact constants, a tree contraction with a distortion bound, and an online randomized rounding against a transportation cost. The allocation, HST and rounding statements are reusable for other online problems on trees (metrical task systems, weighted paging).

Difficulty

For a deterministic or randomized algorithm on a tree, the natural recursion splits the servers of each node among its children. Coté, Meyerson and Poplawski showed that this works if each node solves an allocation problem with a strong guarantee: hit cost within a factor 1+ε1+\varepsilon1+ε of optimal. Integral allocation algorithms cannot achieve this; the integrality gap example of the paper (p. 8) gives a factor Ω(k)\Omega(k)Ω(k). The fractional relaxation avoids the gap, but then the rounding step must keep a randomized state consistent with a fractional state at constant-factor cost, and the HSTs obtained from general metrics have depth growing with the aspect ratio, which a depth-dependent ratio cannot afford. Each of the three reductions (allocation to fractional k-server, deep HST to shallow weighted HST, fractional to randomized) loses only polylogarithmic or constant factors, and the main theorem needs all three at once.

Formalization scope

The k-server model, randomized algorithms and competitiveness are the published definitions KServer_model and KServer_randomized; competitiveness carries an additive constant fixed before the request sequence. Trees are finite rooted trees with a parent map, a depth function and positive edge lengths; points of the k-server problem are the leaves, and the theorems take an arbitrary finite metric space together with a bijection to the leaves and the hypothesis that the distance equals the tree distance. Fractional k-server states have exactly kkk units of mass, each leaf at most 111, and fractional algorithms are measured against the integral offline optimum. The allocation optimum is the integral optimum; cost vectors are finite, non-negative and non-increasing; the diameter of the star is wmax⁡=max⁡iwiw_{\max}=\max_i w_iwmax​=maxi​wi​. The cost of changing a randomized state is the transportation cost over couplings, with minimum-matching cost between configurations. Every O(⋅)O(\cdot)O(⋅) is an explicit constant quantified before the instance, except that in Theorems 7 and 24 and Lemma 25 it may depend on σ\sigmaσ.

Formalizations that make the targets trivial are excluded: the fractional state must place a full server on every request and stay in [0,1][0,1][0,1], the benchmark is the integral optimum (not the algorithm's own or the fractional cost), and no constant may depend on kkk, nnn, the metric or the tree, since otherwise Theorem 1 would follow from the 2k−12k-12k−1 bound.

The proof of Theorem 1 also uses the embedding of Fakcharoenphol, Rao and Talwar [18] of a finite metric into a distribution over σ-HSTs with expected distortion O(σlog⁡σn)O(\sigma\log_\sigma n)O(σlogσ​n). It is an external ingredient, not a result of this paper, and is not a milestone; contributions formalizing it (or Bartal's earlier embedding) are welcome, as are formalizations of the integral optimum's properties on trees (Lemmas 21–22 of the paper), which are not stated here.

Selected references

  • N. Bansal, N. Buchbinder, A. Mądry, J. Naor, A Polylogarithmic-Competitive Algorithm for the k-Server Problem, arXiv:1110.1580v1, 2011; J. ACM 62(5), 2015. https://arxiv.org/abs/1110.1580, https://doi.org/10.1145/2783434
  • M. Manasse, L. McGeoch, D. Sleator, Competitive algorithms for server problems, J. Algorithms 11, 1990. https://doi.org/10.1016/0196-6774(90)90003-W
  • E. Koutsoupias, C. Papadimitriou, On the k-server conjecture, J. ACM 42(5), 1995. https://doi.org/10.1145/210118.210128
  • A. Fiat, R. Karp, M. Luby, L. McGeoch, D. Sleator, N. Young, Competitive paging algorithms, J. Algorithms 12, 1991. https://doi.org/10.1016/0196-6774(91)90041-V
  • J. Fakcharoenphol, S. Rao, K. Talwar, A tight bound on approximating arbitrary metrics by tree metrics, J. Comput. Syst. Sci. 69(3), 2004. https://doi.org/10.1016/j.jcss.2004.04.011
  • A. Coté, A. Meyerson, L. Poplawski, Randomized k-server on hierarchical binary trees, STOC 2008. https://doi.org/10.1145/1374376.1374474
14 thms3 active usersReviewed
🏆Completed
Operations ResearchProbabilityTheoretical Computer Science·Captain: mikedeng1

Secretary Problems: Weights and Discounts 3: An O(log n)-Competitive Algorithm for the Discounted Secretary ProblemResearch Paper

Motivation

In the secretary problem, nnn candidates with arbitrary values arrive one at a time in a uniformly random order, and an online decision maker must accept or reject each candidate on arrival, irrevocably, keeping at most one. The rule that observes the first n/en/en/e candidates and then accepts the first one better than everything seen so far selects the best candidate with probability about 1/e1/e1/e (Dynkin, 1963). The problem is a basic model of online selection and, read economically, of posted-price mechanisms for agents who arrive in random order: a rule that compares each agent only against a threshold set by earlier agents is truthful.

Babaioff, Dinitz, Gupta, Immorlica and Talwar (SODA 2009) study a variant in which time costs value. Selecting the candidate who arrives at time ttt earns that candidate's value multiplied by a discount d(t)d(t)d(t), for an arbitrary non-negative discount function ddd known in advance. Earlier work treated only specific discount shapes, such as geometric discounting d(t)=βtd(t)=\beta^td(t)=βt (Rasmussen and Pliska, 1976). For a general ddd the classical rule can fail badly: if all the discount mass sits in the first few time steps, a rule that waits through a sample of size n/en/en/e earns nothing. The paper shows that the best competitive ratio for arbitrary discounts lies between Ω(log⁡n/log⁡log⁡n)\Omega(\log n/\log\log n)Ω(logn/loglogn) (its Theorem 4.3) and O(log⁡n)O(\log n)O(logn) (its Theorem 4.4). This mission formalizes the upper bound.

Setting

There are n≥1n\ge1n≥1 elements, indexed {0,…,n−1}\{0,\dots,n-1\}{0,…,n−1}, with values v(e)≥0v(e)\ge 0v(e)≥0, and nnn times with discounts d(t)≥0d(t)\ge0d(t)≥0. A uniformly random permutation π\piπ fixes the order of arrivals: element π(t)\pi(t)π(t) arrives at time ttt. An algorithm knows ddd but not vvv; it sees each value on arrival and may select the current element, irrevocably, earning d(t) v(π(t))d(t)\,v(\pi(t))d(t)v(π(t)). Expectations over π\piπ are exact averages over the n!n!n! orders.

The offline optimum on order π\piπ is OPT(π)=max⁡td(t) v(π(t))\mathsf{OPT}(\pi)=\max_t d(t)\,v(\pi(t))OPT(π)=maxt​d(t)v(π(t)); it is a random variable, and the benchmark is its expectation Eπ[OPT]\mathbb E_\pi[\mathsf{OPT}]Eπ​[OPT] (p. 4 of the paper).

Let dmax⁡=max⁡td(t)d_{\max}=\max_t d(t)dmax​=maxt​d(t) and vmax⁡=max⁡ev(e)v_{\max}=\max_e v(e)vmax​=maxe​v(e). For c≥1c\ge1c≥1 the ccc-th discount class is the set of times

Pc={ i:2−cdmax⁡<d(i)≤2−(c−1)dmax⁡ }.P_c=\{\,i : 2^{-c}d_{\max}<d(i)\le 2^{-(c-1)}d_{\max}\,\}.Pc​={i:2−cdmax​<d(i)≤2−(c−1)dmax​}.

The quantity OPTc\mathsf{OPT}_cOPTc​ is the part of Eπ[OPT]\mathbb E_\pi[\mathsf{OPT}]Eπ​[OPT] earned when the optimal time (the smallest time attaining the maximum) lies in PcP_cPc​.

The classical secretary rule on mmm arrivals observes the first ⌊m/e⌋\lfloor m/e\rfloor⌊m/e⌋ and then selects the first arrival that ranks above every earlier arrival. Ranks use a fixed tie-break order: larger value first, and smaller element index among equal values.

The algorithm A\mathcal AA sets M=3⌈log⁡2n⌉+2M=3\lceil\log_2 n\rceil+2M=3⌈log2​n⌉+2, draws c∈{1,…,M}c\in\{1,\dots,M\}c∈{1,…,M} uniformly, and runs the classical rule on the subsequence of arrivals at the times of PcP_cPc​, ignoring all other arrivals.

Formalization targets

Goal: Theorem 4.4 with its explicit constant

Eπ[OPT]  ≤  4e (3⌈log⁡2n⌉+2)  E[A](n≥1, d≥0, v≥0).\mathbb E_\pi[\mathsf{OPT}]\;\le\;4e\,\bigl(3\lceil\log_2 n\rceil+2\bigr)\;\mathbb E[\mathcal A]\qquad(n\ge1,\ d\ge0,\ v\ge0).Eπ​[OPT]≤4e(3⌈log2​n⌉+2)E[A](n≥1, d≥0, v≥0).

The paper states E[OPT]/E[A]≤O(log⁡n)\mathbb E[\mathsf{OPT}]/\mathbb E[\mathcal A]\le O(\log n)E[OPT]/E[A]≤O(logn); the constant 4e4e4e is the one its proof yields.

Milestones

  1. The classical secretary rule selects the top-ranked of m≥1m\ge1m≥1 elements with probability at least 1/e1/e1/e (§2, p. 4).
  2. OPT1≥vmax⁡dmax⁡/n\mathsf{OPT}_1\ge v_{\max}d_{\max}/nOPT1​≥vmax​dmax​/n (proof of Theorem 4.4, p. 7).
  3. OPTc≤2−c 2n2dmax⁡vmax⁡\mathsf{OPT}_c\le 2^{-c}\,2n^2d_{\max}v_{\max}OPTc​≤2−c2n2dmax​vmax​ for every c≥1c\ge1c≥1 (p. 7).
  4. ∑c=13⌈log⁡2n⌉+1OPTc≥12Eπ[OPT]\sum_{c=1}^{3\lceil\log_2 n\rceil+1}\mathsf{OPT}_c\ge\tfrac12\mathbb E_\pi[\mathsf{OPT}]∑c=13⌈log2​n⌉+1​OPTc​≥21​Eπ​[OPT] (p. 7).
  5. E[Ac]≥OPTc/2e\mathbb E[\mathcal A_c]\ge\mathsf{OPT}_c/2eE[Ac​]≥OPTc​/2e for every c≥1c\ge1c≥1, where Ac\mathcal A_cAc​ is the classical rule on PcP_cPc​ (p. 7).

Significance

The theorem shows that a general discount function costs only a logarithmic factor against the offline benchmark, and that one algorithm achieves this without any knowledge of the values. Together with the lower bound of Theorem 4.3 it pins the competitive ratio of the discounted secretary problem between log⁡n/log⁡log⁡n\log n/\log\log nlogn/loglogn and log⁡n\log nlogn. The same scale-splitting idea, stated in the paper as Theorem 4.5 without full proof, extends the bound to the weighted discounted problem.

The result is proved in the paper; to our knowledge it has not been formalized. A complete development would also produce a machine-checked proof of the classical secretary guarantee for the rule with sample size exactly ⌊m/e⌋\lfloor m/e\rfloor⌊m/e⌋ at every finite mmm, with an explicit tie-break, which is reusable by every secretary-type mission. Milestone 1 is that statement. Sharper constants or a smaller class range are welcome as additional statements but do not replace the goal, which is about this algorithm with this MMM.

Difficulty

The obvious argument, running the classical rule on all nnn arrivals, fails because the discounts can be concentrated at times the rule spends sampling. Splitting by discount scale fixes this but creates two problems. First, there are unboundedly many scales, and one has to show that the offline optimum's mass outside the top O(log⁡n)O(\log n)O(logn) of them is negligible against E[OPT]\mathbb E[\mathsf{OPT}]E[OPT], a random quantity rather than a fixed maximum. Second, the classical rule on a class sees only a random subset of the elements, in random order, and the guarantee must be transferred to this subsequence, conditioning on which elements land in PcP_cPc​. Neither step is deep, but both require careful bookkeeping of permutations, and the classical 1/e1/e1/e bound at finite mmm with a floor in the sample size is itself a nontrivial estimate.

Formalization scope

Elements and times are Fin n, an order is π : Equiv.Perm (Fin n) read as time ↦\mapsto↦ element, and the paper's time t=1,…,nt=1,\dots,nt=1,…,n is index t−1t-1t−1. Values and discounts are Fin n → ℝ with non-negativity hypotheses. Every expectation is the finite average 1n!∑π\frac1{n!}\sum_\pin!1​∑π​; the algorithm's random class is the explicit average 1M∑c=1M\frac1M\sum_{c=1}^MM1​∑c=1M​. Maxima are suprema over the finite index set. The logarithm is base 2, ⌈log⁡2n⌉\lceil\log_2 n\rceil⌈log2​n⌉ is Nat.clog 2 n, and the sample size is Nat.floor (m / Real.exp 1). Ties are broken by the order on Lex (ℝ × (Fin n)ᵒᵈ) (larger value, then smaller index); distinct values are not assumed. The optimal time is the smallest maximizing time, so that the OPTc\mathsf{OPT}_cOPTc​ add up to E[OPT]\mathbb E[\mathsf{OPT}]E[OPT]. Competitiveness is stated multiplicatively, never as a quotient, so E[A]=0\mathbb E[\mathcal A]=0E[A]=0 is not a loophole.

The goal is a statement about the specific algorithm A\mathcal AA, not "there exists an algorithm": an existential over unrestricted algorithms is witnessed by a clairvoyant rule that reads the values in advance. A\mathcal AA sees the values only through comparisons among arrivals that have already occurred, and E[OPT]\mathbb E[\mathsf{OPT}]E[OPT] is the expected offline maximum over the same random order, not dmax⁡vmax⁡d_{\max}v_{\max}dmax​vmax​.

Needed infrastructure: averages over permutations and the fact that the elements landing at a fixed set of times form a uniformly random subset in uniformly random order; the finite-mmm analysis of the classical rule; and elementary estimates on geometric sums. Contributions of general lemmas about uniform permutations are welcome and reusable.

Selected references

  • M. Babaioff, M. Dinitz, A. Gupta, N. Immorlica, K. Talwar, Secretary Problems: Weights and Discounts, Proc. 20th ACM-SIAM Symposium on Discrete Algorithms (SODA), 2009. https://doi.org/10.1137/1.9781611973068.139
  • E. B. Dynkin, The optimum choice of the instant for stopping a Markov process, Soviet Math. Doklady 4, 1963.
  • T. S. Ferguson, Who solved the secretary problem?, Statistical Science 4(3), 1989. https://doi.org/10.1214/ss/1177012493
  • L. T. Rasmussen, S. R. Pliska, Choosing the maximum from a sequence with a discount function, Applied Mathematics and Optimization 2, 1976. https://doi.org/10.1007/BF01458209
  • M. Babaioff, N. Immorlica, R. Kleinberg, Matroids, secretary problems, and online mechanisms, SODA 2007. https://dl.acm.org/doi/10.5555/1283383.1283429
9 thms3 active usersReviewed
🏆Completed
Operations ResearchProbabilityTheoretical Computer Science·Captain: mikedeng1

On the Power of Randomization in On-Line Algorithms 2: The Bound α∘β Against Adaptive Off-Line Adversaries Is TightResearch Paper

Motivation

An on-line algorithm must answer each request as it arrives, without knowing the requests to come; paging, caching, the kkk-server problem and metrical task systems are standard examples. Its quality is measured by competitive analysis: its cost is compared with the cost of an optimal off-line solution that knows the whole request sequence. For randomized on-line algorithms the comparison depends on how much the adversary producing the requests is allowed to see. Ben-David, Borodin, Karp, Tardos and Wigderson (Algorithmica 11, 1994; conference version STOC 1990) introduced the three standard adversaries — oblivious, adaptive on-line and adaptive off-line — and related the competitive ratios achievable against each.

Their Theorem 2.2 (manuscript p. 10) shows that if a randomized algorithm is α\alphaα-competitive against adaptive on-line adversaries and some randomized algorithm is β\betaβ-competitive against oblivious adversaries, then the first algorithm is αβ\alpha\betaαβ-competitive against adaptive off-line adversaries. This mission formalizes the paper's claim (manuscript p. 11) that this product bound cannot be improved in general, together with the explicit construction on pp. 12–13 that proves it.

Setting

A request-answer game consists of a request set RRR, a finite answer set AAA, and cost functions fn:Rn×An→Rf_n : R^n \times A^n \to \mathbb Rfn​:Rn×An→R. For a request sequence r‾∈Rn\underline r \in R^nr​∈Rn, the off-line optimum is c(r‾)=min⁡a‾∈Anfn(r‾,a‾)c(\underline r) = \min_{\underline a \in A^n} f_n(\underline r, \underline a)c(r​)=mina​∈An​fn​(r​,a​). A deterministic on-line algorithm GGG answers the iii-th request with ai=gi(r1,…,ri)a_i = g_i(r_1, \dots, r_i)ai​=gi​(r1​,…,ri​); a randomized one is a probability distribution over deterministic algorithms GxG_xGx​, xxx being the coin tosses.

An adaptive off-line adversary QQQ chooses each request ri+1=qi(a1,…,ai)r_{i+1} = q_i(a_1, \dots, a_i)ri+1​=qi​(a1​,…,ai​) from the answers given so far, stops after at most dQd_QdQ​ requests, and pays the off-line optimum cQ(G)=c(r‾)c_Q(G) = c(\underline r)cQ​(G)=c(r​) of the requests it made; the algorithm pays cG(Q)=fn(r‾,a‾)c_G(Q) = f_n(\underline r, \underline a)cG​(Q)=fn​(r​,a​). An adaptive on-line adversary SSS must in addition answer each request itself, before the algorithm does, with bi+1=pi(a1,…,ai)b_{i+1} = p_i(a_1, \dots, a_i)bi+1​=pi​(a1​,…,ai​), and pays cS(G)=fn(r‾,b‾)c_S(G) = f_n(\underline r, \underline b)cS​(G)=fn​(r​,b​). An oblivious adversary fixes r‾\underline rr​ in advance and pays c(r‾)c(\underline r)c(r​). A randomized GGG is α\alphaα-competitive against oblivious adversaries if Ex[cGx(r‾)]≤α c(r‾)\mathbb E_x[c_{G_x}(\underline r)] \le \alpha\, c(\underline r)Ex​[cGx​​(r​)]≤αc(r​) for all r‾\underline rr​, and against adaptive on-line adversaries if Ex[cGx(S)]≤Ex[α cS(Gx)]\mathbb E_x[c_{G_x}(S)] \le \mathbb E_x[\alpha\, c_S(G_x)]Ex​[cGx​​(S)]≤Ex​[αcS​(Gx​)] for all SSS.

The construction uses the mates game: R=AR = AR=A is a set of 2t2t2t elements split into ttt pairs of mates, and for n≥2n \ge 2n≥2 the cost depends only on the first answer a1a_1a1​ and the second request r2r_2r2​: it is 111 if a1=r2a_1 = r_2a1​=r2​, MMM if a1a_1a1​ is the mate of r2r_2r2​, and mmm otherwise. The algorithm GGG draws a1a_1a1​ uniformly at random. The parameters solve

β=(2t−2)m+M+12t,α=1+(2t−1)M2+(2t−2)m.\beta = \frac{(2t-2)m + M + 1}{2t}, \qquad \alpha = \frac{1 + (2t-1)M}{2 + (2t-2)m}.β=2t(2t−2)m+M+1​,α=2+(2t−2)m1+(2t−1)M​.

Formalization targets

Goal: tightness of Theorem 2.2

For 1<β≤α1 < \beta \le \alpha1<β≤α (or α=β=1\alpha = \beta = 1α=β=1) and every C<αβC < \alpha\betaC<αβ, there are a game and a randomized algorithm GGG such that

G is α-competitive against adaptive on-line adversaries,G is β-competitive against oblivious adversaries,G \text{ is } \alpha\text{-competitive against adaptive on-line adversaries}, \qquad G \text{ is } \beta\text{-competitive against oblivious adversaries},G is α-competitive against adaptive on-line adversaries,G is β-competitive against oblivious adversaries,

and for every randomized algorithm KKK some adaptive off-line adversary QQQ achieves

E[cQ(K)]>0,E[cK(Q)]≥C⋅E[cQ(K)].\mathbb E[c_Q(K)] > 0, \qquad \mathbb E[c_K(Q)] \ge C\cdot \mathbb E[c_Q(K)].E[cQ​(K)]>0,E[cK​(Q)]≥C⋅E[cQ​(K)].

Milestones (pp. 12–13)

  1. The closed forms m(t)m(t)m(t), M(t)M(t)M(t) are the unique solution of the two equations.
  2. m(t)→βm(t) \to \betam(t)→β and M(t)→αβM(t) \to \alpha\betaM(t)→αβ as t→∞t \to \inftyt→∞.
  3. For all large ttt: M(t)≥max⁡(m(t)2,C)M(t) \ge \max(m(t)^2, C)M(t)≥max(m(t)2,C), 1≤m(t)≤M(t)1 \le m(t) \le M(t)1≤m(t)≤M(t), α(m(t)−1)≤M(t)−m(t)\alpha(m(t)-1) \le M(t) - m(t)α(m(t)−1)≤M(t)−m(t).
  4. GGG is β\betaβ-competitive against oblivious adversaries in the mates game.
  5. GGG is α\alphaα-competitive against adaptive on-line adversaries in the mates game.
  6. An adaptive off-line adversary makes every algorithm pay MMM while paying 111.

Significance

The result. Together with Theorem 2.2, the claim pins down exactly how much the adaptive off-line adversary can gain over the other two: the product αβ\alpha\betaαβ is an upper bound for every game and is approached by a single game for every admissible pair (α,β)(\alpha, \beta)(α,β). It shows that no general argument relating the three adversary models can give a bound better than the product, so any improvement for a specific problem (paging, kkk-server) must use the structure of that problem. The paging example cited on p. 11 (RANDOM against the three adversaries) gives one instance of tightness; the mates game gives tightness for every admissible pair.

Formalizing it. The result is proved in the paper, in about one page, with two steps left to the reader ("by inspection of the equations", "a simple case analysis"). No machine-checked proof of this or of any statement about adaptive adversaries is known to us. The formalization makes the model of §2 precise (sequences, stopping, the order in which adversary and algorithm commit, expectations over coins), checks the asymptotics of the parameters, and verifies the case analysis, which on inspection needs an inequality the page does not state. Two printed formulas on p. 12 contain typos; the formal statements carry the correct values.

Difficulty

The construction is explicit, but each competitiveness claim quantifies over all adversaries, which may adapt their requests to the algorithm's random answers, stop at any time, and (for the on-line adversary) commit to their own answers in advance. The algebra of α\alphaα-competitiveness is tight: the adversary's best expected advantage is exactly zero, so every case of its best reply must be checked with no slack. The page's condition M≥m2M \ge m^2M≥m2 does not suffice for this: when a1a_1a1​ is neither the adversary's first answer nor its mate, the reply "mate of a1a_1a1​" beats the reply "the adversary's own answer" only when α(m−1)≤M−m\alpha(m-1) \le M - mα(m−1)≤M−m, which holds for the solved parameters but is not implied by M≥m2M \ge m^2M≥m2. At β=1<α\beta = 1 < \alphaβ=1<α the solved parameter mmm is below 111 for every ttt, and the oblivious bound fails.

Formalization scope

All declarations live in OnlineRandomization.Tightness. The conventions:

  • Costs are real-valued; the paper allows +∞+\infty+∞, so the game class is a special case.
  • Answer sets are nonempty finite types; request sets are arbitrary types.
  • Sequences are Lean lists, oldest first; cost r a is fnf_nfn​ on lists of equal length nnn.
  • Adversaries return none for "stop" and carry a depth bound dQd_QdQ​; an on-line adversary's answer bi+1b_{i+1}bi+1​ depends only on a1,…,aia_1, \dots, a_ia1​,…,ai​.
  • Randomized algorithms are a probability space of coins with a deterministic algorithm per coin and measurable answers; expectations are Bochner integrals, with α\alphaα applied inside the expectation. In the goal, coin spaces range over Type.
  • Competitiveness uses the ratio functions x↦αxx \mapsto \alpha xx↦αx and x↦βxx \mapsto \beta xx↦βx, with no additive constant.
  • The mates game is on Fin t × Bool, with mate (i,b)↦(i,¬b)(i, b) \mapsto (i, \lnot b)(i,b)↦(i,¬b). The paper leaves the costs of plays with fewer than two requests undefined; the formalization sets f0=0f_0 = 0f0​=0 and f1≡1f_1 \equiv 1f1​≡1 (with f1≡0f_1 \equiv 0f1​≡0 the algorithm would not be α\alphaα-competitive).
  • Range. The goal assumes 1<β≤α1 < \beta \le \alpha1<β≤α or α=β=1\alpha = \beta = 1α=β=1; the page's case β=1<α\beta = 1 < \alphaβ=1<α is not covered by its construction and is left out. In fact the claim is false there for 1<C<α1 < C < \alpha1<C<α: an algorithm that is 111-competitive against oblivious adversaries answers optimally, almost surely, on every request sequence (its cost is never below the optimum and its expected cost does not exceed it), and an adaptive off-line adversary reaches only finitely many request sequences, so against K=GK = GK=G every adversary has E[cG(Q)]=E[cQ(G)]\mathbb E[c_G(Q)] = \mathbb E[c_Q(G)]E[cG​(Q)]=E[cQ​(G)], a ratio of 1<C1 < C1<C.

The positivity requirement E[cQ(K)]>0\mathbb E[c_Q(K)] > 0E[cQ​(K)]>0 in the goal is essential: without it the adversary that asks nothing satisfies E[cK(Q)]≥C⋅0\mathbb E[c_K(Q)] \ge C \cdot 0E[cK​(Q)]≥C⋅0 for every KKK, and the third clause would hold vacuously.

A complete development needs: finite expectations over a uniform coin, the evaluation of the play of an adversary against a constant algorithm, and limit and eventual-inequality arguments for rational functions of ttt. The model of §2 is shared with the other missions of this series and is reusable for any request-answer formulation of an on-line problem. Proofs of individual milestones are welcome.

Selected references

  • S. Ben-David, A. Borodin, R. Karp, G. Tardos, A. Wigderson, On the power of randomization in on-line algorithms, Algorithmica 11 (1994) 2–14. https://doi.org/10.1007/BF01294260 (cited from the authors' manuscript, manuscript pp. 7–13).
  • A. Borodin, R. El-Yaniv, Online Computation and Competitive Analysis, Cambridge University Press, 1998. ISBN 0-521-56392-5.
  • P. Raghavan, M. Snir, Memory versus randomization in on-line algorithms, IBM Journal of Research and Development 38 (1994) 683–707. https://doi.org/10.1147/rd.386.0683
9 thms3 active usersReviewed
🏆Completed
Operations ResearchProbabilityTheoretical Computer Science·Captain: mikedeng1

On the Power of Randomization in On-Line Algorithms 1: α-Competitiveness Against Adaptive On-Line and β Against Oblivious Adversaries Give a Deterministic α∘β-Competitive AlgorithmResearch Paper

Why randomization matters in online algorithms

An online algorithm must answer each request before it sees the next one. Its performance is compared with an optimum that may choose all its answers after seeing the complete request string. Randomization can improve an online algorithm's guarantee when the request string is fixed in advance. The comparison changes when an adversary chooses later requests after seeing the algorithm's earlier answers. Ben-David, Borodin, Karp, Tardos and Wigderson studied these choices of adversary in a common request-answer model and proved a general relation between their competitive guarantees (Ben-David et al., 1994, manuscript §§2–3).

The paper distinguishes three adversaries. An oblivious adversary fixes the request string before the algorithm's random choices affect any answer. An adaptive off-line adversary chooses the next request from previous answers but serves the resulting request string optimally after the play. An adaptive on-line adversary also chooses its own answer as each request arrives. The ability to react to answers makes the latter two adversaries materially different from the oblivious one for randomized algorithms (Ben-David et al., 1994, manuscript pp. 7–9).

Request-answer games and competitive cost

A request-answer game has a request set RRR, a finite nonempty answer set AAA, and a real cost fn(r,a)f_n(r,a)fn​(r,a) for a request string r∈Rnr\in R^nr∈Rn and an answer string a∈Ana\in A^na∈An. The off-line optimum for rrr is c(r)=min⁡a∈Anfn(r,a)c(r)=\min_{a\in A^n}f_n(r,a)c(r)=mina∈An​fn​(r,a). A deterministic online algorithm DDD returns its iiith answer from the first iii requests alone; it has no access to the rest of rrr or to the eventual stopping time. Its cost on rrr is cD(r)=fn(r,D(r))c_D(r)=f_n(r,D(r))cD​(r)=fn​(r,D(r)).

A randomized online algorithm is a distribution over deterministic online algorithms. With coins ω\omegaω, write GωG_\omegaGω​ for the resulting deterministic algorithm. For a fixed request string rrr, GGG is β\betaβ-competitive against oblivious adversaries when Eω[cGω(r)]≤β(c(r))\mathbb E_\omega[c_{G_\omega}(r)]\leq\beta(c(r))Eω​[cGω​​(r)]≤β(c(r)). The paper calls a transformation “linear” when it has the affine form x↦ux+vx\mapsto ux+vx↦ux+v (Ben-David et al., 1994, manuscript p. 7).

An adaptive off-line adversary QQQ has a rule from prior answer strings to either the next request or a stop signal, together with a common finite upper bound on play length. Let r(Gω,Q)r(G_\omega,Q)r(Gω​,Q) denote its request string and cQ(Gω)=c(r(Gω,Q))c_Q(G_\omega)=c(r(G_\omega,Q))cQ​(Gω​)=c(r(Gω​,Q)). Its competitiveness condition places the transformation inside the expectation: Eω[cGω(Q)]≤Eω[α(cQ(Gω))]\mathbb E_\omega[c_{G_\omega}(Q)]\leq\mathbb E_\omega[\alpha(c_Q(G_\omega))]Eω​[cGω​​(Q)]≤Eω​[α(cQ​(Gω​))]. An adaptive on-line adversary SSS has the same request rule and an additional answer rule; its own cost is cS(Gω)c_S(G_\omega)cS​(Gω​), and the corresponding condition uses Eω[α(cS(Gω))]\mathbb E_\omega[\alpha(c_S(G_\omega))]Eω​[α(cS​(Gω​))] on the right (Ben-David et al., 1994, manuscript pp. 8–9).

Formalization targets

Randomization against adaptive off-line adversaries

The first target is Theorem 2.1: if some randomized algorithm is α\alphaα-competitive against every adaptive off-line adversary, a deterministic algorithm has that same guarantee on every request string:

∃G  ∀Q,E[cG(Q)]≤E[α(cQ(G))]⟹∃D  ∀r,cD(r)≤α(c(r)).\exists G\;\forall Q,\quad \mathbb E[c_G(Q)]\leq\mathbb E[\alpha(c_Q(G))]\quad\Longrightarrow\quad\exists D\;\forall r,\quad c_D(r)\leq\alpha(c(r)).∃G∀Q,E[cG​(Q)]≤E[α(cQ​(G))]⟹∃D∀r,cD​(r)≤α(c(r)).

Composition of two guarantees

Theorem 2.2 takes an α\alphaα guarantee for GGG against adaptive on-line adversaries and a β\betaβ guarantee for another randomized algorithm against oblivious adversaries. It concludes that GGG has the composed guarantee against adaptive off-line adversaries:

E[cG(Q)]≤E[(α∘β)(cQ(G))]for every Q.\mathbb E[c_G(Q)]\leq\mathbb E[(\alpha\circ\beta)(c_Q(G))]\qquad\text{for every }Q.E[cG​(Q)]≤E[(α∘β)(cQ​(G))]for every Q.

The mission goal is Corollary 2.1, the deterministic consequence of these two results:

∃D  ∀r,cD(r)≤(α∘β)(c(r)).\exists D\;\forall r,\qquad c_D(r)\leq(\alpha\circ\beta)(c(r)).∃D∀r,cD​(r)≤(α∘β)(c(r)).

The milestones follow the paper's two theorems and the stated claims in their proofs, including the finite-horizon winning-position formulation and the adversary that simulates a fixed online algorithm (Ben-David et al., 1994, manuscript pp. 9–13).

What the result supplies

The corollary turns the existence of two randomized guarantees under different information rules into the existence of a deterministic online strategy with an explicit composed cost transformation. It is an existence result: it does not say that the deterministic strategy can be computed efficiently from the randomized algorithms. The paper itself notes that such a construction is unavailable in full generality and then examines settings where constructive versions are possible (Ben-David et al., 1994, manuscript p. 13).

The mathematical results were proved in the 1994 paper; this mission asks for machine-checked Lean proofs of the abstract model, the intermediate claims, and Corollary 2.1. The local draft currently contains compiled statements with proof placeholders, so it does not yet provide checked proofs. A completed development would make the adversary distinctions and the exact placement of expectations available for reuse in later online-algorithm formalizations.

Why the proof is difficult

The apparent shortcut is to treat an adaptive request sequence as fixed and apply a guarantee against oblivious adversaries directly. That loses the dependence of later requests on the algorithm's earlier answers. For Theorem 2.1, a winning request strategy must have one finite horizon that works for every answer path; separate finite horizons for each branch do not suffice when the answer set is infinite. For Theorem 2.2, the simulated adversary must make its own answers before the algorithm answers the current request, while still matching a fixed online benchmark along every resulting play. The expectation inequalities must remain valid when the request string itself depends on the algorithm's coins (Ben-David et al., 1994, manuscript pp. 9–11).

Formalization scope

Lean represents requests and answers as oldest-first lists. List index zero is request one in the paper. The general game is a separate definition; the algorithm, adversary, and competitiveness definitions build on it. An off-line adversary's rule returns Option R, where none is the stop signal, and has a uniform finite depth bound. A randomized algorithm consists of a coin probability space and a deterministic prefix algorithm for each coin; its answer events are measurable. Finiteness of AAA and bounded play depth make the cost of each fixed adversarial play take finitely many values, so its real expectation is an ordinary integrable expectation.

The formal game uses real-valued costs, a deliberate restriction of the paper's R∪{∞}\mathbb R\cup\{\infty\}R∪{∞} costs. The answer set is finite and nonempty, while the request set may be infinite. The transformations α\alphaα and β\betaβ are affine. Theorem 2.2 and the goal assume α\alphaα is monotone: the paper applies α\alphaα to an inequality in its proof, and its competitive-ratio examples have positive slope. Theorem 2.1 does not need this added assumption. The two randomized algorithms may have different coin spaces, each an arbitrary Lean type at the declaration's universe level. The off-line and on-line adaptive comparisons retain α\alphaα inside the expectation.

The target ranges over every equal-length request and answer play generated by these rules, including an adversary that stops without a request. It does not allow the deterministic algorithm to see future requests or choose a different policy for each adversary. Reusable contributions include the game interface, bounded adaptive plays, measurable randomized algorithms, and finite-horizon winning positions. The statements of all three principal results, their intervening claims, and proofs of those statements are within scope.

Selected references

  • S. Ben-David, A. Borodin, R. Karp, G. Tardos and A. Wigderson, On the Power of Randomization in On-Line Algorithms, Algorithmica 11, 1994. DOI: 10.1007/BF01294260. The local source is the authors' 20-page manuscript; citations above use its page numbers.
11 thms3 active usersReviewed
🏆Completed
Operations ResearchProbabilityTheoretical Computer Science·Captain: mikedeng1

On the Power of Randomization in On-Line Algorithms 3: An Augmented Potential Function Yields an Explicit Deterministic α∘β-Competitive AlgorithmResearch Paper

Motivation

Competitive analysis measures an online algorithm, which must answer each request before seeing the next, against the best off-line answer to the whole request sequence. Randomized online algorithms are often much better than deterministic ones against an oblivious adversary, who fixes the requests in advance; the paging problem is the standard example. Against an adaptive adversary, who sees the algorithm's answers before choosing the next request, the advantage can disappear.

Ben-David, Borodin, Karp, Tardos and Wigderson (Algorithmica 11, 1994; preliminary version STOC 1990) made this precise in an abstract framework of request-answer games. Their Corollary 2.1 says: if a game has a randomized algorithm that is α\alphaα-competitive against adaptive on-line adversaries and one that is β\betaβ-competitive against oblivious adversaries, then it has a deterministic α∘β\alpha\circ\betaα∘β-competitive algorithm. That proof is non-constructive: it goes through a game-theoretic determinacy argument. Section 3 of the paper gives a constructive version. Most competitive analyses of randomized algorithms against adaptive adversaries are carried out with a potential function, in the style of Manasse, McGeoch and Sleator (J. Algorithms 11, 1990). The paper shows that such a potential function, together with any oblivious-competitive algorithm HHH, determines an explicit deterministic algorithm MMM, answer by answer. This mission formalizes that construction and its guarantee.

Setting

A request-answer game has a request set RRR, a finite answer set AAA and cost functions fn:Rn×An→Rf_n : R^n \times A^n \to \mathbb Rfn​:Rn×An→R. The off-line optimum of r∈Rnr \in R^nr∈Rn is c(r)=min⁡a∈Anfn(r,a)c(r) = \min_{a \in A^n} f_n(r, a)c(r)=mina∈An​fn​(r,a). A deterministic online algorithm MMM is a sequence of maps mi:Ri→Am_i : R^i \to Ami​:Ri→A; on r=(r1,…,rn)r = (r_1,\dots,r_n)r=(r1​,…,rn​) it answers M(r)=(m1(r1),m2(r1,r2),…,mn(r))M(r) = (m_1(r_1), m_2(r_1,r_2), \dots, m_n(r))M(r)=(m1​(r1​),m2​(r1​,r2​),…,mn​(r)), at cost cM(r)=fn(r,M(r))c_M(r) = f_n(r, M(r))cM​(r)=fn​(r,M(r)). It is α\alphaα-competitive if cM(r)≤α(c(r))c_M(r) \le \alpha(c(r))cM​(r)≤α(c(r)) for all rrr. Throughout, α\alphaα and β\betaβ are affine maps R→R\mathbb R \to \mathbb RR→R (the paper's "linear functions").

A randomized online algorithm HHH is a probability distribution over deterministic algorithms HyH_yHy​; it is β\betaβ-competitive against any oblivious adversary if Ey[fn(r,Hy(r))]≤β(c(r))\mathbb E_y[f_n(r, H_y(r))] \le \beta(c(r))Ey​[fn​(r,Hy​(r))]≤β(c(r)) for all rrr. The algorithm GGG analysed by the potential function is described by its next-answer laws gn+1(rrn+1,a)g_{n+1}(r r_{n+1}, a)gn+1​(rrn+1​,a) on AAA, given the requests so far, the new request and its own past answers. An adaptive on-line adversary SSS chooses each request from the algorithm's past answers and answers it itself, before the algorithm does, for at most dQd_QdQ​ rounds; a configuration after nnn rounds is (r,a,b)∈Rn×An×An(r, a, b) \in R^n \times A^n \times A^n(r,a,b)∈Rn×An×An: requests, algorithm's answers, adversary's answers.

An augmented potential function for α\alphaα and GGG (Definition 3.1) is a family Φn:Rn×An×An→R\Phi_n : R^n \times A^n \times A^n \to \mathbb RΦn​:Rn×An×An→R with (1) Φ0=0\Phi_0 = 0Φ0​=0; (2) Φn(r,a,b)≤α(fn(r,b))−fn(r,a)\Phi_n(r,a,b) \le \alpha(f_n(r,b)) - f_n(r,a)Φn​(r,a,b)≤α(fn​(r,b))−fn​(r,a) for every configuration; (3) Ean+1∼gn+1(rrn+1,a)[Φn+1(rrn+1,aan+1,bbn+1)]≥Φn(r,a,b)\mathbb E_{a_{n+1} \sim g_{n+1}(r r_{n+1}, a)}[\Phi_{n+1}(r r_{n+1}, a a_{n+1}, b b_{n+1})] \ge \Phi_n(r,a,b)Ean+1​∼gn+1​(rrn+1​,a)​[Φn+1​(rrn+1​,aan+1​,bbn+1​)]≥Φn​(r,a,b) for every configuration, every rn+1∈Rr_{n+1} \in Rrn+1​∈R and every bn+1∈Ab_{n+1} \in Abn+1​∈A.

Formalization targets

Goal: Theorem 3.1 (p. 15)

Let Φ\PhiΦ be an augmented potential function for α\alphaα and GGG, and HHH a β\betaβ-competitive algorithm against oblivious adversaries. Say that MMM obeys the potential rule if for every r∈Rnr \in R^nr∈Rn and r′=rtr' = rtr′=rt,

Ey[Φn+1(r′,M(r) mn+1(r′),Hy(r′))] ≥ Ey[Φn(r,M(r),Hy(r))].\mathbb E_y\big[\Phi_{n+1}(r', M(r)\,m_{n+1}(r'), H_y(r'))\big] \ \ge\ \mathbb E_y\big[\Phi_n(r, M(r), H_y(r))\big].Ey​[Φn+1​(r′,M(r)mn+1​(r′),Hy​(r′))] ≥ Ey​[Φn​(r,M(r),Hy​(r))].

Then such an MMM exists, and every such MMM satisfies

cM(r)≤α(β(c(r)))for all r.c_M(r) \le \alpha\big(\beta(c(r))\big) \quad \text{for all } r .cM​(r)≤α(β(c(r)))for all r.

Both parts are part of the goal: the rule can be followed, and following it guarantees α∘β\alpha\circ\betaα∘β-competitiveness.

Milestones

  1. In every play of GGG against an adaptive on-line adversary, the expected final potential is nonnegative (proof of Lemma 3.1).
  2. Lemma 3.1, "if" direction: an augmented potential function for α\alphaα and GGG makes GGG α\alphaα-competitive against any adaptive on-line adversary, E[cG(S)]≤E[α(cS(G))]\mathbb E[c_G(S)] \le \mathbb E[\alpha(c_S(G))]E[cG​(S)]≤E[α(cS​(G))].
  3. For every rrr, ttt and every a∈Ana \in A^na∈An, some a′∈Aa' \in Aa′∈A satisfies Ey[Φn+1(rt,aa′,Hy(rt))]≥Ey[Φn(r,a,Hy(r))]\mathbb E_y[\Phi_{n+1}(rt, aa', H_y(rt))] \ge \mathbb E_y[\Phi_n(r, a, H_y(r))]Ey​[Φn+1​(rt,aa′,Hy​(rt))]≥Ey​[Φn​(r,a,Hy​(r))].
  4. If MMM obeys the rule, Ey[Φn(r,M(r),Hy(r))]≥0\mathbb E_y[\Phi_n(r, M(r), H_y(r))] \ge 0Ey​[Φn​(r,M(r),Hy​(r))]≥0 for every rrr.
  5. If MMM obeys the rule, fn(r,M(r))≤Ey[α(fn(r,Hy(r)))]f_n(r, M(r)) \le \mathbb E_y[\alpha(f_n(r, H_y(r)))]fn​(r,M(r))≤Ey​[α(fn​(r,Hy​(r)))] for every rrr: MMM is α\alphaα-competitive against the randomized adaptive adversary that serves its requests with HHH.

Significance

The theorem turns two separate analyses into one deterministic algorithm with an explicit description. The potential function certifies GGG against the strongest on-line adversary; the oblivious algorithm HHH need not be related to GGG, and the paper remarks that HHH may be GGG itself. The next answer of MMM is computable whenever the expected potential under HHH is (Corollary 3.1, stated informally in the paper), and the paper notes that for the potential functions used in the KKK-server literature this expectation is computable in time polynomial in the number of nodes and KKK. Read in this light, a potential-function proof for a randomized algorithm doubles as a deterministic algorithm.

The result is proved in the paper. As far as is known, neither this theorem nor the abstract framework of request-answer games with adaptive adversaries has a machine-checked formalization. The mission produces that framework and a checked derandomization principle that applies to every request-answer game with real costs, not to one problem.

Difficulty

The obvious argument for the existence of mn+1(r′)m_{n+1}(r')mn+1​(r′) averages property (3) of Φ\PhiΦ; the work is in seeing which configuration to apply it to. The rule compares MMM's configuration against HyH_yHy​'s answers, not against an adversary playing GGG, and the paper argues through an auxiliary on-line adversary that asks r′r'r′ and serves it with HyH_yHy​. Making this rigorous requires interchanging the expectation over HHH's coins with the finite expectation over GGG's next answer, and checking that the needed expectations are finite.

The second difficulty is the two kinds of randomness. GGG enters only through its next-answer laws, while HHH must be a single distribution over deterministic algorithms: the rule evaluates Hy(r)H_y(r)Hy​(r) and Hy(r′)H_y(r')Hy​(r′) with the same coins yyy. Replacing HHH by a behavioural description breaks the coupling between consecutive rounds.

Formalization scope

Requests and answers are Lean lists, oldest first, and fn(r,a)f_n(r,a)fn​(r,a) is F.cost r a on lists of common length; values on lists of different lengths are never used. Costs are real: the paper allows fn=+∞f_n = +\inftyfn​=+∞, so every statement here is about the real-valued games. The answer type is finite and nonempty, so the minimum c(r)c(r)c(r) exists. Affine maps are written α(x)=cx+d\alpha(x) = c x + dα(x)=cx+d. The goal additionally assumes α\alphaα nondecreasing: the last step of the paper's proof applies α\alphaα to an inequality, which needs it, and the paper's examples are positive ratios. In Lemma 3.1 and milestone 5 linearity of α\alphaα is kept as the paper's standing convention, although with α\alphaα inside the expectation the argument does not use it.

GGG is a map from (requests, own answers) to a probability mass function on AAA (behavioural form); its play against an adaptive on-line adversary is a probability mass function on final configurations, with finite support, and its expectations are finite sums. HHH is a probability measure on a coin space with a deterministic algorithm per coin, each answer measurable in the coins; expectations over HHH are Bochner integrals of functions with finitely many values. α\alphaα stays inside expectations, as in the paper's definition of competitiveness against adaptive adversaries. Adversaries stop by returning none and have a uniform depth bound.

The goal cannot be satisfied vacuously: it states the existence of an algorithm obeying the rule alongside the guarantee for every such algorithm, and Definition 3.1 is required at every configuration, not only at reachable ones.

Not formalized: the "only if" direction of Lemma 3.1, which the paper only sketches, and Corollary 3.1, whose notion of computability the paper leaves unspecified. The definitions of request-answer games, online algorithms, adversaries and competitiveness are reusable for the other missions of this paper and for any problem-specific competitive analysis. Contributions welcome: proofs of the milestones, and a lemma relating the mixed and behavioural forms of a randomized algorithm.

Selected references

  • S. Ben-David, A. Borodin, R. Karp, G. Tardos, A. Wigderson, On the power of randomization in on-line algorithms, Algorithmica 11 (1994), 2–14. https://doi.org/10.1007/BF01294260
  • M. Manasse, L. McGeoch, D. Sleator, Competitive algorithms for server problems, Journal of Algorithms 11 (1990), 208–230. https://doi.org/10.1016/0196-6774(90)90003-W
  • D. Sleator, R. Tarjan, Amortized efficiency of list update and paging rules, Communications of the ACM 28 (1985), 202–208. https://doi.org/10.1145/2786.2793
  • A. Borodin, R. El-Yaniv, Online Computation and Competitive Analysis, Cambridge University Press, 1998. ISBN 0-521-56392-5
9 thms3 active usersReviewed
🏆Completed
Operations ResearchTheoretical Computer Science·Captain: mikedeng1

On the Power of Randomization in On-Line Algorithms 4: Restarting a Bounded-Cost Algorithm Is (1+ε)α-Competitive in Games of Finite DiameterResearch Paper

Motivation

Competitive analysis compares an online algorithm, which must answer each request before seeing the next, with the optimal off-line solution of the same request sequence. Ben-David, Borodin, Karp, Tardos and Wigderson (Algorithmica 11, 1994) set up a general framework, request-answer games, in which paging, the KKK-server problem and metrical task systems are all instances, and used it to compare the power of randomized algorithms against several kinds of adversaries.

One of their results (Theorem 2.1) says that if a randomized algorithm is α\alphaα-competitive against every adaptive off-line adversary, then some deterministic algorithm is already α\alphaα-competitive. The argument is a game-theoretic existence proof: it says nothing about how to compute the deterministic algorithm. Section 4 of the paper, "A Constructive Version of Theorem 2.1", answers the natural follow-up question for a large class of games: under monotonicity, locality and a finite diameter, a deterministic algorithm that loses only a factor 1+ϵ1+\epsilon1+ϵ can be assembled from a finite object.

Setting

A request-answer game FFF has a request set RRR, a finite answer set AAA, and cost functions fn:Rn×An→Rf_n : R^n \times A^n \to \mathbb{R}fn​:Rn×An→R, n≥0n \ge 0n≥0; f0f_0f0​ is the cost of the empty play. The off-line optimum of a request sequence rrr of length nnn is c(r)=min⁡a∈Anfn(r,a)c(r) = \min_{a \in A^n} f_n(r, a)c(r)=mina∈An​fn​(r,a). A deterministic online algorithm GGG answers the iii-th request by a function gi(r1,…,ri)g_i(r_1, \dots, r_i)gi​(r1​,…,ri​) of the requests so far; its cost on rrr is cG(r)=fn(r,G(r))c_G(r) = f_n(r, G(r))cG​(r)=fn​(r,G(r)). It is α\alphaα-competitive if cG(r)≤α(c(r))c_G(r) \le \alpha(c(r))cG​(r)≤α(c(r)) for every rrr.

The game is monotone if fn+1(rt,ab)≥fn(r,a)f_{n+1}(rt, ab) \ge f_n(r, a)fn+1​(rt,ab)≥fn​(r,a) always, and local if for every h>0h > 0h>0 only finitely many request sequences have c(r)≤hc(r) \le hc(r)≤h. The discrepancy of two request-answer sequences is

δ((r,a),(r′,a′))=f(rr′,aa′)−f(r,a)−f(r′,a′),\delta((r,a),(r',a')) = f(rr', aa') - f(r,a) - f(r',a'),δ((r,a),(r′,a′))=f(rr′,aa′)−f(r,a)−f(r′,a′),

and the diameter D(F)D(F)D(F) is the supremum of ∣δ∣|\delta|∣δ∣ over all pairs.

For a real HHH, the set RHR_HRH​ consists of the request sequences all of whose proper prefixes have off-line optimum at most HHH. Given a deterministic algorithm AHA_HAH​, the restart algorithm simulates AHA_HAH​ and, as soon as the request sequence leaves RHR_HRH​, starts over as if it had received no previous requests. This cuts every request sequence into segments r=r(1) r(2)⋯r(t)r = r(1)\, r(2) \cdots r(t)r=r(1)r(2)⋯r(t), each a longest prefix in RHR_HRH​ of what remains.

Formalization targets

Goal: Theorem 4.1 through its construction

Let FFF be monotone and local, with finite nonempty RRR and AAA, f0≥0f_0 \ge 0f0​≥0, and diameter at most DDD. Let α(x)=d x\alpha(x) = d\,xα(x)=dx with d≥1d \ge 1d≥1, ϵ>0\epsilon > 0ϵ>0, and

H=(2+ϵ)Dϵ.H = \frac{(2+\epsilon) D}{\epsilon}.H=ϵ(2+ϵ)D​.

Then RHR_HRH​ is finite; the restart algorithm depends on AHA_HAH​ only through its values on RHR_HRH​; and for every AHA_HAH​ with cAH(r)≤α(c(r))c_{A_H}(r) \le \alpha(c(r))cAH​​(r)≤α(c(r)) on RHR_HRH​,

cRestart(r)≤(1+ϵ) α(c(r))for all request sequences r.c_{\mathrm{Restart}}(r) \le (1+\epsilon)\,\alpha(c(r)) \qquad \text{for all request sequences } r.cRestart​(r)≤(1+ϵ)α(c(r))for all request sequences r.

Milestones (proof of Theorem 4.1, pp. 17–18)

  1. RHR_HRH​ is finite.
  2. The restart rule produces the greedy decomposition into longest prefixes in RHR_HRH​.
  3. The restart algorithm answers AH(r(1)),AH(r(2)),…,AH(r(t))A_H(r(1)), A_H(r(2)), \dots, A_H(r(t))AH​(r(1)),AH​(r(2)),…,AH​(r(t)).
  4. c(r(i))≥Hc(r(i)) \ge Hc(r(i))≥H for i=1,…,t−1i = 1, \dots, t-1i=1,…,t−1.
  5. c(r)≥c(r(1))+∑i=2t(c(r(i))−D(F))c(r) \ge c(r(1)) + \sum_{i=2}^{t} (c(r(i)) - D(F))c(r)≥c(r(1))+∑i=2t​(c(r(i))−D(F)).
  6. cRestart(r)≤α(c(1))+∑i=2t(α(c(i))+D(F))c_{\mathrm{Restart}}(r) \le \alpha(c(1)) + \sum_{i=2}^{t} (\alpha(c(i)) + D(F))cRestart​(r)≤α(c(1))+∑i=2t​(α(c(i))+D(F)).

Significance

Theorem 2.1 shows that, against adaptive off-line adversaries, randomization gives no advantage, but only as an existence statement. Theorem 4.1 turns it into a recipe: a deterministic algorithm need only be good on the finite set RHR_HRH​, which can be prepared in advance, and restarting extends it to all inputs at a loss of 1+ϵ1+\epsilon1+ϵ. The paper illustrates this with KKK-server problems on finite graphs, where AHA_HAH​ is a finite table and each step of the resulting algorithm costs one dynamic-programming evaluation of an off-line optimum.

The restart construction is of independent use: it is a general way to turn a guarantee on bounded-cost inputs into a guarantee on all inputs when the cost is nearly additive over concatenation.

To our knowledge neither the abstract request-answer game model nor this theorem has a machine-checked proof. The mission produces a formal model of request-answer games with the monotonicity, locality and diameter conditions, the restart algorithm as an explicit definition, and the full chain of inequalities of the proof.

Difficulty

The individual inequalities are elementary; the work lies in the bookkeeping of the construction. The algorithm is defined online, one request at a time, while the analysis is phrased through the decomposition of the whole sequence. Relating the two requires showing that the online rule produces exactly the decomposition into longest prefixes in RHR_HRH​, and that the answers produced on each segment are those of AHA_HAH​ run from scratch, so that the cost of the whole play can be compared with the costs on the segments. The constants must close exactly: with H=(2+ϵ)D/ϵH = (2+\epsilon)D/\epsilonH=(2+ϵ)D/ϵ the additive losses at the t−1t-1t−1 cuts, on both the algorithm's side and the optimum's side, must be absorbed by the factor 1+ϵ1+\epsilon1+ϵ, and they do so only for ratios d≥1d \ge 1d≥1.

A tempting shortcut is to conclude Theorem 4.1 from Theorem 2.1 directly: a deterministic α\alphaα-competitive algorithm is trivially (1+ϵ)α(1+\epsilon)\alpha(1+ϵ)α-competitive when costs are nonnegative. This proves the sentence of the theorem without its point, and is ruled out below.

Formalization scope

  • Request and answer sequences are Lean Lists, oldest first; fn(r,a)f_n(r,a)fn​(r,a) is F.cost r a with r.length = a.length. Costs are real-valued (the paper allows +∞+\infty+∞; real costs are a special case).
  • The answer set is a Fintype and nonempty; in the goal the request set is a Fintype and nonempty.
  • A deterministic algorithm is one function List R → A. Competitiveness of a deterministic algorithm against adaptive off-line adversaries is stated as competitiveness on every request sequence, which is equivalent for deterministic algorithms (p. 8).
  • Finite diameter is a real bound DDD with ∣δ∣≤D|\delta| \le D∣δ∣≤D for all pairs, and every statement holds for every such DDD, in particular D=D(F)D = D(F)D=D(F); no real supremum is taken.
  • f0≥0f_0 \ge 0f0​≥0 is assumed in the goal; with monotonicity it makes every cost nonnegative. It holds in the paper's examples.
  • α(x)=d x\alpha(x) = d\,xα(x)=dx with d≥1d \ge 1d≥1 in the goal; the cost bound for the restart algorithm (milestone 6) holds for an arbitrary α\alphaα.
  • HHH is fixed to the paper's value (2+ϵ)D/ϵ(2+\epsilon)D/\epsilon(2+ϵ)D/ϵ.
  • The restart algorithm is a definition (a left fold over the requests), not a hypothesis. The paper's assumption of a randomized algorithm competitive against adaptive off-line adversaries is used only, through Theorem 2.1, to obtain AHA_HAH​; the goal quantifies over every AHA_HAH​ that is α\alphaα-competitive on RHR_HRH​. "Computable" has no precise meaning for real costs; its content is the finiteness of RHR_HRH​ together with the fact that the restart algorithm reads AHA_HAH​ only on RHR_HRH​. A formalization that proves only the existence of a deterministic (1+ϵ)α(1+\epsilon)\alpha(1+ϵ)α-competitive algorithm, without the construction, does not meet the goal.
  • Milestones 5 and 6 are stated for nonempty request sequences, so that t≥1t \ge 1t≥1; milestone 5 is stated for every decomposition into consecutive pieces.

Contributions welcome: proofs of the milestones, and a connection to the other missions of this series, where the randomized model and Theorem 2.1 are formalized.

Selected references

  • S. Ben-David, A. Borodin, R. Karp, G. Tardos, A. Wigderson, On the power of randomization in on-line algorithms, Algorithmica 11 (1994). https://doi.org/10.1007/BF01294260
  • M. Chrobak, H. Karloff, T. Payne, S. Vishwanathan, New results on server problems, SIAM Journal on Discrete Mathematics 4 (1991), 172–181. https://doi.org/10.1137/0404017
10 thms3 active usersReviewed
🏆Completed
CombinatoricsOperations ResearchTheoretical Computer Science·Captain: mikedeng1

The Online Set Cover Problem 1: A Deterministic O(log m log n)-Competitive Algorithm for Unweighted Online Set CoverResearch Paper

Motivation

Set cover asks for the fewest sets from a family S\mathcal SS of mmm subsets of a ground set XXX of nnn elements whose union contains XXX. It is NP-hard, and the best ratio achievable in polynomial time is Θ(log⁡n)\Theta(\log n)Θ(logn) (Feige 1998, doi:10.1145/285055.285059).

Alon, Awerbuch, Azar, Buchbinder and Naor (SIAM J. Comput. 39(2), 2009; preliminary version STOC 2003) introduced an online version. The instance (X,S)(X,\mathcal S)(X,S) is known in advance, but an adversary reveals elements one at a time, and each revealed element must be covered at once, by sets that can never be removed later. The set X′⊆XX'\subseteq XX′⊆X of elements that will actually be revealed is unknown. The paper's motivating example is a network of servers: the potential clients and the servers that can serve each client are known, but which clients will request service is not, and every activated server costs money.

The question is how much an algorithm loses against an offline adversary who knows X′X'X′ and covers it with a family COPT\mathcal C_{OPT}COPT​. This mission formalizes the paper's answer for unit costs (Section 2): a deterministic algorithm whose cover is within a factor O(log⁡mlog⁡n)O(\log m\log n)O(logmlogn) of ∣COPT∣|\mathcal C_{OPT}|∣COPT​∣. Section 3 of the paper extends the algorithm to weighted sets and Section 4 proves a nearly matching lower bound; those are separate missions of this series.

Setting

An instance consists of a finite ground set XXX with n=∣X∣n=|X|n=∣X∣ elements and a finite family S\mathcal SS of m=∣S∣m=|\mathcal S|m=∣S∣ sets. For an element jjj, Sj\mathcal S_jSj​ is the collection of sets containing jjj. Every set has cost 111, so the cost of a family is its number of members.

The adversary gives a sequence σ\sigmaσ of elements (the given elements form X′X'X′). A family COPT⊆S\mathcal C_{OPT}\subseteq\mathcal SCOPT​⊆S covers σ\sigmaσ if each element of σ\sigmaσ lies in some member of it.

The algorithm keeps a weight wS>0w_S>0wS​>0 for every set, initially wS=1/(2m)w_S=1/(2m)wS​=1/(2m), and a cover C\mathcal CC, initially empty. The weight of an element is wj=∑S∈SjwSw_j=\sum_{S\in\mathcal S_j}w_Swj​=∑S∈Sj​​wS​, and CCC is the set of elements covered by members of C\mathcal CC. The potential is

Φ=∑j∉Cn2wj.\Phi=\sum_{j\notin C}n^{2w_j}.Φ=j∈/C∑​n2wj​.

When the adversary gives an element jjj:

  1. if wj≥1w_j\ge1wj​≥1, nothing changes;
  2. otherwise a weight augmentation is performed: (a) kkk is the minimal integer with 2kwj>12^k w_j>12kwj​>1; (b) every S∈SjS\in\mathcal S_jS∈Sj​ gets the weight 2kwS2^k w_S2kwS​; (c) at most 4log⁡n4\log n4logn sets from Sj\mathcal S_jSj​ are added to C\mathcal CC, so that Φ\PhiΦ does not exceed its value before the augmentation.

Step (c) prescribes a property of the chosen sets, not the sets themselves. A run on σ\sigmaσ is any sequence of iterations, one per arrival, in which every iteration makes an admissible choice.

Formalization targets

Goal: Theorem 2.3

For n≥2n\ge2n≥2, every arrival sequence σ\sigmaσ, and every family COPT\mathcal C_{OPT}COPT​ covering σ\sigmaσ: a run of the algorithm on σ\sigmaσ exists, and every run ends with a cover C\mathcal CC that covers every element of σ\sigmaσ and satisfies

∣C∣  ≤  ⌈4ln⁡n⌉⋅∣COPT∣⋅(log⁡2m+2).|\mathcal C|\;\le\;\lceil 4\ln n\rceil\cdot|\mathcal C_{OPT}|\cdot(\log_2 m+2).∣C∣≤⌈4lnn⌉⋅∣COPT​∣⋅(log2​m+2).

The paper states ∣C∣=O(∣COPT∣log⁡mlog⁡n)|\mathcal C|=O(|\mathcal C_{OPT}|\log m\log n)∣C∣=O(∣COPT​∣logmlogn); the displayed bound is the constant its proof produces. Because the bound holds for every covering family, it holds in particular for an optimal one.

Milestones

Lemma 2.1. In every run, the number of iterations with a weight augmentation is at most

∣COPT∣⋅(log⁡2m+2).|\mathcal C_{OPT}|\cdot(\log_2 m+2).∣COPT​∣⋅(log2​m+2).

Lemma 2.2. In an iteration with a weight augmentation, from a state with positive weights, there is a family F⊆SjF\subseteq\mathcal S_jF⊆Sj​ with ∣F∣≤⌈4ln⁡n⌉|F|\le\lceil4\ln n\rceil∣F∣≤⌈4lnn⌉ such that

Φe≤Φs,\Phi_e\le\Phi_s,Φe​≤Φs​,

where Φs\Phi_sΦs​ is the potential before the iteration and Φe\Phi_eΦe​ the potential after it, computed with the augmented weights and the cover C∪F\mathcal C\cup FC∪F.

Significance

The theorem shows that online set cover over a known instance admits a deterministic O(log⁡mlog⁡n)O(\log m\log n)O(logmlogn)-competitive algorithm. Section 4 of the paper shows this is nearly optimal: no deterministic algorithm achieves o ⁣(log⁡mlog⁡nlog⁡log⁡m+log⁡log⁡n)o\!\left(\frac{\log m\log n}{\log\log m+\log\log n}\right)o(loglogm+loglognlogmlogn​) over a wide range of parameters. Its multiplicative weight updates were developed further into the online primal–dual framework for covering problems of Buchbinder and Naor (FnT TCS 3(2–3), 2009), whose Section 5.1 restates this algorithm.

The result is proved in the paper; it is not machine-checked. The Prove2Me platform has the weighted version's final counting step from the Buchbinder–Naor monograph, but no statement of Section 2. A complete development here gives a checked proof of the unweighted competitive ratio with an explicit constant, together with a reusable formal model of an online algorithm with a nondeterministic step, whose correctness includes the existence of an admissible choice at every step.

Difficulty

The central step is Lemma 2.2: a family of at most ⌈4ln⁡n⌉\lceil4\ln n\rceil⌈4lnn⌉ sets that keeps the potential from increasing must exist at every augmentation. The obvious rules fail. Adding every set of Sj\mathcal S_jSj​ can exceed the cardinality bound, since Sj\mathcal S_jSj​ may contain up to mmm sets. Adding nothing, or a single set, can increase Φ\PhiΦ: every uncovered element sharing a set with jjj has its weight raised, and its term n2wn^{2w}n2w grows by a factor up to n2δn^{2\delta}n2δ. The paper's argument is non-constructive, and a formal proof must establish existence for a finite averaging statement over real powers of nnn.

The second difficulty is that the algorithm is nondeterministic. A statement "every run has property P" is empty if no run exists, and the existence of a run is exactly Lemma 2.2 applied at every step under the invariants that weights stay positive and that each arriving element lies in some set. Feasibility (that every given element ends up covered) is not part of the algorithm's rule; it follows from the potential never increasing, which needs n≥2n\ge2n≥2 and a careful treatment of the initial potential, which is at most n2n^2n2 and equals n2n^2n2 when every element lies in every set.

Formalization scope

The instance is the published OnlinePrimalDual.OnlineSetCover.SetCoverInstance (finite types E of elements and T of set indices, incidence elemSets), with the published elementWeight (wjw_jwj​) and coveredBy (j∈Cj\in Cj∈C). Its positive cost field is not used: all sets have unit cost and the cover is measured by its cardinality. n=∣E∣n=|E|n=∣E∣ and m=∣T∣m=|T|m=∣T∣. Weights are real numbers; n2wjn^{2w_j}n2wj​ is the real power.

The algorithm is the definition OnlineSetCover.Unweighted.Algorithm: a relation Step for one iteration (recording whether a weight augmentation occurred) and Run for a sequence of iterations from the initial state, counting augmentations. Arrival sequences are lists and may repeat elements.

Explicit forms of the paper's asymptotic and unspecified quantities:

  • the paper's "4log⁡n4\log n4logn" sets per augmentation is ⌈4ln⁡n⌉\lceil 4\ln n\rceil⌈4lnn⌉ (natural logarithm, rounded up: the proof repeats a random choice that many times and needs (1−δ/2)4log⁡n≤n−2δ(1-\delta/2)^{4\log n}\le n^{-2\delta}(1−δ/2)4logn≤n−2δ);
  • Lemma 2.1's log⁡m+2\log m+2logm+2 is log⁡2m+2=log⁡2(4m)\log_2 m+2=\log_2(4m)log2​m+2=log2​(4m) (weights grow from 1/(2m)1/(2m)1/(2m) to at most 222 by factors at least 222);
  • Theorem 2.3's O(∣COPT∣log⁡mlog⁡n)O(|\mathcal C_{OPT}|\log m\log n)O(∣COPT​∣logmlogn) is ⌈4ln⁡n⌉⋅∣COPT∣⋅(log⁡2m+2)\lceil4\ln n\rceil\cdot|\mathcal C_{OPT}|\cdot(\log_2 m+2)⌈4lnn⌉⋅∣COPT​∣⋅(log2​m+2);
  • kkk ranges over natural numbers; for wj<1w_j<1wj​<1 the minimal integer with 2kwj>12^kw_j>12kwj​>1 is one;
  • the paper's remark "(Clearly, 2k⋅wj<22^k\cdot w_j<22k⋅wj​<2.)" is not encoded; the correct bound is ≤2\le2≤2 (wj=1/2w_j=1/2wj​=1/2 gives k=2k=2k=2) and is not a hypothesis anywhere.

The goal adds the hypothesis n≥2n\ge2n≥2, which the paper's log⁡n\log nlogn assumes tacitly: for n=1n=1n=1 no set may be added and the element is never covered.

Replacing the algorithm by the set of states whose potential is at most the initial one, or dropping the existence of a run from the goal, gives a weaker theorem; part (a) of the goal rules this out.

A complete development needs elementary real analysis (Real.rpow, Real.log, 1−x≤e−x1-x\le e^{-x}1−x≤e−x), a finite probabilistic or averaging argument for Lemma 2.2, and induction over runs. Contributions are welcome on any milestone; a derandomized averaging lemma for Lemma 2.2 would be reusable in the weighted mission of this series.

Selected references

  • N. Alon, B. Awerbuch, Y. Azar, N. Buchbinder, J. Naor, The Online Set Cover Problem, SIAM J. Comput. 39(2):361–370, 2009. https://doi.org/10.1137/060661946
  • U. Feige, A Threshold of ln n for Approximating Set Cover, J. ACM 45(4):634–652, 1998. https://doi.org/10.1145/285055.285059
  • N. Buchbinder, J. Naor, The Design of Competitive Online Algorithms via a Primal–Dual Approach, Foundations and Trends in Theoretical Computer Science 3(2–3):93–263, 2009. https://doi.org/10.1561/0400000024
7 thms2 active usersReviewed
🏆Completed
CombinatoricsOperations ResearchTheoretical Computer Science·Captain: mikedeng1

The Online Set Cover Problem 3: Every Deterministic Online Algorithm Has Competitive Ratio at Least kr on the Block FamilyResearch Paper

Motivation

In the online set cover problem of Alon, Awerbuch, Azar, Buchbinder and Naor (SIAM J. Comput. 2009; preliminary version STOC 2003), a ground set and a family of subsets are known in advance, but the elements that actually need covering arrive one at a time, and each must be covered on arrival by sets chosen irrevocably. The paper's motivating example is a network of servers with activation costs: the set of potential clients is known, the clients that actually request service are not, and each request must be served on arrival.

The paper gives a deterministic online algorithm whose cost is within a factor O(log⁡mlog⁡n)O(\log m \log n)O(logmlogn) of the offline optimum, where nnn is the number of elements and mmm the number of sets. Its Section 4 shows that this is close to optimal for deterministic algorithms: for all interesting values of mmm and nnn, every deterministic online algorithm has competitive ratio Ω(log⁡nlog⁡m/(log⁡log⁡m+log⁡log⁡n))\Omega\big(\log n \log m / (\log\log m + \log\log n)\big)Ω(lognlogm/(loglogm+loglogn)). The lower bound is the reason the log⁡mlog⁡n\log m \log nlogmlogn product, rather than the ln⁡n\ln nlnn of offline approximation (Feige 1998), is the right target online. The online primal–dual framework that grew out of this paper (Buchbinder and Naor 2009) cites it as the benchmark for online covering problems.

This mission formalizes the exact, non-asymptotic statements behind that lower bound: Propositions 4.1 and 4.2 of the paper.

Setting

A ground set XXX and a family F\mathcal FF of distinct subsets of XXX are fixed and known to the algorithm; m=∣F∣m = |\mathcal F|m=∣F∣. An adversary presents elements x1,x2,…x_1, x_2, \dotsx1​,x2​,… of XXX one by one, choosing each after seeing the algorithm's previous responses. A deterministic online algorithm AAA, on the arrival of xtx_txt​, sees the earlier arrivals (x1,…,xt−1)(x_1, \dots, x_{t-1})(x1​,…,xt−1​) and xtx_txt​, and adds a finite family A((x1,…,xt−1),xt)⊆FA\big((x_1,\dots,x_{t-1}), x_t\big) \subseteq \mathcal FA((x1​,…,xt−1​),xt​)⊆F of sets to its collection; sets are never removed. It is valid if after every arrival that lies in some member of F\mathcal FF, that element lies in a chosen set. After an arrival sequence σ\sigmaσ the chosen collection is CA(σ)\mathcal C_A(\sigma)CA​(σ), and since every set has unit cost, the cost is ∣CA(σ)∣|\mathcal C_A(\sigma)|∣CA​(σ)∣. The offline optimum OPT(σ)\mathrm{OPT}(\sigma)OPT(σ) is the least number of members of F\mathcal FF covering the elements of σ\sigmaσ. The competitive ratio of AAA is at least ρ\rhoρ when some arrival sequence σ\sigmaσ has OPT(σ)≥1\mathrm{OPT}(\sigma) \ge 1OPT(σ)≥1 and ∣CA(σ)∣≥ρ OPT(σ)|\mathcal C_A(\sigma)| \ge \rho\,\mathrm{OPT}(\sigma)∣CA​(σ)∣≥ρOPT(σ).

Two families are used.

  • The bit family: X={0,…,2k−1}X = \{0, \dots, 2^k - 1\}X={0,…,2k−1} and Fi={j:bit i of j is on}F_i = \{ j : \text{bit } i \text{ of } j \text{ is on}\}Fi​={j:bit i of j is on} for 1≤i≤k1 \le i \le k1≤i≤k.
  • The block family: kr2k r^2kr2 disjoint blocks X1,…,Xkr2X_1, \dots, X_{kr^2}X1​,…,Xkr2​ of 2k2^k2k elements each; Xb(t)X_b(t)Xb​(t) is the set of elements of block XbX_bXb​ whose tttth bit is on. For an rrr-set R={b1<⋯<br}R = \{b_1 < \dots < b_r\}R={b1​<⋯<br​} of blocks and bit locations I=(i1,…,ir)I = (i_1, \dots, i_r)I=(i1​,…,ir​),
FR,I=⋃t=1rXbt(it),F_{R,I} = \bigcup_{t=1}^r X_{b_t}(i_t),FR,I​=t=1⋃r​Xbt​​(it​),

and the family consists of all FR,IF_{R,I}FR,I​; it has m=(kr2r)krm = \binom{kr^2}{r} k^rm=(rkr2​)kr members.

Formalization targets

Goal: Proposition 4.2

For all positive integers k,rk, rk,r and all n,mn, mn,m with

n≥2k+1kr2,22kkr2≥m≥(kr2r)kr,n \ge 2^{k+1} k r^2, \qquad 2^{2^k k r^2} \ge m \ge \binom{kr^2}{r} k^r,n≥2k+1kr2,22kkr2≥m≥(rkr2​)kr,

there is a family F\mathcal FF of exactly mmm distinct subsets of an nnn-element set such that for every valid deterministic online algorithm AAA there is a nonempty arrival sequence σ\sigmaσ, covered by a single member of F\mathcal FF, with

∣CA(σ)∣≥kr=kr⋅OPT(σ).|\mathcal C_A(\sigma)| \ge kr = kr \cdot \mathrm{OPT}(\sigma).∣CA​(σ)∣≥kr=kr⋅OPT(σ).

The goal leaves the instance existential, as the paper does, and keeps both bounds on mmm and the bound on nnn exactly as printed.

Milestones

  1. Proposition 4.1. On the bit family, ∣F∣=k|\mathcal F| = k∣F∣=k; every valid deterministic algorithm can be forced to cost kkk on a sequence with OPT=1\mathrm{OPT} = 1OPT=1; and some valid algorithm has cost at most k⋅∣C∣k \cdot |C|k⋅∣C∣ for every offline cover CCC. So the best deterministic competitive ratio is exactly k=log⁡2nk = \log_2 nk=log2​n.
  2. The adversary claim of Section 4 (p. 369). On the block family, every valid deterministic algorithm can be forced to choose krkrkr sets by at most krkrkr arrivals that a single set covers.

A supporting item (not a milestone) records the count ∣F∣=(kr2r)kr|\mathcal F| = \binom{kr^2}{r} k^r∣F∣=(rkr2​)kr of the block family.

Significance

The result. Proposition 4.2 is the exact statement behind the paper's lower bound: choosing rrr of order log⁡m/(log⁡log⁡m+log⁡log⁡n)\log m / (\log\log m + \log\log n)logm/(loglogm+loglogn) and kkk of order log⁡n\log nlogn turns it into the asymptotic bound Ω(log⁡nlog⁡m/(log⁡log⁡m+log⁡log⁡n))\Omega\big(\log n \log m/(\log\log m + \log\log n)\big)Ω(lognlogm/(loglogm+loglogn)), which shows that the paper's O(log⁡mlog⁡n)O(\log m \log n)O(logmlogn) algorithm is optimal among deterministic algorithms up to a log⁡log⁡m+log⁡log⁡n\log\log m + \log\log nloglogm+loglogn factor. Without it, the gap between the ln⁡n\ln nlnn achievable offline and the log⁡mlog⁡n\log m \log nlogmlogn achieved online would be unexplained. Proposition 4.1 alone gives the matching bound log⁡2n\log_2 nlog2​n when m=log⁡2nm = \log_2 nm=log2​n.

Formalizing it. Both propositions are proved in the paper; neither is formalized anywhere to our knowledge. The mission produces a reusable model of deterministic online algorithms against an adaptive adversary, with a validity notion and a cost, and machine-checked adversary arguments on it. The paper's proof tacitly lets the algorithm add one set per arrival; the statements here cover algorithms that add any number of sets per arrival, so a complete formalization also closes that gap.

Difficulty

The adversary must be adaptive, and the quantifiers are ordered instance, then algorithm, then arrival sequence. The obvious single-block argument (Proposition 4.1) forces only kkk sets. To force krkrkr sets with OPT=1\mathrm{OPT} = 1OPT=1, the adversary must move to blocks that no chosen set has touched yet, which requires counting the blocks touched by the sets chosen so far. When an algorithm adds many sets at once, the paper's count "at most 1+(r−1)k1 + (r-1)k1+(r−1)k blocks after kkk steps" no longer applies as written, and the stopping rule has to be phrased in terms of the cost already paid. The padding of Proposition 4.2 must reach exactly nnn elements and exactly mmm distinct sets without creating sets that help cover the adversary's elements.

Formalization scope

The ground set is a Fin type: Fin (2^k) for Proposition 4.1, Fin (k r²) × Fin (2^k) (block, element) for the block family, Fin n for Proposition 4.2. A family is a Finset (Finset X), so its cardinality counts distinct sets. Bit iii (1-based) of jjj is Nat.testBit j (i-1). An online algorithm is a function from (earlier arrivals in arrival order, current element) to the finite family of sets it adds; it may add any number of sets. Validity demands coverage only for elements that some member of the family contains. Costs are unit (the problem of Section 4 is unweighted).

The offline optimum is never encoded as an infimum: lower bounds exhibit a nonempty arrival sequence and a single covering set (OPT=1\mathrm{OPT} = 1OPT=1), and the upper bound of Proposition 4.1 quantifies over all offline covers. This rules out the trivializing reading in which the empty arrival sequence satisfies cost≥kr⋅OPT\text{cost} \ge kr \cdot \mathrm{OPT}cost≥kr⋅OPT as 0≥00 \ge 00≥0.

The statements contain no O(⋅)O(\cdot)O(⋅): every quantity is the paper's exact one. The asymptotic bound (8) under the range (7), whose final paragraph only sketches the choice of rrr and kkk, is excluded, as are the remarks on the trivial ratio-mmm and O(n)O(\sqrt n)O(n​) algorithms.

Contributions welcome: proofs of the milestones; lemmas on the chosen collection (monotonicity, decomposition along a sequence); the count of the block family; and the padding construction of Proposition 4.2. The online-algorithm model is reusable for other deterministic online covering lower bounds.

Selected references

  • N. Alon, B. Awerbuch, Y. Azar, N. Buchbinder, J. Naor, The Online Set Cover Problem, SIAM J. Comput. 39(2):361–370, 2009. https://doi.org/10.1137/060661946
  • N. Alon, B. Awerbuch, Y. Azar, N. Buchbinder, J. Naor, The online set cover problem, Proc. 35th ACM STOC, 2003, pp. 100–105. https://doi.org/10.1145/780542.780558
  • U. Feige, A threshold of ln n for approximating set cover, J. ACM 45(4):634–652, 1998. https://doi.org/10.1145/285055.285059
  • N. Buchbinder, J. Naor, The Design of Competitive Online Algorithms via a Primal–Dual Approach, Foundations and Trends in Theoretical Computer Science 3(2–3):93–263, 2009. https://doi.org/10.1561/0400000024
6 thms2 active usersReviewed
🏆Completed
CombinatoricsOperations ResearchTheoretical Computer Science·Captain: mikedeng1

The Online Set Cover Problem 2: Given α ≥ c(C_OPT), the Weighted Potential-Function Algorithm Never Fails and Pays at Most (6+o(1)) α log m log nResearch Paper

Motivation

Set cover is one of the basic covering problems of combinatorial optimization: given a ground set and a family of subsets with costs, choose a cheapest subfamily whose union contains every element. In many applications the elements to be covered are not known in advance but appear over time: requests for a service that must be served by opening facilities, clients that must be assigned to servers, or constraints of a covering program that are revealed one at a time. Each arriving element must be covered at once, and decisions cannot be undone. This is the online set cover problem, introduced by Alon, Awerbuch, Azar, Buchbinder and Naor (SIAM J. Comput. 39(2), 2009; conference version STOC 2003).

The quality of an online algorithm is measured by its competitive ratio: the worst case, over all arrival sequences, of the ratio between the algorithm's cost and the cost of an optimal offline cover of the elements that actually arrived. The paper gives a deterministic algorithm with ratio O(log⁡mlog⁡n)O(\log m \log n)O(logmlogn), where nnn is the number of elements and mmm the number of sets, and shows a nearly matching lower bound for deterministic algorithms. Its algorithm for the weighted case, analysed with a potential function, became a template for the online primal–dual method surveyed by Buchbinder and Naor (Found. Trends Theor. Comput. Sci. 3(2–3), 2009).

This mission formalizes the core of the weighted result: the algorithm that is given a value α\alphaα at least the optimal cost, and its guarantee (Theorem 3.4).

Setting

The ground set XXX has n=∣X∣n = |X|n=∣X∣ elements and the family S\mathcal SS has m=∣S∣m = |\mathcal S|m=∣S∣ sets; every set SSS has a cost cS>0c_S > 0cS​>0. Both are known to the algorithm in advance. For an element jjj, Sj\mathcal S_jSj​ denotes the sets containing jjj. Elements of an unknown subset of XXX arrive one at a time in a sequence σ\sigmaσ; on arrival each must be covered by a chosen set. The chosen family C\mathcal CC can only grow. COPT\mathcal C_{OPT}COPT​ is any family covering every arriving element, and c(COPT)=∑S∈COPTcSc(\mathcal C_{OPT}) = \sum_{S \in \mathcal C_{OPT}} c_Sc(COPT​)=∑S∈COPT​​cS​.

The algorithm is given α≥c(COPT)\alpha \ge c(\mathcal C_{OPT})α≥c(COPT​). It discards sets costing more than α\alphaα, buys sets costing at most α/m\alpha/mα/m outright, and rescales costs; on the resulting normalized instance 1≤cS≤m1 \le c_S \le m1≤cS​≤m and cS≤αc_S \le \alphacS​≤α for every set (p. 365).

The algorithm keeps a weight wS>0w_S > 0wS​>0 for every set, initially wS=1/m2w_S = 1/m^2wS​=1/m2; the weight of an element is wj=∑S∈SjwSw_j = \sum_{S \in \mathcal S_j} w_Swj​=∑S∈Sj​​wS​. With CCC the set of covered elements and χC\chi_{\mathcal C}χC​ the indicator of C\mathcal CC, the potential is

Φ=∑j∉Cn2wj+n⋅exp⁡(12α∑S∈S(cSχC(S)−3wScSlog⁡n)),\Phi = \sum_{j \notin C} n^{2 w_j} + n \cdot \exp\Big(\frac{1}{2\alpha} \sum_{S \in \mathcal S} \big(c_S \chi_{\mathcal C}(S) - 3 w_S c_S \log n\big)\Big),Φ=j∈/C∑​n2wj​+n⋅exp(2α1​S∈S∑​(cS​χC​(S)−3wS​cS​logn)),

with natural logarithms throughout. When jjj arrives with wj≥1w_j \ge 1wj​≥1 nothing happens; otherwise the algorithm performs weight augmentation steps while wj<1w_j < 1wj​<1. In a step, for each S∈SjS \in \mathcal S_jS∈Sj​: (a) wS←wS(1+1ncS)w_S \leftarrow w_S (1 + \frac{1}{n c_S})wS​←wS​(1+ncS​1​); (b) if S∉CS \notin \mathcal CS∈/C, add SSS to C\mathcal CC when Φ\PhiΦ does not exceed its value before (a); (c) if Φ\PhiΦ has increased, return FAIL.

In Lean, the instance is the published OnlinePrimalDual.OnlineSetCover.SetCoverInstance over finite types X (elements) and T (sets), with the published elementWeight, coveredBy and potential. The run is OnlineSetCover.Weighted.Reachable inst α σ, the set of configurations reachable from initState σ under the transition relation Step.

Formalization targets

Goal: Theorem 3.4

On the normalized instance, with COPT\mathcal C_{OPT}COPT​ covering σ\sigmaσ, c(COPT)≤αc(\mathcal C_{OPT}) \le \alphac(COPT​)≤α, and n⋅n2/m+n<n2n \cdot n^{2/m} + n < n^2n⋅n2/m+n<n2, every reachable configuration is a running state (never FAIL) in which (i) every j∈Xj \in Xj∈X with wj≥1w_j \ge 1wj​≥1 is covered, and (ii)

∑S∈CcS≤3log⁡n(1+(1+1n)αlog⁡(m2(1+1n)))+2αlog⁡n=(6+o(1)) αlog⁡mlog⁡n.\sum_{S \in \mathcal C} c_S \le 3 \log n \Big(1 + \Big(1 + \frac1n\Big)\alpha \log\Big(m^2\Big(1+\frac1n\Big)\Big)\Big) + 2\alpha \log n = (6 + o(1))\,\alpha \log m \log n.S∈C∑​cS​≤3logn(1+(1+n1​)αlog(m2(1+n1​)))+2αlogn=(6+o(1))αlogmlogn.

Milestones

  • Lemma 3.1 (p. 365): the number NNN of augmentation steps satisfies N≤∑S∈COPT(ncS+1)log⁡(m2(1+1/n))≤(n+1)αlog⁡(m2(1+1/n))N \le \sum_{S \in \mathcal C_{OPT}} (n c_S + 1)\log(m^2(1 + 1/n)) \le (n+1)\alpha\log(m^2(1+1/n))N≤∑S∈COPT​​(ncS​+1)log(m2(1+1/n))≤(n+1)αlog(m2(1+1/n)).
  • Lemma 3.2 (p. 366): throughout, ∑SwScS≤1+N/n≤1+(1+1/n)αlog⁡(m2(1+1/n))\sum_S w_S c_S \le 1 + N/n \le 1 + (1 + 1/n)\alpha\log(m^2(1+1/n))∑S​wS​cS​≤1+N/n≤1+(1+1/n)αlog(m2(1+1/n)).
  • Lemma 3.3 (p. 366): a per-set step with cS≤αc_S \le \alphacS​≤α never increases Φ\PhiΦ; in particular the algorithm never fails.

The Proved platform theorem OnlinePrimalDual.OnlineSetCover.algorithm_correctness (the last paragraph of the proof of Theorem 3.4, with the invariant Φ<n2\Phi < n^2Φ<n2 assumed) is included as a supporting reference.

Significance

Theorem 3.4 is the analysis of the subroutine; with the doubling over guesses of α\alphaα described on pp. 364–365 (which loses a factor of at most 4) it yields the paper's deterministic O(log⁡mlog⁡n)O(\log m \log n)O(logmlogn)-competitive algorithm for weighted online set cover. The lower bound of Section 4 shows that no deterministic algorithm can do much better on general instances, so the result is close to the deterministic optimum. The technique, a potential that couples a fractional multiplicative-weights solution to a deterministic rounding, reappears in online covering and packing, online facility location and related problems.

The result is proved in the paper and restated in the Buchbinder–Naor monograph. On Prove2Me, the monograph's final step (from the invariant Φ<n2\Phi < n^2Φ<n2 to the cost bound) is a Proved theorem, and its expectation form of the monotonicity lemma is Disproved because it omits the hypothesis cS≤αc_S \le \alphacS​≤α. Neither the full statement about the algorithm's run nor Lemmas 3.1, 3.2 and the corrected Lemma 3.3 are formalized on the platform. This mission produces them, with the o(1)o(1)o(1) terms replaced by explicit expressions.

Difficulty

The cost bound in the last step is short once two facts about the run are available: that Φ\PhiΦ stays below n2n^2n2, and that the fractional cost ∑SwScS\sum_S w_S c_S∑S​wS​cS​ stays logarithmic. Neither is a local fact about one state. The first requires showing that, at every per-set step, one of the two deterministic choices (add SSS or not) does not increase Φ\PhiΦ; the paper proves this by a probabilistic argument over an auxiliary randomized choice, and the bound on the exponential term depends on the cost of the set being at most α\alphaα. The platform's earlier statement of this lemma, which omits that hypothesis, is Disproved. The second requires a bound on the number of augmentation steps over the whole run, which depends on the run's history and not on any single state. In Lean both are inductions over an operational semantics with real-valued exponentials and powers n2wjn^{2 w_j}n2wj​, where the initial bound Φ<n2\Phi < n^2Φ<n2 is a genuine size condition on nnn and mmm.

Formalization scope

The run is a small-step transition relation. A state records the weights, the cover, the number of augmentation steps begun, the elements not yet given, and the position inside the current step; FAIL is a separate terminal configuration. The order in which a step visits Sj\mathcal S_jSj​ is arbitrary and may differ between steps; every statement holds for every order. "Throughout the algorithm" means every reachable configuration, including those between per-set substeps. Arrival sequences are arbitrary lists (repetitions allowed) of elements covered by COPT\mathcal C_{OPT}COPT​.

Conventions: costs, weights and α\alphaα are real; nnn and mmm are the cardinalities of the finite types cast to R\mathbb RR; log⁡\loglog is Real.log; n2wjn^{2 w_j}n2wj​ and n2/mn^{2/m}n2/m are real powers. The paper's asymptotic expressions are replaced by what its proofs establish:

  • Lemma 3.1: (2+o(1))nαlog⁡m(2 + o(1)) n\alpha\log m(2+o(1))nαlogm becomes (n+1)αlog⁡(m2(1+1/n))(n+1)\alpha\log(m^2(1+1/n))(n+1)αlog(m2(1+1/n));
  • Lemma 3.2: (2+o(1))αlog⁡m(2 + o(1))\alpha\log m(2+o(1))αlogm becomes 1+(1+1/n)αlog⁡(m2(1+1/n))1 + (1+1/n)\alpha\log(m^2(1+1/n))1+(1+1/n)αlog(m2(1+1/n)), together with the intermediate bound 1+N/n1 + N/n1+N/n;
  • Theorem 3.4 (ii): (6+o(1))αlog⁡mlog⁡n(6 + o(1))\alpha\log m\log n(6+o(1))αlogmlogn becomes 3log⁡n (1+(1+1/n)αlog⁡(m2(1+1/n)))+2αlog⁡n3\log n\,(1 + (1+1/n)\alpha\log(m^2(1+1/n))) + 2\alpha\log n3logn(1+(1+1/n)αlog(m2(1+1/n)))+2αlogn;
  • "n and m large" becomes the hypothesis n⋅n2/m+n<n2n \cdot n^{2/m} + n < n^2n⋅n2/m+n<n2 used for the initial potential (it holds, for instance, when n≥4n \ge 4n≥4 and m≥3m \ge 3m≥3).

The goal is a statement about the configurations the algorithm actually reaches from wS=1/m2w_S = 1/m^2wS​=1/m2 and the empty cover. Taking the invariant Φ<n2\Phi < n^2Φ<n2 or the fractional-cost bound as a hypothesis on an arbitrary state would trivialize it, and is ruled out: those are exactly what the milestones establish. The doubling wrapper for unknown α\alphaα is not part of this mission.

A complete development needs an invariant for reachable states (positive weights, steps of an element processed in full), the per-set potential inequality, and the step-counting argument. The per-set inequality is reusable for the monograph's version of the algorithm. Contributions of proofs of any milestone, and of auxiliary invariants as separate lemmas, are welcome.

Selected references

  • N. Alon, B. Awerbuch, Y. Azar, N. Buchbinder, J. Naor, The Online Set Cover Problem, SIAM Journal on Computing 39(2):361–370, 2009. https://doi.org/10.1137/060661946
  • N. Buchbinder, J. Naor, The Design of Competitive Online Algorithms via a Primal–Dual Approach, Foundations and Trends in Theoretical Computer Science 3(2–3):93–263, 2009. https://doi.org/10.1561/0400000024
10 thms2 active usersReviewed
🏆Completed
Algorithmic Game TheoryOperations ResearchProbability+1·Captain: mikedeng1

Secretary Problems: Weights and Discounts 1: An (8+3e)-Competitive Algorithm for the Weighted Secretary ProblemResearch Paper

Motivation

The classical secretary problem asks how to select one valuable candidate when candidates arrive in random order and a decision must be made when each candidate appears. Many allocation settings have several goods of unequal quality instead of a single position. An employer may have roles of different desirability, or a seller may have placements with different visibility. In the weighted secretary problem, an agent's value is multiplied by the weight of the good assigned to that agent. The algorithm must decide irrevocably as agents arrive, while the benchmark sees every value before assigning goods. Babaioff, Dinitz, Gupta, Immorlica and Talwar study this model with arbitrary fixed agent values and a uniformly random arrival order, and give a constant competitive ratio independent of the number of agents and goods (authors' version, §§2–3).

The paper also studies time discounts and matroid constraints. This mission concerns its weighted-goods result, Theorem 3.4. The result combines an online allocation rule for several comparably valuable agents with the familiar one-choice secretary rule for an unusually valuable agent. These are distinct ways in which the sorted offline assignment can earn value; both are present even when the weights are fixed in advance. The weighted model matters because matching a valuable agent to an unsuitable good can lose value despite accepting the right agent.

Setting

There are nnn agents e∈Ue\in Ue∈U, each with a nonnegative value v(e)v(e)v(e), and KKK goods indexed in decreasing order of nonnegative weight:

w(1)≥w(2)≥⋯≥w(K)≥0.w(1)\ge w(2)\ge\cdots\ge w(K)\ge0.w(1)≥w(2)≥⋯≥w(K)≥0.

An assignment sss gives each good to at most one agent, and each agent receives at most one good. A good may remain unassigned, represented by ⊥\bot⊥ with v(⊥)=0v(\bot)=0v(⊥)=0. Its value is ∑k=1Kv(s(k))w(k)\sum_{k=1}^K v(s(k))w(k)∑k=1K​v(s(k))w(k). Agent values are arbitrary, not drawn independently from a distribution. The uncertainty is the arrival order π\piπ, chosen uniformly from all permutations; an agent's value becomes visible on arrival, and an allocation decision cannot be revised.

The offline optimum, OPT\mathrm{OPT}OPT, assigns the heaviest good to the highest-valued agent, the next good to the next agent, and so on. If K>nK>nK>n, the extra goods remain unassigned. A consistent tie break makes the ordering unique without changing the numerical value. This sorted assignment is defined directly; the mission does not replace it with an unconstrained variable said to be optimal.

The reservation algorithm draws a sample size τ∼Binom(n,1/2)\tau\sim\mathrm{Binom}(n,1/2)τ∼Binom(n,1/2), observes the first τ\tauτ agents without allocation, and retains the best min⁡(K,τ)\min(K,\tau)min(K,τ) sampled agents. Positive values are grouped into value classes [2i−1,2i)[2^{i-1},2^i)[2i−1,2i) for integer iii. A sampled agent in class iii reserves one good in that class's contiguous block, with higher classes receiving heavier blocks. A later agent receives the heaviest unassigned good reserved for its class when one is available. The classical secretary rule instead observes the first ⌊n/e⌋\lfloor n/e\rfloor⌊n/e⌋ agents, then selects the first later arrival better than every predecessor; its winner receives good 111.

Formalization targets

The mission's goal is the exact guarantee of Theorem 3.4 for Algorithm AAA, which runs the reservation algorithm with probability 8/(3e+8)8/(3e+8)8/(3e+8) and the classical rule with probability 3e/(3e+8)3e/(3e+8)3e/(3e+8):

OPT≤(8+3e) E[A].\mathrm{OPT}\le(8+3e)\,\mathbb E[A].OPT≤(8+3e)E[A].

Here the expectation covers the uniform arrival permutation, the independent binomial sample size used by the reservation branch, and the mixing coin. The multiplicative inequality expresses competitiveness even when an expected payoff is zero. It uses the explicit constant in the paper's proof rather than an instance-dependent or unspecified constant.

Four source results form the milestones. The classical secretary rule selects the maximum with probability at least 1/e1/e1/e. Lemma 3.2 compares the starting indices bib_ibi​ and oio_ioi​ of class-iii blocks in the reservation and optimum assignments. Lemma 3.1 says that if the optimum assigns at least two agents from class iii, the reservation rule assigns at least ui/4u_i/4ui​/4 agents from that class in expectation. Lemma 3.3 converts this to expected value at least OPTi/8\mathrm{OPT}_i/8OPTi​/8. The target retains the paper's class condition and both numerical fractions (authors' version, pp. 4–5).

Significance

Theorem 3.4 supplies a constant factor guarantee for irrevocable allocation when goods have different weights and agents arrive in random order. The factor does not grow with nnn or KKK. It separates the effects of uncertain arrivals from the offline matching of high values to high weights, and it supplies a benchmark for later variants with more complicated feasibility constraints. The paper extends the reservation idea to additional combinatorial settings, including partition-matroid variants in Appendix C (authors' version, Appendix C).

The theorem is proved in the source paper, while the Lean statements in this mission are proof obligations. Formalizing them requires checking that the random-order model, sample distribution, tie convention and assignments jointly express the same algorithm. A complete development will also establish reusable finite-average facts for random permutations and binomial samples, and structural facts about sorted assignments and reserved blocks. Those pieces can support other secretary problems in the series; the mission's specific promise remains the weighted algorithm's exact bound.

Difficulty

A count of how many agents a class receives does not by itself control the weighted value of those goods. Goods have unequal weights, and the value of assigning the next good changes with its position in a block. A class whose offline optimum receives several agents can also lose all its sampled members from the allocation phase. Thus a direct comparison of expected class counts with expected class values is insufficient. The paper's separate count, block-position and value statements identify the claims a solver must establish; the final theorem must also account for classes represented only once in the offline assignment (authors' version, p. 5).

Formalization scope

Agents and goods are Fin n and Fin K; their indices start at zero in Lean, so paper time ttt corresponds to Lean index t−1t-1t−1. An arrival permutation maps time to agent. Values and weights are real and explicitly nonnegative, and weights are antitone in the good index. The finite sums defining expectations are normalized by n!n!n! for permutations and by (nτ)/2n\binom n\tau/2^n(τn​)/2n for sample sizes. No measurability or integration convention is needed. For the goal, K≥1K\ge1K≥1 makes the heaviest good available; K>nK>nK>n is allowed.

Equal values are ordered by smaller original agent index throughout the sorted optimum, the sample's top agents and the classical rule. The classical rule observes exactly ⌊n/e⌋\lfloor n/e\rfloor⌊n/e⌋ arrivals, and zero-valued agents reserve no value-class goods. Positive values below one use negative integer class indices. The paper says only that class iii holds the values “between” 2i−12^{i-1}2i−1 and 2i2^i2i (p. 4, and again in Appendix C, p. 12); the mission fixes the half-open interval [2i−1,2i)[2^{i-1},2^i)[2i−1,2i), so that the classes partition the positive reals (authors' version, pp. 4, 12). A reservation assignment is built from each post-sample agent's rank within its class, so a good is offered to at most one such agent. The theorem is about this concrete algorithm and the concrete sorted offline assignment; an arbitrary favorable policy or an optimum supplied as a hypothesis would not express the source result.

The development needs a finite assignment interface, a tie-aware rank order, value classes, the two online rules, and normalized finite expectations. The assignment and finite-average definitions are reusable. Contributions that prove the structural validity of the reservation assignment, the classical success guarantee, Lemmas 3.1–3.3, or the final combination all advance the stated target.

Selected references

  • Moshe Babaioff, Michael Dinitz, Anupam Gupta, Nicole Immorlica and Kunal Talwar, Secretary Problems: Weights and Discounts, Proceedings of SODA 2009; authors' full version, proceedings DOI.
7 thms2 active usersReviewed
PreviousNext

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me