Repository logo
 

Balanced allocations under incomplete information: New settings and techniques


Type

Thesis

Change log

Authors

Los, Dimitrios 

Abstract

In the balanced allocations framework, there are ๐‘š balls to be allocated into ๐‘› bins with the aim of minimising the maximum load of any of the bins, or equivalently minimising the ๐‘”๐‘Ž๐‘, i.e., the difference between the maximum load and the average load. In this dissertation, we focus on the โ„Ž๐‘’๐‘Ž๐‘ฃ๐‘–๐‘™๐‘ฆ-๐‘™๐‘œ๐‘Ž๐‘‘๐‘’๐‘‘ ๐‘๐‘Ž๐‘ ๐‘’ where ๐‘š โ‰ซ ๐‘›, which tends to be more challenging to analyse.

In a decentralised setting, the simplest process is One-Choice, which allocates each ball to a bin sampled uniformly at random. It is well-known that w.h.p. Gap(๐‘š) = ฮ˜( sqrt( ๐‘š/๐‘› ยท log ๐‘› ) ) for any ๐‘š โ‰ซ ๐‘›. A great improvement over this is the Two-Choice process [ABKU99, KLM96], which allocates each ball to the least loaded of ๐‘ก๐‘ค๐‘œ bins sampled uniformly at random. Berenbrink, Czumaj, Steger, and Vรถcking (2006) showed that w.h.p. Gap(๐‘š) = logโ‚‚ log ๐‘› + ฮ˜(1) for any ๐‘š โฉพ ๐‘›. This improvement is known as the "power of two choices". It has found several applications in hashing, load balancing and routing; and its importance was recently recognised in the 2020 ACM Theory and Practice Award.

In this dissertation, we introduce a set of techniques based on ๐‘๐‘œ๐‘ก๐‘’๐‘›๐‘ก๐‘–๐‘Ž๐‘™ ๐‘“๐‘ข๐‘›๐‘๐‘ก๐‘–๐‘œ๐‘›๐‘ . These enable us to analyse (both in terms of gap and load distribution) a wide range of processes and settings in the heavily-loaded case and to establish interesting insights in the balanced allocations framework:

  • We analyse variants of the Two-Choice process which trade sample efficiency, completeness of information and gap guarantees. For the (1+ฮฒ)-process which mixes One-Choice and Two-Choice with probability ฮฒ in (0, 1], we prove tight bounds for small and large ฮฒ, extending the results of Peres, Talwar and Wieder (2015). Another sample efficient family is that of Two-Thinning processes, which allocate to the two sampled bins in an online manner. For Two-Thinning processes that use as a decision function thresholds relative to the average load or thresholds in the rank domain, we establish tight bounds and also resolve a conjecture by Feldheim and Gurel-Gurevich (2021). We also quantify trade-offs for two-sample processes between the number of queries and the gap bound, establishing a "power of two queries" phenomenon.

  • We analyse the Two-Choice process with random, adversarial and delay noise, proving tight bounds for various settings. In the adversarial setting, the adversary can decide in which of the two sampled bins the ball is allocated to, only when the two loads differ by at most ๐‘”. The analysis of this setting implies bounds for settings with random noise and delay.

    For the setting where load information is updated periodically every ๐‘ steps, for ๐‘ = ๐‘› we tighten the bound of [BCEFN12] to ฮ˜( log ๐‘› / log log ๐‘› ) and prove that Two-Choice is optimal in this setting for any in [๐‘› ยท exp(-logแถœ ๐‘›), ๐‘› log ๐‘›] for any constant ๐‘ > 0. For ๐‘ in [๐‘› log ๐‘›, ๐‘›ยณ], we show that Two-Choice achieves w.h.p. a ฮ˜(๐‘/๐‘›) gap, while surprisingly the (1+ฮฒ)-process with appropriately chosen ฮฒ achieves w.h.p. a ฮ˜( sqrt( ๐‘/๐‘› ยท log ๐‘›) ) gap, which is optimal over a large family of processes. This proves that in the presence of outdated information, less aggressive strategies can outperform the greedy processes (such as Two-Choice), which has been empirically observed in the queuing setting [D00, M00] for centralised processes since 2000, but to the best of our knowledge has not been formally proven.

  • Next we analyse Two-Choice in the graphical setting, where bins are vertices of a graph and each ball is allocated to the lesser loaded of the vertices adjacent to a randomly sampled edge. We extend the results of Kenthapadi and Panigrahy (2006) proving that for dense expanders in the heavily-loaded case the gap is w.h.p. O(log log ๐‘›). In the presence of weights, we make progress towards [Open Problem 1, PTW15] by proving that for graphs with conductance ฯ†, the gap is w.h.p. ฮŸ(log ๐‘› / ฯ†).

  • Further, we introduce and analyse processes which can allocate more than one balls to a sampled bin. We prove that these processes achieve w.h.p. an O(log ๐‘›) gap (which also applies for any ๐‘‘-regular graph), while still being more sample-efficient than One-Choice ("power of filling").

  • For the Memory process that can store bins in a cache, we generalise the O(log log ๐‘›) gap bound by Mitzenmacher, Prabhakar and Shah (2002) to the heavily-loaded case and prove a matching lower bound. Further, in the presence of heterogeneous sampling distributions, we establish a striking difference between Two-Choice (or even ๐‘‘-Choice with ๐‘‘ = O(1)) and Memory, showing that for the later the gap is bounded, while for the former it is known to diverge [W07] ("power of memory").

Description

Date

2023-03-31

Advisors

Sauerwald, Thomas

Keywords

adversarial noise, balanced allocations, balls-into-bins, incomplete information, maximum load, oudated information, potential functions, random noise

Qualification

Doctor of Philosophy (PhD)

Awarding Institution

University of Cambridge
Sponsorship
St John's College and Cambridge Trust