An exponential backoff iterator with collision avoidance.
Project description
Exponential Backoff with Collision Avoidance
This module defines a Python iterator implementing exponential backoff with collision avoidance. See https://en.wikipedia.org/wiki/Exponential_backoff#Collision_avoidance for a complete explanation of the algorithm.
A fixed time slot size is defined and then in each iteration a random number of these times slots is chosen. The wait time is the total amount of time represented by these time slots. In each iteration the number of available time slots increases.
For example, define the time slot size to be two seconds. In the first
iteration the number of available slots is 2**1-1=1
. The number N of
slots is chosen randomly in the integer interval [0, 1], that is, either
zero or one. The wait time returned is two seconds multiplied by N.
In the second iteration the number of available slots is 2**2-1=3
. The
number N of slots is chosen randomly in the integer interval [0, 3], that
is, either zero, one, two, or three. The wait time returned is two seconds
multiplied by N.
And so on.
Because the number of slots is randomly chosen in [0, N], the wait time returned in each iteration can sometimes go down.
Here is a simple example:
from exponential_backoff_ca import ExponentialBackoff
time_slot_secs = 2.0 # The number of seconds in each time slot.
num_iterations = 10 # The number of iterations.
exp_boff = ExponentialBackoff(time_slot_secs, num_iterations)
for interval in exp_boff:
print(f"wait seconds is {interval}")
Will output (something like)
wait seconds is 2.0
wait seconds is 6.0
wait seconds is 4.0
wait seconds is 24.0
wait seconds is 0.0
wait seconds is 114.0
wait seconds is 238.0
wait seconds is 184.0
wait seconds is 926.0
wait seconds is 1438.0
You can also access where you are in the iteration using the counter
property.
from exponential_backoff_ca import ExponentialBackoff
time_slot_secs = 2.0
num_iterations = 5
exp_boff = ExponentialBackoff(time_slot_secs, num_iterations)
for interval in exp_boff:
print(f"number of times going through loop: {exp_boff.counter}")
Will output
number of times going through loop: 1
number of times going through loop: 2
number of times going through loop: 3
number of times going through loop: 4
number of times going through loop: 5
To limit the maxiumum number of available slots use the optional max_slots
parameter:
from exponential_backoff_ca import ExponentialBackoff
time_slot_secs = 2.0 # The number of seconds in each time slot.
num_iterations = 10 # The number of iterations.
max_slots = 4 # No more than 4 slots available (so wait time <= 4 * 2.0 seconds)
exp_boff = ExponentialBackoff(time_slot_secs, num_iterations, max_slots=max_slots)
for interval in exp_boff:
print(f"wait seconds is {interval}")
Will output (something like)
wait seconds is 2.0
wait seconds is 2.0
wait seconds is 8.0
wait seconds is 0.0
wait seconds is 8.0
wait seconds is 8.0
wait seconds is 4.0
wait seconds is 4.0
wait seconds is 0.0
wait seconds is 4.0
You can also limit the wait time returned by passing in the limit_value
parameter.
from exponential_backoff_ca import ExponentialBackoff
time_slot_secs = 2.0 # The number of seconds in each time slot.
num_iterations = 10 # The number of iterations.
limit_value = 13.0 # Never return more than 13.0 seconds.
exp_boff = ExponentialBackoff(time_slot_secs, num_iterations, limit_value=limit_value)
for interval in exp_boff:
print(f"wait seconds is {interval}")
will output (something like)
wait seconds is 0.0
wait seconds is 4.0
wait seconds is 4.0
wait seconds is 13.0
wait seconds is 0.0
wait seconds is 13.0
wait seconds is 13.0
wait seconds is 6.0
wait seconds is 13.0
wait seconds is 13.0
The exponential backoff object doubles the number of slots each time.
However, there may be circumstances where that doubling is too much (or
too little). You can adjust how fast the number of available slots
increases using the multiplier
parameter. Passing in a
multiplier
value less than 1.0 will raise an exception.
from exponential_backoff_ca import ExponentialBackoff
time_slot_secs = 2.0 # The number of seconds in each time slot.
num_iterations = 10 # The number of iterations.
multiplier = 1.5 # Increase the number of available slots by 1.5 (takes integer part)
exp_boff = ExponentialBackoff(time_slot_secs, num_iterations, multiplier=multiplier)
for interval in exp_boff:
print(f"wait seconds is {interval}")
Will output something like
wait seconds is 0.0
wait seconds is 2.0
wait seconds is 0.0
wait seconds is 4.0
wait seconds is 8.0
wait seconds is 6.0
wait seconds is 14.0
wait seconds is 38.0
wait seconds is 30.0
wait seconds is 22.0
To see what the iterator is doing, pass in the debug
parameter set to
True
.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for exponential_backoff_ca-2.1.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2f9f7482116eb99eac2801c6cfb631847f23b30fc0110636ad80aea8b02b4dd9 |
|
MD5 | cd88cb1f1e99dd179c02c7823dea8a63 |
|
BLAKE2b-256 | 3e716088c7620d5ff813feedd93fda8b7ab386ad32d3a2f5d486a3c69292e24b |
Hashes for exponential_backoff_ca-2.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6256ffbb359021afbfb5e504674c304810bd7e1856a36e04bcb402669609a004 |
|
MD5 | e4b49cac0e0ba55ec128e9de783888e3 |
|
BLAKE2b-256 | 799937d054c615502dab5724fe00bf7d61178a923c76539da9e62378e67d37f8 |