aiosteady: rate limiting for asyncio
aiosteady is an MIT licensed library, written in Python, for rate limiting in asyncio applications using Redis and the aioredis library.
aiosteady currently implements the leaky bucket algorithm in a very efficient way.
max_capacity = 10 # The bucket can contain up to 10 drops, starts with 0
drop_recharge = 5.0 # 5 seconds between drop recharges.
throttler = Throttler(aioredis, max_capacity, drop_recharge)
# consume() returns information about success, the current bucket level,
# how long until the next drop recharges, etc.
res = await throttler.consume(f'user:{user_id}')Installation
To install aiosteady, simply:
$ pip install aiosteadyUsage
The leaky bucket algorithm follows a simple model.
A single bucket contains a number of drops, called the bucket level. Buckets start with zero drops.
Buckets have a maximum capacity of drops.
Each use of the bucket (consumption) inserts one or more drops into the bucket, up until the maximum capacity. If the bucket would overflow, the consumption fails.
One drop leaks out every drop_recharge seconds, freeing space in the bucket for a new drop to be put into it.
The bucket may also be manually drained.
In addition to making the consumption fail, full buckets can optionally be configured to block further attempts to consume for a period.
Create an instance of aiosteady.leakybucket.Throttler, giving it an instance of an aioredis client and rate limiting parameters (the maximum bucket capacity, the number of seconds it takes for a drop to leak out, and an optional blocking duration).
A Throttler supports two operations: consuming and peeking.
await Throttler.consume("a_key") (consume because it consumes bucket resources) attempts to put the given number of drops (default 1) into the bucket at the given key. It returns an instance of aiosteady.leakybucket.ThrottleResult, with fields for:
success: a boolean, describing whether the consumption was successful
level: an integer, describing the new level of the bucket
until_next_drop: a float, describing the number of seconds left after the next drop regenerates
blocked_for: an optional float, if blocking is being used and the bucket is blocked, the number of seconds until the block expires
If the number of drops given is negative, drops are instead removed from the bucket. The bucket may not go below zero drops.
await Throttler.peek("a_key") returns the same ThrottleResult but without attempting to consume any drops.
Both operations are implemented using a single Redis call, using Lua scripting.
Changelog
22.1.0 (UNRELEASED)
Switch to CalVer.
Add Python 3.10 support.
Add support for recharging the bucket (removing existing drops).
Switch the main branch name from master to main.
0.2.1 (2021-05-12)
Improve the attrs dependency specification, since attrs uses CalVer.
0.2.0 (2021-04-08)
Use the Redis evalsha instead of eval, for efficiency.
0.1.0 (2021-03-07)
Initial release.
Credits
The Lua Redis script for atomic leaky bucket has been taken and heavily adapted from the Prorate project.
1 maintainer
Metadata
1 maintainer
Release files for aiosteady 22.1.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| aiosteady-22.1.0.tar.gz | 6.2 kB | Without provenance | Details for aiosteady-22.1.0.tar.gz |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| aiosteady-22.1.0-py3-none-any.whl | Python 3 | none | any | Details for aiosteady-22.1.0-py3-none-any.whl |
Total release size: 13.4 kB
Release files / aiosteady-22.1.0.tar.gz
| Download URL | aiosteady-22.1.0.tar.gz |
|---|---|
| Size | 6.2 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
b13522fe1dc1840c5749e0bf56af2b463b356939ef6bbc6086d68335f848e379
|
|
BLAKE2b-256 checksum How to use checksums |
d9072a07ded9b6d2d1491db19268a7304b95565730b35e8409c84138fdb99eea
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/1.2.0b2 CPython/3.10.5 Darwin/21.5.0
|
Release files / aiosteady-22.1.0-py3-none-any.whl
| Download URL | aiosteady-22.1.0-py3-none-any.whl |
|---|---|
| Size | 7.2 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
336cfe899ee83a5ab5f6036f2ed02581cc2db26e5baa860e0532f94fb540330a
|
|
BLAKE2b-256 checksum How to use checksums |
e52ead6dae020519457ca305fd5bc588e628c1058c2deab66d2e4202c713167e
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/1.2.0b2 CPython/3.10.5 Darwin/21.5.0
|
Security for aiosteady 22.1.0
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.
