async-cache
- info:
In-memory application layer cache
Installation
pip install async-cache
See full documentation at https://async-cache.readthedocs.io/
Core Usage: Function API for Microservices
Use AsyncCache for flexible caching:
from cache import AsyncCache
cache = AsyncCache(maxsize=1000, default_ttl=300) # TTL in seconds
async def get_data(key):
return await cache.get(
key,
loader=lambda: db_query(key), # auto-caches on miss
)
# Warmup hot keys at startup
await cache.warmup({"hot:key": lambda: preload_hot()})
# Metrics for observability
print(cache.get_metrics()) # hits, misses, size, hit_rate
Key Features & Examples
- Thundering Herd Protection
Prevents duplicate work under concurrent load (e.g., popular keys). Without it, 100 misses = 100 DB hits; with it, = 1.
cache = AsyncCache() async def loader(): return await db_query() # expensive # 100 concurrent -> 1 loader call results = await asyncio.gather(*[cache.get('key', loader=loader) for _ in range(100)])- DataLoader-Style Batching
Groups concurrent gets into one batch call (reduces DB load; configurable window/size).
async def batch_loader(keys): # one DB query for batch return {k: await db_batch_query(k) for k in keys} # auto-groups within 5ms window await asyncio.gather( cache.get(1, batch_loader=batch_loader), cache.get(2, batch_loader=batch_loader) )- Cache Warmup
Preload at startup to avoid cold misses.
await cache.warmup({ "user:1": lambda: load_user(1), "config:global": lambda: load_config(), })- Metrics
Observability for hit rate, size, etc. (global or per-function).
metrics = cache.get_metrics() # or func.get_metrics() # {'hits': 950, 'misses': 50, 'size': 200, 'hit_rate': 0.95} # Use for Prometheus/monitoring- TTL & Invalidation
Per-key control + size-based eviction.
await cache.set('key', value, ttl=60) # override await cache.delete('key') # or func.invalidate_cache(args) cache.clear()
Decorator Convenience
For simple/readable code (uses core API under the hood):
from cache import AsyncLRU, AsyncTTL
@AsyncLRU(maxsize=128)
async def func(*args):
...
@AsyncTTL(time_to_live=60, skip_args=1) # e.g. skip 'self'
async def method(self, arg):
...
Testing
A local test dashboard is available for interactive testing:
python demo/app.py # Runs on http://localhost:5001
Use it to verify caching behavior, metrics, and concurrent load handling.
Metadata
Release files for async-cache 2.0.3
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| async_cache-2.0.3.tar.gz | 18.9 kB | With provenance | Details for async_cache-2.0.3.tar.gz |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| async_cache-2.0.3-py3-none-any.whl | Python 3 | none | any | Details for async_cache-2.0.3-py3-none-any.whl |
Total release size: 28.8 kB
Release files / async_cache-2.0.3.tar.gz
| Download URL | async_cache-2.0.3.tar.gz |
|---|---|
| Size | 18.9 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
b59fa5ffcc0490fe993dc5bc07b7b7110e31ba0204693188e2569a839b28c51b
|
|
BLAKE2b-256 checksum How to use checksums |
f348eeeef74bc9c60cbd240b108901eaaab8de330c519ede4d6fbac70c1e0e15
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.13.12
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Apr 22, 2026.
Transparency logRelease files / async_cache-2.0.3-py3-none-any.whl
| Download URL | async_cache-2.0.3-py3-none-any.whl |
|---|---|
| Size | 9.9 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
a28b93156ab253d400a34c6fb46e618a7709fc15fc8516b530d4ea61abc010a7
|
|
BLAKE2b-256 checksum How to use checksums |
d26fd3278dfbe128f73f909872dbc5e3116bd22542cba35450cb0725159e351b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.13.12
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Apr 22, 2026.
Transparency logSecurity for async-cache 2.0.3
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
Full provenance
Both files in this release have been uploaded with provenance metadata.
Attestation for async_cache-2.0.3.tar.gz
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Apr 22, 2026.
Transparency logA note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.