Skip to main content

Persistent cache for aiohttp requests

Project description

aiohttp-client-cache

Build status Documentation Status Codecov PyPI Conda PyPI - Python Versions PyPI - Format

aiohttp-client-cache is an async persistent cache for aiohttp client requests, based on requests-cache.

Features

  • Ease of use: Use as a drop-in replacement for aiohttp.ClientSession
  • Customization: Works out of the box with little to no config, but with plenty of options available for customizing cache expiration and other behavior
  • Persistence: Includes several storage backends: SQLite, DynamoDB, MongoDB, DragonflyDB and Redis.

Quickstart

First, install with pip (python 3.9+ required):

pip install aiohttp-client-cache[all]

Note: Adding [all] will install optional dependencies for all supported backends. When adding this library to your application, you can include only the dependencies you actually need; see individual backend docs and pyproject.toml for details.

Basic Usage

Next, use aiohttp_client_cache.CachedSession in place of aiohttp.ClientSession. To briefly demonstrate how to use it:

Replace this:

from aiohttp import ClientSession

async with ClientSession() as session:
    await session.get('http://httpbin.org/delay/1')

With this:

from aiohttp_client_cache import CachedSession, SQLiteBackend

async with CachedSession(cache=SQLiteBackend('demo_cache')) as session:
    await session.get('http://httpbin.org/delay/1')

The URL in this example adds a delay of 1 second, simulating a slow or rate-limited website. With caching, the response will be fetched once, saved to demo_cache.sqlite, and subsequent requests will return the cached response near-instantly.

Configuration

Several options are available to customize caching behavior. This example demonstrates a few of them:

# fmt: off
from aiohttp_client_cache import SQLiteBackend

cache = SQLiteBackend(
    cache_name='~/.cache/aiohttp-requests.db',  # For SQLite, this will be used as the filename
    expire_after=60*60,                         # By default, cached responses expire in an hour
    urls_expire_after={'*.fillmurray.com': -1}, # Requests for any subdomain on this site will never expire
    allowed_codes=(200, 418),                   # Cache responses with these status codes
    allowed_methods=['GET', 'POST'],            # Cache requests with these HTTP methods
    include_headers=True,                       # Cache requests with different headers separately
    ignored_params=['auth_token'],              # Keep using the cached response even if this param changes
    timeout=2.5,                                # Connection timeout for SQLite backend
)

More Info

To learn more, see:

Feedback

If there is a feature you want, if you've discovered a bug, or if you have other general feedback, please create an issue for it!

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

aiohttp_client_cache-0.13.0.tar.gz (61.9 kB view details)

Uploaded Source

Built Distribution

aiohttp_client_cache-0.13.0-py3-none-any.whl (32.9 kB view details)

Uploaded Python 3

File details

Details for the file aiohttp_client_cache-0.13.0.tar.gz.

File metadata

  • Download URL: aiohttp_client_cache-0.13.0.tar.gz
  • Upload date:
  • Size: 61.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/2.1.2 CPython/3.12.9 Linux/6.8.0-1021-azure

File hashes

Hashes for aiohttp_client_cache-0.13.0.tar.gz
Algorithm Hash digest
SHA256 dc5cd62340adbee18e0fedc7b0c37542692df08f8ed9945d751b7292a0433853
MD5 02f6d59ee4ad7ac942c3ac0667bd5f1c
BLAKE2b-256 fc6b2c09e4a0dd7d8f1b23ad0afac1ebdb200ed59445057f6caca3f653e7510a

See more details on using hashes here.

File details

Details for the file aiohttp_client_cache-0.13.0-py3-none-any.whl.

File metadata

File hashes

Hashes for aiohttp_client_cache-0.13.0-py3-none-any.whl
Algorithm Hash digest
SHA256 89211544e9f290de42ef85f545cdae8eb34d1af6e51dcc8b2cf956dd539d2f39
MD5 59fbfe697677ef4dad7866d613be8b3e
BLAKE2b-256 b3b5f0a011dd20fad83c9aa1c75b3a640e2e4f05dbc9ee13e723c34fe25802f0

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page