Skip to main content

AioCache DynamoDB Backend using Aiobotocore

Project description

aiocache-dynamodb

PyPI Python Versions Ruff Coverage Status pre-commit

aiocache-dynamodb is an asynchronous cache backend for DynamoDB, built on top of aiobotocore and aiocache. It provides a fully asynchronous interface for caching data using DynamoDB, allowing for efficient and scalable caching solutions in Python applications.

For more information on aiocache:

For more information on aiobotocore:

Features

  • Fully asynchronous operations using aiobotocore.
  • TTL support for expiring cache items (even though DynamoDB only deletes items within 48hr of expiration, we double-check).
  • Batch operations for efficient multi-key handling.
  • Customizable key, value, and TTL column names.
  • S3 Extension for large object storage (+400kb)

Installation

Install the package using pip:

pip install aiocache-dynamodb

Usage

import asyncio
from aiocache_dynamodb import DynamoDBCache

async def main():
    cache = DynamoDBCache(
        table_name="my-cache-table",
        endpoint_url="http://localhost:4566",  # For local development
        aws_access_key_id="your-access-key",
        aws_secret_access_key="your-secret-key",
        region_name="us-east-1",
    )

    # Set a value with a TTL of 60 seconds
    await cache.set("my_key", "my_value", ttl=60)

    # Get the value
    value = await cache.get("my_key")
    print(value)  # Output: my_value

    # Delete the value
    await cache.delete("my_key")

    # Check if the key exists
    exists = await cache.exists("my_key")
    print(exists)  # Output: False

    # Close the cache
    await cache.close()

asyncio.run(main())

To use the S3 extension feature:

import asyncio
from aiocache_dynamodb import DynamoDBCache

async def main():
    cache = DynamoDBCache(
        table_name="my-cache-table",
        bucket_name="this-is-my-bucket",
        endpoint_url="http://localhost:4566",  # For local development
        aws_access_key_id="your-access-key",
        aws_secret_access_key="your-secret-key",
        region_name="us-east-1",
    )

    large_value = "x" * 1024 * 400  # 400KB
    # Set a value with a TTL of 60 seconds
    # Deletion of item on S3 is not managed by the TTL
    # Please use lifecycle policies on the bucket
    await cache.set("my_key", large_value, ttl=60)

    # Get the value
    value = await cache.get("my_key")
    print(value)  # Output: large_value

    # Delete the value (both on dynamodb + S3)
    await cache.delete("my_key")

    # Close the cache
    await cache.close()

asyncio.run(main())

Configuration

The DynamoDBCache class supports the following parameters:

  • serializer: Serializer to use for serializing and deserializing values (default: aiocache.serializers.JsonSerializer).
  • plugins: List of plugins to use (default: []).
  • namespace: Namespace to use for the cache (default: "").
  • timeout: Timeout for cache operations (default: 5).
  • table_name: Name of the DynamoDB table to use for caching.
  • endpoint_url: Endpoint URL for DynamoDB (useful for LocalStack).
  • region_name: AWS region (default: "us-east-1").
  • aws_access_key_id: AWS access key ID.
  • aws_secret_access_key: AWS secret access key.
  • key_column: Column name for the cache key (default: "cache_key").
  • value_column: Column name for the cache value (default: "cache_value").
  • ttl_column: Column name for the TTL (default: "ttl").

Local Development:

We use make to handle the commands for the project, you can see the available commands by running this in the root directory:

make

Setup

To setup the project, you can run the following commands:

make dev

This will install the required dependencies for the project using uv + pip. When updating the dependencies, you can run the following command to update the uv lock file:

make upgrade

Linting

We use pre-commit to do linting locally, this will be included in the dev dependencies. We use ruff for linting and formatting, and pyright for static type checking. To install the pre-commit hooks, you can run the following command:

pre-commit install

If you for some reason hate pre-commit, you can run the following command to lint the code:

make check

Testing

To run tests, you can use the following command:

make test

In the background this will setup localstack to replicate the AWS services, and run the tests. It will also generate the coverage badge.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

aiocache_dynamodb-1.0.0.tar.gz (18.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

aiocache_dynamodb-1.0.0-py3-none-any.whl (12.6 kB view details)

Uploaded Python 3

File details

Details for the file aiocache_dynamodb-1.0.0.tar.gz.

File metadata

  • Download URL: aiocache_dynamodb-1.0.0.tar.gz
  • Upload date:
  • Size: 18.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for aiocache_dynamodb-1.0.0.tar.gz
Algorithm Hash digest
SHA256 8a4a5b3636a0a80b4065f94875cf0f0252436960fbf90df2b8416ecb25e66917
MD5 4c73cd285bb53c1780033c5805f83071
BLAKE2b-256 fc333fef7b2400cf078464c1e6fcf601f799ddb88c77a43976e86bf4947457ec

See more details on using hashes here.

Provenance

The following attestation bundles were made for aiocache_dynamodb-1.0.0.tar.gz:

Publisher: publish.yml on vonsteer/aiocache-dynamodb

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file aiocache_dynamodb-1.0.0-py3-none-any.whl.

File metadata

File hashes

Hashes for aiocache_dynamodb-1.0.0-py3-none-any.whl
Algorithm Hash digest
SHA256 3fbeabbbcfabd29acd67e376ffa339fa1f5c48d00d267ea34e450856dde59fb8
MD5 802f6bf85f5a1e76fba0b5efefc8ca51
BLAKE2b-256 0dafd124f0eb0de4c66c09bebddfff932838096014af57815dfdac831f07f371

See more details on using hashes here.

Provenance

The following attestation bundles were made for aiocache_dynamodb-1.0.0-py3-none-any.whl:

Publisher: publish.yml on vonsteer/aiocache-dynamodb

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page