Skip to main content

A comprehensive Redis toolkit for Python with caching, memoization, and utilities

Project description

rediskit

A Python toolkit that provides Redis-backed performance and concurrency primitives for applications. It enables developers to add caching, distributed coordination, and data protection to their Python applications with minimal effort.

Features

  • Function Result Caching: Use the @RedisMemoize decorator to cache expensive function calls with automatic serialization, compression, and encryption
  • Distributed Coordination: Redis-based distributed locks and semaphores for coordinating access across multiple processes/machines
  • Data Protection: Multi-version encryption keys with automatic key rotation for sensitive cached data
  • Async Support: Full support for both synchronous and asynchronous applications
  • Flexible Storage: Choose between string or hash-based Redis storage patterns
  • Modern Type Hints: Full type safety with Python 3.12+ syntax

Installation

uv add rediskit
# or
poetry add rediskit

Quick Start

Basic Setup

from rediskit import RedisMemoize, InitRedisConnectionPool

# Initialize Redis connection pool (call once at app startup)
InitRedisConnectionPool()

# Cache expensive function results
@RedisMemoize(memoizeKey="expensive_calc", ttl=300)
def expensive_calculation(tenantId: str, value: int) -> dict:
    # Simulate expensive computation
    import time
    time.sleep(2)
    return {"result": value * 42}

# Usage
result = expensive_calculation("tenant1", 10)  # Takes 2 seconds
result = expensive_calculation("tenant1", 10)  # Returns instantly from cache

Custom Redis Connection

import redis
from rediskit import RedisMemoize

# Use your own Redis connection
my_redis = redis.Redis(host='my-redis-host', port=6379, db=1)

@RedisMemoize(
    memoizeKey="custom_calc", 
    ttl=600,
    connection=my_redis
)
def my_function(tenantId: str, data: dict) -> dict:
    return {"processed": data}

Advanced Caching Options

from rediskit import RedisMemoize

# Hash-based storage with encryption
@RedisMemoize(
    memoizeKey=lambda tenantId, user_id: f"user_profile:{tenantId}:{user_id}",
    ttl=3600,
    storageType="hash",  # Store in Redis hash for efficient field access
    enableEncryption=True,  # Encrypt sensitive data
    cacheType="zipJson"  # JSON serialization with compression
)
def get_user_profile(tenantId: str, user_id: str) -> dict:
    # Fetch user data from database
    return {"user_id": user_id, "name": "John Doe", "email": "john@example.com"}

# Dynamic TTL and cache bypass
@RedisMemoize(
    memoizeKey="dynamic_data",
    ttl=lambda tenantId, priority: 3600 if priority == "high" else 300,
    bypassCache=lambda tenantId, force_refresh: force_refresh
)
def get_dynamic_data(tenantId: str, priority: str, force_refresh: bool = False) -> dict:
    return {"data": "fresh_data", "priority": priority}

Async Support

import asyncio
from rediskit import RedisMemoize, InitAsyncRedisConnectionPool

# Initialize async Redis connection pool
await InitAsyncRedisConnectionPool()

@RedisMemoize(memoizeKey="async_calc", ttl=300)
async def async_expensive_function(tenantId: str, value: int) -> dict:
    await asyncio.sleep(1)  # Simulate async work
    return {"async_result": value * 100}

# Usage
result = await async_expensive_function("tenant1", 5)

Distributed Locking

from rediskit import GetRedisMutexLock, GetAsyncRedisMutexLock

# Synchronous distributed lock
with GetRedisMutexLock("critical_section", expire=30) as lock:
    # Only one process can execute this block at a time
    perform_critical_operation()

# Async distributed lock
async with GetAsyncRedisMutexLock("async_critical_section", expire=30) as lock:
    await perform_async_critical_operation()

Encryption Management

from rediskit import Encrypter

# Generate new encryption keys
encrypter = Encrypter()
new_key = encrypter.generateNewHexKey()

# Encrypt/decrypt data manually
encrypted = encrypter.encrypt("sensitive data", useZstd=True)
decrypted = encrypter.decrypt(encrypted)

Configuration

Configure rediskit using environment variables:

# Redis connection settings
export REDISKIT_REDIS_HOST="localhost"
export REDISKIT_REDIS_PORT="6379"
export REDISKIT_REDIS_PASSWORD=""

# Encryption keys (base64-encoded JSON)
export REDISKIT_ENCRYPTION_SECRET="eyJfX2VuY192MSI6ICI0MGViODJlNWJhNTJiNmQ4..."

# Cache settings
export REDISKIT_REDIS_TOP_NODE="my_app_cache"
export REDISKIT_REDIS_SKIP_CACHING="false"

API Reference

Core Decorators

@RedisMemoize

Cache function results in Redis with configurable options.

Parameters:

  • memoizeKey: Cache key (string or callable)
  • ttl: Time to live in seconds (int, callable, or None)
  • bypassCache: Skip cache lookup (bool or callable)
  • cacheType: Serialization method ("zipJson" or "zipPickled")
  • resetTtlUponRead: Refresh TTL when reading from cache
  • enableEncryption: Encrypt cached data
  • storageType: Redis storage pattern ("string" or "hash")
  • connection: Custom Redis connection (optional)

Connection Management

  • InitRedisConnectionPool(): Initialize sync Redis connection pool
  • InitAsyncRedisConnectionPool(): Initialize async Redis connection pool
  • GetRedisConnection(): Get sync Redis connection
  • GetAsyncRedisConnection(): Get async Redis connection

Distributed Locking

  • GetRedisMutexLock(name, expire, auto_renewal, id): Get sync distributed lock
  • GetAsyncRedisMutexLock(name, expire, auto_renewal): Get async distributed lock

Encryption

  • Encrypter(keyHexDict): Encryption/decryption with key versioning

Requirements

  • Python 3.12+
  • Redis server
  • Dependencies: redis, redis-lock, nacl, zstd

License

Apache-2.0 license

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

rediskit-0.0.6.tar.gz (35.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

rediskit-0.0.6-py3-none-any.whl (21.9 kB view details)

Uploaded Python 3

File details

Details for the file rediskit-0.0.6.tar.gz.

File metadata

  • Download URL: rediskit-0.0.6.tar.gz
  • Upload date:
  • Size: 35.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for rediskit-0.0.6.tar.gz
Algorithm Hash digest
SHA256 20f5a91ed43e7eae6e68c02121edd964be6617e0b58ee66e763a19b8278daebe
MD5 695187c8a18393b5fe371cee0358576b
BLAKE2b-256 34aeb4f4864481e0d2f51cb7b8ddb104f5fb2e3fada878c34acbf99bad36b2b2

See more details on using hashes here.

Provenance

The following attestation bundles were made for rediskit-0.0.6.tar.gz:

Publisher: publish.yml on BadrElfarri/rediskit

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file rediskit-0.0.6-py3-none-any.whl.

File metadata

  • Download URL: rediskit-0.0.6-py3-none-any.whl
  • Upload date:
  • Size: 21.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for rediskit-0.0.6-py3-none-any.whl
Algorithm Hash digest
SHA256 153b16dc473d123f74c17cfa7b9a3892b0a848279bd6630f87beb3ea2b0f11ba
MD5 0d5606b094d94a554a284df330d12453
BLAKE2b-256 1d8845e87496b3e66f721bbeaa0eff0167733758c94b37763aadd9889015b1a4

See more details on using hashes here.

Provenance

The following attestation bundles were made for rediskit-0.0.6-py3-none-any.whl:

Publisher: publish.yml on BadrElfarri/rediskit

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page