Pynenc Redis Plugin

Full-stack Redis backend for Pynenc distributed task orchestration

Documentation: https://pynenc-redis.readthedocs.io

Pynenc Documentation: https://docs.pynenc.org

Source Code: https://github.com/pynenc/pynenc-redis

The pynenc-redis plugin provides all five Pynenc backend components running on Redis, enabling production-ready distributed task orchestration with a single infrastructure dependency.

Components

Installation

pip install pynenc-redis

The plugin registers itself automatically via Python entry points when installed.

Quick Start

from pynenc import PynencBuilder

app = (
    PynencBuilder()
    .app_id("my_app")
    .redis(url="redis://localhost:6379")  # all components on Redis
    .process_runner()
    .build()
)

@app.task
def add(x: int, y: int) -> int:
    return x + y

result = add(1, 2).result  # 3

.redis() registers every component at once. Start a runner with:

pynenc --app=tasks.app runner start

For a complete working example with Docker Compose and multiple workers, see the basic_redis_example in the pynenc samples repository.

Configuration

Builder Parameters

# URL-based (recommended)
app = (
    PynencBuilder()
    .app_id("my_app")
    .redis(url="redis://localhost:6379/0")
    .multi_thread_runner(min_threads=2, max_threads=8)
    .build()
)

# Database number only (uses host/port from env or defaults)
app = (
    PynencBuilder()
    .app_id("my_app")
    .redis(db=1)
    .process_runner()
    .build()
)

Component-Specific Configuration

app = (
    PynencBuilder()
    .app_id("my_app")
    .redis(url="redis://localhost:6379")
    .redis_client_data_store(
        min_size_to_cache=1024,   # cache arguments > 1KB
        local_cache_size=1000,    # local LRU cache entries
    )
    .redis_trigger(
        scheduler_interval_seconds=60,
        enable_scheduler=True,
    )
    .build()
)

Environment Variables

PYNENC__REDIS__REDIS_URL="redis://localhost:6379/0"
# Or individual parameters:
PYNENC__REDIS__REDIS_HOST="localhost"
PYNENC__REDIS__REDIS_PORT=6379
PYNENC__REDIS__REDIS_DB=0

Connection URLs

.redis(url="redis://localhost:6379/0")           # Standard
.redis(url="redis://:password@localhost:6379/0")  # With password
.redis(url="rediss://localhost:6380/0")           # SSL/TLS

Requirements

• Python >= 3.12
• Pynenc >= 0.3.0
• redis >= 4.6.0
• A running Redis server

Related Plugins

• pynenc-mongodb: Full-stack MongoDB backend
• pynenc-rabbitmq: RabbitMQ broker (pairs with Redis for state/orchestrator/triggers)

License

This project is licensed under the MIT License - see the LICENSE file for details.