pynenc-redis 0.1.5

Redis plugging for pynenc, a distributed task queue for Python.

Pynenc Redis Plugin

Full-stack Redis backend for Pynenc distributed task orchestration

---

Documentation: https://pynenc-redis.readthedocs.io

Pynenc Documentation: https://docs.pynenc.org

Source Code: https://github.com/pynenc/pynenc-redis

---

The pynenc-redis plugin provides all five Pynenc backend components running on Redis, enabling production-ready distributed task orchestration with a single infrastructure dependency.

Components

Component	Class	Role
Orchestrator	RedisOrchestrator	Distributed status tracking & blocking control
Broker	RedisBroker	FIFO message queue via Redis lists with blocking pop
State Backend	RedisStateBackend	Persistent state, results, exceptions & workflow data
Client Data Store	RedisClientDataStore	Argument caching for large serialized payloads
Trigger	RedisTrigger	Event-driven & cron-based task scheduling

Installation

pip install pynenc-redis

The plugin registers itself automatically via Python entry points when installed.

Quick Start

from pynenc import PynencBuilder

app = (
    PynencBuilder()
    .app_id("my_app")
    .redis(url="redis://localhost:6379")  # all components on Redis
    .process_runner()
    .build()
)

@app.task
def add(x: int, y: int) -> int:
    return x + y

result = add(1, 2).result  # 3

.redis() registers every component at once. Start a runner with:

pynenc --app=tasks.app runner start

Configuration

Builder Parameters

# URL-based (recommended)
app = (
    PynencBuilder()
    .app_id("my_app")
    .redis(url="redis://localhost:6379/0")
    .multi_thread_runner(min_threads=2, max_threads=8)
    .build()
)

# Database number only (uses host/port from env or defaults)
app = (
    PynencBuilder()
    .app_id("my_app")
    .redis(db=1)
    .process_runner()
    .build()
)

Component-Specific Configuration

app = (
    PynencBuilder()
    .app_id("my_app")
    .redis(url="redis://localhost:6379")
    .redis_client_data_store(
        min_size_to_cache=1024,   # cache arguments > 1KB
        local_cache_size=1000,    # local LRU cache entries
    )
    .redis_trigger(
        scheduler_interval_seconds=60,
        enable_scheduler=True,
    )
    .build()
)

Environment Variables

PYNENC__REDIS__REDIS_URL="redis://localhost:6379/0"
# Or individual parameters:
PYNENC__REDIS__REDIS_HOST="localhost"
PYNENC__REDIS__REDIS_PORT=6379
PYNENC__REDIS__REDIS_DB=0

Connection URLs

.redis(url="redis://localhost:6379/0")           # Standard
.redis(url="redis://:password@localhost:6379/0")  # With password
.redis(url="rediss://localhost:6380/0")           # SSL/TLS

Requirements

• Python >= 3.11
• Pynenc >= 0.1.0
• redis >= 4.6.0
• A running Redis server

Related Plugins

• pynenc-mongodb: Full-stack MongoDB backend
• pynenc-rabbitmq: RabbitMQ broker (pairs with Redis for state/orchestrator/triggers)

License

This project is licensed under the MIT License - see the LICENSE file for details.