django-celery-outbox 0.3.0

Transactional Outbox pattern for Celery tasks in Django

django-celery-outbox

Transactional Outbox pattern for Celery tasks in Django.

Features

• Durable persistence for committed task intents
• Duplicate-tolerant relay recovery
• Automatic retry with capped exponential backoff
• Dead letter queue for exhausted retries
• Structlog & Sentry trace propagation
• StatsD metrics
• Django admin integration

Quick Start

pip install django-celery-outbox

# settings.py
INSTALLED_APPS = [..., 'django_celery_outbox']
CELERY_OUTBOX_APP = 'myproject.celery.app'

# celery.py
from django_celery_outbox import OutboxCelery

app = OutboxCelery('myproject')

python manage.py migrate
python manage.py check
python manage.py celery_outbox_relay

Committed rows stay in the outbox until the relay publishes them or dead-letters them, but consumers still need to be idempotent. If the relay crashes after a broker publish and before cleanup, stale-timeout recovery can reclaim and resend the row. Stronger end-to-end guarantees still depend on broker confirms; without publisher confirms, the broker can fail ambiguously after Celery.send_task() returns.

Full Documentation →

Security

See Security Guide for PII handling, traceback logging, and DLQ retention.

License

MIT