z4j-celery

The Celery engine adapter for z4j.

Streams supported task lifecycle events from your Celery workers to the z4j brain and accepts operator control actions from the dashboard. Pair with z4j-celerybeat to manage periodic / cron schedules.

Compatibility

• Celery 5.2.2+ (no upper cap)
• Python 3.11+

Full per-adapter matrix at https://docs.z4j.com/reference/compatibility/.

What it ships

The widest feature coverage of any z4j engine adapter, Celery's remote-control surface provides controls other engines cannot expose. Worker-control broadcasts do not acknowledge execution: verify the worker state afterward. pool_restart is intended for prefork deployments; Celery's gevent and eventlet pools do not support it reliably.

Install

pip install z4j-celery z4j-celerybeat

Pair with a framework adapter:

pip install z4j-django  z4j-celery z4j-celerybeat   # Django
pip install z4j-flask   z4j-celery z4j-celerybeat   # Flask
pip install z4j-fastapi z4j-celery z4j-celerybeat   # FastAPI
pip install z4j-bare    z4j-celery z4j-celerybeat   # framework-free worker

Pairs with

• z4j-celerybeat, schedule adapter for Celery Beat / django-celery-beat

Retry prerequisites

Retry uses original arguments from Celery's result backend when available. Enable result_extended=True (CELERY_RESULT_EXTENDED=True with Django's CELERY namespace) to store them, and configure a result backend. Those original values are stored outside z4j's redaction layer; apply the backend's access and retention controls. If arguments are unavailable, provide both args and kwargs explicitly. The adapter refuses to replay a task using incomplete or redacted arguments.

Reliability

• Lifecycle-capture failures are isolated from Celery workers and signal handlers; capture hooks make no brain network request inline.
• The in-process event queue and SQLite outbound buffer are bounded. A full queue evicts its oldest queued event to admit the new one, up to three times. Queue overflow drops new events only if that cannot make room. Buffer pressure evicts oldest rows. Every loss is logged.

Documentation

Full docs at docs.z4j.com/engines/celery/.

License

Apache-2.0, see LICENSE.

Links

• Homepage: https://z4j.com
• Documentation: https://docs.z4j.com
• PyPI: https://pypi.org/project/z4j-celery/
• Issues: https://github.com/z4jdev/z4j-celery/issues
• Changelog: CHANGELOG.md
• Security: security@z4j.com (see SECURITY.md)