Skip to main content

Celery integration for Vercel Queue and Runtime Cache

Project description

vercel-celery-bundle

This is a version of vercel-celery with third-party dependencies bundled. For normal use, install the unbundled vercel-celery package instead: https://pypi.org/project/vercel-celery/

vercel-celery

Celery integration for Vercel Queue Service and Vercel Runtime Cache.

This package provides a Celery broker transport backed by Vercel Queue Service and a Celery result backend backed by Vercel Runtime Cache.

from vercel.integrations.celery import install_vercel_celery_integration

install_vercel_celery_integration()

By default, named Celery apps publish to app-prefixed Vercel Queue topics. For example, Celery("my_app") maps Celery queue emails to the Vercel Queue topic celery-my__app-emails after Vercel Queue name sanitization. Apps with no name use unprefixed topics. To override this, set broker_transport_options = {"queue_name_prefix": "jobs-"}. Set queue_name_prefix to "" to use Celery queue names as Vercel Queue topics.

The broker's Vercel Queue consumer group defaults to celery. Workers sharing the same Vercel Queue topic and consumer group compete for tasks. Workers using the same topic with different consumer groups receive fan-out copies. To override it, set broker_transport_options = {"consumer_group": "workers"}.

The installer sets Celery's default broker_url to vercel:// when Celery has no broker default configured. Pass set_default_broker=False to opt out. It also sets Celery's default result_backend to vercel-runtime-cache:// when Celery has no result backend configured. Pass set_default_result_backend=False to opt out.

vercel:// uses push delivery when VERCEL is truthy in the environment and poll delivery otherwise. Set broker_url = "vercel-push://" to force push delivery, or broker_url = "vercel-poll://" for forced polling workers, local workers, and background workers.

Pass register_queues=False to skip automatic Vercel Queue trigger registration. When using that mode, manually register each Celery app whose queues should receive Vercel Queue push deliveries:

from vercel.integrations.celery import register_celery_app_queues

register_celery_app_queues(app)

To customize Celery task result storage in Vercel Runtime Cache, configure Celery's result backend transport options:

result_backend_transport_options = {
    "namespace": "celery-results",
    "ttl": 3600,
}

By default, named Celery apps use an app-scoped Runtime Cache namespace. For example, Celery("my_app") stores results under celery-results-my_app. Apps with no name use celery-results. If producers and workers use different Celery app names, configure a shared explicit namespace.

The Runtime Cache backend uses vercel.cache, including its normal key hashing, namespacing, and local in-memory fallback when Runtime Cache is unavailable. Celery result backends are not required to retain results indefinitely; results may expire according to Celery's result expiration settings or the backend's own retention behavior. This backend is therefore an expiring, cache-backed result backend rather than durable result storage. Celery treats missing result entries as pending results. By default, stored results use Celery's result_expires value as their Runtime Cache TTL; set result_backend_transport_options["ttl"] to override that retention period.

JSON result serialization works normally. Binary serializers, including pickle, are stored through an internal base64 wrapper so Runtime Cache only receives JSON-compatible values.

Runtime Cache is a single-key cache API, so this backend does not provide native bulk result fetches or increment-backed chord counters. Result availability is limited by Runtime Cache retention and eviction behavior.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

vercel_celery_bundle-0.7.1.tar.gz (18.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

vercel_celery_bundle-0.7.1-py3-none-any.whl (19.1 kB view details)

Uploaded Python 3

File details

Details for the file vercel_celery_bundle-0.7.1.tar.gz.

File metadata

  • Download URL: vercel_celery_bundle-0.7.1.tar.gz
  • Upload date:
  • Size: 18.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.29 {"installer":{"name":"uv","version":"0.11.29","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for vercel_celery_bundle-0.7.1.tar.gz
Algorithm Hash digest
SHA256 7e8b2f91ad8ee2c05b487489fca98e1c01c87dd0d687be374fa137624772ca36
MD5 e63a8f6345eb5ada8a4bf72c111c469f
BLAKE2b-256 f1332f3c0bcc3bd3219e8bb6d4e8be98b6266d3ea29e5eb196c34667f9315dab

See more details on using hashes here.

File details

Details for the file vercel_celery_bundle-0.7.1-py3-none-any.whl.

File metadata

  • Download URL: vercel_celery_bundle-0.7.1-py3-none-any.whl
  • Upload date:
  • Size: 19.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.29 {"installer":{"name":"uv","version":"0.11.29","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for vercel_celery_bundle-0.7.1-py3-none-any.whl
Algorithm Hash digest
SHA256 50856068384005863b99d148c0d4852323cc36ef45b9ca4129a573697cf0646e
MD5 fde458a62999f0facfd0aa6c0182752e
BLAKE2b-256 1ca35c8e84f429954376bd2ba2153a154005829360a63c5b082aaf74aa8f0f16

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page