Skip to main content

A task queue for Python based on Redis Streams.

Project description

Fennel

A task queue for Python 3.7+ based on Redis Streams with a Celery-like API.

https://fennel.dev/

Note: This is an alpha release. The project is under development, breaking changes are likely.

Features

  • Supports both sync (e.g. Django, Flask) and async (e.g. Starlette, FastAPI) code.
  • Sane defaults: at least once processing semantics, tasks acknowledged on completion.
  • Automatic retries with exponential backoff for fire-and-forget jobs.
  • Clear task statuses available (e.g. sent, executing, success).
  • Automatic task discovery (defaults to using **/tasks.py).
  • Exceptionally small and understandable codebase.

Installation

pip install fennel

Basic Usage

Run Redis and then execute your code in tasks.py:

from fennel import App

app = App(name='myapp', redis_url='redis://127.0.0.1')


@app.task
def foo(n):
    return n


# Enqueue a task to be executed in the background by a fennel worker process.
foo.delay(7)

Meanwhile, run the worker:

$ fennel worker --app tasks:app

Asynchronous API

Fennel also supports an async API. If your code is running in an event loop (e.g. via Starlette or FastAPI), you will want to use the async interface instead:

from fennel import App

app = App(name='myapp', redis_url='redis://127.0.0.1', interface='async')


@app.task
async def bar(x):
    return x


await bar.delay(5)

See also

If you need to ensure that all tasks for a given key are processed in-order, please see our sister project Runnel.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for fennel, version 0.3.0
Filename, size File type Python version Upload date Hashes
Filename, size fennel-0.3.0-py3-none-any.whl (34.7 kB) File type Wheel Python version py3 Upload date Hashes View
Filename, size fennel-0.3.0.tar.gz (23.9 kB) File type Source Python version None Upload date Hashes View

Supported by

Pingdom Pingdom Monitoring Google Google Object Storage and Download Analytics Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page