firm-queue

Database-backed background jobs for Python — a pure-Python port of Rails' Solid Queue. No Redis required: jobs live in your existing SQLite, PostgreSQL, or MySQL/MariaDB database.

Part of firm, a port of the Rails 8 Solid stack.

pip install firm-queue
pip install "firm-queue[postgres]"  # with the PostgreSQL driver

Quickstart

import firm.queue as bq

bq.configure(database_url="postgresql://localhost/myapp")


@bq.job()
def greet(name):
    print(f"hi {name}")


greet.enqueue("Ada")

Then run the workers:

firm-queue start --import myapp.jobs

(Create the schema first with schema.create_all() or the bundled Alembic migrations — see Getting started.)

Highlights

• Concurrency controls — limit how many jobs with the same key run at once
• Recurring tasks — cron-style schedules, enqueued exactly once per tick
• Retries & failure handling — configurable retry/discard policies with backoff
• Forked or threaded supervisor — with heartbeats and crash recovery
• Flask and FastAPI integrations via firm-queue[flask] / firm-queue[fastapi]

Docs

• Queue overview
• Defining jobs
• Workers & the supervisor
• All firm documentation

MIT licensed. Schema and design derived from Solid Queue (© 37signals, MIT); see NOTICE.