Skip to main content

Postgres Broker for Huey Task Queue

Project description

=====================================
huey-pg -- Postgres Broker for Huey
=====================================

huey_ is a simple task queue implementation for Python. huey-pg provides a
Postgres-based implementation of a huey storage.

**The project is not feature complete yet.**


Features
========

- Super simple deployment.
- Stores messages in a single table.
- All data are wrapped in a dedicated schema.
- Uses LISTEN/NOTIFY to keep worker sync. No polling.
- Reliable thanks to Postgres MVCC.
- Using plain psycopg2. No ORM.


Installation
============

- Install huey-pg package from PyPI::

pip install huey-pg

- Apply ``huey-pg.sql`` file in your database::

psql -f huey-pg.sql

- Then use ``PostgresHuey`` class:

import psycopg2.pool
from huey_pg import PostgresHuey

pool = psycopg2.pool.ThreadedConnectionPool(0, 4, conninfo)
huey = Postgres(connection_pool=pool))

@huey.task
def hello(name):
print(f"Hello {name}!")

Roadmap
=======

- Process missed notifies while resuming worker.
- Functionnal tests.
- Result storage.
- Delayed & scheduled task.


.. _huey:: https://huey.rtfd.io/

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

huey-pg-0.1.0.tar.gz (3.2 kB view hashes)

Uploaded Source

Built Distribution

huey_pg-0.1.0-py3-none-any.whl (6.0 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page