Skip to main content

Postgres Broker for Huey Task Queue

Project description

=====================================
huey-pg -- Postgres Broker for Huey
=====================================

huey_ is a simple task queue implementation for Python. huey-pg provides a
Postgres-based implementation of a huey storage.

**The project is not feature complete yet.**


Features
========

- Super simple deployment.
- Stores messages in a single table.
- All data are wrapped in a dedicated schema.
- Uses LISTEN/NOTIFY to keep worker sync. No polling.
- Reliable thanks to Postgres MVCC.
- Using plain psycopg2. No ORM.


Installation
============

- Install huey-pg package from PyPI::

pip install huey-pg

- Apply ``huey-pg.sql`` file in your database::

psql -f huey-pg.sql

- Then use ``PostgresHuey`` class:

import psycopg2.pool
from huey_pg import PostgresHuey

pool = psycopg2.pool.ThreadedConnectionPool(0, 4, conninfo)
huey = Postgres(connection_pool=pool))

@huey.task
def hello(name):
print(f"Hello {name}!")

Roadmap
=======

- Process missed notifies while resuming worker.
- Functionnal tests.
- Result storage.
- Delayed & scheduled task.


.. _huey:: https://huey.rtfd.io/

Project details


Release history Release notifications

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Filename, size & hash SHA256 hash help File type Python version Upload date
huey_pg-0.1.0-py3-none-any.whl (6.0 kB) Copy SHA256 hash SHA256 Wheel py3
huey-pg-0.1.0.tar.gz (3.2 kB) Copy SHA256 hash SHA256 Source None

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN SignalFx SignalFx Supporter DigiCert DigiCert EV certificate StatusPage StatusPage Status page