Barebones async-powered message queue on python with psycopg (v3)

Navigation

Verified details

These details have been verified by PyPI
Project links
GitHub Statistics
Maintainers
Avatar for amithkk from gravatar.com amithkk

Unverified details

These details have not been verified by PyPI
Meta
  • License: MIT License (MIT)
  • Author: Amith K K
  • Requires: Python <4.0, >=3.11
Classifiers

Project description

PG-AsynQ

PG-AsynQ is a Python library that provides an asynchronous transaction/message queue based on PostgreSQL. It is inspired by pq, but is built for use in asynchronous contexts such as FastAPI, and uses psycopg 3.x for database access.

Non blocking queuing is implemented with a combination of LISTEN/NOTIFY and SKIP LOCKED. This means that this library is safe to use across multiple containers/processes without duplicated processing of messages.

How to use

  1. Ensure you create the tables in migrations using your preferred migration tool
  2. See the examples for how to use the library

Features

  • Create and consume queues dynamically at runtime
  • Consume queue from any number of consumers
  • Retain messages until a consumer connects
  • In-order processing of messages
  • Message retention policies (delete older than x)

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page