Skip to main content

Yet Another python queue backed by redis; but modern and compliant

Project description

https://img.shields.io/pypi/v/yarqueue.svg https://img.shields.io/travis/clbarnes/yarqueue.svg Documentation Status

Yet Another python queue backed by redis; but modern and compliant

Heavily inspired by hotqueue.

Features

  • Compatible with the API of multiprocessing.Queue
  • LIFO, FIFO and Double-Ended variants
    • Each has a non-joinable and a joinable form (compatible with multiprocessing.JoinableQueue)
  • Additional convenience methods:
    • get_many(), put_many(), clear() for all queues
    • n_tasks() and n_in_progress() for joinable queues
  • Can be used as a context manager
    • Deletes the queue on exit
    • For Joinable variants, first waits for all tasks to be done
  • Can use custom serializers, or none at all
    • By default, uses the highest pickle protocol available, using the pickle5 backport if possible.
  • As thread-safe as the underlying Redis client instance
  • Simple queue watchers
    • yarqwatch: command-line progress bars for given queues
    • yarqserve: simple REST API and browser page for given queues

Credits

This package was created with Cookiecutter and the audreyr/cookiecutter-pypackage project template.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for yarqueue, version 0.4.1
Filename, size File type Python version Upload date Hashes
Filename, size yarqueue-0.4.1-py2.py3-none-any.whl (10.0 kB) File type Wheel Python version py2.py3 Upload date Hashes View hashes
Filename, size yarqueue-0.4.1.tar.gz (17.7 kB) File type Source Python version None Upload date Hashes View hashes

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN SignalFx SignalFx Supporter DigiCert DigiCert EV certificate StatusPage StatusPage Status page