aiodiskqueue 0.1.0b7

Persistent queue for Python AsyncIO.

Persistent queue for Python AsyncIO.

Description

This library provides a persistent FIFO queue for Python AsyncIO:

• Queue content can persist a process restart

• Feature parity with Python’s asyncio.Queue

• Similar API to Python’s asyncio.Queue

• Sane logging

• Type hints

• Fully tested

• Supports different storage engines

Usage

Here is a basic example on how to use the queue:

import asyncio
from aiodiskqueue import Queue

async def main():
    q = await Queue.create("example_queue.sqlite")
    await q.put("some item")
    item = await q.get()
    print(item)

asyncio.run(main())

Please see the examples folder for more usage examples.

Installation

You can install this library directly from PyPI with the following command:

pip install aiodiskqueue

storage Engines

Support different storage engines. The default engine is DbmEngine.

• DbmEngine: Stores the queue in a DBM database. Consistent throughput even at higher volumes and much faster then Sqlite

• SqliteEngine: Stores the queue in a SQlite database. Consistent throughput even at higher volumes and also process safe

• PickledList: Stores the queue in a pickled list. Very fast at smaller volumes, but does not scale well

• PickleSequence: Stores the queue in a list of pickled items. Very fast for putting and at smaller volumes, does not scale well