redis-unique-queue 0.0.4

A module that combines the use of redis in-built data types to build a unique queue for processing and expiry.

redis-unique-queue

A module that combines the use of redis in-built data types to build a unique queue for processing and expiry.

Usage

Items are put on the queue with an optional key. A duplicate key cannot be added until either: - the previous key that was added has been fully processed. - expiry_in_seconds have passed.

The unique queue creates 3 datastructures to ensure the keys are unique. To ensure the keys don’t linger after usage, all commands reset the ttl on the datastructures. Examples ——– .. code-block:: python

import time

import redis

import ruqueue

expiry_in_seconds = 1 conn = redis.Redis() uqueue = ruqueue.Queue(redis_conn=conn, expiry_in_seconds=expiry_in_seconds) uqueue.put(100) print(“Expected size 1:”, uqueue.qsize())

uqueue.put(100) # not added again print(“Expected size 1:”, uqueue.qsize())

uqueue.put(200) # not added again print(“Expected size 2:”, uqueue.qsize())

print(“Expected item 100:”, uqueue.get()) # get an item

time.sleep(expiry_in_seconds) # go past expiry seconds to test

# item 100 has expired

print(“Items that expired:”, uqueue.clear_expired()) # [100] -> a list of items that expires

print(“Expected size 1:”, uqueue.qsize())

print(“Expected item 200:”, uqueue.get()) # we have finished handling 200

uqueue.task_done(200) print(“Expected size 0:”, uqueue.qsize())

print(“Expected item None:”, uqueue.get())