traxix.rsq 0.2.8

No project description provided

rsq

Really Simple Queue is a really simple queue. It allows to push work in an async queue. Workers can consume that queue, and submit results.

Requirements

• Mongo >= 3

Usage

Python

from traxix.rsq import RSQ, Const

# Init
rsq = RSQ(mongo_url="localhost")

# Push work
rsq.push(foo="bar")

# Get work
work = rsq.pull()

# Send result
rsq.done(_id=work[Const.ID], result=42)

Example (hello_world.py)

from traxix.rsq import RSQ, Const

# Init
rsq = RSQ(mongo_url="mongodb://172.17.0.2:27017", db_name="hello_word")

# Create 2 tasks
task_id_1 = rsq.push(payload=2)
task_id_2 = rsq.push(payload=3)

# List tasks
rsq.print_tasks()

while work := rsq.pull():
    print("pulled>", work)

    payload = work[Const.DATA]["payload"]
    if payload % 2 == 0:
        rsq.done(_id=work[Const.ID], result="even")
    else:
        # simulating a fail
        rsq.done(_id=work[Const.ID], success=False, result="odd")

    
# List tasks DONE
print("tasks>done>", rsq.list_tasks(state=Const.State.DONE))
print("tasks>fail>", rsq.list_tasks(state=Const.State.FAIL))

# cleanup
rsq.remove(_id=Const.REMOVE_EVERYTHING)

Cli

$ python3 rsq.py list_tasks
$ python3 rsq.py push --foo=bar 
61128c086f94b0d168e6a339
$ python3 rsq.py list_tasks
{'_id': ObjectId('61128c086f94b0d168e6a339'), 'state': 'todo', 'data': {'foo': 'bar'}}
$ python3 rsq.py pull -- -v # fire remove keys beginning with "_" hence the -v
_id: 61128c086f94b0d168e6a339
data: {"foo": "bar"}
$ python3 rsq.py done 61128c086f94b0d168e6a339 42
$ python3 rsq.py list_tasks
{'_id': ObjectId('61128c086f94b0d168e6a339'), 'state': 'done', 'data': {'foo': 'bar'}, 'result': 42}

Install

pip install traxix.rsq