Skip to main content

kamma is a very simplified Task File Queue

Project description

kamma is a very simplified task file queue that persists tasks and its needed data. It also has a worker that process all pending tasks.

Version Status Coverage License

Motivation

Nowadays local disk access is an undervalued resource for many reasons, however stored data is always available even after power outage. By contrast, network resources or remote third parties are not always ready. Is for this reason I developed the kamma in order to isolate dependent tasks from the miseries of remote services. kamma would try process all pending tasks forever respecting the queue order.

Limitations

Up to (sys.maxint - FileQue.max_head_index) items can hold the queue. Not recommended for high performance scenarios.

Install

As simple as:

pip install kamma

Example

import kamma
from kamma import task
from kamma.app import Kamma

# python 2 and 3 compatibility issue
try:
   input = raw_input
except NameError:
   pass

# kamma worker
app = Kamma()

# registering fibonacci callback in kamma app
@app.task_callback(timeout=5, retry_wait=task.wait_fixed(1),
                   retry_stop=task.stop_after_attempt(1))
def fibonacci(n, level=0):
    result = 1
    if n < 0 or n > 100:
        raise kamma.AbortTask("n has to be 0 <= n <= 100")
    if n > 1:
        result = fibonacci(n - 1, level=level + 1) + fibonacci(n - 2, level=level + 1)
    if level == 0:
        print("*** RESULT: fibonacci of '{}'' is '{}' ***".format(n, result))
    return result


if __name__ == "__main__":
    # start listening for incoming tasks
    app.run_async()
    print("Enter the value of the fibonacci you want to compute, 0 to exit")
    n = 1
    while True:
        n = int(input(""))
        if n == 0:
            break
        # add new fibonacci task
        app.push_task(fibonacci, n=n)
    app.stop()

The complete example here: examples/example.py

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

kamma-0.0.6.tar.gz (7.6 kB view hashes)

Uploaded Source

Built Distribution

kamma-0.0.6-py2.py3-none-any.whl (10.2 kB view hashes)

Uploaded Python 2 Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page