Skip to main content

This module provides a framework for handling and processing asynchronous tasks through message queues.

Project description

Message Queue Tasks

This module provides a framework for handling and processing asynchronous tasks through message queues.


Overview

  • Utilizes the aio_pika library for AMQP message processing.
  • Offers easy-to-use decorators and methods for defining tasks, producing and consuming them.
  • Built with asynchronous patterns to allow seamless scalability.

Requirements

  • Python 3.11+
  • aio_pika library
  • RabbitMQ or other AMQP broker

Usage

1. Defining a Task

To define a task, instantiate the MqTasks object and use the task decorator:

import mqtasks

mq_tasks = MqTasks(amqp_connection="amqp://localhost", queue_name="my_queue")

@mq_tasks.task(name="my_task")
def my_task_function(ctx: MqTaskContext):
    # Process task
    pass

mq_tasks.run()

2. Sending a Task

Instantiate MqTasksClient and use it to send a task:

import asyncio
import mqtasks

client = MqTasksClient(
    loop=asyncio.get_event_loop(),
    amqp_connection="amqp://localhost"
)

# define channel
channel = await client.queue(queue_name="my_queue")

#
result = await channel.request_task_async(task_name="my_task", body={"message": "hello world"})

Examples:

How to start example:

  • Work dir: ./example
    • cd ./example
  • Start RabbitMQ
    1. docker pull rabbitmq:management
    2. docker run -d --name rabbitmq -p 5672:5672 -p 15672:15672 rabbitmq:management
  • Access the RabbitMQ management web UI:
    • http://localhost:15672/
  • By default, the credentials are:
    • Username: guest
    • Password: guest
  • Server
    • python example_server.py
  • Client
    • python example_client.py

Release

make a release/x.x.x branch, up the version and commit

change the minor version 0.X.0

./scripts/release.sh minor

change the patch version 0.0.X

./scripts/release.sh patch

merge the release/x.x.x branch into the master and the develop branch

./scripts/merge.sh

License

MIT License

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

mqtasks-0.1.0.tar.gz (12.2 kB view details)

Uploaded Source

Built Distribution

mqtasks-0.1.0-py3-none-any.whl (16.3 kB view details)

Uploaded Python 3

File details

Details for the file mqtasks-0.1.0.tar.gz.

File metadata

  • Download URL: mqtasks-0.1.0.tar.gz
  • Upload date:
  • Size: 12.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.11.10

File hashes

Hashes for mqtasks-0.1.0.tar.gz
Algorithm Hash digest
SHA256 7a5e030cc224ddf43aa596490039b5133afcaad4f3a6d4a5779efbd6d9f855f6
MD5 2ff256e8d91e2a870a5da6d9ca4f2536
BLAKE2b-256 d50f65efd9f2df3fce3dbe79eb4d9d662692612aea137af57630094afa440c54

See more details on using hashes here.

File details

Details for the file mqtasks-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: mqtasks-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 16.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.11.10

File hashes

Hashes for mqtasks-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 b42da54c85a914bf9c18619d3610722a35d1afcf93ecde49d01e3e126ae8eaea
MD5 d8e58e98f08aa8f6fc7fbcc9423648a4
BLAKE2b-256 435fd8e8aeb6eca43c02edeb6c88f7b53fb667f5d0aded816b8f9d75cee25e3e

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page