Message Queue Based Service
from mq4hemc import HemcMessage, HemcService
HemcService - a class to create a separate thread which is extracting messages
from the message queue and passes them to user callback for processing.
It has a thread-safe methods to add messages to the queue synchronously
(wait until processed) and asynchronously.
HemcMessage - a dataclass to inherit from to create a custom message.
Usage
Define a custom class for the messages:
@dataclass
class BigHemcMessage(HemcMessage):
payload: dict = field(default_factory=dict)
Create a service which is running in a separate thread and processes messages from the message queue:
service = HemcService()
Register a callback function to process messages from the message queue:
def process_cb(item: HemcMessage):
if hasattr(item, 'payload') and item.payload is not None:
# Simulate processing time
time.sleep(1)
logger.info(f"Processed message '{item.type}', payload: {item.payload}")
return item.type
service.register_process_cb(process_cb)
A callback method could also be passed to the constructor:
service = HemcService(process_cb)
Start a service:
service.start()
Send messages from another thread asynchronously (without waiting until the message is processed)
for i in range(3):
message = BigHemcMessage()
message.type = f"test{i}"
message.payload = {"key": f"value{i}"}
logger.info(f"Send {message.type} and do not wait for reply.")
status = service.send_async_msg(message)
Send a message from another thread synchronously (wait until the message is processed) and get the response from callback method.
message = BigHemcMessage()
message.type = "test_sync"
message.payload = {"key": "value"}
logger.info(f"Now send {message.type} and wait for reply...")
status = service.send_sync_msg(message)
logger.info(f"Message {message.type} processed, reply: {status}")
Stop the service.
service.stop()
service.join()
logger.info("Service stopped.")
This code will produce the following output. Please pay attention to the test_sync timestamps.
2024-05-02 14:39:28 - test_mq4hemc - INFO - Send test0 and do not wait for reply.
2024-05-02 14:39:28 - test_mq4hemc - INFO - Send test1 and do not wait for reply.
2024-05-02 14:39:28 - test_mq4hemc - INFO - Send test2 and do not wait for reply.
2024-05-02 14:39:28 - test_mq4hemc - INFO - Now send test_sync and wait for reply...
2024-05-02 14:39:29 - test_mq4hemc - INFO - Processed message 'test0'
2024-05-02 14:39:30 - test_mq4hemc - INFO - Processed message 'test1'
2024-05-02 14:39:31 - test_mq4hemc - INFO - Processed message 'test2'
2024-05-02 14:39:32 - test_mq4hemc - INFO - Processed message 'test_sync'
2024-05-02 14:39:32 - test_mq4hemc - INFO - Message test_sync processed, reply: test_sync
2024-05-02 14:39:32 - test_mq4hemc - INFO - Service stopped.
Yocto recipes
Use the following bitbake recipes python3-mq4hemc_0.0.20.bb to install mq4hemc package:
From github.com:
DESCRIPTION = "Message Queue Based Service"
HOMEPAGE = "https://github.com/oshevchenko/mq4hemc"
LICENSE = "MIT"
LIC_FILES_CHKSUM = "file://LICENSE;md5=bd6d2057bbfc3f9442bc4dfd9a7c4580"
SRC_URI = "git://github.com/oshevchenko/mq4hemc.git;protocol=https"
SRCREV = "75a10cfbf3e16c6a2491b2295d4d4d63f4a952f1"
S = "${WORKDIR}/git"
inherit setuptools3
do_configure:prepend() {
cp ${S}/setup_git.txt ${S}/setup.py
}
From PyPi
DESCRIPTION = "Message Queue Based Service"
HOMEPAGE = "https://github.com/oshevchenko/mq4hemc"
LICENSE = "MIT"
LIC_FILES_CHKSUM = "file://LICENSE;md5=bd6d2057bbfc3f9442bc4dfd9a7c4580"
PYPI_PACKAGE = "mq4hemc"
SRC_URI[md5sum] = "5317fbdc5cc857b70f622005730ef66f"
inherit pypi setuptools3
do_configure:prepend() {
cp ${S}/setup_pypi.txt ${S}/setup.py
}
Metadata
Release files for mq4hemc 0.2.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| mq4hemc-0.2.0.tar.gz | 13.5 kB | Without provenance | Details for mq4hemc-0.2.0.tar.gz |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| mq4hemc-0.2.0-py3-none-any.whl | Python 3 | none | any | Details for mq4hemc-0.2.0-py3-none-any.whl |
Total release size: 20.8 kB
Release files / mq4hemc-0.2.0.tar.gz
| Download URL | mq4hemc-0.2.0.tar.gz |
|---|---|
| Size | 13.5 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
6a9882c3e80c1ce7721668fad7a1582af7c30c50e345ed52c9cad51136c0f54b
|
|
BLAKE2b-256 checksum How to use checksums |
47ab7b3dfe08adb54c7b7744f0e4563191a848286f45478388260bb2eaed6dbb
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/5.0.0 CPython/3.8.10
|
Release files / mq4hemc-0.2.0-py3-none-any.whl
| Download URL | mq4hemc-0.2.0-py3-none-any.whl |
|---|---|
| Size | 7.2 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
3d79305c31a5dc846810e60434fbe26e50c467511948d8910ff0003038b3d109
|
|
BLAKE2b-256 checksum How to use checksums |
1754639f1b3e1c012126ebd49af6622640db15176b32771dd4276b28925a463d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/5.0.0 CPython/3.8.10
|
Security for mq4hemc 0.2.0
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.