Asynchronous message dispatcher for concurrent tasks processing
Project description
Loafer is an asynchronous message dispatcher for concurrent tasks processing.
Currently, only AWS SQS is supported
Features:
Encourages decoupling from message providers and consumers
Easy to extend and customize
Easy error handling, including integration with sentry
Easy to create one or multiple services
Generic Handlers
Amazon SQS integration
It requires Python 3.7+
Example
A simple message forwader, from source-queue to destination-queue:
from loafer.ext.aws.handlers import SQSHandler
from loafer.ext.aws.routes import SQSRoute
from loafer.managers import LoaferManager
routes = [
SQSRoute('source-queue', handler=SQSHandler('destination-queue')),
]
if __name__ == '__main__':
manager = LoaferManager(routes)
manager.run()
Documentation
Check out the latest Loafer full documentation at Read the Docs website.
Changelog:
3.0.0 (2020-10-20)
Add support for python 3.9
Drop support for python 3.5 and 3.6
2.0.0 (2020-07-02)
Inicial fork release(test)
2.0.0+post1 (2020-05-26)
Use sentry_sdk
1.3.2+post3 (2020-04-27)
Improve shut down methods
1.3.2+post2 (2020-04-14)
Update aiobotocore client
1.3.2+post1 (2019-04-27)
Update dependencies
Update makefile for olist build
1.3.2 (2019-04-27)
Improve message processing (#48 by @lamenezes)
Improve error logging (#39 by @wiliamsouza)
Refactor in message dispatcher and event-loop shutdown
Minor fixes and improvements
1.3.1 (2017-10-22)
Improve performance (#35 by @allisson)
Fix requirement versions resolution
Minor fixes and improvements
1.3.0 (2017-09-26)
Refactor tasks dispatching, it should improve performance
Refactor SQSProvider to ignore HTTP 404 errors when deleting messages
Minor fixes and improvements
1.2.1 (2017-09-11)
Bump boto3 version (by @daneoshiga)
1.2.0 (2017-08-15)
Enable provider parameters (boto client options)
1.1.1 (2017-06-14)
Bugfix: fix SNS prefix value in use for topic name wildcard (by @lamenezes)
1.1.0 (2017-05-01)
Added initial contracsts for class-based handlers
Added generic handlers: SQSHandler/SNSHander
Improve internal error handling
Improve docs
1.0.2 (2017-04-13)
Fix sentry error handler integration
1.0.1 (2017-04-09)
Add tox and execute tests for py36
Update aiohttp/aiobotocore versions
Minor fixes and enhancements
1.0.0 (2017-03-27)
Major code rewrite
Remove CLI
Add better support for error handlers, including sentry/raven
Refactor exceptions
Add message metadata information
Update message lifecycle with handler/error handler return value
Enable execution of one service iteration (by default, it still runs “forever”)
0.0.3 (2016-04-24)
Improve documentation
Improve package metadata and dependencies
Add loafer.aws.message_translator.SNSMessageTranslator class
Fix ImportError exceptions for configuration that uses loafer.utils.import_callable
0.0.2 (2016-04-18)
Fix build hardcoding tests dependencies
0.0.1 (2016-04-18)
Initial release
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file olist-loafer-3.0.0.tar.gz
.
File metadata
- Download URL: olist-loafer-3.0.0.tar.gz
- Upload date:
- Size: 13.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.2.0 pkginfo/1.6.0 requests/2.24.0 setuptools/49.2.1 requests-toolbelt/0.9.1 tqdm/4.50.2 CPython/3.9.0
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5b537209e2efb31720cb4fcdbe2a7f67a5ca11c06a063a76f4c5bc2b9af5e33e |
|
MD5 | 70b63fbc4a613e0c3eb7814b3d62104c |
|
BLAKE2b-256 | dabe475bf4b748e3c40ac89ce8d0100d6119c7f6d0e547a4f33104254c8a6368 |
File details
Details for the file olist_loafer-3.0.0-py3-none-any.whl
.
File metadata
- Download URL: olist_loafer-3.0.0-py3-none-any.whl
- Upload date:
- Size: 14.2 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.2.0 pkginfo/1.6.0 requests/2.24.0 setuptools/49.2.1 requests-toolbelt/0.9.1 tqdm/4.50.2 CPython/3.9.0
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | bb955519bb14c6e9e131abae83b47b364aac775b1527dc89d8c6f83bf2e1b81b |
|
MD5 | 55a7b90cf07ef9de248cf09e103dc0e0 |
|
BLAKE2b-256 | d2859a68ef0c639c327275581dfb2b9c83c181c4d111d06c043675673e42fbc1 |