Skip to main content

Asynchronous message dispatcher for concurrent tasks processing

Project description

PyPI latest PyPI Version PyPI License Docs

CI Build Status Coverage Status Requirements Status Scrutinizer Code Quality Code Climate


Loafer is an asynchronous message dispatcher for concurrent tasks processing.

Currently, only AWS SQS is supported

Features:

  • Encourages decoupling from message providers and consumers
  • Easy to extend and customize
  • Easy error handling, including integration with sentry
  • Easy to create one or multiple services
  • Generic Handlers
  • Amazon SQS integration

It requires Python 3.6+ and is very experimental at the moment, expect a lot of changes until the first major version.

Example

A simple message forwader, from source-queue to destination-queue:

from loafer.ext.aws.handlers import SQSHandler
from loafer.ext.aws.routes import SQSRoute
from loafer.managers import LoaferManager


routes = [
    SQSRoute('source-queue', handler=SQSHandler('destination-queue')),
]


if __name__ == '__main__':
    manager = LoaferManager(routes)
    manager.run()

Documentation

Check out the latest Loafer full documentation at Read the Docs website.

Changelog:

2.0.0 (2020-05-16)

  • Dropped support for Python 3.5
  • Added support for Python 3.8
  • Update aiobotocore dependency version (#61 by @GuilhermeVBeira)
  • Improvements due to changes in asyncio (#48, #52 by @lamenezes)
  • Sentry wrapper/helper updated to support new sdk (wip)
  • Minor documentation improvements

1.3.2 (2019-04-27)

  • Improve message processing (#48 by @lamenezes)
  • Improve error logging (#39 by @wiliamsouza)
  • Refactor in message dispatcher and event-loop shutdown
  • Minor fixes and improvements

1.3.1 (2017-10-22)

  • Improve performance (#35 by @allisson)
  • Fix requirement versions resolution
  • Minor fixes and improvements

1.3.0 (2017-09-26)

  • Refactor tasks dispatching, it should improve performance
  • Refactor SQSProvider to ignore HTTP 404 errors when deleting messages
  • Minor fixes and improvements

1.2.1 (2017-09-11)

  • Bump boto3 version (by @daneoshiga)

1.2.0 (2017-08-15)

  • Enable provider parameters (boto client options)

1.1.1 (2017-06-14)

  • Bugfix: fix SNS prefix value in use for topic name wildcard (by @lamenezes)

1.1.0 (2017-05-01)

  • Added initial contracsts for class-based handlers
  • Added generic handlers: SQSHandler/SNSHander
  • Improve internal error handling
  • Improve docs

1.0.2 (2017-04-13)

  • Fix sentry error handler integration

1.0.1 (2017-04-09)

  • Add tox and execute tests for py36
  • Update aiohttp/aiobotocore versions
  • Minor fixes and enhancements

1.0.0 (2017-03-27)

  • Major code rewrite
  • Remove CLI
  • Add better support for error handlers, including sentry/raven
  • Refactor exceptions
  • Add message metadata information
  • Update message lifecycle with handler/error handler return value
  • Enable execution of one service iteration (by default, it still runs “forever”)

0.0.3 (2016-04-24)

  • Improve documentation
  • Improve package metadata and dependencies
  • Add loafer.aws.message_translator.SNSMessageTranslator class
  • Fix ImportError exceptions for configuration that uses loafer.utils.import_callable

0.0.2 (2016-04-18)

  • Fix build hardcoding tests dependencies

0.0.1 (2016-04-18)

  • Initial release

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for loafer, version 2.0.0
Filename, size File type Python version Upload date Hashes
Filename, size loafer-2.0.0-py3-none-any.whl (14.0 kB) File type Wheel Python version py3 Upload date Hashes View
Filename, size loafer-2.0.0.tar.gz (12.9 kB) File type Source Python version None Upload date Hashes View

Supported by

Pingdom Pingdom Monitoring Google Google Object Storage and Download Analytics Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page