Skip to main content

simplistic asyncio-based framework for loosely coupling application modules that can interact synchronously and asynchronously (event queue)

Project description

LooselyCoupled

Simplistic asyncio-based framework for loosely coupling application modules that can interact synchronously and asynchronously (via event queue)

For instance in smarthome applications, there are different components that need to operate quite independently. One component is responsible for communication over a serial bus like RS232, another component for managing the I2C bus, another component does KNX, another component provides a web frontend to the user, another component acts as a controller with the business logic of the application. In such a scenario, it is beneficial to have quite independent application modules with powerful communication facilities between them: synchronous calls, asynchronous calls and a publish/subscribe mechanism for notifications to possible multiple receivers. I faced such a scenario many years ago when Python3 was still young. I solved the requirement with some code that I have reused many times since then. This project is a reimplementation based on Python's asyncio framework while still supporting non-asyncio code and threading. It provides everything that in my experience is needed all the time for applications with loosely-coupled functionality.


Features

  • Manage the lifecycle (from startup to active to shutdown) of independent application modules (implemented as classes).
  • Capability to call methods in other modules synchronously.
  • Capability to call methods in other modules asynchronously by adding them as tasks into a queue that is getting processed.
  • Capability to trigger events that are broadcast asynchronously to all modules subscribing to the event notifications by simply implementing a on_<eventname> method.
  • Uses a simple addressing scheme for calling methods: <modulename>.<methodname>.
  • Support of calling asyncio coroutines and regular methods.
  • Calling methods and enqueuing tasks and events can be done in a threadsafe manner thus supporting threaded code.
  • The event queue supports priorities.
  • Facility to react on the event queue becoming empty, i.e. the application becoming idle.
  • Contains code for commonly needed stuff like logging, keeping configuration in a yaml configuration file, custom exception handling, and subscribing to signals.
  • Example code for often used modules provided, e.g. controller, CherryPy webserver, GPIO management via gpiod with generic support of input and output (incl. blinking).
  • Very lightweight due to small and manageable code base.

Installation

Install using PyPi:

pip3 install looselycoupled

Quickstart

Learning by example

Look at the code in the 'example' folder and adapt it as needed. The modules to be used are defined in the provided 'main.py'. You may adapt it to your needs.

Basic concepts

Modules are created by subclassing "Module" (defined in "module.py"). If you want to create a module that uses separate threads, you may subclass the extended "ModuleThreaded" (defined in "module_threaded.py") that makes it easy.

Modules are managed by an instance of "ModuleManager" that manages the lifecycle of the modules and provides common facilities like the task/event queue, exception handling and logging, and the asyncio event loop. The queue is used for asynchronous calls and event notifications to and between modules.

In each module, three pairs of methods are available for interacting with other modules:

1. Calling methods of other modules synchronously:

  • async def exec_task(self, task, **kwargs)
    Coroutine for immediately executing the task <modulename>.<methodname> and returning its result.
  • def exec_task_threadsafe(self, task, **kwargs)
    Regular method for doing that; can safely be called from any thread.

2. Calling methods of other modules asynchronously:

  • async def enqueue_task(self, task, **kwargs)
    Coroutine for scheduling a call to <modulename>.<methodname> by putting it into the execution queue.
  • def enqueue_task_threadsafe(self, task, **kwargs)
    Regular method for doing that; can safely be called from any thread.

3. Triggering an event that gets notified to any module listening for it by implementing an on_<eventname> method:

  • async def trigger_event(self, event, **kwargs)
    Trigger an event that is put into the execution queue for broadcast.
  • def trigger_event_threadsafe(self, event=None, **kwargs)
    Regular method for doing that; can safely be called from any thread.

Reporting bugs

In case you encounter any bugs, please report the expected behavior and the actual behavior so that the issue can be reproduced and fixed.


Developers

Clone repository

Clone this repo to your local machine using https://github.com/towalink/looselycoupled.git

Install the module temporarily to make it available in your Python installation:

pip3 install -e <path to root of "src" directory>

License

License

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

looselycoupled-0.5.0.tar.gz (43.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

looselycoupled-0.5.0-py3-none-any.whl (47.8 kB view details)

Uploaded Python 3

File details

Details for the file looselycoupled-0.5.0.tar.gz.

File metadata

  • Download URL: looselycoupled-0.5.0.tar.gz
  • Upload date:
  • Size: 43.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.12.9

File hashes

Hashes for looselycoupled-0.5.0.tar.gz
Algorithm Hash digest
SHA256 2f147c624d6c304eceb39fafe54fd855bb3c70be68d00bf7dd1f752a29a1b985
MD5 aa1eb1e4e760c43b82848cc7b7bd3666
BLAKE2b-256 0e5cf7f295af76402315d46fd2e0c405cfbae36abaebf29543f2c60256ecbaa6

See more details on using hashes here.

File details

Details for the file looselycoupled-0.5.0-py3-none-any.whl.

File metadata

  • Download URL: looselycoupled-0.5.0-py3-none-any.whl
  • Upload date:
  • Size: 47.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.12.9

File hashes

Hashes for looselycoupled-0.5.0-py3-none-any.whl
Algorithm Hash digest
SHA256 6bb30229ba687de0acc335eae961c36308f2dbc3fbbf5bd8e49efea00d75c28a
MD5 8f691d9e58ff93e75c6f975f148100dd
BLAKE2b-256 0ac34aecf886ed2e7171253425d9980f941d84676e285d15b3e89ce7db409c6e

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page