Skip to main content

simplistic asyncio-based framework for loosely coupling application modules that can interact synchronously and asynchronously (event queue)

Project description

LooselyCoupled

Simplistic asyncio-based framework for loosely coupling application modules that can interact synchronously and asynchronously (via event queue)

For instance in smarthome applications, there are different components that need to operate quite independently. One component is responsible for communication over a serial bus like RS232, another component for managing the I2C bus, another component does KNX, another component provides a web frontend to the user, another component acts as a controller with the business logic of the application. In such a scenario, it is beneficial to have quite independent application modules with powerful communication facilities between them: synchronous calls, asynchronous calls and a publish/subscribe mechanism for notifications to possible multiple receivers. I faced such a scenario many years ago when Python3 was still young. I solved the requirement with some code that I have reused many times since then. This project is a reimplementation based on Python's asyncio framework while still supporting non-asyncio code and threading. It provides everything that in my experience is needed all the time for applications with loosely-coupled functionality.


Features

  • Manage the lifecycle (from startup to active to shutdown) of independent application modules (implemented as classes).
  • Capability to call methods in other modules synchronously.
  • Capability to call methods in other modules asynchronously by adding them as tasks into a queue that is getting processed.
  • Capability to trigger events that are broadcast asynchronously to all modules subscribing to the event notifications by simply implementing a on_<eventname> method.
  • Uses a simple addressing scheme for calling methods: <modulename>.<methodname>.
  • Support of calling asyncio coroutines and regular methods.
  • Calling methods and enqueuing tasks and events can be done in a threadsafe manner thus supporting threaded code.
  • The event queue supports priorities.
  • Facility to react on the event queue becoming empty, i.e. the application becoming idle.
  • Contains code for commonly needed stuff like logging, keeping configuration in a yaml configuration file, custom exception handling, and subscribing to signals.
  • Example code for often used modules provided, e.g. controller, CherryPy webserver, GPIO management via gpiod with generic support of input and output (incl. blinking).
  • Very lightweight due to small and manageable code base.

Installation

Install using PyPi:

pip3 install looselycoupled

Quickstart

Learning by example

Look at the code in the 'example' folder and adapt it as needed. The modules to be used are defined in the provided 'main.py'. You may adapt it to your needs.

Basic concepts

Modules are created by subclassing "Module" (defined in "module.py"). If you want to create a module that uses separate threads, you may subclass the extended "ModuleThreaded" (defined in "module_threaded.py") that makes it easy.

Modules are managed by an instance of "ModuleManager" that manages the lifecycle of the modules and provides common facilities like the task/event queue, exception handling and logging, and the asyncio event loop. The queue is used for asynchronous calls and event notifications to and between modules.

In each module, three pairs of methods are available for interacting with other modules:

1. Calling methods of other modules synchronously:

  • async def exec_task(self, task, **kwargs)
    Coroutine for immediately executing the task <modulename>.<methodname> and returning its result.
  • def exec_task_threadsafe(self, task, **kwargs)
    Regular method for doing that; can safely be called from any thread.

2. Calling methods of other modules asynchronously:

  • async def enqueue_task(self, task, **kwargs)
    Coroutine for scheduling a call to <modulename>.<methodname> by putting it into the execution queue.
  • def enqueue_task_threadsafe(self, task, **kwargs)
    Regular method for doing that; can safely be called from any thread.

3. Triggering an event that gets notified to any module listening for it by implementing an on_<eventname> method:

  • async def trigger_event(self, event, **kwargs)
    Trigger an event that is put into the execution queue for broadcast.
  • def trigger_event_threadsafe(self, event=None, **kwargs)
    Regular method for doing that; can safely be called from any thread.

Reporting bugs

In case you encounter any bugs, please report the expected behavior and the actual behavior so that the issue can be reproduced and fixed.


Developers

Clone repository

Clone this repo to your local machine using https://github.com/towalink/looselycoupled.git

Install the module temporarily to make it available in your Python installation:

pip3 install -e <path to root of "src" directory>

License

License

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

looselycoupled-0.5.3.tar.gz (43.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

looselycoupled-0.5.3-py3-none-any.whl (47.9 kB view details)

Uploaded Python 3

File details

Details for the file looselycoupled-0.5.3.tar.gz.

File metadata

  • Download URL: looselycoupled-0.5.3.tar.gz
  • Upload date:
  • Size: 43.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.12.9

File hashes

Hashes for looselycoupled-0.5.3.tar.gz
Algorithm Hash digest
SHA256 b378115d3fd000adb44448f1752c0630b643f975f4ec2cb4f6aad7ab1660563e
MD5 f2739f0e9ecb63bf6ed5b5c7fb43ffca
BLAKE2b-256 55a5758352c2aea80295aac643a59bb1775bab5f7040df57431f81f5f5130cdc

See more details on using hashes here.

File details

Details for the file looselycoupled-0.5.3-py3-none-any.whl.

File metadata

  • Download URL: looselycoupled-0.5.3-py3-none-any.whl
  • Upload date:
  • Size: 47.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.12.9

File hashes

Hashes for looselycoupled-0.5.3-py3-none-any.whl
Algorithm Hash digest
SHA256 dde76719f4f8c183162f9fa8d2049961c00d5b94123e23fe9299403d1b8cf02e
MD5 28253f66ae22bffae53713af07f048bb
BLAKE2b-256 9fe5b24f89f35841e490cdf93354cce72c389c5866a859928e9553f0b6f85bdb

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page