eric-sse 0.4.1.3

A lightweight message dispatcher based on SSE protocol data transfer objects format

The lightweight library for async messaging nobody expects.

Installation

pip install eric-sse

Changelog

0.4.1.0

• Breaking: Changed DataProcessingChannel adapter to suit with SSE

0.4.0

Breaking changes:

• Rework of DataProcessingChannel, now extends AbstractChannel and its methods’ signatures have been updated
• AbstractChannel.retry_timeout_milliseconds have been moved to SSEChannel

0.3.2

• Breaking change: now ThreadPoolListener callback only accepts Message as parameter
• Fixed a concurrency bug in ThreadPoolListener

Features

• Send to one listener and broadcast
• SSE format was adopted by design, is order to make library suitable for such kind of model
• Sockets
• Callbacks
• [Experimental] Threading support for large data processing

Possible applications

• Message delivery mechanisms based on SSE
• Message queue processing (logging, etc)
• See https://github.com/laxertu/eric-api

Trivia

Library name pretends to be a tribute to the following movie https://en.wikipedia.org/wiki/Looking_for_Eric

Entities

class eric_sse.entities.AbstractChannel(stream_delay_seconds: int = 0)

Base class for channels.

Provides functionalities for listeners and message delivery management. SSEChannel is the default implementation

add_listener() → MessageQueueListener

Add the default listener

broadcast(msg: Message)

Enqueue a message to all listeners

deliver_next(listener_id: str) → Message

Returns next message for given listener id. Raises a NoMessagesException if queue is empty

dispatch(listener_id: str, msg: Message)

Adds a message to listener’s queue

async message_stream(listener: MessageQueueListener) → AsyncIterable[dict]

Entry point for message streaming

In case of failure at channel resolution time, a special message with type=MESSAGE_TYPE_CLOSED is sent, and correspondant listener is stopped

register_listener(l: MessageQueueListener)

Adds a listener to channel

class eric_sse.entities.Message(type: str, payload: dict | list | str | int | float | None = None)

Models a message

It’s just a container of information identified by a type. For validation purposes you can override MessageQueueListener.on_message

class eric_sse.entities.MessageQueueListener

Base class for listeners.

Optionally you can override on_message method if you need to inject code at message delivery time.

on_message(msg: Message) → None

Event handler. It executes when a message is delivered to client

Prefab channels and listeners

class eric_sse.prefabs.DataProcessingChannel(max_workers: int, stream_delay_seconds: int = 0)

Channel intended for concurrent processing of data.

• Parameters:
  • max_workers – Num og workers to use
  • stream_delay_seconds – Can be used to limit response rate of streamings

Relies on concurrent.futures.ThreadPoolExecutor.

Just override adapt method to control output returned to clients

MESSAGE_TYPE_CLOSED type is intended as end of stream. It should be considered as a reserved Message type.

Note that:

• same callback is invoked, no matter of message type
• callback execution order is not guaranteed (to be the same as the one while dispatching to channel)

adapt(msg: Message) → Any

Models output returned to clients

add_threaded_listener(callback: Callable[[Message], None]) → ThreadPoolListener

Adds a threaded listener

notify_end()

Broadcasts a MESSAGE_TYPE_CLOSED Message

class eric_sse.prefabs.SSEChannel(retry_timeout_milliseconds: int = 5)

SSE streaming channel.

• Parameters: retry_timeout_milliseconds – Used to indicate waiting time to clients

See https://developer.mozilla.org/en-US/docs/Web/API/Server-sent_events/Using_server-sent_events#event_stream_format

Currently, ‘id’ field is not supported.

class eric_sse.prefabs.ThreadPoolListener(callback: Callable[[Message], None], executor: ThreadPoolExecutor)

on_message(msg: Message) → None

Event handler. It executes when a message is delivered to client

Prefab servers

class eric_sse.servers.ChannelContainer

Helper class for management of multiple SSE channels cases of use.

class eric_sse.servers.SocketServer(file_descriptor_path: str)

An implementation of a socket server that acts as a controller to interact with library

A static shortcut for starting a basic server is provided. See examples. Accepted format: a plain (no nested) JSON with the following keys:

“c”: “channel id” “v”: “verb” “t”: “message type” “p”: “message payload”

Possible values of verb identifies a supported action:

“d” dispatch “b” broadcast “c” add listener “w” watch (opens a stream)

See examples

async static connect_callback(reader: StreamReader, writer: StreamWriter)

Integration with SocketServer.

See https://docs.python.org/3/library/asyncio-stream.html#asyncio.start_unix_server Handles low-lwvel communication and raw messages parsing

async shutdown(server: Server)

Graceful Shutdown

static start(file_descriptor_path: str)

Shortcut to start a server

Exceptions

exception eric_sse.exception.InvalidChannelException

exception eric_sse.exception.InvalidListenerException

exception eric_sse.exception.InvalidMessageFormat

exception eric_sse.exception.NoMessagesException

Raised when trying to fetch from an empty queue

Developers section

Update README.md scipt: update_docs.sh