syncstream 0.2.1

A python tool for synchronize the messages from different threads, processes or hosts.

Sync-stream

This project is designed for providing the synchoronization of the stdout / stderr among different threads, processes, devices or hosts. The package could be used for the following cases:

1. Use syncstream.LineBuffer: Multiple threads are created. The messages (stdout) from different threads are required to be collected.
2. Use syncstream.LineProcBuffer in the main process, and syncstream.LineProcMirror in the sub-processes: Multiple sub-processes are created on the same device. The stdout / stderr of each process is redirected to a LineProcMirror, and the results are collected by LineProcBuffer.
3. Use syncstream.LineFileBuffer: Multiple processes are created. These processes may be deployed on different devices (even with different platforms), but all devices could get accessed to the same shared disk. In this case, the message could be shared by locked files. Each process would hold an independent LineFileBuffer pointing to the same log files.
4. Use syncstream.LineHostBuffer on the server side, and syncstream.LineHostMirror on the client side: Multiple processes are deployed on different devices, and they could not share the same disk. In this case, the message are synchronized by the web service. Each process would hold a LineHostMirror, and the results would be collected by LineHostBuffer.

The basic package would not contain the file and host modules. To install the package, please use the following options:

pip install syncstream[option1,option2...]

Option	Supports
file	The file module, including syncstream.LineFileBuffer.
host	The host module, including syncstream.LineHostBuffer, and syncstream.LineHostMirror.

Documentation

To be built...

Update reports

0.2.1 @ 5/24/2021

1. Add the PyPI publish workflow.

0.2.0 @ 5/24/2021

1. Finish the synchronization based on the file lock package fasteners.
2. Finish the synchronization based on the web service packages flask, flask-restful and urllib3.
3. Fix the compatibility of the testing scripts for py36, py37.

0.1.0 @ 5/22/2021

1. Finish the synchronization based on the stdlib.
2. Create this project.