Pre-release
This release is a pre-release and may not be stable for production use.
Slipstream
Slipstream provides a data-flow model to simplify development of stateful streaming applications.
pip install slipstream-async
from asyncio import run
from slipstream import handle, stream
async def messages():
for emoji in '🏆📞🐟👌':
yield emoji
@handle(messages(), sink=[print])
def handle_message(msg):
yield f'Hello {msg}!'
if __name__ == '__main__':
run(stream())
Hello 🏆!
Hello 📞!
Hello 🐟!
Hello 👌!
Usage
Slipstream components interoperate with basic python building blocks:
Any-thing can be passed around as data- Any
Callablemay be used as a sink AsyncIterablesact as sources- Parallelize through
handle
A many-to-many relation is established by passing multiple sources / sinks.
Quickstart
Install Slipstream along with aiokafka (latest):
pip install slipstream-async[kafka]
Spin up a local Kafka broker with docker-compose.yml, using localhost:29091 to connect:
docker compose up broker -d
Copy-paste this snippet.
Features
slipstream.handle: bind streams (iterables) and sinks (callables) to user defined handler functionsslipstream.stream: start streamingslipstream.Topic: consume from (iterable), and produce to (callable) kafka using aiokafkaslipstream.Cache: store data to disk using rocksdictslipstream.Conf: set global kafka configuration (can be overridden per topic). Produce is fail-fast by default; setproduce_retries/produce_retry_backoffto retry retriable broker errors (sources pause viaConf.signal_iterableswhile retrying)slipstream.codecs.JsonCodec: serialize and deserialize json messagesslipstream.Checkpoint: recover from stream downtimes
1 maintainer
Metadata
1 maintainer
Release files for slipstream-async 1.0.6b5
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| slipstream_async-1.0.6b5.tar.gz | 40.8 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| slipstream_async-1.0.6b5-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 68.8 kB
Release files / slipstream_async-1.0.6b5.tar.gz
| Download URL | slipstream_async-1.0.6b5.tar.gz |
|---|---|
| Size | 40.8 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
05f4ecd0289872795a7262eedf6e6b7f6c5a2931963833ce5b80487c87735044
|
|
BLAKE2b-256 checksum How to use checksums |
6c65a332b280add42b2b10f0d6df9535d1eb1870d5f8c6791c8c5ecb489aee0a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.10.21
|
Release files / slipstream_async-1.0.6b5-py3-none-any.whl
| Download URL | slipstream_async-1.0.6b5-py3-none-any.whl |
|---|---|
| Size | 28.0 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
0643bcf2b93da2926f9ad19c07d2f07e279048ea691cc5fd7774fc1e3753aa9c
|
|
BLAKE2b-256 checksum How to use checksums |
1aa81c91ec7a34b02dca453cbbf53aeb3f6258af9e52ed0ea7d01ab2022d3d36
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.10.21
|
