AsyncIterator based connectable components
Project description
aiterio
tl;dr
aiterio
is a minimal library to build asynchronous pipelines based on Python's asynchronous iterators.
It transforms a syntax like:
aiterator_3(aiterator_2(aiterator_1(source_data)))
or
aiterator_1 = fn_1(source_data)
aiterator_2 = fn_2(aiterator_1)
aiterator_3 = fn_3(aiterator_3)
async for item in aiterator_3:
pass
into
await Component1().source(source_data).then(Component2()).then(Component3()).run()
# or
for item in Component1().source(source_data).then(Component2()).then(Component3()):
pass
Why use this?
- Minimal library without dependencies
- Simplifies usage of asynchronous iterators
- Makes it easy to create components with a single responsibility and to test them
- Built-in shutdown logic
Alternatives / Inspiration
- Akka (java, scala): https://doc.akka.io/docs/akka/current/stream/index.html
- Faust: https://github.com/robinhood/faust
- Flink: https://flink.apache.org/
- RxPy: https://github.com/ReactiveX/RxPY
- Streamz: https://github.com/python-streamz/streamz
- License: MIT
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
aiterio-0.1.6.tar.gz
(6.4 kB
view hashes)