Overview
What it does:
process stuff one step at a time
allows class based and function based steps
can scale steps independent of each other (manually)
don’t do deadlocks
never expose the developer to the concept of a thread (if she doesn’t like to)
run in finite batches where all threads are terminated at the end
run in continuous mode while being fed through a queue
automatically rate limit each step to minimize memory usage
terminate the pipeline in case of an Exception and propagate the error to the developer
What it explicitly doesn’t do (if it doesn’t, it’s not a bug!):
pipelines with multiple different parents. Multiple parents of the same type are handled automatically though.
auto-scale threads
bake bread
What it shouldn’t do (if it does, it’s a bug!):
confuse the user/developer
hang on termination
hog resources
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
File details
Details for the file paipa-0.1.0.tar.gz.
File metadata
- Download URL: paipa-0.1.0.tar.gz
- Upload date:
- Size: 14.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
60c1565b5c9a2eed39ffc9fa1d16cd8877c5b8ed5684b1c41295f722fa82441b
|
|
| MD5 |
7dea2b3f636da9e9e776bdfa2e1ef99b
|
|
| BLAKE2b-256 |
d4f6226de6efaa227031c6902d681dde176dc62b2445af0d31a04995ffbbb23f
|
