Skip to main content
https://travis-ci.org/stylight/python-paipa.svg?branch=master

Overview

What it does:

  • process stuff one step at a time

  • allows class based and function based steps

  • can scale steps independent of each other (manually)

  • don’t do deadlocks

  • never expose the developer to the concept of a thread (if she doesn’t like to)

  • run in finite batches where all threads are terminated at the end

  • run in continuous mode while being fed through a queue

  • automatically rate limit each step to minimize memory usage

  • terminate the pipeline in case of an Exception and propagate the error to the developer

What it explicitly doesn’t do (if it doesn’t, it’s not a bug!):

  • pipelines with multiple different parents. Multiple parents of the same type are handled automatically though.

  • auto-scale threads

  • bake bread

What it shouldn’t do (if it does, it’s a bug!):

  • confuse the user/developer

  • hang on termination

  • hog resources

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

paipa-0.1.1.tar.gz (15.9 kB view details)

Uploaded Source

File details

Details for the file paipa-0.1.1.tar.gz.

File metadata

  • Download URL: paipa-0.1.1.tar.gz
  • Upload date:
  • Size: 15.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No

File hashes

Hashes for paipa-0.1.1.tar.gz
Algorithm Hash digest
SHA256 676c18eda4fa1f478fb25a95145f19f38f34365ae960a5da060f580f1f639210
MD5 7cf8f8568281f8d8d4716c078b50b412
BLAKE2b-256 c55f33fb863e69f27a1262fedb2a3e57e8be58a8a6912b6848f7a2a8e09bfb93

See more details on using hashes here.

Release history Release notifications | RSS feed

0.3.3

1 file

0.3.2

1 file

0.3.1

2 files

0.3.0

1 file

0.2.1

1 file

0.2.0

1 file

This release

0.1.1 This release

1 file

0.1.0

1 file

0.0.2

1 file

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page