Skip to main content

Asynchronous pipeline builder

Project description

Coroflow

This is a library for building asynchronous coroutine-based pipelines in Python. Useful features include:

  • pass data between tasks with queues
  • Connect stages of the pipeline with fanout/fanin patterns or load-balancer patterns
  • mix in blocking taks, coroflow will run it in threads
  • has an apache ariflow like api for connecting tasks

Tests

Run like so:

$ pytest

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

coroflow-4.0.0.tar.gz (7.6 kB view hashes)

Uploaded Source

Built Distribution

coroflow-4.0.0-py3-none-any.whl (7.5 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page