Skip to main content

*fluxus* is designed to handle data flows in a pipeline-like manner. It provides a

Project description

FLUXUS is a Python framework designed by BCG X to streamline the development of complex data processing pipelines (called flows), enabling users to quickly and efficiently build, test, and deploy data workflows.

Key features include:

  • Modular Design: Build complex data processing pipelines by composing simple, reusable components into flows structured as directed acyclic graphs (DAGs).

  • Efficient Execution: Leverage asynchronous processing to speed up execution and manage costs of pipelines that rely heavily on remote API calls.

  • Customizable: Develop custom components to connect to any data service and define custom pipeline steps to process data in any way you need.

  • Functional API: Build flows using a simplified functional API that abstracts away the underlying object-oriented implementation details, using just a few simple functions.

pypi conda python_versions code_style made_with_sphinx_doc license_badge

License

fluxus is licensed under Apache 2.0 as described in the LICENSE file.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

fluxus-1.0.1.tar.gz (179.2 kB view hashes)

Uploaded Source

Built Distribution

fluxus-1.0.1-py3-none-any.whl (86.2 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page