*fluxus* is designed to handle data flows in a pipeline-like manner. It provides a
Project description
FLUXUS is a Python framework designed by BCG X to streamline the development of complex data processing pipelines (called flows), enabling users to quickly and efficiently build, test, and deploy data workflows.
Key features include:
Modular Design: Build complex data processing pipelines by composing simple, reusable components into flows structured as directed acyclic graphs (DAGs).
Efficient Execution: Leverage asynchronous processing to speed up execution and manage costs of pipelines that rely heavily on remote API calls.
Customizable: Develop custom components to connect to any data service and define custom pipeline steps to process data in any way you need.
Functional API: Build flows using a simplified functional API that abstracts away the underlying object-oriented implementation details, using just a few simple functions.
License
fluxus is licensed under Apache 2.0 as described in the LICENSE file.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.