Task and Workflow orchestration.
Project description
FlowHive
FlowHive is a flexible Python library for building pipelines that seamlessly integrate sequential processing, parallel execution, AI agents, and distributed task orchestration. Whether you’re creating a simple chain of tasks or deploying multi-agent workflows on a cluster, FlowHive provides an intuitive API to build scalable and maintainable solutions.
Features
- Sequential Pipelines: Chain functions so that the output of one task is passed as the input to the next.
- Parallel Execution: Run multiple tasks concurrently on the same input to optimize performance.
- AI Agent Integration: Easily incorporate AI and multi-agent frameworks into your pipelines.
- Distributed Orchestration: Distribute tasks across a cluster for high-performance, scalable execution.
- Simple & Extensible API: Build your workflow with minimal configuration and customize it as your project grows.
Installation
Install FlowHive from PyPI using pip:
pip install flowhive
Quick Start
Sequential Pipeline Example
Create a simple pipeline where tasks are executed one after another:
from flowhive import Pipeline
def task1(data):
print("Executing Task 1")
return data + 1
def task2(data):
print("Executing Task 2")
return data * 2
# Create and run a sequential pipeline
pipeline = Pipeline([task1, task2])
result = pipeline.run(5)
print("Final Result:", result) # Expected output: 12
Parallel Pipeline Example
Run multiple tasks concurrently on the same input:
from flowhive import ParallelPipeline
def task_a(data):
return f"Task A processed {data * 2}"
def task_b(data):
return f"Task B processed {data + 100}"
# Create and run a parallel pipeline
parallel_pipeline = ParallelPipeline([task_a, task_b])
results = parallel_pipeline.run(10)
print("Parallel Results:", results)
Distributed Task Orchestration
FlowHive also supports integration with distributed task queues and multi-agent orchestration frameworks. For complex workflows running across clusters, check out our detailed documentation for integration examples and best practices.
Documentation
For comprehensive details on usage, API reference, and advanced features, please visit our Documentation.
Contributing
We welcome contributions! If you'd like to help improve FlowHive, please check out our CONTRIBUTING.md for guidelines on how to get started.
License
FlowHive is distributed under the MIT License.
Contact
For support, questions, or business inquiries, please open an issue on GitHub or contact us at email@example.com.
Happy piping with FlowHive!
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file flowhive-0.0.2.tar.gz.
File metadata
- Download URL: flowhive-0.0.2.tar.gz
- Upload date:
- Size: 2.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.12.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
b0055aa6b4597724a07423b9a62a17368cb92363d85b562a88860b5bab316110
|
|
| MD5 |
4ea571db71f67371fea5e7c2e2d5807e
|
|
| BLAKE2b-256 |
eb69050b852f3af570d633a8078b44e5fc04d755c3f4d6a85a117cc2f1438f93
|
File details
Details for the file flowhive-0.0.2-py3-none-any.whl.
File metadata
- Download URL: flowhive-0.0.2-py3-none-any.whl
- Upload date:
- Size: 2.4 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.12.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
58a9c0119568d5944904216ba9a7f20a503906d42d41bd4d1a04274ea18ddcf6
|
|
| MD5 |
beb921e24aa5571ff2c1bc947c2851f8
|
|
| BLAKE2b-256 |
33db087f37d37e0db283faa49300c034716d9c49918be9991fdcacbb94d61005
|