Skip to main content

Task and Workflow orchestration.

Project description

FlowHive

FlowHive is a flexible Python library for building pipelines that seamlessly integrate sequential processing, parallel execution, AI agents, and distributed task orchestration. Whether you’re creating a simple chain of tasks or deploying multi-agent workflows on a cluster, FlowHive provides an intuitive API to build scalable and maintainable solutions.

Features

  • Sequential Pipelines: Chain functions so that the output of one task is passed as the input to the next.
  • Parallel Execution: Run multiple tasks concurrently on the same input to optimize performance.
  • AI Agent Integration: Easily incorporate AI and multi-agent frameworks into your pipelines.
  • Distributed Orchestration: Distribute tasks across a cluster for high-performance, scalable execution.
  • Simple & Extensible API: Build your workflow with minimal configuration and customize it as your project grows.

Installation

Install FlowHive from PyPI using pip:

pip install flowhive

Quick Start

Sequential Pipeline Example

Create a simple pipeline where tasks are executed one after another:

from flowhive import Pipeline

def task1(data):
    print("Executing Task 1")
    return data + 1

def task2(data):
    print("Executing Task 2")
    return data * 2

# Create and run a sequential pipeline
pipeline = Pipeline([task1, task2])
result = pipeline.run(5)
print("Final Result:", result)  # Expected output: 12

Parallel Pipeline Example

Run multiple tasks concurrently on the same input:

from flowhive import ParallelPipeline

def task_a(data):
    return f"Task A processed {data * 2}"

def task_b(data):
    return f"Task B processed {data + 100}"

# Create and run a parallel pipeline
parallel_pipeline = ParallelPipeline([task_a, task_b])
results = parallel_pipeline.run(10)
print("Parallel Results:", results)

Distributed Task Orchestration

FlowHive also supports integration with distributed task queues and multi-agent orchestration frameworks. For complex workflows running across clusters, check out our detailed documentation for integration examples and best practices.

Documentation

For comprehensive details on usage, API reference, and advanced features, please visit our Documentation.

Contributing

We welcome contributions! If you'd like to help improve FlowHive, please check out our CONTRIBUTING.md for guidelines on how to get started.

License

FlowHive is distributed under the MIT License.

Contact

For support, questions, or business inquiries, please open an issue on GitHub or contact us at email@example.com.


Happy piping with FlowHive!

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

flowhive-0.0.2.tar.gz (2.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

flowhive-0.0.2-py3-none-any.whl (2.4 kB view details)

Uploaded Python 3

File details

Details for the file flowhive-0.0.2.tar.gz.

File metadata

  • Download URL: flowhive-0.0.2.tar.gz
  • Upload date:
  • Size: 2.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.4

File hashes

Hashes for flowhive-0.0.2.tar.gz
Algorithm Hash digest
SHA256 b0055aa6b4597724a07423b9a62a17368cb92363d85b562a88860b5bab316110
MD5 4ea571db71f67371fea5e7c2e2d5807e
BLAKE2b-256 eb69050b852f3af570d633a8078b44e5fc04d755c3f4d6a85a117cc2f1438f93

See more details on using hashes here.

File details

Details for the file flowhive-0.0.2-py3-none-any.whl.

File metadata

  • Download URL: flowhive-0.0.2-py3-none-any.whl
  • Upload date:
  • Size: 2.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.4

File hashes

Hashes for flowhive-0.0.2-py3-none-any.whl
Algorithm Hash digest
SHA256 58a9c0119568d5944904216ba9a7f20a503906d42d41bd4d1a04274ea18ddcf6
MD5 beb921e24aa5571ff2c1bc947c2851f8
BLAKE2b-256 33db087f37d37e0db283faa49300c034716d9c49918be9991fdcacbb94d61005

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page