Pre-release

This release is a pre-release and may not be stable for production use.

CogFlow

CogFlow is a modular, SDK-first machine learning workflow management system built on Kubeflow Pipelines, MLflow, Kubernetes, and MinIO.

It provides a clean Python API for:

  • building production-grade ML pipelines
  • managing datasets and components
  • orchestrating federated learning workflows
  • enforcing consistent error handling and validation

CogFlow is designed for real infrastructure, not notebooks only.

Why CogFlow?

Modern ML platforms are powerful but fragmented:

  • Kubeflow Pipelines → great orchestration, weak ergonomics
  • MLflow → experiment tracking, limited workflow control
  • Kubernetes → powerful, but verbose and error-prone
  • Federated learning → no standard orchestration layer

CogFlow bridges these gaps by providing:

  • a stable Python SDK
  • safe lazy-loading of heavy dependencies
  • unified error handling
  • infrastructure-aware abstractions
  • zero circular imports

Core Features

🧩 Pipeline Orchestration

  • Lazy-loaded Kubeflow Pipelines client
  • Safe pipeline compilation and submission
  • Runtime environment injection
  • Kubernetes service lifecycle management

📦 Component Management

  • YAML-based component registry
  • MinIO-backed component storage
  • Automatic component registration
  • Runtime-safe component loading

📊 Dataset Management

  • Dataset registration and metadata retrieval
  • Secure dataset downloads
  • Silent deletes with strict error semantics
  • Pluggable storage backends

🤝 Federated Learning

  • Auto-generated FL pipelines
  • Dynamic pipeline signatures
  • Connector-based and dataspace-based workflows
  • Region-aware scheduling with node selectors

🧠 Unified Error Handling

  • Strongly typed error hierarchy
  • Context-aware exception wrapping
  • API-ready error serialization
  • Zero silent failures

Architecture Overview

CogFlow follows a layered SDK architecture:

cogflow/ ├── core/ │ ├── pipelines/ # Kubeflow orchestration & FL pipelines │ ├── datasets/ # Dataset lifecycle management │ ├── components/ # Component registry & YAML handling │ └── models/ # (future extension) │ ├── utils/ │ ├── common.py # UUIDs, paths, Kubernetes helpers │ ├── network.py # HTTP utilities with retry & streaming │ ├── storage.py # MinIO client abstraction │ └── exceptions.py # Unified error framework │ ├── config.py └── api.py

Project links

Data verified by PyPI on Aug 7, 2026
Data provided by the project maintainers, verified at the time the release was uploaded to PyPI.

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Stable release available (1.13.8)

1 maintainer

PyPI data
Data sourced directly from PyPI's database.
Avatar for sai_kireeti from gravatar.com sai_kireeti

Credits

Author: Sai Kireeti

GitHub Statistics

Data verified by PyPI on Aug 7, 2026
The GitHub source repository was provided by the project maintainers and verified by PyPI at the time of upload. Stars, forks, and open issues/PRs are derived from that repository and have not been independently verified.

License expression

MIT
View SPDX License List

Requires

Python >=3.10

Provides Extra

dev docs agent agent-otel openai llm full

Tags

ml workflow kfp federated-learning cogflow mlops

Classifiers

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

cogflow-3.0.0b13.tar.gz (366.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

cogflow-3.0.0b13-py3-none-any.whl (421.0 kB view details)

Uploaded Python 3

File details

Details for the file cogflow-3.0.0b13.tar.gz.

File metadata

  • Download URL: cogflow-3.0.0b13.tar.gz
  • Upload date:
  • Size: 366.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for cogflow-3.0.0b13.tar.gz
Algorithm Hash digest
SHA256 00af0fe0ac2fb703af42920ba9c35dc4bd07b4b66639abe5c853701f8fad94b9
MD5 aa36981daf357d4f3b1e71f8c0caaeaa
BLAKE2b-256 ac867a9b86089a9097275771f2fc31c222db0954a397993cdea693ffa065720d

See more details on using hashes here.

Provenance

The following attestation bundles were made for cogflow-3.0.0b13.tar.gz:

Publisher: release.yml on HIRO-MicroDataCenters-BV/cogflow

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file cogflow-3.0.0b13-py3-none-any.whl.

File metadata

  • Download URL: cogflow-3.0.0b13-py3-none-any.whl
  • Upload date:
  • Size: 421.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for cogflow-3.0.0b13-py3-none-any.whl
Algorithm Hash digest
SHA256 036b7ae07d734fddb330b6e9d54726f7194d9a5a4ed18129c0e2bbe9c9a648dd
MD5 8316e7ddfd4815f3bfe4d72334930cec
BLAKE2b-256 4ade74e4ec181b4b33702c43f1fee2a7e106bbd477515b19f1669765daac18b1

See more details on using hashes here.

Provenance

The following attestation bundles were made for cogflow-3.0.0b13-py3-none-any.whl:

Publisher: release.yml on HIRO-MicroDataCenters-BV/cogflow

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

Pre-release

3.0.0b14

2 files

This release
Pre-release

3.0.0b13 This release

2 files

Pre-release

3.0.0b12

2 files

Pre-release

3.0.0b11

2 files

Pre-release

3.0.0b10

2 files

Pre-release

3.0.0b9

2 files

Pre-release

3.0.0b8

2 files

Pre-release

3.0.0b7

2 files

Pre-release

3.0.0b6

2 files

Pre-release

3.0.0b5

2 files

Pre-release

3.0.0b4

2 files

Pre-release

3.0.0b2

2 files

Pre-release

3.0.0b1

2 files

Pre-release

2.0.1b12

2 files

Pre-release

2.0.1b11

2 files

Pre-release

2.0.1b10

2 files

Pre-release

2.0.1b9

2 files

Pre-release

2.0.1b8

2 files

Pre-release

2.0.1b7

2 files

Pre-release

2.0.1b6

2 files

Pre-release

2.0.1b5

2 files

Pre-release

2.0.1b4

2 files

Pre-release

2.0.1b3

2 files

Pre-release

2.0.1b2

2 files

Pre-release

2.0.1b1

2 files

Pre-release

2.0.0b1

2 files

1.13.8

2 files

1.13.7

2 files

1.13.6

2 files

1.13.5

2 files

1.13.4

2 files

1.13.3

2 files

1.13.2

2 files

1.13.1

2 files

1.13.0

2 files

1.12.0

2 files

1.11.27

2 files

1.11.26

2 files

1.11.25

2 files

1.11.24

2 files

1.11.23

2 files

1.11.22

2 files

1.11.21

2 files

1.11.20

2 files

1.11.19

2 files

1.11.18

2 files

1.11.17

2 files

1.11.16

2 files

1.11.15

2 files

1.11.14

2 files

1.11.13

2 files

1.11.12

2 files

1.11.11

2 files

1.11.10

2 files

1.11.9

2 files

1.11.8

2 files

1.11.7

2 files

1.11.6

2 files

1.11.5

2 files

1.11.4

2 files

1.11.3

2 files

1.11.2

2 files

1.11.1

2 files

1.11.0

2 files

1.10.13

2 files

1.10.12

2 files

1.10.11

2 files

1.10.10

2 files

1.10.9

2 files

1.10.8

2 files

1.10.7

2 files

1.10.5

2 files

1.10.4

2 files

1.10.3.1

2 files

1.10.3

2 files

1.10.2

2 files

1.10.1

2 files

1.10.0

2 files

Pre-release

1.10.0b86

2 files

Pre-release

1.10.0b85

2 files

Pre-release

1.10.0b83

2 files

Pre-release

1.10.0b82

2 files

Pre-release

1.10.0b81

2 files

Pre-release

1.10.0b80

2 files

Pre-release

1.10.0b33

2 files

Pre-release

1.10.0b32

2 files

Pre-release

1.10.0b31

2 files

Pre-release

1.10.0b8

2 files

Pre-release

1.10.0b7

2 files

Pre-release

1.10.0b6

2 files

Pre-release

1.10.0b5

2 files

Pre-release

1.10.0b4

2 files

Pre-release

1.10.0b3

2 files

Pre-release

1.10.0b2

2 files

Pre-release

1.10.0b1

2 files

1.9.47

2 files

1.9.46

2 files

1.9.45

2 files

1.9.44

2 files

Pre-release

1.9.44b3

2 files

Pre-release

1.9.44b2

2 files

Pre-release

1.9.44b1

2 files

1.9.43

2 files

Pre-release

1.9.43b4

2 files

Pre-release

1.9.43b3

2 files

Pre-release

1.9.43b2

2 files

Pre-release

1.9.43b1

2 files

1.9.40

2 files

Pre-release

1.9.40b2

2 files

Pre-release

1.9.40b1

2 files

1.9.39

2 files

Pre-release

1.9.39b10

2 files

Pre-release

1.9.39b9

2 files

Pre-release

1.9.39b8

2 files

Pre-release

1.9.39b7

2 files

Pre-release

1.9.39b6

2 files

Pre-release

1.9.39b5

2 files

Pre-release

1.9.39b4

2 files

Pre-release

1.9.39b3

2 files

Pre-release

1.9.39b2

2 files

Pre-release

1.9.39b1

2 files

1.9.38

2 files

Pre-release

1.9.38b1

2 files

1.9.37

2 files

1.9.36

2 files

Pre-release

1.9.36b1

2 files

1.9.35

2 files

1.9.34

2 files

Pre-release

1.9.33b2

2 files

1.9.32

2 files

Pre-release

1.9.32b2

2 files

1.9.31

2 files

Pre-release

1.9.31b2

2 files

Pre-release

1.9.31b1

2 files

1.9.30

2 files

1.9.29

2 files

1.9.28

2 files

1.9.27

2 files

1.9.26

2 files

1.9.25

2 files

1.9.24

2 files

1.9.23

2 files

1.9.22

2 files

1.9.21

2 files

1.9.20

2 files

1.9.19

2 files

1.9.18

2 files

1.9.17

2 files

1.9.16

2 files

1.9.15

2 files

1.9.14

2 files

1.9.13

2 files

1.9.12

2 files

1.9.11

2 files

1.9.10

2 files

1.9.9

2 files

1.9.8

2 files

1.9.7

2 files

1.9.6

2 files

1.9.4

2 files

1.9.3

2 files

1.9.2

2 files

1.9.1

2 files

1.9.0

2 files

1.8.9

2 files

1.8.8

2 files

1.8.7

2 files

1.8.6

2 files

1.8.5

2 files

1.8.4

2 files

1.8.3

2 files

1.8.2

2 files

1.8.1

2 files

1.6.0

2 files

1.5.2

2 files

1.3.6

2 files

1.3.5

2 files

1.3.4

2 files

1.3.3

2 files

1.3.2

2 files

1.3.1

2 files

1.3.0

2 files

1.2.25

2 files

1.2.24

2 files

1.2.23

2 files

1.2.22

2 files

1.2.21

2 files

1.2.20

2 files

1.2.19

2 files

1.2.18

2 files

1.2.17

2 files

1.2.16

2 files

1.2.15

2 files

1.2.14

2 files

1.2.13

2 files

1.2.12

2 files

1.2.11

2 files

1.2.10

2 files

1.2.9

2 files

1.2.8

2 files

1.2.7

2 files

1.2.6

2 files

1.2.5

2 files

1.2.4

2 files

1.2.3

2 files

1.2.2

2 files

1.2.1

2 files

1.2

3 files

1.1

2 files

1.0

2 files

0.9

2 files

0.8

2 files

0.7

2 files

0.6

2 files

0.5

2 files

0.4

2 files

0.3

2 files

0.2

2 files

0.1.0

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page