Pre-release

This release is a pre-release and may not be stable for production use.

CogFlow

CogFlow is a modular, SDK-first machine learning workflow management system built on Kubeflow Pipelines, MLflow, Kubernetes, and MinIO.

It provides a clean Python API for:

  • building production-grade ML pipelines
  • managing datasets and components
  • orchestrating federated learning workflows
  • enforcing consistent error handling and validation

CogFlow is designed for real infrastructure, not notebooks only.

Why CogFlow?

Modern ML platforms are powerful but fragmented:

  • Kubeflow Pipelines → great orchestration, weak ergonomics
  • MLflow → experiment tracking, limited workflow control
  • Kubernetes → powerful, but verbose and error-prone
  • Federated learning → no standard orchestration layer

CogFlow bridges these gaps by providing:

  • a stable Python SDK
  • safe lazy-loading of heavy dependencies
  • unified error handling
  • infrastructure-aware abstractions
  • zero circular imports

Core Features

🧩 Pipeline Orchestration

  • Lazy-loaded Kubeflow Pipelines client
  • Safe pipeline compilation and submission
  • Runtime environment injection
  • Kubernetes service lifecycle management

📦 Component Management

  • YAML-based component registry
  • MinIO-backed component storage
  • Automatic component registration
  • Runtime-safe component loading

📊 Dataset Management

  • Dataset registration and metadata retrieval
  • Secure dataset downloads
  • Silent deletes with strict error semantics
  • Pluggable storage backends

🤝 Federated Learning

  • Auto-generated FL pipelines
  • Dynamic pipeline signatures
  • Connector-based and dataspace-based workflows
  • Region-aware scheduling with node selectors

🧠 Unified Error Handling

  • Strongly typed error hierarchy
  • Context-aware exception wrapping
  • API-ready error serialization
  • Zero silent failures

Architecture Overview

CogFlow follows a layered SDK architecture:

cogflow/ ├── core/ │ ├── pipelines/ # Kubeflow orchestration & FL pipelines │ ├── datasets/ # Dataset lifecycle management │ ├── components/ # Component registry & YAML handling │ └── models/ # (future extension) │ ├── utils/ │ ├── common.py # UUIDs, paths, Kubernetes helpers │ ├── network.py # HTTP utilities with retry & streaming │ ├── storage.py # MinIO client abstraction │ └── exceptions.py # Unified error framework │ ├── config.py └── api.py

Project links

Data verified by PyPI on Aug 7, 2026
Data provided by the project maintainers, verified at the time the release was uploaded to PyPI.

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Stable release available (1.13.8)

1 maintainer

PyPI data
Data sourced directly from PyPI's database.
Avatar for sai_kireeti from gravatar.com sai_kireeti

Credits

Author: Sai Kireeti

GitHub Statistics

Data verified by PyPI on Aug 7, 2026
The GitHub source repository was provided by the project maintainers and verified by PyPI at the time of upload. Stars, forks, and open issues/PRs are derived from that repository and have not been independently verified.

License expression

MIT
View SPDX License List

Requires

Python >=3.10

Provides Extra

dev docs agent agent-otel openai llm full

Tags

ml workflow kfp federated-learning cogflow mlops

Classifiers

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

cogflow-3.0.0b12.tar.gz (366.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

cogflow-3.0.0b12-py3-none-any.whl (421.0 kB view details)

Uploaded Python 3

File details

Details for the file cogflow-3.0.0b12.tar.gz.

File metadata

  • Download URL: cogflow-3.0.0b12.tar.gz
  • Upload date:
  • Size: 366.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for cogflow-3.0.0b12.tar.gz
Algorithm Hash digest
SHA256 2666d0d56d5289bbd39c8efe439ff6dc6b7bbda04b5e4983f17fd5698eea281f
MD5 d54c6ced55f24c5341c62801e244cbd6
BLAKE2b-256 371998bd48927839ad92ff548830dab59abd256d82b8ed252b2a63bd9471f846

See more details on using hashes here.

Provenance

The following attestation bundles were made for cogflow-3.0.0b12.tar.gz:

Publisher: release.yml on HIRO-MicroDataCenters-BV/cogflow

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file cogflow-3.0.0b12-py3-none-any.whl.

File metadata

  • Download URL: cogflow-3.0.0b12-py3-none-any.whl
  • Upload date:
  • Size: 421.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for cogflow-3.0.0b12-py3-none-any.whl
Algorithm Hash digest
SHA256 9f13d86ce8fc03d5d3185725ac847c5ff3d73703d660fcb72f669faf77d6b81d
MD5 1575bc0fe9bdbce7774cd9edaadea5d0
BLAKE2b-256 786f04cd2c13dcaa4679574861fbad0651ed4906ffb06e4a0fa1e79dde0862d2

See more details on using hashes here.

Provenance

The following attestation bundles were made for cogflow-3.0.0b12-py3-none-any.whl:

Publisher: release.yml on HIRO-MicroDataCenters-BV/cogflow

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

Pre-release

3.0.0b14

2 files

Pre-release

3.0.0b13

2 files

This release
Pre-release

3.0.0b12 This release

2 files

Pre-release

3.0.0b11

2 files

Pre-release

3.0.0b10

2 files

Pre-release

3.0.0b9

2 files

Pre-release

3.0.0b8

2 files

Pre-release

3.0.0b7

2 files

Pre-release

3.0.0b6

2 files

Pre-release

3.0.0b5

2 files

Pre-release

3.0.0b4

2 files

Pre-release

3.0.0b2

2 files

Pre-release

3.0.0b1

2 files

Pre-release

2.0.1b12

2 files

Pre-release

2.0.1b11

2 files

Pre-release

2.0.1b10

2 files

Pre-release

2.0.1b9

2 files

Pre-release

2.0.1b8

2 files

Pre-release

2.0.1b7

2 files

Pre-release

2.0.1b6

2 files

Pre-release

2.0.1b5

2 files

Pre-release

2.0.1b4

2 files

Pre-release

2.0.1b3

2 files

Pre-release

2.0.1b2

2 files

Pre-release

2.0.1b1

2 files

Pre-release

2.0.0b1

2 files

1.13.8

2 files

1.13.7

2 files

1.13.6

2 files

1.13.5

2 files

1.13.4

2 files

1.13.3

2 files

1.13.2

2 files

1.13.1

2 files

1.13.0

2 files

1.12.0

2 files

1.11.27

2 files

1.11.26

2 files

1.11.25

2 files

1.11.24

2 files

1.11.23

2 files

1.11.22

2 files

1.11.21

2 files

1.11.20

2 files

1.11.19

2 files

1.11.18

2 files

1.11.17

2 files

1.11.16

2 files

1.11.15

2 files

1.11.14

2 files

1.11.13

2 files

1.11.12

2 files

1.11.11

2 files

1.11.10

2 files

1.11.9

2 files

1.11.8

2 files

1.11.7

2 files

1.11.6

2 files

1.11.5

2 files

1.11.4

2 files

1.11.3

2 files

1.11.2

2 files

1.11.1

2 files

1.11.0

2 files

1.10.13

2 files

1.10.12

2 files

1.10.11

2 files

1.10.10

2 files

1.10.9

2 files

1.10.8

2 files

1.10.7

2 files

1.10.5

2 files

1.10.4

2 files

1.10.3.1

2 files

1.10.3

2 files

1.10.2

2 files

1.10.1

2 files

1.10.0

2 files

Pre-release

1.10.0b86

2 files

Pre-release

1.10.0b85

2 files

Pre-release

1.10.0b83

2 files

Pre-release

1.10.0b82

2 files

Pre-release

1.10.0b81

2 files

Pre-release

1.10.0b80

2 files

Pre-release

1.10.0b33

2 files

Pre-release

1.10.0b32

2 files

Pre-release

1.10.0b31

2 files

Pre-release

1.10.0b8

2 files

Pre-release

1.10.0b7

2 files

Pre-release

1.10.0b6

2 files

Pre-release

1.10.0b5

2 files

Pre-release

1.10.0b4

2 files

Pre-release

1.10.0b3

2 files

Pre-release

1.10.0b2

2 files

Pre-release

1.10.0b1

2 files

1.9.47

2 files

1.9.46

2 files

1.9.45

2 files

1.9.44

2 files

Pre-release

1.9.44b3

2 files

Pre-release

1.9.44b2

2 files

Pre-release

1.9.44b1

2 files

1.9.43

2 files

Pre-release

1.9.43b4

2 files

Pre-release

1.9.43b3

2 files

Pre-release

1.9.43b2

2 files

Pre-release

1.9.43b1

2 files

1.9.40

2 files

Pre-release

1.9.40b2

2 files

Pre-release

1.9.40b1

2 files

1.9.39

2 files

Pre-release

1.9.39b10

2 files

Pre-release

1.9.39b9

2 files

Pre-release

1.9.39b8

2 files

Pre-release

1.9.39b7

2 files

Pre-release

1.9.39b6

2 files

Pre-release

1.9.39b5

2 files

Pre-release

1.9.39b4

2 files

Pre-release

1.9.39b3

2 files

Pre-release

1.9.39b2

2 files

Pre-release

1.9.39b1

2 files

1.9.38

2 files

Pre-release

1.9.38b1

2 files

1.9.37

2 files

1.9.36

2 files

Pre-release

1.9.36b1

2 files

1.9.35

2 files

1.9.34

2 files

Pre-release

1.9.33b2

2 files

1.9.32

2 files

Pre-release

1.9.32b2

2 files

1.9.31

2 files

Pre-release

1.9.31b2

2 files

Pre-release

1.9.31b1

2 files

1.9.30

2 files

1.9.29

2 files

1.9.28

2 files

1.9.27

2 files

1.9.26

2 files

1.9.25

2 files

1.9.24

2 files

1.9.23

2 files

1.9.22

2 files

1.9.21

2 files

1.9.20

2 files

1.9.19

2 files

1.9.18

2 files

1.9.17

2 files

1.9.16

2 files

1.9.15

2 files

1.9.14

2 files

1.9.13

2 files

1.9.12

2 files

1.9.11

2 files

1.9.10

2 files

1.9.9

2 files

1.9.8

2 files

1.9.7

2 files

1.9.6

2 files

1.9.4

2 files

1.9.3

2 files

1.9.2

2 files

1.9.1

2 files

1.9.0

2 files

1.8.9

2 files

1.8.8

2 files

1.8.7

2 files

1.8.6

2 files

1.8.5

2 files

1.8.4

2 files

1.8.3

2 files

1.8.2

2 files

1.8.1

2 files

1.6.0

2 files

1.5.2

2 files

1.3.6

2 files

1.3.5

2 files

1.3.4

2 files

1.3.3

2 files

1.3.2

2 files

1.3.1

2 files

1.3.0

2 files

1.2.25

2 files

1.2.24

2 files

1.2.23

2 files

1.2.22

2 files

1.2.21

2 files

1.2.20

2 files

1.2.19

2 files

1.2.18

2 files

1.2.17

2 files

1.2.16

2 files

1.2.15

2 files

1.2.14

2 files

1.2.13

2 files

1.2.12

2 files

1.2.11

2 files

1.2.10

2 files

1.2.9

2 files

1.2.8

2 files

1.2.7

2 files

1.2.6

2 files

1.2.5

2 files

1.2.4

2 files

1.2.3

2 files

1.2.2

2 files

1.2.1

2 files

1.2

3 files

1.1

2 files

1.0

2 files

0.9

2 files

0.8

2 files

0.7

2 files

0.6

2 files

0.5

2 files

0.4

2 files

0.3

2 files

0.2

2 files

0.1.0

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page