This release is a pre-release and may not be stable for production use.
Built on Kubernetes. Konduktor uses existing open source tools to build a platform that makes it easy for ML Researchers to submit batch jobs and for administrative/infra teams to easily manage GPU clusters.
How it works
Konduktor uses a combination of open source projects. Where tools exist with MIT, Apache, or another compatible open license, we want to use and even contribute to that tool. Where we see gaps in tooling, we build it.
Architecture
Konduktor can be self-hosted and run on any certified Kubernetes distribution or managed by us. Contact us at founders@trainy.ai if you are just interested in the managed version. We're focused on tooling for clusters with NVIDIA cards for now but in the future we may expand to our scope to support other accelerators.
For ML researchers
- Konduktor CLI & SDK - user friendly batch job framework, where users only need to specify the resource requirements of their job and a script to launch that makes simple to scale work across multiple nodes. Works with most ML application frameworks out of the box.
num_nodes: 100
resources:
accelerators: H100:8
cloud: kubernetes
labels:
kueue.x-k8s.io/queue-name: user-queue
kueue.x-k8s.io/priority-class: low-priority
run: |
torchrun \
--nproc_per_node 8 \
--rdzv_id=1 --rdzv_endpoint=$master_addr:1234 \
--rdzv_backend=c10d --nnodes $num_nodes \
torch_ddp_benchmark.py --distributed-backend nccl
For cluster administrators
- DCGM Exporter, GPU operator, Network Operator - For installing NVIDIA driver, container runtime, and exporting node health metrics.
- Kueue - centralized creation of job queues, gang-scheduling, and resource quotas and sharing across projects.
- Prometheus - For publishing metrics about node health and workload queues.
- OpenTelemetry - For pushing logs from each node
- Grafana, Loki - Visualizations for metrics/logging solution.
Community & Support
Development Setup
Prerequisites
- Python 3.9+ (3.10+ recommended)
- Poetry for dependency management (installation guide)
- kubectl and access to a Kubernetes cluster (for integration/smoke tests)
Quick Start
# Clone the repository
git clone https://github.com/Trainy-ai/konduktor.git
cd konduktor
# Install dependencies (including dev tools)
poetry install --with dev
# Verify installation
poetry run konduktor --help
Running Tests
# Run unit tests
poetry run pytest tests/unit_tests/ -v
# Run smoke tests (requires Kubernetes cluster)
poetry run pytest tests/smoke_tests/ -v
Code Formatting
All code must pass linting before being merged. Run the format script to auto-fix issues:
bash format.sh
This runs:
- ruff - Python linter and formatter
- mypy - Static type checking
Local Kubernetes Cluster (Optional)
For running smoke tests locally, you can set up a kind cluster:
# Install kind and set up a local cluster with JobSet and Kueue
bash tests/kind_install.sh
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file konduktor_nightly-0.1.0.dev20260803114743.tar.gz.
File metadata
- Download URL: konduktor_nightly-0.1.0.dev20260803114743.tar.gz
- Upload date:
- Size: 343.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via:
twine/6.1.0 CPython/3.13.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
20f11d7b6d47d1e82a02cb51915ed962fa5f4131739c9d54d4f8a4c5f1428047
|
|
| MD5 |
719d7a334be6bfd17e684cb9e8b4515c
|
|
| BLAKE2b-256 |
1947d1e3698e8e1c7aa8d18ca98cd2113f623af04ac5805ad69461b923c92929
|
Provenance
The following attestation bundles were made for konduktor_nightly-0.1.0.dev20260803114743.tar.gz:
Publisher:
pypi-nightly-build.yaml on Trainy-ai/konduktor
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
konduktor_nightly-0.1.0.dev20260803114743.tar.gz -
Subject digest:
20f11d7b6d47d1e82a02cb51915ed962fa5f4131739c9d54d4f8a4c5f1428047 - Sigstore transparency entry: 2334675332
- Sigstore integration time:
-
Permalink:
Trainy-ai/konduktor@0fac1d4ed6f693ad2e6a4f934c4e3deda8d8951e -
Branch / Tag:
refs/heads/main - Owner: https://github.com/Trainy-ai
-
Access:
private
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
self-hosted -
Publication workflow:
pypi-nightly-build.yaml@0fac1d4ed6f693ad2e6a4f934c4e3deda8d8951e -
Trigger Event:
schedule
-
Statement type:
File details
Details for the file konduktor_nightly-0.1.0.dev20260803114743-py3-none-any.whl.
File metadata
- Download URL: konduktor_nightly-0.1.0.dev20260803114743-py3-none-any.whl
- Upload date:
- Size: 396.7 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via:
twine/6.1.0 CPython/3.13.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
a343df116ec936aa7c1c1f0cdd94628c64e883979232c09563a8bbfcbcbbacaf
|
|
| MD5 |
58a23b1a61d4876923dccc25210d64d8
|
|
| BLAKE2b-256 |
76cbd280f460e96db57e642667ad89f072055963a3752ca6e8faa37d6a1030f8
|
Provenance
The following attestation bundles were made for konduktor_nightly-0.1.0.dev20260803114743-py3-none-any.whl:
Publisher:
pypi-nightly-build.yaml on Trainy-ai/konduktor
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
konduktor_nightly-0.1.0.dev20260803114743-py3-none-any.whl -
Subject digest:
a343df116ec936aa7c1c1f0cdd94628c64e883979232c09563a8bbfcbcbbacaf - Sigstore transparency entry: 2334675345
- Sigstore integration time:
-
Permalink:
Trainy-ai/konduktor@0fac1d4ed6f693ad2e6a4f934c4e3deda8d8951e -
Branch / Tag:
refs/heads/main - Owner: https://github.com/Trainy-ai
-
Access:
private
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
self-hosted -
Publication workflow:
pypi-nightly-build.yaml@0fac1d4ed6f693ad2e6a4f934c4e3deda8d8951e -
Trigger Event:
schedule
-
Statement type:
