Skip to main content
Pre-release

This release is a pre-release and may not be stable for production use.

Trainy Konduktor Logo

Konduktor is a source available Run:AI alternative built on Kubernetes. Konduktor uses existing open source tools to build a platform that makes it easy for ML Researchers to submit batch jobs and for administrative/infra teams to easily manage GPU clusters.

How it works

Konduktor uses a combination of open source projects. Where tools exist with MIT, Apache, or another compatible open license, we want to use and even contribute to that tool. Where we see gaps in tooling, we build it and open source ourselves.

Architecture

Konduktor can be self-hosted and run on any certified Kubernetes distribution or managed by us. Contact us at founders@trainy.ai if you are just interested in the managed version. We're focused on tooling for clusters with NVIDIA cards for now but in the future we may expand to our scope to support other accelerators.

architecture

For ML researchers

  • Skypilot - user friendly batch job framework, where users only need to specify the resource requirements of their job and a script to launch that makes simple to scale work across multiple nodes. Works with most ML application frameworks. Examples
num_nodes: 100

resources:
  accelerators: H100:8
  cloud: kubernetes
  labels:
    kueue.x-k8s.io/queue-name: user-queue
    kueue.x-k8s.io/priority-class: low-priority

setup: |
  pip install torch torchvision

run: |
  torchrun \
  --nproc_per_node 8 \
  --rdzv_id=1 --rdzv_endpoint=$master_addr:1234 \
  --rdzv_backend=c10d --nnodes $num_nodes \
  torch_ddp_benchmark.py --distributed-backend nccl

For cluster administrators

  • DCGM Exporter, GPU operator, Network Operator - For installing NVIDIA driver, container runtime, and exporting node health metrics.
  • Kueue - centralized creation of job queues, gang-scheduling, and resource quotas and sharing across projects.
  • Prometheus - For publishing metrics about node health and workload queues.
  • OpenTelemetry - For pushing logs from each node
  • Grafana, Loki - Visualizations for metrics/logging solution.

Community & Support

Contributor Guide

Format your code with

poetry install --with dev
bash format.sh

Metadata

Release files for konduktor-nightly 0.1.0.dev20240923104607

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for konduktor-nightly 0.1.0.dev20240923104607
File Size Uploaded Provenance Actions
konduktor_nightly-0.1.0.dev20240923104607.tar.gz 12.2 kB Without provenance Details for konduktor_nightly-0.1.0.dev20240923104607.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for konduktor-nightly 0.1.0.dev20240923104607
File Interpreter ABI Platform Actions
konduktor_nightly-0.1.0.dev20240923104607-py3-none-any.whl Python 3 none any Details for konduktor_nightly-0.1.0.dev20240923104607-py3-none-any.whl

Total release size: 26.4 kB

Release files / konduktor_nightly-0.1.0.dev20240923104607.tar.gz

Download URL konduktor_nightly-0.1.0.dev20240923104607.tar.gz
Size 12.2 kB
Tags Source
SHA-256 checksum
How to use checksums
8d632a9fa7212cfc1c9327185ea41301657b96eb89664c70bbc25a2305d3c14a
BLAKE2b-256 checksum
How to use checksums
71fcf13eee2d3d366e968329182d533783bef8f74e43c471bd6d2412f00746e8
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/1.7.1 CPython/3.10.15 Linux/6.8.0-1014-azure

Release files / konduktor_nightly-0.1.0.dev20240923104607-py3-none-any.whl

Download URL konduktor_nightly-0.1.0.dev20240923104607-py3-none-any.whl
Size 14.1 kB
Tags Python 3
SHA-256 checksum
How to use checksums
5ea81fa5b67af73c9ccf1b53c4befff5d074b2a252f0e3ed0f4b867181d3b810
BLAKE2b-256 checksum
How to use checksums
aa120ebb0b135f90e7cb7ea85b30c7178ed8599039dac3ad8c772d1bf5ffd86a
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/1.7.1 CPython/3.10.15 Linux/6.8.0-1014-azure

Security for konduktor-nightly 0.1.0.dev20240923104607

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page