Skip to main content

A CLI tool for launching Kubernetes jobs in EIDF

Project description

kblaunch

Test Python Version Ruff PyPI Version

A CLI tool for launching Kubernetes jobs with environment variable and secret management.

Installation

pip install kblaunch

Or using uv:

uv add kblaunch

You can even use uvx to use the cli without installing it:

uvx kblaunch --help

Usage

Basic Usage

Launch a simple job:

kblaunch \
    --email your.email@ed.ac.uk \
    --job-name myjob \
    --command "python script.py"

With Environment Variables

  1. From local environment:

    kblaunch \
        --job-name myjob \
        --command "python script.py" \
        --local-env-vars PATH \
        --local-env-vars PYTHONPATH
    
  2. From Kubernetes secrets:

    kblaunch \
        --job-name myjob \
        --command "python script.py" \
        --secrets-env-vars mysecret1 \
        --secrets-env-vars mysecret2
    
  3. From .env file:

    kblaunch \
        --job-name myjob \
        --command "python script.py" \
        --load-dotenv
    

GPU Jobs

Specify GPU requirements:

kblaunch \
    --job-name gpu-job \
    --command "python train.py" \
    --gpu-limit 2 \
    --gpu-product "NVIDIA-A100-SXM4-80GB"

Interactive Mode

Launch an interactive job:

kblaunch \
    --job-name interactive \
    --interactive

Options

  • --email: User email [required]
  • --job-name: Name of the Kubernetes job [required]
  • --docker-image: Docker image (default: "nvcr.io/nvidia/cuda:12.0.0-devel-ubuntu22.04")
  • --namespace: Kubernetes namespace (default: "informatics")
  • --queue-name: Kueue queue name
  • --interactive: Run in interactive mode (default: False)
  • --command: Command to run in the container [required]
  • --cpu-request: CPU request (default: "1")
  • --ram-request: RAM request (default: "8Gi")
  • --gpu-limit: GPU limit (default: 1)
  • --gpu-product: GPU product (default: "NVIDIA-A100-SXM4-80GB")
  • --secrets-env-vars: List of secret environment variables
  • --local-env-vars: List of local environment variables
  • --load-dotenv: Load environment variables from .env file (default: True)

Features

  • Kubernetes job management
  • Environment variable handling from multiple sources
  • Kubernetes secrets integration
  • GPU job support
  • Interactive mode
  • Automatic job cleanup
  • Slack notifications (when configured)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

kblaunch-0.1.12.tar.gz (38.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

kblaunch-0.1.12-py3-none-any.whl (8.6 kB view details)

Uploaded Python 3

File details

Details for the file kblaunch-0.1.12.tar.gz.

File metadata

  • Download URL: kblaunch-0.1.12.tar.gz
  • Upload date:
  • Size: 38.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.5.24

File hashes

Hashes for kblaunch-0.1.12.tar.gz
Algorithm Hash digest
SHA256 8d750fadb800a77292a40793cfd5fbfb7df94b132e035f5099a7f445191807dd
MD5 1dd8c39d17b6fa7b3db05093334fb451
BLAKE2b-256 a189ae3fa20811a58fdc92c69f31d3abbdfa268d14fc1b465e6f9567e78c26ba

See more details on using hashes here.

File details

Details for the file kblaunch-0.1.12-py3-none-any.whl.

File metadata

  • Download URL: kblaunch-0.1.12-py3-none-any.whl
  • Upload date:
  • Size: 8.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.5.24

File hashes

Hashes for kblaunch-0.1.12-py3-none-any.whl
Algorithm Hash digest
SHA256 3854a2de9be43370ecb860f9f9fc1c474e120dbd959faed29106765d59b4a6f3
MD5 8a291620fef2ae36e8edc7bc7958746d
BLAKE2b-256 3be6423b25598e0d96e61b71d5b1438a57eae1d29c2fbbc340b2c48cd3fc115d

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page