Skip to main content

A CLI tool for launching Kubernetes jobs in EIDF

Project description

kblaunch

Test Python Version Ruff PyPI Version

A CLI tool for launching Kubernetes jobs with environment variable and secret management.

Installation

pip install kblaunch

Or using uv:

uv add kblaunch

You can even use uvx to use the cli without installing it:

uvx kblaunch --help

Usage

Basic Usage

Launch a simple job:

kblaunch \
    --email your.email@ed.ac.uk \
    --job-name myjob \
    --command "python script.py"

With Environment Variables

  1. From local environment:

    kblaunch \
        --job-name myjob \
        --command "python script.py" \
        --local-env-vars PATH \
        --local-env-vars PYTHONPATH
    
  2. From Kubernetes secrets:

    kblaunch \
        --job-name myjob \
        --command "python script.py" \
        --secrets-env-vars mysecret1 \
        --secrets-env-vars mysecret2
    
  3. From .env file:

    kblaunch \
        --job-name myjob \
        --command "python script.py" \
        --load-dotenv
    

GPU Jobs

Specify GPU requirements:

kblaunch \
    --job-name gpu-job \
    --command "python train.py" \
    --gpu-limit 2 \
    --gpu-product "NVIDIA-A100-SXM4-80GB"

Interactive Mode

Launch an interactive job:

kblaunch \
    --job-name interactive \
    --interactive

Options

  • --email: User email [required]
  • --job-name: Name of the Kubernetes job [required]
  • --docker-image: Docker image (default: "nvcr.io/nvidia/cuda:12.0.0-devel-ubuntu22.04")
  • --namespace: Kubernetes namespace (default: "informatics")
  • --queue-name: Kueue queue name
  • --interactive: Run in interactive mode (default: False)
  • --command: Command to run in the container [required]
  • --cpu-request: CPU request (default: "1")
  • --ram-request: RAM request (default: "8Gi")
  • --gpu-limit: GPU limit (default: 1)
  • --gpu-product: GPU product (default: "NVIDIA-A100-SXM4-80GB")
  • --secrets-env-vars: List of secret environment variables
  • --local-env-vars: List of local environment variables
  • --load-dotenv: Load environment variables from .env file (default: True)

Features

  • Kubernetes job management
  • Environment variable handling from multiple sources
  • Kubernetes secrets integration
  • GPU job support
  • Interactive mode
  • Automatic job cleanup
  • Slack notifications (when configured)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

kblaunch-0.1.11.tar.gz (38.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

kblaunch-0.1.11-py3-none-any.whl (8.6 kB view details)

Uploaded Python 3

File details

Details for the file kblaunch-0.1.11.tar.gz.

File metadata

  • Download URL: kblaunch-0.1.11.tar.gz
  • Upload date:
  • Size: 38.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.5.24

File hashes

Hashes for kblaunch-0.1.11.tar.gz
Algorithm Hash digest
SHA256 632195828cc65a0312bcae0434229c935f50140ae86bb19d3429ae9f39f1122c
MD5 c696dfdfe63ec0eb0bec5cdc10e14f4b
BLAKE2b-256 a0f5f0ae0d6f818c6a5ef25539ccab4c8e772d71cbd6c391b67492327877660c

See more details on using hashes here.

File details

Details for the file kblaunch-0.1.11-py3-none-any.whl.

File metadata

  • Download URL: kblaunch-0.1.11-py3-none-any.whl
  • Upload date:
  • Size: 8.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.5.24

File hashes

Hashes for kblaunch-0.1.11-py3-none-any.whl
Algorithm Hash digest
SHA256 c8d71a4ca421beaeea90c61b2f885854a9325bb273c17a4a134c4992646321c8
MD5 5b761cee480cdeab81e6b56dfe553355
BLAKE2b-256 1cd580d51b8eda6b4cb734b62b30b0108ba08dfbaad33e34ded60434c2079e32

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page