Skip to main content

SkyPilot AdminPolicy that surfaces piqc GPU waste scanning when a GPU workload is launched on Kubernetes

Project description

paralleliq-skypilot-plugin

A SkyPilot AdminPolicy that surfaces piqc — Paralleliq's GPU waste scanner — when a GPU workload is launched on a Kubernetes cluster.

What it does

When you run sky launch with GPU accelerators targeting a Kubernetes cluster, the policy prints instructions to run a free piqc scan on your cluster before the job starts.

Install

pip install paralleliq-skypilot-plugin

Configure

Add one line to ~/.sky/config.yaml:

admin_policy: paralleliq_skypilot_plugin.ParalleliqPolicy

Usage

Run any GPU workload as normal:

sky launch -c my-cluster task.yaml

If the task requests GPU accelerators on a Kubernetes backend, you will see:

  Paralleliq — GPU workload detected on Kubernetes.
  Run a free GPU waste scan on this cluster before launching:

    kubectl apply -f https://raw.githubusercontent.com/paralleliq/piqc/main/deploy/rbac.yaml
    kubectl apply -f https://raw.githubusercontent.com/paralleliq/piqc/main/deploy/scan-job.yaml
    kubectl logs -n kube-system job/piqc-scan

  github.com/paralleliq/piqc  ·  paralleliq.ai

License

Apache-2.0

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

paralleliq_skypilot_plugin-0.1.0.tar.gz (5.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

paralleliq_skypilot_plugin-0.1.0-py3-none-any.whl (2.8 kB view details)

Uploaded Python 3

File details

Details for the file paralleliq_skypilot_plugin-0.1.0.tar.gz.

File metadata

File hashes

Hashes for paralleliq_skypilot_plugin-0.1.0.tar.gz
Algorithm Hash digest
SHA256 810fc4aabf56e0b239fc8d6c149e7306a360e27bf52eefd35e5f54d9500a865d
MD5 7f0dd83f9da2630571466aca29cb4b34
BLAKE2b-256 f0c7e147dc06876b5af8f1cbe7d5b82c6fe1dc689a15a7e1097ea35bcf961ecf

See more details on using hashes here.

File details

Details for the file paralleliq_skypilot_plugin-0.1.0-py3-none-any.whl.

File metadata

File hashes

Hashes for paralleliq_skypilot_plugin-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 149ec417fa14d8729953b5a52c2177d6b36e54fe845a461aec3d01b9db712bf4
MD5 51b6d90e84bff07f8dfd402b5e1666aa
BLAKE2b-256 9a6048f6e60d3a44e6b8222917be61814956f9315a92e4c8219d2845342a52e4

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page