Skip to main content

Lab GPU scheduler — in-task Python SDK

Project description

runq Python SDK

In-task SDK for the runq GPU scheduler.

Install

From the repo root:

pip install -e ./sdk/python

Optional extras:

pip install -e "./sdk/python[wandb]"   # auto wandb integration
pip install -e "./sdk/python[dev]"     # for pytest

Quick start

import runq

ctx = runq.context()
runq.log_metric("loss", 0.42, step=epoch)

See demo/l2c/stage2_sdk_design.md for the full API design.

Three modes

Detected automatically at runq.context():

  • daemon — running under a runq daemon (RUNQ_TASK_ID + RUNQ_SOCKET_PATH set)
  • no_daemon — running on HPC compute node (RUNQ_TASK_ID set, no socket / RUNQ_NO_DAEMON=1)
  • manual — running outside runq (no RUNQ_TASK_ID); useful for local debugging

ctx.mode exposes which mode is active.

Stage 2 status

This is incremental — Tier A first, Tier B/C as we go.

  • Step 1: package skeleton + context() + tri-mode + log_metric
  • Step 2: transport.py (unix socket HTTP client)
  • Step 3: safe_save core (path resolution + TOCTOU + freeze)
  • Step 4: safe_save decorator + size walker
  • Step 5: safe_save manifest + keep_last_n / keep_best
  • Step 6: report + Decision + @early_stop
  • Step 7: YAML early_stop policies
  • Step 8: loop + @epoch + @log_group
  • Step 9: wandb integration (L3)
  • Step 10: daemon-side preflight (Go side, parallel track)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

runq_sdk-0.5.0rc2.tar.gz (66.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

runq_sdk-0.5.0rc2-py3-none-any.whl (43.2 kB view details)

Uploaded Python 3

File details

Details for the file runq_sdk-0.5.0rc2.tar.gz.

File metadata

  • Download URL: runq_sdk-0.5.0rc2.tar.gz
  • Upload date:
  • Size: 66.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for runq_sdk-0.5.0rc2.tar.gz
Algorithm Hash digest
SHA256 22e43295dac464e2d7a9603506c8679f4d7fd567bd03c464c4c3e53e90fb6974
MD5 e6157691ea0f878c7132ba3affe6463a
BLAKE2b-256 06eaf6d3829066ccf1e3fc339d0c3bfaca84ad72c61e974143a749a66bb194ad

See more details on using hashes here.

Provenance

The following attestation bundles were made for runq_sdk-0.5.0rc2.tar.gz:

Publisher: release.yml on Gliese129/runq

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file runq_sdk-0.5.0rc2-py3-none-any.whl.

File metadata

  • Download URL: runq_sdk-0.5.0rc2-py3-none-any.whl
  • Upload date:
  • Size: 43.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for runq_sdk-0.5.0rc2-py3-none-any.whl
Algorithm Hash digest
SHA256 5f7f4f36905b9890e0c0bffa084e3753fbef23a1f5a8b4760cf6452095e58e54
MD5 d828004dc83582f425b85a86e57e1737
BLAKE2b-256 571e4ae97819f8985ba18e3fb08acd7e40f34cda42bdde294e19d7c4e1560a5d

See more details on using hashes here.

Provenance

The following attestation bundles were made for runq_sdk-0.5.0rc2-py3-none-any.whl:

Publisher: release.yml on Gliese129/runq

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page