Skip to main content

Worker CLI for the JobDistributor distributed job system

Project description

Worker client (jd-worker)

Workers run jd_worker_cli, which requests jobs from the job server, executes your entry script with parameters as CLI flags, sends heartbeats, and reports DONE / ABORTED.

Full behaviour, environment variables, local paths (~/jd_data/…), and library helpers (jd_upload, checkpoints, jd_job_dir, …) are documented in docs/jd-worker.md.


Install

From the repo root (editable):

cd job-distributor/client
python3 -m venv venv
source venv/bin/activate   # Windows: venv\Scripts\activate
pip install -e .

Or install from GitHub (see docs/jd-worker.md for branch / subdirectory).


Run

jd_worker_cli expId=<experiment_id> entry_script=<your_script.py>

Optional: server=, port=, machine_type=, once=true, etc. — see jd_worker_cli help or docs/jd-worker.md.


Example workload

For an end-to-end ML-style example (MNIST tuning), see
MNIST-parameter-tuning. Point entry_script at that repo’s training script and align expId with the server.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

jd_worker-1.2.2.tar.gz (14.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

jd_worker-1.2.2-py3-none-any.whl (14.8 kB view details)

Uploaded Python 3

File details

Details for the file jd_worker-1.2.2.tar.gz.

File metadata

  • Download URL: jd_worker-1.2.2.tar.gz
  • Upload date:
  • Size: 14.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for jd_worker-1.2.2.tar.gz
Algorithm Hash digest
SHA256 c2a833f18342fa9944a9a1dc90f16b327c80b69b1b78e04bfc0f317f66c412a3
MD5 6bb8add50d17f0a069d8cff3b853efc6
BLAKE2b-256 70c36208348a9e2d3e6a0a3352689c2e436db6d8f22b5d8cc66ec29960dbf812

See more details on using hashes here.

Provenance

The following attestation bundles were made for jd_worker-1.2.2.tar.gz:

Publisher: client-publish.yml on NWSL-UCF/job-distributor

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file jd_worker-1.2.2-py3-none-any.whl.

File metadata

  • Download URL: jd_worker-1.2.2-py3-none-any.whl
  • Upload date:
  • Size: 14.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for jd_worker-1.2.2-py3-none-any.whl
Algorithm Hash digest
SHA256 eabe2bea3617e568316e372a6091feb673da556dc37d9a2a6e2a0ac74d18ca89
MD5 42d30b9f57cb225b9fa1fcaa312f9f47
BLAKE2b-256 c29a1344410253a3eb63ac9c0531acac781cb8e68cbb922157b4fe2716e60a51

See more details on using hashes here.

Provenance

The following attestation bundles were made for jd_worker-1.2.2-py3-none-any.whl:

Publisher: client-publish.yml on NWSL-UCF/job-distributor

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page