Skip to main content

Worker CLI for the JobDistributor distributed job system

Project description

Worker client (jd-worker)

Workers run jd_worker_cli, which requests jobs from the job server, executes your entry script with parameters as CLI flags, sends heartbeats, and reports DONE / ABORTED.

Full behaviour, environment variables, local paths (~/jd_data/…), and library helpers (jd_upload, checkpoints, jd_job_dir, …) are documented in docs/jd-worker.md.


Install

From the repo root (editable):

cd job-distributor/client
python3 -m venv venv
source venv/bin/activate   # Windows: venv\Scripts\activate
pip install -e .

Or install from GitHub (see docs/jd-worker.md for branch / subdirectory).


Run

jd_worker_cli expId=<experiment_id> entry_script=<your_script.py>

Optional: server=, port=, machine_type=, once=true, etc. — see jd_worker_cli help or docs/jd-worker.md.


Example workload

For an end-to-end ML-style example (MNIST tuning), see
MNIST-parameter-tuning. Point entry_script at that repo’s training script and align expId with the server.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

jd_worker-1.2.1.tar.gz (13.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

jd_worker-1.2.1-py3-none-any.whl (13.7 kB view details)

Uploaded Python 3

File details

Details for the file jd_worker-1.2.1.tar.gz.

File metadata

  • Download URL: jd_worker-1.2.1.tar.gz
  • Upload date:
  • Size: 13.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for jd_worker-1.2.1.tar.gz
Algorithm Hash digest
SHA256 c68342cd1989ecddbb8d4fcc3fba6b11d0955589e04668921dc2a82ee193d49a
MD5 698023f2e8d389180ed00e07d27697e9
BLAKE2b-256 cd5b59e9588117ff4e5136fc3f0e2784314fe27e5b41cb0bc10415081209ff07

See more details on using hashes here.

Provenance

The following attestation bundles were made for jd_worker-1.2.1.tar.gz:

Publisher: client-publish.yml on NWSL-UCF/job-distributor

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file jd_worker-1.2.1-py3-none-any.whl.

File metadata

  • Download URL: jd_worker-1.2.1-py3-none-any.whl
  • Upload date:
  • Size: 13.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for jd_worker-1.2.1-py3-none-any.whl
Algorithm Hash digest
SHA256 adaaf98ecd5a643d31e7849ad39a14daba61872bca42e347b187ed145b6c68a3
MD5 097629465a91ee81b6dc86847b1df5e9
BLAKE2b-256 7346aa50e75c63ff5297aa4b6d97b2715c387afd007002b91f911460a1f89d0f

See more details on using hashes here.

Provenance

The following attestation bundles were made for jd_worker-1.2.1-py3-none-any.whl:

Publisher: client-publish.yml on NWSL-UCF/job-distributor

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page