Skip to main content

flux-batch

Python SDK to generate Flux batch jobs and services

PyPI - Version docs

https://github.com/converged-computing/flux-batch/raw/main/img/flux-batch-small.png

flux-batch builds Flux batch jobs from a list of commands, wraps them with prologs, epilogs and services, and submits them. Modules deploy something across every node of the job before your work runs, such as a user space Kubernetes cluster with usernetes.

📖 Documentation: https://converged-computing.github.io/flux-batch/

Quick start

Inside a Flux instance (flux start, or an allocation with FLUX_URI set; see the installation docs):

flux python -m pip install --user -e .
flux python my_script.py
import flux
import flux_batch

batch = flux_batch.BatchJobV1()
batch.add_job(["echo", "hello from flux-batch"])

spec = flux_batch.BatchJobspecV1.from_jobs(batch, nodes=1, time_limit="10m")
print(flux_batch.submit(flux.Flux(), spec, dry_run=True))  # preview
jobid = flux_batch.submit(flux.Flux(), spec)

See the examples directory for more.

License

HPCIC DevTools is distributed under the terms of the MIT license. All new contributions must be made under this license.

See LICENSE, COPYRIGHT, and NOTICE for details.

SPDX-License-Identifier: (MIT)

LLNL-CODE- 842614

Metadata

Release files for flux-batch 0.0.15

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for flux-batch 0.0.15
File Size Uploaded Provenance Actions
flux_batch-0.0.15.tar.gz 37.9 kB Without provenance Details for flux_batch-0.0.15.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for flux-batch 0.0.15
File Interpreter ABI Platform Actions
flux_batch-0.0.15-py3-none-any.whl Python 3 none any Details for flux_batch-0.0.15-py3-none-any.whl

Total release size: 91.1 kB

Release files / flux_batch-0.0.15.tar.gz

Download URL flux_batch-0.0.15.tar.gz
Size 37.9 kB
Tags Source
SHA-256 checksum
How to use checksums
e2534d28e12500ddc796853d2aefe4e3c61ad039105f1b80330621a3a0609a63
BLAKE2b-256 checksum
How to use checksums
5d0a8333edf8953c53ccd046838ba2fe44c36d8955733b64d913ca81b0b825f1
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.12.2

Release files / flux_batch-0.0.15-py3-none-any.whl

Download URL flux_batch-0.0.15-py3-none-any.whl
Size 53.2 kB
Tags Python 3
SHA-256 checksum
How to use checksums
f3fa89002996743d0a811913e1832f9ec3068f6f7557ee22bb90e5e886ede727
BLAKE2b-256 checksum
How to use checksums
069c7b636e3ccd200aaf9531c4ab003a770198786adc11e21242d189c947e75c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.12.2

Security for flux-batch 0.0.15

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page