Skip to main content

Prefect executor integrations for HPC schedulers

Project description

QCSC Prefect Executor

Prefect executor integrations for local processes and QCSC HPC scheduler workflows.

Local execution

Set HPCProfileBlock.hpc_target to "local" and map the command's executable key to a path or command available on the Prefect worker. Local execution does not generate a job script and does not call a scheduler. It invokes the command directly with cwd=work_dir.

With launcher="single", the command is:

executable default_args... user_args...

With another launcher, it is:

launcher mpi_options... executable default_args... user_args...

environments are merged into the worker process environment. Values are passed literally without shell expansion. modules and pre_commands are explicitly unsupported for local execution and cause ValueError before the process starts.

Bulk execution

BulkJobSpec supports optional per-job execution_profile_block and hpc_profile_block overrides. None uses the runner/API default blocks. The single-submit bulk paths use these effective blocks for submission and group monitoring by effective hpc_profile_block; native PJM bulk mode rejects per-job block overrides because one generated script/profile is shared by all subjobs.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

qcsc_prefect_executor-0.2.5.tar.gz (50.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

qcsc_prefect_executor-0.2.5-py3-none-any.whl (37.3 kB view details)

Uploaded Python 3

File details

Details for the file qcsc_prefect_executor-0.2.5.tar.gz.

File metadata

  • Download URL: qcsc_prefect_executor-0.2.5.tar.gz
  • Upload date:
  • Size: 50.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for qcsc_prefect_executor-0.2.5.tar.gz
Algorithm Hash digest
SHA256 634c2f438260ddd52e7d835670fd759561e4586f6813545e1795c3a2b61d62c2
MD5 0590bcbcd36a633452281571c609a773
BLAKE2b-256 d7bf5c2f80a7831aa6b7f7fb162e069150e93e419481763cc38df4979fdae801

See more details on using hashes here.

Provenance

The following attestation bundles were made for qcsc_prefect_executor-0.2.5.tar.gz:

Publisher: pypi-publish.yml on qiskit-community/qcsc-prefect

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file qcsc_prefect_executor-0.2.5-py3-none-any.whl.

File metadata

File hashes

Hashes for qcsc_prefect_executor-0.2.5-py3-none-any.whl
Algorithm Hash digest
SHA256 66c3be0a627a34036af00ba29a29359eef5434d228637a5200fe5772c3af84ce
MD5 f07eda83f34581fbad2542a2348506c4
BLAKE2b-256 2371c2fcedef7f9bb4acc8f2ba7efaa11d467a90bdadf8916ede16eb6ae06952

See more details on using hashes here.

Provenance

The following attestation bundles were made for qcsc_prefect_executor-0.2.5-py3-none-any.whl:

Publisher: pypi-publish.yml on qiskit-community/qcsc-prefect

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page