Generate HPC scheduler systems jobs input scripts, submit these scripts to HPC systems, and poke until they finish

Navigation

Verified details

These details have been verified by PyPI
Project links
Owner
GitHub Statistics
Maintainers
Avatar for amcadmus from gravatar.com amcadmus Avatar for yfb222333 from gravatar.com yfb222333

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: GNU Lesser General Public License v3 (LGPLv3) (GNU LESSER GENERAL PUBLIC LICENSE)
  • Author: DeepModeling
  • Tags dispatcher , hpc , slurm , lsf , pbs , ssh , jh_unischeduler
  • Requires: Python >=3.7
  • Provides-Extra: docs , cloudserver , bohrium , gui , test
Classifiers
Report project as malware

Project description

DPDispatcher

conda-forge pip install docker pull Documentation Status

DPDispatcher is a Python package used to generate HPC (High-Performance Computing) scheduler systems (Slurm/PBS/LSF/Bohrium) jobs input scripts, submit them to HPC systems, and poke until they finish.

DPDispatcher will monitor (poke) until these jobs finish and download the results files (if these jobs are running on remote systems connected by SSH).

For more information, check the documentation.

Credits

Please cite the following paper if you use this project in your work:

  • Fengbo Yuan, Zhaohan Ding, Yun-Pei Liu, Kai Cao, Jiahao Fan, Cao Thang Nguyen, Yuzhi Zhang, Haidi Wang, Yixiao Chen, Jiameng Huang, Tongqi Wen, Mingkang Liu, Yifan Li, Yong-Bin Zhuang, Hao Yu, Ping Tuo, Yaotang Zhang, Yibo Wang, Linfeng Zhang, Han Wang, Jinzhe Zeng, DPDispatcher: Scalable HPC Task Scheduling for AI-Driven Science, J. Chem. Inf. Model., 2025, DOI: 10.1021/acs.jcim.5c02081. Citations

This project was separated out from the DP-GEN project (Section 3.3 in its paper) to be used by more workflow software.

Installation

DPDispatcher can be installed by pip:

pip install dpdispatcher

To add Bohrium support, execute

pip install dpdispatcher[bohrium]

Usage

See Getting Started for usage.

Contributing

DPDispatcher is maintained by DeepModeling's developers and welcomes other people. See Contributing Guide to become a contributor! 🤓

Project details

Verified details

These details have been verified by PyPI
Project links
Owner
GitHub Statistics
Maintainers
Avatar for amcadmus from gravatar.com amcadmus Avatar for yfb222333 from gravatar.com yfb222333

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: GNU Lesser General Public License v3 (LGPLv3) (GNU LESSER GENERAL PUBLIC LICENSE)
  • Author: DeepModeling
  • Tags dispatcher , hpc , slurm , lsf , pbs , ssh , jh_unischeduler
  • Requires: Python >=3.7
  • Provides-Extra: docs , cloudserver , bohrium , gui , test
Classifiers

Release history Release notifications | RSS feed

This version

1.0.3

1.0.2

1.0.1

1.0.0

0.6.12

0.6.11

0.6.10

0.6.9

0.6.8

0.6.7

0.6.6

0.6.5

0.6.4

0.6.3

0.6.2

0.6.1

0.6.0

0.5.11

0.5.10

0.5.9

0.5.8

0.5.7

0.5.6

0.5.5

0.5.4

0.5.3

0.5.2

0.5.1

0.5.0

0.4.19

0.4.18

0.4.17

0.4.16

0.4.15

0.4.14

0.4.13

0.4.12

0.4.11

0.4.10

0.4.9

0.4.8

0.4.7

0.4.6

0.4.5

0.4.4

0.4.3

0.4.2

0.4.1

0.4.0

0.3.46

0.3.45

0.3.44

0.3.43

0.3.42

0.3.41

0.3.40

0.3.39

0.3.38

0.3.37

0.3.36

0.3.35

0.3.34

0.3.33

0.3.30

0.3.29

0.3.28

0.3.27

0.3.26

0.3.25

0.3.24

0.3.23

0.3.22

0.3.21

0.3.20

0.3.19

0.3.18

0.3.17

0.3.16

0.3.15

0.3.14

0.3.13

0.3.12

0.3.11

0.3.10

0.3.9

0.3.8

0.3.7

0.3.6

0.3.5

0.3.4

0.3.3

0.3.2

0.3.1

0.3.0

0.2.8

0.2.7

0.2.6

0.2.5

0.2.4

0.2.3

0.2.2

0.2.1

0.1.1

0.1.0

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dpdispatcher-1.0.3.tar.gz (142.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

dpdispatcher-1.0.3-py3-none-any.whl (92.4 kB view details)

Uploaded Python 3

File details

Details for the file dpdispatcher-1.0.3.tar.gz.

File metadata

  • Download URL: dpdispatcher-1.0.3.tar.gz
  • Upload date:
  • Size: 142.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for dpdispatcher-1.0.3.tar.gz
Algorithm Hash digest
SHA256 dc81bc8810a34fdc0a1ab28a2d12b6388ce76a042eb34faa83c9dce4c4377ada
MD5 028bb6348970486c26e5b63621c12739
BLAKE2b-256 a25e128a0cabf65cbc17811972f2d17685877ac5bd49d75e96e0f959b31c94e0

See more details on using hashes here.

Provenance

The following attestation bundles were made for dpdispatcher-1.0.3.tar.gz:

Publisher: release.yml on deepmodeling/dpdispatcher

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file dpdispatcher-1.0.3-py3-none-any.whl.

File metadata

  • Download URL: dpdispatcher-1.0.3-py3-none-any.whl
  • Upload date:
  • Size: 92.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for dpdispatcher-1.0.3-py3-none-any.whl
Algorithm Hash digest
SHA256 b46c8b599d0dce64093e8f8e181091dba7daae07f049195e71f4ba24f62f4d91
MD5 71d1154dedff0dd164e68842e7368242
BLAKE2b-256 75468a64283a37660b2b01c069d09b1f44fccefc1356b4bbf6d9245db4f8d410

See more details on using hashes here.

Provenance

The following attestation bundles were made for dpdispatcher-1.0.3-py3-none-any.whl:

Publisher: release.yml on deepmodeling/dpdispatcher

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page