Skip to main content

The distributed parallel computing library hooks for xonsh

If you like the idea click ⭐ on the repo and tweet.

Importantly this provides a substitute 'dworker' command which enables distributed workers to have access to xonsh builtins.

Furthermore, this xontrib adds a 'DSubmitter' context manager for executing a block remotely. Moreover, this also adds a convenience function 'dsubmit()' for creating DSubmitter and Executor instances at the same time.

Thus users may submit distributed jobs with::

with dsubmit('127.0.0.1:8786', rtn='x') as dsub:
    x = $(echo I am elsewhere)
res = dsub.future.result()
print(res)

This is useful for long running or non-blocking jobs.

Installation

To install use pip:

xpip install xontrib-distributed
# or: xpip install -U git+https://github.com/xonsh/xontrib-distributed

Usage

xontrib load distributed
# TODO: what's next?

Releasing your package

  • Bump the version of your package.
  • Create a GitHub release (The release notes are automatically generated as a draft release after each push).
  • And publish with poetry publish --build or twine

Credits

This package was created with xontrib cookiecutter template.

Metadata

Release files for xontrib-distributed 0.0.4

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for xontrib-distributed 0.0.4
File Size Uploaded
xontrib-distributed-0.0.4.tar.gz 4.0 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for xontrib-distributed 0.0.4
File Interpreter ABI Platform
xontrib_distributed-0.0.4-py3-none-any.whl Python 3 none any Details

Total release size: 8.1 kB

Release files / xontrib-distributed-0.0.4.tar.gz

Download URL xontrib-distributed-0.0.4.tar.gz
Size 4.0 kB
Tags Source
SHA-256 checksum
How to use checksums
a1e8543b5cc18d661ba32c25a1296048a8dbff8cb1a9b61c888304e359d3ee4e
BLAKE2b-256 checksum
How to use checksums
d11fc6f7a597c66a96e3eb94a2db3640492b5a58ccec45a9aa04fa40718974df
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/1.1.13 CPython/3.10.2 Darwin/21.4.0

Release files / xontrib_distributed-0.0.4-py3-none-any.whl

Download URL xontrib_distributed-0.0.4-py3-none-any.whl
Size 4.1 kB
Tags Python 3
SHA-256 checksum
How to use checksums
e1ee19a521d64f1c425edf3f0245cecb15cd0dae6bccd17433c9cbe352c52f0f
BLAKE2b-256 checksum
How to use checksums
6c5a20d0cd6ec53ac4513fc9db64fb213aafb153a9125268a9aade547d3e138c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/1.1.13 CPython/3.10.2 Darwin/21.4.0

Release history Release notifications | RSS feed

This release

0.0.4 This release

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page